2024-02-15T17:57:30.183 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-15T17:57:30.183 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660 --name lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi --owner scheduled_lflores@teuthology --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} --verbose -- /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660/orig.config.yaml 2024-02-15T17:57:30.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T17:57:30.326 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660 branch: wip-yuri10-testing-2024-02-08-0854-pacific description: rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} email: null first_in_suite: false job_id: '7561660' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific v16.2.4 ' name: lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri10-testing-2024-02-08-0854-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(PG_DEGRADED\) - Degraded data redundancy - \(PG_ - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-tracker-64343-pacific sha1: bedfc49c6a823fb0ff75911e476e1f3cb464ad3e owner: scheduled_lflores@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 964 sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-tracker-64343-pacific suite_path: /home/teuthworker/src/github.com_ljflores_ceph_bedfc49c6a823fb0ff75911e476e1f3cb464ad3e/qa suite_relpath: qa suite_repo: https://github.com/ljflores/ceph.git suite_sha1: bedfc49c6a823fb0ff75911e476e1f3cb464ad3e targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZPgHaUoLtL8aDy5AByyeDx0k5ZIAoC1tf93FmE2SamUbpB3wb278hdHxbS4TWDGB627OiN7VApJOz6essezVA= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/0zTmiEH8TOSIkYV9BIk+QNwqG+O3IcutFNQ4xYzIssbN1fiQAeQ3QY2nJ/zNInxNUBPJLj60aqIdr4BLUDnQ= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - pexec: clients: - sudo modprobe -r ceph - sudo modprobe ceph disable_send_metrics=on - install: exclude_packages: - ceph-volume tag: v16.2.4 - print: '**** done install task...' - cephadm: avoid_pacific_features: true cephadm_branch: v16.2.4 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v16.2.4 roleless: true - print: '**** done starting v16.2.4' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-15_17:32:20 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: lflores verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-15T17:57:30.326 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ljflores_ceph_bedfc49c6a823fb0ff75911e476e1f3cb464ad3e/qa; will attempt to use it 2024-02-15T17:57:30.327 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ljflores_ceph_bedfc49c6a823fb0ff75911e476e1f3cb464ad3e/qa/tasks 2024-02-15T17:57:30.327 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-15T17:57:30.329 INFO:teuthology.task.internal:Checking packages... 2024-02-15T17:57:30.352 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0e714d9a4bd2a821113e6318adb87bd06cf81ec1' 2024-02-15T17:57:30.352 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T17:57:30.352 INFO:teuthology.packaging:ref: None 2024-02-15T17:57:30.352 INFO:teuthology.packaging:tag: None 2024-02-15T17:57:30.352 INFO:teuthology.packaging:branch: wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-15T17:57:30.352 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T17:57:30.353 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-15T17:57:30.749 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-521.g0e714d9a 2024-02-15T17:57:30.750 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-15T17:57:30.757 INFO:teuthology.task.internal:no buildpackages task found 2024-02-15T17:57:30.757 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-15T17:57:30.764 INFO:teuthology.task.internal:Saving configuration 2024-02-15T17:57:30.783 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-15T17:57:30.789 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T17:57:30.813 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 17:52:18.261729', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZPgHaUoLtL8aDy5AByyeDx0k5ZIAoC1tf93FmE2SamUbpB3wb278hdHxbS4TWDGB627OiN7VApJOz6essezVA='} 2024-02-15T17:57:30.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 17:52:18.259829', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/0zTmiEH8TOSIkYV9BIk+QNwqG+O3IcutFNQ4xYzIssbN1fiQAeQ3QY2nJ/zNInxNUBPJLj60aqIdr4BLUDnQ='} 2024-02-15T17:57:30.839 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-15T17:57:30.846 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-15T17:57:30.846 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-15T17:57:30.846 INFO:teuthology.run_tasks:Running task console_log... 2024-02-15T17:57:30.918 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa32054df70>, signals=[15]) 2024-02-15T17:57:30.918 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-15T17:57:30.924 INFO:teuthology.task.internal:Opening connections... 2024-02-15T17:57:30.924 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T17:57:30.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T17:57:30.999 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T17:57:31.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T17:57:31.076 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-15T17:57:31.083 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-02-15T17:57:31.106 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-02-15T17:57:31.106 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-02-15T17:57:31.167 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-02-15T17:57:31.167 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2024-02-15T17:57:31.167 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-02-15T17:57:31.167 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-02-15T17:57:31.167 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2024-02-15T17:57:31.168 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2024-02-15T17:57:31.168 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-15T17:57:31.168 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-02-15T17:57:31.168 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-15T17:57:31.168 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-02-15T17:57:31.168 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T17:57:31.168 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-15T17:57:31.168 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T17:57:31.169 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-02-15T17:57:31.189 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-02-15T17:57:31.211 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-02-15T17:57:31.211 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-02-15T17:57:31.272 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-02-15T17:57:31.272 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-02-15T17:57:31.272 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-15T17:57:31.273 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T17:57:31.274 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-02-15T17:57:31.297 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-15T17:57:31.306 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-15T17:57:31.339 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-15T17:57:31.339 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-02-15T17:57:31.342 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-02-15T17:57:31.363 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-15T17:57:31.369 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-15T17:57:31.369 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-02-15T17:57:31.403 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-02-15T17:57:31.439 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-15T17:57:31.491 INFO:teuthology.run_tasks:Running task kernel... 2024-02-15T17:57:31.505 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-15T17:57:31.505 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-15T17:57:31.506 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T17:57:31.506 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T17:57:31.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T17:57:31.526 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-02-15T17:57:31.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T17:57:31.528 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-02-15T17:57:31.587 INFO:teuthology.orchestra.run.smithi133.stdout:4.18.0-489.el8.x86_64 2024-02-15T17:57:31.587 INFO:teuthology.task.kernel:Running kernel on smithi133: 4.18.0-489.el8.x86_64 2024-02-15T17:57:31.587 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum install -y kernel 2024-02-15T17:57:31.588 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-489.el8.x86_64 2024-02-15T17:57:31.589 INFO:teuthology.task.kernel:Running kernel on smithi084: 4.18.0-489.el8.x86_64 2024-02-15T17:57:31.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2024-02-15T17:58:02.084 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - AppStream 1.0 MB/s | 27 MB 00:27 2024-02-15T17:58:07.491 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - BaseOS 18 MB/s | 10 MB 00:00 2024-02-15T17:58:09.833 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras 25 kB/s | 18 kB 00:00 2024-02-15T17:58:10.525 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2024-02-15T17:58:10.785 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-02-15T17:58:12.035 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-02-15T17:58:15.820 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 389 kB/s | 24 kB 00:00 2024-02-15T17:58:18.790 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-15T17:58:18.790 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-15T17:58:18.896 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T17:58:18.897 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T17:58:18.897 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T17:58:18.897 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T17:58:18.897 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T17:58:18.897 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-15T17:58:18.897 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T17:58:18.897 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-15T17:58:18.898 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-15T17:58:18.898 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T17:58:18.898 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T17:58:18.898 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T17:58:18.898 INFO:teuthology.orchestra.run.smithi084.stdout:Install 3 Packages 2024-02-15T17:58:18.898 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T17:58:18.898 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 90 M 2024-02-15T17:58:18.899 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 97 M 2024-02-15T17:58:18.899 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T17:58:19.156 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - AppStream 618 kB/s | 27 MB 00:45 2024-02-15T17:58:19.324 INFO:teuthology.orchestra.run.smithi084.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 27 MB/s | 10 MB 00:00 2024-02-15T17:58:19.978 INFO:teuthology.orchestra.run.smithi084.stdout:(2/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 35 MB/s | 36 MB 00:01 2024-02-15T17:58:20.428 INFO:teuthology.orchestra.run.smithi084.stdout:(3/3): kernel-core-4.18.0-539.el8.x86_64.rpm 29 MB/s | 43 MB 00:01 2024-02-15T17:58:20.429 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T17:58:20.429 INFO:teuthology.orchestra.run.smithi084.stdout:Total 58 MB/s | 90 MB 00:01 2024-02-15T17:58:21.111 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T17:58:21.529 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T17:58:21.529 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T17:58:22.779 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T17:58:22.804 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T17:58:24.548 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 10 MB 00:00 2024-02-15T17:58:25.584 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T17:58:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-15T17:58:26.423 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - Extras 66 kB/s | 18 kB 00:00 2024-02-15T17:58:26.924 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2024-02-15T17:58:27.192 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2024-02-15T17:58:28.770 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-02-15T17:58:29.665 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-15T17:58:30.052 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-15T17:58:32.509 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 401 kB/s | 24 kB 00:00 2024-02-15T17:58:33.483 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-15T17:58:33.775 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:58:35.564 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-15T17:58:35.564 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-15T17:58:35.679 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T17:58:35.679 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T17:58:35.679 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout:Install 3 Packages 2024-02-15T17:58:35.680 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T17:58:35.681 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 90 M 2024-02-15T17:58:35.681 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 97 M 2024-02-15T17:58:35.681 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T17:58:36.102 INFO:teuthology.orchestra.run.smithi133.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 27 MB/s | 10 MB 00:00 2024-02-15T17:58:36.752 INFO:teuthology.orchestra.run.smithi133.stdout:(2/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 35 MB/s | 36 MB 00:01 2024-02-15T17:58:37.203 INFO:teuthology.orchestra.run.smithi133.stdout:(3/3): kernel-core-4.18.0-539.el8.x86_64.rpm 29 MB/s | 43 MB 00:01 2024-02-15T17:58:37.203 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T17:58:37.203 INFO:teuthology.orchestra.run.smithi133.stdout:Total 59 MB/s | 90 MB 00:01 2024-02-15T17:58:37.886 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T17:58:38.325 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T17:58:38.325 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T17:58:39.567 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T17:58:39.609 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T17:58:42.392 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T17:58:42.900 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-15T17:58:46.489 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-15T17:58:46.875 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-15T17:58:50.306 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-15T17:58:50.639 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:58:55.856 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:58:55.879 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:58:56.245 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:58:56.245 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-15T17:58:56.245 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-15T17:58:56.745 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:58:56.745 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T17:58:56.745 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T17:58:56.745 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-15T17:58:56.745 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-15T17:58:56.745 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T17:58:56.746 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T17:58:56.900 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T17:58:57.117 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-15T17:58:57.117 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-15T17:58:57.117 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-15T17:58:57.117 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T17:58:57.117 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T17:58:57.117 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-15T17:58:57.118 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T17:58:57.118 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T17:58:57.328 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-15T17:58:57.328 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-15T17:58:57.328 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2024-02-15T17:58:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2024-02-15T17:58:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2024-02-15T17:58:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.02 2024-02-15T17:58:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 129.el8 2024-02-15T17:58:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2024-02-15T17:58:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-15T17:58:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Group : System Environment/Base 2024-02-15T17:58:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 9265586 2024-02-15T17:58:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Relocations : (not relocatable) 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : CentOS BuildSystem 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2024-02-15T17:58:57.363 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T17:58:57.364 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T17:58:57.364 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T17:58:57.365 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 4.18.0-539.el8.x86_64 2024-02-15T17:58:57.365 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T17:58:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-02-15T17:59:01.721 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-02-15T17:59:01.722 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-02-15T17:59:01.757 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.3GzCfLGJMN 2024-02-15T17:59:01.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3GzCfLGJMN 2024-02-15T17:59:01.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.3GzCfLGJMN 2024-02-15T17:59:01.975 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.3GzCfLGJMN is 6KB 2024-02-15T17:59:02.024 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.3GzCfLGJMN 2024-02-15T17:59:02.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T17:59:02.116 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-15T17:59:02.116 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-15T17:59:02.116 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-15T17:59:02.116 INFO:teuthology.orchestra.run.smithi084.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-15T17:59:02.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-15T17:59:02.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-02-15T17:59:12.366 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:59:12.390 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:59:12.746 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:59:12.746 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-15T17:59:12.746 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-15T17:59:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-15T17:59:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T17:59:13.260 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T17:59:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-15T17:59:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-15T17:59:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T17:59:13.260 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T17:59:13.425 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T17:59:13.640 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-15T17:59:13.640 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-15T17:59:13.640 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-15T17:59:13.640 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T17:59:13.640 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T17:59:13.641 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-15T17:59:13.641 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T17:59:13.641 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T17:59:13.853 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-15T17:59:13.853 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-15T17:59:13.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo rpm -qi grub2-tools 2024-02-15T17:59:13.886 INFO:teuthology.orchestra.run.smithi133.stdout:Name : grub2-tools 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Epoch : 1 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Version : 2.02 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Release : 129.el8 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: x86_64 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Group : System Environment/Base 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Size : 9265586 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:License : GPLv3+ 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-15T17:59:13.887 INFO:teuthology.orchestra.run.smithi133.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:Relocations : (not relocatable) 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:Packager : CentOS BuildSystem 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:Vendor : CentOS 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:Summary : Support tools for GRUB. 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:Description : 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T17:59:13.888 INFO:teuthology.orchestra.run.smithi133.stdout:hardware devices. 2024-02-15T17:59:13.889 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T17:59:13.889 INFO:teuthology.orchestra.run.smithi133.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T17:59:13.890 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T17:59:13.890 INFO:teuthology.task.kernel:Updating grub on smithi133 to boot 4.18.0-539.el8.x86_64 2024-02-15T17:59:13.890 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T17:59:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2024-02-15T17:59:18.043 INFO:teuthology.orchestra.run.smithi133.stderr:done 2024-02-15T17:59:18.044 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-02-15T17:59:18.067 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.xyVI1xJfBT 2024-02-15T17:59:18.067 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xyVI1xJfBT 2024-02-15T17:59:18.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.xyVI1xJfBT 2024-02-15T17:59:18.299 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.xyVI1xJfBT is 6KB 2024-02-15T17:59:18.347 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.xyVI1xJfBT 2024-02-15T17:59:18.365 DEBUG:teuthology.orchestra.run.smithi133:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T17:59:18.440 INFO:teuthology.orchestra.run.smithi133.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-15T17:59:18.440 INFO:teuthology.orchestra.run.smithi133.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-15T17:59:18.440 INFO:teuthology.orchestra.run.smithi133.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-15T17:59:18.440 INFO:teuthology.orchestra.run.smithi133.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-15T17:59:18.441 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-15T17:59:18.594 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2024-02-15T17:59:32.310 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-15T17:59:32.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-15T17:59:32.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T17:59:48.612 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-15T17:59:48.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T17:59:48.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:00:06.972 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-15T18:00:15.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T18:00:15.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:00:19.036 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-15T18:00:31.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T18:00:31.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:00:32.315 DEBUG:teuthology.orchestra.remote:timed out 2024-02-15T18:00:41.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-15T18:00:41.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:00:41.688 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-02-15T18:00:41.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-15T18:00:41.963 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-539.el8.x86_64"... 2024-02-15T18:00:41.964 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-02-15T18:00:41.980 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-539.el8.x86_64 2024-02-15T18:00:41.980 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-15T18:00:41.980 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T18:00:41.981 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T18:00:42.981 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-15T18:00:42.982 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T18:00:43.065 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2024-02-15T18:00:43.082 DEBUG:teuthology.parallel:result is None 2024-02-15T18:00:49.468 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-02-15T18:01:04.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T18:01:04.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:01:05.312 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-02-15T18:01:06.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T18:01:06.088 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-539.el8.x86_64"... 2024-02-15T18:01:06.089 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-02-15T18:01:06.105 INFO:teuthology.orchestra.run.smithi133.stdout:4.18.0-539.el8.x86_64 2024-02-15T18:01:06.106 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-15T18:01:06.106 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T18:01:06.106 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T18:01:07.107 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-15T18:01:07.107 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T18:01:07.186 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2024-02-15T18:01:07.201 DEBUG:teuthology.parallel:result is None 2024-02-15T18:01:07.202 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-15T18:01:07.210 INFO:teuthology.task.internal:Creating test directory... 2024-02-15T18:01:07.211 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T18:01:07.214 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T18:01:07.235 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-15T18:01:07.241 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-15T18:01:07.249 INFO:teuthology.task.internal:Creating archive directory... 2024-02-15T18:01:07.249 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T18:01:07.278 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T18:01:07.339 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-15T18:01:07.346 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-15T18:01:07.347 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T18:01:07.357 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T18:01:07.391 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T18:01:07.400 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T18:01:07.402 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T18:01:07.413 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T18:01:07.414 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-15T18:01:07.422 INFO:teuthology.task.internal:Configuring sudo... 2024-02-15T18:01:07.422 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T18:01:07.424 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T18:01:07.469 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-15T18:01:07.478 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-15T18:01:07.478 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T18:01:07.493 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T18:01:07.527 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T18:01:07.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T18:01:07.644 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T18:01:07.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T18:01:07.772 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:01:07.772 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T18:01:07.839 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T18:01:07.883 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T18:01:07.936 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T18:01:08.019 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T18:01:08.062 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:01:08.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T18:01:08.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-02-15T18:01:08.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-02-15T18:01:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T18:01:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T18:01:08.658 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-15T18:01:08.666 INFO:teuthology.task.internal:Starting timer... 2024-02-15T18:01:08.666 INFO:teuthology.run_tasks:Running task pcp... 2024-02-15T18:01:08.677 INFO:teuthology.run_tasks:Running task selinux... 2024-02-15T18:01:08.684 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-15T18:01:08.685 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-02-15T18:01:08.752 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-02-15T18:01:08.754 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2024-02-15T18:01:08.832 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2024-02-15T18:01:08.834 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-15T18:01:08.834 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-02-15T18:01:08.881 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-02-15T18:01:08.881 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2024-02-15T18:01:08.932 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2024-02-15T18:01:08.933 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive'} 2024-02-15T18:01:08.933 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T18:01:08.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:01:08.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T18:01:08.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:01:08.988 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-15T18:01:08.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-02-15T18:01:09.028 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2024-02-15T18:01:09.055 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-15T18:01:09.066 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-15T18:01:09.084 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-15T18:01:09.085 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-15T18:09:14.427 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2024-02-15T18:09:14.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-15T18:09:14.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:09:14.505 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-02-15T18:09:14.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-02-15T18:09:14.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T18:09:14.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:09:14.651 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-02-15T18:09:14.719 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-02-15T18:09:14.720 INFO:teuthology.run_tasks:Running task clock... 2024-02-15T18:09:14.730 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-15T18:09:14.730 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T18:09:14.731 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T18:09:14.733 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T18:09:14.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T18:09:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T18:09:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T18:09:14.794 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T18:09:14.808 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T18:09:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-02-15T18:09:14.847 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-02-15T18:09:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T18:09:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T18:09:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2024-02-15T18:09:14.890 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2024-02-15T18:09:14.904 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T18:09:14.917 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T18:09:14.937 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2024-02-15T18:09:14.941 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T18:09:14.941 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-02-15T18:09:14.941 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:09:14.941 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:09:14.941 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:09:14.941 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:09:14.981 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2024-02-15T18:09:14.986 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T18:09:14.986 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-02-15T18:09:14.986 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:09:14.986 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:09:14.986 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:09:14.986 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:09:14.987 INFO:teuthology.run_tasks:Running task pexec... 2024-02-15T18:09:14.996 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-15T18:09:14.996 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:09:14.996 DEBUG:teuthology.orchestra.run.smithi084:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-15T18:09:14.997 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T18:09:14.997 DEBUG:teuthology.orchestra.run.smithi133:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-15T18:09:15.780 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:43 ago on Thu 15 Feb 2024 06:05:32 PM UTC. 2024-02-15T18:09:15.810 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:03:43 ago on Thu 15 Feb 2024 06:05:32 PM UTC. 2024-02-15T18:09:17.842 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:09:17.843 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:09:17.843 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T18:09:17.843 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:09:17.843 INFO:teuthology.orchestra.run.smithi084.stdout:Resetting modules: 2024-02-15T18:09:17.843 INFO:teuthology.orchestra.run.smithi084.stdout: container-tools 2024-02-15T18:09:17.843 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:09:17.843 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:09:17.843 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:09:17.843 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:09:17.859 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:09:17.860 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:09:17.860 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T18:09:17.861 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:09:17.861 INFO:teuthology.orchestra.run.smithi133.stdout:Resetting modules: 2024-02-15T18:09:17.861 INFO:teuthology.orchestra.run.smithi133.stdout: container-tools 2024-02-15T18:09:17.861 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:09:17.861 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:09:17.861 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:09:17.862 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:09:18.093 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:09:18.107 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:09:18.940 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:46 ago on Thu 15 Feb 2024 06:05:32 PM UTC. 2024-02-15T18:09:18.959 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:03:46 ago on Thu 15 Feb 2024 06:05:32 PM UTC. 2024-02-15T18:09:20.960 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:09:20.996 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout:Installing group/module packages: 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: crun x86_64 1.14-1.module_el8+871+552be958 appstream 257 k 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: netavark x86_64 2:1.10.2-1.module_el8+885+7da147f3 appstream 4.3 M 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T18:09:20.997 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout:Installing module profiles: 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: container-tools/common 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling module streams: 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: container-tools rhel8 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout:Install 13 Packages 2024-02-15T18:09:20.998 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:09:20.999 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 28 M 2024-02-15T18:09:20.999 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 92 M 2024-02-15T18:09:20.999 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:09:21.007 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:09:21.042 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:09:21.042 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T18:09:21.042 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:09:21.042 INFO:teuthology.orchestra.run.smithi133.stdout:Installing group/module packages: 2024-02-15T18:09:21.042 INFO:teuthology.orchestra.run.smithi133.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: crun x86_64 1.14-1.module_el8+871+552be958 appstream 257 k 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: netavark x86_64 2:1.10.2-1.module_el8+885+7da147f3 appstream 4.3 M 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout:Installing weak dependencies: 2024-02-15T18:09:21.043 INFO:teuthology.orchestra.run.smithi133.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout:Installing module profiles: 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout: container-tools/common 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout:Enabling module streams: 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout: container-tools rhel8 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout:Install 13 Packages 2024-02-15T18:09:21.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:09:21.045 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 28 M 2024-02-15T18:09:21.045 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 92 M 2024-02-15T18:09:21.045 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:09:27.652 INFO:teuthology.orchestra.run.smithi084.stdout:(1/13): cockpit-podman-83-1.module_el8+847+7863 106 kB/s | 688 kB 00:06 2024-02-15T18:09:27.711 INFO:teuthology.orchestra.run.smithi084.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 653 kB/s | 38 kB 00:00 2024-02-15T18:09:27.794 INFO:teuthology.orchestra.run.smithi084.stdout:(3/13): aardvark-dns-1.10.0-1.module_el8+871+55 156 kB/s | 1.0 MB 00:06 2024-02-15T18:09:27.878 INFO:teuthology.orchestra.run.smithi084.stdout:(4/13): crun-1.14-1.module_el8+871+552be958.x86 1.5 MB/s | 257 kB 00:00 2024-02-15T18:09:27.995 INFO:teuthology.orchestra.run.smithi084.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 1.5 MB/s | 180 kB 00:00 2024-02-15T18:09:28.070 INFO:teuthology.orchestra.run.smithi084.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 330 kB/s | 25 kB 00:00 2024-02-15T18:09:28.154 INFO:teuthology.orchestra.run.smithi084.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.1 MB/s | 94 kB 00:00 2024-02-15T18:09:29.786 INFO:teuthology.orchestra.run.smithi084.stdout:(8/13): netavark-1.10.2-1.module_el8+885+7da147 2.2 MB/s | 4.3 MB 00:01 2024-02-15T18:09:30.979 INFO:teuthology.orchestra.run.smithi084.stdout:(9/13): toolbox-0.0.99.5-1.module_el8+847+7863d 2.1 MB/s | 2.5 MB 00:01 2024-02-15T18:09:31.037 INFO:teuthology.orchestra.run.smithi084.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 903 kB/s | 53 kB 00:00 2024-02-15T18:09:31.096 INFO:teuthology.orchestra.run.smithi084.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 702 kB/s | 41 kB 00:00 2024-02-15T18:09:31.729 INFO:teuthology.orchestra.run.smithi084.stdout:(12/13): buildah-1.33.5-1.module_el8+885+7da147 938 kB/s | 9.7 MB 00:10 2024-02-15T18:09:32.263 INFO:teuthology.orchestra.run.smithi084.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 2.1 MB/s | 8.8 MB 00:04 2024-02-15T18:09:32.263 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:09:32.263 INFO:teuthology.orchestra.run.smithi084.stdout:Total 2.5 MB/s | 28 MB 00:11 2024-02-15T18:09:32.536 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:09:32.557 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:09:32.557 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:09:32.825 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:09:32.828 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:09:33.512 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:09:34.755 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-15T18:09:34.939 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-02-15T18:09:35.134 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-02-15T18:09:35.308 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-02-15T18:09:35.544 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-02-15T18:09:36.106 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-02-15T18:09:37.047 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 7/13 2024-02-15T18:09:37.261 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 8/13 2024-02-15T18:09:37.465 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : crun-1.14-1.module_el8+871+552be958.x86_64 9/13 2024-02-15T18:09:37.900 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-02-15T18:09:38.127 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-15T18:09:38.325 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-15T18:09:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-15T18:09:38.950 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-15T18:09:38.950 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : crun-1.14-1.module_el8+871+552be958.x86_64 5/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 6/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-15T18:09:38.951 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-15T18:09:39.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: crun-1.14-1.module_el8+871+552be958.x86_64 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-15T18:09:39.471 INFO:teuthology.orchestra.run.smithi084.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-15T18:09:39.472 INFO:teuthology.orchestra.run.smithi084.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-15T18:09:39.472 INFO:teuthology.orchestra.run.smithi084.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-15T18:09:39.472 INFO:teuthology.orchestra.run.smithi084.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-15T18:09:39.472 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:09:39.472 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:09:39.775 DEBUG:teuthology.parallel:result is None 2024-02-15T18:11:31.841 INFO:teuthology.orchestra.run.smithi133.stdout:[MIRROR] aardvark-dns-1.10.0-1.module_el8+871+552be958.x86_64.rpm: Curl error (7): Couldn't connect to server for http://packages.oit.ncsu.edu/centos/8-stream/AppStream/x86_64/os/Packages/aardvark-dns-1.10.0-1.module_el8%2b871%2b552be958.x86_64.rpm [Failed to connect to packages.oit.ncsu.edu port 80: Connection timed out] 2024-02-15T18:11:31.841 INFO:teuthology.orchestra.run.smithi133.stdout:[MIRROR] buildah-1.33.5-1.module_el8+885+7da147f3.x86_64.rpm: Curl error (7): Couldn't connect to server for http://packages.oit.ncsu.edu/centos/8-stream/AppStream/x86_64/os/Packages/buildah-1.33.5-1.module_el8%2b885%2b7da147f3.x86_64.rpm [Failed to connect to packages.oit.ncsu.edu port 80: Connection timed out] 2024-02-15T18:11:31.841 INFO:teuthology.orchestra.run.smithi133.stdout:[MIRROR] cockpit-podman-83-1.module_el8+847+7863d4e6.noarch.rpm: Curl error (7): Couldn't connect to server for http://packages.oit.ncsu.edu/centos/8-stream/AppStream/x86_64/os/Packages/cockpit-podman-83-1.module_el8%2b847%2b7863d4e6.noarch.rpm [Failed to connect to packages.oit.ncsu.edu port 80: Connection timed out] 2024-02-15T18:11:32.016 INFO:teuthology.orchestra.run.smithi133.stdout:(1/13): aardvark-dns-1.10.0-1.module_el8+871+55 7.9 kB/s | 1.0 MB 02:10 2024-02-15T18:11:32.042 INFO:teuthology.orchestra.run.smithi133.stdout:(2/13): cockpit-podman-83-1.module_el8+847+7863 5.3 kB/s | 688 kB 02:10 2024-02-15T18:11:32.058 INFO:teuthology.orchestra.run.smithi133.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 908 kB/s | 38 kB 00:00 2024-02-15T18:11:32.109 INFO:teuthology.orchestra.run.smithi133.stdout:(4/13): crun-1.14-1.module_el8+871+552be958.x86 3.8 MB/s | 257 kB 00:00 2024-02-15T18:11:32.262 INFO:teuthology.orchestra.run.smithi133.stdout:(5/13): netavark-1.10.2-1.module_el8+885+7da147 21 MB/s | 4.3 MB 00:00 2024-02-15T18:11:32.293 INFO:teuthology.orchestra.run.smithi133.stdout:(6/13): python3-podman-4.9.0-1.module_el8+847+7 982 kB/s | 180 kB 00:00 2024-02-15T18:11:32.327 INFO:teuthology.orchestra.run.smithi133.stdout:(7/13): python3-pytoml-0.1.14-5.git7dea353.el8. 384 kB/s | 25 kB 00:00 2024-02-15T18:11:32.352 INFO:teuthology.orchestra.run.smithi133.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.6 MB/s | 94 kB 00:00 2024-02-15T18:11:32.461 INFO:teuthology.orchestra.run.smithi133.stdout:(9/13): buildah-1.33.5-1.module_el8+885+7da147f 75 kB/s | 9.7 MB 02:11 2024-02-15T18:11:32.503 INFO:teuthology.orchestra.run.smithi133.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 1.2 MB/s | 53 kB 00:00 2024-02-15T18:11:32.553 INFO:teuthology.orchestra.run.smithi133.stdout:(11/13): toolbox-0.0.99.5-1.module_el8+847+7863 13 MB/s | 2.5 MB 00:00 2024-02-15T18:11:32.578 INFO:teuthology.orchestra.run.smithi133.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 547 kB/s | 41 kB 00:00 2024-02-15T18:11:32.695 INFO:teuthology.orchestra.run.smithi133.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 24 MB/s | 8.8 MB 00:00 2024-02-15T18:11:32.696 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:11:32.696 INFO:teuthology.orchestra.run.smithi133.stdout:Total 215 kB/s | 28 MB 02:11 2024-02-15T18:11:32.961 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:11:32.982 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:11:32.982 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:11:33.243 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:11:33.246 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:11:33.951 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:11:34.928 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-15T18:11:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-02-15T18:11:35.312 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-02-15T18:11:35.522 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-02-15T18:11:35.747 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-02-15T18:11:36.332 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-02-15T18:11:37.306 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 7/13 2024-02-15T18:11:37.546 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 8/13 2024-02-15T18:11:37.757 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : crun-1.14-1.module_el8+871+552be958.x86_64 9/13 2024-02-15T18:11:38.177 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-02-15T18:11:38.378 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-15T18:11:38.605 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-15T18:11:38.794 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-15T18:11:39.215 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-15T18:11:39.216 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-02-15T18:11:39.216 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/13 2024-02-15T18:11:39.216 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/13 2024-02-15T18:11:39.216 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-15T18:11:39.216 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : crun-1.14-1.module_el8+871+552be958.x86_64 5/13 2024-02-15T18:11:39.217 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 6/13 2024-02-15T18:11:39.217 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-02-15T18:11:39.217 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-15T18:11:39.217 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-15T18:11:39.217 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-02-15T18:11:39.217 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-15T18:11:39.217 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-15T18:11:39.944 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-15T18:11:39.944 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:11:39.944 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:11:39.944 INFO:teuthology.orchestra.run.smithi133.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: crun-1.14-1.module_el8+871+552be958.x86_64 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:11:39.945 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:11:40.212 DEBUG:teuthology.parallel:result is None 2024-02-15T18:11:40.212 INFO:teuthology.run_tasks:Running task pexec... 2024-02-15T18:11:40.222 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-15T18:11:40.222 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:11:40.223 DEBUG:teuthology.orchestra.run.smithi084:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-15T18:11:40.223 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T18:11:40.223 DEBUG:teuthology.orchestra.run.smithi133:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-15T18:11:40.375 DEBUG:teuthology.parallel:result is None 2024-02-15T18:11:40.422 DEBUG:teuthology.parallel:result is None 2024-02-15T18:11:40.422 INFO:teuthology.run_tasks:Running task install... 2024-02-15T18:11:40.431 DEBUG:teuthology.task.install:project ceph 2024-02-15T18:11:40.432 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'}} 2024-02-15T18:11:40.432 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v16.2.4', 'flavor': 'default', 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'} 2024-02-15T18:11:40.432 INFO:teuthology.task.install:Using flavor: default 2024-02-15T18:11:40.440 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-15T18:11:40.440 INFO:teuthology.task.install:extra packages: [] 2024-02-15T18:11:40.441 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1', 'tag': 'v16.2.4', 'wait_for_package': False} 2024-02-15T18:11:40.441 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:11:40.441 INFO:teuthology.packaging:ref: None 2024-02-15T18:11:40.441 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:11:40.441 INFO:teuthology.packaging:branch: None 2024-02-15T18:11:40.441 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:11:41.019 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:11:41.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:11:41.022 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1', 'tag': 'v16.2.4', 'wait_for_package': False} 2024-02-15T18:11:41.023 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:11:41.023 INFO:teuthology.packaging:ref: None 2024-02-15T18:11:41.023 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:11:41.023 INFO:teuthology.packaging:branch: None 2024-02-15T18:11:41.023 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:11:41.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:11:41.167 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2024-02-15T18:11:41.167 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2024-02-15T18:11:41.207 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T18:11:41.207 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:11:41.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T18:11:41.241 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2024-02-15T18:11:41.241 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2024-02-15T18:11:41.245 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T18:11:41.245 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:11:41.245 INFO:teuthology.packaging:ref: None 2024-02-15T18:11:41.245 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:11:41.245 INFO:teuthology.packaging:branch: None 2024-02-15T18:11:41.245 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:11:41.245 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T18:11:41.269 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T18:11:41.269 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:11:41.270 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T18:11:41.300 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T18:11:41.300 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:11:41.300 INFO:teuthology.packaging:ref: None 2024-02-15T18:11:41.300 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:11:41.300 INFO:teuthology.packaging:branch: None 2024-02-15T18:11:41.300 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:11:41.300 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T18:11:41.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T18:11:41.369 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T18:11:41.396 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T18:11:41.447 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T18:11:41.466 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-02-15T18:11:41.468 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-02-15T18:11:41.513 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2024-02-15T18:11:41.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2024-02-15T18:11:41.738 INFO:teuthology.orchestra.run.smithi084.stdout:76 files removed 2024-02-15T18:11:41.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw 2024-02-15T18:11:41.788 INFO:teuthology.orchestra.run.smithi133.stdout:76 files removed 2024-02-15T18:11:41.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw 2024-02-15T18:11:42.238 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 1.1 MB/s | 74 kB 00:00 2024-02-15T18:11:42.311 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 841 kB/s | 74 kB 00:00 2024-02-15T18:11:42.347 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 215 kB/s | 15 kB 00:00 2024-02-15T18:11:42.429 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 190 kB/s | 15 kB 00:00 2024-02-15T18:11:42.456 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 22 kB/s | 1.7 kB 00:00 2024-02-15T18:11:42.530 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2024-02-15T18:12:20.568 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - AppStream 733 kB/s | 27 MB 00:38 2024-02-15T18:12:25.843 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 10 MB 00:00 2024-02-15T18:12:27.752 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - Extras 56 kB/s | 18 kB 00:00 2024-02-15T18:12:28.419 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2024-02-15T18:12:29.545 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 8 - PowerTools 4.7 MB/s | 4.8 MB 00:01 2024-02-15T18:12:30.605 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-02-15T18:12:32.191 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-02-15T18:12:36.005 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 433 kB/s | 24 kB 00:00 2024-02-15T18:12:39.536 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:12:39.538 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2024-02-15T18:12:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj x86_64 1.6.1-1.el8 appstream 145 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-15T18:12:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout:Install 25 Packages 2024-02-15T18:12:39.541 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 2 Packages 2024-02-15T18:12:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:12:39.542 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 59 M 2024-02-15T18:12:39.542 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:12:39.965 INFO:teuthology.orchestra.run.smithi133.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 44 MB/s | 6.0 MB 00:00 2024-02-15T18:12:39.990 INFO:teuthology.orchestra.run.smithi133.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-02-15T18:12:40.032 INFO:teuthology.orchestra.run.smithi133.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 19 MB/s | 801 kB 00:00 2024-02-15T18:12:40.065 INFO:teuthology.orchestra.run.smithi133.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 14 MB/s | 486 kB 00:00 2024-02-15T18:12:40.183 INFO:teuthology.orchestra.run.smithi133.stdout:(5/27): librgw2-16.2.4-0.el8.x86_64.rpm 35 MB/s | 4.1 MB 00:00 2024-02-15T18:12:40.241 INFO:teuthology.orchestra.run.smithi133.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 765 kB/s | 44 kB 00:00 2024-02-15T18:12:40.266 INFO:teuthology.orchestra.run.smithi133.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 3.1 MB/s | 80 kB 00:00 2024-02-15T18:12:40.292 INFO:teuthology.orchestra.run.smithi133.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 8.3 MB/s | 213 kB 00:00 2024-02-15T18:12:40.317 INFO:teuthology.orchestra.run.smithi133.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 15 MB/s | 387 kB 00:00 2024-02-15T18:12:40.343 INFO:teuthology.orchestra.run.smithi133.stdout:(10/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 14 MB/s | 368 kB 00:00 2024-02-15T18:12:40.368 INFO:teuthology.orchestra.run.smithi133.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2024-02-15T18:12:40.493 INFO:teuthology.orchestra.run.smithi133.stdout:(12/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 19 MB/s | 13 MB 00:00 2024-02-15T18:12:40.744 INFO:teuthology.orchestra.run.smithi133.stdout:(13/27): ceph-common-16.2.4-0.el8.x86_64.rpm 26 MB/s | 24 MB 00:00 2024-02-15T18:12:44.860 INFO:teuthology.orchestra.run.smithi133.stdout:(14/27): librdkafka-1.6.1-1.el8.x86_64.rpm 155 kB/s | 677 kB 00:04 2024-02-15T18:12:44.919 INFO:teuthology.orchestra.run.smithi133.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 752 kB/s | 44 kB 00:00 2024-02-15T18:12:45.010 INFO:teuthology.orchestra.run.smithi133.stdout:(16/27): daxctl-libs-71.1-7.el8.x86_64.rpm 461 kB/s | 42 kB 00:00 2024-02-15T18:12:45.061 INFO:teuthology.orchestra.run.smithi133.stdout:(17/27): librabbitmq-0.9.0-5.el8.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-02-15T18:12:45.111 INFO:teuthology.orchestra.run.smithi133.stdout:(18/27): ndctl-libs-71.1-7.el8.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-02-15T18:12:45.853 INFO:teuthology.orchestra.run.smithi133.stdout:(19/27): fmt-6.2.1-1.el8.x86_64.rpm 157 kB/s | 116 kB 00:00 2024-02-15T18:12:46.004 INFO:teuthology.orchestra.run.smithi133.stdout:(20/27): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2024-02-15T18:12:46.129 INFO:teuthology.orchestra.run.smithi133.stdout:(21/27): leveldb-1.22-1.el8.x86_64.rpm 1.4 MB/s | 181 kB 00:00 2024-02-15T18:12:46.187 INFO:teuthology.orchestra.run.smithi133.stdout:(22/27): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2024-02-15T18:12:46.254 INFO:teuthology.orchestra.run.smithi133.stdout:(23/27): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2024-02-15T18:12:46.321 INFO:teuthology.orchestra.run.smithi133.stdout:(24/27): librados2-16.2.4-0.el8.x86_64.rpm 56 MB/s | 3.7 MB 00:00 2024-02-15T18:12:46.404 INFO:teuthology.orchestra.run.smithi133.stdout:(25/27): librbd1-16.2.4-0.el8.x86_64.rpm 49 MB/s | 4.0 MB 00:00 2024-02-15T18:12:48.601 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - AppStream 421 kB/s | 27 MB 01:06 2024-02-15T18:12:53.868 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 10 MB 00:00 2024-02-15T18:12:53.937 INFO:teuthology.orchestra.run.smithi133.stdout:(26/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 11 kB/s | 145 kB 00:13 2024-02-15T18:12:55.910 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2024-02-15T18:12:56.560 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2024-02-15T18:12:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 8 - PowerTools 4.9 MB/s | 4.8 MB 00:00 2024-02-15T18:12:58.730 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-02-15T18:12:59.472 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 26 MB/s | 16 MB 00:00 2024-02-15T18:13:00.503 INFO:teuthology.orchestra.run.smithi133.stdout:(27/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 kB/s | 259 kB 00:19 2024-02-15T18:13:00.506 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:13:00.506 INFO:teuthology.orchestra.run.smithi133.stdout:Total 2.8 MB/s | 59 MB 00:20 2024-02-15T18:13:00.576 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:13:00.624 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:13:00.625 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:13:00.980 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:13:00.983 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:13:02.239 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:13:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2024-02-15T18:13:02.648 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2024-02-15T18:13:02.838 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2024-02-15T18:13:03.221 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 405 kB/s | 24 kB 00:00 2024-02-15T18:13:03.259 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2024-02-15T18:13:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:13:03.562 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:13:03.803 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2024-02-15T18:13:03.988 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:13:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:13:04.298 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/29 2024-02-15T18:13:04.881 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/29 2024-02-15T18:13:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:13:05.137 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:13:05.326 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2024-02-15T18:13:05.504 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 11/29 2024-02-15T18:13:05.571 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 11/29 2024-02-15T18:13:05.768 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2024-02-15T18:13:05.955 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2024-02-15T18:13:06.138 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 14/29 2024-02-15T18:13:06.239 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 14/29 2024-02-15T18:13:06.413 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:13:06.842 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:13:06.844 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2024-02-15T18:13:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.6.1-1.el8 appstream 145 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-15T18:13:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout:Install 25 Packages 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2024-02-15T18:13:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:13:06.848 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 59 M 2024-02-15T18:13:06.848 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:13:06.861 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:13:07.146 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2024-02-15T18:13:07.239 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2024-02-15T18:13:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2024-02-15T18:13:07.464 INFO:teuthology.orchestra.run.smithi084.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 38 MB/s | 6.0 MB 00:00 2024-02-15T18:13:07.489 INFO:teuthology.orchestra.run.smithi084.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 999 kB/s | 25 kB 00:00 2024-02-15T18:13:07.522 INFO:teuthology.orchestra.run.smithi084.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 24 MB/s | 801 kB 00:00 2024-02-15T18:13:07.556 INFO:teuthology.orchestra.run.smithi084.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 14 MB/s | 486 kB 00:00 2024-02-15T18:13:07.665 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2024-02-15T18:13:07.682 INFO:teuthology.orchestra.run.smithi084.stdout:(5/27): librgw2-16.2.4-0.el8.x86_64.rpm 33 MB/s | 4.1 MB 00:00 2024-02-15T18:13:07.707 INFO:teuthology.orchestra.run.smithi084.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 1.7 MB/s | 44 kB 00:00 2024-02-15T18:13:07.733 INFO:teuthology.orchestra.run.smithi084.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 3.1 MB/s | 80 kB 00:00 2024-02-15T18:13:07.758 INFO:teuthology.orchestra.run.smithi084.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 8.4 MB/s | 213 kB 00:00 2024-02-15T18:13:07.783 INFO:teuthology.orchestra.run.smithi084.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 15 MB/s | 387 kB 00:00 2024-02-15T18:13:07.808 INFO:teuthology.orchestra.run.smithi084.stdout:(10/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 14 MB/s | 368 kB 00:00 2024-02-15T18:13:07.829 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2024-02-15T18:13:07.842 INFO:teuthology.orchestra.run.smithi084.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 3.4 MB/s | 114 kB 00:00 2024-02-15T18:13:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2024-02-15T18:13:07.976 INFO:teuthology.orchestra.run.smithi084.stdout:(12/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 19 MB/s | 13 MB 00:00 2024-02-15T18:13:08.122 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2024-02-15T18:13:08.251 INFO:teuthology.orchestra.run.smithi084.stdout:(13/27): ceph-common-16.2.4-0.el8.x86_64.rpm 25 MB/s | 24 MB 00:00 2024-02-15T18:13:08.346 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2024-02-15T18:13:08.519 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2024-02-15T18:13:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2024-02-15T18:13:11.001 INFO:teuthology.orchestra.run.smithi084.stdout:(14/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 94 kB/s | 259 kB 00:02 2024-02-15T18:13:11.059 INFO:teuthology.orchestra.run.smithi084.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 752 kB/s | 44 kB 00:00 2024-02-15T18:13:11.160 INFO:teuthology.orchestra.run.smithi084.stdout:(16/27): daxctl-libs-71.1-7.el8.x86_64.rpm 423 kB/s | 42 kB 00:00 2024-02-15T18:13:11.210 INFO:teuthology.orchestra.run.smithi084.stdout:(17/27): librabbitmq-0.9.0-5.el8.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-02-15T18:13:11.260 INFO:teuthology.orchestra.run.smithi084.stdout:(18/27): ndctl-libs-71.1-7.el8.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-02-15T18:13:11.297 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:13:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:13:11.627 INFO:teuthology.orchestra.run.smithi084.stdout:(19/27): librdkafka-1.6.1-1.el8.x86_64.rpm 185 kB/s | 677 kB 00:03 2024-02-15T18:13:11.732 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Status code: 500 for https://mirror.servaxnet.com/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm (IP: 162.255.226.75) 2024-02-15T18:13:11.927 INFO:teuthology.orchestra.run.smithi084.stdout:(20/27): fmt-6.2.1-1.el8.x86_64.rpm 174 kB/s | 116 kB 00:00 2024-02-15T18:13:11.978 INFO:teuthology.orchestra.run.smithi084.stdout:(21/27): gperftools-libs-2.7-9.el8.x86_64.rpm 874 kB/s | 306 kB 00:00 2024-02-15T18:13:12.233 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:13:12.492 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2024-02-15T18:13:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2024-02-15T18:13:12.756 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:13:12.869 INFO:teuthology.orchestra.run.smithi084.stdout:(22/27): leveldb-1.22-1.el8.x86_64.rpm 192 kB/s | 181 kB 00:00 2024-02-15T18:13:12.961 INFO:teuthology.orchestra.run.smithi084.stdout:(23/27): liboath-2.6.2-3.el8.x86_64.rpm 60 kB/s | 59 kB 00:00 2024-02-15T18:13:13.044 INFO:teuthology.orchestra.run.smithi084.stdout:(24/27): librados2-16.2.4-0.el8.x86_64.rpm 45 MB/s | 3.7 MB 00:00 2024-02-15T18:13:13.120 INFO:teuthology.orchestra.run.smithi084.stdout:(25/27): librbd1-16.2.4-0.el8.x86_64.rpm 54 MB/s | 4.0 MB 00:00 2024-02-15T18:13:13.278 INFO:teuthology.orchestra.run.smithi084.stdout:(26/27): libunwind-1.3.1-3.el8.x86_64.rpm 184 kB/s | 75 kB 00:00 2024-02-15T18:13:32.025 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:13:32.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2024-02-15T18:13:32.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2024-02-15T18:13:32.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2024-02-15T18:13:32.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /run 2024-02-15T18:13:32.025 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2024-02-15T18:13:32.026 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2024-02-15T18:13:32.026 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2024-02-15T18:13:32.026 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2024-02-15T18:13:32.026 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2024-02-15T18:13:32.026 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:13:33.396 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2024-02-15T18:13:33.470 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2024-02-15T18:13:33.470 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2024-02-15T18:13:33.685 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2024-02-15T18:13:33.685 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:13:34.389 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:13:34.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2024-02-15T18:13:34.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2024-02-15T18:13:34.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2024-02-15T18:13:34.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:13:34.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2024-02-15T18:13:34.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:13:34.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2024-02-15T18:13:34.389 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 18/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 19/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 20/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2024-02-15T18:13:34.390 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2024-02-15T18:13:34.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2024-02-15T18:13:34.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2024-02-15T18:13:34.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:13:34.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2024-02-15T18:13:34.391 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2024-02-15T18:13:35.252 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:13:35.252 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:13:35.252 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-02-15T18:13:35.252 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.252 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:13:35.252 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.252 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.252 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: daxctl-libs-71.1-7.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: fmt-6.2.1-1.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: leveldb-1.22-1.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj-1.6.1-1.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.253 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: ndctl-libs-71.1-7.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2024-02-15T18:13:35.254 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:13:35.255 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:13:35.599 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-test 2024-02-15T18:13:36.354 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:01 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:13:37.912 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:13:37.913 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:13:37.914 INFO:teuthology.orchestra.run.smithi133.stdout:Install 6 Packages 2024-02-15T18:13:37.915 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:13:37.915 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 53 M 2024-02-15T18:13:37.915 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 229 M 2024-02-15T18:13:37.915 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:13:38.120 INFO:teuthology.orchestra.run.smithi133.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 1.0 MB/s | 169 kB 00:00 2024-02-15T18:13:38.629 INFO:teuthology.orchestra.run.smithi133.stdout:(2/6): ceph-test-16.2.4-0.el8.x86_64.rpm 77 MB/s | 52 MB 00:00 2024-02-15T18:13:40.351 INFO:teuthology.orchestra.run.smithi084.stdout:(27/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 4.5 kB/s | 145 kB 00:32 2024-02-15T18:13:40.355 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:13:40.355 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.8 MB/s | 59 MB 00:33 2024-02-15T18:13:40.421 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:13:40.468 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:13:40.468 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:13:40.824 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:13:40.827 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:13:40.928 INFO:teuthology.orchestra.run.smithi133.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 67 kB/s | 188 kB 00:02 2024-02-15T18:13:40.987 INFO:teuthology.orchestra.run.smithi133.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-02-15T18:13:41.295 INFO:teuthology.orchestra.run.smithi133.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 121 kB/s | 323 kB 00:02 2024-02-15T18:13:41.939 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:13:42.139 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2024-02-15T18:13:42.358 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2024-02-15T18:13:42.521 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2024-02-15T18:13:42.917 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2024-02-15T18:13:43.096 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:13:43.173 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:13:43.420 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2024-02-15T18:13:43.579 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:13:43.644 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:13:43.847 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/29 2024-02-15T18:13:44.112 INFO:teuthology.orchestra.run.smithi133.stdout:(6/6): jq-1.6-8.el8.x86_64.rpm 33 kB/s | 203 kB 00:06 2024-02-15T18:13:44.114 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:13:44.114 INFO:teuthology.orchestra.run.smithi133.stdout:Total 8.5 MB/s | 53 MB 00:06 2024-02-15T18:13:44.156 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:13:44.177 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:13:44.178 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:13:44.421 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/29 2024-02-15T18:13:44.492 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:13:44.495 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:13:44.604 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:13:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:13:44.892 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2024-02-15T18:13:44.977 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:13:45.053 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 11/29 2024-02-15T18:13:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 11/29 2024-02-15T18:13:45.192 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-15T18:13:45.292 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2024-02-15T18:13:45.374 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-15T18:13:45.471 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2024-02-15T18:13:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-15T18:13:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-15T18:13:45.670 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 14/29 2024-02-15T18:13:45.742 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 14/29 2024-02-15T18:13:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-15T18:13:45.878 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:13:45.964 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2024-02-15T18:13:46.295 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:13:46.478 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2024-02-15T18:13:46.562 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2024-02-15T18:13:46.732 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2024-02-15T18:13:46.988 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2024-02-15T18:13:47.145 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2024-02-15T18:13:47.222 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2024-02-15T18:13:47.428 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2024-02-15T18:13:47.625 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2024-02-15T18:13:47.794 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2024-02-15T18:13:48.028 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2024-02-15T18:13:50.546 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:13:50.745 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:13:50.791 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2024-02-15T18:13:51.012 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2024-02-15T18:13:51.295 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2024-02-15T18:13:51.295 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2024-02-15T18:13:51.295 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2024-02-15T18:13:51.295 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-15T18:13:51.295 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-15T18:13:51.295 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-15T18:13:51.438 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:13:51.708 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2024-02-15T18:13:51.709 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-15T18:13:51.709 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:13:51.710 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:13:51.710 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-02-15T18:13:51.710 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-02-15T18:13:51.710 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-02-15T18:13:51.710 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:13:51.710 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:13:51.809 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2024-02-15T18:13:51.935 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:13:51.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph 2024-02-15T18:13:52.729 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:17 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:13:54.283 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2024-02-15T18:13:54.286 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-15T18:13:54.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-15T18:13:54.288 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-15T18:13:54.289 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-15T18:13:54.289 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-15T18:13:54.289 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-15T18:13:54.289 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-15T18:13:54.289 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:13:54.289 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:13:54.289 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:13:54.289 INFO:teuthology.orchestra.run.smithi133.stdout:Install 32 Packages 2024-02-15T18:13:54.289 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:13:54.290 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 31 M 2024-02-15T18:13:54.290 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 111 M 2024-02-15T18:13:54.290 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:13:54.482 INFO:teuthology.orchestra.run.smithi133.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 123 kB/s | 6.3 kB 00:00 2024-02-15T18:13:54.536 INFO:teuthology.orchestra.run.smithi133.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-02-15T18:13:54.591 INFO:teuthology.orchestra.run.smithi133.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-02-15T18:13:54.625 INFO:teuthology.orchestra.run.smithi133.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 6.5 MB/s | 220 kB 00:00 2024-02-15T18:13:54.726 INFO:teuthology.orchestra.run.smithi133.stdout:(5/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 20 MB/s | 5.0 MB 00:00 2024-02-15T18:13:54.959 INFO:teuthology.orchestra.run.smithi133.stdout:(6/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 43 MB/s | 18 MB 00:00 2024-02-15T18:13:58.201 INFO:teuthology.orchestra.run.smithi133.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 32 kB/s | 103 kB 00:03 2024-02-15T18:13:58.259 INFO:teuthology.orchestra.run.smithi133.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 980 kB/s | 57 kB 00:00 2024-02-15T18:13:59.167 INFO:teuthology.orchestra.run.smithi133.stdout:(9/32): python3-markupsafe-0.23-19.el8.x86_64.r 8.7 kB/s | 39 kB 00:04 2024-02-15T18:13:59.201 INFO:teuthology.orchestra.run.smithi133.stdout:(10/32): python3-mako-1.0.6-14.el8.noarch.rpm 34 kB/s | 157 kB 00:04 2024-02-15T18:13:59.350 INFO:teuthology.orchestra.run.smithi133.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2024-02-15T18:13:59.401 INFO:teuthology.orchestra.run.smithi133.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2024-02-15T18:13:59.435 INFO:teuthology.orchestra.run.smithi133.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 2.7 MB/s | 641 kB 00:00 2024-02-15T18:13:59.752 INFO:teuthology.orchestra.run.smithi133.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 124 kB/s | 44 kB 00:00 2024-02-15T18:13:59.869 INFO:teuthology.orchestra.run.smithi133.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 427 kB/s | 185 kB 00:00 2024-02-15T18:14:00.019 INFO:teuthology.orchestra.run.smithi133.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 646 kB/s | 173 kB 00:00 2024-02-15T18:14:00.070 INFO:teuthology.orchestra.run.smithi133.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.9 MB/s | 384 kB 00:00 2024-02-15T18:14:00.120 INFO:teuthology.orchestra.run.smithi133.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-02-15T18:14:00.178 INFO:teuthology.orchestra.run.smithi133.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 162 kB/s | 18 kB 00:00 2024-02-15T18:14:00.229 INFO:teuthology.orchestra.run.smithi133.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 448 kB/s | 49 kB 00:00 2024-02-15T18:14:00.287 INFO:teuthology.orchestra.run.smithi133.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 541 kB/s | 59 kB 00:00 2024-02-15T18:14:00.396 INFO:teuthology.orchestra.run.smithi133.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2024-02-15T18:14:00.421 INFO:teuthology.orchestra.run.smithi133.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2024-02-15T18:14:00.505 INFO:teuthology.orchestra.run.smithi133.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 172 kB/s | 19 kB 00:00 2024-02-15T18:14:00.530 INFO:teuthology.orchestra.run.smithi133.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 220 kB/s | 24 kB 00:00 2024-02-15T18:14:00.605 INFO:teuthology.orchestra.run.smithi133.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 292 kB/s | 29 kB 00:00 2024-02-15T18:14:00.631 INFO:teuthology.orchestra.run.smithi133.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 275 kB/s | 27 kB 00:00 2024-02-15T18:14:00.723 INFO:teuthology.orchestra.run.smithi133.stdout:(28/32): python3-werkzeug-0.12.2-4.el8.noarch.r 186 kB/s | 457 kB 00:02 2024-02-15T18:14:00.790 INFO:teuthology.orchestra.run.smithi133.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.4 MB/s | 255 kB 00:00 2024-02-15T18:14:00.815 INFO:teuthology.orchestra.run.smithi133.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.3 MB/s | 251 kB 00:00 2024-02-15T18:14:00.890 INFO:teuthology.orchestra.run.smithi133.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 229 kB/s | 23 kB 00:00 2024-02-15T18:14:01.090 INFO:teuthology.orchestra.run.smithi133.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 232 kB/s | 85 kB 00:00 2024-02-15T18:14:01.091 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:14:01.092 INFO:teuthology.orchestra.run.smithi133.stdout:Total 4.6 MB/s | 31 MB 00:06 2024-02-15T18:14:01.172 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:14:01.210 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:14:01.210 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:14:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:14:01.534 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:14:02.691 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:14:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-15T18:14:03.106 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-15T18:14:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-15T18:14:03.551 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-15T18:14:03.691 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-15T18:14:03.854 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-15T18:14:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-15T18:14:04.208 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-15T18:14:04.401 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-15T18:14:04.614 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-15T18:14:04.818 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-15T18:14:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-15T18:14:05.427 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-15T18:14:05.688 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-15T18:14:05.877 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-15T18:14:06.104 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-15T18:14:06.261 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-15T18:14:06.569 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-15T18:14:06.766 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-15T18:14:06.971 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-15T18:14:07.683 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-15T18:14:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-15T18:14:08.165 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-15T18:14:08.403 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-15T18:14:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-15T18:14:09.016 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-15T18:14:09.395 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2024-02-15T18:14:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2024-02-15T18:14:11.019 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:14:11.019 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-02-15T18:14:11.019 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-02-15T18:14:11.020 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2024-02-15T18:14:11.020 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /run 2024-02-15T18:14:11.020 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-02-15T18:14:11.020 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-02-15T18:14:11.020 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-02-15T18:14:11.020 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-02-15T18:14:11.020 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2024-02-15T18:14:11.020 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:11.125 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2024-02-15T18:14:11.348 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2024-02-15T18:14:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2024-02-15T18:14:11.990 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2024-02-15T18:14:12.212 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2024-02-15T18:14:12.395 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2024-02-15T18:14:12.401 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2024-02-15T18:14:12.419 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2024-02-15T18:14:12.470 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2024-02-15T18:14:12.470 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2024-02-15T18:14:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2024-02-15T18:14:12.683 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2024-02-15T18:14:12.683 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:14:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2024-02-15T18:14:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2024-02-15T18:14:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2024-02-15T18:14:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2024-02-15T18:14:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2024-02-15T18:14:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-15T18:14:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-15T18:14:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-15T18:14:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-15T18:14:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-15T18:14:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-15T18:14:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-15T18:14:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-15T18:14:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-15T18:14:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-15T18:14:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-15T18:14:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-15T18:14:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-15T18:14:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-15T18:14:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-15T18:14:13.406 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:14:13.406 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2024-02-15T18:14:13.406 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2024-02-15T18:14:13.406 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2024-02-15T18:14:13.406 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:14:13.406 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2024-02-15T18:14:13.406 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:14:13.406 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 18/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 19/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 20/29 2024-02-15T18:14:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2024-02-15T18:14:13.408 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2024-02-15T18:14:13.408 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2024-02-15T18:14:13.408 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2024-02-15T18:14:13.408 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2024-02-15T18:14:13.408 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:14:13.408 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2024-02-15T18:14:13.408 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2024-02-15T18:14:13.721 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-15T18:14:13.722 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-2.6-1.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-15T18:14:13.723 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:13.724 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:14:13.950 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-base 2024-02-15T18:14:14.434 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:14:14.434 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:14.434 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-02-15T18:14:14.434 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.434 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:14:14.434 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: daxctl-libs-71.1-7.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: fmt-6.2.1-1.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: leveldb-1.22-1.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.6.1-1.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-15T18:14:14.435 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: ndctl-libs-71.1-7.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.436 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:14.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:14.437 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:14:14.709 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:39 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:14:14.745 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-test 2024-02-15T18:14:15.496 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:12 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:14:16.217 INFO:teuthology.orchestra.run.smithi133.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:14:16.264 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:14:16.265 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T18:14:16.265 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:14:16.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install cephadm 2024-02-15T18:14:17.027 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:14:17.028 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:14:17.028 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T18:14:17.028 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:14:17.028 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout:Install 6 Packages 2024-02-15T18:14:17.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:17.030 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 53 M 2024-02-15T18:14:17.030 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 229 M 2024-02-15T18:14:17.030 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:14:17.123 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:42 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:14:17.127 INFO:teuthology.orchestra.run.smithi084.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 3.0 MB/s | 169 kB 00:00 2024-02-15T18:14:17.761 INFO:teuthology.orchestra.run.smithi084.stdout:(2/6): ceph-test-16.2.4-0.el8.x86_64.rpm 75 MB/s | 52 MB 00:00 2024-02-15T18:14:18.664 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:14:18.664 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 71 k 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 290 k 2024-02-15T18:14:18.665 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:14:18.936 INFO:teuthology.orchestra.run.smithi133.stdout:cephadm-16.2.4-0.el8.noarch.rpm 263 kB/s | 71 kB 00:00 2024-02-15T18:14:18.937 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:14:18.937 INFO:teuthology.orchestra.run.smithi133.stdout:Total 262 kB/s | 71 kB 00:00 2024-02-15T18:14:18.937 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:14:18.944 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:14:18.944 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:14:18.946 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:14:18.949 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:14:18.990 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:14:19.511 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:14:19.659 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:14:19.889 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:14:20.275 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:14:20.275 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:20.275 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:14:20.275 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:16.2.4-0.el8.noarch 2024-02-15T18:14:20.275 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:20.275 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:14:20.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T18:14:21.295 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:46 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:14:22.842 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repo Size 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:22.843 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 163 k 2024-02-15T18:14:22.844 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 587 k 2024-02-15T18:14:22.844 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:14:22.891 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 3.4 MB/s | 163 kB 00:00 2024-02-15T18:14:22.892 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:14:22.892 INFO:teuthology.orchestra.run.smithi133.stdout:Total 3.3 MB/s | 163 kB 00:00 2024-02-15T18:14:22.892 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:14:22.902 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:14:22.902 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:14:22.949 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:14:22.952 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:14:23.035 INFO:teuthology.orchestra.run.smithi084.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 61 kB/s | 323 kB 00:05 2024-02-15T18:14:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:14:23.093 INFO:teuthology.orchestra.run.smithi084.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-02-15T18:14:23.291 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:14:23.707 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:14:24.596 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:14:24.597 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:24.597 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:14:24.597 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:24.597 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:24.597 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:14:25.051 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr 2024-02-15T18:14:25.826 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:50 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:14:27.319 INFO:teuthology.orchestra.run.smithi133.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:14:27.366 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:14:27.367 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T18:14:27.367 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:14:27.477 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T18:14:27.984 INFO:teuthology.orchestra.run.smithi084.stdout:(5/6): jq-1.6-8.el8.x86_64.rpm 19 kB/s | 203 kB 00:10 2024-02-15T18:14:28.101 INFO:teuthology.orchestra.run.smithi084.stdout:(6/6): oniguruma-6.8.2-3.el8.x86_64.rpm 17 kB/s | 188 kB 00:10 2024-02-15T18:14:28.103 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:14:28.104 INFO:teuthology.orchestra.run.smithi084.stdout:Total 4.8 MB/s | 53 MB 00:11 2024-02-15T18:14:28.145 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:14:28.166 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:14:28.166 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:14:28.229 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:53 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:14:28.487 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:14:28.490 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:14:29.012 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:14:29.238 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-15T18:14:29.426 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-15T18:14:29.577 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-15T18:14:29.638 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-15T18:14:29.780 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:14:29.781 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-15T18:14:29.782 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:29.783 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:14:29.783 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:29.783 INFO:teuthology.orchestra.run.smithi133.stdout:Install 6 Packages 2024-02-15T18:14:29.783 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:29.783 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 3.0 M 2024-02-15T18:14:29.783 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 15 M 2024-02-15T18:14:29.784 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:14:29.826 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-15T18:14:29.969 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2024-02-15T18:14:30.085 INFO:teuthology.orchestra.run.smithi133.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 521 kB/s | 24 kB 00:00 2024-02-15T18:14:30.111 INFO:teuthology.orchestra.run.smithi133.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 125 kB/s | 8.9 kB 00:00 2024-02-15T18:14:30.219 INFO:teuthology.orchestra.run.smithi133.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 15 MB/s | 2.7 MB 00:00 2024-02-15T18:14:30.294 INFO:teuthology.orchestra.run.smithi133.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 204 kB/s | 43 kB 00:00 2024-02-15T18:14:30.320 INFO:teuthology.orchestra.run.smithi133.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 161 kB/s | 34 kB 00:00 2024-02-15T18:14:30.445 INFO:teuthology.orchestra.run.smithi133.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 872 kB/s | 196 kB 00:00 2024-02-15T18:14:30.447 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:14:30.447 INFO:teuthology.orchestra.run.smithi133.stdout:Total 4.4 MB/s | 3.0 MB 00:00 2024-02-15T18:14:30.457 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:14:30.466 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:14:30.467 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:14:30.615 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:14:30.618 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:14:30.904 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:14:31.096 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-15T18:14:31.374 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-15T18:14:31.575 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-15T18:14:31.687 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2024-02-15T18:14:32.652 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2024-02-15T18:14:32.902 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:14:33.196 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:14:33.196 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2024-02-15T18:14:33.196 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2024-02-15T18:14:33.196 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2024-02-15T18:14:33.197 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-15T18:14:33.197 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-15T18:14:33.576 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-15T18:14:33.576 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:33.576 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:14:33.577 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2024-02-15T18:14:33.577 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2024-02-15T18:14:33.577 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2024-02-15T18:14:33.577 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-15T18:14:33.577 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-15T18:14:33.577 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-15T18:14:33.577 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:33.577 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:14:33.735 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T18:14:34.492 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:01:59 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:14:34.790 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2024-02-15T18:14:35.049 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2024-02-15T18:14:35.333 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2024-02-15T18:14:35.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2024-02-15T18:14:35.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2024-02-15T18:14:35.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-15T18:14:35.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-15T18:14:35.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-15T18:14:35.777 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-15T18:14:35.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:35.777 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:14:35.777 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-02-15T18:14:35.777 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-02-15T18:14:35.777 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-02-15T18:14:35.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:35.778 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:14:36.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph 2024-02-15T18:14:36.036 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:14:36.037 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-15T18:14:36.038 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-15T18:14:36.039 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:36.039 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:14:36.039 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================ 2024-02-15T18:14:36.039 INFO:teuthology.orchestra.run.smithi133.stdout:Install 8 Packages 2024-02-15T18:14:36.039 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:36.039 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 37 M 2024-02-15T18:14:36.039 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 210 M 2024-02-15T18:14:36.040 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:14:36.483 INFO:teuthology.orchestra.run.smithi133.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 58 MB/s | 8.6 MB 00:00 2024-02-15T18:14:36.762 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:33 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:14:38.334 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2024-02-15T18:14:38.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-15T18:14:38.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-15T18:14:38.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-15T18:14:38.341 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:38.341 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:14:38.341 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:14:38.341 INFO:teuthology.orchestra.run.smithi084.stdout:Install 32 Packages 2024-02-15T18:14:38.341 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:38.341 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 31 M 2024-02-15T18:14:38.342 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 111 M 2024-02-15T18:14:38.342 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:14:38.660 INFO:teuthology.orchestra.run.smithi084.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 124 kB/s | 6.3 kB 00:00 2024-02-15T18:14:38.719 INFO:teuthology.orchestra.run.smithi084.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-02-15T18:14:38.769 INFO:teuthology.orchestra.run.smithi084.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-02-15T18:14:38.794 INFO:teuthology.orchestra.run.smithi084.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 8.7 MB/s | 220 kB 00:00 2024-02-15T18:14:38.895 INFO:teuthology.orchestra.run.smithi084.stdout:(5/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 21 MB/s | 5.0 MB 00:00 2024-02-15T18:14:39.120 INFO:teuthology.orchestra.run.smithi084.stdout:(6/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 45 MB/s | 18 MB 00:00 2024-02-15T18:14:41.801 INFO:teuthology.orchestra.run.smithi133.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 719 kB/s | 3.7 MB 00:05 2024-02-15T18:14:42.153 INFO:teuthology.orchestra.run.smithi084.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 12 kB/s | 39 kB 00:03 2024-02-15T18:14:42.178 INFO:teuthology.orchestra.run.smithi084.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 46 kB/s | 157 kB 00:03 2024-02-15T18:14:42.270 INFO:teuthology.orchestra.run.smithi084.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 488 kB/s | 57 kB 00:00 2024-02-15T18:14:42.429 INFO:teuthology.orchestra.run.smithi084.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 249 kB 00:00 2024-02-15T18:14:42.471 INFO:teuthology.orchestra.run.smithi084.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.5 MB/s | 457 kB 00:00 2024-02-15T18:14:42.521 INFO:teuthology.orchestra.run.smithi084.stdout:(12/32): python3-cryptography-3.2.1-7.el8.x86_6 6.9 MB/s | 641 kB 00:00 2024-02-15T18:14:42.534 INFO:teuthology.orchestra.run.smithi133.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 307 kB/s | 225 kB 00:00 2024-02-15T18:14:42.580 INFO:teuthology.orchestra.run.smithi084.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.0 MB/s | 109 kB 00:00 2024-02-15T18:14:42.664 INFO:teuthology.orchestra.run.smithi084.stdout:(14/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 29 kB/s | 103 kB 00:03 2024-02-15T18:14:42.680 INFO:teuthology.orchestra.run.smithi084.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 274 kB/s | 44 kB 00:00 2024-02-15T18:14:42.822 INFO:teuthology.orchestra.run.smithi084.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 764 kB/s | 185 kB 00:00 2024-02-15T18:14:42.881 INFO:teuthology.orchestra.run.smithi084.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2024-02-15T18:14:42.939 INFO:teuthology.orchestra.run.smithi084.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 626 kB/s | 173 kB 00:00 2024-02-15T18:14:43.007 INFO:teuthology.orchestra.run.smithi084.stdout:(19/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.2 MB/s | 384 kB 00:00 2024-02-15T18:14:43.026 INFO:teuthology.orchestra.run.smithi133.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 743 kB/s | 4.9 MB 00:06 2024-02-15T18:14:43.040 INFO:teuthology.orchestra.run.smithi084.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 111 kB/s | 18 kB 00:00 2024-02-15T18:14:43.065 INFO:teuthology.orchestra.run.smithi084.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 388 kB/s | 49 kB 00:00 2024-02-15T18:14:43.090 INFO:teuthology.orchestra.run.smithi084.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 705 kB/s | 59 kB 00:00 2024-02-15T18:14:43.124 INFO:teuthology.orchestra.run.smithi084.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2024-02-15T18:14:43.158 INFO:teuthology.orchestra.run.smithi084.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 280 kB/s | 19 kB 00:00 2024-02-15T18:14:43.183 INFO:teuthology.orchestra.run.smithi084.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2024-02-15T18:14:43.185 INFO:teuthology.orchestra.run.smithi133.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 4.0 MB/s | 645 kB 00:00 2024-02-15T18:14:43.208 INFO:teuthology.orchestra.run.smithi084.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 286 kB/s | 24 kB 00:00 2024-02-15T18:14:43.227 INFO:teuthology.orchestra.run.smithi133.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 4.1 MB/s | 172 kB 00:00 2024-02-15T18:14:43.234 INFO:teuthology.orchestra.run.smithi084.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 387 kB/s | 29 kB 00:00 2024-02-15T18:14:43.259 INFO:teuthology.orchestra.run.smithi084.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2024-02-15T18:14:43.302 INFO:teuthology.orchestra.run.smithi133.stdout:(7/8): openblas-0.3.15-4.el8.x86_64.rpm 695 kB/s | 4.7 MB 00:06 2024-02-15T18:14:43.334 INFO:teuthology.orchestra.run.smithi084.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.4 MB/s | 251 kB 00:00 2024-02-15T18:14:43.359 INFO:teuthology.orchestra.run.smithi084.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 853 kB/s | 85 kB 00:00 2024-02-15T18:14:43.385 INFO:teuthology.orchestra.run.smithi084.stdout:(31/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.4 MB/s | 255 kB 00:00 2024-02-15T18:14:43.410 INFO:teuthology.orchestra.run.smithi084.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2024-02-15T18:14:43.411 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:14:43.411 INFO:teuthology.orchestra.run.smithi084.stdout:Total 6.1 MB/s | 31 MB 00:05 2024-02-15T18:14:43.493 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:14:43.531 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:14:43.531 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:14:43.838 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:14:43.841 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:14:44.569 INFO:teuthology.orchestra.run.smithi133.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 7.0 MB/s | 14 MB 00:02 2024-02-15T18:14:44.570 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:14:44.570 INFO:teuthology.orchestra.run.smithi133.stdout:Total 4.3 MB/s | 37 MB 00:08 2024-02-15T18:14:44.804 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:14:44.822 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:14:44.822 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:14:44.934 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:14:45.147 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-15T18:14:45.155 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:14:45.158 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:14:45.373 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-15T18:14:45.614 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-15T18:14:45.813 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-15T18:14:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:14:46.396 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-15T18:14:46.528 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-15T18:14:46.594 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-15T18:14:46.710 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-15T18:14:46.771 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-15T18:14:46.868 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-15T18:14:47.079 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-15T18:14:47.272 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-15T18:14:47.369 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-15T18:14:47.467 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-15T18:14:47.553 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:14:47.672 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-15T18:14:47.920 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-15T18:14:48.194 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:14:48.271 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-15T18:14:48.349 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-15T18:14:48.534 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-15T18:14:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-15T18:14:48.972 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-15T18:14:49.043 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-15T18:14:49.148 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-15T18:14:49.415 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-15T18:14:49.473 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-15T18:14:49.682 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-15T18:14:49.694 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-15T18:14:49.866 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-15T18:14:50.063 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-15T18:14:50.288 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-15T18:14:50.502 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-15T18:14:50.729 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-15T18:14:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-15T18:14:51.338 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-15T18:14:51.459 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-15T18:14:51.710 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2024-02-15T18:14:51.895 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2024-02-15T18:14:52.801 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-15T18:14:52.989 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2024-02-15T18:14:53.311 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2024-02-15T18:14:53.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2024-02-15T18:14:53.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-15T18:14:53.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:14:53.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-15T18:14:53.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-15T18:14:53.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-15T18:14:53.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-15T18:14:53.443 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2024-02-15T18:14:53.653 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-15T18:14:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-15T18:14:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-15T18:14:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:53.754 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:14:53.868 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-rook 2024-02-15T18:14:54.091 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2024-02-15T18:14:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2024-02-15T18:14:54.527 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2024-02-15T18:14:54.630 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:19 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:14:54.697 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2024-02-15T18:14:54.714 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2024-02-15T18:14:54.846 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2024-02-15T18:14:55.256 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-15T18:14:55.257 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-15T18:14:55.258 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-15T18:14:55.259 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-15T18:14:56.116 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-15T18:14:56.117 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-2.6-1.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-15T18:14:56.118 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-15T18:14:56.119 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-15T18:14:56.119 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-15T18:14:56.119 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-15T18:14:56.119 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-15T18:14:56.119 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-15T18:14:56.119 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-15T18:14:56.119 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-15T18:14:56.119 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:14:56.119 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:14:56.176 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:14:56.178 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:56.178 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T18:14:56.178 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:56.178 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:14:56.178 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2024-02-15T18:14:56.178 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T18:14:56.178 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-15T18:14:56.178 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-15T18:14:56.178 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:14:56.179 INFO:teuthology.orchestra.run.smithi133.stdout:Install 13 Packages 2024-02-15T18:14:56.180 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:14:56.180 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 1.9 M 2024-02-15T18:14:56.180 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 24 M 2024-02-15T18:14:56.180 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:14:56.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-base 2024-02-15T18:14:56.816 INFO:teuthology.orchestra.run.smithi133.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 693 kB/s | 27 kB 00:00 2024-02-15T18:14:57.184 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:54 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:14:58.687 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:14:58.733 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:14:58.734 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-02-15T18:14:58.734 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:14:58.852 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install cephadm 2024-02-15T18:14:59.049 INFO:teuthology.orchestra.run.smithi133.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 8.8 kB/s | 20 kB 00:02 2024-02-15T18:14:59.075 INFO:teuthology.orchestra.run.smithi133.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 12 kB/s | 27 kB 00:02 2024-02-15T18:14:59.167 INFO:teuthology.orchestra.run.smithi133.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 54 kB/s | 126 kB 00:02 2024-02-15T18:14:59.192 INFO:teuthology.orchestra.run.smithi133.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.3 MB/s | 155 kB 00:00 2024-02-15T18:14:59.217 INFO:teuthology.orchestra.run.smithi133.stdout:(6/13): python3-pyasn1-modules-0.3.7-6.el8.noar 656 kB/s | 110 kB 00:00 2024-02-15T18:14:59.268 INFO:teuthology.orchestra.run.smithi133.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 424 kB/s | 43 kB 00:00 2024-02-15T18:14:59.518 INFO:teuthology.orchestra.run.smithi133.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 54 kB/s | 16 kB 00:00 2024-02-15T18:14:59.535 INFO:teuthology.orchestra.run.smithi133.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 96 kB/s | 33 kB 00:00 2024-02-15T18:14:59.598 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:56 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:14:59.652 INFO:teuthology.orchestra.run.smithi133.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 212 kB/s | 81 kB 00:00 2024-02-15T18:14:59.719 INFO:teuthology.orchestra.run.smithi133.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 350 kB/s | 64 kB 00:00 2024-02-15T18:14:59.785 INFO:teuthology.orchestra.run.smithi133.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 459 kB/s | 61 kB 00:00 2024-02-15T18:15:00.011 INFO:teuthology.orchestra.run.smithi133.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.4 MB/s | 1.2 MB 00:00 2024-02-15T18:15:00.014 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:00.014 INFO:teuthology.orchestra.run.smithi133.stdout:Total 510 kB/s | 1.9 MB 00:03 2024-02-15T18:15:00.072 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:15:00.088 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:15:00.088 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:15:00.177 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:15:00.180 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:15:00.719 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:15:00.961 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-15T18:15:01.138 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-15T18:15:01.151 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-02-15T18:15:01.152 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:01.153 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 71 k 2024-02-15T18:15:01.153 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 290 k 2024-02-15T18:15:01.153 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:15:01.197 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm-16.2.4-0.el8.noarch.rpm 1.6 MB/s | 71 kB 00:00 2024-02-15T18:15:01.197 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:01.197 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.6 MB/s | 71 kB 00:00 2024-02-15T18:15:01.198 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:15:01.204 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:15:01.204 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:15:01.206 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:15:01.209 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:15:01.249 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:15:01.361 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-15T18:15:01.608 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-15T18:15:01.783 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:15:01.839 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-15T18:15:02.095 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-15T18:15:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-15T18:15:02.638 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-15T18:15:03.605 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:15:03.657 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-15T18:15:03.840 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:15:03.966 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-15T18:15:04.153 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-15T18:15:04.374 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-15T18:15:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:15:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:04.487 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:15:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:16.2.4-0.el8.noarch 2024-02-15T18:15:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:04.487 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:15:04.534 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2024-02-15T18:15:04.713 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T18:15:04.831 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2024-02-15T18:15:04.831 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2024-02-15T18:15:04.831 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-15T18:15:04.831 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-15T18:15:04.831 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-15T18:15:04.831 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-15T18:15:04.831 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-15T18:15:04.831 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-15T18:15:04.832 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-15T18:15:04.832 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-15T18:15:04.832 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-15T18:15:04.832 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-15T18:15:04.832 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-15T18:15:05.305 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-15T18:15:05.305 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-15T18:15:05.306 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:05.307 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:05.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T18:15:05.476 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:02 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:15:06.205 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:31 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:06.975 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:15:06.975 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:06.975 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-02-15T18:15:06.975 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:06.975 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:15:06.975 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2024-02-15T18:15:06.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:06.975 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:15:06.976 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:06.976 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-02-15T18:15:06.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:06.976 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 163 k 2024-02-15T18:15:06.976 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 587 k 2024-02-15T18:15:06.976 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:15:07.018 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 3.8 MB/s | 163 kB 00:00 2024-02-15T18:15:07.019 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:07.019 INFO:teuthology.orchestra.run.smithi084.stdout:Total 3.7 MB/s | 163 kB 00:00 2024-02-15T18:15:07.019 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:15:07.029 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:15:07.030 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:15:07.077 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:15:07.080 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:15:07.195 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:15:07.377 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:07.758 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:07.759 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:07.759 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:07.760 INFO:teuthology.orchestra.run.smithi133.stdout:Install 6 Packages 2024-02-15T18:15:07.761 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:07.761 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 5.9 M 2024-02-15T18:15:07.761 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 24 M 2024-02-15T18:15:07.761 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:15:07.795 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:08.078 INFO:teuthology.orchestra.run.smithi133.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 2.1 MB/s | 89 kB 00:00 2024-02-15T18:15:08.160 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:08.160 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:08.160 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:15:08.160 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2024-02-15T18:15:08.161 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:08.161 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:15:08.329 INFO:teuthology.orchestra.run.smithi133.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 84 kB/s | 21 kB 00:00 2024-02-15T18:15:08.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr 2024-02-15T18:15:08.445 INFO:teuthology.orchestra.run.smithi133.stdout:(3/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 1.4 MB/s | 578 kB 00:00 2024-02-15T18:15:08.603 INFO:teuthology.orchestra.run.smithi133.stdout:(4/6): python3-remoto-1.2.1-1.el8.noarch.rpm 309 kB/s | 49 kB 00:00 2024-02-15T18:15:08.695 INFO:teuthology.orchestra.run.smithi133.stdout:(5/6): python3-execnet-1.7.1-1.el8.noarch.rpm 971 kB/s | 355 kB 00:00 2024-02-15T18:15:09.148 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:06 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:15:09.795 INFO:teuthology.orchestra.run.smithi133.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 2.7 MB/s | 4.8 MB 00:01 2024-02-15T18:15:09.796 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:09.796 INFO:teuthology.orchestra.run.smithi133.stdout:Total 2.9 MB/s | 5.9 MB 00:02 2024-02-15T18:15:09.850 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:15:09.860 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:15:09.861 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:15:09.973 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:15:09.976 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:15:10.267 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:15:10.523 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-15T18:15:10.657 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:15:10.704 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:15:10.705 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-02-15T18:15:10.705 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:15:10.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T18:15:10.850 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-15T18:15:11.566 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:08 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:15:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-15T18:15:12.115 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-15T18:15:12.337 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-15T18:15:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:15:12.822 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:15:12.823 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2024-02-15T18:15:12.823 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-15T18:15:12.823 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-15T18:15:12.823 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-15T18:15:12.823 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-15T18:15:13.128 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:15:13.129 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:13.129 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-02-15T18:15:13.129 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:13.129 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:15:13.129 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout:Install 6 Packages 2024-02-15T18:15:13.130 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:13.131 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 3.0 M 2024-02-15T18:15:13.131 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 15 M 2024-02-15T18:15:13.131 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:15:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-15T18:15:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:13.231 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:15:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2024-02-15T18:15:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2024-02-15T18:15:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.10.1-4.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2024-02-15T18:15:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:13.231 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:13.368 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-fuse 2024-02-15T18:15:14.127 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:39 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:14.553 INFO:teuthology.orchestra.run.smithi084.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 546 kB/s | 24 kB 00:00 2024-02-15T18:15:14.579 INFO:teuthology.orchestra.run.smithi084.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 130 kB/s | 8.9 kB 00:00 2024-02-15T18:15:14.645 INFO:teuthology.orchestra.run.smithi084.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 20 MB/s | 2.7 MB 00:00 2024-02-15T18:15:14.729 INFO:teuthology.orchestra.run.smithi084.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 243 kB/s | 43 kB 00:00 2024-02-15T18:15:14.988 INFO:teuthology.orchestra.run.smithi084.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 82 kB/s | 34 kB 00:00 2024-02-15T18:15:15.230 INFO:teuthology.orchestra.run.smithi084.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 337 kB/s | 196 kB 00:00 2024-02-15T18:15:15.233 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:15.233 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.4 MB/s | 3.0 MB 00:02 2024-02-15T18:15:15.244 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:15:15.254 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:15:15.254 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:15:15.431 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:15:15.434 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:15:15.663 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout:Install 2 Packages 2024-02-15T18:15:15.664 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:15.665 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 968 k 2024-02-15T18:15:15.665 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 3.2 M 2024-02-15T18:15:15.665 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:15:15.715 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:15:15.939 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-15T18:15:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 17 MB/s | 885 kB 00:00 2024-02-15T18:15:16.079 INFO:teuthology.orchestra.run.smithi133.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 613 kB/s | 83 kB 00:00 2024-02-15T18:15:16.080 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:16.080 INFO:teuthology.orchestra.run.smithi133.stdout:Total 2.3 MB/s | 968 kB 00:00 2024-02-15T18:15:16.092 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:15:16.109 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:15:16.110 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:15:16.184 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-15T18:15:16.197 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:15:16.201 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:15:16.385 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-15T18:15:16.404 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:15:16.531 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2024-02-15T18:15:16.673 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-15T18:15:16.881 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2024-02-15T18:15:17.292 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2024-02-15T18:15:17.292 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2024-02-15T18:15:17.505 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2024-02-15T18:15:17.781 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:15:18.053 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:15:18.053 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2024-02-15T18:15:18.053 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2024-02-15T18:15:18.053 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2024-02-15T18:15:18.053 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-15T18:15:18.053 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-15T18:15:18.388 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-15T18:15:18.389 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:18.389 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:15:18.389 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-15T18:15:18.389 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:18.389 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:18.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-15T18:15:18.468 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:18.468 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:15:18.469 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2024-02-15T18:15:18.469 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2024-02-15T18:15:18.469 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2024-02-15T18:15:18.469 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-15T18:15:18.469 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-15T18:15:18.469 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-15T18:15:18.469 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:18.469 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:15:18.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install librados-devel 2024-02-15T18:15:18.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T18:15:19.366 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:16 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:15:19.383 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:44 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:20.908 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================================ 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================================ 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-15T18:15:20.909 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:20.910 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:15:20.910 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================================ 2024-02-15T18:15:20.910 INFO:teuthology.orchestra.run.smithi084.stdout:Install 8 Packages 2024-02-15T18:15:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:20.910 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 37 M 2024-02-15T18:15:20.910 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 210 M 2024-02-15T18:15:20.910 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:15:20.926 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:20.926 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:20.926 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T18:15:20.926 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:20.927 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:15:20.927 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2024-02-15T18:15:20.927 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:20.927 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:15:20.927 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:20.927 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T18:15:20.927 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:20.928 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 131 k 2024-02-15T18:15:20.928 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 439 k 2024-02-15T18:15:20.928 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:15:20.974 INFO:teuthology.orchestra.run.smithi133.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 2.8 MB/s | 131 kB 00:00 2024-02-15T18:15:20.975 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:20.975 INFO:teuthology.orchestra.run.smithi133.stdout:Total 2.7 MB/s | 131 kB 00:00 2024-02-15T18:15:20.975 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:15:20.980 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:15:20.981 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:15:21.031 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:15:21.034 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:15:21.141 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:15:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:21.393 INFO:teuthology.orchestra.run.smithi084.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 60 MB/s | 8.6 MB 00:00 2024-02-15T18:15:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:22.005 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:22.005 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:22.006 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:15:22.006 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2024-02-15T18:15:22.006 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:22.006 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:22.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install libcephfs2 2024-02-15T18:15:23.017 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:48 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:24.551 INFO:teuthology.orchestra.run.smithi133.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:15:24.597 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:24.598 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T18:15:24.598 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:24.716 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install libcephfs-devel 2024-02-15T18:15:25.476 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:50 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:26.385 INFO:teuthology.orchestra.run.smithi084.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 766 kB/s | 3.7 MB 00:04 2024-02-15T18:15:26.611 INFO:teuthology.orchestra.run.smithi084.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.0 MB/s | 225 kB 00:00 2024-02-15T18:15:27.026 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T18:15:27.027 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:27.028 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 24 k 2024-02-15T18:15:27.028 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 94 k 2024-02-15T18:15:27.028 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:15:27.080 INFO:teuthology.orchestra.run.smithi133.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 470 kB/s | 24 kB 00:00 2024-02-15T18:15:27.081 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:27.081 INFO:teuthology.orchestra.run.smithi133.stdout:Total 459 kB/s | 24 kB 00:00 2024-02-15T18:15:27.081 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:15:27.084 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:15:27.084 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:15:27.086 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:15:27.089 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:15:27.140 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:15:27.339 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:27.602 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:27.942 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:27.943 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:27.943 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:15:27.943 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2024-02-15T18:15:27.943 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:27.943 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:28.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install librados2 2024-02-15T18:15:28.819 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:53 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:30.202 INFO:teuthology.orchestra.run.smithi084.stdout:(4/8): openblas-0.3.15-4.el8.x86_64.rpm 541 kB/s | 4.7 MB 00:08 2024-02-15T18:15:30.332 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:15:30.361 INFO:teuthology.orchestra.run.smithi084.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 4.0 MB/s | 645 kB 00:00 2024-02-15T18:15:30.379 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:30.380 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T18:15:30.380 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:30.402 INFO:teuthology.orchestra.run.smithi084.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 4.1 MB/s | 172 kB 00:00 2024-02-15T18:15:30.474 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install librbd1 2024-02-15T18:15:31.233 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:56 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:32.577 INFO:teuthology.orchestra.run.smithi084.stdout:(7/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 439 kB/s | 4.9 MB 00:11 2024-02-15T18:15:32.736 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:15:32.782 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:32.783 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T18:15:32.784 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:32.891 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-rados 2024-02-15T18:15:33.651 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:02:58 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:35.144 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:15:35.191 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:35.192 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T18:15:35.192 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:35.294 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-rgw 2024-02-15T18:15:36.052 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:03:01 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:37.551 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:15:37.598 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:37.599 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T18:15:37.599 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:37.714 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-cephfs 2024-02-15T18:15:38.470 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:03:03 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:39.978 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:15:40.025 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:40.026 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T18:15:40.026 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:40.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install python3-rbd 2024-02-15T18:15:40.897 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:03:05 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:42.388 INFO:teuthology.orchestra.run.smithi133.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:15:42.434 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:42.435 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-02-15T18:15:42.435 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:42.548 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install rbd-fuse 2024-02-15T18:15:42.659 INFO:teuthology.orchestra.run.smithi084.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 904 kB/s | 14 MB 00:16 2024-02-15T18:15:42.659 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:42.660 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.7 MB/s | 37 MB 00:21 2024-02-15T18:15:42.891 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:15:42.909 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:15:42.909 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:15:43.266 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:15:43.269 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:15:43.324 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:03:08 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:43.918 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:15:44.094 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-15T18:15:44.212 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-15T18:15:44.380 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-15T18:15:44.899 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:44.899 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:44.900 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T18:15:44.900 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:44.900 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:15:44.900 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2024-02-15T18:15:44.900 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:44.900 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:15:44.900 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:44.900 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T18:15:44.900 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:44.901 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 89 k 2024-02-15T18:15:44.901 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 298 k 2024-02-15T18:15:44.901 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:15:44.943 INFO:teuthology.orchestra.run.smithi133.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 2.1 MB/s | 89 kB 00:00 2024-02-15T18:15:44.943 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:44.943 INFO:teuthology.orchestra.run.smithi133.stdout:Total 2.0 MB/s | 89 kB 00:00 2024-02-15T18:15:44.944 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:15:44.953 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:15:44.953 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:15:44.974 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-15T18:15:45.003 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:15:45.006 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:15:45.107 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:15:45.152 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:15:45.334 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:45.793 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:15:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-15T18:15:46.278 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:46.279 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:46.279 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:15:46.279 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2024-02-15T18:15:46.279 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:46.279 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:46.503 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install rbd-mirror 2024-02-15T18:15:46.676 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-15T18:15:47.038 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-15T18:15:47.271 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:03:12 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:47.309 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-15T18:15:48.813 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:48.814 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:48.814 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T18:15:48.814 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:48.814 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:15:48.814 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2024-02-15T18:15:48.814 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:48.814 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:15:48.814 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:48.815 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T18:15:48.815 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:48.815 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 3.7 M 2024-02-15T18:15:48.815 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 18 M 2024-02-15T18:15:48.815 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:15:48.897 INFO:teuthology.orchestra.run.smithi133.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 45 MB/s | 3.7 MB 00:00 2024-02-15T18:15:48.897 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:48.898 INFO:teuthology.orchestra.run.smithi133.stdout:Total 45 MB/s | 3.7 MB 00:00 2024-02-15T18:15:48.898 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:15:48.910 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:15:48.910 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:15:48.973 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:15:48.977 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:15:49.055 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-15T18:15:49.447 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:15:49.660 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:50.079 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:50.349 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-15T18:15:50.442 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:50.443 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:50.443 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:15:50.443 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2024-02-15T18:15:50.443 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:50.443 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:50.598 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2024-02-15T18:15:50.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install rbd-nbd 2024-02-15T18:15:50.904 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2024-02-15T18:15:50.904 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2024-02-15T18:15:50.904 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-15T18:15:50.904 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:15:50.904 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-15T18:15:50.904 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-15T18:15:50.905 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-15T18:15:50.905 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-15T18:15:51.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-15T18:15:51.335 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:51.336 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:15:51.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-rook 2024-02-15T18:15:51.480 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:03:16 ago on Thu 15 Feb 2024 06:12:35 PM UTC. 2024-02-15T18:15:52.198 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:49 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:15:53.031 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-02-15T18:15:53.031 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:53.031 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-02-15T18:15:53.032 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:53.032 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-02-15T18:15:53.032 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2024-02-15T18:15:53.032 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:53.032 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-02-15T18:15:53.032 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-02-15T18:15:53.032 INFO:teuthology.orchestra.run.smithi133.stdout:Install 1 Package 2024-02-15T18:15:53.032 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:53.033 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 173 k 2024-02-15T18:15:53.033 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 649 k 2024-02-15T18:15:53.033 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-02-15T18:15:53.083 INFO:teuthology.orchestra.run.smithi133.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-02-15T18:15:53.083 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:53.084 INFO:teuthology.orchestra.run.smithi133.stdout:Total 3.3 MB/s | 173 kB 00:00 2024-02-15T18:15:53.084 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-02-15T18:15:53.094 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-02-15T18:15:53.094 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-02-15T18:15:53.145 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-02-15T18:15:53.148 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-02-15T18:15:53.256 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-02-15T18:15:53.474 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:53.734 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:15:53.735 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-15T18:15:53.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout:Install 13 Packages 2024-02-15T18:15:53.737 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:15:53.738 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 1.9 M 2024-02-15T18:15:53.738 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 24 M 2024-02-15T18:15:53.738 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:15:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:54.093 INFO:teuthology.orchestra.run.smithi084.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 575 kB/s | 27 kB 00:00 2024-02-15T18:15:54.204 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:15:54.204 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:54.204 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-02-15T18:15:54.204 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2024-02-15T18:15:54.204 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:15:54.204 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-02-15T18:15:54.218 INFO:teuthology.orchestra.run.smithi084.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 116 kB/s | 20 kB 00:00 2024-02-15T18:15:54.243 INFO:teuthology.orchestra.run.smithi084.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 135 kB/s | 27 kB 00:00 2024-02-15T18:15:54.361 INFO:teuthology.orchestra.run.smithi084.stdout:(4/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.3 MB/s | 155 kB 00:00 2024-02-15T18:15:54.386 INFO:teuthology.orchestra.run.smithi084.stdout:(5/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 432 kB/s | 126 kB 00:00 2024-02-15T18:15:54.419 DEBUG:teuthology.parallel:result is None 2024-02-15T18:15:54.437 INFO:teuthology.orchestra.run.smithi084.stdout:(6/13): python3-pyasn1-modules-0.3.7-6.el8.noar 502 kB/s | 110 kB 00:00 2024-02-15T18:15:54.470 INFO:teuthology.orchestra.run.smithi084.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 391 kB/s | 43 kB 00:00 2024-02-15T18:15:54.853 INFO:teuthology.orchestra.run.smithi084.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 71 kB/s | 33 kB 00:00 2024-02-15T18:15:54.895 INFO:teuthology.orchestra.run.smithi084.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 38 kB/s | 16 kB 00:00 2024-02-15T18:15:55.021 INFO:teuthology.orchestra.run.smithi084.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 148 kB/s | 81 kB 00:00 2024-02-15T18:15:55.196 INFO:teuthology.orchestra.run.smithi084.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 214 kB/s | 64 kB 00:00 2024-02-15T18:15:55.221 INFO:teuthology.orchestra.run.smithi084.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 306 kB/s | 61 kB 00:00 2024-02-15T18:15:55.522 INFO:teuthology.orchestra.run.smithi084.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.7 MB/s | 1.2 MB 00:00 2024-02-15T18:15:55.522 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:15:55.522 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.1 MB/s | 1.9 MB 00:01 2024-02-15T18:15:55.581 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:15:55.597 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:15:55.597 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:15:55.683 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:15:55.686 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:15:56.169 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:15:56.410 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-15T18:15:56.583 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-15T18:15:56.827 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-15T18:15:57.022 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-15T18:15:57.213 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-15T18:15:57.461 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-15T18:15:57.736 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-15T18:15:58.011 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-15T18:15:59.056 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-15T18:15:59.313 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-15T18:15:59.514 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-15T18:15:59.731 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-15T18:15:59.890 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-15T18:16:00.190 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-15T18:16:00.191 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-15T18:16:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-15T18:16:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:00.642 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:16:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2024-02-15T18:16:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-15T18:16:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:00.643 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:00.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T18:16:01.515 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:58 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-02-15T18:16:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:16:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2024-02-15T18:16:03.066 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout:Install 6 Packages 2024-02-15T18:16:03.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 5.9 M 2024-02-15T18:16:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 24 M 2024-02-15T18:16:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:16:03.519 INFO:teuthology.orchestra.run.smithi084.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 1.9 MB/s | 89 kB 00:00 2024-02-15T18:16:03.820 INFO:teuthology.orchestra.run.smithi084.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 71 kB/s | 21 kB 00:00 2024-02-15T18:16:03.895 INFO:teuthology.orchestra.run.smithi084.stdout:(3/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 1.3 MB/s | 578 kB 00:00 2024-02-15T18:16:04.237 INFO:teuthology.orchestra.run.smithi084.stdout:(4/6): python3-execnet-1.7.1-1.el8.noarch.rpm 853 kB/s | 355 kB 00:00 2024-02-15T18:16:04.262 INFO:teuthology.orchestra.run.smithi084.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 133 kB/s | 49 kB 00:00 2024-02-15T18:16:04.846 INFO:teuthology.orchestra.run.smithi084.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 3.5 MB/s | 4.8 MB 00:01 2024-02-15T18:16:04.846 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:16:04.846 INFO:teuthology.orchestra.run.smithi084.stdout:Total 3.3 MB/s | 5.9 MB 00:01 2024-02-15T18:16:04.901 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:16:04.912 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:16:04.912 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:16:05.019 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:16:05.022 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:16:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:16:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-15T18:16:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-15T18:16:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-15T18:16:07.143 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-15T18:16:07.384 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-15T18:16:07.588 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:16:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:16:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2024-02-15T18:16:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-15T18:16:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-15T18:16:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-15T18:16:07.907 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-15T18:16:08.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-15T18:16:08.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:08.332 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:16:08.332 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2024-02-15T18:16:08.332 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2024-02-15T18:16:08.332 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.10.1-4.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2024-02-15T18:16:08.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:08.332 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:08.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-fuse 2024-02-15T18:16:09.232 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:06 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:10.803 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:10.804 INFO:teuthology.orchestra.run.smithi084.stdout:Install 2 Packages 2024-02-15T18:16:10.805 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:10.805 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 968 k 2024-02-15T18:16:10.805 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 3.2 M 2024-02-15T18:16:10.805 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:16:11.054 INFO:teuthology.orchestra.run.smithi084.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 16 MB/s | 885 kB 00:00 2024-02-15T18:16:11.146 INFO:teuthology.orchestra.run.smithi084.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 567 kB/s | 83 kB 00:00 2024-02-15T18:16:11.146 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:16:11.146 INFO:teuthology.orchestra.run.smithi084.stdout:Total 2.8 MB/s | 968 kB 00:00 2024-02-15T18:16:11.157 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:16:11.177 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:16:11.177 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:16:11.263 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:16:11.266 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:16:11.448 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:16:11.704 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-15T18:16:12.038 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2024-02-15T18:16:12.545 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2024-02-15T18:16:12.545 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2024-02-15T18:16:12.969 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-15T18:16:12.969 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:12.970 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:16:12.970 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-15T18:16:12.970 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:12.970 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:13.194 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librados-devel 2024-02-15T18:16:13.953 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:10 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:15.503 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:15.503 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 131 k 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 439 k 2024-02-15T18:16:15.504 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:16:15.548 INFO:teuthology.orchestra.run.smithi084.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 2.9 MB/s | 131 kB 00:00 2024-02-15T18:16:15.549 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:16:15.549 INFO:teuthology.orchestra.run.smithi084.stdout:Total 2.8 MB/s | 131 kB 00:00 2024-02-15T18:16:15.549 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:16:15.555 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:16:15.555 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:16:15.603 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:16:15.606 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:16:15.717 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:16:15.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:16.208 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:16.597 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:16.597 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:16.597 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:16:16.597 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2024-02-15T18:16:16.597 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:16.597 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:16.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs2 2024-02-15T18:16:17.592 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:14 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:19.098 INFO:teuthology.orchestra.run.smithi084.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:16:19.144 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:19.145 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-02-15T18:16:19.145 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:19.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs-devel 2024-02-15T18:16:20.004 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:17 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:21.633 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:21.634 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T18:16:21.634 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:21.634 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:16:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2024-02-15T18:16:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:21.635 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:16:21.635 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:21.635 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-02-15T18:16:21.635 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:21.635 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 24 k 2024-02-15T18:16:21.635 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 94 k 2024-02-15T18:16:21.635 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:16:21.680 INFO:teuthology.orchestra.run.smithi084.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 560 kB/s | 24 kB 00:00 2024-02-15T18:16:21.680 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:16:21.680 INFO:teuthology.orchestra.run.smithi084.stdout:Total 544 kB/s | 24 kB 00:00 2024-02-15T18:16:21.680 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:16:21.683 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:16:21.683 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:16:21.685 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:16:21.688 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:16:21.734 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:16:21.953 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:22.202 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:22.561 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:22.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:22.561 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:16:22.561 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2024-02-15T18:16:22.562 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:22.562 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:22.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librados2 2024-02-15T18:16:23.466 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:20 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:24.961 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:16:25.008 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:25.009 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-02-15T18:16:25.009 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:25.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librbd1 2024-02-15T18:16:25.869 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:22 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:27.367 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:16:27.413 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:27.414 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-02-15T18:16:27.414 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:27.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rados 2024-02-15T18:16:28.284 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:25 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:29.783 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:16:29.830 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:29.831 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-02-15T18:16:29.831 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:29.940 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rgw 2024-02-15T18:16:30.696 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:27 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:32.196 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:16:32.243 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:32.244 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-02-15T18:16:32.244 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:32.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-cephfs 2024-02-15T18:16:33.099 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:30 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:34.616 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:16:34.663 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:34.664 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-02-15T18:16:34.665 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:34.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rbd 2024-02-15T18:16:35.522 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:32 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:36.990 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:16:37.037 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:37.038 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-02-15T18:16:37.038 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:37.142 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-fuse 2024-02-15T18:16:37.894 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:34 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:39.445 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:39.446 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:39.446 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T18:16:39.446 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:39.446 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:16:39.446 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2024-02-15T18:16:39.446 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:39.447 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:16:39.447 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:39.447 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-02-15T18:16:39.447 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:39.447 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 89 k 2024-02-15T18:16:39.447 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 298 k 2024-02-15T18:16:39.447 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:16:39.499 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 1.7 MB/s | 89 kB 00:00 2024-02-15T18:16:39.500 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:16:39.500 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.6 MB/s | 89 kB 00:00 2024-02-15T18:16:39.500 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:16:39.510 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:16:39.510 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:16:39.559 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:16:39.562 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:16:39.666 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:16:39.830 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:40.104 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:40.664 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:40.665 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:16:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2024-02-15T18:16:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:40.665 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:40.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-mirror 2024-02-15T18:16:41.626 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:38 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:43.166 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:43.166 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:43.166 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T18:16:43.166 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:43.167 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:16:43.167 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2024-02-15T18:16:43.167 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:43.167 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:16:43.167 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:43.167 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-02-15T18:16:43.167 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:43.167 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 3.7 M 2024-02-15T18:16:43.168 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 18 M 2024-02-15T18:16:43.168 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:16:43.262 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 39 MB/s | 3.7 MB 00:00 2024-02-15T18:16:43.263 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:16:43.263 INFO:teuthology.orchestra.run.smithi084.stdout:Total 39 MB/s | 3.7 MB 00:00 2024-02-15T18:16:43.263 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:16:43.275 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:16:43.275 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:16:43.338 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:16:43.341 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:16:43.804 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:16:43.989 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:44.416 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:44.774 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:44.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:44.774 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:16:44.774 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2024-02-15T18:16:44.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:44.774 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:44.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-nbd 2024-02-15T18:16:45.744 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:03:42 ago on Thu 15 Feb 2024 06:13:03 PM UTC. 2024-02-15T18:16:47.314 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-02-15T18:16:47.315 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:47.315 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-02-15T18:16:47.316 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:47.316 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-02-15T18:16:47.316 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2024-02-15T18:16:47.316 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:47.316 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-02-15T18:16:47.316 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-02-15T18:16:47.317 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-02-15T18:16:47.317 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:47.317 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 173 k 2024-02-15T18:16:47.317 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 649 k 2024-02-15T18:16:47.317 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-02-15T18:16:47.364 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 3.5 MB/s | 173 kB 00:00 2024-02-15T18:16:47.365 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:16:47.365 INFO:teuthology.orchestra.run.smithi084.stdout:Total 3.4 MB/s | 173 kB 00:00 2024-02-15T18:16:47.365 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-02-15T18:16:47.376 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-02-15T18:16:47.376 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-02-15T18:16:47.425 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-02-15T18:16:47.428 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-02-15T18:16:47.541 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-02-15T18:16:47.731 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:48.020 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:48.379 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:16:48.379 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:48.379 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-02-15T18:16:48.379 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2024-02-15T18:16:48.379 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:16:48.379 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-02-15T18:16:48.598 DEBUG:teuthology.parallel:result is None 2024-02-15T18:16:48.599 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:16:48.599 INFO:teuthology.packaging:ref: None 2024-02-15T18:16:48.599 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:16:48.599 INFO:teuthology.packaging:branch: None 2024-02-15T18:16:48.599 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:16:48.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:16:48.820 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T18:16:48.842 INFO:teuthology.orchestra.run.smithi084.stdout:16.2.4-0.el8 2024-02-15T18:16:48.843 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2024-02-15T18:16:48.843 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2024-02-15T18:16:48.845 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:16:48.845 INFO:teuthology.packaging:ref: None 2024-02-15T18:16:48.845 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:16:48.845 INFO:teuthology.packaging:branch: None 2024-02-15T18:16:48.845 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:16:48.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:16:49.061 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T18:16:49.088 INFO:teuthology.orchestra.run.smithi133.stdout:16.2.4-0.el8 2024-02-15T18:16:49.089 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2024-02-15T18:16:49.089 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2024-02-15T18:16:49.091 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-15T18:16:49.091 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:16:49.091 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T18:16:49.119 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:16:49.119 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T18:16:49.162 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-15T18:16:49.163 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:16:49.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T18:16:49.189 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T18:16:49.256 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:16:49.256 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T18:16:49.286 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T18:16:49.356 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-15T18:16:49.356 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:16:49.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T18:16:49.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T18:16:49.449 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:16:49.449 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T18:16:49.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T18:16:49.549 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-15T18:16:49.549 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:16:49.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T18:16:49.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T18:16:49.642 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:16:49.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T18:16:49.670 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T18:16:49.739 INFO:teuthology.run_tasks:Running task print... 2024-02-15T18:16:49.750 INFO:teuthology.task.print:**** done install task... 2024-02-15T18:16:49.750 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-15T18:16:49.828 INFO:tasks.cephadm:Config: {'avoid_pacific_features': True, 'cephadm_branch': 'v16.2.4', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v16.2.4', 'roleless': True, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(PG_DEGRADED\\)', 'Degraded data redundancy', '\\(PG_', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'} 2024-02-15T18:16:49.829 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v16.2.4 2024-02-15T18:16:49.829 INFO:tasks.cephadm:Cluster fsid is 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:16:49.829 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-15T18:16:49.829 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-15T18:16:49.829 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi084': '172.21.15.84', 'mon.smithi133': '172.21.15.133'} 2024-02-15T18:16:49.830 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-15T18:16:49.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2024-02-15T18:16:49.857 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname $(hostname -s) 2024-02-15T18:16:49.885 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v16.2.4)... 2024-02-15T18:16:49.885 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-15T18:16:50.027 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Feb 15 18:16 /home/ubuntu/cephtest/cephadm 2024-02-15T18:16:50.027 DEBUG:teuthology.orchestra.run.smithi133:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-15T18:16:50.317 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Feb 15 18:16 /home/ubuntu/cephtest/cephadm 2024-02-15T18:16:50.317 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-15T18:16:50.337 DEBUG:teuthology.orchestra.run.smithi133:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-15T18:16:50.368 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2024-02-15T18:16:50.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph 2024-02-15T18:16:50.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2024-02-15T18:16:50.472 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /etc/ceph 2024-02-15T18:16:50.502 INFO:tasks.cephadm:Writing seed config... 2024-02-15T18:16:50.503 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-15T18:16:50.503 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-15T18:16:50.503 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-15T18:16:50.503 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-15T18:16:50.503 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-15T18:16:50.503 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-15T18:16:50.503 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-15T18:16:50.503 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-15T18:16:50.503 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-15T18:16:50.504 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-15T18:16:50.505 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-15T18:16:50.506 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:16:50.506 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-15T18:16:50.530 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 631a4cdc-cc2e-11ee-95ba-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-15T18:16:50.531 DEBUG:teuthology.orchestra.run.smithi084:mon.smithi084> sudo journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084.service 2024-02-15T18:16:50.574 INFO:tasks.cephadm:Bootstrapping... 2024-02-15T18:16:50.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 -v bootstrap --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.84 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:16:50.599 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:-- Logs begin at Thu 2024-02-15 18:00:24 UTC. -- 2024-02-15T18:16:50.835 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2024-02-15T18:16:51.773 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: 4.9.3-dev 2024-02-15T18:16:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:Verifying podman|docker is present... 2024-02-15T18:16:51.784 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2024-02-15T18:16:51.807 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: 4.9.3-dev 2024-02-15T18:16:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:Verifying lvm2 is present... 2024-02-15T18:16:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:Verifying time synchronization is in place... 2024-02-15T18:16:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-enabled chrony.service 2024-02-15T18:16:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-15T18:16:51.830 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-active chrony.service 2024-02-15T18:16:51.836 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: inactive 2024-02-15T18:16:51.837 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-enabled chronyd.service 2024-02-15T18:16:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: enabled 2024-02-15T18:16:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-active chronyd.service 2024-02-15T18:16:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: active 2024-02-15T18:16:51.849 INFO:teuthology.orchestra.run.smithi084.stderr:Unit chronyd.service is enabled and running 2024-02-15T18:16:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:Repeating the final host check... 2024-02-15T18:16:51.850 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2024-02-15T18:16:51.870 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: 4.9.3-dev 2024-02-15T18:16:51.881 INFO:teuthology.orchestra.run.smithi084.stderr:podman|docker (/bin/podman) is present 2024-02-15T18:16:51.882 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl is present 2024-02-15T18:16:51.882 INFO:teuthology.orchestra.run.smithi084.stderr:lvcreate is present 2024-02-15T18:16:51.882 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-enabled chrony.service 2024-02-15T18:16:51.887 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-15T18:16:51.888 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-active chrony.service 2024-02-15T18:16:51.893 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: inactive 2024-02-15T18:16:51.894 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-enabled chronyd.service 2024-02-15T18:16:51.900 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: enabled 2024-02-15T18:16:51.900 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-active chronyd.service 2024-02-15T18:16:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: active 2024-02-15T18:16:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:Unit chronyd.service is enabled and running 2024-02-15T18:16:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:Host looks OK 2024-02-15T18:16:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:Cluster fsid: 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:16:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:Acquiring lock 140429859191272 on /run/cephadm/631a4cdc-cc2e-11ee-95ba-87774f69a715.lock 2024-02-15T18:16:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:Lock 140429859191272 acquired on /run/cephadm/631a4cdc-cc2e-11ee-95ba-87774f69a715.lock 2024-02-15T18:16:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:Verifying IP 172.21.15.84 port 3300 ... 2024-02-15T18:16:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:Verifying IP 172.21.15.84 port 6789 ... 2024-02-15T18:16:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:Base mon IP is 172.21.15.84, final addrv is [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-02-15T18:16:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /sbin/ip route ls 2024-02-15T18:16:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.84 metric 100 2024-02-15T18:16:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.84 metric 100 2024-02-15T18:16:51.911 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /sbin/ip -6 route ls 2024-02-15T18:16:51.914 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-02-15T18:16:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-15T18:16:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1728sec hoplimit 64 pref medium 2024-02-15T18:16:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /sbin/ip -6 addr ls 2024-02-15T18:16:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-15T18:16:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-02-15T18:16:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-15T18:16:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-15T18:16:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-02-15T18:16:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-15T18:16:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:Mon IP 172.21.15.84 is in CIDR network 172.21.0.0/20 2024-02-15T18:16:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-15T18:16:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2024-02-15T18:16:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman pull docker.io/ceph/ceph:v16.2.4 2024-02-15T18:16:52.019 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: Trying to pull docker.io/ceph/ceph:v16.2.4... 2024-02-15T18:16:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: Getting image source signatures 2024-02-15T18:16:58.738 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: Copying blob sha256:551101690791055467b1840be133b2e6b029d263771bc6c46a96bb7acdacac39 2024-02-15T18:16:58.738 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: Copying blob sha256:7a0437f04f83f084b7ed68ad9c4a4947e12fc4e1b006b38129bac89114ec3621 2024-02-15T18:17:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: Copying config sha256:8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2024-02-15T18:17:17.082 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: Writing manifest to image destination 2024-02-15T18:17:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:/bin/podman: 8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2024-02-15T18:17:17.396 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --version 2024-02-15T18:17:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:ceph: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2024-02-15T18:17:19.018 INFO:teuthology.orchestra.run.smithi084.stderr:Ceph version: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2024-02-15T18:17:19.018 INFO:teuthology.orchestra.run.smithi084.stderr:Extracting ceph user uid/gid from container image... 2024-02-15T18:17:19.018 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 -c %u %g /var/lib/ceph 2024-02-15T18:17:19.519 INFO:teuthology.orchestra.run.smithi084.stderr:stat: 167 167 2024-02-15T18:17:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:Creating initial keys... 2024-02-15T18:17:20.056 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2024-02-15T18:17:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-authtool: AQAwVc5lH1GCHhAATSXuOPjtDaU4fX+Kbo5SNQ== 2024-02-15T18:17:21.161 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2024-02-15T18:17:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-authtool: AQAxVc5lAOseIRAA3d4VdJlI2qYlCnCbJQzCiA== 2024-02-15T18:17:22.141 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2024-02-15T18:17:22.670 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-authtool: AQAyVc5lPM56IhAAS2PIt/l2eP2luF+qFksNVQ== 2024-02-15T18:17:23.216 INFO:teuthology.orchestra.run.smithi084.stderr:Creating initial monmap... 2024-02-15T18:17:23.216 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmp71m3fl8j:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --create --clobber --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 --addv smithi084 [v2:172.21.15.84:3300,v1:172.21.15.84:6789] /tmp/monmap 2024-02-15T18:17:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-15T18:17:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-15T18:17:24.403 INFO:teuthology.orchestra.run.smithi084.stderr:monmaptool for smithi084 [v2:172.21.15.84:3300,v1:172.21.15.84:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-15T18:17:24.403 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/monmaptool: set fsid to 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:24.403 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-15T18:17:24.403 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:17:24.403 INFO:teuthology.orchestra.run.smithi084.stderr:Creating mon... 2024-02-15T18:17:24.403 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084:/var/lib/ceph/mon/ceph-smithi084:z -v /tmp/ceph-tmpq4bi6pti:/tmp/keyring:z -v /tmp/ceph-tmp71m3fl8j:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --mkfs -i smithi084 --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.874+0000 7fd6213a7700 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.874+0000 7fd6213a7700 1 imported monmap: 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: epoch 0 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: last_changed 2024-02-15T18:17:23.658771+0000 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: created 2024-02-15T18:17:23.658771+0000 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.smithi084 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.960 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.874+0000 7fd6213a7700 0 /usr/bin/ceph-mon: set fsid to 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: RocksDB version: 6.8.1 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Compile date May 13 2021 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: DB SUMMARY 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi084/store.db dir, Total Num: 0, files: 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi084/store.db: 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.error_if_exists: 0 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.create_if_missing: 1 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.paranoid_checks: 1 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.env: 0x563ef8ee61c0 2024-02-15T18:17:24.961 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.fs: Posix File System 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.info_log: 0x563efa352ec0 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.statistics: (nil) 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.use_fsync: 0 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_log_file_size: 0 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.allow_fallocate: 1 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.use_direct_reads: 0 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T18:17:24.962 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.create_missing_column_families: 0 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.db_log_dir: 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi084/store.db 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_subcompactions: 1 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_background_flushes: -1 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.advise_random_on_open: 1 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.write_buffer_manager: 0x563efa359530 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T18:17:24.963 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.rate_limiter: (nil) 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.unordered_write: 0 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.row_cache: None 2024-02-15T18:17:24.964 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.wal_filter: None 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.preserve_deletes: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.two_write_queues: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.manual_wal_flush: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.atomic_flush: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.log_readahead_size: 0 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_background_jobs: 2 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_background_compactions: -1 2024-02-15T18:17:24.965 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_total_wal_size: 0 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.max_open_files: -1 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.bytes_per_sync: 0 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Compression algorithms supported: 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T18:17:24.966 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: kZSTD supported: 0 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: kXpressCompression supported: 0 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: kLZ4Compression supported: 1 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: kBZip2Compression supported: 0 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: kZlibCompression supported: 1 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: kSnappyCompression supported: 1 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.875+0000 7fd6213a7700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000001 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.967 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.merge_operator: 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_filter: None 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_filter_factory: None 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563efa26bcb8) 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: index_type: 0 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-02-15T18:17:24.968 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: checksum: 1 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: block_cache: 0x563efa2a0d10 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-02-15T18:17:24.969 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: format_version: 2 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: block_align: 0 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compression: NoCompression 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-15T18:17:24.970 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.num_levels: 7 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compression_opts.level: 32767 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T18:17:24.971 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compression_opts.enabled: false 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T18:17:24.972 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.arena_block_size: 4194304 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T18:17:24.973 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.table_properties_collectors: 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.inplace_update_support: 0 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T18:17:24.974 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.bloom_locality: 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.max_successive_merges: 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.force_consistency_checks: 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.ttl: 2592000 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.876+0000 7fd6213a7700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.975 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.877+0000 7fd6213a7700 4 rocksdb: DB pointer 0x563efa365800 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.877+0000 7fd60a240700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.877+0000 7fd60a240700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:17:24.976 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:17:24.977 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:17:24.978 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.879+0000 7fd6213a7700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.879+0000 7fd6213a7700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-02-15T18:17:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:17:24.879+0000 7fd6213a7700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi084 for mon.smithi084 2024-02-15T18:17:25.561 INFO:teuthology.orchestra.run.smithi084.stderr:create mon.smithi084 on 2024-02-15T18:17:25.562 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:25.567 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl disable ceph.target 2024-02-15T18:17:25.574 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-02-15T18:17:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl enable ceph.target 2024-02-15T18:17:25.663 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-15T18:17:25.741 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl start ceph.target 2024-02-15T18:17:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl enable ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715.target 2024-02-15T18:17:25.754 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715.target. 2024-02-15T18:17:25.755 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715.target. 2024-02-15T18:17:25.832 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl start ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715.target 2024-02-15T18:17:25.840 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl daemon-reload 2024-02-15T18:17:25.923 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084 2024-02-15T18:17:25.946 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl reset-failed ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084 2024-02-15T18:17:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Failed to reset failed state of unit ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084.service: Unit ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084.service not loaded. 2024-02-15T18:17:25.953 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl enable ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084 2024-02-15T18:17:25.959 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Created symlink /etc/systemd/system/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715.target.wants/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084.service → /etc/systemd/system/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@.service. 2024-02-15T18:17:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl start ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084 2024-02-15T18:17:26.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:26 smithi084 systemd[1]: Starting Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:17:26.594 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-enabled firewalld.service 2024-02-15T18:17:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: disabled 2024-02-15T18:17:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-active firewalld.service 2024-02-15T18:17:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: inactive 2024-02-15T18:17:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:firewalld.service is not enabled 2024-02-15T18:17:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:Not possible to enable service . firewalld.service is not available 2024-02-15T18:17:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:Not possible to open ports <[]>. firewalld.service is not available 2024-02-15T18:17:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:Waiting for mon to start... 2024-02-15T18:17:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:Waiting for mon... 2024-02-15T18:17:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084:/var/lib/ceph/mon/ceph-smithi084:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status 2024-02-15T18:17:26.842 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:26 smithi084 bash[37786]: a14cf14ce7719bbdd3d2599eb5415695a90c2b623381703cd2e93d4ef111f0fa 2024-02-15T18:17:26.842 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:26 smithi084 systemd[1]: Started Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:17:26.842 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: cluster 2024-02-15T18:17:26.592322+0000 mon.smithi084 (mon.0) 0 : [INF] mkfs 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:26.842 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: cluster 2024-02-15T18:17:26.575283+0000 mon.smithi084 (mon.0) 1 : cluster [INF] mon.smithi084 is new leader, mons smithi084 in quorum (ranks 0) 2024-02-15T18:17:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.137+0000 7f8a76e27700 1 Processor -- start 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.137+0000 7f8a76e27700 1 -- start start 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.137+0000 7f8a76e27700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a700fc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.137+0000 7f8a76e27700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700fc7a0 con 0x7f8a700fbe70 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.138+0000 7f8a74bc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a700fc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.138+0000 7f8a74bc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a700fc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43050/0 (socket says 172.21.15.84:43050) 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.138+0000 7f8a74bc3700 1 -- 172.21.15.84:0/3503712010 learned_addr learned my addr 172.21.15.84:0/3503712010 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.138+0000 7f8a74bc3700 1 -- 172.21.15.84:0/3503712010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700fc8e0 con 0x7f8a700fbe70 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.138+0000 7f8a74bc3700 1 --2- 172.21.15.84:0/3503712010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a700fc2b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f8a6400b5f0 tx=0x7f8a64006ee0).ready entity=mon.0 client_cookie=3558279387bca527 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.138+0000 7f8a6f7fe700 1 -- 172.21.15.84:0/3503712010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a6400d600 con 0x7f8a700fbe70 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.138+0000 7f8a6f7fe700 1 -- 172.21.15.84:0/3503712010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6400d760 con 0x7f8a700fbe70 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.138+0000 7f8a6f7fe700 1 -- 172.21.15.84:0/3503712010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a6400da30 con 0x7f8a700fbe70 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.139+0000 7f8a76e27700 1 -- 172.21.15.84:0/3503712010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 msgr2=0x7f8a700fc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.139+0000 7f8a76e27700 1 --2- 172.21.15.84:0/3503712010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a700fc2b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f8a6400b5f0 tx=0x7f8a64006ee0).stop 2024-02-15T18:17:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.139+0000 7f8a76e27700 1 -- 172.21.15.84:0/3503712010 shutdown_connections 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.139+0000 7f8a76e27700 1 --2- 172.21.15.84:0/3503712010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a700fc2b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.139+0000 7f8a76e27700 1 -- 172.21.15.84:0/3503712010 >> 172.21.15.84:0/3503712010 conn(0x7f8a700f7640 msgr2=0x7f8a700f9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.139+0000 7f8a76e27700 1 -- 172.21.15.84:0/3503712010 shutdown_connections 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.139+0000 7f8a76e27700 1 -- 172.21.15.84:0/3503712010 wait complete. 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.139+0000 7f8a76e27700 1 Processor -- start 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.139+0000 7f8a76e27700 1 -- start start 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a76e27700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a7010a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a76e27700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7010a870 con 0x7f8a700fbe70 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a74bc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a7010a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a74bc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a7010a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43058/0 (socket says 172.21.15.84:43058) 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a74bc3700 1 -- 172.21.15.84:0/1896225779 learned_addr learned my addr 172.21.15.84:0/1896225779 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a74bc3700 1 -- 172.21.15.84:0/1896225779 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6400b200 con 0x7f8a700fbe70 2024-02-15T18:17:27.144 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a74bc3700 1 --2- 172.21.15.84:0/1896225779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a7010a380 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f8a64006c70 tx=0x7f8a64016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:27.144 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a6d7fa700 1 -- 172.21.15.84:0/1896225779 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a64011b40 con 0x7f8a700fbe70 2024-02-15T18:17:27.144 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a6d7fa700 1 -- 172.21.15.84:0/1896225779 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a64011ca0 con 0x7f8a700fbe70 2024-02-15T18:17:27.144 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a6d7fa700 1 -- 172.21.15.84:0/1896225779 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a6401d430 con 0x7f8a700fbe70 2024-02-15T18:17:27.144 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.140+0000 7f8a76e27700 1 -- 172.21.15.84:0/1896225779 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7010aa70 con 0x7f8a700fbe70 2024-02-15T18:17:27.144 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.141+0000 7f8a76e27700 1 -- 172.21.15.84:0/1896225779 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7010af00 con 0x7f8a700fbe70 2024-02-15T18:17:27.144 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.141+0000 7f8a6d7fa700 1 -- 172.21.15.84:0/1896225779 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f8a6400f070 con 0x7f8a700fbe70 2024-02-15T18:17:27.144 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.141+0000 7f8a6d7fa700 1 -- 172.21.15.84:0/1896225779 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f8a64027460 con 0x7f8a700fbe70 2024-02-15T18:17:27.144 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.141+0000 7f8a76e27700 1 -- 172.21.15.84:0/1896225779 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a70045ad0 con 0x7f8a700fbe70 2024-02-15T18:17:27.145 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.144+0000 7f8a6d7fa700 1 -- 172.21.15.84:0/1896225779 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f8a64016070 con 0x7f8a700fbe70 2024-02-15T18:17:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.209+0000 7f8a76e27700 1 -- 172.21.15.84:0/1896225779 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8a70103dd0 con 0x7f8a700fbe70 2024-02-15T18:17:27.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.210+0000 7f8a6d7fa700 1 -- 172.21.15.84:0/1896225779 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f8a64036070 con 0x7f8a700fbe70 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: cluster: 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: id: 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: services: 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi084 (age 0.619785s) 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mgr: no daemons active 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: data: 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-02-15T18:17:27.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: pgs: 2024-02-15T18:17:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.210+0000 7f8a76e27700 1 -- 172.21.15.84:0/1896225779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 msgr2=0x7f8a7010a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.210+0000 7f8a76e27700 1 --2- 172.21.15.84:0/1896225779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a7010a380 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f8a64006c70 tx=0x7f8a64016000).stop 2024-02-15T18:17:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.210+0000 7f8a76e27700 1 -- 172.21.15.84:0/1896225779 shutdown_connections 2024-02-15T18:17:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.210+0000 7f8a76e27700 1 --2- 172.21.15.84:0/1896225779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a700fbe70 0x7f8a7010a380 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.211+0000 7f8a76e27700 1 -- 172.21.15.84:0/1896225779 >> 172.21.15.84:0/1896225779 conn(0x7f8a700f7640 msgr2=0x7f8a700feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.211+0000 7f8a76e27700 1 -- 172.21.15.84:0/1896225779 shutdown_connections 2024-02-15T18:17:27.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:27.211+0000 7f8a76e27700 1 -- 172.21.15.84:0/1896225779 wait complete. 2024-02-15T18:17:27.806 INFO:teuthology.orchestra.run.smithi084.stderr:mon is available 2024-02-15T18:17:27.807 INFO:teuthology.orchestra.run.smithi084.stderr:Assimilating anything we can from ceph.conf... 2024-02-15T18:17:27.807 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z -v /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084:/var/lib/ceph/mon/ceph-smithi084:z docker.io/ceph/ceph:v16.2.4 config assimilate-conf -i /var/lib/ceph/mon/ceph-smithi084/config 2024-02-15T18:17:27.808 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: cluster 2024-02-15T18:17:26.591080+0000 mon.smithi084 (mon.0) 2 : cluster [INF] mon.smithi084 is new leader, mons smithi084 in quorum (ranks 0) 2024-02-15T18:17:27.808 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: cluster 2024-02-15T18:17:26.591243+0000 mon.smithi084 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0]} 2024-02-15T18:17:27.809 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: cluster 2024-02-15T18:17:26.594391+0000 mon.smithi084 (mon.0) 4 : cluster [DBG] fsmap 2024-02-15T18:17:27.809 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: cluster 2024-02-15T18:17:26.596941+0000 mon.smithi084 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-15T18:17:27.809 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: cluster 2024-02-15T18:17:26.597372+0000 mon.smithi084 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-15T18:17:27.809 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: audit 2024-02-15T18:17:27.210829+0000 mon.smithi084 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.84:0/1896225779' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-15T18:17:28.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.293+0000 7f97b5f2c700 1 Processor -- start 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.293+0000 7f97b5f2c700 1 -- start start 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.293+0000 7f97b5f2c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b00fea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.293+0000 7f97b5f2c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00fef80 con 0x7f97b00703f0 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.293+0000 7f97af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b00fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.293+0000 7f97af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b00fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43060/0 (socket says 172.21.15.84:43060) 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.293+0000 7f97af7fe700 1 -- 172.21.15.84:0/2360455973 learned_addr learned my addr 172.21.15.84:0/2360455973 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.293+0000 7f97af7fe700 1 -- 172.21.15.84:0/2360455973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00ff0c0 con 0x7f97b00703f0 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.293+0000 7f97af7fe700 1 --2- 172.21.15.84:0/2360455973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b00fea90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f97a0009960 tx=0x7f97a00092d0).ready entity=mon.0 client_cookie=78c2f7482ce75893 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97ae7fc700 1 -- 172.21.15.84:0/2360455973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97a000ba50 con 0x7f97b00703f0 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97ae7fc700 1 -- 172.21.15.84:0/2360455973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a000bbb0 con 0x7f97b00703f0 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97ae7fc700 1 -- 172.21.15.84:0/2360455973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97a000be80 con 0x7f97b00703f0 2024-02-15T18:17:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97b5f2c700 1 -- 172.21.15.84:0/2360455973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 msgr2=0x7f97b00fea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97b5f2c700 1 --2- 172.21.15.84:0/2360455973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b00fea90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f97a0009960 tx=0x7f97a00092d0).stop 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97b5f2c700 1 -- 172.21.15.84:0/2360455973 shutdown_connections 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97b5f2c700 1 --2- 172.21.15.84:0/2360455973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b00fea90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97b5f2c700 1 -- 172.21.15.84:0/2360455973 >> 172.21.15.84:0/2360455973 conn(0x7f97b00f6530 msgr2=0x7f97b00f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97b5f2c700 1 -- 172.21.15.84:0/2360455973 shutdown_connections 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.294+0000 7f97b5f2c700 1 -- 172.21.15.84:0/2360455973 wait complete. 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.295+0000 7f97b5f2c700 1 Processor -- start 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.295+0000 7f97b5f2c700 1 -- start start 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.295+0000 7f97b5f2c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b010a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.295+0000 7f97b5f2c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b010a820 con 0x7f97b00703f0 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.295+0000 7f97af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b010a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.295+0000 7f97af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b010a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43066/0 (socket says 172.21.15.84:43066) 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.295+0000 7f97af7fe700 1 -- 172.21.15.84:0/3113427013 learned_addr learned my addr 172.21.15.84:0/3113427013 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.296+0000 7f97af7fe700 1 -- 172.21.15.84:0/3113427013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0009570 con 0x7f97b00703f0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.296+0000 7f97af7fe700 1 --2- 172.21.15.84:0/3113427013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b010a330 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f97a0009f20 tx=0x7f97a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.296+0000 7f9797fff700 1 -- 172.21.15.84:0/3113427013 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97a001c580 con 0x7f97b00703f0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.296+0000 7f9797fff700 1 -- 172.21.15.84:0/3113427013 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a001c6e0 con 0x7f97b00703f0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.296+0000 7f97b5f2c700 1 -- 172.21.15.84:0/3113427013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b010aa20 con 0x7f97b00703f0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.296+0000 7f9797fff700 1 -- 172.21.15.84:0/3113427013 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97a001c9b0 con 0x7f97b00703f0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.296+0000 7f97b5f2c700 1 -- 172.21.15.84:0/3113427013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b010aeb0 con 0x7f97b00703f0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.296+0000 7f9797fff700 1 -- 172.21.15.84:0/3113427013 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f97a002c070 con 0x7f97b00703f0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.296+0000 7f9797fff700 1 -- 172.21.15.84:0/3113427013 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f97a00256b0 con 0x7f97b00703f0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.297+0000 7f97b5f2c700 1 -- 172.21.15.84:0/3113427013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b0045ad0 con 0x7f97b00703f0 2024-02-15T18:17:28.300 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.299+0000 7f9797fff700 1 -- 172.21.15.84:0/3113427013 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f97a002a060 con 0x7f97b00703f0 2024-02-15T18:17:28.363 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.363+0000 7f97b5f2c700 1 -- 172.21.15.84:0/3113427013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f97b0027a00 con 0x7f97b00703f0 2024-02-15T18:17:28.369 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.366+0000 7f9797fff700 1 -- 172.21.15.84:0/3113427013 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f97a002e870 con 0x7f97b00703f0 2024-02-15T18:17:28.369 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.366+0000 7f9797fff700 1 -- 172.21.15.84:0/3113427013 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+489 (secure 0 0 0) 0x7f97a0033030 con 0x7f97b00703f0 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: [global] 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: fsid = 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: [mgr] 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-15T18:17:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: [osd] 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: osd_memory_target_autotune = true 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.367+0000 7f97b5f2c700 1 -- 172.21.15.84:0/3113427013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 msgr2=0x7f97b010a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.367+0000 7f97b5f2c700 1 --2- 172.21.15.84:0/3113427013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b010a330 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f97a0009f20 tx=0x7f97a0017000).stop 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.367+0000 7f97b5f2c700 1 -- 172.21.15.84:0/3113427013 shutdown_connections 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.367+0000 7f97b5f2c700 1 --2- 172.21.15.84:0/3113427013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b00703f0 0x7f97b010a330 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.367+0000 7f97b5f2c700 1 -- 172.21.15.84:0/3113427013 >> 172.21.15.84:0/3113427013 conn(0x7f97b00f6530 msgr2=0x7f97b00f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.367+0000 7f97b5f2c700 1 -- 172.21.15.84:0/3113427013 shutdown_connections 2024-02-15T18:17:28.371 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:28.367+0000 7f97b5f2c700 1 -- 172.21.15.84:0/3113427013 wait complete. 2024-02-15T18:17:28.701 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: audit 2024-02-15T18:17:28.364584+0000 mon.smithi084 (mon.0) 8 : audit [INF] from='client.? 172.21.15.84:0/3113427013' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-15T18:17:28.702 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: audit 2024-02-15T18:17:28.367527+0000 mon.smithi084 (mon.0) 9 : audit [INF] from='client.? 172.21.15.84:0/3113427013' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-15T18:17:28.962 INFO:teuthology.orchestra.run.smithi084.stderr:Generating new minimal ceph.conf... 2024-02-15T18:17:28.962 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z -v /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084:/var/lib/ceph/mon/ceph-smithi084:z docker.io/ceph/ceph:v16.2.4 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-smithi084/config 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.478+0000 7f5c31147700 1 Processor -- start 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.478+0000 7f5c31147700 1 -- start start 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.478+0000 7f5c31147700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.478+0000 7f5c31147700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c0faaa0 con 0x7f5c2c0fa190 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.478+0000 7f5c2ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.478+0000 7f5c2ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43070/0 (socket says 172.21.15.84:43070) 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.478+0000 7f5c2ad9d700 1 -- 172.21.15.84:0/700966802 learned_addr learned my addr 172.21.15.84:0/700966802 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c2ad9d700 1 -- 172.21.15.84:0/700966802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0fabe0 con 0x7f5c2c0fa190 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c2ad9d700 1 --2- 172.21.15.84:0/700966802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fa5b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f5c2000b5f0 tx=0x7f5c20006ee0).ready entity=mon.0 client_cookie=c799ef4477f29488 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c29d9b700 1 -- 172.21.15.84:0/700966802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c2000d600 con 0x7f5c2c0fa190 2024-02-15T18:17:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c29d9b700 1 -- 172.21.15.84:0/700966802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f5c2000dbf0 con 0x7f5c2c0fa190 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c29d9b700 1 -- 172.21.15.84:0/700966802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c20011cb0 con 0x7f5c2c0fa190 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c31147700 1 -- 172.21.15.84:0/700966802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 msgr2=0x7f5c2c0fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c31147700 1 --2- 172.21.15.84:0/700966802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fa5b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f5c2000b5f0 tx=0x7f5c20006ee0).stop 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c31147700 1 -- 172.21.15.84:0/700966802 shutdown_connections 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c31147700 1 --2- 172.21.15.84:0/700966802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fa5b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.479+0000 7f5c31147700 1 -- 172.21.15.84:0/700966802 >> 172.21.15.84:0/700966802 conn(0x7f5c2c0f5c30 msgr2=0x7f5c2c0f8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.480+0000 7f5c31147700 1 -- 172.21.15.84:0/700966802 shutdown_connections 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.480+0000 7f5c31147700 1 -- 172.21.15.84:0/700966802 wait complete. 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.480+0000 7f5c31147700 1 Processor -- start 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.480+0000 7f5c31147700 1 -- start start 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.480+0000 7f5c31147700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.480+0000 7f5c31147700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c0fb200 con 0x7f5c2c0fa190 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c2ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c2ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43082/0 (socket says 172.21.15.84:43082) 2024-02-15T18:17:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c2ad9d700 1 -- 172.21.15.84:0/3687613483 learned_addr learned my addr 172.21.15.84:0/3687613483 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c2ad9d700 1 -- 172.21.15.84:0/3687613483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2000b200 con 0x7f5c2c0fa190 2024-02-15T18:17:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c2ad9d700 1 --2- 172.21.15.84:0/3687613483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fcd80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5c20011ea0 tx=0x7f5c20006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c137fe700 1 -- 172.21.15.84:0/3687613483 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c2001b570 con 0x7f5c2c0fa190 2024-02-15T18:17:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c137fe700 1 -- 172.21.15.84:0/3687613483 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f5c2001bb60 con 0x7f5c2c0fa190 2024-02-15T18:17:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c31147700 1 -- 172.21.15.84:0/3687613483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c0fb3a0 con 0x7f5c2c0fa190 2024-02-15T18:17:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c137fe700 1 -- 172.21.15.84:0/3687613483 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c2001a8d0 con 0x7f5c2c0fa190 2024-02-15T18:17:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c31147700 1 -- 172.21.15.84:0/3687613483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2c0fb830 con 0x7f5c2c0fa190 2024-02-15T18:17:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c137fe700 1 -- 172.21.15.84:0/3687613483 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f5c2000f070 con 0x7f5c2c0fa190 2024-02-15T18:17:29.484 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.481+0000 7f5c137fe700 1 -- 172.21.15.84:0/3687613483 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f5c20025d00 con 0x7f5c2c0fa190 2024-02-15T18:17:29.485 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.482+0000 7f5c31147700 1 -- 172.21.15.84:0/3687613483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2c045ad0 con 0x7f5c2c0fa190 2024-02-15T18:17:29.485 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.484+0000 7f5c137fe700 1 -- 172.21.15.84:0/3687613483 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f5c20016070 con 0x7f5c2c0fa190 2024-02-15T18:17:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.547+0000 7f5c31147700 1 -- 172.21.15.84:0/3687613483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5c2c027ad0 con 0x7f5c2c0fa190 2024-02-15T18:17:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.547+0000 7f5c137fe700 1 -- 172.21.15.84:0/3687613483 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f5c20025460 con 0x7f5c2c0fa190 2024-02-15T18:17:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.548+0000 7f5c31147700 1 -- 172.21.15.84:0/3687613483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 msgr2=0x7f5c2c0fcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.548+0000 7f5c31147700 1 --2- 172.21.15.84:0/3687613483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fcd80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5c20011ea0 tx=0x7f5c20006ee0).stop 2024-02-15T18:17:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.548+0000 7f5c31147700 1 -- 172.21.15.84:0/3687613483 shutdown_connections 2024-02-15T18:17:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.548+0000 7f5c31147700 1 --2- 172.21.15.84:0/3687613483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c2c0fa190 0x7f5c2c0fcd80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.548+0000 7f5c31147700 1 -- 172.21.15.84:0/3687613483 >> 172.21.15.84:0/3687613483 conn(0x7f5c2c0f5c30 msgr2=0x7f5c2c0f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.548+0000 7f5c31147700 1 -- 172.21.15.84:0/3687613483 shutdown_connections 2024-02-15T18:17:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:29.548+0000 7f5c31147700 1 -- 172.21.15.84:0/3687613483 wait complete. 2024-02-15T18:17:29.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: audit 2024-02-15T18:17:29.548545+0000 mon.smithi084 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.84:0/3687613483' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:17:30.137 INFO:teuthology.orchestra.run.smithi084.stderr:Restarting the monitor... 2024-02-15T18:17:30.137 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl restart ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084 2024-02-15T18:17:30.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:30 smithi084 systemd[1]: Stopping Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:17:30.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: debug 2024-02-15T18:17:30.284+0000 7f757249e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi084 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:17:30.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[37801]: debug 2024-02-15T18:17:30.284+0000 7f757249e700 -1 mon.smithi084@0(leader) e1 *** Got Signal Terminated *** 2024-02-15T18:17:31.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:30 smithi084 podman[38124]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084 2024-02-15T18:17:31.496 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 systemd[1]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084.service: Succeeded. 2024-02-15T18:17:31.496 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 systemd[1]: Stopped Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:17:31.496 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 systemd[1]: Starting Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:17:31.626 INFO:teuthology.orchestra.run.smithi084.stderr:Setting mon public_network to 172.21.0.0/20 2024-02-15T18:17:31.626 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mon public_network 172.21.0.0/20 2024-02-15T18:17:31.859 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.582+0000 7f74d1f77700 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-15T18:17:31.859 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.582+0000 7f74d1f77700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.582+0000 7f74d1f77700 0 pidfile_write: ignore empty --pid-file 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.586+0000 7f74d1f77700 0 load: jerasure load: lrc load: isa 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: RocksDB version: 6.8.1 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Compile date May 13 2021 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: DB SUMMARY 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: CURRENT file: CURRENT 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.860 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: IDENTITY file: IDENTITY 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi084/store.db dir, Total Num: 1, files: 000004.sst 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi084/store.db: 000006.log size: 98708 ; 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.error_if_exists: 0 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.create_if_missing: 0 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.paranoid_checks: 1 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.env: 0x55659a2451c0 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.fs: Posix File System 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.info_log: 0x55659b715960 2024-02-15T18:17:31.861 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.statistics: (nil) 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.use_fsync: 0 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_log_file_size: 0 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.allow_fallocate: 1 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.use_direct_reads: 0 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.create_missing_column_families: 0 2024-02-15T18:17:31.862 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.db_log_dir: 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi084/store.db 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_subcompactions: 1 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_background_flushes: -1 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.advise_random_on_open: 1 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.write_buffer_manager: 0x55659c38a030 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T18:17:31.863 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.rate_limiter: (nil) 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.unordered_write: 0 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.row_cache: None 2024-02-15T18:17:31.864 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.wal_filter: None 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.preserve_deletes: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.two_write_queues: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.manual_wal_flush: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.atomic_flush: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.log_readahead_size: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_background_jobs: 2 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_background_compactions: -1 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T18:17:31.865 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_total_wal_size: 0 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_open_files: -1 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.bytes_per_sync: 0 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Compression algorithms supported: 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T18:17:31.866 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: kZSTD supported: 0 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: kXpressCompression supported: 0 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: kLZ4Compression supported: 1 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: kBZip2Compression supported: 0 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: kZlibCompression supported: 1 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: kSnappyCompression supported: 1 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000005 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.merge_operator: 2024-02-15T18:17:31.867 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_filter: None 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_filter_factory: None 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55659b62dcb0) 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cache_index_and_filter_blocks: 1 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: pin_top_level_index_and_filter: 1 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: index_type: 0 2024-02-15T18:17:31.868 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: data_block_index_type: 0 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: index_shortening: 1 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: data_block_hash_table_util_ratio: 0.750000 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: hash_index_allow_collision: 1 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: checksum: 1 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: no_block_cache: 0 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: block_cache: 0x55659b662f10 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: block_cache_name: BinnedLRUCache 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: block_cache_options: 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: capacity : 536870912 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: num_shard_bits : 4 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: strict_capacity_limit : 0 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: high_pri_pool_ratio: 0.000 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: block_cache_compressed: (nil) 2024-02-15T18:17:31.869 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: persistent_cache: (nil) 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: block_size: 4096 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: block_size_deviation: 10 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: block_restart_interval: 16 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: index_block_restart_interval: 1 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: metadata_block_size: 4096 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: partition_filters: 0 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: use_delta_encoding: 1 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: whole_key_filtering: 1 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: verify_compression: 0 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: read_amp_bytes_per_bit: 0 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: format_version: 2 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: enable_index_compression: 1 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: block_align: 0 2024-02-15T18:17:31.870 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compression: NoCompression 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.num_levels: 7 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T18:17:31.871 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compression_opts.level: 32767 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compression_opts.enabled: false 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T18:17:31.872 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.arena_block_size: 4194304 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T18:17:31.873 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.table_properties_collectors: 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.inplace_update_support: 0 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T18:17:31.874 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.bloom_locality: 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.max_successive_merges: 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.force_consistency_checks: 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.ttl: 2592000 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.587+0000 7f74d1f77700 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.588+0000 7f74d1f77700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.588+0000 7f74d1f77700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-02-15T18:17:31.875 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.588+0000 7f74d1f77700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021051588926, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.588+0000 7f74d1f77700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.588+0000 7f74d1f77700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.589+0000 7f74d1f77700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021051589772, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 94282, "table_properties": {"data_size": 92370, "index_size": 389, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12563, "raw_average_key_size": 49, "raw_value_size": 85401, "raw_average_value_size": 336, "num_data_blocks": 12, "num_entries": 254, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708021051, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.589+0000 7f74d1f77700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.589+0000 7f74d1f77700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021051590147, "job": 1, "event": "recovery_finished"} 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.590+0000 7f74d1f77700 4 rocksdb: DB pointer 0x55659b727800 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.590+0000 7f74b8d8f700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.590+0000 7f74b8d8f700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ** DB Stats ** 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T18:17:31.876 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T18:17:31.877 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:17:31.877 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ** Compaction Stats [default] ** 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: L0 2/0 93.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.001 0 0 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Sum 2/0 93.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.001 0 0 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.001 0 0 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ** Compaction Stats [default] ** 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:17:31.878 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 161.1 0.00 0.00 1 0.001 0 0 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Cumulative compaction: 0.00 GB write, 32.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Interval compaction: 0.00 GB write, 32.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ** Compaction Stats [default] ** 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:17:31.879 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: L0 2/0 93.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.001 0 0 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Sum 2/0 93.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.001 0 0 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ** Compaction Stats [default] ** 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 161.1 0.00 0.00 1 0.001 0 0 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:17:31.880 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Cumulative compaction: 0.00 GB write, 32.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.590+0000 7f74d1f77700 0 starting mon.smithi084 rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi084 fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.591+0000 7f74d1f77700 1 mon.smithi084@-1(???) e1 preinit fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.591+0000 7f74d1f77700 0 mon.smithi084@-1(???).mds e1 new map 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.591+0000 7f74d1f77700 0 mon.smithi084@-1(???).mds e1 print_map 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: e1 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:17:31.881 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: legacy client fscid: -1 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: No filesystems configured 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.591+0000 7f74d1f77700 0 mon.smithi084@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.591+0000 7f74d1f77700 0 mon.smithi084@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.591+0000 7f74d1f77700 0 mon.smithi084@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.591+0000 7f74d1f77700 0 mon.smithi084@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:29.548545+0000 mon.smithi084 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.84:0/3687613483' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.591+0000 7f74d1f77700 1 mon.smithi084@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta expand map: {default=false} 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta from 'false' to 'false' 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta expanded map: {default=false} 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta expand map: {default=info} 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta from 'info' to 'info' 2024-02-15T18:17:31.882 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta expanded map: {default=info} 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta expand map: {default=daemon} 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta from 'daemon' to 'daemon' 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta expanded map: {default=daemon} 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta expand map: {default=debug} 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta from 'debug' to 'debug' 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:17:31.592+0000 7f74d1f77700 20 expand_channel_meta expanded map: {default=debug} 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 bash[38195]: 77f1f72e867cee3ecfe8affd4e5e55b3cf343da9936305f3a08f8133bdaade79 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 systemd[1]: Started Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:31.608511+0000 mon.smithi084 (mon.0) 1 : cluster [INF] mon.smithi084 is new leader, mons smithi084 in quorum (ranks 0) 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:31.608573+0000 mon.smithi084 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0]} 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:31.608602+0000 mon.smithi084 (mon.0) 3 : cluster [DBG] fsmap 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:31.608624+0000 mon.smithi084 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-15T18:17:31.883 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:31.608980+0000 mon.smithi084 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-15T18:17:32.127 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.125+0000 7f418af6b700 1 Processor -- start 2024-02-15T18:17:32.127 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.126+0000 7f418af6b700 1 -- start start 2024-02-15T18:17:32.127 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.126+0000 7f418af6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f4184100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.126+0000 7f418af6b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840fc6c0 con 0x7f41840703f0 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.126+0000 7f4189f69700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f4184100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.126+0000 7f4189f69700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f4184100cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43092/0 (socket says 172.21.15.84:43092) 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.126+0000 7f4189f69700 1 -- 172.21.15.84:0/3481905363 learned_addr learned my addr 172.21.15.84:0/3481905363 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.127+0000 7f4189f69700 1 -- 172.21.15.84:0/3481905363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41841011c0 con 0x7f41840703f0 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.127+0000 7f4189f69700 1 --2- 172.21.15.84:0/3481905363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f4184100cd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f417800b5f0 tx=0x7f4178006ee0).ready entity=mon.0 client_cookie=d6f66db13d60f6cc server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.127+0000 7f4188f67700 1 -- 172.21.15.84:0/3481905363 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f417800d600 con 0x7f41840703f0 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.127+0000 7f4188f67700 1 -- 172.21.15.84:0/3481905363 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f417800dbf0 con 0x7f41840703f0 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.127+0000 7f4188f67700 1 -- 172.21.15.84:0/3481905363 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4178011ce0 con 0x7f41840703f0 2024-02-15T18:17:32.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.128+0000 7f418af6b700 1 -- 172.21.15.84:0/3481905363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 msgr2=0x7f4184100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:32.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.128+0000 7f418af6b700 1 --2- 172.21.15.84:0/3481905363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f4184100cd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f417800b5f0 tx=0x7f4178006ee0).stop 2024-02-15T18:17:32.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.128+0000 7f418af6b700 1 -- 172.21.15.84:0/3481905363 shutdown_connections 2024-02-15T18:17:32.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.128+0000 7f418af6b700 1 --2- 172.21.15.84:0/3481905363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f4184100cd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:32.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.128+0000 7f418af6b700 1 -- 172.21.15.84:0/3481905363 >> 172.21.15.84:0/3481905363 conn(0x7f41840f6390 msgr2=0x7f41840f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:32.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.128+0000 7f418af6b700 1 -- 172.21.15.84:0/3481905363 shutdown_connections 2024-02-15T18:17:32.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.128+0000 7f418af6b700 1 -- 172.21.15.84:0/3481905363 wait complete. 2024-02-15T18:17:32.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.128+0000 7f418af6b700 1 Processor -- start 2024-02-15T18:17:32.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.128+0000 7f418af6b700 1 -- start start 2024-02-15T18:17:32.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f418af6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f418410cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f418af6b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418410d070 con 0x7f41840703f0 2024-02-15T18:17:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f4189f69700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f418410cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f4189f69700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f418410cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43098/0 (socket says 172.21.15.84:43098) 2024-02-15T18:17:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f4189f69700 1 -- 172.21.15.84:0/3847918661 learned_addr learned my addr 172.21.15.84:0/3847918661 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f4189f69700 1 -- 172.21.15.84:0/3847918661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417800b200 con 0x7f41840703f0 2024-02-15T18:17:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f4189f69700 1 --2- 172.21.15.84:0/3847918661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f418410cb80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f4178011ed0 tx=0x7f4178006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f41767fc700 1 -- 172.21.15.84:0/3847918661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f417801b570 con 0x7f41840703f0 2024-02-15T18:17:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f41767fc700 1 -- 172.21.15.84:0/3847918661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f417801bb60 con 0x7f41840703f0 2024-02-15T18:17:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f418af6b700 1 -- 172.21.15.84:0/3847918661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418410d270 con 0x7f41840703f0 2024-02-15T18:17:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f41767fc700 1 -- 172.21.15.84:0/3847918661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f417801aad0 con 0x7f41840703f0 2024-02-15T18:17:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.129+0000 7f418af6b700 1 -- 172.21.15.84:0/3847918661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418410d700 con 0x7f41840703f0 2024-02-15T18:17:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.130+0000 7f41767fc700 1 -- 172.21.15.84:0/3847918661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f417800f070 con 0x7f41840703f0 2024-02-15T18:17:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.130+0000 7f41767fc700 1 -- 172.21.15.84:0/3847918661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4178025cb0 con 0x7f41840703f0 2024-02-15T18:17:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.131+0000 7f418af6b700 1 -- 172.21.15.84:0/3847918661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4184045ad0 con 0x7f41840703f0 2024-02-15T18:17:32.133 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.133+0000 7f41767fc700 1 -- 172.21.15.84:0/3847918661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f4178016070 con 0x7f41840703f0 2024-02-15T18:17:32.196 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.196+0000 7f418af6b700 1 -- 172.21.15.84:0/3847918661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f4184101e40 con 0x7f41840703f0 2024-02-15T18:17:32.198 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.198+0000 7f41767fc700 1 -- 172.21.15.84:0/3847918661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4178025460 con 0x7f41840703f0 2024-02-15T18:17:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.199+0000 7f418af6b700 1 -- 172.21.15.84:0/3847918661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 msgr2=0x7f418410cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.199+0000 7f418af6b700 1 --2- 172.21.15.84:0/3847918661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f418410cb80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f4178011ed0 tx=0x7f4178006ee0).stop 2024-02-15T18:17:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.199+0000 7f418af6b700 1 -- 172.21.15.84:0/3847918661 shutdown_connections 2024-02-15T18:17:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.199+0000 7f418af6b700 1 --2- 172.21.15.84:0/3847918661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41840703f0 0x7f418410cb80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:32.199 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.199+0000 7f418af6b700 1 -- 172.21.15.84:0/3847918661 >> 172.21.15.84:0/3847918661 conn(0x7f41840f6390 msgr2=0x7f41840f7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:32.200 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.199+0000 7f418af6b700 1 -- 172.21.15.84:0/3847918661 shutdown_connections 2024-02-15T18:17:32.200 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:32.199+0000 7f418af6b700 1 -- 172.21.15.84:0/3847918661 wait complete. 2024-02-15T18:17:32.749 INFO:teuthology.orchestra.run.smithi084.stderr:Wrote config to /etc/ceph/ceph.conf 2024-02-15T18:17:32.749 INFO:teuthology.orchestra.run.smithi084.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:17:32.749 INFO:teuthology.orchestra.run.smithi084.stderr:Creating mgr... 2024-02-15T18:17:32.750 INFO:teuthology.orchestra.run.smithi084.stderr:Verifying port 9283 ... 2024-02-15T18:17:32.751 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl daemon-reload 2024-02-15T18:17:32.846 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mgr.smithi084.hjmnez 2024-02-15T18:17:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl reset-failed ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mgr.smithi084.hjmnez 2024-02-15T18:17:32.879 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Failed to reset failed state of unit ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mgr.smithi084.hjmnez.service: Unit ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mgr.smithi084.hjmnez.service not loaded. 2024-02-15T18:17:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl enable ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mgr.smithi084.hjmnez 2024-02-15T18:17:32.886 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: Created symlink /etc/systemd/system/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715.target.wants/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mgr.smithi084.hjmnez.service → /etc/systemd/system/ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@.service. 2024-02-15T18:17:32.967 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl start ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mgr.smithi084.hjmnez 2024-02-15T18:17:33.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:32.199007+0000 mon.smithi084 (mon.0) 6 : audit [INF] from='client.? 172.21.15.84:0/3847918661' entity='client.admin' 2024-02-15T18:17:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-enabled firewalld.service 2024-02-15T18:17:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: disabled 2024-02-15T18:17:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-active firewalld.service 2024-02-15T18:17:34.860 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: inactive 2024-02-15T18:17:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:firewalld.service is not enabled 2024-02-15T18:17:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:Not possible to enable service . firewalld.service is not available 2024-02-15T18:17:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:Not possible to open ports <[]>. firewalld.service is not available 2024-02-15T18:17:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-enabled firewalld.service 2024-02-15T18:17:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: disabled 2024-02-15T18:17:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-active firewalld.service 2024-02-15T18:17:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: inactive 2024-02-15T18:17:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:firewalld.service is not enabled 2024-02-15T18:17:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-15T18:17:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:Waiting for mgr to start... 2024-02-15T18:17:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:Waiting for mgr... 2024-02-15T18:17:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2024-02-15T18:17:36.211 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.208+0000 7f8a00b50700 1 Processor -- start 2024-02-15T18:17:36.211 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.208+0000 7f8a00b50700 1 -- start start 2024-02-15T18:17:36.211 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.209+0000 7f8a00b50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:36.211 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.209+0000 7f8a00b50700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0728d0 con 0x7f89fc0724b0 2024-02-15T18:17:36.211 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.209+0000 7f89fa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:36.211 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.209+0000 7f89fa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40014/0 (socket says 172.21.15.84:40014) 2024-02-15T18:17:36.211 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.209+0000 7f89fa59c700 1 -- 172.21.15.84:0/6364049 learned_addr learned my addr 172.21.15.84:0/6364049 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.209+0000 7f89fa59c700 1 -- 172.21.15.84:0/6364049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc070f40 con 0x7f89fc0724b0 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.209+0000 7f89fa59c700 1 --2- 172.21.15.84:0/6364049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc070a50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f89ec00b5f0 tx=0x7f89ec006ee0).ready entity=mon.0 client_cookie=1a9d2d829fb98dd2 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.210+0000 7f89f959a700 1 -- 172.21.15.84:0/6364049 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89ec00d600 con 0x7f89fc0724b0 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.210+0000 7f89f959a700 1 -- 172.21.15.84:0/6364049 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f89ec00dbf0 con 0x7f89fc0724b0 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.210+0000 7f89f959a700 1 -- 172.21.15.84:0/6364049 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89ec011cb0 con 0x7f89fc0724b0 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.211+0000 7f8a00b50700 1 -- 172.21.15.84:0/6364049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 msgr2=0x7f89fc070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.211+0000 7f8a00b50700 1 --2- 172.21.15.84:0/6364049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc070a50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f89ec00b5f0 tx=0x7f89ec006ee0).stop 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.211+0000 7f8a00b50700 1 -- 172.21.15.84:0/6364049 shutdown_connections 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.211+0000 7f8a00b50700 1 --2- 172.21.15.84:0/6364049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc070a50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:36.212 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.211+0000 7f8a00b50700 1 -- 172.21.15.84:0/6364049 >> 172.21.15.84:0/6364049 conn(0x7f89fc0f7640 msgr2=0x7f89fc0f9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:36.213 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.211+0000 7f8a00b50700 1 -- 172.21.15.84:0/6364049 shutdown_connections 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.211+0000 7f8a00b50700 1 -- 172.21.15.84:0/6364049 wait complete. 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.212+0000 7f8a00b50700 1 Processor -- start 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.212+0000 7f8a00b50700 1 -- start start 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.212+0000 7f8a00b50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc10cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.212+0000 7f8a00b50700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc10d2c0 con 0x7f89fc0724b0 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.212+0000 7f89fa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc10cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.212+0000 7f89fa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc10cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40030/0 (socket says 172.21.15.84:40030) 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.212+0000 7f89fa59c700 1 -- 172.21.15.84:0/742480357 learned_addr learned my addr 172.21.15.84:0/742480357 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.212+0000 7f89fa59c700 1 -- 172.21.15.84:0/742480357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec00b200 con 0x7f89fc0724b0 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.213+0000 7f89fa59c700 1 --2- 172.21.15.84:0/742480357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc10cdd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f89ec00df90 tx=0x7f89ec006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.213+0000 7f89eaffd700 1 -- 172.21.15.84:0/742480357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89ec01b410 con 0x7f89fc0724b0 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.213+0000 7f89eaffd700 1 -- 172.21.15.84:0/742480357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f89ec01ba00 con 0x7f89fc0724b0 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.213+0000 7f89eaffd700 1 -- 172.21.15.84:0/742480357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89ec01aa30 con 0x7f89fc0724b0 2024-02-15T18:17:36.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.213+0000 7f8a00b50700 1 -- 172.21.15.84:0/742480357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc10d4c0 con 0x7f89fc0724b0 2024-02-15T18:17:36.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.213+0000 7f8a00b50700 1 -- 172.21.15.84:0/742480357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc10e100 con 0x7f89fc0724b0 2024-02-15T18:17:36.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.213+0000 7f89eaffd700 1 -- 172.21.15.84:0/742480357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f89ec00f070 con 0x7f89fc0724b0 2024-02-15T18:17:36.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.213+0000 7f89eaffd700 1 -- 172.21.15.84:0/742480357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f89ec025c80 con 0x7f89fc0724b0 2024-02-15T18:17:36.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.214+0000 7f8a00b50700 1 -- 172.21.15.84:0/742480357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc10d950 con 0x7f89fc0724b0 2024-02-15T18:17:36.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.216+0000 7f89eaffd700 1 -- 172.21.15.84:0/742480357 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f89ec016070 con 0x7f89fc0724b0 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.285+0000 7f8a00b50700 1 -- 172.21.15.84:0/742480357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f89fc1020d0 con 0x7f89fc0724b0 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.285+0000 7f89eaffd700 1 -- 172.21.15.84:0/742480357 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f89ec025460 con 0x7f89fc0724b0 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: { 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "fsid": "631a4cdc-cc2e-11ee-95ba-87774f69a715", 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "health": { 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "checks": {}, 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "mutes": [] 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "quorum": [ 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 0 2024-02-15T18:17:36.291 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ], 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "smithi084" 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ], 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "quorum_age": 4, 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "monmap": { 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "osdmap": { 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-15T18:17:36.292 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "pgmap": { 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "fsmap": { 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-15T18:17:36.293 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "available": false, 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "modules": [ 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "iostat", 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "restful" 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ], 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "servicemap": { 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "modified": "2024-02-15T18:17:26.592730+0000", 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-15T18:17:36.294 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: } 2024-02-15T18:17:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.286+0000 7f8a00b50700 1 -- 172.21.15.84:0/742480357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 msgr2=0x7f89fc10cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.286+0000 7f8a00b50700 1 --2- 172.21.15.84:0/742480357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc10cdd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f89ec00df90 tx=0x7f89ec006ee0).stop 2024-02-15T18:17:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.286+0000 7f8a00b50700 1 -- 172.21.15.84:0/742480357 shutdown_connections 2024-02-15T18:17:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.286+0000 7f8a00b50700 1 --2- 172.21.15.84:0/742480357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc0724b0 0x7f89fc10cdd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.286+0000 7f8a00b50700 1 -- 172.21.15.84:0/742480357 >> 172.21.15.84:0/742480357 conn(0x7f89fc0f7640 msgr2=0x7f89fc0f90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.286+0000 7f8a00b50700 1 -- 172.21.15.84:0/742480357 shutdown_connections 2024-02-15T18:17:36.295 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:36.286+0000 7f8a00b50700 1 -- 172.21.15.84:0/742480357 wait complete. 2024-02-15T18:17:36.660 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:36.286171+0000 mon.smithi084 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.84:0/742480357' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T18:17:36.930 INFO:teuthology.orchestra.run.smithi084.stderr:mgr not available, waiting (1/15)... 2024-02-15T18:17:38.932 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2024-02-15T18:17:39.457 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.454+0000 7f0bd153e700 1 Processor -- start 2024-02-15T18:17:39.457 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.454+0000 7f0bd153e700 1 -- start start 2024-02-15T18:17:39.457 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.455+0000 7f0bd153e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0feab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:39.457 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.455+0000 7f0bd153e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0fefa0 con 0x7f0bcc0703d0 2024-02-15T18:17:39.457 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.455+0000 7f0bcaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:39.457 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.455+0000 7f0bcaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0feab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40070/0 (socket says 172.21.15.84:40070) 2024-02-15T18:17:39.457 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.455+0000 7f0bcaffd700 1 -- 172.21.15.84:0/2159204178 learned_addr learned my addr 172.21.15.84:0/2159204178 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:39.457 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.455+0000 7f0bcaffd700 1 -- 172.21.15.84:0/2159204178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0ff0e0 con 0x7f0bcc0703d0 2024-02-15T18:17:39.457 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.455+0000 7f0bcaffd700 1 --2- 172.21.15.84:0/2159204178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0feab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0bc000b5f0 tx=0x7f0bc0006ee0).ready entity=mon.0 client_cookie=d4f7cebd5e702638 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:39.458 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.455+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/2159204178 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bc000d600 con 0x7f0bcc0703d0 2024-02-15T18:17:39.458 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.456+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/2159204178 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f0bc000dbf0 con 0x7f0bcc0703d0 2024-02-15T18:17:39.458 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.456+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/2159204178 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bc0011cb0 con 0x7f0bcc0703d0 2024-02-15T18:17:39.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.456+0000 7f0bd153e700 1 -- 172.21.15.84:0/2159204178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 msgr2=0x7f0bcc0feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:39.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.456+0000 7f0bd153e700 1 --2- 172.21.15.84:0/2159204178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0feab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0bc000b5f0 tx=0x7f0bc0006ee0).stop 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.456+0000 7f0bd153e700 1 -- 172.21.15.84:0/2159204178 shutdown_connections 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.456+0000 7f0bd153e700 1 --2- 172.21.15.84:0/2159204178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0feab0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.456+0000 7f0bd153e700 1 -- 172.21.15.84:0/2159204178 >> 172.21.15.84:0/2159204178 conn(0x7f0bcc0f6530 msgr2=0x7f0bcc0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.456+0000 7f0bd153e700 1 -- 172.21.15.84:0/2159204178 shutdown_connections 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.456+0000 7f0bd153e700 1 -- 172.21.15.84:0/2159204178 wait complete. 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.457+0000 7f0bd153e700 1 Processor -- start 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.457+0000 7f0bd153e700 1 -- start start 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.457+0000 7f0bd153e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0fc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.457+0000 7f0bd153e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0fa9b0 con 0x7f0bcc0703d0 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.457+0000 7f0bcaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.458+0000 7f0bcaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0fc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40076/0 (socket says 172.21.15.84:40076) 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.458+0000 7f0bcaffd700 1 -- 172.21.15.84:0/1997943900 learned_addr learned my addr 172.21.15.84:0/1997943900 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.458+0000 7f0bcaffd700 1 -- 172.21.15.84:0/1997943900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc000b200 con 0x7f0bcc0703d0 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.458+0000 7f0bcaffd700 1 --2- 172.21.15.84:0/1997943900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0fc530 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0bc0006c70 tx=0x7f0bc0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.458+0000 7f0bb37fe700 1 -- 172.21.15.84:0/1997943900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bc0011400 con 0x7f0bcc0703d0 2024-02-15T18:17:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.458+0000 7f0bb37fe700 1 -- 172.21.15.84:0/1997943900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f0bc001b8a0 con 0x7f0bcc0703d0 2024-02-15T18:17:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.458+0000 7f0bd153e700 1 -- 172.21.15.84:0/1997943900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc0fab50 con 0x7f0bcc0703d0 2024-02-15T18:17:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.458+0000 7f0bb37fe700 1 -- 172.21.15.84:0/1997943900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bc001a7c0 con 0x7f0bcc0703d0 2024-02-15T18:17:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.458+0000 7f0bd153e700 1 -- 172.21.15.84:0/1997943900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc0fafe0 con 0x7f0bcc0703d0 2024-02-15T18:17:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.459+0000 7f0bb37fe700 1 -- 172.21.15.84:0/1997943900 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 2) v1 ==== 35959+0+0 (secure 0 0 0) 0x7f0bc000f070 con 0x7f0bcc0703d0 2024-02-15T18:17:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.459+0000 7f0bb37fe700 1 -- 172.21.15.84:0/1997943900 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0bc0041f90 con 0x7f0bcc0703d0 2024-02-15T18:17:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.459+0000 7f0bd153e700 1 -- 172.21.15.84:0/1997943900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc059100 con 0x7f0bcc0703d0 2024-02-15T18:17:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.461+0000 7f0bb37fe700 1 -- 172.21.15.84:0/1997943900 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f0bc0016070 con 0x7f0bcc0703d0 2024-02-15T18:17:39.537 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.527+0000 7f0bd153e700 1 -- 172.21.15.84:0/1997943900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0bcc045ad0 con 0x7f0bcc0703d0 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.528+0000 7f0bb37fe700 1 -- 172.21.15.84:0/1997943900 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f0bc0025460 con 0x7f0bcc0703d0 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: { 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "fsid": "631a4cdc-cc2e-11ee-95ba-87774f69a715", 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "health": { 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "checks": {}, 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "mutes": [] 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "quorum": [ 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 0 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ], 2024-02-15T18:17:39.538 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "smithi084" 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ], 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "quorum_age": 7, 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "monmap": { 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "osdmap": { 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-15T18:17:39.539 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "pgmap": { 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "fsmap": { 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:39.540 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "available": false, 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "modules": [ 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "iostat", 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "restful" 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ], 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "servicemap": { 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "modified": "2024-02-15T18:17:26.592730+0000", 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:39.541 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-15T18:17:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: } 2024-02-15T18:17:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.528+0000 7f0bd153e700 1 -- 172.21.15.84:0/1997943900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 msgr2=0x7f0bcc0fc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.528+0000 7f0bd153e700 1 --2- 172.21.15.84:0/1997943900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0fc530 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0bc0006c70 tx=0x7f0bc0006ee0).stop 2024-02-15T18:17:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.529+0000 7f0bd153e700 1 -- 172.21.15.84:0/1997943900 shutdown_connections 2024-02-15T18:17:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.529+0000 7f0bd153e700 1 --2- 172.21.15.84:0/1997943900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0703d0 0x7f0bcc0fc530 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.529+0000 7f0bd153e700 1 -- 172.21.15.84:0/1997943900 >> 172.21.15.84:0/1997943900 conn(0x7f0bcc0f6530 msgr2=0x7f0bcc0f7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.529+0000 7f0bd153e700 1 -- 172.21.15.84:0/1997943900 shutdown_connections 2024-02-15T18:17:39.542 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:39.529+0000 7f0bd153e700 1 -- 172.21.15.84:0/1997943900 wait complete. 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:39.345815+0000 mon.smithi084 (mon.0) 8 : cluster [INF] Activating manager daemon smithi084.hjmnez 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:39.348366+0000 mon.smithi084 (mon.0) 9 : cluster [DBG] mgrmap e2: smithi084.hjmnez(active, starting, since 0.00266508s) 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.349203+0000 mon.smithi084 (mon.0) 10 : audit [DBG] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.349315+0000 mon.smithi084 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.349424+0000 mon.smithi084 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.349529+0000 mon.smithi084 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.349890+0000 mon.smithi084 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi084.hjmnez", "id": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:39.363593+0000 mon.smithi084 (mon.0) 15 : cluster [INF] Manager daemon smithi084.hjmnez is now available 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.371906+0000 mon.smithi084 (mon.0) 16 : audit [INF] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.375539+0000 mon.smithi084 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:17:39.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.376696+0000 mon.smithi084 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:17:39.765 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.381775+0000 mon.smithi084 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' 2024-02-15T18:17:39.765 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.383714+0000 mon.smithi084 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.84:0/3920980351' entity='mgr.smithi084.hjmnez' 2024-02-15T18:17:40.152 INFO:teuthology.orchestra.run.smithi084.stderr:mgr not available, waiting (2/15)... 2024-02-15T18:17:40.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:39.528899+0000 mon.smithi084 (mon.0) 21 : audit [DBG] from='client.? 172.21.15.84:0/1997943900' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T18:17:40.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:40.351076+0000 mon.smithi084 (mon.0) 22 : cluster [DBG] mgrmap e3: smithi084.hjmnez(active, since 1.00537s) 2024-02-15T18:17:42.155 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.655+0000 7f0ef0593700 1 Processor -- start 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.655+0000 7f0ef0593700 1 -- start start 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.655+0000 7f0ef0593700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.655+0000 7f0ef0593700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80fef80 con 0x7f0ee80703f0 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.656+0000 7f0eee32f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.656+0000 7f0eee32f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40084/0 (socket says 172.21.15.84:40084) 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.656+0000 7f0eee32f700 1 -- 172.21.15.84:0/2214938307 learned_addr learned my addr 172.21.15.84:0/2214938307 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.656+0000 7f0eee32f700 1 -- 172.21.15.84:0/2214938307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80ff0c0 con 0x7f0ee80703f0 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.656+0000 7f0eee32f700 1 --2- 172.21.15.84:0/2214938307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fea90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f0ed800b5f0 tx=0x7f0ed8006ee0).ready entity=mon.0 client_cookie=9fe285ab21e3d59f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.656+0000 7f0eed32d700 1 -- 172.21.15.84:0/2214938307 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ed800d600 con 0x7f0ee80703f0 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.656+0000 7f0eed32d700 1 -- 172.21.15.84:0/2214938307 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f0ed800dbf0 con 0x7f0ee80703f0 2024-02-15T18:17:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.656+0000 7f0eed32d700 1 -- 172.21.15.84:0/2214938307 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ed8011ce0 con 0x7f0ee80703f0 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.657+0000 7f0ef0593700 1 -- 172.21.15.84:0/2214938307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 msgr2=0x7f0ee80fea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.657+0000 7f0ef0593700 1 --2- 172.21.15.84:0/2214938307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fea90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f0ed800b5f0 tx=0x7f0ed8006ee0).stop 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.657+0000 7f0ef0593700 1 -- 172.21.15.84:0/2214938307 shutdown_connections 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.657+0000 7f0ef0593700 1 --2- 172.21.15.84:0/2214938307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fea90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.657+0000 7f0ef0593700 1 -- 172.21.15.84:0/2214938307 >> 172.21.15.84:0/2214938307 conn(0x7f0ee80f6530 msgr2=0x7f0ee80f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.657+0000 7f0ef0593700 1 -- 172.21.15.84:0/2214938307 shutdown_connections 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.657+0000 7f0ef0593700 1 -- 172.21.15.84:0/2214938307 wait complete. 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.657+0000 7f0ef0593700 1 Processor -- start 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.657+0000 7f0ef0593700 1 -- start start 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0ef0593700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0ef0593700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80fa990 con 0x7f0ee80703f0 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0eee32f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0eee32f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40088/0 (socket says 172.21.15.84:40088) 2024-02-15T18:17:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0eee32f700 1 -- 172.21.15.84:0/3369883939 learned_addr learned my addr 172.21.15.84:0/3369883939 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0eee32f700 1 -- 172.21.15.84:0/3369883939 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed800b200 con 0x7f0ee80703f0 2024-02-15T18:17:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0eee32f700 1 --2- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fc510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0ed8011ed0 tx=0x7f0ed8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0ed6ffd700 1 -- 172.21.15.84:0/3369883939 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ed801b570 con 0x7f0ee80703f0 2024-02-15T18:17:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0ed6ffd700 1 -- 172.21.15.84:0/3369883939 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f0ed801bb60 con 0x7f0ee80703f0 2024-02-15T18:17:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0ed6ffd700 1 -- 172.21.15.84:0/3369883939 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ed801aad0 con 0x7f0ee80703f0 2024-02-15T18:17:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee80fab30 con 0x7f0ee80703f0 2024-02-15T18:17:42.662 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.658+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee80fafc0 con 0x7f0ee80703f0 2024-02-15T18:17:42.662 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.659+0000 7f0ed6ffd700 1 -- 172.21.15.84:0/3369883939 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 36109+0+0 (secure 0 0 0) 0x7f0ed800f070 con 0x7f0ee80703f0 2024-02-15T18:17:42.662 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.659+0000 7f0ed6ffd700 1 --2- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7f0ed002fe10 0x7f0ed00322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:42.662 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.659+0000 7f0ed6ffd700 1 -- 172.21.15.84:0/3369883939 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0ed8041290 con 0x7f0ee80703f0 2024-02-15T18:17:42.662 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.659+0000 7f0eedb2e700 1 --2- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7f0ed002fe10 0x7f0ed00322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:42.662 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.660+0000 7f0eedb2e700 1 --2- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7f0ed002fe10 0x7f0ed00322d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f0ee40096a0 tx=0x7f0ee4006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:42.662 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.660+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee8059100 con 0x7f0ee80703f0 2024-02-15T18:17:42.664 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.664+0000 7f0ed6ffd700 1 -- 172.21.15.84:0/3369883939 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0ed8016070 con 0x7f0ee80703f0 2024-02-15T18:17:42.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:41.402674+0000 mon.smithi084 (mon.0) 23 : cluster [DBG] mgrmap e4: smithi084.hjmnez(active, since 2s) 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.867+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0ee8045ad0 con 0x7f0ee80703f0 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.867+0000 7f0ed6ffd700 1 -- 172.21.15.84:0/3369883939 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f0ed8022310 con 0x7f0ee80703f0 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: { 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "fsid": "631a4cdc-cc2e-11ee-95ba-87774f69a715", 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "health": { 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "checks": {}, 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "mutes": [] 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:42.875 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "quorum": [ 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 0 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ], 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "smithi084" 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ], 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "quorum_age": 11, 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "monmap": { 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "osdmap": { 2024-02-15T18:17:42.876 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "pgmap": { 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-15T18:17:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "fsmap": { 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "available": true, 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-15T18:17:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "modules": [ 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "iostat", 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "restful" 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ], 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "servicemap": { 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "modified": "2024-02-15T18:17:26.592730+0000", 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: }, 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: } 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7f0ed002fe10 msgr2=0x7f0ed00322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 --2- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7f0ed002fe10 0x7f0ed00322d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f0ee40096a0 tx=0x7f0ee4006b40).stop 2024-02-15T18:17:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 msgr2=0x7f0ee80fc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 --2- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fc510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0ed8011ed0 tx=0x7f0ed8006ee0).stop 2024-02-15T18:17:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 shutdown_connections 2024-02-15T18:17:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 --2- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7f0ed002fe10 0x7f0ed00322d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 --2- 172.21.15.84:0/3369883939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ee80703f0 0x7f0ee80fc510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 >> 172.21.15.84:0/3369883939 conn(0x7f0ee80f6530 msgr2=0x7f0ee80f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 shutdown_connections 2024-02-15T18:17:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:42.869+0000 7f0ef0593700 1 -- 172.21.15.84:0/3369883939 wait complete. 2024-02-15T18:17:43.492 INFO:teuthology.orchestra.run.smithi084.stderr:mgr is available 2024-02-15T18:17:43.492 INFO:teuthology.orchestra.run.smithi084.stderr:Enabling cephadm module... 2024-02-15T18:17:43.492 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable cephadm 2024-02-15T18:17:43.494 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:42.868361+0000 mon.smithi084 (mon.0) 24 : audit [DBG] from='client.? 172.21.15.84:0/3369883939' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T18:17:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.007+0000 7fc4ad8fe700 1 Processor -- start 2024-02-15T18:17:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.007+0000 7fc4ad8fe700 1 -- start start 2024-02-15T18:17:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.007+0000 7fc4ad8fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a80feb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.007+0000 7fc4ad8fe700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80707e0 con 0x7fc4a80703c0 2024-02-15T18:17:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.008+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a80feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.008+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a80feb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36838/0 (socket says 172.21.15.84:36838) 2024-02-15T18:17:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.008+0000 7fc4a6ffd700 1 -- 172.21.15.84:0/2678220087 learned_addr learned my addr 172.21.15.84:0/2678220087 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.008+0000 7fc4a6ffd700 1 -- 172.21.15.84:0/2678220087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a80ff070 con 0x7fc4a80703c0 2024-02-15T18:17:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.008+0000 7fc4a6ffd700 1 --2- 172.21.15.84:0/2678220087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a80feb80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fc49c00b5f0 tx=0x7fc49c006ee0).ready entity=mon.0 client_cookie=6e823d3696fa4eda server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.008+0000 7fc4a5ffb700 1 -- 172.21.15.84:0/2678220087 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49c00d600 con 0x7fc4a80703c0 2024-02-15T18:17:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.008+0000 7fc4a5ffb700 1 -- 172.21.15.84:0/2678220087 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fc49c00dbf0 con 0x7fc4a80703c0 2024-02-15T18:17:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.008+0000 7fc4a5ffb700 1 -- 172.21.15.84:0/2678220087 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49c011cb0 con 0x7fc4a80703c0 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.009+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/2678220087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 msgr2=0x7fc4a80feb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.009+0000 7fc4ad8fe700 1 --2- 172.21.15.84:0/2678220087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a80feb80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fc49c00b5f0 tx=0x7fc49c006ee0).stop 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.009+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/2678220087 shutdown_connections 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.009+0000 7fc4ad8fe700 1 --2- 172.21.15.84:0/2678220087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a80feb80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.009+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/2678220087 >> 172.21.15.84:0/2678220087 conn(0x7fc4a80f6560 msgr2=0x7fc4a80f8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.009+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/2678220087 shutdown_connections 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.009+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/2678220087 wait complete. 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.010+0000 7fc4ad8fe700 1 Processor -- start 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.010+0000 7fc4ad8fe700 1 -- start start 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.010+0000 7fc4ad8fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a810ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.010+0000 7fc4ad8fe700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a810b010 con 0x7fc4a80703c0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.010+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a810ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.010+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a810ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36844/0 (socket says 172.21.15.84:36844) 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.010+0000 7fc4a6ffd700 1 -- 172.21.15.84:0/3082039281 learned_addr learned my addr 172.21.15.84:0/3082039281 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.011+0000 7fc4a6ffd700 1 -- 172.21.15.84:0/3082039281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c00b200 con 0x7fc4a80703c0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.011+0000 7fc4a6ffd700 1 --2- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a810ab20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc49c006800 tx=0x7fc49c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.011+0000 7fc48f7fe700 1 -- 172.21.15.84:0/3082039281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49c01b570 con 0x7fc4a80703c0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.011+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a810b210 con 0x7fc4a80703c0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.011+0000 7fc48f7fe700 1 -- 172.21.15.84:0/3082039281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fc49c01bb60 con 0x7fc4a80703c0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.011+0000 7fc48f7fe700 1 -- 172.21.15.84:0/3082039281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc49c01a9f0 con 0x7fc4a80703c0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.011+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a810b6a0 con 0x7fc4a80703c0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.012+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a8045ad0 con 0x7fc4a80703c0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.012+0000 7fc48f7fe700 1 -- 172.21.15.84:0/3082039281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 36109+0+0 (secure 0 0 0) 0x7fc49c00f070 con 0x7fc4a80703c0 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.012+0000 7fc48f7fe700 1 --2- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fc49402fdc0 0x7fc494032280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.012+0000 7fc48f7fe700 1 -- 172.21.15.84:0/3082039281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fc49c041400 con 0x7fc4a80703c0 2024-02-15T18:17:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.012+0000 7fc4a67fc700 1 --2- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fc49402fdc0 0x7fc494032280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.013+0000 7fc4a67fc700 1 --2- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fc49402fdc0 0x7fc494032280 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc4980096a0 tx=0x7fc498006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.017+0000 7fc48f7fe700 1 -- 172.21.15.84:0/3082039281 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc49c019cd0 con 0x7fc4a80703c0 2024-02-15T18:17:44.199 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.199+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fc4a80ffe70 con 0x7fc4a80703c0 2024-02-15T18:17:44.404 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.404+0000 7fc48f7fe700 1 -- 172.21.15.84:0/3082039281 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fc49c01ab50 con 0x7fc4a80703c0 2024-02-15T18:17:44.405 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.405+0000 7fc48f7fe700 1 -- 172.21.15.84:0/3082039281 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fc49c024bb0 con 0x7fc4a80703c0 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fc49402fdc0 msgr2=0x7fc494032280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 --2- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fc49402fdc0 0x7fc494032280 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc4980096a0 tx=0x7fc498006b40).stop 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 msgr2=0x7fc4a810ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 --2- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a810ab20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc49c006800 tx=0x7fc49c006ee0).stop 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 shutdown_connections 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 --2- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fc49402fdc0 0x7fc494032280 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 --2- 172.21.15.84:0/3082039281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4a80703c0 0x7fc4a810ab20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 >> 172.21.15.84:0/3082039281 conn(0x7fc4a80f6560 msgr2=0x7fc4a80f7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 shutdown_connections 2024-02-15T18:17:44.408 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:44.407+0000 7fc4ad8fe700 1 -- 172.21.15.84:0/3082039281 wait complete. 2024-02-15T18:17:44.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:44.200255+0000 mon.smithi084 (mon.0) 25 : audit [INF] from='client.? 172.21.15.84:0/3082039281' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-15T18:17:45.032 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2024-02-15T18:17:45.579 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.578+0000 7fd3863ec700 1 Processor -- start 2024-02-15T18:17:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.578+0000 7fd3863ec700 1 -- start start 2024-02-15T18:17:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.578+0000 7fd3863ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd3800faf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.578+0000 7fd3863ec700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800fb440 con 0x7fd3800fab30 2024-02-15T18:17:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.578+0000 7fd3853ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd3800faf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.578+0000 7fd3853ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd3800faf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36868/0 (socket says 172.21.15.84:36868) 2024-02-15T18:17:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.578+0000 7fd3853ea700 1 -- 172.21.15.84:0/4173373968 learned_addr learned my addr 172.21.15.84:0/4173373968 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.579+0000 7fd3853ea700 1 -- 172.21.15.84:0/4173373968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3800fb580 con 0x7fd3800fab30 2024-02-15T18:17:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.579+0000 7fd3853ea700 1 --2- 172.21.15.84:0/4173373968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd3800faf50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd37c00b5f0 tx=0x7fd37c006ee0).ready entity=mon.0 client_cookie=30686a4b6c95dce server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:45.580 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.579+0000 7fd36ffff700 1 -- 172.21.15.84:0/4173373968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd37c00d600 con 0x7fd3800fab30 2024-02-15T18:17:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.579+0000 7fd36ffff700 1 -- 172.21.15.84:0/4173373968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fd37c00dbf0 con 0x7fd3800fab30 2024-02-15T18:17:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.579+0000 7fd36ffff700 1 -- 172.21.15.84:0/4173373968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd37c011cb0 con 0x7fd3800fab30 2024-02-15T18:17:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.580+0000 7fd3863ec700 1 -- 172.21.15.84:0/4173373968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 msgr2=0x7fd3800faf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:45.581 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.580+0000 7fd3863ec700 1 --2- 172.21.15.84:0/4173373968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd3800faf50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd37c00b5f0 tx=0x7fd37c006ee0).stop 2024-02-15T18:17:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.580+0000 7fd3863ec700 1 -- 172.21.15.84:0/4173373968 shutdown_connections 2024-02-15T18:17:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.580+0000 7fd3863ec700 1 --2- 172.21.15.84:0/4173373968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd3800faf50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.580+0000 7fd3863ec700 1 -- 172.21.15.84:0/4173373968 >> 172.21.15.84:0/4173373968 conn(0x7fd3800f6390 msgr2=0x7fd3800f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.580+0000 7fd3863ec700 1 -- 172.21.15.84:0/4173373968 shutdown_connections 2024-02-15T18:17:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.580+0000 7fd3863ec700 1 -- 172.21.15.84:0/4173373968 wait complete. 2024-02-15T18:17:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.580+0000 7fd3863ec700 1 Processor -- start 2024-02-15T18:17:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.580+0000 7fd3863ec700 1 -- start start 2024-02-15T18:17:45.584 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd3863ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd38010d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd3863ec700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380070450 con 0x7fd3800fab30 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd3853ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd38010d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd3853ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd38010d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36880/0 (socket says 172.21.15.84:36880) 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd3853ea700 1 -- 172.21.15.84:0/3572855367 learned_addr learned my addr 172.21.15.84:0/3572855367 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd3853ea700 1 -- 172.21.15.84:0/3572855367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c00b200 con 0x7fd3800fab30 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd3853ea700 1 --2- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd38010d690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd37c011ea0 tx=0x7fd37c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd36dffb700 1 -- 172.21.15.84:0/3572855367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd37c01b570 con 0x7fd3800fab30 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd380070650 con 0x7fd3800fab30 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd36dffb700 1 -- 172.21.15.84:0/3572855367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fd37c01bb60 con 0x7fd3800fab30 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.581+0000 7fd36dffb700 1 -- 172.21.15.84:0/3572855367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd37c01a8d0 con 0x7fd3800fab30 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.582+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38010dd40 con 0x7fd3800fab30 2024-02-15T18:17:45.585 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.582+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd380045ad0 con 0x7fd3800fab30 2024-02-15T18:17:45.586 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.583+0000 7fd36dffb700 1 -- 172.21.15.84:0/3572855367 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fd37c00f070 con 0x7fd3800fab30 2024-02-15T18:17:45.586 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.583+0000 7fd36dffb700 1 --2- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fd36802fe10 0x7fd3680322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:45.586 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.583+0000 7fd36dffb700 1 -- 172.21.15.84:0/3572855367 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fd37c041460 con 0x7fd3800fab30 2024-02-15T18:17:45.586 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.583+0000 7fd384be9700 1 -- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fd36802fe10 msgr2=0x7fd3680322d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/2060840097 2024-02-15T18:17:45.586 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.583+0000 7fd384be9700 1 --2- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fd36802fe10 0x7fd3680322d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:17:45.587 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.587+0000 7fd36dffb700 1 -- 172.21.15.84:0/3572855367 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd37c022b70 con 0x7fd3800fab30 2024-02-15T18:17:45.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:44.406166+0000 mon.smithi084 (mon.0) 26 : audit [INF] from='client.? 172.21.15.84:0/3082039281' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-15T18:17:45.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:44.406224+0000 mon.smithi084 (mon.0) 27 : cluster [DBG] mgrmap e5: smithi084.hjmnez(active, since 5s) 2024-02-15T18:17:45.784 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.784+0000 7fd384be9700 1 -- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fd36802fe10 msgr2=0x7fd3680322d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/2060840097 2024-02-15T18:17:45.784 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.784+0000 7fd384be9700 1 --2- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fd36802fe10 0x7fd3680322d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-15T18:17:45.815 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.815+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd3800fca10 con 0x7fd3800fab30 2024-02-15T18:17:45.816 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.815+0000 7fd36dffb700 1 -- 172.21.15.84:0/3572855367 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fd37c016070 con 0x7fd3800fab30 2024-02-15T18:17:45.816 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: { 2024-02-15T18:17:45.816 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 5, 2024-02-15T18:17:45.816 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "available": true, 2024-02-15T18:17:45.816 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "active_name": "smithi084.hjmnez", 2024-02-15T18:17:45.816 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-15T18:17:45.816 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: } 2024-02-15T18:17:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fd36802fe10 msgr2=0x7fd3680322d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:17:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 --2- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fd36802fe10 0x7fd3680322d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:17:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 msgr2=0x7fd38010d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 --2- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd38010d690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd37c011ea0 tx=0x7fd37c006ee0).stop 2024-02-15T18:17:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 shutdown_connections 2024-02-15T18:17:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 --2- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:6800/2060840097,v1:172.21.15.84:6801/2060840097] conn(0x7fd36802fe10 0x7fd3680322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:17:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 --2- 172.21.15.84:0/3572855367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3800fab30 0x7fd38010d690 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 >> 172.21.15.84:0/3572855367 conn(0x7fd3800f6390 msgr2=0x7fd3800f7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 shutdown_connections 2024-02-15T18:17:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:45.817+0000 7fd3863ec700 1 -- 172.21.15.84:0/3572855367 wait complete. 2024-02-15T18:17:46.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:45.816209+0000 mon.smithi084 (mon.0) 28 : audit [DBG] from='client.? 172.21.15.84:0/3572855367' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-15T18:17:48.596 INFO:teuthology.orchestra.run.smithi084.stderr:Waiting for the mgr to restart... 2024-02-15T18:17:48.597 INFO:teuthology.orchestra.run.smithi084.stderr:Waiting for mgr epoch 5... 2024-02-15T18:17:48.597 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2024-02-15T18:17:50.670 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:49.286739+0000 mon.smithi084 (mon.0) 29 : cluster [INF] Active manager daemon smithi084.hjmnez restarted 2024-02-15T18:17:50.670 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:49.332039+0000 mon.smithi084 (mon.0) 30 : cluster [INF] Activating manager daemon smithi084.hjmnez 2024-02-15T18:17:50.670 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:49.336129+0000 mon.smithi084 (mon.0) 31 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:49.385427+0000 mon.smithi084 (mon.0) 32 : cluster [DBG] mgrmap e6: smithi084.hjmnez(active, starting, since 0.0534929s) 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.386307+0000 mon.smithi084 (mon.0) 33 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.386914+0000 mon.smithi084 (mon.0) 34 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi084.hjmnez", "id": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.387745+0000 mon.smithi084 (mon.0) 35 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.387948+0000 mon.smithi084 (mon.0) 36 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.388132+0000 mon.smithi084 (mon.0) 37 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:49.401179+0000 mon.smithi084 (mon.0) 38 : cluster [INF] Manager daemon smithi084.hjmnez is now available 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.414338+0000 mon.smithi084 (mon.0) 39 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.417009+0000 mon.smithi084 (mon.0) 40 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.419360+0000 mon.smithi084 (mon.0) 41 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.506253+0000 mon.smithi084 (mon.0) 42 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.506937+0000 mon.smithi084 (mon.0) 43 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:17:50.671 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.508012+0000 mon.smithi084 (mon.0) 44 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:17:50.672 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.509504+0000 mon.smithi084 (mon.0) 45 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:17:50.672 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.519908+0000 mon.smithi084 (mon.0) 46 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:17:50.672 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:49.521073+0000 mon.smithi084 (mon.0) 47 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:17:51.653 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:50.387471+0000 mon.smithi084 (mon.0) 48 : cluster [DBG] mgrmap e7: smithi084.hjmnez(active, since 1.05553s) 2024-02-15T18:17:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.610+0000 7f7b26855700 1 Processor -- start 2024-02-15T18:17:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.610+0000 7f7b26855700 1 -- start start 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.611+0000 7f7b26855700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b200fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.611+0000 7f7b26855700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b200fb6a0 con 0x7f7b200fad90 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.611+0000 7f7b1ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b200fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.611+0000 7f7b1ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b200fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36938/0 (socket says 172.21.15.84:36938) 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.611+0000 7f7b1ffff700 1 -- 172.21.15.84:0/2523634192 learned_addr learned my addr 172.21.15.84:0/2523634192 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.611+0000 7f7b1ffff700 1 -- 172.21.15.84:0/2523634192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b200fb7e0 con 0x7f7b200fad90 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.611+0000 7f7b1ffff700 1 --2- 172.21.15.84:0/2523634192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b200fb1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7b1000b5f0 tx=0x7f7b10006ee0).ready entity=mon.0 client_cookie=13ec58c333be091a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.611+0000 7f7b1effd700 1 -- 172.21.15.84:0/2523634192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b1000d600 con 0x7f7b200fad90 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.612+0000 7f7b1effd700 1 -- 172.21.15.84:0/2523634192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f7b1000dbf0 con 0x7f7b200fad90 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.612+0000 7f7b1effd700 1 -- 172.21.15.84:0/2523634192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b10011cb0 con 0x7f7b200fad90 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.612+0000 7f7b26855700 1 -- 172.21.15.84:0/2523634192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 msgr2=0x7f7b200fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.612+0000 7f7b26855700 1 --2- 172.21.15.84:0/2523634192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b200fb1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7b1000b5f0 tx=0x7f7b10006ee0).stop 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.612+0000 7f7b26855700 1 -- 172.21.15.84:0/2523634192 shutdown_connections 2024-02-15T18:17:52.274 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.612+0000 7f7b26855700 1 --2- 172.21.15.84:0/2523634192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b200fb1b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.612+0000 7f7b26855700 1 -- 172.21.15.84:0/2523634192 >> 172.21.15.84:0/2523634192 conn(0x7f7b200f6530 msgr2=0x7f7b200f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.612+0000 7f7b26855700 1 -- 172.21.15.84:0/2523634192 shutdown_connections 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.612+0000 7f7b26855700 1 -- 172.21.15.84:0/2523634192 wait complete. 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.613+0000 7f7b26855700 1 Processor -- start 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.613+0000 7f7b26855700 1 -- start start 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.613+0000 7f7b26855700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b2010d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.613+0000 7f7b26855700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b20070450 con 0x7f7b200fad90 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.613+0000 7f7b1ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b2010d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.613+0000 7f7b1ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b2010d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36942/0 (socket says 172.21.15.84:36942) 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.613+0000 7f7b1ffff700 1 -- 172.21.15.84:0/413410198 learned_addr learned my addr 172.21.15.84:0/413410198 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.613+0000 7f7b1ffff700 1 -- 172.21.15.84:0/413410198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1000b200 con 0x7f7b200fad90 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.613+0000 7f7b1ffff700 1 --2- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b2010d850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7b10002f40 tx=0x7f7b10006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.614+0000 7f7b1cff9700 1 -- 172.21.15.84:0/413410198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b1001b410 con 0x7f7b200fad90 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.614+0000 7f7b1cff9700 1 -- 172.21.15.84:0/413410198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f7b1001ba00 con 0x7f7b200fad90 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.614+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b20070650 con 0x7f7b200fad90 2024-02-15T18:17:52.275 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.614+0000 7f7b1cff9700 1 -- 172.21.15.84:0/413410198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b1001a900 con 0x7f7b200fad90 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.614+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2010df00 con 0x7f7b200fad90 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.614+0000 7f7b1cff9700 1 -- 172.21.15.84:0/413410198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f7b1000f070 con 0x7f7b200fad90 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.614+0000 7f7b1cff9700 1 --2- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7b0c02fe70 0x7f7b0c032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.614+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b20059100 con 0x7f7b0c02fe70 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.615+0000 7f7b1cff9700 1 -- 172.21.15.84:0/413410198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f7b10041320 con 0x7f7b200fad90 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.615+0000 7f7b1f7fe700 1 --2- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7b0c02fe70 0x7f7b0c032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.615+0000 7f7b1f7fe700 1 --2- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7b0c02fe70 0x7f7b0c032330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7b140096a0 tx=0x7f7b14006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.615+0000 7f7b1cff9700 1 -- 172.21.15.84:0/413410198 <== mgr.14114 v2:172.21.15.84:6800/519542921 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f7b20059100 con 0x7f7b0c02fe70 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7b20045ad0 con 0x7f7b0c02fe70 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b1cff9700 1 -- 172.21.15.84:0/413410198 <== mgr.14114 v2:172.21.15.84:6800/519542921 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7b20045ad0 con 0x7f7b0c02fe70 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7b0c02fe70 msgr2=0x7f7b0c032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 --2- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7b0c02fe70 0x7f7b0c032330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7b140096a0 tx=0x7f7b14006b40).stop 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 msgr2=0x7f7b2010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 --2- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b2010d850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7b10002f40 tx=0x7f7b10006ee0).stop 2024-02-15T18:17:52.276 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 shutdown_connections 2024-02-15T18:17:52.277 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 --2- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7b0c02fe70 0x7f7b0c032330 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:52.277 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 --2- 172.21.15.84:0/413410198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b200fad90 0x7f7b2010d850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:52.277 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 >> 172.21.15.84:0/413410198 conn(0x7f7b200f6530 msgr2=0x7f7b200f7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:52.277 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 shutdown_connections 2024-02-15T18:17:52.277 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:51.621+0000 7f7b26855700 1 -- 172.21.15.84:0/413410198 wait complete. 2024-02-15T18:17:52.277 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: { 2024-02-15T18:17:52.277 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "mgrmap_epoch": 8, 2024-02-15T18:17:52.277 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "initialized": true 2024-02-15T18:17:52.277 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: } 2024-02-15T18:17:52.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:17:51.390117+0000 mon.smithi084 (mon.0) 49 : cluster [DBG] mgrmap e8: smithi084.hjmnez(active, since 2s) 2024-02-15T18:17:53.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:51.616252+0000 mgr.smithi084.hjmnez (mgr.14114) 1 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-15T18:17:53.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:51.622042+0000 mgr.smithi084.hjmnez (mgr.14114) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-15T18:17:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:mgr epoch 5 is available 2024-02-15T18:17:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:Setting orchestrator backend to cephadm... 2024-02-15T18:17:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch set backend cephadm 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.910+0000 7fcd7458f700 1 Processor -- start 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.910+0000 7fcd7458f700 1 -- start start 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.910+0000 7fcd7458f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c0fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.910+0000 7fcd7458f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c0fb6a0 con 0x7fcd6c0fad90 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.910+0000 7fcd7232b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c0fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.910+0000 7fcd7232b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c0fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53586/0 (socket says 172.21.15.84:53586) 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.910+0000 7fcd7232b700 1 -- 172.21.15.84:0/2805124388 learned_addr learned my addr 172.21.15.84:0/2805124388 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.911+0000 7fcd7232b700 1 -- 172.21.15.84:0/2805124388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0fb7e0 con 0x7fcd6c0fad90 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.911+0000 7fcd7232b700 1 --2- 172.21.15.84:0/2805124388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c0fb1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcd6800b5f0 tx=0x7fcd68006ee0).ready entity=mon.0 client_cookie=6da7e6b81d9a91e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:55.914 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.911+0000 7fcd71329700 1 -- 172.21.15.84:0/2805124388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd6800d600 con 0x7fcd6c0fad90 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.911+0000 7fcd71329700 1 -- 172.21.15.84:0/2805124388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fcd6800dbf0 con 0x7fcd6c0fad90 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.911+0000 7fcd71329700 1 -- 172.21.15.84:0/2805124388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd68011cb0 con 0x7fcd6c0fad90 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.912+0000 7fcd7458f700 1 -- 172.21.15.84:0/2805124388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 msgr2=0x7fcd6c0fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.912+0000 7fcd7458f700 1 --2- 172.21.15.84:0/2805124388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c0fb1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcd6800b5f0 tx=0x7fcd68006ee0).stop 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.912+0000 7fcd7458f700 1 -- 172.21.15.84:0/2805124388 shutdown_connections 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.912+0000 7fcd7458f700 1 --2- 172.21.15.84:0/2805124388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c0fb1b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.912+0000 7fcd7458f700 1 -- 172.21.15.84:0/2805124388 >> 172.21.15.84:0/2805124388 conn(0x7fcd6c0f6530 msgr2=0x7fcd6c0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.912+0000 7fcd7458f700 1 -- 172.21.15.84:0/2805124388 shutdown_connections 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.912+0000 7fcd7458f700 1 -- 172.21.15.84:0/2805124388 wait complete. 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.912+0000 7fcd7458f700 1 Processor -- start 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.912+0000 7fcd7458f700 1 -- start start 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd7458f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c10ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd7458f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c10b000 con 0x7fcd6c0fad90 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd7232b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c10ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd7232b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c10ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53596/0 (socket says 172.21.15.84:53596) 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd7232b700 1 -- 172.21.15.84:0/935942480 learned_addr learned my addr 172.21.15.84:0/935942480 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd7232b700 1 -- 172.21.15.84:0/935942480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6800b200 con 0x7fcd6c0fad90 2024-02-15T18:17:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd7232b700 1 --2- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c10ab10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcd68011ea0 tx=0x7fcd68006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd5affd700 1 -- 172.21.15.84:0/935942480 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd6801b570 con 0x7fcd6c0fad90 2024-02-15T18:17:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd5affd700 1 -- 172.21.15.84:0/935942480 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fcd6801bb60 con 0x7fcd6c0fad90 2024-02-15T18:17:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6c10b200 con 0x7fcd6c0fad90 2024-02-15T18:17:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd5affd700 1 -- 172.21.15.84:0/935942480 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd6801a8d0 con 0x7fcd6c0fad90 2024-02-15T18:17:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.913+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6c10b690 con 0x7fcd6c0fad90 2024-02-15T18:17:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.914+0000 7fcd5affd700 1 -- 172.21.15.84:0/935942480 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fcd6800f070 con 0x7fcd6c0fad90 2024-02-15T18:17:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.914+0000 7fcd5affd700 1 --2- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fcd5402fe10 0x7fcd540322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.914+0000 7fcd5affd700 1 -- 172.21.15.84:0/935942480 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fcd68041590 con 0x7fcd6c0fad90 2024-02-15T18:17:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.914+0000 7fcd71b2a700 1 --2- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fcd5402fe10 0x7fcd540322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.915+0000 7fcd71b2a700 1 --2- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fcd5402fe10 0x7fcd540322d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fcd5c0096a0 tx=0x7fcd5c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:55.917 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.915+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6c045ad0 con 0x7fcd6c0fad90 2024-02-15T18:17:55.919 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:55.919+0000 7fcd5affd700 1 -- 172.21.15.84:0/935942480 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcd68016080 con 0x7fcd6c0fad90 2024-02-15T18:17:56.096 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.096+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd6c104d00 con 0x7fcd5402fe10 2024-02-15T18:17:56.102 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.102+0000 7fcd5affd700 1 -- 172.21.15.84:0/935942480 <== mgr.14114 v2:172.21.15.84:6800/519542921 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcd6c104d00 con 0x7fcd5402fe10 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.104+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fcd5402fe10 msgr2=0x7fcd540322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.104+0000 7fcd7458f700 1 --2- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fcd5402fe10 0x7fcd540322d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fcd5c0096a0 tx=0x7fcd5c006b40).stop 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.104+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 msgr2=0x7fcd6c10ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.104+0000 7fcd7458f700 1 --2- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c10ab10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcd68011ea0 tx=0x7fcd68006ee0).stop 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.104+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 shutdown_connections 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.104+0000 7fcd7458f700 1 --2- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fcd5402fe10 0x7fcd540322d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.104+0000 7fcd7458f700 1 --2- 172.21.15.84:0/935942480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd6c0fad90 0x7fcd6c10ab10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.104+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 >> 172.21.15.84:0/935942480 conn(0x7fcd6c0f6530 msgr2=0x7fcd6c0f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.105+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 shutdown_connections 2024-02-15T18:17:56.105 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:56.105+0000 7fcd7458f700 1 -- 172.21.15.84:0/935942480 wait complete. 2024-02-15T18:17:56.715 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm set-user root 2024-02-15T18:17:57.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:56.097804+0000 mgr.smithi084.hjmnez (mgr.14114) 3 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:17:57.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:56.101842+0000 mon.smithi084 (mon.0) 50 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:17:57.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:56.104804+0000 mon.smithi084 (mon.0) 51 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:17:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.276+0000 7fe446b75700 1 Processor -- start 2024-02-15T18:17:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.276+0000 7fe446b75700 1 -- start start 2024-02-15T18:17:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe446b75700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe4400fea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:57.278 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe446b75700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400fef40 con 0x7fe440070430 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe444911700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe4400fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe444911700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe4400fea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53608/0 (socket says 172.21.15.84:53608) 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe444911700 1 -- 172.21.15.84:0/2440296558 learned_addr learned my addr 172.21.15.84:0/2440296558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe444911700 1 -- 172.21.15.84:0/2440296558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4400ff080 con 0x7fe440070430 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe444911700 1 --2- 172.21.15.84:0/2440296558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe4400fea50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe43400b5f0 tx=0x7fe434006ee0).ready entity=mon.0 client_cookie=7e1177f1e16f4b83 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe43f7fe700 1 -- 172.21.15.84:0/2440296558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe43400d600 con 0x7fe440070430 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe43f7fe700 1 -- 172.21.15.84:0/2440296558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fe43400dbf0 con 0x7fe440070430 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.277+0000 7fe43f7fe700 1 -- 172.21.15.84:0/2440296558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe434011cb0 con 0x7fe440070430 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.278+0000 7fe446b75700 1 -- 172.21.15.84:0/2440296558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 msgr2=0x7fe4400fea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.278+0000 7fe446b75700 1 --2- 172.21.15.84:0/2440296558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe4400fea50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe43400b5f0 tx=0x7fe434006ee0).stop 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.278+0000 7fe446b75700 1 -- 172.21.15.84:0/2440296558 shutdown_connections 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.278+0000 7fe446b75700 1 --2- 172.21.15.84:0/2440296558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe4400fea50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.278+0000 7fe446b75700 1 -- 172.21.15.84:0/2440296558 >> 172.21.15.84:0/2440296558 conn(0x7fe4400f6530 msgr2=0x7fe4400f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:57.281 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.278+0000 7fe446b75700 1 -- 172.21.15.84:0/2440296558 shutdown_connections 2024-02-15T18:17:57.281 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.278+0000 7fe446b75700 1 -- 172.21.15.84:0/2440296558 wait complete. 2024-02-15T18:17:57.281 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.279+0000 7fe446b75700 1 Processor -- start 2024-02-15T18:17:57.281 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.279+0000 7fe446b75700 1 -- start start 2024-02-15T18:17:57.281 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.279+0000 7fe446b75700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe44010ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:57.281 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.279+0000 7fe446b75700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44010b030 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.279+0000 7fe444911700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe44010ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.279+0000 7fe444911700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe44010ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53614/0 (socket says 172.21.15.84:53614) 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.279+0000 7fe444911700 1 -- 172.21.15.84:0/961664540 learned_addr learned my addr 172.21.15.84:0/961664540 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.279+0000 7fe444911700 1 -- 172.21.15.84:0/961664540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43400b200 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.279+0000 7fe444911700 1 --2- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe44010ab40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe434006800 tx=0x7fe434006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.280+0000 7fe43d7fa700 1 -- 172.21.15.84:0/961664540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe43401b570 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.280+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44010b230 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.280+0000 7fe43d7fa700 1 -- 172.21.15.84:0/961664540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fe43401bb60 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.280+0000 7fe43d7fa700 1 -- 172.21.15.84:0/961664540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe43401a9f0 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.280+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44010b6c0 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.280+0000 7fe43d7fa700 1 -- 172.21.15.84:0/961664540 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fe43400f070 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.281+0000 7fe43d7fa700 1 --2- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fe42402fe70 0x7fe424032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.281+0000 7fe43d7fa700 1 -- 172.21.15.84:0/961664540 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fe434042210 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.281+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe440045ad0 con 0x7fe440070430 2024-02-15T18:17:57.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.281+0000 7fe43ffff700 1 --2- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fe42402fe70 0x7fe424032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.281+0000 7fe43ffff700 1 --2- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fe42402fe70 0x7fe424032330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe42c0096a0 tx=0x7fe42c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:57.285 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.285+0000 7fe43d7fa700 1 -- 172.21.15.84:0/961664540 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe434016070 con 0x7fe440070430 2024-02-15T18:17:57.437 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.437+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fe44010bf20 con 0x7fe42402fe70 2024-02-15T18:17:57.437 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.437+0000 7fe43d7fa700 1 -- 172.21.15.84:0/961664540 <== mgr.14114 v2:172.21.15.84:6800/519542921 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fe44010bf20 con 0x7fe42402fe70 2024-02-15T18:17:57.437 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: value unchanged 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fe42402fe70 msgr2=0x7fe424032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 --2- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fe42402fe70 0x7fe424032330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe42c0096a0 tx=0x7fe42c006b40).stop 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 msgr2=0x7fe44010ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 --2- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe44010ab40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe434006800 tx=0x7fe434006ee0).stop 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 shutdown_connections 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 --2- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fe42402fe70 0x7fe424032330 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 --2- 172.21.15.84:0/961664540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe440070430 0x7fe44010ab40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 >> 172.21.15.84:0/961664540 conn(0x7fe4400f6530 msgr2=0x7fe4400f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 shutdown_connections 2024-02-15T18:17:57.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:57.439+0000 7fe446b75700 1 -- 172.21.15.84:0/961664540 wait complete. 2024-02-15T18:17:57.955 INFO:teuthology.orchestra.run.smithi084.stderr:Generating ssh key... 2024-02-15T18:17:57.955 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm generate-key 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.485+0000 7faab9505700 1 Processor -- start 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab9505700 1 -- start start 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab9505700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab40fd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab9505700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab40fde80 con 0x7faab40fd570 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab40fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab40fd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53630/0 (socket says 172.21.15.84:53630) 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab2ffd700 1 -- 172.21.15.84:0/757976097 learned_addr learned my addr 172.21.15.84:0/757976097 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab2ffd700 1 -- 172.21.15.84:0/757976097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab40fdfc0 con 0x7faab40fd570 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab2ffd700 1 --2- 172.21.15.84:0/757976097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab40fd990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7faaa400b5f0 tx=0x7faaa4006ee0).ready entity=mon.0 client_cookie=4e057ec8dd78d7bb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:58.491 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab1ffb700 1 -- 172.21.15.84:0/757976097 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faaa400d600 con 0x7faab40fd570 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab1ffb700 1 -- 172.21.15.84:0/757976097 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7faaa400dbf0 con 0x7faab40fd570 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.486+0000 7faab1ffb700 1 -- 172.21.15.84:0/757976097 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faaa4011cb0 con 0x7faab40fd570 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.487+0000 7faab9505700 1 -- 172.21.15.84:0/757976097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 msgr2=0x7faab40fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.487+0000 7faab9505700 1 --2- 172.21.15.84:0/757976097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab40fd990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7faaa400b5f0 tx=0x7faaa4006ee0).stop 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.487+0000 7faab9505700 1 -- 172.21.15.84:0/757976097 shutdown_connections 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.487+0000 7faab9505700 1 --2- 172.21.15.84:0/757976097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab40fd990 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.487+0000 7faab9505700 1 -- 172.21.15.84:0/757976097 >> 172.21.15.84:0/757976097 conn(0x7faab40f5d30 msgr2=0x7faab40f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.487+0000 7faab9505700 1 -- 172.21.15.84:0/757976097 shutdown_connections 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.487+0000 7faab9505700 1 -- 172.21.15.84:0/757976097 wait complete. 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.488+0000 7faab9505700 1 Processor -- start 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.488+0000 7faab9505700 1 -- start start 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.488+0000 7faab9505700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab410abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.488+0000 7faab9505700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab410b0e0 con 0x7faab40fd570 2024-02-15T18:17:58.492 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.488+0000 7faab2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab410abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.489+0000 7faab2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab410abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53632/0 (socket says 172.21.15.84:53632) 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.489+0000 7faab2ffd700 1 -- 172.21.15.84:0/3789035364 learned_addr learned my addr 172.21.15.84:0/3789035364 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.489+0000 7faab2ffd700 1 -- 172.21.15.84:0/3789035364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa400b200 con 0x7faab40fd570 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.489+0000 7faab2ffd700 1 --2- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab410abf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faaa4002f40 tx=0x7faaa4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.489+0000 7faaab7fe700 1 -- 172.21.15.84:0/3789035364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faaa401b410 con 0x7faab40fd570 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.489+0000 7faaab7fe700 1 -- 172.21.15.84:0/3789035364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7faaa401ba00 con 0x7faab40fd570 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.489+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab410b2e0 con 0x7faab40fd570 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.489+0000 7faaab7fe700 1 -- 172.21.15.84:0/3789035364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faaa401a900 con 0x7faab40fd570 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.489+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab410b770 con 0x7faab40fd570 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.490+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab4045ad0 con 0x7faab40fd570 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.490+0000 7faaab7fe700 1 -- 172.21.15.84:0/3789035364 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7faaa400f070 con 0x7faab40fd570 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.490+0000 7faaab7fe700 1 --2- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7faa9402fe10 0x7faa940322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.491+0000 7faaab7fe700 1 -- 172.21.15.84:0/3789035364 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7faaa40413d0 con 0x7faab40fd570 2024-02-15T18:17:58.493 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.491+0000 7faab27fc700 1 --2- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7faa9402fe10 0x7faa940322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:17:58.494 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.491+0000 7faab27fc700 1 --2- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7faa9402fe10 0x7faa940322d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7faa9c0096a0 tx=0x7faa9c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:17:58.494 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.495+0000 7faaab7fe700 1 -- 172.21.15.84:0/3789035364 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7faaa4022310 con 0x7faab40fd570 2024-02-15T18:17:58.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:17:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:57.438223+0000 mgr.smithi084.hjmnez (mgr.14114) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:17:58.645 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:58.645+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7faab410bfd0 con 0x7faa9402fe10 2024-02-15T18:17:59.148 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.148+0000 7faaab7fe700 1 -- 172.21.15.84:0/3789035364 <== mgr.14114 v2:172.21.15.84:6800/519542921 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faab410bfd0 con 0x7faa9402fe10 2024-02-15T18:17:59.150 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7faa9402fe10 msgr2=0x7faa940322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 --2- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7faa9402fe10 0x7faa940322d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7faa9c0096a0 tx=0x7faa9c006b40).stop 2024-02-15T18:17:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 msgr2=0x7faab410abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:17:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 --2- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab410abf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faaa4002f40 tx=0x7faaa4006ee0).stop 2024-02-15T18:17:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 shutdown_connections 2024-02-15T18:17:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 --2- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7faa9402fe10 0x7faa940322d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 --2- 172.21.15.84:0/3789035364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faab40fd570 0x7faab410abf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:17:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 >> 172.21.15.84:0/3789035364 conn(0x7faab40f5d30 msgr2=0x7faab40ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:17:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 shutdown_connections 2024-02-15T18:17:59.151 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:17:59.150+0000 7faab9505700 1 -- 172.21.15.84:0/3789035364 wait complete. 2024-02-15T18:17:59.678 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm get-pub-key 2024-02-15T18:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.184+0000 7fee8a49f700 1 Processor -- start 2024-02-15T18:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.184+0000 7fee8a49f700 1 -- start start 2024-02-15T18:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.184+0000 7fee8a49f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee840fe890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.184+0000 7fee8a49f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee840fed80 con 0x7fee84070430 2024-02-15T18:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.184+0000 7fee8949d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee840fe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.184+0000 7fee8949d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee840fe890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53642/0 (socket says 172.21.15.84:53642) 2024-02-15T18:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.184+0000 7fee8949d700 1 -- 172.21.15.84:0/2566908740 learned_addr learned my addr 172.21.15.84:0/2566908740 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee8949d700 1 -- 172.21.15.84:0/2566908740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee840feec0 con 0x7fee84070430 2024-02-15T18:18:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee8949d700 1 --2- 172.21.15.84:0/2566908740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee840fe890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fee8000b5f0 tx=0x7fee80006ee0).ready entity=mon.0 client_cookie=7eb00a5eb43366a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee73fff700 1 -- 172.21.15.84:0/2566908740 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee8000d600 con 0x7fee84070430 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee73fff700 1 -- 172.21.15.84:0/2566908740 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fee8000dbf0 con 0x7fee84070430 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee73fff700 1 -- 172.21.15.84:0/2566908740 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee80011cb0 con 0x7fee84070430 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee8a49f700 1 -- 172.21.15.84:0/2566908740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 msgr2=0x7fee840fe890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee8a49f700 1 --2- 172.21.15.84:0/2566908740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee840fe890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fee8000b5f0 tx=0x7fee80006ee0).stop 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee8a49f700 1 -- 172.21.15.84:0/2566908740 shutdown_connections 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee8a49f700 1 --2- 172.21.15.84:0/2566908740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee840fe890 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.185+0000 7fee8a49f700 1 -- 172.21.15.84:0/2566908740 >> 172.21.15.84:0/2566908740 conn(0x7fee840f6390 msgr2=0x7fee840f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.186+0000 7fee8a49f700 1 -- 172.21.15.84:0/2566908740 shutdown_connections 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.186+0000 7fee8a49f700 1 -- 172.21.15.84:0/2566908740 wait complete. 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.186+0000 7fee8a49f700 1 Processor -- start 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.186+0000 7fee8a49f700 1 -- start start 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee8a49f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee8410a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:00.190 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee8a49f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8410ae80 con 0x7fee84070430 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee8949d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee8410a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee8949d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee8410a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53644/0 (socket says 172.21.15.84:53644) 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee8949d700 1 -- 172.21.15.84:0/2670845871 learned_addr learned my addr 172.21.15.84:0/2670845871 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee8949d700 1 -- 172.21.15.84:0/2670845871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8000b200 con 0x7fee84070430 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee8949d700 1 --2- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee8410a990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fee80006800 tx=0x7fee80006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee71ffb700 1 -- 172.21.15.84:0/2670845871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee8001b570 con 0x7fee84070430 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee71ffb700 1 -- 172.21.15.84:0/2670845871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fee8001bb60 con 0x7fee84070430 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee71ffb700 1 -- 172.21.15.84:0/2670845871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee8001a9f0 con 0x7fee84070430 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8410b080 con 0x7fee84070430 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.187+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8410b510 con 0x7fee84070430 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.188+0000 7fee71ffb700 1 -- 172.21.15.84:0/2670845871 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fee8000f070 con 0x7fee84070430 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.188+0000 7fee71ffb700 1 --2- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fee6c02fe70 0x7fee6c032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.188+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee84045ad0 con 0x7fee84070430 2024-02-15T18:18:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.188+0000 7fee71ffb700 1 -- 172.21.15.84:0/2670845871 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fee80041460 con 0x7fee84070430 2024-02-15T18:18:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.188+0000 7fee88c9c700 1 --2- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fee6c02fe70 0x7fee6c032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.189+0000 7fee88c9c700 1 --2- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fee6c02fe70 0x7fee6c032330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fee740096a0 tx=0x7fee74006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.193+0000 7fee71ffb700 1 -- 172.21.15.84:0/2670845871 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fee80025460 con 0x7fee84070430 2024-02-15T18:18:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.342+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fee8410bd70 con 0x7fee6c02fe70 2024-02-15T18:18:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.343+0000 7fee71ffb700 1 -- 172.21.15.84:0/2670845871 <== mgr.14114 v2:172.21.15.84:6800/519542921 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fee8410bd70 con 0x7fee6c02fe70 2024-02-15T18:18:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAJTuQbmETBq1BYsFrhhapoyddS3ue61W/sNnsyEV5WAULLB8s2wYItQkk/OfbXN1ZG7z5HjYcdcNcEs5q0tmgg2qHLBNU3XCQDCOFz92ETm88EKFRSe8uownQBmAb8Ymh6xulSZucGpTXYzTECeyEzYDkouEFEJ8VxqZy2UYGSzcq1UzUROx8smSBYgyNe6FYyBA1Hln0hCTFRSIGzAm9hSYF8AHjkoy3uvXkZsWwY2u5JT6VsObr87Pe361IhqqdjJ3EaNuj+c/EtdlxoShkCHS2+dXnXzEw7ao6f7N2I1DURsfzpQaW3xkWjXVDyVOiSnPfTf14oPYGQ0c9H/Sv4dp7p4mx0ijSfwbLhbcN1ntlkOzS4iK/fOgetCmSESA2ik/wsdotTIybv9JJnCSnV+Xapjqplx7HHIcmRjCJ7llngVkzYFBgCaJZoPMYOFqIJ6hVJpMNj1TkBnsU+gTHm941gyA947yPNHRtqDgvjZun6kJSK1PhxNXU9ah+d/s= ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:18:00.345 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fee6c02fe70 msgr2=0x7fee6c032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 --2- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fee6c02fe70 0x7fee6c032330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fee740096a0 tx=0x7fee74006b40).stop 2024-02-15T18:18:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 msgr2=0x7fee8410a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 --2- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee8410a990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fee80006800 tx=0x7fee80006ee0).stop 2024-02-15T18:18:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 shutdown_connections 2024-02-15T18:18:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 --2- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fee6c02fe70 0x7fee6c032330 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 --2- 172.21.15.84:0/2670845871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee84070430 0x7fee8410a990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 >> 172.21.15.84:0/2670845871 conn(0x7fee840f6390 msgr2=0x7fee840f7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 shutdown_connections 2024-02-15T18:18:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:00.345+0000 7fee8a49f700 1 -- 172.21.15.84:0/2670845871 wait complete. 2024-02-15T18:18:00.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:17:58.647041+0000 mgr.smithi084.hjmnez (mgr.14114) 6 : cephadm [INF] Generating ssh key... 2024-02-15T18:18:00.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:59.145788+0000 mon.smithi084 (mon.0) 52 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:00.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:17:59.148456+0000 mon.smithi084 (mon.0) 53 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-15T18:18:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:Adding key to root@localhost authorized_keys... 2024-02-15T18:18:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:Adding host smithi084... 2024-02-15T18:18:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch host add smithi084 172.21.15.84 2024-02-15T18:18:01.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:00.343980+0000 mgr.smithi084.hjmnez (mgr.14114) 7 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:01.471 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.461+0000 7fde90572700 1 Processor -- start 2024-02-15T18:18:01.471 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.461+0000 7fde90572700 1 -- start start 2024-02-15T18:18:01.471 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.461+0000 7fde90572700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde88100f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:01.471 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.461+0000 7fde90572700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde880fc940 con 0x7fde880703f0 2024-02-15T18:18:01.471 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.461+0000 7fde8e30e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde88100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:01.471 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.461+0000 7fde8e30e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde88100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53648/0 (socket says 172.21.15.84:53648) 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.461+0000 7fde8e30e700 1 -- 172.21.15.84:0/1928963630 learned_addr learned my addr 172.21.15.84:0/1928963630 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde8e30e700 1 -- 172.21.15.84:0/1928963630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde88101440 con 0x7fde880703f0 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde8e30e700 1 --2- 172.21.15.84:0/1928963630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde88100f50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fde7800b5f0 tx=0x7fde78006ee0).ready entity=mon.0 client_cookie=fc7497522326ca71 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde8d30c700 1 -- 172.21.15.84:0/1928963630 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde7800d600 con 0x7fde880703f0 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde8d30c700 1 -- 172.21.15.84:0/1928963630 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fde7800dbf0 con 0x7fde880703f0 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde8d30c700 1 -- 172.21.15.84:0/1928963630 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde78011ce0 con 0x7fde880703f0 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde90572700 1 -- 172.21.15.84:0/1928963630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 msgr2=0x7fde88100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde90572700 1 --2- 172.21.15.84:0/1928963630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde88100f50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fde7800b5f0 tx=0x7fde78006ee0).stop 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde90572700 1 -- 172.21.15.84:0/1928963630 shutdown_connections 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde90572700 1 --2- 172.21.15.84:0/1928963630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde88100f50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.462+0000 7fde90572700 1 -- 172.21.15.84:0/1928963630 >> 172.21.15.84:0/1928963630 conn(0x7fde880f65b0 msgr2=0x7fde880f89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde90572700 1 -- 172.21.15.84:0/1928963630 shutdown_connections 2024-02-15T18:18:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde90572700 1 -- 172.21.15.84:0/1928963630 wait complete. 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde90572700 1 Processor -- start 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde90572700 1 -- start start 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde90572700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde8810ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde90572700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8810d340 con 0x7fde880703f0 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde8e30e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde8810ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde8e30e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde8810ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53654/0 (socket says 172.21.15.84:53654) 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde8e30e700 1 -- 172.21.15.84:0/339549961 learned_addr learned my addr 172.21.15.84:0/339549961 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.463+0000 7fde8e30e700 1 -- 172.21.15.84:0/339549961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7800b200 con 0x7fde880703f0 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.464+0000 7fde8e30e700 1 --2- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde8810ce50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fde7800df90 tx=0x7fde78006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.464+0000 7fde76ffd700 1 -- 172.21.15.84:0/339549961 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde7801b570 con 0x7fde880703f0 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.464+0000 7fde76ffd700 1 -- 172.21.15.84:0/339549961 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fde7801bb60 con 0x7fde880703f0 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.464+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8810d540 con 0x7fde880703f0 2024-02-15T18:18:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.464+0000 7fde76ffd700 1 -- 172.21.15.84:0/339549961 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde7801ab80 con 0x7fde880703f0 2024-02-15T18:18:01.474 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.464+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8810e150 con 0x7fde880703f0 2024-02-15T18:18:01.474 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.464+0000 7fde76ffd700 1 -- 172.21.15.84:0/339549961 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fde7800f070 con 0x7fde880703f0 2024-02-15T18:18:01.474 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.465+0000 7fde76ffd700 1 --2- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fde7002fe10 0x7fde700322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:01.474 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.465+0000 7fde76ffd700 1 -- 172.21.15.84:0/339549961 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fde78041080 con 0x7fde880703f0 2024-02-15T18:18:01.474 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.465+0000 7fde8db0d700 1 --2- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fde7002fe10 0x7fde700322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:01.474 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.465+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde88059100 con 0x7fde880703f0 2024-02-15T18:18:01.474 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.465+0000 7fde8db0d700 1 --2- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fde7002fe10 0x7fde700322d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fde840096a0 tx=0x7fde84006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:01.474 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.469+0000 7fde76ffd700 1 -- 172.21.15.84:0/339549961 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fde78010be0 con 0x7fde880703f0 2024-02-15T18:18:01.640 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:01.640+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}) v1 -- 0x7fde88102150 con 0x7fde7002fe10 2024-02-15T18:18:02.227 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: Added host 'smithi084' 2024-02-15T18:18:02.227 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.226+0000 7fde76ffd700 1 -- 172.21.15.84:0/339549961 <== mgr.14114 v2:172.21.15.84:6800/519542921 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7fde88102150 con 0x7fde7002fe10 2024-02-15T18:18:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fde7002fe10 msgr2=0x7fde700322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 --2- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fde7002fe10 0x7fde700322d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fde840096a0 tx=0x7fde84006b40).stop 2024-02-15T18:18:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 msgr2=0x7fde8810ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 --2- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde8810ce50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fde7800df90 tx=0x7fde78006ee0).stop 2024-02-15T18:18:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 shutdown_connections 2024-02-15T18:18:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 --2- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fde7002fe10 0x7fde700322d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 --2- 172.21.15.84:0/339549961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde880703f0 0x7fde8810ce50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 >> 172.21.15.84:0/339549961 conn(0x7fde880f65b0 msgr2=0x7fde880f7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 shutdown_connections 2024-02-15T18:18:02.230 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:02.229+0000 7fde90572700 1 -- 172.21.15.84:0/339549961 wait complete. 2024-02-15T18:18:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:Deploying mon service with default placement... 2024-02-15T18:18:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mon 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.326+0000 7f139e096700 1 Processor -- start 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.326+0000 7f139e096700 1 -- start start 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.326+0000 7f139e096700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f1398100c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.326+0000 7f139e096700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13980fc680 con 0x7f1398070430 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.326+0000 7f139d094700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f1398100c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.326+0000 7f139d094700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f1398100c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46096/0 (socket says 172.21.15.84:46096) 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.326+0000 7f139d094700 1 -- 172.21.15.84:0/2910076007 learned_addr learned my addr 172.21.15.84:0/2910076007 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.326+0000 7f139d094700 1 -- 172.21.15.84:0/2910076007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398101180 con 0x7f1398070430 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f139d094700 1 --2- 172.21.15.84:0/2910076007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f1398100c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f139400b5f0 tx=0x7f1394006ee0).ready entity=mon.0 client_cookie=243a6d89def1aeb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:03.330 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f1387fff700 1 -- 172.21.15.84:0/2910076007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f139400d600 con 0x7f1398070430 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f1387fff700 1 -- 172.21.15.84:0/2910076007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f139400dbf0 con 0x7f1398070430 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f1387fff700 1 -- 172.21.15.84:0/2910076007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1394011cb0 con 0x7f1398070430 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f139e096700 1 -- 172.21.15.84:0/2910076007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 msgr2=0x7f1398100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f139e096700 1 --2- 172.21.15.84:0/2910076007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f1398100c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f139400b5f0 tx=0x7f1394006ee0).stop 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f139e096700 1 -- 172.21.15.84:0/2910076007 shutdown_connections 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f139e096700 1 --2- 172.21.15.84:0/2910076007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f1398100c90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f139e096700 1 -- 172.21.15.84:0/2910076007 >> 172.21.15.84:0/2910076007 conn(0x7f13980f6390 msgr2=0x7f13980f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f139e096700 1 -- 172.21.15.84:0/2910076007 shutdown_connections 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.327+0000 7f139e096700 1 -- 172.21.15.84:0/2910076007 wait complete. 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.328+0000 7f139e096700 1 Processor -- start 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.328+0000 7f139e096700 1 -- start start 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.328+0000 7f139e096700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f139810cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.328+0000 7f139e096700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139810d0e0 con 0x7f1398070430 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.328+0000 7f139d094700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f139810cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:03.331 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.328+0000 7f139d094700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f139810cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46110/0 (socket says 172.21.15.84:46110) 2024-02-15T18:18:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.328+0000 7f139d094700 1 -- 172.21.15.84:0/698399375 learned_addr learned my addr 172.21.15.84:0/698399375 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.329+0000 7f139d094700 1 -- 172.21.15.84:0/698399375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139400b200 con 0x7f1398070430 2024-02-15T18:18:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.329+0000 7f139d094700 1 --2- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f139810cbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f139400df90 tx=0x7f1394006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.329+0000 7f1385ffb700 1 -- 172.21.15.84:0/698399375 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f139401b410 con 0x7f1398070430 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.329+0000 7f1385ffb700 1 -- 172.21.15.84:0/698399375 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f139401ba00 con 0x7f1398070430 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.329+0000 7f1385ffb700 1 -- 172.21.15.84:0/698399375 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f139401aa30 con 0x7f1398070430 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.329+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139810d2e0 con 0x7f1398070430 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.329+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139810d770 con 0x7f1398070430 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.330+0000 7f1385ffb700 1 -- 172.21.15.84:0/698399375 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f139400f070 con 0x7f1398070430 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.330+0000 7f1385ffb700 1 --2- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f138002fe70 0x7f1380032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.330+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1398045ad0 con 0x7f1398070430 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.330+0000 7f1385ffb700 1 -- 172.21.15.84:0/698399375 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f1394041220 con 0x7f1398070430 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.330+0000 7f139c893700 1 --2- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f138002fe70 0x7f1380032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.330+0000 7f139c893700 1 --2- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f138002fe70 0x7f1380032330 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f13880096a0 tx=0x7f1388006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:03.335 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.334+0000 7f1385ffb700 1 -- 172.21.15.84:0/698399375 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1394022720 con 0x7f1398070430 2024-02-15T18:18:03.512 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.511+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f139810e090 con 0x7f138002fe70 2024-02-15T18:18:03.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:01.641511+0000 mgr.smithi084.hjmnez (mgr.14114) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:03.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:02.226504+0000 mon.smithi084 (mon.0) 54 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:03.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:02.226812+0000 mgr.smithi084.hjmnez (mgr.14114) 9 : cephadm [INF] Added host smithi084 2024-02-15T18:18:03.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:02.227036+0000 mon.smithi084 (mon.0) 55 : audit [DBG] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:18:03.516 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.515+0000 7f1385ffb700 1 -- 172.21.15.84:0/698399375 <== mgr.14114 v2:172.21.15.84:6800/519542921 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f139810e090 con 0x7f138002fe70 2024-02-15T18:18:03.516 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: Scheduled mon update... 2024-02-15T18:18:03.519 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f138002fe70 msgr2=0x7f1380032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:03.519 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 --2- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f138002fe70 0x7f1380032330 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f13880096a0 tx=0x7f1388006b40).stop 2024-02-15T18:18:03.519 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 msgr2=0x7f139810cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:03.519 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 --2- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f139810cbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f139400df90 tx=0x7f1394006ee0).stop 2024-02-15T18:18:03.519 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 shutdown_connections 2024-02-15T18:18:03.519 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 --2- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f138002fe70 0x7f1380032330 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:03.519 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 --2- 172.21.15.84:0/698399375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1398070430 0x7f139810cbf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:03.520 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 >> 172.21.15.84:0/698399375 conn(0x7f13980f6390 msgr2=0x7f13980f7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:03.520 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 shutdown_connections 2024-02-15T18:18:03.520 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:03.517+0000 7f139e096700 1 -- 172.21.15.84:0/698399375 wait complete. 2024-02-15T18:18:04.107 INFO:teuthology.orchestra.run.smithi084.stderr:Deploying mgr service with default placement... 2024-02-15T18:18:04.107 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mgr 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.588+0000 7fd0d5747700 1 Processor -- start 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.588+0000 7fd0d5747700 1 -- start start 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.588+0000 7fd0d5747700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.588+0000 7fd0d5747700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00fdde0 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.589+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.589+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46112/0 (socket says 172.21.15.84:46112) 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.589+0000 7fd0ceffd700 1 -- 172.21.15.84:0/1181590190 learned_addr learned my addr 172.21.15.84:0/1181590190 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.589+0000 7fd0ceffd700 1 -- 172.21.15.84:0/1181590190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d00fdf20 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.589+0000 7fd0ceffd700 1 --2- 172.21.15.84:0/1181590190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fd8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd0c400b5f0 tx=0x7fd0c4006ee0).ready entity=mon.0 client_cookie=db910acbb076f4ae server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.589+0000 7fd0cdffb700 1 -- 172.21.15.84:0/1181590190 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0c400d600 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.589+0000 7fd0cdffb700 1 -- 172.21.15.84:0/1181590190 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fd0c400dbf0 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.589+0000 7fd0cdffb700 1 -- 172.21.15.84:0/1181590190 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0c4011cb0 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.590+0000 7fd0d5747700 1 -- 172.21.15.84:0/1181590190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 msgr2=0x7fd0d00fd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.590+0000 7fd0d5747700 1 --2- 172.21.15.84:0/1181590190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fd8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd0c400b5f0 tx=0x7fd0c4006ee0).stop 2024-02-15T18:18:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.590+0000 7fd0d5747700 1 -- 172.21.15.84:0/1181590190 shutdown_connections 2024-02-15T18:18:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.590+0000 7fd0d5747700 1 --2- 172.21.15.84:0/1181590190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fd8f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.590+0000 7fd0d5747700 1 -- 172.21.15.84:0/1181590190 >> 172.21.15.84:0/1181590190 conn(0x7fd0d00f5d30 msgr2=0x7fd0d00f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.590+0000 7fd0d5747700 1 -- 172.21.15.84:0/1181590190 shutdown_connections 2024-02-15T18:18:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.590+0000 7fd0d5747700 1 -- 172.21.15.84:0/1181590190 wait complete. 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.591+0000 7fd0d5747700 1 Processor -- start 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.591+0000 7fd0d5747700 1 -- start start 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.591+0000 7fd0d5747700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.591+0000 7fd0d5747700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00fb220 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.591+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.591+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46122/0 (socket says 172.21.15.84:46122) 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.591+0000 7fd0ceffd700 1 -- 172.21.15.84:0/2044292257 learned_addr learned my addr 172.21.15.84:0/2044292257 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.591+0000 7fd0ceffd700 1 -- 172.21.15.84:0/2044292257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c400b200 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.592+0000 7fd0ceffd700 1 --2- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fcda0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd0c400bf40 tx=0x7fd0c4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.592+0000 7fd0b77fe700 1 -- 172.21.15.84:0/2044292257 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0c401b570 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.592+0000 7fd0b77fe700 1 -- 172.21.15.84:0/2044292257 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fd0c401bb60 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.592+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d00fb3c0 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.592+0000 7fd0b77fe700 1 -- 172.21.15.84:0/2044292257 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0c401aa20 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.592+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d00fb850 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.593+0000 7fd0b77fe700 1 -- 172.21.15.84:0/2044292257 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fd0c400f070 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.593+0000 7fd0b77fe700 1 --2- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fd0bc02fe70 0x7fd0bc032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.593+0000 7fd0b77fe700 1 -- 172.21.15.84:0/2044292257 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fd0c40414a0 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.593+0000 7fd0ce7fc700 1 --2- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fd0bc02fe70 0x7fd0bc032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.593+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d0045ad0 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.593+0000 7fd0ce7fc700 1 --2- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fd0bc02fe70 0x7fd0bc032330 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fd0c00096a0 tx=0x7fd0c0006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:04.598 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.597+0000 7fd0b77fe700 1 -- 172.21.15.84:0/2044292257 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd0c4016070 con 0x7fd0d00fd4d0 2024-02-15T18:18:04.771 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.770+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0d00008d0 con 0x7fd0bc02fe70 2024-02-15T18:18:04.774 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.774+0000 7fd0b77fe700 1 -- 172.21.15.84:0/2044292257 <== mgr.14114 v2:172.21.15.84:6800/519542921 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd0d00008d0 con 0x7fd0bc02fe70 2024-02-15T18:18:04.775 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-02-15T18:18:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fd0bc02fe70 msgr2=0x7fd0bc032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 --2- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fd0bc02fe70 0x7fd0bc032330 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fd0c00096a0 tx=0x7fd0c0006b40).stop 2024-02-15T18:18:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 msgr2=0x7fd0d00fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 --2- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fcda0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd0c400bf40 tx=0x7fd0c4006ee0).stop 2024-02-15T18:18:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 shutdown_connections 2024-02-15T18:18:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 --2- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7fd0bc02fe70 0x7fd0bc032330 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:04.777 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 --2- 172.21.15.84:0/2044292257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0d00fd4d0 0x7fd0d00fcda0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:04.778 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 >> 172.21.15.84:0/2044292257 conn(0x7fd0d00f5d30 msgr2=0x7fd0d00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:04.778 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 shutdown_connections 2024-02-15T18:18:04.778 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:04.775+0000 7fd0d5747700 1 -- 172.21.15.84:0/2044292257 wait complete. 2024-02-15T18:18:04.797 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:03.513539+0000 mgr.smithi084.hjmnez (mgr.14114) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:04.797 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:03.514236+0000 mgr.smithi084.hjmnez (mgr.14114) 11 : cephadm [INF] Saving service mon spec with placement count:5 2024-02-15T18:18:04.797 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:03.517248+0000 mon.smithi084 (mon.0) 56 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:05.675 INFO:teuthology.orchestra.run.smithi084.stderr:Deploying crash service with default placement... 2024-02-15T18:18:05.675 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply crash 2024-02-15T18:18:05.942 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:04.772727+0000 mgr.smithi084.hjmnez (mgr.14114) 12 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:05.942 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:04.773252+0000 mgr.smithi084.hjmnez (mgr.14114) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2024-02-15T18:18:05.942 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:04.775472+0000 mon.smithi084 (mon.0) 57 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:06.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.209+0000 7f5262ef5700 1 Processor -- start 2024-02-15T18:18:06.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.209+0000 7f5262ef5700 1 -- start start 2024-02-15T18:18:06.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.209+0000 7f5262ef5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c0fea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:06.214 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.209+0000 7f5262ef5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0fef80 con 0x7f525c0703f0 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.209+0000 7f5260c91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c0fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.209+0000 7f5260c91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c0fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46134/0 (socket says 172.21.15.84:46134) 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.209+0000 7f5260c91700 1 -- 172.21.15.84:0/3172762262 learned_addr learned my addr 172.21.15.84:0/3172762262 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.209+0000 7f5260c91700 1 -- 172.21.15.84:0/3172762262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c0ff0c0 con 0x7f525c0703f0 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.209+0000 7f5260c91700 1 --2- 172.21.15.84:0/3172762262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c0fea90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f525000b5f0 tx=0x7f5250006ee0).ready entity=mon.0 client_cookie=d83303301963ea21 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f525b7fe700 1 -- 172.21.15.84:0/3172762262 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f525000d600 con 0x7f525c0703f0 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f525b7fe700 1 -- 172.21.15.84:0/3172762262 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f525000dbf0 con 0x7f525c0703f0 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f525b7fe700 1 -- 172.21.15.84:0/3172762262 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5250011ce0 con 0x7f525c0703f0 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f5262ef5700 1 -- 172.21.15.84:0/3172762262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 msgr2=0x7f525c0fea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f5262ef5700 1 --2- 172.21.15.84:0/3172762262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c0fea90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f525000b5f0 tx=0x7f5250006ee0).stop 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f5262ef5700 1 -- 172.21.15.84:0/3172762262 shutdown_connections 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f5262ef5700 1 --2- 172.21.15.84:0/3172762262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c0fea90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f5262ef5700 1 -- 172.21.15.84:0/3172762262 >> 172.21.15.84:0/3172762262 conn(0x7f525c0f6530 msgr2=0x7f525c0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f5262ef5700 1 -- 172.21.15.84:0/3172762262 shutdown_connections 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.210+0000 7f5262ef5700 1 -- 172.21.15.84:0/3172762262 wait complete. 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.211+0000 7f5262ef5700 1 Processor -- start 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.211+0000 7f5262ef5700 1 -- start start 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.211+0000 7f5262ef5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c10ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.211+0000 7f5262ef5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c10b040 con 0x7f525c0703f0 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.211+0000 7f5260c91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c10ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.211+0000 7f5260c91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c10ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46144/0 (socket says 172.21.15.84:46144) 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.211+0000 7f5260c91700 1 -- 172.21.15.84:0/1440315589 learned_addr learned my addr 172.21.15.84:0/1440315589 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.211+0000 7f5260c91700 1 -- 172.21.15.84:0/1440315589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525000b200 con 0x7f525c0703f0 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.212+0000 7f5260c91700 1 --2- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c10ab50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5250011ed0 tx=0x7f5250006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.212+0000 7f52597fa700 1 -- 172.21.15.84:0/1440315589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f525001b570 con 0x7f525c0703f0 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.212+0000 7f52597fa700 1 -- 172.21.15.84:0/1440315589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f525001bb60 con 0x7f525c0703f0 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.212+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c10b240 con 0x7f525c0703f0 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.212+0000 7f52597fa700 1 -- 172.21.15.84:0/1440315589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f525001aad0 con 0x7f525c0703f0 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.212+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c10b6d0 con 0x7f525c0703f0 2024-02-15T18:18:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.213+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c045ad0 con 0x7f525c0703f0 2024-02-15T18:18:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.213+0000 7f52597fa700 1 -- 172.21.15.84:0/1440315589 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f525000f070 con 0x7f525c0703f0 2024-02-15T18:18:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.213+0000 7f52597fa700 1 --2- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f524002fe70 0x7f5240032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.213+0000 7f52597fa700 1 -- 172.21.15.84:0/1440315589 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f52500413b0 con 0x7f525c0703f0 2024-02-15T18:18:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.213+0000 7f525bfff700 1 --2- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f524002fe70 0x7f5240032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.214+0000 7f525bfff700 1 --2- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f524002fe70 0x7f5240032330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f52480096a0 tx=0x7f5248006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.217+0000 7f52597fa700 1 -- 172.21.15.84:0/1440315589 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5250022700 con 0x7f525c0703f0 2024-02-15T18:18:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.393+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f525c10bf30 con 0x7f524002fe70 2024-02-15T18:18:06.398 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.397+0000 7f52597fa700 1 -- 172.21.15.84:0/1440315589 <== mgr.14114 v2:172.21.15.84:6800/519542921 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f525c10bf30 con 0x7f524002fe70 2024-02-15T18:18:06.398 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: Scheduled crash update... 2024-02-15T18:18:06.400 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.398+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f524002fe70 msgr2=0x7f5240032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:06.400 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.398+0000 7f5262ef5700 1 --2- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f524002fe70 0x7f5240032330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f52480096a0 tx=0x7f5248006b40).stop 2024-02-15T18:18:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.398+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 msgr2=0x7f525c10ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.398+0000 7f5262ef5700 1 --2- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c10ab50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5250011ed0 tx=0x7f5250006ee0).stop 2024-02-15T18:18:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.398+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 shutdown_connections 2024-02-15T18:18:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.398+0000 7f5262ef5700 1 --2- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f524002fe70 0x7f5240032330 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.398+0000 7f5262ef5700 1 --2- 172.21.15.84:0/1440315589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525c0703f0 0x7f525c10ab50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.398+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 >> 172.21.15.84:0/1440315589 conn(0x7f525c0f6530 msgr2=0x7f525c0f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.399+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 shutdown_connections 2024-02-15T18:18:06.401 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:06.399+0000 7f5262ef5700 1 -- 172.21.15.84:0/1440315589 wait complete. 2024-02-15T18:18:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:Enabling mgr prometheus module... 2024-02-15T18:18:06.990 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable prometheus 2024-02-15T18:18:07.509 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.505+0000 7f620ee15700 1 Processor -- start 2024-02-15T18:18:07.509 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.505+0000 7f620ee15700 1 -- start start 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.505+0000 7f620ee15700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f6208100eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.505+0000 7f620ee15700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62080fc8a0 con 0x7f62080703d0 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.505+0000 7f620cbb1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f6208100eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.505+0000 7f620cbb1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f6208100eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46158/0 (socket says 172.21.15.84:46158) 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.505+0000 7f620cbb1700 1 -- 172.21.15.84:0/4271902368 learned_addr learned my addr 172.21.15.84:0/4271902368 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.505+0000 7f620cbb1700 1 -- 172.21.15.84:0/4271902368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62081013a0 con 0x7f62080703d0 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.505+0000 7f620cbb1700 1 --2- 172.21.15.84:0/4271902368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f6208100eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f61fc00b5f0 tx=0x7f61fc006ee0).ready entity=mon.0 client_cookie=bc9b6f2a0ed3b071 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f62077fe700 1 -- 172.21.15.84:0/4271902368 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61fc00d600 con 0x7f62080703d0 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f62077fe700 1 -- 172.21.15.84:0/4271902368 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f61fc00dbf0 con 0x7f62080703d0 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f62077fe700 1 -- 172.21.15.84:0/4271902368 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61fc011cb0 con 0x7f62080703d0 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f620ee15700 1 -- 172.21.15.84:0/4271902368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 msgr2=0x7f6208100eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f620ee15700 1 --2- 172.21.15.84:0/4271902368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f6208100eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f61fc00b5f0 tx=0x7f61fc006ee0).stop 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f620ee15700 1 -- 172.21.15.84:0/4271902368 shutdown_connections 2024-02-15T18:18:07.510 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f620ee15700 1 --2- 172.21.15.84:0/4271902368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f6208100eb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f620ee15700 1 -- 172.21.15.84:0/4271902368 >> 172.21.15.84:0/4271902368 conn(0x7f62080f6530 msgr2=0x7f62080f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f620ee15700 1 -- 172.21.15.84:0/4271902368 shutdown_connections 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.506+0000 7f620ee15700 1 -- 172.21.15.84:0/4271902368 wait complete. 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.507+0000 7f620ee15700 1 Processor -- start 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.507+0000 7f620ee15700 1 -- start start 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.507+0000 7f620ee15700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f620810ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.507+0000 7f620ee15700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620810d330 con 0x7f62080703d0 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.507+0000 7f620cbb1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f620810ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.507+0000 7f620cbb1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f620810ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46168/0 (socket says 172.21.15.84:46168) 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.507+0000 7f620cbb1700 1 -- 172.21.15.84:0/2439421407 learned_addr learned my addr 172.21.15.84:0/2439421407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.508+0000 7f620cbb1700 1 -- 172.21.15.84:0/2439421407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61fc00b200 con 0x7f62080703d0 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.508+0000 7f620cbb1700 1 --2- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f620810ce40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f61fc006800 tx=0x7f61fc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.508+0000 7f62057fa700 1 -- 172.21.15.84:0/2439421407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61fc01b570 con 0x7f62080703d0 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.508+0000 7f62057fa700 1 -- 172.21.15.84:0/2439421407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f61fc01bb60 con 0x7f62080703d0 2024-02-15T18:18:07.511 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.508+0000 7f62057fa700 1 -- 172.21.15.84:0/2439421407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61fc01a940 con 0x7f62080703d0 2024-02-15T18:18:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.508+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620810d530 con 0x7f62080703d0 2024-02-15T18:18:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.508+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620810e140 con 0x7f62080703d0 2024-02-15T18:18:07.512 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.509+0000 7f62057fa700 1 -- 172.21.15.84:0/2439421407 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f61fc00f070 con 0x7f62080703d0 2024-02-15T18:18:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.509+0000 7f62057fa700 1 --2- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f61ec02fe70 0x7f61ec032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.509+0000 7f62057fa700 1 -- 172.21.15.84:0/2439421407 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f61fc041320 con 0x7f62080703d0 2024-02-15T18:18:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.509+0000 7f6207fff700 1 --2- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f61ec02fe70 0x7f61ec032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.509+0000 7f6207fff700 1 --2- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f61ec02fe70 0x7f61ec032330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f61f40096a0 tx=0x7f61f4006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:07.513 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.510+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6208059100 con 0x7f62080703d0 2024-02-15T18:18:07.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:06.395579+0000 mgr.smithi084.hjmnez (mgr.14114) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:07.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:06.396236+0000 mgr.smithi084.hjmnez (mgr.14114) 15 : cephadm [INF] Saving service crash spec with placement * 2024-02-15T18:18:07.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:06.398456+0000 mon.smithi084 (mon.0) 58 : audit [INF] from='mgr.14114 172.21.15.84:0/3868276788' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:07.515 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.514+0000 7f62057fa700 1 -- 172.21.15.84:0/2439421407 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f61fc016070 con 0x7f62080703d0 2024-02-15T18:18:07.701 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:07.700+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "prometheus"} v 0) v1 -- 0x7f6208102050 con 0x7f62080703d0 2024-02-15T18:18:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.399+0000 7f62057fa700 1 -- 172.21.15.84:0/2439421407 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7f61fc022d80 con 0x7f62080703d0 2024-02-15T18:18:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.401+0000 7f62057fa700 1 -- 172.21.15.84:0/2439421407 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "prometheus"}]=0 v9) v1 ==== 89+0+0 (secure 0 0 0) 0x7f61fc019950 con 0x7f62080703d0 2024-02-15T18:18:08.405 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.403+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f61ec02fe70 msgr2=0x7f61ec032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:08.405 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.403+0000 7f620ee15700 1 --2- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f61ec02fe70 0x7f61ec032330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f61f40096a0 tx=0x7f61f4006b40).stop 2024-02-15T18:18:08.405 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.403+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 msgr2=0x7f620810ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:08.406 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.403+0000 7f620ee15700 1 --2- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f620810ce40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f61fc006800 tx=0x7f61fc006ee0).stop 2024-02-15T18:18:08.406 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.404+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 shutdown_connections 2024-02-15T18:18:08.406 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.404+0000 7f620ee15700 1 --2- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f61ec02fe70 0x7f61ec032330 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:08.406 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.404+0000 7f620ee15700 1 --2- 172.21.15.84:0/2439421407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62080703d0 0x7f620810ce40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:08.406 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.404+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 >> 172.21.15.84:0/2439421407 conn(0x7f62080f6530 msgr2=0x7f62080f7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:08.406 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.404+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 shutdown_connections 2024-02-15T18:18:08.406 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:08.404+0000 7f620ee15700 1 -- 172.21.15.84:0/2439421407 wait complete. 2024-02-15T18:18:08.743 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:07.702317+0000 mon.smithi084 (mon.0) 59 : audit [INF] from='client.? 172.21.15.84:0/2439421407' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-15T18:18:09.038 INFO:teuthology.orchestra.run.smithi084.stderr:Deploying prometheus service with default placement... 2024-02-15T18:18:09.038 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply prometheus 2024-02-15T18:18:09.605 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.581+0000 7f7a82036700 1 Processor -- start 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.581+0000 7f7a82036700 1 -- start start 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.581+0000 7f7a82036700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0fd570 0x7f7a7c0fd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.581+0000 7f7a82036700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0fde80 con 0x7f7a7c0fd570 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.581+0000 7f7a7b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0fd570 0x7f7a7c0fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.581+0000 7f7a7b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0fd570 0x7f7a7c0fd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46210/0 (socket says 172.21.15.84:46210) 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.582+0000 7f7a7b7fe700 1 -- 172.21.15.84:0/254258056 learned_addr learned my addr 172.21.15.84:0/254258056 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.582+0000 7f7a7b7fe700 1 -- 172.21.15.84:0/254258056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0fdfc0 con 0x7f7a7c0fd570 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.582+0000 7f7a7b7fe700 1 --2- 172.21.15.84:0/254258056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0fd570 0x7f7a7c0fd990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7a6c00b5f0 tx=0x7f7a6c006ee0).ready entity=mon.0 client_cookie=e88ae425cae8e401 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.582+0000 7f7a7a7fc700 1 -- 172.21.15.84:0/254258056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a6c00d600 con 0x7f7a7c0fd570 2024-02-15T18:18:09.609 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.582+0000 7f7a7a7fc700 1 -- 172.21.15.84:0/254258056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f7a6c00dbf0 con 0x7f7a7c0fd570 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.582+0000 7f7a7a7fc700 1 -- 172.21.15.84:0/254258056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a6c011cb0 con 0x7f7a7c0fd570 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.582+0000 7f7a82036700 1 -- 172.21.15.84:0/254258056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0fd570 msgr2=0x7f7a7c0fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.582+0000 7f7a82036700 1 --2- 172.21.15.84:0/254258056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0fd570 0x7f7a7c0fd990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7a6c00b5f0 tx=0x7f7a6c006ee0).stop 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.583+0000 7f7a82036700 1 -- 172.21.15.84:0/254258056 shutdown_connections 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.583+0000 7f7a82036700 1 --2- 172.21.15.84:0/254258056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0fd570 0x7f7a7c0fd990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.583+0000 7f7a82036700 1 -- 172.21.15.84:0/254258056 >> 172.21.15.84:0/254258056 conn(0x7f7a7c0f5d30 msgr2=0x7f7a7c0f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.583+0000 7f7a82036700 1 -- 172.21.15.84:0/254258056 shutdown_connections 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.583+0000 7f7a82036700 1 -- 172.21.15.84:0/254258056 wait complete. 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.583+0000 7f7a82036700 1 Processor -- start 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.583+0000 7f7a82036700 1 -- start start 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a82036700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c10acf0 0x7f7a7c10b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a82036700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c10b620 con 0x7f7a7c10acf0 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a7b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c10acf0 0x7f7a7c10b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a7b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c10acf0 0x7f7a7c10b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46222/0 (socket says 172.21.15.84:46222) 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a7b7fe700 1 -- 172.21.15.84:0/1907620889 learned_addr learned my addr 172.21.15.84:0/1907620889 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:09.610 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a7b7fe700 1 -- 172.21.15.84:0/1907620889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c00b200 con 0x7f7a7c10acf0 2024-02-15T18:18:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a7b7fe700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c10acf0 0x7f7a7c10b130 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7a6c00b5c0 tx=0x7f7a6c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a6c011400 con 0x7f7a7c10acf0 2024-02-15T18:18:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c10b820 con 0x7f7a7c10acf0 2024-02-15T18:18:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f7a6c01b8a0 con 0x7f7a7c10acf0 2024-02-15T18:18:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a6c01a860 con 0x7f7a7c10acf0 2024-02-15T18:18:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.584+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c10c290 con 0x7f7a7c10acf0 2024-02-15T18:18:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.585+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7f7a6c00f070 con 0x7f7a7c10acf0 2024-02-15T18:18:09.611 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.585+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c045ad0 con 0x7f7a7c10acf0 2024-02-15T18:18:09.612 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.585+0000 7f7a63fff700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 0x7f7a68032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:09.612 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.585+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f7a6c041320 con 0x7f7a7c10acf0 2024-02-15T18:18:09.612 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.585+0000 7f7a7affd700 1 -- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 msgr2=0x7f7a68032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/519542921 2024-02-15T18:18:09.612 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.585+0000 7f7a7affd700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 0x7f7a68032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:18:09.612 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.589+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7a6c022d20 con 0x7f7a7c10acf0 2024-02-15T18:18:09.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:08.402703+0000 mon.smithi084 (mon.0) 60 : audit [INF] from='client.? 172.21.15.84:0/2439421407' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-15T18:18:09.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:08.402776+0000 mon.smithi084 (mon.0) 61 : cluster [DBG] mgrmap e9: smithi084.hjmnez(active, since 19s) 2024-02-15T18:18:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.786+0000 7f7a7affd700 1 -- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 msgr2=0x7f7a68032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/519542921 2024-02-15T18:18:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.786+0000 7f7a7affd700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 0x7f7a68032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-15T18:18:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:09.811+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 --> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a7c1047b0 con 0x7f7a6802fe70 2024-02-15T18:18:10.188 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:10.187+0000 7f7a7affd700 1 -- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 msgr2=0x7f7a68032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/519542921 2024-02-15T18:18:10.188 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:10.187+0000 7f7a7affd700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 0x7f7a68032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-02-15T18:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:10.988+0000 7f7a7affd700 1 -- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 msgr2=0x7f7a68032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/519542921 2024-02-15T18:18:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:10.988+0000 7f7a7affd700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 0x7f7a68032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-02-15T18:18:12.590 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:12.589+0000 7f7a7affd700 1 -- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 msgr2=0x7f7a68032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/519542921 2024-02-15T18:18:12.591 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:12.589+0000 7f7a7affd700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 0x7f7a68032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-02-15T18:18:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:13.438+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 10) v1 ==== 35984+0+0 (secure 0 0 0) 0x7f7a6c0257e0 con 0x7f7a7c10acf0 2024-02-15T18:18:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:13.438+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 msgr2=0x7f7a68032330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:18:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:13.438+0000 7f7a63fff700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 0x7f7a68032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:18:13.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:13.388605+0000 mon.smithi084 (mon.0) 62 : cluster [INF] Active manager daemon smithi084.hjmnez restarted 2024-02-15T18:18:13.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:13.388993+0000 mon.smithi084 (mon.0) 63 : cluster [INF] Activating manager daemon smithi084.hjmnez 2024-02-15T18:18:13.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:13.393106+0000 mon.smithi084 (mon.0) 64 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-15T18:18:14.444 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.442+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mgrmap(e 11) v1 ==== 36054+0+0 (secure 0 0 0) 0x7f7a6c03d550 con 0x7f7a7c10acf0 2024-02-15T18:18:14.445 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.442+0000 7f7a63fff700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f7a68033ce0 0x7f7a680360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:14.445 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.442+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 --> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a7c1047b0 con 0x7f7a68033ce0 2024-02-15T18:18:14.445 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.443+0000 7f7a7affd700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f7a68033ce0 0x7f7a680360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:14.445 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.443+0000 7f7a7affd700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f7a68033ce0 0x7f7a680360d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f7a700036d0 tx=0x7f7a70006cb0).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:14.450 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.449+0000 7f7a63fff700 1 -- 172.21.15.84:0/1907620889 <== mgr.14142 v2:172.21.15.84:6800/1354831571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f7a7c1047b0 con 0x7f7a68033ce0 2024-02-15T18:18:14.450 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: Scheduled prometheus update... 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f7a68033ce0 msgr2=0x7f7a680360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f7a68033ce0 0x7f7a680360d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f7a700036d0 tx=0x7f7a70006cb0).stop 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c10acf0 msgr2=0x7f7a7c10b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c10acf0 0x7f7a7c10b130 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7a6c00b5c0 tx=0x7f7a6c006ee0).stop 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 shutdown_connections 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c10acf0 0x7f7a7c10b130 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f7a68033ce0 0x7f7a680360d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 --2- 172.21.15.84:0/1907620889 >> [v2:172.21.15.84:6800/519542921,v1:172.21.15.84:6801/519542921] conn(0x7f7a6802fe70 0x7f7a68032330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 >> 172.21.15.84:0/1907620889 conn(0x7f7a7c0f5d30 msgr2=0x7f7a7c0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 shutdown_connections 2024-02-15T18:18:14.454 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:14.452+0000 7f7a82036700 1 -- 172.21.15.84:0/1907620889 wait complete. 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:13.441503+0000 mon.smithi084 (mon.0) 65 : cluster [DBG] mgrmap e10: smithi084.hjmnez(active, starting, since 0.0525894s) 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:13.444158+0000 mon.smithi084 (mon.0) 66 : audit [DBG] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:13.444762+0000 mon.smithi084 (mon.0) 67 : audit [DBG] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi084.hjmnez", "id": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:13.445598+0000 mon.smithi084 (mon.0) 68 : audit [DBG] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:13.445778+0000 mon.smithi084 (mon.0) 69 : audit [DBG] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:13.445914+0000 mon.smithi084 (mon.0) 70 : audit [DBG] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:13.459304+0000 mon.smithi084 (mon.0) 71 : cluster [INF] Manager daemon smithi084.hjmnez is now available 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:13.556668+0000 mon.smithi084 (mon.0) 72 : audit [DBG] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:13.558285+0000 mon.smithi084 (mon.0) 73 : audit [DBG] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:13.573612+0000 mon.smithi084 (mon.0) 74 : audit [INF] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:18:14.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:13.581431+0000 mon.smithi084 (mon.0) 75 : audit [INF] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:18:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:Deploying grafana service with default placement... 2024-02-15T18:18:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply grafana 2024-02-15T18:18:15.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:14.445963+0000 mon.smithi084 (mon.0) 76 : cluster [DBG] mgrmap e11: smithi084.hjmnez(active, since 1.05705s) 2024-02-15T18:18:15.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:14.446927+0000 mgr.smithi084.hjmnez (mgr.14142) 2 : cephadm [INF] Saving service prometheus spec with placement count:1 2024-02-15T18:18:15.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:14.450536+0000 mon.smithi084 (mon.0) 77 : audit [INF] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.537+0000 7feb700f5700 1 Processor -- start 2024-02-15T18:18:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.537+0000 7feb700f5700 1 -- start start 2024-02-15T18:18:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.537+0000 7feb700f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb680fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.537+0000 7feb700f5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680fb6a0 con 0x7feb680fad90 2024-02-15T18:18:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.538+0000 7feb6de91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb680fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.538+0000 7feb6de91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb680fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36426/0 (socket says 172.21.15.84:36426) 2024-02-15T18:18:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.538+0000 7feb6de91700 1 -- 172.21.15.84:0/12854162 learned_addr learned my addr 172.21.15.84:0/12854162 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:15.550 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.538+0000 7feb6de91700 1 -- 172.21.15.84:0/12854162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680fb7e0 con 0x7feb680fad90 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.538+0000 7feb6de91700 1 --2- 172.21.15.84:0/12854162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb680fb1b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7feb5800b5f0 tx=0x7feb58006ee0).ready entity=mon.0 client_cookie=a3477a04461c05d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.538+0000 7feb6ce8f700 1 -- 172.21.15.84:0/12854162 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb5800d600 con 0x7feb680fad90 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.538+0000 7feb6ce8f700 1 -- 172.21.15.84:0/12854162 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7feb5800dbf0 con 0x7feb680fad90 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.538+0000 7feb6ce8f700 1 -- 172.21.15.84:0/12854162 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb58011cb0 con 0x7feb680fad90 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.539+0000 7feb700f5700 1 -- 172.21.15.84:0/12854162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 msgr2=0x7feb680fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.539+0000 7feb700f5700 1 --2- 172.21.15.84:0/12854162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb680fb1b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7feb5800b5f0 tx=0x7feb58006ee0).stop 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.539+0000 7feb700f5700 1 -- 172.21.15.84:0/12854162 shutdown_connections 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.539+0000 7feb700f5700 1 --2- 172.21.15.84:0/12854162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb680fb1b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.539+0000 7feb700f5700 1 -- 172.21.15.84:0/12854162 >> 172.21.15.84:0/12854162 conn(0x7feb680f6530 msgr2=0x7feb680f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.539+0000 7feb700f5700 1 -- 172.21.15.84:0/12854162 shutdown_connections 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.539+0000 7feb700f5700 1 -- 172.21.15.84:0/12854162 wait complete. 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.539+0000 7feb700f5700 1 Processor -- start 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.539+0000 7feb700f5700 1 -- start start 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb700f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb6810ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb700f5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6810b020 con 0x7feb680fad90 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb6de91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb6810ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb6de91700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb6810ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36432/0 (socket says 172.21.15.84:36432) 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb6de91700 1 -- 172.21.15.84:0/1252161967 learned_addr learned my addr 172.21.15.84:0/1252161967 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb6de91700 1 -- 172.21.15.84:0/1252161967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5800b200 con 0x7feb680fad90 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb6de91700 1 --2- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb6810ab30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7feb58011ea0 tx=0x7feb58006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb567fc700 1 -- 172.21.15.84:0/1252161967 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb5801b570 con 0x7feb680fad90 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb567fc700 1 -- 172.21.15.84:0/1252161967 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7feb5801bb60 con 0x7feb680fad90 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb567fc700 1 -- 172.21.15.84:0/1252161967 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb5801a8d0 con 0x7feb680fad90 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6810b220 con 0x7feb680fad90 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.540+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6810b6b0 con 0x7feb680fad90 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.541+0000 7feb567fc700 1 -- 172.21.15.84:0/1252161967 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7feb5800f070 con 0x7feb680fad90 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.541+0000 7feb567fc700 1 --2- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7feb5002ff70 0x7feb50032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.541+0000 7feb567fc700 1 -- 172.21.15.84:0/1252161967 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7feb58041520 con 0x7feb680fad90 2024-02-15T18:18:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.541+0000 7feb6d690700 1 --2- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7feb5002ff70 0x7feb50032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.541+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb68045ad0 con 0x7feb680fad90 2024-02-15T18:18:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.541+0000 7feb6d690700 1 --2- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7feb5002ff70 0x7feb50032430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7feb640096a0 tx=0x7feb64006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.545+0000 7feb567fc700 1 -- 172.21.15.84:0/1252161967 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7feb58016070 con 0x7feb680fad90 2024-02-15T18:18:15.722 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.721+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 --> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7feb68104d00 con 0x7feb5002ff70 2024-02-15T18:18:15.728 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.727+0000 7feb567fc700 1 -- 172.21.15.84:0/1252161967 <== mgr.14142 v2:172.21.15.84:6800/1354831571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7feb68104d00 con 0x7feb5002ff70 2024-02-15T18:18:15.729 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: Scheduled grafana update... 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7feb5002ff70 msgr2=0x7feb50032430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 --2- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7feb5002ff70 0x7feb50032430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7feb640096a0 tx=0x7feb64006b40).stop 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 msgr2=0x7feb6810ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 --2- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb6810ab30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7feb58011ea0 tx=0x7feb58006ee0).stop 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 shutdown_connections 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 --2- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7feb5002ff70 0x7feb50032430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 --2- 172.21.15.84:0/1252161967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb680fad90 0x7feb6810ab30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 >> 172.21.15.84:0/1252161967 conn(0x7feb680f6530 msgr2=0x7feb680700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 shutdown_connections 2024-02-15T18:18:15.731 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:15.729+0000 7feb700f5700 1 -- 172.21.15.84:0/1252161967 wait complete. 2024-02-15T18:18:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:Deploying node-exporter service with default placement... 2024-02-15T18:18:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply node-exporter 2024-02-15T18:18:16.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:15.454649+0000 mon.smithi084 (mon.0) 78 : cluster [DBG] mgrmap e12: smithi084.hjmnez(active, since 2s) 2024-02-15T18:18:16.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:15.723614+0000 mgr.smithi084.hjmnez (mgr.14142) 3 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:16.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:15.724137+0000 mgr.smithi084.hjmnez (mgr.14142) 4 : cephadm [INF] Saving service grafana spec with placement count:1 2024-02-15T18:18:16.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:15.729343+0000 mon.smithi084 (mon.0) 79 : audit [INF] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:16.853 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7ab0a8700 1 Processor -- start 2024-02-15T18:18:16.856 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7ab0a8700 1 -- start start 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7ab0a8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a40fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7ab0a8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40fc7b0 con 0x7fa7a40fbea0 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7a8e44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a40fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7a8e44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a40fc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36446/0 (socket says 172.21.15.84:36446) 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7a8e44700 1 -- 172.21.15.84:0/997950811 learned_addr learned my addr 172.21.15.84:0/997950811 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7a8e44700 1 -- 172.21.15.84:0/997950811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a40fc8f0 con 0x7fa7a40fbea0 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7a8e44700 1 --2- 172.21.15.84:0/997950811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a40fc2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa79800b5f0 tx=0x7fa798006ee0).ready entity=mon.0 client_cookie=4109aab43f26bd57 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7a37fe700 1 -- 172.21.15.84:0/997950811 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa79800d600 con 0x7fa7a40fbea0 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7a37fe700 1 -- 172.21.15.84:0/997950811 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fa79800dbf0 con 0x7fa7a40fbea0 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.842+0000 7fa7a37fe700 1 -- 172.21.15.84:0/997950811 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa798011cb0 con 0x7fa7a40fbea0 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.843+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/997950811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 msgr2=0x7fa7a40fc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.843+0000 7fa7ab0a8700 1 --2- 172.21.15.84:0/997950811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a40fc2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa79800b5f0 tx=0x7fa798006ee0).stop 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.843+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/997950811 shutdown_connections 2024-02-15T18:18:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.843+0000 7fa7ab0a8700 1 --2- 172.21.15.84:0/997950811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a40fc2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.843+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/997950811 >> 172.21.15.84:0/997950811 conn(0x7fa7a40f76a0 msgr2=0x7fa7a40f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.843+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/997950811 shutdown_connections 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.843+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/997950811 wait complete. 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.843+0000 7fa7ab0a8700 1 Processor -- start 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.843+0000 7fa7ab0a8700 1 -- start start 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7ab0a8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a410ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7ab0a8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a410b080 con 0x7fa7a40fbea0 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7a8e44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a410ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7a8e44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a410ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36456/0 (socket says 172.21.15.84:36456) 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7a8e44700 1 -- 172.21.15.84:0/3401977767 learned_addr learned my addr 172.21.15.84:0/3401977767 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7a8e44700 1 -- 172.21.15.84:0/3401977767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79800b200 con 0x7fa7a40fbea0 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7a8e44700 1 --2- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a410ab90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa79800bf40 tx=0x7fa798006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7a17fa700 1 -- 172.21.15.84:0/3401977767 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa79801b570 con 0x7fa7a40fbea0 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7a17fa700 1 -- 172.21.15.84:0/3401977767 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fa79801bb60 con 0x7fa7a40fbea0 2024-02-15T18:18:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a410b280 con 0x7fa7a40fbea0 2024-02-15T18:18:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7a17fa700 1 -- 172.21.15.84:0/3401977767 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa79801aa20 con 0x7fa7a40fbea0 2024-02-15T18:18:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.844+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a410b710 con 0x7fa7a40fbea0 2024-02-15T18:18:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.845+0000 7fa7a17fa700 1 -- 172.21.15.84:0/3401977767 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fa79800f070 con 0x7fa7a40fbea0 2024-02-15T18:18:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.845+0000 7fa7a17fa700 1 --2- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fa78802ff20 0x7fa7880323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.845+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a4045ad0 con 0x7fa7a40fbea0 2024-02-15T18:18:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.845+0000 7fa7a17fa700 1 -- 172.21.15.84:0/3401977767 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fa798041600 con 0x7fa7a40fbea0 2024-02-15T18:18:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.845+0000 7fa7a3fff700 1 --2- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fa78802ff20 0x7fa7880323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.845+0000 7fa7a3fff700 1 --2- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fa78802ff20 0x7fa7880323e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa7900096a0 tx=0x7fa790006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:16.849+0000 7fa7a17fa700 1 -- 172.21.15.84:0/3401977767 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa79801ab80 con 0x7fa7a40fbea0 2024-02-15T18:18:17.026 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.025+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 --> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7a410bf70 con 0x7fa78802ff20 2024-02-15T18:18:17.032 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.031+0000 7fa7a17fa700 1 -- 172.21.15.84:0/3401977767 <== mgr.14142 v2:172.21.15.84:6800/1354831571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fa7a410bf70 con 0x7fa78802ff20 2024-02-15T18:18:17.032 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fa78802ff20 msgr2=0x7fa7880323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 --2- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fa78802ff20 0x7fa7880323e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa7900096a0 tx=0x7fa790006b40).stop 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 msgr2=0x7fa7a410ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 --2- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a410ab90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa79800bf40 tx=0x7fa798006ee0).stop 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 shutdown_connections 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 --2- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fa78802ff20 0x7fa7880323e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 --2- 172.21.15.84:0/3401977767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7a40fbea0 0x7fa7a410ab90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 >> 172.21.15.84:0/3401977767 conn(0x7fa7a40f76a0 msgr2=0x7fa7a40f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 shutdown_connections 2024-02-15T18:18:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:17.033+0000 7fa7ab0a8700 1 -- 172.21.15.84:0/3401977767 wait complete. 2024-02-15T18:18:17.701 INFO:teuthology.orchestra.run.smithi084.stderr:Deploying alertmanager service with default placement... 2024-02-15T18:18:17.701 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply alertmanager 2024-02-15T18:18:18.246 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.216+0000 7f68c9276700 1 Processor -- start 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.216+0000 7f68c9276700 1 -- start start 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.216+0000 7f68c9276700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c40fc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.216+0000 7f68c9276700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40fccc0 con 0x7f68c40fc3b0 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.216+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c40fc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.216+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c40fc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36462/0 (socket says 172.21.15.84:36462) 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.216+0000 7f68c2ffd700 1 -- 172.21.15.84:0/367380721 learned_addr learned my addr 172.21.15.84:0/367380721 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.216+0000 7f68c2ffd700 1 -- 172.21.15.84:0/367380721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40fce00 con 0x7f68c40fc3b0 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.216+0000 7f68c2ffd700 1 --2- 172.21.15.84:0/367380721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c40fc7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f68b400b5f0 tx=0x7f68b4006ee0).ready entity=mon.0 client_cookie=14c0d1ccab18a18d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c1ffb700 1 -- 172.21.15.84:0/367380721 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68b400d600 con 0x7f68c40fc3b0 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c1ffb700 1 -- 172.21.15.84:0/367380721 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f68b400dbf0 con 0x7f68c40fc3b0 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c1ffb700 1 -- 172.21.15.84:0/367380721 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68b4011cb0 con 0x7f68c40fc3b0 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c9276700 1 -- 172.21.15.84:0/367380721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 msgr2=0x7f68c40fc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c9276700 1 --2- 172.21.15.84:0/367380721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c40fc7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f68b400b5f0 tx=0x7f68b4006ee0).stop 2024-02-15T18:18:18.247 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c9276700 1 -- 172.21.15.84:0/367380721 shutdown_connections 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c9276700 1 --2- 172.21.15.84:0/367380721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c40fc7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c9276700 1 -- 172.21.15.84:0/367380721 >> 172.21.15.84:0/367380721 conn(0x7f68c40f5d30 msgr2=0x7f68c40f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c9276700 1 -- 172.21.15.84:0/367380721 shutdown_connections 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.217+0000 7f68c9276700 1 -- 172.21.15.84:0/367380721 wait complete. 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.218+0000 7f68c9276700 1 Processor -- start 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.218+0000 7f68c9276700 1 -- start start 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.218+0000 7f68c9276700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c4109a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.218+0000 7f68c9276700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4109f50 con 0x7f68c40fc3b0 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.218+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c4109a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.218+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c4109a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36464/0 (socket says 172.21.15.84:36464) 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.218+0000 7f68c2ffd700 1 -- 172.21.15.84:0/2703683451 learned_addr learned my addr 172.21.15.84:0/2703683451 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.219+0000 7f68c2ffd700 1 -- 172.21.15.84:0/2703683451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b400b200 con 0x7f68c40fc3b0 2024-02-15T18:18:18.248 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.219+0000 7f68c2ffd700 1 --2- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c4109a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f68b400bf40 tx=0x7f68b4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.219+0000 7f68ab7fe700 1 -- 172.21.15.84:0/2703683451 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68b401b570 con 0x7f68c40fc3b0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.219+0000 7f68ab7fe700 1 -- 172.21.15.84:0/2703683451 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f68b401bb60 con 0x7f68c40fc3b0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.219+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c410a150 con 0x7f68c40fc3b0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.219+0000 7f68ab7fe700 1 -- 172.21.15.84:0/2703683451 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68b401aa20 con 0x7f68c40fc3b0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.219+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c410a5e0 con 0x7f68c40fc3b0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.220+0000 7f68ab7fe700 1 -- 172.21.15.84:0/2703683451 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f68b400f070 con 0x7f68c40fc3b0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.220+0000 7f68ab7fe700 1 --2- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f68b002ff20 0x7f68b00323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.220+0000 7f68ab7fe700 1 -- 172.21.15.84:0/2703683451 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f68b4041660 con 0x7f68c40fc3b0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.220+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c4045ad0 con 0x7f68c40fc3b0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.220+0000 7f68c27fc700 1 --2- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f68b002ff20 0x7f68b00323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.220+0000 7f68c27fc700 1 --2- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f68b002ff20 0x7f68b00323e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f68b80096a0 tx=0x7f68b8006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:18.249 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.224+0000 7f68ab7fe700 1 -- 172.21.15.84:0/2703683451 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f68b4016070 con 0x7f68c40fc3b0 2024-02-15T18:18:18.400 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.400+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 --> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f68c410ae40 con 0x7f68b002ff20 2024-02-15T18:18:18.404 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.404+0000 7f68ab7fe700 1 -- 172.21.15.84:0/2703683451 <== mgr.14142 v2:172.21.15.84:6800/1354831571 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f68c410ae40 con 0x7f68b002ff20 2024-02-15T18:18:18.404 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f68b002ff20 msgr2=0x7f68b00323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 --2- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f68b002ff20 0x7f68b00323e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f68b80096a0 tx=0x7f68b8006b40).stop 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 msgr2=0x7f68c4109a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 --2- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c4109a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f68b400bf40 tx=0x7f68b4006ee0).stop 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 shutdown_connections 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 --2- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f68b002ff20 0x7f68b00323e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 --2- 172.21.15.84:0/2703683451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c40fc3b0 0x7f68c4109a60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 >> 172.21.15.84:0/2703683451 conn(0x7f68c40f5d30 msgr2=0x7f68c40fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 shutdown_connections 2024-02-15T18:18:18.407 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:18.406+0000 7f68c9276700 1 -- 172.21.15.84:0/2703683451 wait complete. 2024-02-15T18:18:18.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:17.027447+0000 mgr.smithi084.hjmnez (mgr.14142) 5 : audit [DBG] from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:18.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:17.028071+0000 mgr.smithi084.hjmnez (mgr.14142) 6 : cephadm [INF] Saving service node-exporter spec with placement * 2024-02-15T18:18:18.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:17.032692+0000 mon.smithi084 (mon.0) 80 : audit [INF] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:19.065 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/cephadm/container_init True --force 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.540+0000 7f21d00f2700 1 Processor -- start 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.541+0000 7f21d00f2700 1 -- start start 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.541+0000 7f21d00f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c80fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.541+0000 7f21d00f2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80fb6a0 con 0x7f21c80fad90 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.541+0000 7f21cde8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c80fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.541+0000 7f21cde8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c80fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36470/0 (socket says 172.21.15.84:36470) 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.541+0000 7f21cde8e700 1 -- 172.21.15.84:0/1917493440 learned_addr learned my addr 172.21.15.84:0/1917493440 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.541+0000 7f21cde8e700 1 -- 172.21.15.84:0/1917493440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c80fb7e0 con 0x7f21c80fad90 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.541+0000 7f21cde8e700 1 --2- 172.21.15.84:0/1917493440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c80fb1b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f21b800b5f0 tx=0x7f21b8006ee0).ready entity=mon.0 client_cookie=30212c3c633a73a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:19.543 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21cce8c700 1 -- 172.21.15.84:0/1917493440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21b800d600 con 0x7f21c80fad90 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21cce8c700 1 -- 172.21.15.84:0/1917493440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f21b800dbf0 con 0x7f21c80fad90 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21cce8c700 1 -- 172.21.15.84:0/1917493440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21b8011cb0 con 0x7f21c80fad90 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21d00f2700 1 -- 172.21.15.84:0/1917493440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 msgr2=0x7f21c80fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21d00f2700 1 --2- 172.21.15.84:0/1917493440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c80fb1b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f21b800b5f0 tx=0x7f21b8006ee0).stop 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21d00f2700 1 -- 172.21.15.84:0/1917493440 shutdown_connections 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21d00f2700 1 --2- 172.21.15.84:0/1917493440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c80fb1b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21d00f2700 1 -- 172.21.15.84:0/1917493440 >> 172.21.15.84:0/1917493440 conn(0x7f21c80f6530 msgr2=0x7f21c80f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21d00f2700 1 -- 172.21.15.84:0/1917493440 shutdown_connections 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.542+0000 7f21d00f2700 1 -- 172.21.15.84:0/1917493440 wait complete. 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.543+0000 7f21d00f2700 1 Processor -- start 2024-02-15T18:18:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.543+0000 7f21d00f2700 1 -- start start 2024-02-15T18:18:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.543+0000 7f21d00f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c810d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.543+0000 7f21d00f2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8070470 con 0x7f21c80fad90 2024-02-15T18:18:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.543+0000 7f21cde8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c810d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.543+0000 7f21cde8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c810d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36476/0 (socket says 172.21.15.84:36476) 2024-02-15T18:18:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.543+0000 7f21cde8e700 1 -- 172.21.15.84:0/2156998471 learned_addr learned my addr 172.21.15.84:0/2156998471 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.544+0000 7f21cde8e700 1 -- 172.21.15.84:0/2156998471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b800b200 con 0x7f21c80fad90 2024-02-15T18:18:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.544+0000 7f21cde8e700 1 --2- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c810d840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f21b8011ea0 tx=0x7f21b8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.544+0000 7f21b67fc700 1 -- 172.21.15.84:0/2156998471 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21b801b570 con 0x7f21c80fad90 2024-02-15T18:18:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.544+0000 7f21b67fc700 1 -- 172.21.15.84:0/2156998471 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f21b801bb60 con 0x7f21c80fad90 2024-02-15T18:18:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.544+0000 7f21b67fc700 1 -- 172.21.15.84:0/2156998471 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21b801a8d0 con 0x7f21c80fad90 2024-02-15T18:18:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.544+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c8070670 con 0x7f21c80fad90 2024-02-15T18:18:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.544+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c810def0 con 0x7f21c80fad90 2024-02-15T18:18:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.545+0000 7f21b67fc700 1 -- 172.21.15.84:0/2156998471 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f21b800f070 con 0x7f21c80fad90 2024-02-15T18:18:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.545+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c8045ad0 con 0x7f21c80fad90 2024-02-15T18:18:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.545+0000 7f21b67fc700 1 --2- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f21b002ff70 0x7f21b0032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.545+0000 7f21b67fc700 1 -- 172.21.15.84:0/2156998471 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f21b8041690 con 0x7f21c80fad90 2024-02-15T18:18:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.545+0000 7f21cd68d700 1 --2- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f21b002ff70 0x7f21b0032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:19.547 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.545+0000 7f21cd68d700 1 --2- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f21b002ff70 0x7f21b0032430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f21c40096a0 tx=0x7f21c4006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:19.549 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.549+0000 7f21b67fc700 1 -- 172.21.15.84:0/2156998471 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f21b801b6d0 con 0x7f21c80fad90 2024-02-15T18:18:19.697 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.697+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f21c8027a00 con 0x7f21c80fad90 2024-02-15T18:18:19.699 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.699+0000 7f21b67fc700 1 -- 172.21.15.84:0/2156998471 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v8)=0 v8) v1 ==== 142+0+0 (secure 0 0 0) 0x7f21b8016070 con 0x7f21c80fad90 2024-02-15T18:18:19.702 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f21b002ff70 msgr2=0x7f21b0032430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:19.702 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 --2- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f21b002ff70 0x7f21b0032430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f21c40096a0 tx=0x7f21c4006b40).stop 2024-02-15T18:18:19.702 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 msgr2=0x7f21c810d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:19.702 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 --2- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c810d840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f21b8011ea0 tx=0x7f21b8006ee0).stop 2024-02-15T18:18:19.702 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 shutdown_connections 2024-02-15T18:18:19.702 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 --2- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f21b002ff70 0x7f21b0032430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:19.703 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 --2- 172.21.15.84:0/2156998471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21c80fad90 0x7f21c810d840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:19.703 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 >> 172.21.15.84:0/2156998471 conn(0x7f21c80f6530 msgr2=0x7f21c80f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:19.703 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 shutdown_connections 2024-02-15T18:18:19.703 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:19.701+0000 7f21d00f2700 1 -- 172.21.15.84:0/2156998471 wait complete. 2024-02-15T18:18:19.726 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:18.402071+0000 mgr.smithi084.hjmnez (mgr.14142) 7 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:19.726 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:18.402578+0000 mgr.smithi084.hjmnez (mgr.14142) 8 : cephadm [INF] Saving service alertmanager spec with placement count:1 2024-02-15T18:18:19.726 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:18.404724+0000 mon.smithi084 (mon.0) 81 : audit [INF] from='mgr.14142 172.21.15.84:0/640462520' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/dashboard/ssl_server_port 8443 2024-02-15T18:18:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.909+0000 7fbe25866700 1 Processor -- start 2024-02-15T18:18:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.909+0000 7fbe25866700 1 -- start start 2024-02-15T18:18:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.909+0000 7fbe25866700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe200fd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.909+0000 7fbe25866700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200fdea0 con 0x7fbe200fd590 2024-02-15T18:18:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.910+0000 7fbe1effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe200fd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.910+0000 7fbe1effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe200fd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36492/0 (socket says 172.21.15.84:36492) 2024-02-15T18:18:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.910+0000 7fbe1effd700 1 -- 172.21.15.84:0/2300193974 learned_addr learned my addr 172.21.15.84:0/2300193974 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.910+0000 7fbe1effd700 1 -- 172.21.15.84:0/2300193974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe200fdfe0 con 0x7fbe200fd590 2024-02-15T18:18:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.910+0000 7fbe1effd700 1 --2- 172.21.15.84:0/2300193974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe200fd9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbe1800b5f0 tx=0x7fbe18006ee0).ready entity=mon.0 client_cookie=73db4e4ab676c1c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.910+0000 7fbe1dffb700 1 -- 172.21.15.84:0/2300193974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe1800d600 con 0x7fbe200fd590 2024-02-15T18:18:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.910+0000 7fbe1dffb700 1 -- 172.21.15.84:0/2300193974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fbe1800dbf0 con 0x7fbe200fd590 2024-02-15T18:18:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.910+0000 7fbe1dffb700 1 -- 172.21.15.84:0/2300193974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe18011cb0 con 0x7fbe200fd590 2024-02-15T18:18:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 -- 172.21.15.84:0/2300193974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 msgr2=0x7fbe200fd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 --2- 172.21.15.84:0/2300193974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe200fd9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbe1800b5f0 tx=0x7fbe18006ee0).stop 2024-02-15T18:18:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 -- 172.21.15.84:0/2300193974 shutdown_connections 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 --2- 172.21.15.84:0/2300193974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe200fd9b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 -- 172.21.15.84:0/2300193974 >> 172.21.15.84:0/2300193974 conn(0x7fbe200f5d30 msgr2=0x7fbe200f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 -- 172.21.15.84:0/2300193974 shutdown_connections 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 -- 172.21.15.84:0/2300193974 wait complete. 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 Processor -- start 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 -- start start 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe2010abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.911+0000 7fbe25866700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2010b0c0 con 0x7fbe200fd590 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe1effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe2010abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe1effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe2010abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36498/0 (socket says 172.21.15.84:36498) 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe1effd700 1 -- 172.21.15.84:0/2747255787 learned_addr learned my addr 172.21.15.84:0/2747255787 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe1effd700 1 -- 172.21.15.84:0/2747255787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1800b200 con 0x7fbe200fd590 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe1effd700 1 --2- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe2010abd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbe18002f40 tx=0x7fbe18006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe177fe700 1 -- 172.21.15.84:0/2747255787 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe1801b410 con 0x7fbe200fd590 2024-02-15T18:18:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe177fe700 1 -- 172.21.15.84:0/2747255787 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fbe1801ba00 con 0x7fbe200fd590 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2010b2c0 con 0x7fbe200fd590 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe177fe700 1 -- 172.21.15.84:0/2747255787 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe1801a980 con 0x7fbe200fd590 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.912+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2010b750 con 0x7fbe200fd590 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.913+0000 7fbe177fe700 1 -- 172.21.15.84:0/2747255787 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fbe1800f070 con 0x7fbe200fd590 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.913+0000 7fbe177fe700 1 --2- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fbe0002ff20 0x7fbe000323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.913+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe20045ad0 con 0x7fbe200fd590 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.913+0000 7fbe177fe700 1 -- 172.21.15.84:0/2747255787 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fbe18041570 con 0x7fbe200fd590 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.913+0000 7fbe1e7fc700 1 --2- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fbe0002ff20 0x7fbe000323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.913+0000 7fbe1e7fc700 1 --2- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fbe0002ff20 0x7fbe000323e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fbe080096a0 tx=0x7fbe08006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:20.917+0000 7fbe177fe700 1 -- 172.21.15.84:0/2747255787 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fbe18019cd0 con 0x7fbe200fd590 2024-02-15T18:18:21.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:19.700618+0000 mon.smithi084 (mon.0) 82 : audit [INF] from='client.? 172.21.15.84:0/2156998471' entity='client.admin' 2024-02-15T18:18:21.082 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.082+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fbe200fa950 con 0x7fbe200fd590 2024-02-15T18:18:21.085 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.085+0000 7fbe177fe700 1 -- 172.21.15.84:0/2747255787 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v9)=0 v9) v1 ==== 130+0+0 (secure 0 0 0) 0x7fbe180160c0 con 0x7fbe200fd590 2024-02-15T18:18:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.087+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fbe0002ff20 msgr2=0x7fbe000323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.087+0000 7fbe25866700 1 --2- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fbe0002ff20 0x7fbe000323e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fbe080096a0 tx=0x7fbe08006b40).stop 2024-02-15T18:18:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.087+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 msgr2=0x7fbe2010abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.087+0000 7fbe25866700 1 --2- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe2010abd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbe18002f40 tx=0x7fbe18006ee0).stop 2024-02-15T18:18:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.087+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 shutdown_connections 2024-02-15T18:18:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.087+0000 7fbe25866700 1 --2- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fbe0002ff20 0x7fbe000323e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.087+0000 7fbe25866700 1 --2- 172.21.15.84:0/2747255787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe200fd590 0x7fbe2010abd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.087+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 >> 172.21.15.84:0/2747255787 conn(0x7fbe200f5d30 msgr2=0x7fbe200ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.088+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 shutdown_connections 2024-02-15T18:18:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:21.088+0000 7fbe25866700 1 -- 172.21.15.84:0/2747255787 wait complete. 2024-02-15T18:18:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:21.085989+0000 mon.smithi084 (mon.0) 83 : audit [INF] from='client.? 172.21.15.84:0/2747255787' entity='client.admin' 2024-02-15T18:18:22.427 INFO:teuthology.orchestra.run.smithi084.stderr:Enabling the dashboard module... 2024-02-15T18:18:22.427 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable dashboard 2024-02-15T18:18:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.043+0000 7f6c347f1700 1 Processor -- start 2024-02-15T18:18:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.043+0000 7f6c347f1700 1 -- start start 2024-02-15T18:18:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.043+0000 7f6c347f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c0fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.043+0000 7f6c347f1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0fb6a0 con 0x7f6c2c0fad90 2024-02-15T18:18:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.043+0000 7f6c3258d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c0fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.043+0000 7f6c3258d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c0fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36504/0 (socket says 172.21.15.84:36504) 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.043+0000 7f6c3258d700 1 -- 172.21.15.84:0/1129068841 learned_addr learned my addr 172.21.15.84:0/1129068841 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.043+0000 7f6c3258d700 1 -- 172.21.15.84:0/1129068841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c0fb7e0 con 0x7f6c2c0fad90 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c3258d700 1 --2- 172.21.15.84:0/1129068841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c0fb1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6c2800b5f0 tx=0x7f6c28006ee0).ready entity=mon.0 client_cookie=2cc08a3e7666a2c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c3158b700 1 -- 172.21.15.84:0/1129068841 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c2800d600 con 0x7f6c2c0fad90 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c3158b700 1 -- 172.21.15.84:0/1129068841 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f6c2800dbf0 con 0x7f6c2c0fad90 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c3158b700 1 -- 172.21.15.84:0/1129068841 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c28011cb0 con 0x7f6c2c0fad90 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c347f1700 1 -- 172.21.15.84:0/1129068841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 msgr2=0x7f6c2c0fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c347f1700 1 --2- 172.21.15.84:0/1129068841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c0fb1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6c2800b5f0 tx=0x7f6c28006ee0).stop 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c347f1700 1 -- 172.21.15.84:0/1129068841 shutdown_connections 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c347f1700 1 --2- 172.21.15.84:0/1129068841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c0fb1b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:23.048 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c347f1700 1 -- 172.21.15.84:0/1129068841 >> 172.21.15.84:0/1129068841 conn(0x7f6c2c0f6530 msgr2=0x7f6c2c0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c347f1700 1 -- 172.21.15.84:0/1129068841 shutdown_connections 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.044+0000 7f6c347f1700 1 -- 172.21.15.84:0/1129068841 wait complete. 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.045+0000 7f6c347f1700 1 Processor -- start 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.045+0000 7f6c347f1700 1 -- start start 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.045+0000 7f6c347f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c10d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.045+0000 7f6c347f1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c070470 con 0x7f6c2c0fad90 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.045+0000 7f6c3258d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c10d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.045+0000 7f6c3258d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c10d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36520/0 (socket says 172.21.15.84:36520) 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.045+0000 7f6c3258d700 1 -- 172.21.15.84:0/1826533217 learned_addr learned my addr 172.21.15.84:0/1826533217 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.045+0000 7f6c3258d700 1 -- 172.21.15.84:0/1826533217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2800b200 con 0x7f6c2c0fad90 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.046+0000 7f6c3258d700 1 --2- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c10d890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6c28002f40 tx=0x7f6c28006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.046+0000 7f6c1affd700 1 -- 172.21.15.84:0/1826533217 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c2801b410 con 0x7f6c2c0fad90 2024-02-15T18:18:23.049 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.046+0000 7f6c1affd700 1 -- 172.21.15.84:0/1826533217 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f6c2801ba00 con 0x7f6c2c0fad90 2024-02-15T18:18:23.050 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.046+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c070670 con 0x7f6c2c0fad90 2024-02-15T18:18:23.050 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.046+0000 7f6c1affd700 1 -- 172.21.15.84:0/1826533217 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c2801a900 con 0x7f6c2c0fad90 2024-02-15T18:18:23.050 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.046+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c10df40 con 0x7f6c2c0fad90 2024-02-15T18:18:23.050 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.046+0000 7f6c1affd700 1 -- 172.21.15.84:0/1826533217 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f6c2800f070 con 0x7f6c2c0fad90 2024-02-15T18:18:23.050 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.047+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c045ad0 con 0x7f6c2c0fad90 2024-02-15T18:18:23.050 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.047+0000 7f6c1affd700 1 --2- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f6c1402ff20 0x7f6c140323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:23.050 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.047+0000 7f6c1affd700 1 -- 172.21.15.84:0/1826533217 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f6c28041530 con 0x7f6c2c0fad90 2024-02-15T18:18:23.050 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.047+0000 7f6c31d8c700 1 --2- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f6c1402ff20 0x7f6c140323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:23.050 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.047+0000 7f6c31d8c700 1 --2- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f6c1402ff20 0x7f6c140323e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f6c1c0096a0 tx=0x7f6c1c006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:23.051 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.051+0000 7f6c1affd700 1 -- 172.21.15.84:0/1826533217 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6c28022b00 con 0x7f6c2c0fad90 2024-02-15T18:18:23.242 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.242+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f6c2c027a00 con 0x7f6c2c0fad90 2024-02-15T18:18:23.295 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.294+0000 7f6c1affd700 1 -- 172.21.15.84:0/1826533217 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f6c28025980 con 0x7f6c2c0fad90 2024-02-15T18:18:23.295 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.295+0000 7f6c1affd700 1 -- 172.21.15.84:0/1826533217 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v13) v1 ==== 88+0+0 (secure 0 0 0) 0x7f6c28010a00 con 0x7f6c2c0fad90 2024-02-15T18:18:23.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.297+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f6c1402ff20 msgr2=0x7f6c140323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:23.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.297+0000 7f6c347f1700 1 --2- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f6c1402ff20 0x7f6c140323e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f6c1c0096a0 tx=0x7f6c1c006b40).stop 2024-02-15T18:18:23.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.297+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 msgr2=0x7f6c2c10d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:23.298 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.297+0000 7f6c347f1700 1 --2- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c10d890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6c28002f40 tx=0x7f6c28006ee0).stop 2024-02-15T18:18:23.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.297+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 shutdown_connections 2024-02-15T18:18:23.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.297+0000 7f6c347f1700 1 --2- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7f6c1402ff20 0x7f6c140323e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:23.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.297+0000 7f6c347f1700 1 --2- 172.21.15.84:0/1826533217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c2c0fad90 0x7f6c2c10d890 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:23.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.297+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 >> 172.21.15.84:0/1826533217 conn(0x7f6c2c0f6530 msgr2=0x7f6c2c0f7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:23.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.299+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 shutdown_connections 2024-02-15T18:18:23.299 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:23.299+0000 7f6c347f1700 1 -- 172.21.15.84:0/1826533217 wait complete. 2024-02-15T18:18:23.452 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:23.243264+0000 mon.smithi084 (mon.0) 84 : audit [INF] from='client.? 172.21.15.84:0/1826533217' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-15T18:18:24.078 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2024-02-15T18:18:24.348 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:23.296534+0000 mon.smithi084 (mon.0) 85 : audit [INF] from='client.? 172.21.15.84:0/1826533217' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-15T18:18:24.348 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:23.296588+0000 mon.smithi084 (mon.0) 86 : cluster [DBG] mgrmap e13: smithi084.hjmnez(active, since 9s) 2024-02-15T18:18:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.665+0000 7fe441956700 1 Processor -- start 2024-02-15T18:18:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.666+0000 7fe441956700 1 -- start start 2024-02-15T18:18:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.666+0000 7fe441956700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c0feab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.666+0000 7fe441956700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0fefa0 con 0x7fe43c0703d0 2024-02-15T18:18:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.666+0000 7fe43affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c0feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:24.667 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.666+0000 7fe43affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c0feab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48040/0 (socket says 172.21.15.84:48040) 2024-02-15T18:18:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.666+0000 7fe43affd700 1 -- 172.21.15.84:0/1765430416 learned_addr learned my addr 172.21.15.84:0/1765430416 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.666+0000 7fe43affd700 1 -- 172.21.15.84:0/1765430416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c0ff0e0 con 0x7fe43c0703d0 2024-02-15T18:18:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.666+0000 7fe43affd700 1 --2- 172.21.15.84:0/1765430416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c0feab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe42c00b5f0 tx=0x7fe42c006ee0).ready entity=mon.0 client_cookie=1499505de871abf4 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.666+0000 7fe439ffb700 1 -- 172.21.15.84:0/1765430416 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe42c00d600 con 0x7fe43c0703d0 2024-02-15T18:18:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.667+0000 7fe439ffb700 1 -- 172.21.15.84:0/1765430416 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fe42c00dbf0 con 0x7fe43c0703d0 2024-02-15T18:18:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.667+0000 7fe439ffb700 1 -- 172.21.15.84:0/1765430416 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe42c011cb0 con 0x7fe43c0703d0 2024-02-15T18:18:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.667+0000 7fe441956700 1 -- 172.21.15.84:0/1765430416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 msgr2=0x7fe43c0feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:24.668 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.667+0000 7fe441956700 1 --2- 172.21.15.84:0/1765430416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c0feab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe42c00b5f0 tx=0x7fe42c006ee0).stop 2024-02-15T18:18:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.667+0000 7fe441956700 1 -- 172.21.15.84:0/1765430416 shutdown_connections 2024-02-15T18:18:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.667+0000 7fe441956700 1 --2- 172.21.15.84:0/1765430416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c0feab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.667+0000 7fe441956700 1 -- 172.21.15.84:0/1765430416 >> 172.21.15.84:0/1765430416 conn(0x7fe43c0f6530 msgr2=0x7fe43c0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.667+0000 7fe441956700 1 -- 172.21.15.84:0/1765430416 shutdown_connections 2024-02-15T18:18:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.667+0000 7fe441956700 1 -- 172.21.15.84:0/1765430416 wait complete. 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.668+0000 7fe441956700 1 Processor -- start 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.668+0000 7fe441956700 1 -- start start 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe441956700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c10abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe441956700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c10b0b0 con 0x7fe43c0703d0 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe43affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c10abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe43affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c10abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48054/0 (socket says 172.21.15.84:48054) 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe43affd700 1 -- 172.21.15.84:0/1634148326 learned_addr learned my addr 172.21.15.84:0/1634148326 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe43affd700 1 -- 172.21.15.84:0/1634148326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c00b200 con 0x7fe43c0703d0 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe43affd700 1 --2- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c10abc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe42c006c70 tx=0x7fe42c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe4237fe700 1 -- 172.21.15.84:0/1634148326 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe42c011400 con 0x7fe43c0703d0 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c10b2b0 con 0x7fe43c0703d0 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe4237fe700 1 -- 172.21.15.84:0/1634148326 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fe42c01b8a0 con 0x7fe43c0703d0 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe4237fe700 1 -- 172.21.15.84:0/1634148326 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe42c01a7c0 con 0x7fe43c0703d0 2024-02-15T18:18:24.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.669+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c10b740 con 0x7fe43c0703d0 2024-02-15T18:18:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.670+0000 7fe4237fe700 1 -- 172.21.15.84:0/1634148326 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7fe42c00f070 con 0x7fe43c0703d0 2024-02-15T18:18:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.670+0000 7fe4237fe700 1 --2- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fe42802ff70 0x7fe428032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.671+0000 7fe4237fe700 1 -- 172.21.15.84:0/1634148326 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fe42c0413f0 con 0x7fe43c0703d0 2024-02-15T18:18:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.671+0000 7fe43a7fc700 1 -- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fe42802ff70 msgr2=0x7fe428032430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/1354831571 2024-02-15T18:18:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.671+0000 7fe43a7fc700 1 --2- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fe42802ff70 0x7fe428032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:18:24.675 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.671+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c045ad0 con 0x7fe43c0703d0 2024-02-15T18:18:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.679+0000 7fe4237fe700 1 -- 172.21.15.84:0/1634148326 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe42c025460 con 0x7fe43c0703d0 2024-02-15T18:18:24.872 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.872+0000 7fe43a7fc700 1 -- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fe42802ff70 msgr2=0x7fe428032430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/1354831571 2024-02-15T18:18:24.872 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.872+0000 7fe43a7fc700 1 --2- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fe42802ff70 0x7fe428032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-15T18:18:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.893+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fe43c104b50 con 0x7fe43c0703d0 2024-02-15T18:18:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.893+0000 7fe4237fe700 1 -- 172.21.15.84:0/1634148326 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v13) v1 ==== 56+0+104 (secure 0 0 0) 0x7fe42c022310 con 0x7fe43c0703d0 2024-02-15T18:18:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: { 2024-02-15T18:18:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "epoch": 13, 2024-02-15T18:18:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "available": true, 2024-02-15T18:18:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "active_name": "smithi084.hjmnez", 2024-02-15T18:18:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-15T18:18:24.895 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: } 2024-02-15T18:18:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fe42802ff70 msgr2=0x7fe428032430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:18:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 --2- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fe42802ff70 0x7fe428032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:18:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 msgr2=0x7fe43c10abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 --2- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c10abc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe42c006c70 tx=0x7fe42c006ee0).stop 2024-02-15T18:18:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 shutdown_connections 2024-02-15T18:18:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 --2- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fe42802ff70 0x7fe428032430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:18:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 --2- 172.21.15.84:0/1634148326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe43c0703d0 0x7fe43c10abc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:24.897 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 >> 172.21.15.84:0/1634148326 conn(0x7fe43c0f6530 msgr2=0x7fe43c0f7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:24.897 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 shutdown_connections 2024-02-15T18:18:24.897 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:24.895+0000 7fe441956700 1 -- 172.21.15.84:0/1634148326 wait complete. 2024-02-15T18:18:25.584 INFO:teuthology.orchestra.run.smithi084.stderr:Waiting for the mgr to restart... 2024-02-15T18:18:25.584 INFO:teuthology.orchestra.run.smithi084.stderr:Waiting for mgr epoch 13... 2024-02-15T18:18:25.585 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2024-02-15T18:18:25.587 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:24.894594+0000 mon.smithi084 (mon.0) 87 : audit [DBG] from='client.? 172.21.15.84:0/1634148326' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.183+0000 7fb6194b7700 1 Processor -- start 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.183+0000 7fb6194b7700 1 -- start start 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.183+0000 7fb6194b7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb6140fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.183+0000 7fb6194b7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140fb6a0 con 0x7fb6140fad90 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.183+0000 7fb612ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb6140fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.183+0000 7fb612ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb6140fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48066/0 (socket says 172.21.15.84:48066) 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.183+0000 7fb612ffd700 1 -- 172.21.15.84:0/580568718 learned_addr learned my addr 172.21.15.84:0/580568718 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.183+0000 7fb612ffd700 1 -- 172.21.15.84:0/580568718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140fb7e0 con 0x7fb6140fad90 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb612ffd700 1 --2- 172.21.15.84:0/580568718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb6140fb1b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb60400b5f0 tx=0x7fb604006ee0).ready entity=mon.0 client_cookie=714baf5b7a9e3f68 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb611ffb700 1 -- 172.21.15.84:0/580568718 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb60400d600 con 0x7fb6140fad90 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb611ffb700 1 -- 172.21.15.84:0/580568718 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fb60400dbf0 con 0x7fb6140fad90 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb611ffb700 1 -- 172.21.15.84:0/580568718 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb604011cb0 con 0x7fb6140fad90 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb6194b7700 1 -- 172.21.15.84:0/580568718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 msgr2=0x7fb6140fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:26.186 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb6194b7700 1 --2- 172.21.15.84:0/580568718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb6140fb1b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb60400b5f0 tx=0x7fb604006ee0).stop 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb6194b7700 1 -- 172.21.15.84:0/580568718 shutdown_connections 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb6194b7700 1 --2- 172.21.15.84:0/580568718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb6140fb1b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb6194b7700 1 -- 172.21.15.84:0/580568718 >> 172.21.15.84:0/580568718 conn(0x7fb6140f6530 msgr2=0x7fb6140f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb6194b7700 1 -- 172.21.15.84:0/580568718 shutdown_connections 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.184+0000 7fb6194b7700 1 -- 172.21.15.84:0/580568718 wait complete. 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.185+0000 7fb6194b7700 1 Processor -- start 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.185+0000 7fb6194b7700 1 -- start start 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.185+0000 7fb6194b7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb61410ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.185+0000 7fb6194b7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61410b040 con 0x7fb6140fad90 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.185+0000 7fb612ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb61410ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.185+0000 7fb612ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb61410ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48078/0 (socket says 172.21.15.84:48078) 2024-02-15T18:18:26.187 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.185+0000 7fb612ffd700 1 -- 172.21.15.84:0/2048552128 learned_addr learned my addr 172.21.15.84:0/2048552128 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.186+0000 7fb612ffd700 1 -- 172.21.15.84:0/2048552128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60400b200 con 0x7fb6140fad90 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.186+0000 7fb612ffd700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb61410ab50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb604002f40 tx=0x7fb604006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.186+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb60401b410 con 0x7fb6140fad90 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.186+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fb60401ba00 con 0x7fb6140fad90 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.186+0000 7fb6194b7700 1 -- 172.21.15.84:0/2048552128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61410b240 con 0x7fb6140fad90 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.186+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb60401a900 con 0x7fb6140fad90 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.186+0000 7fb6194b7700 1 -- 172.21.15.84:0/2048552128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61410b6d0 con 0x7fb6140fad90 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.187+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7fb60400f070 con 0x7fb6140fad90 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.187+0000 7fb5fb7fe700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 0x7fb600032480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.187+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 --> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb600032b40 con 0x7fb60002ffc0 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.187+0000 7fb6127fc700 1 -- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 msgr2=0x7fb600032480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/1354831571 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.187+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fb604041590 con 0x7fb6140fad90 2024-02-15T18:18:26.189 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.187+0000 7fb6127fc700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 0x7fb600032480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:18:26.388 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.388+0000 7fb6127fc700 1 -- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 msgr2=0x7fb600032480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/1354831571 2024-02-15T18:18:26.388 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.388+0000 7fb6127fc700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 0x7fb600032480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-15T18:18:26.789 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.789+0000 7fb6127fc700 1 -- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 msgr2=0x7fb600032480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/1354831571 2024-02-15T18:18:26.789 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:26.789+0000 7fb6127fc700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 0x7fb600032480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-02-15T18:18:27.590 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:27.590+0000 7fb6127fc700 1 -- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 msgr2=0x7fb600032480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6800/1354831571 2024-02-15T18:18:27.590 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:27.590+0000 7fb6127fc700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 0x7fb600032480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-02-15T18:18:28.344 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:28.340+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mgrmap(e 14) v1 ==== 35997+0+0 (secure 0 0 0) 0x7fb60401bb70 con 0x7fb6140fad90 2024-02-15T18:18:28.344 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:28.341+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 msgr2=0x7fb600032480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:18:28.344 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:28.341+0000 7fb5fb7fe700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 0x7fb600032480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:18:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.342+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 15) v1 ==== 36067+0+0 (secure 0 0 0) 0x7fb6040411e0 con 0x7fb6140fad90 2024-02-15T18:18:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.342+0000 7fb5fb7fe700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb600033c50 0x7fb600036040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.342+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb600032b40 con 0x7fb600033c50 2024-02-15T18:18:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.342+0000 7fb6127fc700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb600033c50 0x7fb600036040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.343+0000 7fb6127fc700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb600033c50 0x7fb600036040 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fb6080036d0 tx=0x7fb608006d20).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.344+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7fb600032b40 con 0x7fb600033c50 2024-02-15T18:18:29.349 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 -- 172.21.15.84:0/2048552128 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fb614059100 con 0x7fb600033c50 2024-02-15T18:18:29.350 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb5fb7fe700 1 -- 172.21.15.84:0/2048552128 <== mgr.14162 v2:172.21.15.84:6800/610282832 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fb614059100 con 0x7fb600033c50 2024-02-15T18:18:29.351 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: { 2024-02-15T18:18:29.351 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "mgrmap_epoch": 15, 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: "initialized": true 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: } 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 -- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb600033c50 msgr2=0x7fb600036040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb600033c50 0x7fb600036040 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fb6080036d0 tx=0x7fb608006d20).stop 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 -- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 msgr2=0x7fb61410ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb61410ab50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb604002f40 tx=0x7fb604006ee0).stop 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 -- 172.21.15.84:0/2048552128 shutdown_connections 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb600033c50 0x7fb600036040 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6140fad90 0x7fb61410ab50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 --2- 172.21.15.84:0/2048552128 >> [v2:172.21.15.84:6800/1354831571,v1:172.21.15.84:6801/1354831571] conn(0x7fb60002ffc0 0x7fb600032480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 -- 172.21.15.84:0/2048552128 >> 172.21.15.84:0/2048552128 conn(0x7fb6140f6530 msgr2=0x7fb6140f7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 -- 172.21.15.84:0/2048552128 shutdown_connections 2024-02-15T18:18:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:29.350+0000 7fb6194b7700 1 -- 172.21.15.84:0/2048552128 wait complete. 2024-02-15T18:18:29.630 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:28.289500+0000 mon.smithi084 (mon.0) 88 : cluster [INF] Active manager daemon smithi084.hjmnez restarted 2024-02-15T18:18:29.630 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:28.289943+0000 mon.smithi084 (mon.0) 89 : cluster [INF] Activating manager daemon smithi084.hjmnez 2024-02-15T18:18:29.630 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:28.291549+0000 mon.smithi084 (mon.0) 90 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-15T18:18:29.630 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:28.342520+0000 mon.smithi084 (mon.0) 91 : cluster [DBG] mgrmap e14: smithi084.hjmnez(active, starting, since 0.0526968s) 2024-02-15T18:18:29.630 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:28.343293+0000 mon.smithi084 (mon.0) 92 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:18:29.630 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:28.343822+0000 mon.smithi084 (mon.0) 93 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi084.hjmnez", "id": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:18:29.630 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:28.344423+0000 mon.smithi084 (mon.0) 94 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:18:29.631 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:28.344560+0000 mon.smithi084 (mon.0) 95 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:18:29.631 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:28.344681+0000 mon.smithi084 (mon.0) 96 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:18:29.631 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:28.358068+0000 mon.smithi084 (mon.0) 97 : cluster [INF] Manager daemon smithi084.hjmnez is now available 2024-02-15T18:18:29.631 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:28.454396+0000 mon.smithi084 (mon.0) 98 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:18:29.631 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:28.456859+0000 mon.smithi084 (mon.0) 99 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:18:29.631 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:28.471309+0000 mon.smithi084 (mon.0) 100 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:18:29.631 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:28.473859+0000 mon.smithi084 (mon.0) 101 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:18:29.899 INFO:teuthology.orchestra.run.smithi084.stderr:mgr epoch 13 is available 2024-02-15T18:18:29.900 INFO:teuthology.orchestra.run.smithi084.stderr:Generating a dashboard self-signed certificate... 2024-02-15T18:18:29.900 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 dashboard create-self-signed-cert 2024-02-15T18:18:30.459 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.456+0000 7ff385173700 1 Processor -- start 2024-02-15T18:18:30.459 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.456+0000 7ff385173700 1 -- start start 2024-02-15T18:18:30.459 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff385173700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:30.459 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff385173700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800fef40 con 0x7ff380070430 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff37ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff37ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48126/0 (socket says 172.21.15.84:48126) 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff37ed9d700 1 -- 172.21.15.84:0/1800690400 learned_addr learned my addr 172.21.15.84:0/1800690400 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff37ed9d700 1 -- 172.21.15.84:0/1800690400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800ff080 con 0x7ff380070430 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff37ed9d700 1 --2- 172.21.15.84:0/1800690400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fea50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff37400b5f0 tx=0x7ff374006ee0).ready entity=mon.0 client_cookie=63d310a15c86e02d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff37dd9b700 1 -- 172.21.15.84:0/1800690400 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff37400d600 con 0x7ff380070430 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff37dd9b700 1 -- 172.21.15.84:0/1800690400 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7ff37400dbf0 con 0x7ff380070430 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.457+0000 7ff37dd9b700 1 -- 172.21.15.84:0/1800690400 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff374011cb0 con 0x7ff380070430 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.458+0000 7ff385173700 1 -- 172.21.15.84:0/1800690400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 msgr2=0x7ff3800fea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.458+0000 7ff385173700 1 --2- 172.21.15.84:0/1800690400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fea50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff37400b5f0 tx=0x7ff374006ee0).stop 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.458+0000 7ff385173700 1 -- 172.21.15.84:0/1800690400 shutdown_connections 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.458+0000 7ff385173700 1 --2- 172.21.15.84:0/1800690400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fea50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.458+0000 7ff385173700 1 -- 172.21.15.84:0/1800690400 >> 172.21.15.84:0/1800690400 conn(0x7ff3800f6530 msgr2=0x7ff3800f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:30.460 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.458+0000 7ff385173700 1 -- 172.21.15.84:0/1800690400 shutdown_connections 2024-02-15T18:18:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.458+0000 7ff385173700 1 -- 172.21.15.84:0/1800690400 wait complete. 2024-02-15T18:18:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff385173700 1 Processor -- start 2024-02-15T18:18:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff385173700 1 -- start start 2024-02-15T18:18:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff385173700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff385173700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800fa950 con 0x7ff380070430 2024-02-15T18:18:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff37ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff37ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48128/0 (socket says 172.21.15.84:48128) 2024-02-15T18:18:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff37ed9d700 1 -- 172.21.15.84:0/1285671183 learned_addr learned my addr 172.21.15.84:0/1285671183 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:30.461 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff37ed9d700 1 -- 172.21.15.84:0/1285671183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37400b200 con 0x7ff380070430 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff37ed9d700 1 --2- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fc4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff374006800 tx=0x7ff374006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff3677fe700 1 -- 172.21.15.84:0/1285671183 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff37401b570 con 0x7ff380070430 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff3677fe700 1 -- 172.21.15.84:0/1285671183 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7ff37401bb60 con 0x7ff380070430 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff3677fe700 1 -- 172.21.15.84:0/1285671183 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff37401a9f0 con 0x7ff380070430 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3800faaf0 con 0x7ff380070430 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.459+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3800faf80 con 0x7ff380070430 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.460+0000 7ff3677fe700 1 -- 172.21.15.84:0/1285671183 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7ff37400f070 con 0x7ff380070430 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.460+0000 7ff3677fe700 1 --2- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff36c02ffc0 0x7ff36c032480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.460+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff380045ad0 con 0x7ff380070430 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.461+0000 7ff3677fe700 1 -- 172.21.15.84:0/1285671183 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7ff3740416b0 con 0x7ff380070430 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.461+0000 7ff37e59c700 1 --2- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff36c02ffc0 0x7ff36c032480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:30.462 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.461+0000 7ff37e59c700 1 --2- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff36c02ffc0 0x7ff36c032480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff3700096a0 tx=0x7ff370006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:30.465 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.465+0000 7ff3677fe700 1 -- 172.21.15.84:0/1285671183 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff374022310 con 0x7ff380070430 2024-02-15T18:18:30.618 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.617+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3800fb1c0 con 0x7ff36c02ffc0 2024-02-15T18:18:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.671+0000 7ff3677fe700 1 -- 172.21.15.84:0/1285671183 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7ff3800fb1c0 con 0x7ff36c02ffc0 2024-02-15T18:18:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: Self-signed certificate created 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff36c02ffc0 msgr2=0x7ff36c032480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 --2- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff36c02ffc0 0x7ff36c032480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff3700096a0 tx=0x7ff370006b40).stop 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 msgr2=0x7ff3800fc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 --2- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fc4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff374006800 tx=0x7ff374006ee0).stop 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 shutdown_connections 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 --2- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff36c02ffc0 0x7ff36c032480 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 --2- 172.21.15.84:0/1285671183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff380070430 0x7ff3800fc4d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 >> 172.21.15.84:0/1285671183 conn(0x7ff3800f6530 msgr2=0x7ff3800f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 shutdown_connections 2024-02-15T18:18:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:30.673+0000 7ff385173700 1 -- 172.21.15.84:0/1285671183 wait complete. 2024-02-15T18:18:30.695 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:29.344452+0000 mgr.smithi084.hjmnez (mgr.14162) 1 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-15T18:18:30.695 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:29.345134+0000 mon.smithi084 (mon.0) 102 : cluster [DBG] mgrmap e15: smithi084.hjmnez(active, since 1.05531s) 2024-02-15T18:18:30.695 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:29.350908+0000 mgr.smithi084.hjmnez (mgr.14162) 2 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-15T18:18:31.238 INFO:teuthology.orchestra.run.smithi084.stderr:Creating initial admin user... 2024-02-15T18:18:31.239 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpyh7ivlc9:/tmp/dashboard.pw:z docker.io/ceph/ceph:v16.2.4 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2024-02-15T18:18:31.760 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.730+0000 7f5b9f393700 1 Processor -- start 2024-02-15T18:18:31.760 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.730+0000 7f5b9f393700 1 -- start start 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.730+0000 7f5b9f393700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b980fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.730+0000 7f5b9f393700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980fb6a0 con 0x7f5b980fad90 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.730+0000 7f5b9d12f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b980fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.730+0000 7f5b9d12f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b980fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48130/0 (socket says 172.21.15.84:48130) 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.730+0000 7f5b9d12f700 1 -- 172.21.15.84:0/2840815338 learned_addr learned my addr 172.21.15.84:0/2840815338 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.730+0000 7f5b9d12f700 1 -- 172.21.15.84:0/2840815338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b980fb7e0 con 0x7f5b980fad90 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b9d12f700 1 --2- 172.21.15.84:0/2840815338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b980fb1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5b9400b5f0 tx=0x7f5b94006ee0).ready entity=mon.0 client_cookie=c26e311116f939d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b87fff700 1 -- 172.21.15.84:0/2840815338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b9400d600 con 0x7f5b980fad90 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b87fff700 1 -- 172.21.15.84:0/2840815338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f5b9400dbf0 con 0x7f5b980fad90 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b87fff700 1 -- 172.21.15.84:0/2840815338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b94011cb0 con 0x7f5b980fad90 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b9f393700 1 -- 172.21.15.84:0/2840815338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 msgr2=0x7f5b980fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:31.761 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b9f393700 1 --2- 172.21.15.84:0/2840815338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b980fb1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5b9400b5f0 tx=0x7f5b94006ee0).stop 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b9f393700 1 -- 172.21.15.84:0/2840815338 shutdown_connections 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b9f393700 1 --2- 172.21.15.84:0/2840815338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b980fb1b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b9f393700 1 -- 172.21.15.84:0/2840815338 >> 172.21.15.84:0/2840815338 conn(0x7f5b980f6530 msgr2=0x7f5b980f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b9f393700 1 -- 172.21.15.84:0/2840815338 shutdown_connections 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.731+0000 7f5b9f393700 1 -- 172.21.15.84:0/2840815338 wait complete. 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b9f393700 1 Processor -- start 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b9f393700 1 -- start start 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b9f393700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b98108950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b9f393700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98108e40 con 0x7f5b980fad90 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b9d12f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b98108950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b9d12f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b98108950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48142/0 (socket says 172.21.15.84:48142) 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b9d12f700 1 -- 172.21.15.84:0/1452551643 learned_addr learned my addr 172.21.15.84:0/1452551643 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:31.762 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b9d12f700 1 -- 172.21.15.84:0/1452551643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9400b200 con 0x7f5b980fad90 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b9d12f700 1 --2- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b98108950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5b94011ea0 tx=0x7f5b94006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.732+0000 7f5b85ffb700 1 -- 172.21.15.84:0/1452551643 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b9401b570 con 0x7f5b980fad90 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.733+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b98109040 con 0x7f5b980fad90 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.733+0000 7f5b85ffb700 1 -- 172.21.15.84:0/1452551643 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f5b9401bb60 con 0x7f5b980fad90 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.733+0000 7f5b85ffb700 1 -- 172.21.15.84:0/1452551643 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b9401a8d0 con 0x7f5b980fad90 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.733+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b981094d0 con 0x7f5b980fad90 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.733+0000 7f5b85ffb700 1 -- 172.21.15.84:0/1452551643 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f5b9400f070 con 0x7f5b980fad90 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.734+0000 7f5b85ffb700 1 --2- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b800321c0 0x7f5b80034680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.734+0000 7f5b85ffb700 1 -- 172.21.15.84:0/1452551643 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f5b94041630 con 0x7f5b980fad90 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.734+0000 7f5b9c92e700 1 --2- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b800321c0 0x7f5b80034680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.734+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b98045ad0 con 0x7f5b980fad90 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.734+0000 7f5b9c92e700 1 --2- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b800321c0 0x7f5b80034680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f5b880096a0 tx=0x7f5b88006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:31.763 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.738+0000 7f5b85ffb700 1 -- 172.21.15.84:0/1452551643 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5b94016020 con 0x7f5b980fad90 2024-02-15T18:18:31.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:30.345224+0000 mon.smithi084 (mon.0) 103 : cluster [DBG] mgrmap e16: smithi084.hjmnez(active, since 2s) 2024-02-15T18:18:31.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:30.619268+0000 mgr.smithi084.hjmnez (mgr.14162) 3 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:31.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:30.670137+0000 mon.smithi084 (mon.0) 104 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:31.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:30.671956+0000 mon.smithi084 (mon.0) 105 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:31.901+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f5b98058f20 con 0x7f5b800321c0 2024-02-15T18:18:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.117+0000 7f5b85ffb700 1 -- 172.21.15.84:0/1452551643 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f5b98058f20 con 0x7f5b800321c0 2024-02-15T18:18:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$kplQUkSp9YjfsIIIzOaEPe7CniVHaep372oxZaVugC6Q9PGIdsy7a", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708021112, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.119+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b800321c0 msgr2=0x7f5b80034680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.119+0000 7f5b9f393700 1 --2- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b800321c0 0x7f5b80034680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f5b880096a0 tx=0x7f5b88006b40).stop 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.119+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 msgr2=0x7f5b98108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.119+0000 7f5b9f393700 1 --2- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b98108950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5b94011ea0 tx=0x7f5b94006ee0).stop 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.119+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 shutdown_connections 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.119+0000 7f5b9f393700 1 --2- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b800321c0 0x7f5b80034680 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.119+0000 7f5b9f393700 1 --2- 172.21.15.84:0/1452551643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b980fad90 0x7f5b98108950 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.119+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 >> 172.21.15.84:0/1452551643 conn(0x7f5b980f6530 msgr2=0x7f5b980ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.119+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 shutdown_connections 2024-02-15T18:18:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:32.120+0000 7f5b9f393700 1 -- 172.21.15.84:0/1452551643 wait complete. 2024-02-15T18:18:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:Fetching dashboard port number... 2024-02-15T18:18:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi084 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzhadl5ft:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp1x8_3229:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config get mgr mgr/dashboard/ssl_server_port 2024-02-15T18:18:33.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.124+0000 7fcf51a83700 1 Processor -- start 2024-02-15T18:18:33.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.124+0000 7fcf51a83700 1 -- start start 2024-02-15T18:18:33.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.124+0000 7fcf51a83700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0feab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:33.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.124+0000 7fcf51a83700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0fefa0 con 0x7fcf4c0703d0 2024-02-15T18:18:33.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.125+0000 7fcf4b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:33.128 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.125+0000 7fcf4b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0feab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48144/0 (socket says 172.21.15.84:48144) 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.125+0000 7fcf4b7fe700 1 -- 172.21.15.84:0/1237184207 learned_addr learned my addr 172.21.15.84:0/1237184207 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.125+0000 7fcf4b7fe700 1 -- 172.21.15.84:0/1237184207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0ff0e0 con 0x7fcf4c0703d0 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.125+0000 7fcf4b7fe700 1 --2- 172.21.15.84:0/1237184207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0feab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcf4000b5f0 tx=0x7fcf40006ee0).ready entity=mon.0 client_cookie=45687ed4091c7313 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.125+0000 7fcf4a7fc700 1 -- 172.21.15.84:0/1237184207 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf4000d600 con 0x7fcf4c0703d0 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.125+0000 7fcf4a7fc700 1 -- 172.21.15.84:0/1237184207 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fcf4000dbf0 con 0x7fcf4c0703d0 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.125+0000 7fcf4a7fc700 1 -- 172.21.15.84:0/1237184207 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf40011cb0 con 0x7fcf4c0703d0 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.126+0000 7fcf51a83700 1 -- 172.21.15.84:0/1237184207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 msgr2=0x7fcf4c0feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.126+0000 7fcf51a83700 1 --2- 172.21.15.84:0/1237184207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0feab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcf4000b5f0 tx=0x7fcf40006ee0).stop 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.126+0000 7fcf51a83700 1 -- 172.21.15.84:0/1237184207 shutdown_connections 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.126+0000 7fcf51a83700 1 --2- 172.21.15.84:0/1237184207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0feab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.126+0000 7fcf51a83700 1 -- 172.21.15.84:0/1237184207 >> 172.21.15.84:0/1237184207 conn(0x7fcf4c0f6530 msgr2=0x7fcf4c0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.126+0000 7fcf51a83700 1 -- 172.21.15.84:0/1237184207 shutdown_connections 2024-02-15T18:18:33.129 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.126+0000 7fcf51a83700 1 -- 172.21.15.84:0/1237184207 wait complete. 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.126+0000 7fcf51a83700 1 Processor -- start 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.126+0000 7fcf51a83700 1 -- start start 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf51a83700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0fc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf51a83700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0fa9b0 con 0x7fcf4c0703d0 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf4b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf4b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0fc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48150/0 (socket says 172.21.15.84:48150) 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf4b7fe700 1 -- 172.21.15.84:0/71260252 learned_addr learned my addr 172.21.15.84:0/71260252 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf4b7fe700 1 -- 172.21.15.84:0/71260252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4000b200 con 0x7fcf4c0703d0 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf4b7fe700 1 --2- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0fc530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcf40006c70 tx=0x7fcf40006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf33fff700 1 -- 172.21.15.84:0/71260252 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf40011400 con 0x7fcf4c0703d0 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf33fff700 1 -- 172.21.15.84:0/71260252 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fcf4001b8a0 con 0x7fcf4c0703d0 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c0fab50 con 0x7fcf4c0703d0 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf33fff700 1 -- 172.21.15.84:0/71260252 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf4001a7c0 con 0x7fcf4c0703d0 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.127+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c0fafe0 con 0x7fcf4c0703d0 2024-02-15T18:18:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.128+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c045ad0 con 0x7fcf4c0703d0 2024-02-15T18:18:33.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.129+0000 7fcf33fff700 1 -- 172.21.15.84:0/71260252 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7fcf4000f070 con 0x7fcf4c0703d0 2024-02-15T18:18:33.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.129+0000 7fcf33fff700 1 --2- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fcf3802ffc0 0x7fcf38032480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:33.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.129+0000 7fcf33fff700 1 -- 172.21.15.84:0/71260252 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fcf4001be40 con 0x7fcf4c0703d0 2024-02-15T18:18:33.131 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.129+0000 7fcf4affd700 1 --2- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fcf3802ffc0 0x7fcf38032480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:33.132 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.129+0000 7fcf4affd700 1 --2- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fcf3802ffc0 0x7fcf38032480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fcf3c0096a0 tx=0x7fcf3c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:33.132 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.133+0000 7fcf33fff700 1 -- 172.21.15.84:0/71260252 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcf4002dd90 con 0x7fcf4c0703d0 2024-02-15T18:18:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.280+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fcf4c027a00 con 0x7fcf4c0703d0 2024-02-15T18:18:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.280+0000 7fcf33fff700 1 -- 172.21.15.84:0/71260252 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v9) v1 ==== 112+0+5 (secure 0 0 0) 0x7fcf40016030 con 0x7fcf4c0703d0 2024-02-15T18:18:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 8443 2024-02-15T18:18:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.281+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fcf3802ffc0 msgr2=0x7fcf38032480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.281+0000 7fcf51a83700 1 --2- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fcf3802ffc0 0x7fcf38032480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fcf3c0096a0 tx=0x7fcf3c006b40).stop 2024-02-15T18:18:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.281+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 msgr2=0x7fcf4c0fc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.281+0000 7fcf51a83700 1 --2- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0fc530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcf40006c70 tx=0x7fcf40006ee0).stop 2024-02-15T18:18:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.281+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 shutdown_connections 2024-02-15T18:18:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.281+0000 7fcf51a83700 1 --2- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fcf3802ffc0 0x7fcf38032480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.281+0000 7fcf51a83700 1 --2- 172.21.15.84:0/71260252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf4c0703d0 0x7fcf4c0fc530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.281+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 >> 172.21.15.84:0/71260252 conn(0x7fcf4c0f6530 msgr2=0x7fcf4c0f7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.282+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 shutdown_connections 2024-02-15T18:18:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:/usr/bin/ceph: 2024-02-15T18:18:33.282+0000 7fcf51a83700 1 -- 172.21.15.84:0/71260252 wait complete. 2024-02-15T18:18:33.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:31.903248+0000 mgr.smithi084.hjmnez (mgr.14162) 4 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:18:33.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:32.118147+0000 mon.smithi084 (mon.0) 106 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-enabled firewalld.service 2024-02-15T18:18:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: disabled 2024-02-15T18:18:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: systemctl is-active firewalld.service 2024-02-15T18:18:33.885 INFO:teuthology.orchestra.run.smithi084.stderr:systemctl: inactive 2024-02-15T18:18:33.886 INFO:teuthology.orchestra.run.smithi084.stderr:firewalld.service is not enabled 2024-02-15T18:18:33.886 INFO:teuthology.orchestra.run.smithi084.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-15T18:18:33.889 INFO:teuthology.orchestra.run.smithi084.stderr:Ceph Dashboard is now available at: 2024-02-15T18:18:33.889 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:18:33.889 INFO:teuthology.orchestra.run.smithi084.stderr: URL: https://smithi084.front.sepia.ceph.com:8443/ 2024-02-15T18:18:33.889 INFO:teuthology.orchestra.run.smithi084.stderr: User: admin 2024-02-15T18:18:33.889 INFO:teuthology.orchestra.run.smithi084.stderr: Password: 70tv082w0d 2024-02-15T18:18:33.889 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:18:33.889 INFO:teuthology.orchestra.run.smithi084.stderr:You can access the Ceph CLI with: 2024-02-15T18:18:33.889 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:18:33.889 INFO:teuthology.orchestra.run.smithi084.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr:Please consider enabling telemetry to help improve Ceph: 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr: ceph telemetry on 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr:For more information see: 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr: https://docs.ceph.com/docs/pacific/mgr/telemetry/ 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr:Bootstrap complete. 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr:Releasing lock 140429859191272 on /run/cephadm/631a4cdc-cc2e-11ee-95ba-87774f69a715.lock 2024-02-15T18:18:33.890 INFO:teuthology.orchestra.run.smithi084.stderr:Lock 140429859191272 released on /run/cephadm/631a4cdc-cc2e-11ee-95ba-87774f69a715.lock 2024-02-15T18:18:33.921 INFO:tasks.cephadm:Fetching config... 2024-02-15T18:18:33.922 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:18:33.922 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-15T18:18:33.939 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-15T18:18:33.940 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:18:33.940 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-15T18:18:33.997 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-15T18:18:33.997 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:18:33.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/keyring of=/dev/stdout 2024-02-15T18:18:34.066 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-15T18:18:34.066 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:18:34.066 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-15T18:18:34.124 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-15T18:18:34.124 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAJTuQbmETBq1BYsFrhhapoyddS3ue61W/sNnsyEV5WAULLB8s2wYItQkk/OfbXN1ZG7z5HjYcdcNcEs5q0tmgg2qHLBNU3XCQDCOFz92ETm88EKFRSe8uownQBmAb8Ymh6xulSZucGpTXYzTECeyEzYDkouEFEJ8VxqZy2UYGSzcq1UzUROx8smSBYgyNe6FYyBA1Hln0hCTFRSIGzAm9hSYF8AHjkoy3uvXkZsWwY2u5JT6VsObr87Pe361IhqqdjJ3EaNuj+c/EtdlxoShkCHS2+dXnXzEw7ao6f7N2I1DURsfzpQaW3xkWjXVDyVOiSnPfTf14oPYGQ0c9H/Sv4dp7p4mx0ijSfwbLhbcN1ntlkOzS4iK/fOgetCmSESA2ik/wsdotTIybv9JJnCSnV+Xapjqplx7HHIcmRjCJ7llngVkzYFBgCaJZoPMYOFqIJ6hVJpMNj1TkBnsU+gTHm941gyA947yPNHRtqDgvjZun6kJSK1PhxNXU9ah+d/s= ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-15T18:18:34.188 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:33.280987+0000 mon.smithi084 (mon.0) 107 : audit [DBG] from='client.? 172.21.15.84:0/71260252' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-15T18:18:34.200 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAJTuQbmETBq1BYsFrhhapoyddS3ue61W/sNnsyEV5WAULLB8s2wYItQkk/OfbXN1ZG7z5HjYcdcNcEs5q0tmgg2qHLBNU3XCQDCOFz92ETm88EKFRSe8uownQBmAb8Ymh6xulSZucGpTXYzTECeyEzYDkouEFEJ8VxqZy2UYGSzcq1UzUROx8smSBYgyNe6FYyBA1Hln0hCTFRSIGzAm9hSYF8AHjkoy3uvXkZsWwY2u5JT6VsObr87Pe361IhqqdjJ3EaNuj+c/EtdlxoShkCHS2+dXnXzEw7ao6f7N2I1DURsfzpQaW3xkWjXVDyVOiSnPfTf14oPYGQ0c9H/Sv4dp7p4mx0ijSfwbLhbcN1ntlkOzS4iK/fOgetCmSESA2ik/wsdotTIybv9JJnCSnV+Xapjqplx7HHIcmRjCJ7llngVkzYFBgCaJZoPMYOFqIJ6hVJpMNj1TkBnsU+gTHm941gyA947yPNHRtqDgvjZun6kJSK1PhxNXU9ah+d/s= ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:18:34.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAJTuQbmETBq1BYsFrhhapoyddS3ue61W/sNnsyEV5WAULLB8s2wYItQkk/OfbXN1ZG7z5HjYcdcNcEs5q0tmgg2qHLBNU3XCQDCOFz92ETm88EKFRSe8uownQBmAb8Ymh6xulSZucGpTXYzTECeyEzYDkouEFEJ8VxqZy2UYGSzcq1UzUROx8smSBYgyNe6FYyBA1Hln0hCTFRSIGzAm9hSYF8AHjkoy3uvXkZsWwY2u5JT6VsObr87Pe361IhqqdjJ3EaNuj+c/EtdlxoShkCHS2+dXnXzEw7ao6f7N2I1DURsfzpQaW3xkWjXVDyVOiSnPfTf14oPYGQ0c9H/Sv4dp7p4mx0ijSfwbLhbcN1ntlkOzS4iK/fOgetCmSESA2ik/wsdotTIybv9JJnCSnV+Xapjqplx7HHIcmRjCJ7llngVkzYFBgCaJZoPMYOFqIJ6hVJpMNj1TkBnsU+gTHm941gyA947yPNHRtqDgvjZun6kJSK1PhxNXU9ah+d/s= ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-15T18:18:34.255 INFO:teuthology.orchestra.run.smithi133.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAJTuQbmETBq1BYsFrhhapoyddS3ue61W/sNnsyEV5WAULLB8s2wYItQkk/OfbXN1ZG7z5HjYcdcNcEs5q0tmgg2qHLBNU3XCQDCOFz92ETm88EKFRSe8uownQBmAb8Ymh6xulSZucGpTXYzTECeyEzYDkouEFEJ8VxqZy2UYGSzcq1UzUROx8smSBYgyNe6FYyBA1Hln0hCTFRSIGzAm9hSYF8AHjkoy3uvXkZsWwY2u5JT6VsObr87Pe361IhqqdjJ3EaNuj+c/EtdlxoShkCHS2+dXnXzEw7ao6f7N2I1DURsfzpQaW3xkWjXVDyVOiSnPfTf14oPYGQ0c9H/Sv4dp7p4mx0ijSfwbLhbcN1ntlkOzS4iK/fOgetCmSESA2ik/wsdotTIybv9JJnCSnV+Xapjqplx7HHIcmRjCJ7llngVkzYFBgCaJZoPMYOFqIJ6hVJpMNj1TkBnsU+gTHm941gyA947yPNHRtqDgvjZun6kJSK1PhxNXU9ah+d/s= ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:18:34.270 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-15T18:18:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.184+0000 7f93a4759700 1 -- 172.21.15.84:0/448376225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 msgr2=0x7f939c0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.184+0000 7f93a4759700 1 --2- 172.21.15.84:0/448376225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 0x7f939c0f5830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f9394009fb0 tx=0x7f9394009b30).stop 2024-02-15T18:18:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.184+0000 7f93a4759700 1 -- 172.21.15.84:0/448376225 shutdown_connections 2024-02-15T18:18:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.184+0000 7f93a4759700 1 --2- 172.21.15.84:0/448376225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 0x7f939c0f5830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.184+0000 7f93a4759700 1 -- 172.21.15.84:0/448376225 >> 172.21.15.84:0/448376225 conn(0x7f939c0f0b70 msgr2=0x7f939c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.184+0000 7f93a4759700 1 -- 172.21.15.84:0/448376225 shutdown_connections 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.184+0000 7f93a4759700 1 -- 172.21.15.84:0/448376225 wait complete. 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.184+0000 7f93a4759700 1 Processor -- start 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.184+0000 7f93a4759700 1 -- start start 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f93a4759700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 0x7f939c109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f93a4759700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c060240 con 0x7f939c0f5410 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f93a24f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 0x7f939c109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f93a24f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 0x7f939c109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59398/0 (socket says 172.21.15.84:59398) 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f93a24f5700 1 -- 172.21.15.84:0/906422322 learned_addr learned my addr 172.21.15.84:0/906422322 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f93a24f5700 1 -- 172.21.15.84:0/906422322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9394005040 con 0x7f939c0f5410 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f93a24f5700 1 --2- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 0x7f939c109490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9394008a20 tx=0x7f939400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f9392ffd700 1 -- 172.21.15.84:0/906422322 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9394009320 con 0x7f939c0f5410 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f9392ffd700 1 -- 172.21.15.84:0/906422322 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f9394013ed0 con 0x7f939c0f5410 2024-02-15T18:18:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f9392ffd700 1 -- 172.21.15.84:0/906422322 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9394014e70 con 0x7f939c0f5410 2024-02-15T18:18:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939c060440 con 0x7f939c0f5410 2024-02-15T18:18:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.185+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939c109b40 con 0x7f939c0f5410 2024-02-15T18:18:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.186+0000 7f9392ffd700 1 -- 172.21.15.84:0/906422322 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f9394014420 con 0x7f939c0f5410 2024-02-15T18:18:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.186+0000 7f9392ffd700 1 --2- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f938802ff10 0x7f93880323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:18:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.186+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939c045ad0 con 0x7f939c0f5410 2024-02-15T18:18:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.186+0000 7f9392ffd700 1 -- 172.21.15.84:0/906422322 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f9394041030 con 0x7f939c0f5410 2024-02-15T18:18:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.186+0000 7f93a1cf4700 1 --2- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f938802ff10 0x7f93880323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:18:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.186+0000 7f93a1cf4700 1 --2- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f938802ff10 0x7f93880323d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f938c0096a0 tx=0x7f938c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:18:36.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.190+0000 7f9392ffd700 1 -- 172.21.15.84:0/906422322 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9394014790 con 0x7f939c0f5410 2024-02-15T18:18:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.347+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f939c0faf90 con 0x7f939c0f5410 2024-02-15T18:18:36.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.351+0000 7f9392ffd700 1 -- 172.21.15.84:0/906422322 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v10)=0 v10) v1 ==== 125+0+0 (secure 0 0 0) 0x7f93940127a0 con 0x7f939c0f5410 2024-02-15T18:18:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f938802ff10 msgr2=0x7f93880323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 --2- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f938802ff10 0x7f93880323d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f938c0096a0 tx=0x7f938c006b40).stop 2024-02-15T18:18:36.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 msgr2=0x7f939c109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:18:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 --2- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 0x7f939c109490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9394008a20 tx=0x7f939400b040).stop 2024-02-15T18:18:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 shutdown_connections 2024-02-15T18:18:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 --2- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f938802ff10 0x7f93880323d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 --2- 172.21.15.84:0/906422322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f939c0f5410 0x7f939c109490 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:18:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 >> 172.21.15.84:0/906422322 conn(0x7f939c0f0b70 msgr2=0x7f939c0f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:18:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 shutdown_connections 2024-02-15T18:18:36.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:18:36.353+0000 7f93a4759700 1 -- 172.21.15.84:0/906422322 wait complete. 2024-02-15T18:18:36.377 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:35.120541+0000 mon.smithi084 (mon.0) 108 : cluster [DBG] mgrmap e17: smithi084.hjmnez(active, since 6s) 2024-02-15T18:18:37.625 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:36.352210+0000 mon.smithi084 (mon.0) 109 : audit [INF] from='client.? 172.21.15.84:0/906422322' entity='client.admin' 2024-02-15T18:18:38.029 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi133 2024-02-15T18:18:38.030 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:18:38.030 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.conf 2024-02-15T18:18:38.051 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:18:38.051 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T18:18:38.112 INFO:tasks.cephadm:Adding host smithi133 to orchestrator... 2024-02-15T18:18:38.112 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph orch host add smithi133 2024-02-15T18:18:39.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:37.645865+0000 mon.smithi084 (mon.0) 110 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:39.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:38.090869+0000 mon.smithi084 (mon.0) 111 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:40.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:39.040521+0000 mon.smithi084 (mon.0) 112 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:43.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:42.231846+0000 mon.smithi084 (mon.0) 113 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:43.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:42.497227+0000 mon.smithi084 (mon.0) 114 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:43.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:42.499267+0000 mon.smithi084 (mon.0) 115 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:44.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:42.505255+0000 mgr.smithi084.hjmnez (mgr.14162) 5 : cephadm [INF] Deploying daemon alertmanager.smithi084 on smithi084 2024-02-15T18:18:49.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:48.345766+0000 mgr.smithi084.hjmnez (mgr.14162) 6 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:18:51.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:50.346005+0000 mgr.smithi084.hjmnez (mgr.14162) 7 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:18:53.935 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:52.346347+0000 mgr.smithi084.hjmnez (mgr.14162) 8 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:18:55.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:54.346626+0000 mgr.smithi084.hjmnez (mgr.14162) 9 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:18:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:56.346927+0000 mgr.smithi084.hjmnez (mgr.14162) 10 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:18:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:56.512204+0000 mon.smithi084 (mon.0) 116 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:18:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:56.513217+0000 mon.smithi084 (mon.0) 117 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:18:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:56.517444+0000 mon.smithi084 (mon.0) 118 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-15T18:18:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:56.518017+0000 mon.smithi084 (mon.0) 119 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:18:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:56.518512+0000 mgr.smithi084.hjmnez (mgr.14162) 11 : cephadm [INF] Deploying daemon crash.smithi084 on smithi084 2024-02-15T18:19:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:18:58.347129+0000 mgr.smithi084.hjmnez (mgr.14162) 12 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:58.918645+0000 mon.smithi084 (mon.0) 120 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:59.137642+0000 mon.smithi084 (mon.0) 121 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:59.139510+0000 mon.smithi084 (mon.0) 122 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:59.139883+0000 mon.smithi084 (mon.0) 123 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:19:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:59.140284+0000 mgr.smithi084.hjmnez (mgr.14162) 13 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:19:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:18:59.143307+0000 mon.smithi084 (mon.0) 124 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:18:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:18:59.146797+0000 mgr.smithi084.hjmnez (mgr.14162) 14 : cephadm [INF] Deploying daemon grafana.smithi084 on smithi084 2024-02-15T18:19:01.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.062+0000 7f4e229b7700 1 -- 172.21.15.133:0/3052521936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 msgr2=0x7f4e1c0f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.062+0000 7f4e229b7700 1 --2- 172.21.15.133:0/3052521936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 0x7f4e1c0f55c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f4e0c009fb0 tx=0x7f4e0c009b30).stop 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.062+0000 7f4e229b7700 1 -- 172.21.15.133:0/3052521936 shutdown_connections 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.062+0000 7f4e229b7700 1 --2- 172.21.15.133:0/3052521936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 0x7f4e1c0f55c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.062+0000 7f4e229b7700 1 -- 172.21.15.133:0/3052521936 >> 172.21.15.133:0/3052521936 conn(0x7f4e1c0f09a0 msgr2=0x7f4e1c0f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.062+0000 7f4e229b7700 1 -- 172.21.15.133:0/3052521936 shutdown_connections 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.062+0000 7f4e229b7700 1 -- 172.21.15.133:0/3052521936 wait complete. 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.063+0000 7f4e229b7700 1 Processor -- start 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.063+0000 7f4e229b7700 1 -- start start 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.063+0000 7f4e229b7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 0x7f4e1c1054d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.063+0000 7f4e229b7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c1059c0 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.063+0000 7f4e219b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 0x7f4e1c1054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.063+0000 7f4e219b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 0x7f4e1c1054d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:48598/0 (socket says 172.21.15.133:48598) 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.063+0000 7f4e219b5700 1 -- 172.21.15.133:0/544163252 learned_addr learned my addr 172.21.15.133:0/544163252 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.063+0000 7f4e219b5700 1 -- 172.21.15.133:0/544163252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c005040 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.063+0000 7f4e219b5700 1 --2- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 0x7f4e1c1054d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f4e0c0089f0 tx=0x7f4e0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.064+0000 7f4e127fc700 1 -- 172.21.15.133:0/544163252 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e0c009320 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.064+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c105bc0 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.064+0000 7f4e127fc700 1 -- 172.21.15.133:0/544163252 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e0c013380 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.064+0000 7f4e127fc700 1 -- 172.21.15.133:0/544163252 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e0c014e20 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.064+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c106050 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.064+0000 7f4e127fc700 1 -- 172.21.15.133:0/544163252 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f4e0c0095f0 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.064+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c045ad0 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.065+0000 7f4e127fc700 1 --2- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4e0802ff10 0x7f4e080323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:01.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.065+0000 7f4e127fc700 1 -- 172.21.15.133:0/544163252 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f4e0c040f10 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.065+0000 7f4e211b4700 1 --2- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4e0802ff10 0x7f4e080323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:01.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.065+0000 7f4e211b4700 1 --2- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4e0802ff10 0x7f4e080323d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4e180096a0 tx=0x7f4e18006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:01.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.070+0000 7f4e127fc700 1 -- 172.21.15.133:0/544163252 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4e0c014420 con 0x7f4e1c0f51a0 2024-02-15T18:19:01.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.240+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi133", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e1c0f1ac0 con 0x7f4e0802ff10 2024-02-15T18:19:01.832 INFO:teuthology.orchestra.run.smithi133.stdout:Added host 'smithi133' 2024-02-15T18:19:01.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.831+0000 7f4e127fc700 1 -- 172.21.15.133:0/544163252 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f4e1c0f1ac0 con 0x7f4e0802ff10 2024-02-15T18:19:01.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4e0802ff10 msgr2=0x7f4e080323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:01.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 --2- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4e0802ff10 0x7f4e080323d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4e180096a0 tx=0x7f4e18006b40).stop 2024-02-15T18:19:01.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 msgr2=0x7f4e1c1054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:01.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 --2- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 0x7f4e1c1054d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f4e0c0089f0 tx=0x7f4e0c00b040).stop 2024-02-15T18:19:01.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 shutdown_connections 2024-02-15T18:19:01.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 --2- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4e0802ff10 0x7f4e080323d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:01.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 --2- 172.21.15.133:0/544163252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1c0f51a0 0x7f4e1c1054d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:01.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 >> 172.21.15.133:0/544163252 conn(0x7f4e1c0f09a0 msgr2=0x7f4e1c0f13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:01.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 shutdown_connections 2024-02-15T18:19:01.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:01.833+0000 7f4e229b7700 1 -- 172.21.15.133:0/544163252 wait complete. 2024-02-15T18:19:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:00.347496+0000 mgr.smithi084.hjmnez (mgr.14162) 15 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:02.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:01.242219+0000 mgr.smithi084.hjmnez (mgr.14162) 16 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi133", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:19:02.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:01.831225+0000 mon.smithi084 (mon.0) 125 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:02.549 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph orch host ls --format=json 2024-02-15T18:19:03.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:19:01.831618+0000 mgr.smithi084.hjmnez (mgr.14162) 17 : cephadm [INF] Added host smithi133 2024-02-15T18:19:04.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:02.347825+0000 mgr.smithi084.hjmnez (mgr.14162) 18 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.521+0000 7f80694ef700 1 -- 172.21.15.133:0/1814088373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 msgr2=0x7f80640f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.521+0000 7f80694ef700 1 --2- 172.21.15.133:0/1814088373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 0x7f80640f6930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f8058009fb0 tx=0x7f8058009b30).stop 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.521+0000 7f80694ef700 1 -- 172.21.15.133:0/1814088373 shutdown_connections 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.521+0000 7f80694ef700 1 --2- 172.21.15.133:0/1814088373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 0x7f80640f6930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.521+0000 7f80694ef700 1 -- 172.21.15.133:0/1814088373 >> 172.21.15.133:0/1814088373 conn(0x7f80640f1c70 msgr2=0x7f80640f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.521+0000 7f80694ef700 1 -- 172.21.15.133:0/1814088373 shutdown_connections 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.521+0000 7f80694ef700 1 -- 172.21.15.133:0/1814088373 wait complete. 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.522+0000 7f80694ef700 1 Processor -- start 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.522+0000 7f80694ef700 1 -- start start 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.522+0000 7f80694ef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 0x7f80641067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.522+0000 7f80694ef700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064106cd0 con 0x7f80640f6510 2024-02-15T18:19:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.522+0000 7f8062ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 0x7f80641067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.522+0000 7f8062ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 0x7f80641067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:42402/0 (socket says 172.21.15.133:42402) 2024-02-15T18:19:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.522+0000 7f8062ffd700 1 -- 172.21.15.133:0/2227577678 learned_addr learned my addr 172.21.15.133:0/2227577678 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.523+0000 7f8062ffd700 1 -- 172.21.15.133:0/2227577678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8058005040 con 0x7f80640f6510 2024-02-15T18:19:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.523+0000 7f8062ffd700 1 --2- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 0x7f80641067e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f8058005010 tx=0x7f805800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.523+0000 7f804b7fe700 1 -- 172.21.15.133:0/2227577678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8058009320 con 0x7f80640f6510 2024-02-15T18:19:04.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.523+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8064106ed0 con 0x7f80640f6510 2024-02-15T18:19:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.523+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8064107360 con 0x7f80640f6510 2024-02-15T18:19:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.523+0000 7f804b7fe700 1 -- 172.21.15.133:0/2227577678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8058013380 con 0x7f80640f6510 2024-02-15T18:19:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.523+0000 7f804b7fe700 1 -- 172.21.15.133:0/2227577678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8058014df0 con 0x7f80640f6510 2024-02-15T18:19:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.524+0000 7f804b7fe700 1 -- 172.21.15.133:0/2227577678 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f8058014420 con 0x7f80640f6510 2024-02-15T18:19:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.524+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8064045ad0 con 0x7f80640f6510 2024-02-15T18:19:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.524+0000 7f804b7fe700 1 --2- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f804c02ff60 0x7f804c032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.524+0000 7f804b7fe700 1 -- 172.21.15.133:0/2227577678 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f80580411a0 con 0x7f80640f6510 2024-02-15T18:19:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.525+0000 7f80627fc700 1 --2- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f804c02ff60 0x7f804c032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:04.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.525+0000 7f80627fc700 1 --2- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f804c02ff60 0x7f804c032420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f80540096a0 tx=0x7f8054006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:04.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.529+0000 7f804b7fe700 1 -- 172.21.15.133:0/2227577678 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f805800fb30 con 0x7f80640f6510 2024-02-15T18:19:04.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.698+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80640f2dd0 con 0x7f804c02ff60 2024-02-15T18:19:04.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.700+0000 7f804b7fe700 1 -- 172.21.15.133:0/2227577678 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+156 (secure 0 0 0) 0x7f80640f2dd0 con 0x7f804c02ff60 2024-02-15T18:19:04.700 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:04.700 INFO:teuthology.orchestra.run.smithi133.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "smithi133", "hostname": "smithi133", "labels": [], "status": ""}] 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f804c02ff60 msgr2=0x7f804c032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 --2- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f804c02ff60 0x7f804c032420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f80540096a0 tx=0x7f8054006b40).stop 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 msgr2=0x7f80641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 --2- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 0x7f80641067e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f8058005010 tx=0x7f805800b040).stop 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 shutdown_connections 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 --2- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f804c02ff60 0x7f804c032420 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 --2- 172.21.15.133:0/2227577678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80640f6510 0x7f80641067e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 >> 172.21.15.133:0/2227577678 conn(0x7f80640f1c70 msgr2=0x7f80640f26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 shutdown_connections 2024-02-15T18:19:04.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:04.701+0000 7f80694ef700 1 -- 172.21.15.133:0/2227577678 wait complete. 2024-02-15T18:19:05.361 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-15T18:19:05.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd crush tunables default 2024-02-15T18:19:06.025 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:04.348122+0000 mgr.smithi084.hjmnez (mgr.14162) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:06.025 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:04.700304+0000 mgr.smithi084.hjmnez (mgr.14162) 20 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:19:07.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.275+0000 7f9157594700 1 -- 172.21.15.84:0/2197359122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 msgr2=0x7f91500f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:07.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.275+0000 7f9157594700 1 --2- 172.21.15.84:0/2197359122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 0x7f91500f8f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f914c009fb0 tx=0x7f914c009b30).stop 2024-02-15T18:19:07.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.275+0000 7f9157594700 1 -- 172.21.15.84:0/2197359122 shutdown_connections 2024-02-15T18:19:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.275+0000 7f9157594700 1 --2- 172.21.15.84:0/2197359122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 0x7f91500f8f20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.275+0000 7f9157594700 1 -- 172.21.15.84:0/2197359122 >> 172.21.15.84:0/2197359122 conn(0x7f91500f09a0 msgr2=0x7f91500f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.275+0000 7f9157594700 1 -- 172.21.15.84:0/2197359122 shutdown_connections 2024-02-15T18:19:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.275+0000 7f9157594700 1 -- 172.21.15.84:0/2197359122 wait complete. 2024-02-15T18:19:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.275+0000 7f9157594700 1 Processor -- start 2024-02-15T18:19:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9157594700 1 -- start start 2024-02-15T18:19:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9157594700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 0x7f9150104390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9157594700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9150104880 con 0x7f91500601e0 2024-02-15T18:19:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9156592700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 0x7f9150104390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9156592700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 0x7f9150104390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56890/0 (socket says 172.21.15.84:56890) 2024-02-15T18:19:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9156592700 1 -- 172.21.15.84:0/97381476 learned_addr learned my addr 172.21.15.84:0/97381476 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:19:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9156592700 1 -- 172.21.15.84:0/97381476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c005040 con 0x7f91500601e0 2024-02-15T18:19:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9156592700 1 --2- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 0x7f9150104390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f914c005010 tx=0x7f914c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9146ffd700 1 -- 172.21.15.84:0/97381476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f914c009320 con 0x7f91500601e0 2024-02-15T18:19:07.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9146ffd700 1 -- 172.21.15.84:0/97381476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f914c013380 con 0x7f91500601e0 2024-02-15T18:19:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9150104a20 con 0x7f91500601e0 2024-02-15T18:19:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.276+0000 7f9146ffd700 1 -- 172.21.15.84:0/97381476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f914c014e50 con 0x7f91500601e0 2024-02-15T18:19:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.277+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9150104f10 con 0x7f91500601e0 2024-02-15T18:19:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.277+0000 7f9146ffd700 1 -- 172.21.15.84:0/97381476 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f914c0263a0 con 0x7f91500601e0 2024-02-15T18:19:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.278+0000 7f9146ffd700 1 --2- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f913c073f20 0x7f913c0763e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.278+0000 7f9146ffd700 1 -- 172.21.15.84:0/97381476 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f914c041160 con 0x7f91500601e0 2024-02-15T18:19:07.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.278+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9138004fa0 con 0x7f91500601e0 2024-02-15T18:19:07.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.278+0000 7f9155d91700 1 --2- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f913c073f20 0x7f913c0763e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:07.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.278+0000 7f9155d91700 1 --2- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f913c073f20 0x7f913c0763e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f91400096a0 tx=0x7f9140006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:07.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.282+0000 7f9146ffd700 1 -- 172.21.15.84:0/97381476 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f914c01d380 con 0x7f91500601e0 2024-02-15T18:19:07.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.459+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9138005670 con 0x7f91500601e0 2024-02-15T18:19:07.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.927+0000 7f9146ffd700 1 -- 172.21.15.84:0/97381476 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v5) v1 ==== 124+0+0 (secure 0 0 0) 0x7f914c02b070 con 0x7f91500601e0 2024-02-15T18:19:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.929+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f913c073f20 msgr2=0x7f913c0763e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.929+0000 7f9157594700 1 --2- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f913c073f20 0x7f913c0763e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f91400096a0 tx=0x7f9140006b40).stop 2024-02-15T18:19:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.929+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 msgr2=0x7f9150104390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.929+0000 7f9157594700 1 --2- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 0x7f9150104390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f914c005010 tx=0x7f914c00b040).stop 2024-02-15T18:19:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.929+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 shutdown_connections 2024-02-15T18:19:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.929+0000 7f9157594700 1 --2- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f913c073f20 0x7f913c0763e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.929+0000 7f9157594700 1 --2- 172.21.15.84:0/97381476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91500601e0 0x7f9150104390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.929+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 >> 172.21.15.84:0/97381476 conn(0x7f91500f09a0 msgr2=0x7f91500f13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.930+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 shutdown_connections 2024-02-15T18:19:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:19:07.930+0000 7f9157594700 1 -- 172.21.15.84:0/97381476 wait complete. 2024-02-15T18:19:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-02-15T18:19:08.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:06.348353+0000 mgr.smithi084.hjmnez (mgr.14162) 21 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:08.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:07.461028+0000 mon.smithi084 (mon.0) 126 : audit [INF] from='client.? 172.21.15.84:0/97381476' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-15T18:19:08.615 INFO:tasks.cephadm:Adding mon.smithi084 on smithi084 2024-02-15T18:19:08.615 INFO:tasks.cephadm:Adding mon.smithi133 on smithi133 2024-02-15T18:19:08.616 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph orch apply mon '2;smithi084:172.21.15.84=smithi084;smithi133:172.21.15.133=smithi133' 2024-02-15T18:19:09.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:07.928738+0000 mon.smithi084 (mon.0) 127 : audit [INF] from='client.? 172.21.15.84:0/97381476' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-15T18:19:09.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:07.928788+0000 mon.smithi084 (mon.0) 128 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-15T18:19:10.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:08.348564+0000 mgr.smithi084.hjmnez (mgr.14162) 22 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 -- 172.21.15.133:0/3014046651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 msgr2=0x7f14c40f90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 --2- 172.21.15.133:0/3014046651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 0x7f14c40f90d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f14b4009fb0 tx=0x7f14b4009b30).stop 2024-02-15T18:19:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 -- 172.21.15.133:0/3014046651 shutdown_connections 2024-02-15T18:19:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 --2- 172.21.15.133:0/3014046651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 0x7f14c40f90d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 -- 172.21.15.133:0/3014046651 >> 172.21.15.133:0/3014046651 conn(0x7f14c40f0b70 msgr2=0x7f14c40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 -- 172.21.15.133:0/3014046651 shutdown_connections 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 -- 172.21.15.133:0/3014046651 wait complete. 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 Processor -- start 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 -- start start 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 0x7f14c4108960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.466+0000 7f14cbc8d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4108e50 con 0x7f14c4060280 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14c9a29700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 0x7f14c4108960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14c9a29700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 0x7f14c4108960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:42434/0 (socket says 172.21.15.133:42434) 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14c9a29700 1 -- 172.21.15.133:0/2708495195 learned_addr learned my addr 172.21.15.133:0/2708495195 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14c9a29700 1 -- 172.21.15.133:0/2708495195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4005040 con 0x7f14c4060280 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14c9a29700 1 --2- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 0x7f14c4108960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f14b40089f0 tx=0x7f14b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14ba7fc700 1 -- 172.21.15.133:0/2708495195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14b4009320 con 0x7f14c4060280 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14ba7fc700 1 -- 172.21.15.133:0/2708495195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14b4013380 con 0x7f14c4060280 2024-02-15T18:19:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c4109050 con 0x7f14c4060280 2024-02-15T18:19:10.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14ba7fc700 1 -- 172.21.15.133:0/2708495195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14b4014e20 con 0x7f14c4060280 2024-02-15T18:19:10.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.467+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c41094e0 con 0x7f14c4060280 2024-02-15T18:19:10.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.468+0000 7f14ba7fc700 1 -- 172.21.15.133:0/2708495195 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f14b4014420 con 0x7f14c4060280 2024-02-15T18:19:10.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.468+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c4045ad0 con 0x7f14c4060280 2024-02-15T18:19:10.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.468+0000 7f14ba7fc700 1 --2- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f14b002ff60 0x7f14b0032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:10.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.468+0000 7f14ba7fc700 1 -- 172.21.15.133:0/2708495195 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f14b4041010 con 0x7f14c4060280 2024-02-15T18:19:10.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.468+0000 7f14c9228700 1 --2- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f14b002ff60 0x7f14b0032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:10.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.469+0000 7f14c9228700 1 --2- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f14b002ff60 0x7f14b0032420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f14c00096a0 tx=0x7f14c0006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:10.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.473+0000 7f14ba7fc700 1 -- 172.21.15.133:0/2708495195 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f14b40095f0 con 0x7f14c4060280 2024-02-15T18:19:10.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.647+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi084:172.21.15.84=smithi084;smithi133:172.21.15.133=smithi133", "target": ["mon-mgr", ""]}) v1 -- 0x7f14c40f1c50 con 0x7f14b002ff60 2024-02-15T18:19:10.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.652+0000 7f14ba7fc700 1 -- 172.21.15.133:0/2708495195 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f14c40f1c50 con 0x7f14b002ff60 2024-02-15T18:19:10.652 INFO:teuthology.orchestra.run.smithi133.stdout:Scheduled mon update... 2024-02-15T18:19:10.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.653+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f14b002ff60 msgr2=0x7f14b0032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:10.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.653+0000 7f14cbc8d700 1 --2- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f14b002ff60 0x7f14b0032420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f14c00096a0 tx=0x7f14c0006b40).stop 2024-02-15T18:19:10.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.653+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 msgr2=0x7f14c4108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:10.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.653+0000 7f14cbc8d700 1 --2- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 0x7f14c4108960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f14b40089f0 tx=0x7f14b400b040).stop 2024-02-15T18:19:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.653+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 shutdown_connections 2024-02-15T18:19:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.653+0000 7f14cbc8d700 1 --2- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f14b002ff60 0x7f14b0032420 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.654+0000 7f14cbc8d700 1 --2- 172.21.15.133:0/2708495195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14c4060280 0x7f14c4108960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.654+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 >> 172.21.15.133:0/2708495195 conn(0x7f14c40f0b70 msgr2=0x7f14c40f1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.654+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 shutdown_connections 2024-02-15T18:19:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:10.654+0000 7f14cbc8d700 1 -- 172.21.15.133:0/2708495195 wait complete. 2024-02-15T18:19:11.200 DEBUG:teuthology.orchestra.run.smithi133:mon.smithi133> sudo journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi133.service 2024-02-15T18:19:11.202 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:11.202 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:11.231 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:-- Logs begin at Thu 2024-02-15 18:00:43 UTC. -- 2024-02-15T18:19:12.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:10.348807+0000 mgr.smithi084.hjmnez (mgr.14162) 23 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:12.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:10.649528+0000 mgr.smithi084.hjmnez (mgr.14162) 24 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi084:172.21.15.84=smithi084;smithi133:172.21.15.133=smithi133", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:19:12.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:19:10.650771+0000 mgr.smithi084.hjmnez (mgr.14162) 25 : cephadm [INF] Saving service mon spec with placement smithi084:172.21.15.84=smithi084;smithi133:172.21.15.133=smithi133;count:2 2024-02-15T18:19:12.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:10.653073+0000 mon.smithi084 (mon.0) 129 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:13.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.074+0000 7f5060b12700 1 -- 172.21.15.133:0/3822185392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 msgr2=0x7f505c0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:13.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.074+0000 7f5060b12700 1 --2- 172.21.15.133:0/3822185392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 0x7f505c0f5830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5050009fb0 tx=0x7f5050009b30).stop 2024-02-15T18:19:13.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.074+0000 7f5060b12700 1 -- 172.21.15.133:0/3822185392 shutdown_connections 2024-02-15T18:19:13.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.074+0000 7f5060b12700 1 --2- 172.21.15.133:0/3822185392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 0x7f505c0f5830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.074+0000 7f5060b12700 1 -- 172.21.15.133:0/3822185392 >> 172.21.15.133:0/3822185392 conn(0x7f505c0f0b70 msgr2=0x7f505c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.074+0000 7f5060b12700 1 -- 172.21.15.133:0/3822185392 shutdown_connections 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.074+0000 7f5060b12700 1 -- 172.21.15.133:0/3822185392 wait complete. 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.075+0000 7f5060b12700 1 Processor -- start 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.075+0000 7f5060b12700 1 -- start start 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.075+0000 7f5060b12700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 0x7f505c0fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.075+0000 7f5060b12700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0fb960 con 0x7f505c0f5410 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.075+0000 7f505a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 0x7f505c0fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.075+0000 7f505a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 0x7f505c0fd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:46458/0 (socket says 172.21.15.133:46458) 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.075+0000 7f505a59c700 1 -- 172.21.15.133:0/2742829567 learned_addr learned my addr 172.21.15.133:0/2742829567 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.075+0000 7f505a59c700 1 -- 172.21.15.133:0/2742829567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5050005040 con 0x7f505c0f5410 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.076+0000 7f505a59c700 1 --2- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 0x7f505c0fd4e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f5050005010 tx=0x7f505000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.076+0000 7f504affd700 1 -- 172.21.15.133:0/2742829567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5050009320 con 0x7f505c0f5410 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.076+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c0fbb00 con 0x7f505c0f5410 2024-02-15T18:19:13.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.076+0000 7f504affd700 1 -- 172.21.15.133:0/2742829567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5050013380 con 0x7f505c0f5410 2024-02-15T18:19:13.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.076+0000 7f504affd700 1 -- 172.21.15.133:0/2742829567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5050014e50 con 0x7f505c0f5410 2024-02-15T18:19:13.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.076+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c0fbf90 con 0x7f505c0f5410 2024-02-15T18:19:13.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.077+0000 7f504affd700 1 -- 172.21.15.133:0/2742829567 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f50500263a0 con 0x7f505c0f5410 2024-02-15T18:19:13.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.077+0000 7f504affd700 1 --2- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f504402ff10 0x7f50440323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:13.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.077+0000 7f504affd700 1 -- 172.21.15.133:0/2742829567 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f5050040fa0 con 0x7f505c0f5410 2024-02-15T18:19:13.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.077+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c059100 con 0x7f505c0f5410 2024-02-15T18:19:13.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.077+0000 7f5059d9b700 1 --2- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f504402ff10 0x7f50440323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:13.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.077+0000 7f5059d9b700 1 --2- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f504402ff10 0x7f50440323d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f504c0096a0 tx=0x7f504c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:13.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.082+0000 7f504affd700 1 -- 172.21.15.133:0/2742829567 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5050012920 con 0x7f505c0f5410 2024-02-15T18:19:13.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.285+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f505c045ad0 con 0x7f505c0f5410 2024-02-15T18:19:13.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.286+0000 7f504affd700 1 -- 172.21.15.133:0/2742829567 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f505002b020 con 0x7f505c0f5410 2024-02-15T18:19:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:13.287 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f504402ff10 msgr2=0x7f50440323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 --2- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f504402ff10 0x7f50440323d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f504c0096a0 tx=0x7f504c006b40).stop 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 msgr2=0x7f505c0fd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 --2- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 0x7f505c0fd4e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f5050005010 tx=0x7f505000b040).stop 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 shutdown_connections 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 --2- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f504402ff10 0x7f50440323d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 --2- 172.21.15.133:0/2742829567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f505c0f5410 0x7f505c0fd4e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 >> 172.21.15.133:0/2742829567 conn(0x7f505c0f0b70 msgr2=0x7f505c05fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 shutdown_connections 2024-02-15T18:19:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:13.287+0000 7f5060b12700 1 -- 172.21.15.133:0/2742829567 wait complete. 2024-02-15T18:19:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:14.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:12.349004+0000 mgr.smithi084.hjmnez (mgr.14162) 26 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:14.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:13.287207+0000 mon.smithi084 (mon.0) 130 : audit [DBG] from='client.? 172.21.15.133:0/2742829567' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:19:14.985 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:14.985 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:16.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:14.349188+0000 mgr.smithi084.hjmnez (mgr.14162) 27 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.255+0000 7f2a27fad700 1 -- 172.21.15.133:0/3211391756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 msgr2=0x7f2a200f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.255+0000 7f2a27fad700 1 --2- 172.21.15.133:0/3211391756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 0x7f2a200f5830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f2a10009fb0 tx=0x7f2a10009b30).stop 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.255+0000 7f2a27fad700 1 -- 172.21.15.133:0/3211391756 shutdown_connections 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.255+0000 7f2a27fad700 1 --2- 172.21.15.133:0/3211391756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 0x7f2a200f5830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.255+0000 7f2a27fad700 1 -- 172.21.15.133:0/3211391756 >> 172.21.15.133:0/3211391756 conn(0x7f2a200f0b70 msgr2=0x7f2a200f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.255+0000 7f2a27fad700 1 -- 172.21.15.133:0/3211391756 shutdown_connections 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.255+0000 7f2a27fad700 1 -- 172.21.15.133:0/3211391756 wait complete. 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.256+0000 7f2a27fad700 1 Processor -- start 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.256+0000 7f2a27fad700 1 -- start start 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.256+0000 7f2a27fad700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 0x7f2a200fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.256+0000 7f2a27fad700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200fb960 con 0x7f2a200f5410 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.256+0000 7f2a25d49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 0x7f2a200fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.256+0000 7f2a25d49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 0x7f2a200fd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:46488/0 (socket says 172.21.15.133:46488) 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.256+0000 7f2a25d49700 1 -- 172.21.15.133:0/997360649 learned_addr learned my addr 172.21.15.133:0/997360649 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.256+0000 7f2a25d49700 1 -- 172.21.15.133:0/997360649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10005040 con 0x7f2a200f5410 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.257+0000 7f2a25d49700 1 --2- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 0x7f2a200fd4e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2a100089f0 tx=0x7f2a1000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:17.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.257+0000 7f2a167fc700 1 -- 172.21.15.133:0/997360649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a10009320 con 0x7f2a200f5410 2024-02-15T18:19:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.257+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a200fbb00 con 0x7f2a200f5410 2024-02-15T18:19:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.257+0000 7f2a167fc700 1 -- 172.21.15.133:0/997360649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a10013380 con 0x7f2a200f5410 2024-02-15T18:19:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.257+0000 7f2a167fc700 1 -- 172.21.15.133:0/997360649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a1001ed80 con 0x7f2a200f5410 2024-02-15T18:19:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.257+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a200fbf90 con 0x7f2a200f5410 2024-02-15T18:19:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.258+0000 7f2a167fc700 1 -- 172.21.15.133:0/997360649 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f2a1001e420 con 0x7f2a200f5410 2024-02-15T18:19:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.258+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a20059100 con 0x7f2a200f5410 2024-02-15T18:19:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.258+0000 7f2a167fc700 1 --2- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2a0c02ff60 0x7f2a0c032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.258+0000 7f2a167fc700 1 -- 172.21.15.133:0/997360649 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f2a10040ed0 con 0x7f2a200f5410 2024-02-15T18:19:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.258+0000 7f2a25548700 1 --2- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2a0c02ff60 0x7f2a0c032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.258+0000 7f2a25548700 1 --2- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2a0c02ff60 0x7f2a0c032420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f2a1c0096a0 tx=0x7f2a1c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:17.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.262+0000 7f2a167fc700 1 -- 172.21.15.133:0/997360649 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2a1001c930 con 0x7f2a200f5410 2024-02-15T18:19:17.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.468+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2a200fafa0 con 0x7f2a200f5410 2024-02-15T18:19:17.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.469+0000 7f2a167fc700 1 -- 172.21.15.133:0/997360649 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f2a1001cb40 con 0x7f2a200f5410 2024-02-15T18:19:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:17.470 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2a0c02ff60 msgr2=0x7f2a0c032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 --2- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2a0c02ff60 0x7f2a0c032420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f2a1c0096a0 tx=0x7f2a1c006b40).stop 2024-02-15T18:19:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 msgr2=0x7f2a200fd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 --2- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 0x7f2a200fd4e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2a100089f0 tx=0x7f2a1000b040).stop 2024-02-15T18:19:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 shutdown_connections 2024-02-15T18:19:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 --2- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2a0c02ff60 0x7f2a0c032420 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 --2- 172.21.15.133:0/997360649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a200f5410 0x7f2a200fd4e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 >> 172.21.15.133:0/997360649 conn(0x7f2a200f0b70 msgr2=0x7f2a200f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 shutdown_connections 2024-02-15T18:19:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:17.471+0000 7f2a27fad700 1 -- 172.21.15.133:0/997360649 wait complete. 2024-02-15T18:19:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:17.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:16.349429+0000 mgr.smithi084.hjmnez (mgr.14162) 28 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:17.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:17.470400+0000 mon.smithi084 (mon.0) 131 : audit [DBG] from='client.? 172.21.15.133:0/997360649' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:19:19.035 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:19.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:20.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:18.349686+0000 mgr.smithi084.hjmnez (mgr.14162) 29 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:20.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:18.966048+0000 mon.smithi084 (mon.0) 132 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:20.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:19:18.967260+0000 mgr.smithi084.hjmnez (mgr.14162) 30 : cephadm [INF] Deploying daemon node-exporter.smithi084 on smithi084 2024-02-15T18:19:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.848+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/648147180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 msgr2=0x7ff7e00f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.848+0000 7ff7e4bf6700 1 --2- 172.21.15.133:0/648147180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 0x7ff7e00f5830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff7d4009fb0 tx=0x7ff7d4009b30).stop 2024-02-15T18:19:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.848+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/648147180 shutdown_connections 2024-02-15T18:19:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.848+0000 7ff7e4bf6700 1 --2- 172.21.15.133:0/648147180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 0x7ff7e00f5830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.848+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/648147180 >> 172.21.15.133:0/648147180 conn(0x7ff7e00f0b70 msgr2=0x7ff7e00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.849+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/648147180 shutdown_connections 2024-02-15T18:19:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.849+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/648147180 wait complete. 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.849+0000 7ff7e4bf6700 1 Processor -- start 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.849+0000 7ff7e4bf6700 1 -- start start 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.849+0000 7ff7e4bf6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 0x7ff7e01067f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.849+0000 7ff7e4bf6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e0106ce0 con 0x7ff7e00f5410 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.849+0000 7ff7de59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 0x7ff7e01067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.849+0000 7ff7de59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 0x7ff7e01067f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:46512/0 (socket says 172.21.15.133:46512) 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.849+0000 7ff7de59c700 1 -- 172.21.15.133:0/2138197051 learned_addr learned my addr 172.21.15.133:0/2138197051 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.850+0000 7ff7de59c700 1 -- 172.21.15.133:0/2138197051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d4005040 con 0x7ff7e00f5410 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.850+0000 7ff7de59c700 1 --2- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 0x7ff7e01067f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff7d40089f0 tx=0x7ff7d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.850+0000 7ff7ceffd700 1 -- 172.21.15.133:0/2138197051 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7d4009320 con 0x7ff7e00f5410 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.850+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e0106ee0 con 0x7ff7e00f5410 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.850+0000 7ff7ceffd700 1 -- 172.21.15.133:0/2138197051 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7d4013380 con 0x7ff7e00f5410 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.850+0000 7ff7ceffd700 1 -- 172.21.15.133:0/2138197051 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7d401ed80 con 0x7ff7e00f5410 2024-02-15T18:19:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.850+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e0107370 con 0x7ff7e00f5410 2024-02-15T18:19:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.851+0000 7ff7ceffd700 1 -- 172.21.15.133:0/2138197051 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7ff7d401e420 con 0x7ff7e00f5410 2024-02-15T18:19:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.851+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e0045ad0 con 0x7ff7e00f5410 2024-02-15T18:19:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.851+0000 7ff7ceffd700 1 --2- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff7c802ff60 0x7ff7c8032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.851+0000 7ff7ceffd700 1 -- 172.21.15.133:0/2138197051 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7ff7d4041150 con 0x7ff7e00f5410 2024-02-15T18:19:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.851+0000 7ff7ddd9b700 1 --2- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff7c802ff60 0x7ff7c8032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.851+0000 7ff7ddd9b700 1 --2- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff7c802ff60 0x7ff7c8032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff7d00096a0 tx=0x7ff7d0006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:20.856+0000 7ff7ceffd700 1 -- 172.21.15.133:0/2138197051 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff7d40095f0 con 0x7ff7e00f5410 2024-02-15T18:19:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.067+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff7e0108220 con 0x7ff7e00f5410 2024-02-15T18:19:21.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.067+0000 7ff7ceffd700 1 -- 172.21.15.133:0/2138197051 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7ff7d4004490 con 0x7ff7e00f5410 2024-02-15T18:19:21.068 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:21.068 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.069+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff7c802ff60 msgr2=0x7ff7c8032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.069+0000 7ff7e4bf6700 1 --2- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff7c802ff60 0x7ff7c8032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff7d00096a0 tx=0x7ff7d0006b40).stop 2024-02-15T18:19:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.069+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 msgr2=0x7ff7e01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.069+0000 7ff7e4bf6700 1 --2- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 0x7ff7e01067f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff7d40089f0 tx=0x7ff7d400b040).stop 2024-02-15T18:19:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.069+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 shutdown_connections 2024-02-15T18:19:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.069+0000 7ff7e4bf6700 1 --2- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff7c802ff60 0x7ff7c8032420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.069+0000 7ff7e4bf6700 1 --2- 172.21.15.133:0/2138197051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e00f5410 0x7ff7e01067f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.069+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 >> 172.21.15.133:0/2138197051 conn(0x7ff7e00f0b70 msgr2=0x7ff7e005fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.070+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 shutdown_connections 2024-02-15T18:19:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:21.070+0000 7ff7e4bf6700 1 -- 172.21.15.133:0/2138197051 wait complete. 2024-02-15T18:19:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:20.350144+0000 mgr.smithi084.hjmnez (mgr.14162) 31 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:21.068829+0000 mon.smithi084 (mon.0) 133 : audit [DBG] from='client.? 172.21.15.133:0/2138197051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:19:24.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:22.350474+0000 mgr.smithi084.hjmnez (mgr.14162) 32 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:24.833 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:24.833 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:26.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:24.350841+0000 mgr.smithi084.hjmnez (mgr.14162) 33 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:26.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.522+0000 7f16b4258700 1 -- 172.21.15.133:0/16662293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 msgr2=0x7f16ac0f7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:26.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.522+0000 7f16b4258700 1 --2- 172.21.15.133:0/16662293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 0x7f16ac0f7f80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f169c009fb0 tx=0x7f169c009b30).stop 2024-02-15T18:19:26.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.522+0000 7f16b4258700 1 -- 172.21.15.133:0/16662293 shutdown_connections 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.522+0000 7f16b4258700 1 --2- 172.21.15.133:0/16662293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 0x7f16ac0f7f80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.522+0000 7f16b4258700 1 -- 172.21.15.133:0/16662293 >> 172.21.15.133:0/16662293 conn(0x7f16ac0f02e0 msgr2=0x7f16ac0f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.522+0000 7f16b4258700 1 -- 172.21.15.133:0/16662293 shutdown_connections 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.522+0000 7f16b4258700 1 -- 172.21.15.133:0/16662293 wait complete. 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.523+0000 7f16b4258700 1 Processor -- start 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.523+0000 7f16b4258700 1 -- start start 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.523+0000 7f16b4258700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 0x7f16ac106830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.523+0000 7f16b4258700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac106d20 con 0x7f16ac0f7b60 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.523+0000 7f16b1ff4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 0x7f16ac106830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.523+0000 7f16b1ff4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 0x7f16ac106830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:37410/0 (socket says 172.21.15.133:37410) 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.523+0000 7f16b1ff4700 1 -- 172.21.15.133:0/1486699787 learned_addr learned my addr 172.21.15.133:0/1486699787 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:26.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.523+0000 7f16b1ff4700 1 -- 172.21.15.133:0/1486699787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c005040 con 0x7f16ac0f7b60 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.524+0000 7f16b1ff4700 1 --2- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 0x7f16ac106830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f169c005010 tx=0x7f169c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.524+0000 7f16a27fc700 1 -- 172.21.15.133:0/1486699787 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f169c009320 con 0x7f16ac0f7b60 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.524+0000 7f16a27fc700 1 -- 172.21.15.133:0/1486699787 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f169c013380 con 0x7f16ac0f7b60 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.524+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac106f20 con 0x7f16ac0f7b60 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.524+0000 7f16a27fc700 1 -- 172.21.15.133:0/1486699787 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f169c014e50 con 0x7f16ac0f7b60 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.524+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac1073b0 con 0x7f16ac0f7b60 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.525+0000 7f16a27fc700 1 -- 172.21.15.133:0/1486699787 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f169c014420 con 0x7f16ac0f7b60 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.525+0000 7f16a27fc700 1 --2- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f169802ff10 0x7f16980323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.525+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac045ad0 con 0x7f16ac0f7b60 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.525+0000 7f16a27fc700 1 -- 172.21.15.133:0/1486699787 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f169c040e60 con 0x7f16ac0f7b60 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.525+0000 7f16b17f3700 1 --2- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f169802ff10 0x7f16980323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.525+0000 7f16b17f3700 1 --2- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f169802ff10 0x7f16980323d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f16a80096a0 tx=0x7f16a8006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:26.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.530+0000 7f16a27fc700 1 -- 172.21.15.133:0/1486699787 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f169c01db70 con 0x7f16ac0f7b60 2024-02-15T18:19:26.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.736+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f16ac108260 con 0x7f16ac0f7b60 2024-02-15T18:19:26.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.736+0000 7f16a27fc700 1 -- 172.21.15.133:0/1486699787 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f169c042070 con 0x7f16ac0f7b60 2024-02-15T18:19:26.737 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:26.737 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:26.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f169802ff10 msgr2=0x7f16980323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 --2- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f169802ff10 0x7f16980323d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f16a80096a0 tx=0x7f16a8006b40).stop 2024-02-15T18:19:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 msgr2=0x7f16ac106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 --2- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 0x7f16ac106830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f169c005010 tx=0x7f169c00b040).stop 2024-02-15T18:19:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 shutdown_connections 2024-02-15T18:19:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 --2- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f169802ff10 0x7f16980323d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 --2- 172.21.15.133:0/1486699787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16ac0f7b60 0x7f16ac106830 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 >> 172.21.15.133:0/1486699787 conn(0x7f16ac0f02e0 msgr2=0x7f16ac0f0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 shutdown_connections 2024-02-15T18:19:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:26.738+0000 7f16b4258700 1 -- 172.21.15.133:0/1486699787 wait complete. 2024-02-15T18:19:26.740 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:27.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:26.351102+0000 mgr.smithi084.hjmnez (mgr.14162) 34 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:27.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:26.737654+0000 mon.smithi084 (mon.0) 134 : audit [DBG] from='client.? 172.21.15.133:0/1486699787' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:19:28.435 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:28.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:29.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:28.315357+0000 mon.smithi084 (mon.0) 135 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:29.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:19:28.320652+0000 mgr.smithi084.hjmnez (mgr.14162) 35 : cephadm [INF] Deploying daemon prometheus.smithi084 on smithi084 2024-02-15T18:19:29.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:28.472378+0000 mon.smithi084 (mon.0) 136 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:19:29.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:28.475426+0000 mon.smithi084 (mon.0) 137 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:19:30.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:28.351331+0000 mgr.smithi084.hjmnez (mgr.14162) 36 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:32.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:30.351711+0000 mgr.smithi084.hjmnez (mgr.14162) 37 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:34.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:32.352039+0000 mgr.smithi084.hjmnez (mgr.14162) 38 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:36.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:34.352301+0000 mgr.smithi084.hjmnez (mgr.14162) 39 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.021+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/160158036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 msgr2=0x7fbf980f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.021+0000 7fbf9e1dd700 1 --2- 172.21.15.133:0/160158036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 0x7fbf980f55c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fbf94009fb0 tx=0x7fbf94009b30).stop 2024-02-15T18:19:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.021+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/160158036 shutdown_connections 2024-02-15T18:19:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.021+0000 7fbf9e1dd700 1 --2- 172.21.15.133:0/160158036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 0x7fbf980f55c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.021+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/160158036 >> 172.21.15.133:0/160158036 conn(0x7fbf980f09a0 msgr2=0x7fbf980f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.022+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/160158036 shutdown_connections 2024-02-15T18:19:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.022+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/160158036 wait complete. 2024-02-15T18:19:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.022+0000 7fbf9e1dd700 1 Processor -- start 2024-02-15T18:19:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.022+0000 7fbf9e1dd700 1 -- start start 2024-02-15T18:19:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.023+0000 7fbf9e1dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 0x7fbf98106650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.023+0000 7fbf9e1dd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf98106b40 con 0x7fbf980f51a0 2024-02-15T18:19:38.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.023+0000 7fbf9d1db700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 0x7fbf98106650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.023+0000 7fbf9d1db700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 0x7fbf98106650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:47734/0 (socket says 172.21.15.133:47734) 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.023+0000 7fbf9d1db700 1 -- 172.21.15.133:0/3946753924 learned_addr learned my addr 172.21.15.133:0/3946753924 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.023+0000 7fbf9d1db700 1 -- 172.21.15.133:0/3946753924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94005040 con 0x7fbf980f51a0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.023+0000 7fbf9d1db700 1 --2- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 0x7fbf98106650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fbf94009f80 tx=0x7fbf9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.024+0000 7fbf8dffb700 1 -- 172.21.15.133:0/3946753924 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf940095f0 con 0x7fbf980f51a0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.024+0000 7fbf8dffb700 1 -- 172.21.15.133:0/3946753924 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf94007e90 con 0x7fbf980f51a0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.024+0000 7fbf8dffb700 1 -- 172.21.15.133:0/3946753924 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbf94014d80 con 0x7fbf980f51a0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.024+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf98106d40 con 0x7fbf980f51a0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.024+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf981071d0 con 0x7fbf980f51a0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.025+0000 7fbf8dffb700 1 -- 172.21.15.133:0/3946753924 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fbf94025070 con 0x7fbf980f51a0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.025+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf98045ad0 con 0x7fbf980f51a0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.025+0000 7fbf8dffb700 1 --2- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbf8402ffb0 0x7fbf84032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.025+0000 7fbf8dffb700 1 -- 172.21.15.133:0/3946753924 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fbf940408f0 con 0x7fbf980f51a0 2024-02-15T18:19:38.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.025+0000 7fbf9c9da700 1 --2- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbf8402ffb0 0x7fbf84032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:38.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.026+0000 7fbf9c9da700 1 --2- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbf8402ffb0 0x7fbf84032470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fbf880096a0 tx=0x7fbf88006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:38.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.030+0000 7fbf8dffb700 1 -- 172.21.15.133:0/3946753924 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fbf9400f4e0 con 0x7fbf980f51a0 2024-02-15T18:19:38.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.236+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbf98108080 con 0x7fbf980f51a0 2024-02-15T18:19:38.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.237+0000 7fbf8dffb700 1 -- 172.21.15.133:0/3946753924 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fbf9400f300 con 0x7fbf980f51a0 2024-02-15T18:19:38.236 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:38.237 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:38.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbf8402ffb0 msgr2=0x7fbf84032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 --2- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbf8402ffb0 0x7fbf84032470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fbf880096a0 tx=0x7fbf88006b40).stop 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 msgr2=0x7fbf98106650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 --2- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 0x7fbf98106650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fbf94009f80 tx=0x7fbf9400b040).stop 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 shutdown_connections 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 --2- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbf8402ffb0 0x7fbf84032470 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 --2- 172.21.15.133:0/3946753924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf980f51a0 0x7fbf98106650 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 >> 172.21.15.133:0/3946753924 conn(0x7fbf980f09a0 msgr2=0x7fbf9805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 shutdown_connections 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:38.239+0000 7fbf9e1dd700 1 -- 172.21.15.133:0/3946753924 wait complete. 2024-02-15T18:19:38.239 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:38.344 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:36.352580+0000 mgr.smithi084.hjmnez (mgr.14162) 40 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:38.344 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:38.237191+0000 mon.smithi084 (mon.0) 138 : audit [DBG] from='client.? 172.21.15.133:0/3946753924' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:19:39.957 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:39.958 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:40.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:38.352849+0000 mgr.smithi084.hjmnez (mgr.14162) 41 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:41.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.803+0000 7f3e323a0700 1 -- 172.21.15.133:0/3427488095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 msgr2=0x7f3e2c0f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.803+0000 7f3e323a0700 1 --2- 172.21.15.133:0/3427488095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 0x7f3e2c0f8f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3e1c009fb0 tx=0x7f3e1c009b30).stop 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.803+0000 7f3e323a0700 1 -- 172.21.15.133:0/3427488095 shutdown_connections 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.803+0000 7f3e323a0700 1 --2- 172.21.15.133:0/3427488095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 0x7f3e2c0f8f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.803+0000 7f3e323a0700 1 -- 172.21.15.133:0/3427488095 >> 172.21.15.133:0/3427488095 conn(0x7f3e2c0f09a0 msgr2=0x7f3e2c0f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.803+0000 7f3e323a0700 1 -- 172.21.15.133:0/3427488095 shutdown_connections 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.803+0000 7f3e323a0700 1 -- 172.21.15.133:0/3427488095 wait complete. 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e323a0700 1 Processor -- start 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e323a0700 1 -- start start 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e323a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 0x7f3e2c1087f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e323a0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c108ce0 con 0x7f3e2c0601e0 2024-02-15T18:19:41.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e3139e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 0x7f3e2c1087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e3139e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 0x7f3e2c1087f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:47752/0 (socket says 172.21.15.133:47752) 2024-02-15T18:19:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e3139e700 1 -- 172.21.15.133:0/3835539870 learned_addr learned my addr 172.21.15.133:0/3835539870 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e3139e700 1 -- 172.21.15.133:0/3835539870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c005040 con 0x7f3e2c0601e0 2024-02-15T18:19:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e3139e700 1 --2- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 0x7f3e2c1087f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3e1c0089f0 tx=0x7f3e1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e21ffb700 1 -- 172.21.15.133:0/3835539870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e1c009320 con 0x7f3e2c0601e0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e21ffb700 1 -- 172.21.15.133:0/3835539870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e1c013380 con 0x7f3e2c0601e0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.804+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c108ee0 con 0x7f3e2c0601e0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.805+0000 7f3e21ffb700 1 -- 172.21.15.133:0/3835539870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e1c01ed80 con 0x7f3e2c0601e0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.805+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c109370 con 0x7f3e2c0601e0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.805+0000 7f3e21ffb700 1 -- 172.21.15.133:0/3835539870 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f3e1c014420 con 0x7f3e2c0601e0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.806+0000 7f3e21ffb700 1 --2- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3e1802ffb0 0x7f3e18032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.806+0000 7f3e21ffb700 1 -- 172.21.15.133:0/3835539870 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f3e1c040f20 con 0x7f3e2c0601e0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.806+0000 7f3e30b9d700 1 --2- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3e1802ffb0 0x7f3e18032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.806+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c059100 con 0x7f3e2c0601e0 2024-02-15T18:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.806+0000 7f3e30b9d700 1 --2- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3e1802ffb0 0x7f3e18032470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3e280096a0 tx=0x7f3e28006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:41.810+0000 7f3e21ffb700 1 -- 172.21.15.133:0/3835539870 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3e1c0672b0 con 0x7f3e2c0601e0 2024-02-15T18:19:42.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.031+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3e2c0fbe10 con 0x7f3e2c0601e0 2024-02-15T18:19:42.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.032+0000 7f3e21ffb700 1 -- 172.21.15.133:0/3835539870 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f3e1c01c910 con 0x7f3e2c0601e0 2024-02-15T18:19:42.031 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:42.031 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:42.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3e1802ffb0 msgr2=0x7f3e18032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:42.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 --2- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3e1802ffb0 0x7f3e18032470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3e280096a0 tx=0x7f3e28006b40).stop 2024-02-15T18:19:42.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 msgr2=0x7f3e2c1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:42.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 --2- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 0x7f3e2c1087f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3e1c0089f0 tx=0x7f3e1c00b040).stop 2024-02-15T18:19:42.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 shutdown_connections 2024-02-15T18:19:42.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 --2- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3e1802ffb0 0x7f3e18032470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:42.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 --2- 172.21.15.133:0/3835539870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0601e0 0x7f3e2c1087f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:42.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 >> 172.21.15.133:0/3835539870 conn(0x7f3e2c0f09a0 msgr2=0x7f3e2c0f1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:42.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 shutdown_connections 2024-02-15T18:19:42.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:42.034+0000 7f3e323a0700 1 -- 172.21.15.133:0/3835539870 wait complete. 2024-02-15T18:19:42.034 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:42.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:40.353038+0000 mgr.smithi084.hjmnez (mgr.14162) 42 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:42.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:41.820095+0000 mon.smithi084 (mon.0) 139 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:42.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:41.820644+0000 mon.smithi084 (mon.0) 140 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:19:42.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:42.031851+0000 mon.smithi084 (mon.0) 141 : audit [DBG] from='client.? 172.21.15.133:0/3835539870' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:19:42.765 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:42.044140+0000 mon.smithi084 (mon.0) 142 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:43.672 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:43.673 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:43.928 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:42.353275+0000 mgr.smithi084.hjmnez (mgr.14162) 43 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:43.928 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:42.669332+0000 mon.smithi084 (mon.0) 143 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:45.993 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:44.353510+0000 mgr.smithi084.hjmnez (mgr.14162) 44 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:46.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.482+0000 7f6c7228e700 1 -- 172.21.15.133:0/2493525101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 msgr2=0x7f6c6c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.482+0000 7f6c7228e700 1 --2- 172.21.15.133:0/2493525101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 0x7f6c6c0f6930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f6c5c009fb0 tx=0x7f6c5c009b30).stop 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.482+0000 7f6c7228e700 1 -- 172.21.15.133:0/2493525101 shutdown_connections 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.482+0000 7f6c7228e700 1 --2- 172.21.15.133:0/2493525101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 0x7f6c6c0f6930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.482+0000 7f6c7228e700 1 -- 172.21.15.133:0/2493525101 >> 172.21.15.133:0/2493525101 conn(0x7f6c6c0f1c70 msgr2=0x7f6c6c0f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.482+0000 7f6c7228e700 1 -- 172.21.15.133:0/2493525101 shutdown_connections 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.482+0000 7f6c7228e700 1 -- 172.21.15.133:0/2493525101 wait complete. 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.483+0000 7f6c7228e700 1 Processor -- start 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.483+0000 7f6c7228e700 1 -- start start 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.483+0000 7f6c7228e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 0x7f6c6c1067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.483+0000 7f6c7228e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c106cd0 con 0x7f6c6c0f6510 2024-02-15T18:19:46.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c6bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 0x7f6c6c1067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c6bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 0x7f6c6c1067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:56076/0 (socket says 172.21.15.133:56076) 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c6bfff700 1 -- 172.21.15.133:0/2261881208 learned_addr learned my addr 172.21.15.133:0/2261881208 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c6bfff700 1 -- 172.21.15.133:0/2261881208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c005040 con 0x7f6c6c0f6510 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c6bfff700 1 --2- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 0x7f6c6c1067e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6c5c005010 tx=0x7f6c5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c68ff9700 1 -- 172.21.15.133:0/2261881208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c5c009320 con 0x7f6c6c0f6510 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c106ed0 con 0x7f6c6c0f6510 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c68ff9700 1 -- 172.21.15.133:0/2261881208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c5c013380 con 0x7f6c6c0f6510 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c68ff9700 1 -- 172.21.15.133:0/2261881208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c5c014e50 con 0x7f6c6c0f6510 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.484+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c107360 con 0x7f6c6c0f6510 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.485+0000 7f6c68ff9700 1 -- 172.21.15.133:0/2261881208 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f6c5c0263a0 con 0x7f6c6c0f6510 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.485+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c045ad0 con 0x7f6c6c0f6510 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.485+0000 7f6c68ff9700 1 --2- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6c5402ff10 0x7f6c540323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.485+0000 7f6c68ff9700 1 -- 172.21.15.133:0/2261881208 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f6c5c041270 con 0x7f6c6c0f6510 2024-02-15T18:19:46.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.485+0000 7f6c6b7fe700 1 --2- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6c5402ff10 0x7f6c540323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:46.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.486+0000 7f6c6b7fe700 1 --2- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6c5402ff10 0x7f6c540323d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6c600096a0 tx=0x7f6c60006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:46.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.490+0000 7f6c68ff9700 1 -- 172.21.15.133:0/2261881208 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6c5c0126f0 con 0x7f6c6c0f6510 2024-02-15T18:19:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.705+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6c6c108210 con 0x7f6c6c0f6510 2024-02-15T18:19:46.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.706+0000 7f6c68ff9700 1 -- 172.21.15.133:0/2261881208 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f6c5c012330 con 0x7f6c6c0f6510 2024-02-15T18:19:46.705 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:46.705 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6c5402ff10 msgr2=0x7f6c540323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 --2- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6c5402ff10 0x7f6c540323d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6c600096a0 tx=0x7f6c60006b40).stop 2024-02-15T18:19:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 msgr2=0x7f6c6c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 --2- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 0x7f6c6c1067e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6c5c005010 tx=0x7f6c5c00b040).stop 2024-02-15T18:19:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 shutdown_connections 2024-02-15T18:19:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 --2- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6c5402ff10 0x7f6c540323d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 --2- 172.21.15.133:0/2261881208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c6c0f6510 0x7f6c6c1067e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 >> 172.21.15.133:0/2261881208 conn(0x7f6c6c0f1c70 msgr2=0x7f6c6c0f26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 shutdown_connections 2024-02-15T18:19:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:46.708+0000 7f6c7228e700 1 -- 172.21.15.133:0/2261881208 wait complete. 2024-02-15T18:19:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:48.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:46.353820+0000 mgr.smithi084.hjmnez (mgr.14162) 45 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:48.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:46.553136+0000 mon.smithi084 (mon.0) 144 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:48.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:46.706160+0000 mon.smithi084 (mon.0) 145 : audit [DBG] from='client.? 172.21.15.133:0/2261881208' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:19:48.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:46.833354+0000 mon.smithi084 (mon.0) 146 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:48.269 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:48.269 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.981+0000 7f50c72f1700 1 -- 172.21.15.133:0/1774973866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 msgr2=0x7f50c00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.981+0000 7f50c72f1700 1 --2- 172.21.15.133:0/1774973866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 0x7f50c00f6930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f50b0009fb0 tx=0x7f50b0009b30).stop 2024-02-15T18:19:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.981+0000 7f50c72f1700 1 -- 172.21.15.133:0/1774973866 shutdown_connections 2024-02-15T18:19:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.981+0000 7f50c72f1700 1 --2- 172.21.15.133:0/1774973866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 0x7f50c00f6930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.981+0000 7f50c72f1700 1 -- 172.21.15.133:0/1774973866 >> 172.21.15.133:0/1774973866 conn(0x7f50c00f1c70 msgr2=0x7f50c00f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.981+0000 7f50c72f1700 1 -- 172.21.15.133:0/1774973866 shutdown_connections 2024-02-15T18:19:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.981+0000 7f50c72f1700 1 -- 172.21.15.133:0/1774973866 wait complete. 2024-02-15T18:19:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.981+0000 7f50c72f1700 1 Processor -- start 2024-02-15T18:19:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.981+0000 7f50c72f1700 1 -- start start 2024-02-15T18:19:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50c72f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 0x7f50c01067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50c72f1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0106cd0 con 0x7f50c00f6510 2024-02-15T18:19:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50c508d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 0x7f50c01067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50c508d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 0x7f50c01067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:56086/0 (socket says 172.21.15.133:56086) 2024-02-15T18:19:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50c508d700 1 -- 172.21.15.133:0/3521610690 learned_addr learned my addr 172.21.15.133:0/3521610690 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50c508d700 1 -- 172.21.15.133:0/3521610690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0005040 con 0x7f50c00f6510 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50c508d700 1 --2- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 0x7f50c01067e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f50b0005010 tx=0x7f50b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50b5ffb700 1 -- 172.21.15.133:0/3521610690 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b0009320 con 0x7f50c00f6510 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50b5ffb700 1 -- 172.21.15.133:0/3521610690 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50b0013380 con 0x7f50c00f6510 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c0106ed0 con 0x7f50c00f6510 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.982+0000 7f50b5ffb700 1 -- 172.21.15.133:0/3521610690 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b0014e50 con 0x7f50c00f6510 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.983+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c0107360 con 0x7f50c00f6510 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.983+0000 7f50b5ffb700 1 -- 172.21.15.133:0/3521610690 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f50b00263a0 con 0x7f50c00f6510 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.983+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c0045ad0 con 0x7f50c00f6510 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.983+0000 7f50b5ffb700 1 --2- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f50ac02ff10 0x7f50ac0323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.983+0000 7f50b5ffb700 1 -- 172.21.15.133:0/3521610690 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f50b0041250 con 0x7f50c00f6510 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.984+0000 7f50c488c700 1 --2- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f50ac02ff10 0x7f50ac0323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.984+0000 7f50c488c700 1 --2- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f50ac02ff10 0x7f50ac0323d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f50bc0096a0 tx=0x7f50bc006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:49.988+0000 7f50b5ffb700 1 -- 172.21.15.133:0/3521610690 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f50b001ccf0 con 0x7f50c00f6510 2024-02-15T18:19:50.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:48.354186+0000 mgr.smithi084.hjmnez (mgr.14162) 46 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.193+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f50c01081b0 con 0x7f50c00f6510 2024-02-15T18:19:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.194+0000 7f50b5ffb700 1 -- 172.21.15.133:0/3521610690 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f50b001ccf0 con 0x7f50c00f6510 2024-02-15T18:19:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:50.195 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.195+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f50ac02ff10 msgr2=0x7f50ac0323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.195+0000 7f50c72f1700 1 --2- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f50ac02ff10 0x7f50ac0323d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f50bc0096a0 tx=0x7f50bc006b40).stop 2024-02-15T18:19:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.195+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 msgr2=0x7f50c01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.195+0000 7f50c72f1700 1 --2- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 0x7f50c01067e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f50b0005010 tx=0x7f50b000b040).stop 2024-02-15T18:19:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.195+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 shutdown_connections 2024-02-15T18:19:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.195+0000 7f50c72f1700 1 --2- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f50ac02ff10 0x7f50ac0323d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.195+0000 7f50c72f1700 1 --2- 172.21.15.133:0/3521610690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c00f6510 0x7f50c01067e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.195+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 >> 172.21.15.133:0/3521610690 conn(0x7f50c00f1c70 msgr2=0x7f50c00f26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.196+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 shutdown_connections 2024-02-15T18:19:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:50.196+0000 7f50c72f1700 1 -- 172.21.15.133:0/3521610690 wait complete. 2024-02-15T18:19:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:51.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:50.195355+0000 mon.smithi084 (mon.0) 147 : audit [DBG] from='client.? 172.21.15.133:0/3521610690' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:19:51.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:50.407244+0000 mon.smithi084 (mon.0) 148 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:51.943 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:51.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:50.354460+0000 mgr.smithi084.hjmnez (mgr.14162) 47 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:50.640524+0000 mon.smithi084 (mon.0) 149 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:50.641567+0000 mon.smithi084 (mon.0) 150 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:19:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:50.643133+0000 mon.smithi084 (mon.0) 151 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-15T18:19:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:50.643698+0000 mon.smithi084 (mon.0) 152 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:19:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:19:50.644162+0000 mgr.smithi084.hjmnez (mgr.14162) 48 : cephadm [INF] Deploying daemon crash.smithi133 on smithi133 2024-02-15T18:19:53.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.948+0000 7fab46f85700 1 -- 172.21.15.133:0/3330121854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 msgr2=0x7fab400f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.948+0000 7fab46f85700 1 --2- 172.21.15.133:0/3330121854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 0x7fab400f5830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fab34009fb0 tx=0x7fab34009b30).stop 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.948+0000 7fab46f85700 1 -- 172.21.15.133:0/3330121854 shutdown_connections 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.948+0000 7fab46f85700 1 --2- 172.21.15.133:0/3330121854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 0x7fab400f5830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.948+0000 7fab46f85700 1 -- 172.21.15.133:0/3330121854 >> 172.21.15.133:0/3330121854 conn(0x7fab400f0b70 msgr2=0x7fab400f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.948+0000 7fab46f85700 1 -- 172.21.15.133:0/3330121854 shutdown_connections 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.948+0000 7fab46f85700 1 -- 172.21.15.133:0/3330121854 wait complete. 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.948+0000 7fab46f85700 1 Processor -- start 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.948+0000 7fab46f85700 1 -- start start 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.949+0000 7fab46f85700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 0x7fab400fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.949+0000 7fab46f85700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab400fb960 con 0x7fab400f5410 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.949+0000 7fab44d21700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 0x7fab400fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.949+0000 7fab44d21700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 0x7fab400fd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:50864/0 (socket says 172.21.15.133:50864) 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.949+0000 7fab44d21700 1 -- 172.21.15.133:0/2375786001 learned_addr learned my addr 172.21.15.133:0/2375786001 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.949+0000 7fab44d21700 1 -- 172.21.15.133:0/2375786001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34005040 con 0x7fab400f5410 2024-02-15T18:19:53.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.949+0000 7fab44d21700 1 --2- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 0x7fab400fd4e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fab34005010 tx=0x7fab3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.949+0000 7fab3d7fa700 1 -- 172.21.15.133:0/2375786001 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab34009320 con 0x7fab400f5410 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.950+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab400fbb00 con 0x7fab400f5410 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.950+0000 7fab3d7fa700 1 -- 172.21.15.133:0/2375786001 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab34013380 con 0x7fab400f5410 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.950+0000 7fab3d7fa700 1 -- 172.21.15.133:0/2375786001 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab34014e50 con 0x7fab400f5410 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.950+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab400fbf90 con 0x7fab400f5410 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.950+0000 7fab3d7fa700 1 -- 172.21.15.133:0/2375786001 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fab340095f0 con 0x7fab400f5410 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.950+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab40059100 con 0x7fab400f5410 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.950+0000 7fab3d7fa700 1 --2- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fab3002ff10 0x7fab300323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.951+0000 7fab3d7fa700 1 -- 172.21.15.133:0/2375786001 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fab34040f10 con 0x7fab400f5410 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.951+0000 7fab3ffff700 1 --2- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fab3002ff10 0x7fab300323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.951+0000 7fab3ffff700 1 --2- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fab3002ff10 0x7fab300323d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fab2c0096a0 tx=0x7fab2c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:53.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:53.955+0000 7fab3d7fa700 1 -- 172.21.15.133:0/2375786001 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fab34014420 con 0x7fab400f5410 2024-02-15T18:19:54.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:52.354814+0000 mgr.smithi084.hjmnez (mgr.14162) 49 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:54.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.167+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fab400fafa0 con 0x7fab400f5410 2024-02-15T18:19:54.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.168+0000 7fab3d7fa700 1 -- 172.21.15.133:0/2375786001 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fab34010230 con 0x7fab400f5410 2024-02-15T18:19:54.168 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:54.168 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:54.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fab3002ff10 msgr2=0x7fab300323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:54.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 --2- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fab3002ff10 0x7fab300323d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fab2c0096a0 tx=0x7fab2c006b40).stop 2024-02-15T18:19:54.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 msgr2=0x7fab400fd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:54.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 --2- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 0x7fab400fd4e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fab34005010 tx=0x7fab3400b040).stop 2024-02-15T18:19:54.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 shutdown_connections 2024-02-15T18:19:54.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 --2- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fab3002ff10 0x7fab300323d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:54.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 --2- 172.21.15.133:0/2375786001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab400f5410 0x7fab400fd4e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:54.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 >> 172.21.15.133:0/2375786001 conn(0x7fab400f0b70 msgr2=0x7fab4005fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:54.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 shutdown_connections 2024-02-15T18:19:54.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:54.169+0000 7fab46f85700 1 -- 172.21.15.133:0/2375786001 wait complete. 2024-02-15T18:19:54.171 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:55.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:54.168813+0000 mon.smithi084 (mon.0) 153 : audit [DBG] from='client.? 172.21.15.133:0/2375786001' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:19:55.895 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:19:55.896 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:19:56.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:54.355095+0000 mgr.smithi084.hjmnez (mgr.14162) 50 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:56.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:55.099420+0000 mon.smithi084 (mon.0) 154 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:56.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:55.100901+0000 mon.smithi084 (mon.0) 155 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.nxzroj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:19:56.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:55.105550+0000 mon.smithi084 (mon.0) 156 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.nxzroj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-15T18:19:56.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:55.106356+0000 mon.smithi084 (mon.0) 157 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:19:56.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:55.107323+0000 mon.smithi084 (mon.0) 158 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:19:56.516 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:19:55.108170+0000 mgr.smithi084.hjmnez (mgr.14162) 51 : cephadm [INF] Deploying daemon mgr.smithi133.nxzroj on smithi133 2024-02-15T18:19:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.396+0000 7f0ce23d0700 1 -- 172.21.15.133:0/1183338291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 msgr2=0x7f0cdc069e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.396+0000 7f0ce23d0700 1 --2- 172.21.15.133:0/1183338291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 0x7f0cdc069e40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0ccc009fb0 tx=0x7f0ccc009b30).stop 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.396+0000 7f0ce23d0700 1 -- 172.21.15.133:0/1183338291 shutdown_connections 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.396+0000 7f0ce23d0700 1 --2- 172.21.15.133:0/1183338291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 0x7f0cdc069e40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.396+0000 7f0ce23d0700 1 -- 172.21.15.133:0/1183338291 >> 172.21.15.133:0/1183338291 conn(0x7f0cdc0f1c70 msgr2=0x7f0cdc0f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.396+0000 7f0ce23d0700 1 -- 172.21.15.133:0/1183338291 shutdown_connections 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.396+0000 7f0ce23d0700 1 -- 172.21.15.133:0/1183338291 wait complete. 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.397+0000 7f0ce23d0700 1 Processor -- start 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.397+0000 7f0ce23d0700 1 -- start start 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.397+0000 7f0ce23d0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 0x7f0cdc1089a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.397+0000 7f0ce23d0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc108e90 con 0x7f0cdc06b940 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.397+0000 7f0cdbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 0x7f0cdc1089a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.397+0000 7f0cdbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 0x7f0cdc1089a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.133:50892/0 (socket says 172.21.15.133:50892) 2024-02-15T18:19:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.397+0000 7f0cdbfff700 1 -- 172.21.15.133:0/221498033 learned_addr learned my addr 172.21.15.133:0/221498033 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.397+0000 7f0cdbfff700 1 -- 172.21.15.133:0/221498033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc005040 con 0x7f0cdc06b940 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.398+0000 7f0cdbfff700 1 --2- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 0x7f0cdc1089a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0ccc0089f0 tx=0x7f0ccc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.398+0000 7f0cd8ff9700 1 -- 172.21.15.133:0/221498033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ccc009320 con 0x7f0cdc06b940 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.398+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc109090 con 0x7f0cdc06b940 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.398+0000 7f0cd8ff9700 1 -- 172.21.15.133:0/221498033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ccc013380 con 0x7f0cdc06b940 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.398+0000 7f0cd8ff9700 1 -- 172.21.15.133:0/221498033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ccc014e20 con 0x7f0cdc06b940 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.398+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc109520 con 0x7f0cdc06b940 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.399+0000 7f0cd8ff9700 1 -- 172.21.15.133:0/221498033 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f0ccc0263a0 con 0x7f0cdc06b940 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.399+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc045ad0 con 0x7f0cdc06b940 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.399+0000 7f0cd8ff9700 1 --2- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0cc402ff10 0x7f0cc40323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.399+0000 7f0cd8ff9700 1 -- 172.21.15.133:0/221498033 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f0ccc040ff0 con 0x7f0cdc06b940 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.399+0000 7f0cdb7fe700 1 --2- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0cc402ff10 0x7f0cc40323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.399+0000 7f0cdb7fe700 1 --2- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0cc402ff10 0x7f0cc40323d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0cd00096a0 tx=0x7f0cd0006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:19:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.403+0000 7f0cd8ff9700 1 -- 172.21.15.133:0/221498033 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0ccc06d2b0 con 0x7f0cdc06b940 2024-02-15T18:19:58.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:56.355414+0000 mgr.smithi084.hjmnez (mgr.14162) 52 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:19:58.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:57.770520+0000 mon.smithi084 (mon.0) 159 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:19:58.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:57.771896+0000 mon.smithi084 (mon.0) 160 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:19:58.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:57.772721+0000 mon.smithi084 (mon.0) 161 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:19:58.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.660+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0cdc10a3d0 con 0x7f0cdc06b940 2024-02-15T18:19:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.661+0000 7f0cd8ff9700 1 -- 172.21.15.133:0/221498033 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f0ccc0126f0 con 0x7f0cdc06b940 2024-02-15T18:19:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:19:58.662 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":1,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:17:23.658771Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:19:58.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0cc402ff10 msgr2=0x7f0cc40323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:58.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 --2- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0cc402ff10 0x7f0cc40323d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0cd00096a0 tx=0x7f0cd0006b40).stop 2024-02-15T18:19:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 msgr2=0x7f0cdc1089a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:19:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 --2- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 0x7f0cdc1089a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0ccc0089f0 tx=0x7f0ccc00b040).stop 2024-02-15T18:19:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 shutdown_connections 2024-02-15T18:19:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 --2- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0cc402ff10 0x7f0cc40323d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 --2- 172.21.15.133:0/221498033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc06b940 0x7f0cdc1089a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:19:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 >> 172.21.15.133:0/221498033 conn(0x7f0cdc0f1c70 msgr2=0x7f0cdc0f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:19:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 shutdown_connections 2024-02-15T18:19:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:19:58.663+0000 7f0ce23d0700 1 -- 172.21.15.133:0/221498033 wait complete. 2024-02-15T18:19:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 1 2024-02-15T18:19:59.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:19:57.773411+0000 mgr.smithi084.hjmnez (mgr.14162) 53 : cephadm [INF] Deploying daemon mon.smithi133 on smithi133 2024-02-15T18:19:59.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:19:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:19:58.662193+0000 mon.smithi084 (mon.0) 162 : audit [DBG] from='client.? 172.21.15.133:0/221498033' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:20:00.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:19:58.355788+0000 mgr.smithi084.hjmnez (mgr.14162) 54 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:00.705 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:20:00.705 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:20:02.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:00.356034+0000 mgr.smithi084.hjmnez (mgr.14162) 55 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:03.085 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: debug 2024-02-15T18:20:02.785+0000 7fe78c217700 1 mon.smithi133@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2024-02-15T18:20:03.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:03 smithi133 bash[40842]: c65c0defe0dd05ae33944f9f6ffc11c4e821c489a7f30fa7de661ec933b2a544 2024-02-15T18:20:03.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:03 smithi133 systemd[1]: Started Ceph mon.smithi133 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:20:08.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:02.356316+0000 mgr.smithi084.hjmnez (mgr.14162) 56 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:08.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:02.793254+0000 mon.smithi084 (mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:20:08.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:02.793490+0000 mon.smithi084 (mon.0) 170 : cluster [INF] mon.smithi084 calling monitor election 2024-02-15T18:20:08.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:02.794673+0000 mon.smithi084 (mon.0) 171 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:03.789983+0000 mon.smithi084 (mon.0) 172 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:04.356651+0000 mgr.smithi084.hjmnez (mgr.14162) 57 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:04.790040+0000 mon.smithi084 (mon.0) 173 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:04.791260+0000 mon.smithi133 (mon.1) 1 : cluster [INF] mon.smithi133 calling monitor election 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:05.790106+0000 mon.smithi084 (mon.0) 174 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:06.357023+0000 mgr.smithi084.hjmnez (mgr.14162) 58 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:06.790354+0000 mon.smithi084 (mon.0) 175 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:07.790515+0000 mon.smithi084 (mon.0) 176 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:07.808150+0000 mon.smithi084 (mon.0) 177 : cluster [INF] mon.smithi084 is new leader, mons smithi084,smithi133 in quorum (ranks 0,1) 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:07.812496+0000 mon.smithi084 (mon.0) 178 : cluster [DBG] monmap e2: 2 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:07.812547+0000 mon.smithi084 (mon.0) 179 : cluster [DBG] fsmap 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:07.812578+0000 mon.smithi084 (mon.0) 180 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:07.812889+0000 mon.smithi084 (mon.0) 181 : cluster [DBG] mgrmap e17: smithi084.hjmnez(active, since 99s) 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:07.813295+0000 mon.smithi084 (mon.0) 182 : cluster [DBG] Standby manager daemon smithi133.nxzroj started 2024-02-15T18:20:08.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:07.816251+0000 mon.smithi084 (mon.0) 183 : cluster [INF] overall HEALTH_OK 2024-02-15T18:20:08.016 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:07.818327+0000 mon.smithi084 (mon.0) 184 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:08.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:02.356316+0000 mgr.smithi084.hjmnez (mgr.14162) 56 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:02.793254+0000 mon.smithi084 (mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:02.793490+0000 mon.smithi084 (mon.0) 170 : cluster [INF] mon.smithi084 calling monitor election 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:02.794673+0000 mon.smithi084 (mon.0) 171 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:03.789983+0000 mon.smithi084 (mon.0) 172 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:04.356651+0000 mgr.smithi084.hjmnez (mgr.14162) 57 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:04.790040+0000 mon.smithi084 (mon.0) 173 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:04.791260+0000 mon.smithi133 (mon.1) 1 : cluster [INF] mon.smithi133 calling monitor election 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:05.790106+0000 mon.smithi084 (mon.0) 174 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:06.357023+0000 mgr.smithi084.hjmnez (mgr.14162) 58 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:06.790354+0000 mon.smithi084 (mon.0) 175 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:07.790515+0000 mon.smithi084 (mon.0) 176 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:08.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:07.808150+0000 mon.smithi084 (mon.0) 177 : cluster [INF] mon.smithi084 is new leader, mons smithi084,smithi133 in quorum (ranks 0,1) 2024-02-15T18:20:08.148 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:07.812496+0000 mon.smithi084 (mon.0) 178 : cluster [DBG] monmap e2: 2 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} 2024-02-15T18:20:08.148 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:07.812547+0000 mon.smithi084 (mon.0) 179 : cluster [DBG] fsmap 2024-02-15T18:20:08.148 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:07.812578+0000 mon.smithi084 (mon.0) 180 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-15T18:20:08.148 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:07.812889+0000 mon.smithi084 (mon.0) 181 : cluster [DBG] mgrmap e17: smithi084.hjmnez(active, since 99s) 2024-02-15T18:20:08.148 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:07.813295+0000 mon.smithi084 (mon.0) 182 : cluster [DBG] Standby manager daemon smithi133.nxzroj started 2024-02-15T18:20:08.148 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:07.816251+0000 mon.smithi084 (mon.0) 183 : cluster [INF] overall HEALTH_OK 2024-02-15T18:20:08.148 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:07.818327+0000 mon.smithi084 (mon.0) 184 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:08.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.180+0000 7f7360eeb700 1 -- 172.21.15.133:0/3691070600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7344003250 msgr2=0x7f73440056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:08.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.180+0000 7f7360eeb700 1 --2- 172.21.15.133:0/3691070600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7344003250 0x7f73440056e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f735c0f61c0 tx=0x7f7350002040).stop 2024-02-15T18:20:08.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.181+0000 7f7360eeb700 1 -- 172.21.15.133:0/3691070600 shutdown_connections 2024-02-15T18:20:08.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.181+0000 7f7360eeb700 1 --2- 172.21.15.133:0/3691070600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7344003250 0x7f73440056e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:08.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.181+0000 7f7360eeb700 1 -- 172.21.15.133:0/3691070600 >> 172.21.15.133:0/3691070600 conn(0x7f735c0f0b70 msgr2=0x7f735c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:20:08.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.181+0000 7f7360eeb700 1 -- 172.21.15.133:0/3691070600 shutdown_connections 2024-02-15T18:20:08.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.181+0000 7f7360eeb700 1 -- 172.21.15.133:0/3691070600 wait complete. 2024-02-15T18:20:08.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f7360eeb700 1 Processor -- start 2024-02-15T18:20:08.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f7360eeb700 1 -- start start 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f7360eeb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 0x7f735c106760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f7360eeb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c106c50 0x7f735c107b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f7360eeb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1071b0 con 0x7f735c106c50 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f7360eeb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1072f0 con 0x7f7344003250 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f735a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 0x7f735c106760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f735a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 0x7f735c106760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48470/0 (socket says 172.21.15.133:48470) 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f735a59c700 1 -- 172.21.15.133:0/1387180092 learned_addr learned my addr 172.21.15.133:0/1387180092 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f735a59c700 1 -- 172.21.15.133:0/1387180092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 msgr2=0x7f735c106760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f735a59c700 1 -- 172.21.15.133:0/1387180092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 msgr2=0x7f735c106760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f735a59c700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 0x7f735c106760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.182+0000 7f735a59c700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 0x7f735c106760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f7359d9b700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c106c50 0x7f735c107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f7359d9b700 1 -- 172.21.15.133:0/1387180092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 msgr2=0x7f735c106760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f7359d9b700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 0x7f735c106760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f7359d9b700 1 -- 172.21.15.133:0/1387180092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7350005040 con 0x7f735c106c50 2024-02-15T18:20:08.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f7359d9b700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c106c50 0x7f735c107b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f734c009390 tx=0x7f734c006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:20:08.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f734affd700 1 -- 172.21.15.133:0/1387180092 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f734c0115e0 con 0x7f735c106c50 2024-02-15T18:20:08.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c108150 con 0x7f735c106c50 2024-02-15T18:20:08.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c108690 con 0x7f735c106c50 2024-02-15T18:20:08.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f734affd700 1 -- 172.21.15.133:0/1387180092 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f734c011c10 con 0x7f735c106c50 2024-02-15T18:20:08.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.183+0000 7f734affd700 1 -- 172.21.15.133:0/1387180092 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f734c01acb0 con 0x7f735c106c50 2024-02-15T18:20:08.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.184+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735c059100 con 0x7f735c106c50 2024-02-15T18:20:08.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.185+0000 7f734affd700 1 -- 172.21.15.133:0/1387180092 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f734c018030 con 0x7f735c106c50 2024-02-15T18:20:08.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.185+0000 7f734affd700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f733c05c3a0 0x7f733c05e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:08.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.185+0000 7f734affd700 1 -- 172.21.15.133:0/1387180092 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f734c074ba0 con 0x7f735c106c50 2024-02-15T18:20:08.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.185+0000 7f735a59c700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f733c05c3a0 0x7f733c05e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:08.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.186+0000 7f735a59c700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f733c05c3a0 0x7f733c05e860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7350004bc0 tx=0x7f7350002040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:20:08.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.190+0000 7f734affd700 1 -- 172.21.15.133:0/1387180092 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f734c0452b0 con 0x7f735c106c50 2024-02-15T18:20:08.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.437+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f735c0f8aa0 con 0x7f735c106c50 2024-02-15T18:20:08.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.438+0000 7f734affd700 1 -- 172.21.15.133:0/1387180092 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+968 (secure 0 0 0) 0x7f734c016030 con 0x7f735c106c50 2024-02-15T18:20:08.438 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-02-15T18:20:08.438 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":2,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:20:02.790143Z","created":"2024-02-15T18:17:23.658771Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi084","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi133","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:3300","nonce":0},{"type":"v1","addr":"172.21.15.133:6789","nonce":0}]},"addr":"172.21.15.133:6789/0","public_addr":"172.21.15.133:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-15T18:20:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f733c05c3a0 msgr2=0x7f733c05e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f733c05c3a0 0x7f733c05e860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7350004bc0 tx=0x7f7350002040).stop 2024-02-15T18:20:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c106c50 msgr2=0x7f735c107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c106c50 0x7f735c107b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f734c009390 tx=0x7f734c006e20).stop 2024-02-15T18:20:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 shutdown_connections 2024-02-15T18:20:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f733c05c3a0 0x7f733c05e860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7344003250 0x7f735c106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 --2- 172.21.15.133:0/1387180092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c106c50 0x7f735c107b40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:08.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 >> 172.21.15.133:0/1387180092 conn(0x7f735c0f0b70 msgr2=0x7f735c0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:20:08.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 shutdown_connections 2024-02-15T18:20:08.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:20:08.439+0000 7f7360eeb700 1 -- 172.21.15.133:0/1387180092 wait complete. 2024-02-15T18:20:08.441 INFO:teuthology.orchestra.run.smithi133.stderr:dumped monmap epoch 2 2024-02-15T18:20:09.026 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:07.819379+0000 mgr.smithi084.hjmnez (mgr.14162) 59 : cephadm [INF] Deploying daemon node-exporter.smithi133 on smithi133 2024-02-15T18:20:09.026 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:07.869465+0000 mon.smithi084 (mon.0) 185 : cluster [DBG] mgrmap e18: smithi084.hjmnez(active, since 99s), standbys: smithi133.nxzroj 2024-02-15T18:20:09.026 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:07.869901+0000 mon.smithi084 (mon.0) 186 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi133.nxzroj", "id": "smithi133.nxzroj"}]: dispatch 2024-02-15T18:20:09.026 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:08.439015+0000 mon.smithi084 (mon.0) 187 : audit [DBG] from='client.? 172.21.15.133:0/1387180092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:20:09.026 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:08.790412+0000 mon.smithi084 (mon.0) 188 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:09.047 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-15T18:20:09.048 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph config generate-minimal-conf 2024-02-15T18:20:09.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:07.819379+0000 mgr.smithi084.hjmnez (mgr.14162) 59 : cephadm [INF] Deploying daemon node-exporter.smithi133 on smithi133 2024-02-15T18:20:09.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:07.869465+0000 mon.smithi084 (mon.0) 185 : cluster [DBG] mgrmap e18: smithi084.hjmnez(active, since 99s), standbys: smithi133.nxzroj 2024-02-15T18:20:09.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:07.869901+0000 mon.smithi084 (mon.0) 186 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi133.nxzroj", "id": "smithi133.nxzroj"}]: dispatch 2024-02-15T18:20:09.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:08.439015+0000 mon.smithi084 (mon.0) 187 : audit [DBG] from='client.? 172.21.15.133:0/1387180092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:20:09.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:08.790412+0000 mon.smithi084 (mon.0) 188 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:20:10.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:08.357293+0000 mgr.smithi084.hjmnez (mgr.14162) 60 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:10.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:08.357293+0000 mgr.smithi084.hjmnez (mgr.14162) 60 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.829+0000 7f594b2d1700 1 -- 172.21.15.84:0/1322350108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59440f5410 msgr2=0x7f59440f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.829+0000 7f594b2d1700 1 --2- 172.21.15.84:0/1322350108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59440f5410 0x7f59440f5830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5934009fb0 tx=0x7f5934009b30).stop 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.829+0000 7f594b2d1700 1 -- 172.21.15.84:0/1322350108 shutdown_connections 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.829+0000 7f594b2d1700 1 --2- 172.21.15.84:0/1322350108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59440f5410 0x7f59440f5830 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.829+0000 7f594b2d1700 1 -- 172.21.15.84:0/1322350108 >> 172.21.15.84:0/1322350108 conn(0x7f59440f0b70 msgr2=0x7f59440f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.829+0000 7f594b2d1700 1 -- 172.21.15.84:0/1322350108 shutdown_connections 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.829+0000 7f594b2d1700 1 -- 172.21.15.84:0/1322350108 wait complete. 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594b2d1700 1 Processor -- start 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594b2d1700 1 -- start start 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594b2d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59440f5410 0x7f59441068d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594b2d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5944106dc0 0x7f5944107cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594b2d1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944107320 con 0x7f5944106dc0 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594b2d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944107460 con 0x7f59440f5410 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594886c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5944106dc0 0x7f5944107cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594886c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5944106dc0 0x7f5944107cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56166/0 (socket says 172.21.15.84:56166) 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594886c700 1 -- 172.21.15.84:0/2310471550 learned_addr learned my addr 172.21.15.84:0/2310471550 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594906d700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59440f5410 0x7f59441068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594886c700 1 -- 172.21.15.84:0/2310471550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59440f5410 msgr2=0x7f59441068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594886c700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59440f5410 0x7f59441068d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594886c700 1 -- 172.21.15.84:0/2310471550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5934005040 con 0x7f5944106dc0 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.830+0000 7f594906d700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59440f5410 0x7f59441068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.831+0000 7f594886c700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5944106dc0 0x7f5944107cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f59400093c0 tx=0x7f5940006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.831+0000 7f5939ffb700 1 -- 172.21.15.84:0/2310471550 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f594000e650 con 0x7f5944106dc0 2024-02-15T18:20:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.831+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59441082c0 con 0x7f5944106dc0 2024-02-15T18:20:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.831+0000 7f5939ffb700 1 -- 172.21.15.84:0/2310471550 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5940009e70 con 0x7f5944106dc0 2024-02-15T18:20:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.831+0000 7f5939ffb700 1 -- 172.21.15.84:0/2310471550 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5940011ce0 con 0x7f5944106dc0 2024-02-15T18:20:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.831+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5944108880 con 0x7f5944106dc0 2024-02-15T18:20:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.832+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5944059100 con 0x7f5944106dc0 2024-02-15T18:20:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.832+0000 7f5939ffb700 1 -- 172.21.15.84:0/2310471550 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5940018030 con 0x7f5944106dc0 2024-02-15T18:20:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.832+0000 7f5939ffb700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f593005c3b0 0x7f593005e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.832+0000 7f5939ffb700 1 -- 172.21.15.84:0/2310471550 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f59400749a0 con 0x7f5944106dc0 2024-02-15T18:20:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.833+0000 7f594906d700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f593005c3b0 0x7f593005e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.833+0000 7f594906d700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f593005c3b0 0x7f593005e870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f59340043d0 tx=0x7f593400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:20:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.836+0000 7f5939ffb700 1 -- 172.21.15.84:0/2310471550 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f59400452b0 con 0x7f5944106dc0 2024-02-15T18:20:10.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.987+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5944045ad0 con 0x7f5944106dc0 2024-02-15T18:20:10.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.988+0000 7f5939ffb700 1 -- 172.21.15.84:0/2310471550 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v12) v1 ==== 76+0+225 (secure 0 0 0) 0x7f5944045ad0 con 0x7f5944106dc0 2024-02-15T18:20:10.988 INFO:teuthology.orchestra.run.smithi084.stdout:# minimal ceph.conf for 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:20:10.988 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-02-15T18:20:10.988 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:20:10.988 INFO:teuthology.orchestra.run.smithi084.stdout: mon_host = [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-02-15T18:20:10.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f593005c3b0 msgr2=0x7f593005e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f593005c3b0 0x7f593005e870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f59340043d0 tx=0x7f593400b040).stop 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5944106dc0 msgr2=0x7f5944107cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5944106dc0 0x7f5944107cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f59400093c0 tx=0x7f5940006ee0).stop 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 shutdown_connections 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f593005c3b0 0x7f593005e870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59440f5410 0x7f59441068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 --2- 172.21.15.84:0/2310471550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5944106dc0 0x7f5944107cb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 >> 172.21.15.84:0/2310471550 conn(0x7f59440f0b70 msgr2=0x7f59440f15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.989+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 shutdown_connections 2024-02-15T18:20:10.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:10.990+0000 7f594b2d1700 1 -- 172.21.15.84:0/2310471550 wait complete. 2024-02-15T18:20:11.979 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-15T18:20:11.979 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:20:11.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2024-02-15T18:20:12.012 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:20:12.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T18:20:12.082 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:20:12.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.conf 2024-02-15T18:20:12.120 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:20:12.121 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T18:20:12.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:10.357546+0000 mgr.smithi084.hjmnez (mgr.14162) 61 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:12.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:10.988896+0000 mon.smithi084 (mon.0) 189 : audit [DBG] from='client.? 172.21.15.84:0/2310471550' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:12.175 INFO:tasks.cephadm:Deploying OSDs... 2024-02-15T18:20:12.176 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:20:12.176 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T18:20:12.195 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T18:20:12.195 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-02-15T18:20:12.253 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T18:20:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:20:12.254 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 167289 Links: 1 2024-02-15T18:20:12.254 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:20:12.254 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:20:12.254 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-02-15 18:19:41.098254065 +0000 2024-02-15T18:20:12.254 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-02-15 18:08:32.291850891 +0000 2024-02-15T18:20:12.254 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-02-15 18:08:32.291850891 +0000 2024-02-15T18:20:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-02-15T18:20:12.254 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T18:20:12.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:10.357546+0000 mgr.smithi084.hjmnez (mgr.14162) 61 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:12.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:10.988896+0000 mon.smithi084 (mon.0) 189 : audit [DBG] from='client.? 172.21.15.84:0/2310471550' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-02-15T18:20:12.290 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-02-15T18:20:12.290 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000198474 s, 2.6 MB/s 2024-02-15T18:20:12.291 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T18:20:12.351 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-02-15T18:20:12.409 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T18:20:12.409 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:20:12.409 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 167376 Links: 1 2024-02-15T18:20:12.409 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:20:12.409 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:20:12.410 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-02-15 18:19:41.098254065 +0000 2024-02-15T18:20:12.410 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-02-15 18:08:32.632844799 +0000 2024-02-15T18:20:12.410 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-02-15 18:08:32.632844799 +0000 2024-02-15T18:20:12.410 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-02-15T18:20:12.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T18:20:12.476 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-02-15T18:20:12.476 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-02-15T18:20:12.476 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000215133 s, 2.4 MB/s 2024-02-15T18:20:12.477 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T18:20:12.536 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-02-15T18:20:12.595 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T18:20:12.595 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:20:12.595 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 167438 Links: 1 2024-02-15T18:20:12.595 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:20:12.595 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:20:12.595 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-02-15 18:19:41.098254065 +0000 2024-02-15T18:20:12.595 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-02-15 18:08:32.978838617 +0000 2024-02-15T18:20:12.596 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-02-15 18:08:32.978838617 +0000 2024-02-15T18:20:12.596 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-02-15T18:20:12.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T18:20:12.660 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-02-15T18:20:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-02-15T18:20:12.661 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000177472 s, 2.9 MB/s 2024-02-15T18:20:12.662 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T18:20:12.721 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-02-15T18:20:12.779 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T18:20:12.779 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:20:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 162531 Links: 1 2024-02-15T18:20:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:20:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:20:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-02-15 18:19:41.098254065 +0000 2024-02-15T18:20:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-02-15 18:08:33.327832382 +0000 2024-02-15T18:20:12.780 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-02-15 18:08:33.327832382 +0000 2024-02-15T18:20:12.780 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-02-15T18:20:12.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T18:20:12.845 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-02-15T18:20:12.845 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-02-15T18:20:12.845 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000225366 s, 2.3 MB/s 2024-02-15T18:20:12.846 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T18:20:12.905 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:20:12.905 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T18:20:12.928 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T18:20:12.928 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-02-15T18:20:12.989 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T18:20:12.989 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:20:12.989 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 168206 Links: 1 2024-02-15T18:20:12.989 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:20:12.989 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:20:12.990 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 18:20:08.250585441 +0000 2024-02-15T18:20:12.990 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 18:06:54.909678541 +0000 2024-02-15T18:20:12.990 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 18:06:54.909678541 +0000 2024-02-15T18:20:12.990 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-02-15T18:20:12.990 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T18:20:13.058 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T18:20:13.058 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T18:20:13.058 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000267587 s, 1.9 MB/s 2024-02-15T18:20:13.059 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T18:20:13.120 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-02-15T18:20:13.180 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T18:20:13.180 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:20:13.180 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 162422 Links: 1 2024-02-15T18:20:13.180 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:20:13.180 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:20:13.180 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 18:20:08.250585441 +0000 2024-02-15T18:20:13.180 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 18:06:55.248671838 +0000 2024-02-15T18:20:13.180 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 18:06:55.248671838 +0000 2024-02-15T18:20:13.180 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-02-15T18:20:13.180 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T18:20:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T18:20:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T18:20:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.00022215 s, 2.3 MB/s 2024-02-15T18:20:13.249 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T18:20:13.309 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-02-15T18:20:13.367 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T18:20:13.367 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:20:13.368 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 166369 Links: 1 2024-02-15T18:20:13.368 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:20:13.368 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:20:13.368 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 18:20:08.250585441 +0000 2024-02-15T18:20:13.368 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 18:06:55.592665035 +0000 2024-02-15T18:20:13.368 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 18:06:55.592665035 +0000 2024-02-15T18:20:13.368 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-02-15T18:20:13.368 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T18:20:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T18:20:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T18:20:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000204587 s, 2.5 MB/s 2024-02-15T18:20:13.436 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T18:20:13.495 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-02-15T18:20:13.553 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T18:20:13.553 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:20:13.553 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 162506 Links: 1 2024-02-15T18:20:13.553 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:20:13.553 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:20:13.553 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-02-15 18:20:08.250585441 +0000 2024-02-15T18:20:13.553 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 18:06:55.928658391 +0000 2024-02-15T18:20:13.553 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 18:06:55.928658391 +0000 2024-02-15T18:20:13.553 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-02-15T18:20:13.554 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T18:20:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-02-15T18:20:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-02-15T18:20:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000207171 s, 2.5 MB/s 2024-02-15T18:20:13.620 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T18:20:13.679 INFO:tasks.cephadm:Deploying osd.0 on smithi084 with /dev/vg_nvme/lv_4... 2024-02-15T18:20:13.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-15T18:20:14.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:12.357855+0000 mgr.smithi084.hjmnez (mgr.14162) 62 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:12.357855+0000 mgr.smithi084.hjmnez (mgr.14162) 62 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:15.742 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-15T18:20:15.743 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-15T18:20:15.743 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-02-15T18:20:15.743 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-02-15T18:20:15.743 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110447 s, 949 MB/s 2024-02-15T18:20:15.743 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-02-15T18:20:16.079 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:14.358079+0000 mgr.smithi084.hjmnez (mgr.14162) 63 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:16.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:14.358079+0000 mgr.smithi084.hjmnez (mgr.14162) 63 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:16.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2024-02-15T18:20:18.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:16.358341+0000 mgr.smithi084.hjmnez (mgr.14162) 64 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:18.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:17.262763+0000 mon.smithi084 (mon.0) 190 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:18.411 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:17.263456+0000 mon.smithi084 (mon.0) 191 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:20:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.515+0000 7fc669941700 1 -- 172.21.15.84:0/3900513588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f66e0 msgr2=0x7fc6640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.515+0000 7fc669941700 1 --2- 172.21.15.84:0/3900513588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f66e0 0x7fc6640f6b00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc658004660 tx=0x7fc658009b30).stop 2024-02-15T18:20:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.515+0000 7fc669941700 1 -- 172.21.15.84:0/3900513588 shutdown_connections 2024-02-15T18:20:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.515+0000 7fc669941700 1 --2- 172.21.15.84:0/3900513588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640f7980 0x7fc6640f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.515+0000 7fc669941700 1 --2- 172.21.15.84:0/3900513588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f66e0 0x7fc6640f6b00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:18.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.515+0000 7fc669941700 1 -- 172.21.15.84:0/3900513588 >> 172.21.15.84:0/3900513588 conn(0x7fc6640f1e40 msgr2=0x7fc6640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.515+0000 7fc669941700 1 -- 172.21.15.84:0/3900513588 shutdown_connections 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.515+0000 7fc669941700 1 -- 172.21.15.84:0/3900513588 wait complete. 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc669941700 1 Processor -- start 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc669941700 1 -- start start 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc669941700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640f66e0 0x7fc6641070a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc669941700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f7980 0x7fc664107590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc669941700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664107b40 con 0x7fc6640f7980 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc669941700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664107c80 con 0x7fc6640f66e0 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc6627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f7980 0x7fc664107590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc6627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f7980 0x7fc664107590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39486/0 (socket says 172.21.15.84:39486) 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc6627fc700 1 -- 172.21.15.84:0/113312538 learned_addr learned my addr 172.21.15.84:0/113312538 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc662ffd700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640f66e0 0x7fc6641070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:18.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc6627fc700 1 -- 172.21.15.84:0/113312538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640f66e0 msgr2=0x7fc6641070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc6627fc700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640f66e0 0x7fc6641070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc6627fc700 1 -- 172.21.15.84:0/113312538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc658005040 con 0x7fc6640f7980 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc6627fc700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f7980 0x7fc664107590 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc6540026d0 tx=0x7fc654009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc64b7fe700 1 -- 172.21.15.84:0/113312538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6540079c0 con 0x7fc6640f7980 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc64b7fe700 1 -- 172.21.15.84:0/113312538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc65400f040 con 0x7fc6640f7980 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc664108620 con 0x7fc6640f7980 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc64b7fe700 1 -- 172.21.15.84:0/113312538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc654014980 con 0x7fc6640f7980 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.516+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc664108be0 con 0x7fc6640f7980 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.517+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc664045ad0 con 0x7fc6640f7980 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.518+0000 7fc64b7fe700 1 -- 172.21.15.84:0/113312538 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc6540090d0 con 0x7fc6640f7980 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.518+0000 7fc64b7fe700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc64c05c2b0 0x7fc64c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.518+0000 7fc64b7fe700 1 -- 172.21.15.84:0/113312538 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fc654074df0 con 0x7fc6640f7980 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.518+0000 7fc662ffd700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc64c05c2b0 0x7fc64c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:18.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.518+0000 7fc662ffd700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc64c05c2b0 0x7fc64c05e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc658004630 tx=0x7fc658009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:20:18.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.522+0000 7fc64b7fe700 1 -- 172.21.15.84:0/113312538 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc654048b40 con 0x7fc6640f7980 2024-02-15T18:20:18.631 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:16.358341+0000 mgr.smithi084.hjmnez (mgr.14162) 64 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:18.631 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:17.262763+0000 mon.smithi084 (mon.0) 190 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:18.632 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:17.263456+0000 mon.smithi084 (mon.0) 191 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:20:18.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:18.699+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc664108eb0 con 0x7fc64c05c2b0 2024-02-15T18:20:19.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:18.701990+0000 mon.smithi084 (mon.0) 192 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:20:19.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:18.703381+0000 mon.smithi084 (mon.0) 193 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:20:19.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:18.703896+0000 mon.smithi084 (mon.0) 194 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:19.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:18.701990+0000 mon.smithi084 (mon.0) 192 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:20:19.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:18.703381+0000 mon.smithi084 (mon.0) 193 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:20:19.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:18.703896+0000 mon.smithi084 (mon.0) 194 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:20.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:18.358576+0000 mgr.smithi084.hjmnez (mgr.14162) 65 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:20.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:18.701248+0000 mgr.smithi084.hjmnez (mgr.14162) 66 : audit [DBG] from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:20:20.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:18.703169+0000 mgr.smithi084.hjmnez (mgr.14162) 67 : cephadm [INF] Applying service osd.None on host smithi084... 2024-02-15T18:20:20.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:19.299628+0000 mon.smithi084 (mon.0) 195 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:20.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:18.358576+0000 mgr.smithi084.hjmnez (mgr.14162) 65 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:20.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:18.701248+0000 mgr.smithi084.hjmnez (mgr.14162) 66 : audit [DBG] from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:20:20.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:18.703169+0000 mgr.smithi084.hjmnez (mgr.14162) 67 : cephadm [INF] Applying service osd.None on host smithi084... 2024-02-15T18:20:20.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:19.299628+0000 mon.smithi084 (mon.0) 195 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:22.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:20.358858+0000 mgr.smithi084.hjmnez (mgr.14162) 68 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:22.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:21.959102+0000 mon.smithi084 (mon.0) 196 : audit [INF] from='client.? 172.21.15.84:0/2237871457' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ce13286-2da9-4b1e-9121-b14ba88e414c"}]: dispatch 2024-02-15T18:20:22.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:21.967240+0000 mon.smithi084 (mon.0) 197 : audit [INF] from='client.? 172.21.15.84:0/2237871457' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ce13286-2da9-4b1e-9121-b14ba88e414c"}]': finished 2024-02-15T18:20:22.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:21.967299+0000 mon.smithi084 (mon.0) 198 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-15T18:20:22.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:21.967415+0000 mon.smithi084 (mon.0) 199 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:22.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:20.358858+0000 mgr.smithi084.hjmnez (mgr.14162) 68 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:22.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:21.959102+0000 mon.smithi084 (mon.0) 196 : audit [INF] from='client.? 172.21.15.84:0/2237871457' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ce13286-2da9-4b1e-9121-b14ba88e414c"}]: dispatch 2024-02-15T18:20:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:21.967240+0000 mon.smithi084 (mon.0) 197 : audit [INF] from='client.? 172.21.15.84:0/2237871457' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ce13286-2da9-4b1e-9121-b14ba88e414c"}]': finished 2024-02-15T18:20:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:21.967299+0000 mon.smithi084 (mon.0) 198 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-15T18:20:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:21.967415+0000 mon.smithi084 (mon.0) 199 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:23.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:22.399700+0000 mon.smithi084 (mon.0) 200 : audit [DBG] from='client.? 172.21.15.84:0/3979616764' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:20:23.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:22.399700+0000 mon.smithi084 (mon.0) 200 : audit [DBG] from='client.? 172.21.15.84:0/3979616764' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:20:24.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:22.359087+0000 mgr.smithi084.hjmnez (mgr.14162) 69 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:24.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:23.455833+0000 mon.smithi084 (mon.0) 201 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:24.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:23.462658+0000 mon.smithi084 (mon.0) 202 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:24.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:23.464359+0000 mon.smithi084 (mon.0) 203 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:20:24.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:23.464859+0000 mon.smithi084 (mon.0) 204 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:20:24.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:23.465300+0000 mon.smithi084 (mon.0) 205 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:24.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:22.359087+0000 mgr.smithi084.hjmnez (mgr.14162) 69 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:24.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:23.455833+0000 mon.smithi084 (mon.0) 201 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:24.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:23.462658+0000 mon.smithi084 (mon.0) 202 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:24.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:23.464359+0000 mon.smithi084 (mon.0) 203 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:20:24.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:23.464859+0000 mon.smithi084 (mon.0) 204 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:20:24.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:23.465300+0000 mon.smithi084 (mon.0) 205 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:25.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:23.464159+0000 mgr.smithi084.hjmnez (mgr.14162) 70 : cephadm [INF] Reconfiguring mon.smithi084 (unknown last config time)... 2024-02-15T18:20:25.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:23.465679+0000 mgr.smithi084.hjmnez (mgr.14162) 71 : cephadm [INF] Reconfiguring daemon mon.smithi084 on smithi084 2024-02-15T18:20:25.674 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:23.464159+0000 mgr.smithi084.hjmnez (mgr.14162) 70 : cephadm [INF] Reconfiguring mon.smithi084 (unknown last config time)... 2024-02-15T18:20:25.674 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:23.465679+0000 mgr.smithi084.hjmnez (mgr.14162) 71 : cephadm [INF] Reconfiguring daemon mon.smithi084 on smithi084 2024-02-15T18:20:26.638 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:24.359436+0000 mgr.smithi084.hjmnez (mgr.14162) 72 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:26.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:24.359436+0000 mgr.smithi084.hjmnez (mgr.14162) 72 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:28.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:26.359848+0000 mgr.smithi084.hjmnez (mgr.14162) 73 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:28.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:27.846548+0000 mon.smithi084 (mon.0) 206 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:28.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:27.847205+0000 mon.smithi084 (mon.0) 207 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.hjmnez", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:20:28.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:27.847863+0000 mon.smithi084 (mon.0) 208 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:20:28.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:27.848333+0000 mon.smithi084 (mon.0) 209 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:28.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:26.359848+0000 mgr.smithi084.hjmnez (mgr.14162) 73 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:28.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:27.846548+0000 mon.smithi084 (mon.0) 206 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:28.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:27.847205+0000 mon.smithi084 (mon.0) 207 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.hjmnez", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:20:28.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:27.847863+0000 mon.smithi084 (mon.0) 208 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:20:28.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:27.848333+0000 mon.smithi084 (mon.0) 209 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:29.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:27.846986+0000 mgr.smithi084.hjmnez (mgr.14162) 74 : cephadm [INF] Reconfiguring mgr.smithi084.hjmnez (unknown last config time)... 2024-02-15T18:20:29.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:27.848724+0000 mgr.smithi084.hjmnez (mgr.14162) 75 : cephadm [INF] Reconfiguring daemon mgr.smithi084.hjmnez on smithi084 2024-02-15T18:20:29.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:28.475018+0000 mon.smithi084 (mon.0) 210 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:20:29.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:28.476086+0000 mon.smithi084 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:20:29.696 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:27.846986+0000 mgr.smithi084.hjmnez (mgr.14162) 74 : cephadm [INF] Reconfiguring mgr.smithi084.hjmnez (unknown last config time)... 2024-02-15T18:20:29.696 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:27.848724+0000 mgr.smithi084.hjmnez (mgr.14162) 75 : cephadm [INF] Reconfiguring daemon mgr.smithi084.hjmnez on smithi084 2024-02-15T18:20:29.697 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:28.475018+0000 mon.smithi084 (mon.0) 210 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:20:29.697 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:28.476086+0000 mon.smithi084 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:20:30.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:28.360241+0000 mgr.smithi084.hjmnez (mgr.14162) 76 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:30.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:29.736074+0000 mon.smithi084 (mon.0) 212 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:30.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:28.360241+0000 mgr.smithi084.hjmnez (mgr.14162) 76 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:30.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:29.736074+0000 mon.smithi084 (mon.0) 212 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:31.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:29.736618+0000 mgr.smithi084.hjmnez (mgr.14162) 77 : cephadm [INF] Reconfiguring alertmanager.smithi084 (dependencies changed)... 2024-02-15T18:20:31.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:29.738529+0000 mgr.smithi084.hjmnez (mgr.14162) 78 : cephadm [INF] Reconfiguring daemon alertmanager.smithi084 on smithi084 2024-02-15T18:20:31.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:31.243598+0000 mon.smithi084 (mon.0) 213 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T18:20:31.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:31.244271+0000 mon.smithi084 (mon.0) 214 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:31.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:29.736618+0000 mgr.smithi084.hjmnez (mgr.14162) 77 : cephadm [INF] Reconfiguring alertmanager.smithi084 (dependencies changed)... 2024-02-15T18:20:31.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:29.738529+0000 mgr.smithi084.hjmnez (mgr.14162) 78 : cephadm [INF] Reconfiguring daemon alertmanager.smithi084 on smithi084 2024-02-15T18:20:31.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:31.243598+0000 mon.smithi084 (mon.0) 213 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T18:20:31.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:31.244271+0000 mon.smithi084 (mon.0) 214 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:32.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:30.360520+0000 mgr.smithi084.hjmnez (mgr.14162) 79 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:32.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:31.244835+0000 mgr.smithi084.hjmnez (mgr.14162) 80 : cephadm [INF] Deploying daemon osd.0 on smithi084 2024-02-15T18:20:32.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:30.360520+0000 mgr.smithi084.hjmnez (mgr.14162) 79 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:32.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:31.244835+0000 mgr.smithi084.hjmnez (mgr.14162) 80 : cephadm [INF] Deploying daemon osd.0 on smithi084 2024-02-15T18:20:34.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:32.360885+0000 mgr.smithi084.hjmnez (mgr.14162) 81 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:34.664 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:32.360885+0000 mgr.smithi084.hjmnez (mgr.14162) 81 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:36.620 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:34.361247+0000 mgr.smithi084.hjmnez (mgr.14162) 82 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:36.620 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:36.303977+0000 mon.smithi084 (mon.0) 215 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:36.620 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:36.304789+0000 mon.smithi084 (mon.0) 216 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:20:36.620 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:36.305438+0000 mon.smithi084 (mon.0) 217 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:36.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:34.361247+0000 mgr.smithi084.hjmnez (mgr.14162) 82 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:36.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:36.303977+0000 mon.smithi084 (mon.0) 215 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:36.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:36.304789+0000 mon.smithi084 (mon.0) 216 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:20:36.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:36.305438+0000 mon.smithi084 (mon.0) 217 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:37.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:36.304537+0000 mgr.smithi084.hjmnez (mgr.14162) 83 : cephadm [INF] Reconfiguring crash.smithi084 (monmap changed)... 2024-02-15T18:20:37.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:36.305888+0000 mgr.smithi084.hjmnez (mgr.14162) 84 : cephadm [INF] Reconfiguring daemon crash.smithi084 on smithi084 2024-02-15T18:20:37.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:36.304537+0000 mgr.smithi084.hjmnez (mgr.14162) 83 : cephadm [INF] Reconfiguring crash.smithi084 (monmap changed)... 2024-02-15T18:20:37.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:36.305888+0000 mgr.smithi084.hjmnez (mgr.14162) 84 : cephadm [INF] Reconfiguring daemon crash.smithi084 on smithi084 2024-02-15T18:20:38.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:36.361481+0000 mgr.smithi084.hjmnez (mgr.14162) 85 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:38.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:36.361481+0000 mgr.smithi084.hjmnez (mgr.14162) 85 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:39.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.944+0000 7fc64b7fe700 1 -- 172.21.15.84:0/113312538 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc664108eb0 con 0x7fc64c05c2b0 2024-02-15T18:20:39.945 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 0 on host 'smithi084' 2024-02-15T18:20:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.947+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc64c05c2b0 msgr2=0x7fc64c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.947+0000 7fc669941700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc64c05c2b0 0x7fc64c05e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc658004630 tx=0x7fc658009b30).stop 2024-02-15T18:20:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.948+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f7980 msgr2=0x7fc664107590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.948+0000 7fc669941700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f7980 0x7fc664107590 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc6540026d0 tx=0x7fc654009de0).stop 2024-02-15T18:20:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.949+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 shutdown_connections 2024-02-15T18:20:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.949+0000 7fc669941700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc64c05c2b0 0x7fc64c05e770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.949+0000 7fc669941700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640f66e0 0x7fc6641070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.949+0000 7fc669941700 1 --2- 172.21.15.84:0/113312538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6640f7980 0x7fc664107590 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.949+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 >> 172.21.15.84:0/113312538 conn(0x7fc6640f1e40 msgr2=0x7fc6640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:20:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.949+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 shutdown_connections 2024-02-15T18:20:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:39.949+0000 7fc669941700 1 -- 172.21.15.84:0/113312538 wait complete. 2024-02-15T18:20:40.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:38.361816+0000 mgr.smithi084.hjmnez (mgr.14162) 86 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:40.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:39.939695+0000 mon.smithi084 (mon.0) 218 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:40.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:39.944430+0000 mon.smithi084 (mon.0) 219 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:40.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:38.361816+0000 mgr.smithi084.hjmnez (mgr.14162) 86 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:40.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:39.939695+0000 mon.smithi084 (mon.0) 218 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:40.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:39.944430+0000 mon.smithi084 (mon.0) 219 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:41.828 DEBUG:teuthology.orchestra.run.smithi084:osd.0> sudo journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.0.service 2024-02-15T18:20:41.831 INFO:tasks.cephadm:Deploying osd.1 on smithi084 with /dev/vg_nvme/lv_3... 2024-02-15T18:20:41.831 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-15T18:20:41.861 INFO:journalctl@ceph.osd.0.smithi084.stdout:-- Logs begin at Thu 2024-02-15 18:00:24 UTC. -- 2024-02-15T18:20:42.616 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:40.362081+0000 mgr.smithi084.hjmnez (mgr.14162) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:42.616 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:41.340792+0000 mon.smithi084 (mon.0) 220 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:42.616 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:41.341313+0000 mgr.smithi084.hjmnez (mgr.14162) 88 : cephadm [INF] Reconfiguring grafana.smithi084 (dependencies changed)... 2024-02-15T18:20:42.616 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:41.345418+0000 mgr.smithi084.hjmnez (mgr.14162) 89 : cephadm [INF] Reconfiguring daemon grafana.smithi084 on smithi084 2024-02-15T18:20:42.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:40.362081+0000 mgr.smithi084.hjmnez (mgr.14162) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:42.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:41.340792+0000 mon.smithi084 (mon.0) 220 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:42.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:41.341313+0000 mgr.smithi084.hjmnez (mgr.14162) 88 : cephadm [INF] Reconfiguring grafana.smithi084 (dependencies changed)... 2024-02-15T18:20:42.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:41.345418+0000 mgr.smithi084.hjmnez (mgr.14162) 89 : cephadm [INF] Reconfiguring daemon grafana.smithi084 on smithi084 2024-02-15T18:20:44.267 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:20:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.0[48569]: debug 2024-02-15T18:20:43.813+0000 7f04c4866080 -1 osd.0 0 log_to_monitors {default=true} 2024-02-15T18:20:44.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:42.362415+0000 mgr.smithi084.hjmnez (mgr.14162) 90 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:44.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:43.817133+0000 mon.smithi084 (mon.0) 221 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T18:20:44.646 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:42.362415+0000 mgr.smithi084.hjmnez (mgr.14162) 90 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:44.646 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:43.817133+0000 mon.smithi084 (mon.0) 221 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T18:20:45.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:44.346242+0000 mon.smithi084 (mon.0) 222 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T18:20:45.429 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:44.346286+0000 mon.smithi084 (mon.0) 223 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-15T18:20:45.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:44.346609+0000 mon.smithi084 (mon.0) 224 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:45.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:44.346879+0000 mon.smithi084 (mon.0) 225 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:20:45.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:45.347795+0000 mon.smithi084 (mon.0) 226 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-02-15T18:20:45.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:45.347886+0000 mon.smithi084 (mon.0) 227 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-02-15T18:20:45.430 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:45.348003+0000 mon.smithi084 (mon.0) 228 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:45.430 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:20:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.0[48569]: debug 2024-02-15T18:20:45.350+0000 7f04badd7700 -1 osd.0 0 waiting for initial osdmap 2024-02-15T18:20:45.430 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:20:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.0[48569]: debug 2024-02-15T18:20:45.357+0000 7f04b3d4c700 -1 osd.0 8 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-15T18:20:45.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:44.346242+0000 mon.smithi084 (mon.0) 222 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T18:20:45.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:44.346286+0000 mon.smithi084 (mon.0) 223 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-15T18:20:45.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:44.346609+0000 mon.smithi084 (mon.0) 224 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:45.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:44.346879+0000 mon.smithi084 (mon.0) 225 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:20:45.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:45.347795+0000 mon.smithi084 (mon.0) 226 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-02-15T18:20:45.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:45.347886+0000 mon.smithi084 (mon.0) 227 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-02-15T18:20:45.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:45.348003+0000 mon.smithi084 (mon.0) 228 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-15T18:20:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-15T18:20:46.339 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-02-15T18:20:46.339 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-02-15T18:20:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0134251 s, 781 MB/s 2024-02-15T18:20:46.340 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-02-15T18:20:46.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:44.362690+0000 mgr.smithi084.hjmnez (mgr.14162) 91 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:46.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:45.352344+0000 mon.smithi084 (mon.0) 229 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:46.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:46.350978+0000 mon.smithi084 (mon.0) 230 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:46.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:44.362690+0000 mgr.smithi084.hjmnez (mgr.14162) 91 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:46.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:45.352344+0000 mon.smithi084 (mon.0) 229 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:46.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:46.350978+0000 mon.smithi084 (mon.0) 230 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:46.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2024-02-15T18:20:47.563 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:44.780411+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:20:47.563 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:44.780621+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:20:47.564 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:46.360995+0000 mon.smithi084 (mon.0) 231 : cluster [INF] osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] boot 2024-02-15T18:20:47.564 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:46.361026+0000 mon.smithi084 (mon.0) 232 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-15T18:20:47.564 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:46.361987+0000 mon.smithi084 (mon.0) 233 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:47.564 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:46.362897+0000 mgr.smithi084.hjmnez (mgr.14162) 92 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:47.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:44.780411+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:20:47.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:44.780621+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:20:47.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:46.360995+0000 mon.smithi084 (mon.0) 231 : cluster [INF] osd.0 [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] boot 2024-02-15T18:20:47.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:46.361026+0000 mon.smithi084 (mon.0) 232 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-15T18:20:47.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:46.361987+0000 mon.smithi084 (mon.0) 233 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:20:47.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:46.362897+0000 mgr.smithi084.hjmnez (mgr.14162) 92 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:20:48.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:47.633356+0000 mon.smithi084 (mon.0) 234 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-15T18:20:48.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:47.843242+0000 mon.smithi084 (mon.0) 235 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:48.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:47.843818+0000 mgr.smithi084.hjmnez (mgr.14162) 93 : cephadm [INF] Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-02-15T18:20:48.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:47.845858+0000 mgr.smithi084.hjmnez (mgr.14162) 94 : cephadm [INF] Reconfiguring daemon prometheus.smithi084 on smithi084 2024-02-15T18:20:49.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:47.633356+0000 mon.smithi084 (mon.0) 234 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-15T18:20:49.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:47.843242+0000 mon.smithi084 (mon.0) 235 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:49.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:47.843818+0000 mgr.smithi084.hjmnez (mgr.14162) 93 : cephadm [INF] Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-02-15T18:20:49.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:47.845858+0000 mgr.smithi084.hjmnez (mgr.14162) 94 : cephadm [INF] Reconfiguring daemon prometheus.smithi084 on smithi084 2024-02-15T18:20:50.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:48.363150+0000 mgr.smithi084.hjmnez (mgr.14162) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:50.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:48.363150+0000 mgr.smithi084.hjmnez (mgr.14162) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:51.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.925+0000 7f06bd890700 1 -- 172.21.15.84:0/3022350920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f66e0 msgr2=0x7f06b80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:51.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.925+0000 7f06bd890700 1 --2- 172.21.15.84:0/3022350920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f66e0 0x7f06b80f6b00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f06ac004660 tx=0x7f06ac009b30).stop 2024-02-15T18:20:51.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.925+0000 7f06bd890700 1 -- 172.21.15.84:0/3022350920 shutdown_connections 2024-02-15T18:20:51.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.925+0000 7f06bd890700 1 --2- 172.21.15.84:0/3022350920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06b80f6ff0 0x7f06b80f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:20:51.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.925+0000 7f06bd890700 1 --2- 172.21.15.84:0/3022350920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f66e0 0x7f06b80f6b00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:51.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.925+0000 7f06bd890700 1 -- 172.21.15.84:0/3022350920 >> 172.21.15.84:0/3022350920 conn(0x7f06b80f1f00 msgr2=0x7f06b80f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:20:51.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.925+0000 7f06bd890700 1 -- 172.21.15.84:0/3022350920 shutdown_connections 2024-02-15T18:20:51.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.925+0000 7f06bd890700 1 -- 172.21.15.84:0/3022350920 wait complete. 2024-02-15T18:20:51.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06bd890700 1 Processor -- start 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06bd890700 1 -- start start 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06bd890700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06b80f66e0 0x7f06b8107080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06bd890700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f6ff0 0x7f06b8107570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06bd890700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8107bb0 con 0x7f06b80f6ff0 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06bd890700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8108460 con 0x7f06b80f66e0 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06b67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f6ff0 0x7f06b8107570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06b67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f6ff0 0x7f06b8107570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45410/0 (socket says 172.21.15.84:45410) 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06b67fc700 1 -- 172.21.15.84:0/1295727087 learned_addr learned my addr 172.21.15.84:0/1295727087 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06b6ffd700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06b80f66e0 0x7f06b8107080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06b67fc700 1 -- 172.21.15.84:0/1295727087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06b80f66e0 msgr2=0x7f06b8107080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06b67fc700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06b80f66e0 0x7f06b8107080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06b67fc700 1 -- 172.21.15.84:0/1295727087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac005040 con 0x7f06b80f6ff0 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.926+0000 7f06b67fc700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f6ff0 0x7f06b8107570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f06a800b410 tx=0x7f06a8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:20:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.927+0000 7f069f7fe700 1 -- 172.21.15.84:0/1295727087 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a80125f0 con 0x7f06b80f6ff0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.927+0000 7f069f7fe700 1 -- 172.21.15.84:0/1295727087 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06a8012c20 con 0x7f06b80f6ff0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.927+0000 7f069f7fe700 1 -- 172.21.15.84:0/1295727087 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a8002b30 con 0x7f06b80f6ff0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.927+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b8108740 con 0x7f06b80f6ff0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.927+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b8108d00 con 0x7f06b80f6ff0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.928+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b80f5b70 con 0x7f06b80f6ff0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.928+0000 7f069f7fe700 1 -- 172.21.15.84:0/1295727087 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f06a800f030 con 0x7f06b80f6ff0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.928+0000 7f069f7fe700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f06a005c2a0 0x7f06a005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.929+0000 7f069f7fe700 1 -- 172.21.15.84:0/1295727087 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1882+0+0 (secure 0 0 0) 0x7f06a80754c0 con 0x7f06b80f6ff0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.929+0000 7f06b6ffd700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f06a005c2a0 0x7f06a005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.929+0000 7f06b6ffd700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f06a005c2a0 0x7f06a005e760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f06ac009490 tx=0x7f06ac009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:20:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:50.933+0000 7f069f7fe700 1 -- 172.21.15.84:0/1295727087 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f06a8048fb0 con 0x7f06b80f6ff0 2024-02-15T18:20:51.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:20:51.112+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f06b80ff130 con 0x7f06a005c2a0 2024-02-15T18:20:52.116 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:50.363573+0000 mgr.smithi084.hjmnez (mgr.14162) 96 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:52.116 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:51.114152+0000 mgr.smithi084.hjmnez (mgr.14162) 97 : audit [DBG] from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:20:52.116 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:51.114888+0000 mon.smithi084 (mon.0) 236 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:20:52.116 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:51.115885+0000 mgr.smithi084.hjmnez (mgr.14162) 98 : cephadm [INF] Applying service osd.None on host smithi084... 2024-02-15T18:20:52.116 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:51.116081+0000 mon.smithi084 (mon.0) 237 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:20:52.116 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:51.116543+0000 mon.smithi084 (mon.0) 238 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:52.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:50.363573+0000 mgr.smithi084.hjmnez (mgr.14162) 96 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:52.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:51.114152+0000 mgr.smithi084.hjmnez (mgr.14162) 97 : audit [DBG] from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:20:52.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:51.114888+0000 mon.smithi084 (mon.0) 236 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:20:52.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:51.115885+0000 mgr.smithi084.hjmnez (mgr.14162) 98 : cephadm [INF] Applying service osd.None on host smithi084... 2024-02-15T18:20:52.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:51.116081+0000 mon.smithi084 (mon.0) 237 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:20:52.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:51.116543+0000 mon.smithi084 (mon.0) 238 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:53.975 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:52.363935+0000 mgr.smithi084.hjmnez (mgr.14162) 99 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:54.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:52.363935+0000 mgr.smithi084.hjmnez (mgr.14162) 99 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:55.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:54.282019+0000 mon.smithi084 (mon.0) 239 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:55.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:54.282528+0000 mgr.smithi084.hjmnez (mgr.14162) 100 : cephadm [INF] Reconfiguring crash.smithi133 (monmap changed)... 2024-02-15T18:20:55.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:54.282817+0000 mon.smithi084 (mon.0) 240 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:20:55.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:54.283442+0000 mon.smithi084 (mon.0) 241 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:55.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:54.283894+0000 mgr.smithi084.hjmnez (mgr.14162) 101 : cephadm [INF] Reconfiguring daemon crash.smithi133 on smithi133 2024-02-15T18:20:55.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:54.282019+0000 mon.smithi084 (mon.0) 239 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:55.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:54.282528+0000 mgr.smithi084.hjmnez (mgr.14162) 100 : cephadm [INF] Reconfiguring crash.smithi133 (monmap changed)... 2024-02-15T18:20:55.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:54.282817+0000 mon.smithi084 (mon.0) 240 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:20:55.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:54.283442+0000 mon.smithi084 (mon.0) 241 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:55.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:54.283894+0000 mgr.smithi084.hjmnez (mgr.14162) 101 : cephadm [INF] Reconfiguring daemon crash.smithi133 on smithi133 2024-02-15T18:20:56.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:54.364206+0000 mgr.smithi084.hjmnez (mgr.14162) 102 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:56.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:55.292813+0000 mon.smithi084 (mon.0) 242 : audit [INF] from='client.? 172.21.15.84:0/748290228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20fe52a-86d7-421f-ab80-219ad7724f4b"}]: dispatch 2024-02-15T18:20:56.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:55.295828+0000 mon.smithi084 (mon.0) 243 : audit [INF] from='client.? 172.21.15.84:0/748290228' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d20fe52a-86d7-421f-ab80-219ad7724f4b"}]': finished 2024-02-15T18:20:56.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:55.295864+0000 mon.smithi084 (mon.0) 244 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-15T18:20:56.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:55.295945+0000 mon.smithi084 (mon.0) 245 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:20:56.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:55.715706+0000 mon.smithi084 (mon.0) 246 : audit [DBG] from='client.? 172.21.15.84:0/1736771318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:20:56.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:55.761907+0000 mon.smithi084 (mon.0) 247 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:56.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:55.762717+0000 mon.smithi084 (mon.0) 248 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.nxzroj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:20:56.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:55.763333+0000 mon.smithi084 (mon.0) 249 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:20:56.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:55.763808+0000 mon.smithi084 (mon.0) 250 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:56.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:54.364206+0000 mgr.smithi084.hjmnez (mgr.14162) 102 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:56.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:55.292813+0000 mon.smithi084 (mon.0) 242 : audit [INF] from='client.? 172.21.15.84:0/748290228' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20fe52a-86d7-421f-ab80-219ad7724f4b"}]: dispatch 2024-02-15T18:20:56.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:55.295828+0000 mon.smithi084 (mon.0) 243 : audit [INF] from='client.? 172.21.15.84:0/748290228' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d20fe52a-86d7-421f-ab80-219ad7724f4b"}]': finished 2024-02-15T18:20:56.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:55.295864+0000 mon.smithi084 (mon.0) 244 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-15T18:20:56.765 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:55.295945+0000 mon.smithi084 (mon.0) 245 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:20:56.765 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:55.715706+0000 mon.smithi084 (mon.0) 246 : audit [DBG] from='client.? 172.21.15.84:0/1736771318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:20:56.765 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:55.761907+0000 mon.smithi084 (mon.0) 247 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:56.765 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:55.762717+0000 mon.smithi084 (mon.0) 248 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.nxzroj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:20:56.765 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:55.763333+0000 mon.smithi084 (mon.0) 249 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:20:56.765 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:55.763808+0000 mon.smithi084 (mon.0) 250 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:57.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:55.762456+0000 mgr.smithi084.hjmnez (mgr.14162) 103 : cephadm [INF] Reconfiguring mgr.smithi133.nxzroj (monmap changed)... 2024-02-15T18:20:57.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:55.764237+0000 mgr.smithi084.hjmnez (mgr.14162) 104 : cephadm [INF] Reconfiguring daemon mgr.smithi133.nxzroj on smithi133 2024-02-15T18:20:57.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:57.113294+0000 mon.smithi084 (mon.0) 251 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:57.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:57.113965+0000 mon.smithi084 (mon.0) 252 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:20:57.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:57.114494+0000 mon.smithi084 (mon.0) 253 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:20:57.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:57.114992+0000 mon.smithi084 (mon.0) 254 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:55.762456+0000 mgr.smithi084.hjmnez (mgr.14162) 103 : cephadm [INF] Reconfiguring mgr.smithi133.nxzroj (monmap changed)... 2024-02-15T18:20:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:55.764237+0000 mgr.smithi084.hjmnez (mgr.14162) 104 : cephadm [INF] Reconfiguring daemon mgr.smithi133.nxzroj on smithi133 2024-02-15T18:20:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:57.113294+0000 mon.smithi084 (mon.0) 251 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:57.113965+0000 mon.smithi084 (mon.0) 252 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:20:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:57.114494+0000 mon.smithi084 (mon.0) 253 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:20:57.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:57.114992+0000 mon.smithi084 (mon.0) 254 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:20:58.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:56.364480+0000 mgr.smithi084.hjmnez (mgr.14162) 105 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:58.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:57.113734+0000 mgr.smithi084.hjmnez (mgr.14162) 106 : cephadm [INF] Reconfiguring mon.smithi133 (monmap changed)... 2024-02-15T18:20:58.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:20:57.115406+0000 mgr.smithi084.hjmnez (mgr.14162) 107 : cephadm [INF] Reconfiguring daemon mon.smithi133 on smithi133 2024-02-15T18:20:58.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:56.364480+0000 mgr.smithi084.hjmnez (mgr.14162) 105 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:58.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:57.113734+0000 mgr.smithi084.hjmnez (mgr.14162) 106 : cephadm [INF] Reconfiguring mon.smithi133 (monmap changed)... 2024-02-15T18:20:58.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:20:57.115406+0000 mgr.smithi084.hjmnez (mgr.14162) 107 : cephadm [INF] Reconfiguring daemon mon.smithi133 on smithi133 2024-02-15T18:20:59.683 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:20:58.364743+0000 mgr.smithi084.hjmnez (mgr.14162) 108 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:59.683 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:58.465088+0000 mon.smithi084 (mon.0) 255 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:59.683 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:58.467891+0000 mon.smithi084 (mon.0) 256 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:20:59.683 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:20:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:20:58.468314+0000 mgr.smithi084.hjmnez (mgr.14162) 109 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:20:59.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:20:58.364743+0000 mgr.smithi084.hjmnez (mgr.14162) 108 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:20:59.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:58.465088+0000 mon.smithi084 (mon.0) 255 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:20:59.897 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:58.467891+0000 mon.smithi084 (mon.0) 256 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:20:59.897 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:20:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:20:58.468314+0000 mgr.smithi084.hjmnez (mgr.14162) 109 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:21:01.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:00.365087+0000 mgr.smithi084.hjmnez (mgr.14162) 110 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:01.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:00.365087+0000 mgr.smithi084.hjmnez (mgr.14162) 110 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:02.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:02.390653+0000 mon.smithi084 (mon.0) 257 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T18:21:02.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:02.391267+0000 mon.smithi084 (mon.0) 258 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:02.896 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:02.390653+0000 mon.smithi084 (mon.0) 257 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T18:21:02.896 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:02.391267+0000 mon.smithi084 (mon.0) 258 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:03.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:02.365355+0000 mgr.smithi084.hjmnez (mgr.14162) 111 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:03.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:21:02.391740+0000 mgr.smithi084.hjmnez (mgr.14162) 112 : cephadm [INF] Deploying daemon osd.1 on smithi084 2024-02-15T18:21:03.926 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:02.365355+0000 mgr.smithi084.hjmnez (mgr.14162) 111 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:03.927 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:21:02.391740+0000 mgr.smithi084.hjmnez (mgr.14162) 112 : cephadm [INF] Deploying daemon osd.1 on smithi084 2024-02-15T18:21:05.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:04.365704+0000 mgr.smithi084.hjmnez (mgr.14162) 113 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:05.990 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:04.365704+0000 mgr.smithi084.hjmnez (mgr.14162) 113 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:06.118 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 1 on host 'smithi084' 2024-02-15T18:21:06.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.116+0000 7f069f7fe700 1 -- 172.21.15.84:0/1295727087 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f06b80ff130 con 0x7f06a005c2a0 2024-02-15T18:21:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f06a005c2a0 msgr2=0x7f06a005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f06a005c2a0 0x7f06a005e760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f06ac009490 tx=0x7f06ac009b30).stop 2024-02-15T18:21:06.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f6ff0 msgr2=0x7f06b8107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f6ff0 0x7f06b8107570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f06a800b410 tx=0x7f06a8006ef0).stop 2024-02-15T18:21:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 shutdown_connections 2024-02-15T18:21:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f06a005c2a0 0x7f06a005e760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06b80f66e0 0x7f06b8107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 --2- 172.21.15.84:0/1295727087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06b80f6ff0 0x7f06b8107570 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 >> 172.21.15.84:0/1295727087 conn(0x7f06b80f1f00 msgr2=0x7f06b80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 shutdown_connections 2024-02-15T18:21:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:06.118+0000 7f06bd890700 1 -- 172.21.15.84:0/1295727087 wait complete. 2024-02-15T18:21:06.834 DEBUG:teuthology.orchestra.run.smithi084:osd.1> sudo journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.1.service 2024-02-15T18:21:06.837 INFO:tasks.cephadm:Deploying osd.2 on smithi084 with /dev/vg_nvme/lv_2... 2024-02-15T18:21:06.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-15T18:21:06.867 INFO:journalctl@ceph.osd.1.smithi084.stdout:-- Logs begin at Thu 2024-02-15 18:00:24 UTC. -- 2024-02-15T18:21:07.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.111507+0000 mon.smithi084 (mon.0) 259 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.117063+0000 mon.smithi084 (mon.0) 260 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.125038+0000 mon.smithi084 (mon.0) 261 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.84:9093"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.125462+0000 mgr.smithi084.hjmnez (mgr.14162) 114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.84:9093"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.130079+0000 mon.smithi084 (mon.0) 262 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.133572+0000 mon.smithi084 (mon.0) 263 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.133983+0000 mgr.smithi084.hjmnez (mgr.14162) 115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.137957+0000 mon.smithi084 (mon.0) 264 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.84:3000"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.138188+0000 mgr.smithi084.hjmnez (mgr.14162) 116 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.84:3000"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.144065+0000 mon.smithi084 (mon.0) 265 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.146757+0000 mon.smithi084 (mon.0) 266 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.147078+0000 mgr.smithi084.hjmnez (mgr.14162) 117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.150755+0000 mon.smithi084 (mon.0) 267 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.84:9095"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.151014+0000 mgr.smithi084.hjmnez (mgr.14162) 118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.84:9095"}]: dispatch 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.154674+0000 mon.smithi084 (mon.0) 268 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:06.156049+0000 mon.smithi084 (mon.0) 269 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:21:07.448 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.111507+0000 mon.smithi084 (mon.0) 259 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.448 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.117063+0000 mon.smithi084 (mon.0) 260 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.448 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.125038+0000 mon.smithi084 (mon.0) 261 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.84:9093"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.125462+0000 mgr.smithi084.hjmnez (mgr.14162) 114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.84:9093"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.130079+0000 mon.smithi084 (mon.0) 262 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.133572+0000 mon.smithi084 (mon.0) 263 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.133983+0000 mgr.smithi084.hjmnez (mgr.14162) 115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.137957+0000 mon.smithi084 (mon.0) 264 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.84:3000"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.138188+0000 mgr.smithi084.hjmnez (mgr.14162) 116 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.84:3000"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.144065+0000 mon.smithi084 (mon.0) 265 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.146757+0000 mon.smithi084 (mon.0) 266 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.147078+0000 mgr.smithi084.hjmnez (mgr.14162) 117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.150755+0000 mon.smithi084 (mon.0) 267 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.84:9095"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.151014+0000 mgr.smithi084.hjmnez (mgr.14162) 118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.84:9095"}]: dispatch 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.154674+0000 mon.smithi084 (mon.0) 268 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:07.449 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:06.156049+0000 mon.smithi084 (mon.0) 269 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:21:08.453 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:06.366066+0000 mgr.smithi084.hjmnez (mgr.14162) 119 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:08.453 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:08.057906+0000 mon.smithi084 (mon.0) 270 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:08.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:06.366066+0000 mgr.smithi084.hjmnez (mgr.14162) 119 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:08.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:08.057906+0000 mon.smithi084 (mon.0) 270 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-15T18:21:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-15T18:21:09.681 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-02-15T18:21:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-02-15T18:21:09.681 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120447 s, 871 MB/s 2024-02-15T18:21:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-02-15T18:21:10.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:08.366383+0000 mgr.smithi084.hjmnez (mgr.14162) 120 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:10.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:09.980245+0000 mon.smithi084 (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T18:21:10.264 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:21:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.1[52354]: debug 2024-02-15T18:21:09.976+0000 7f5d61b19080 -1 osd.1 0 log_to_monitors {default=true} 2024-02-15T18:21:10.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2024-02-15T18:21:10.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:08.366383+0000 mgr.smithi084.hjmnez (mgr.14162) 120 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:10.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:09.980245+0000 mon.smithi084 (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T18:21:11.514 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.1[52354]: debug 2024-02-15T18:21:11.163+0000 7f5d5808a700 -1 osd.1 0 waiting for initial osdmap 2024-02-15T18:21:11.514 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.1[52354]: debug 2024-02-15T18:21:11.168+0000 7f5d54806700 -1 osd.1 13 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-15T18:21:11.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:10.160133+0000 mon.smithi084 (mon.0) 272 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T18:21:11.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:10.160181+0000 mon.smithi084 (mon.0) 273 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-15T18:21:11.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:10.160457+0000 mon.smithi084 (mon.0) 274 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:11.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:10.160681+0000 mon.smithi084 (mon.0) 275 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:21:11.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:11.161734+0000 mon.smithi084 (mon.0) 276 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-02-15T18:21:11.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:11.161790+0000 mon.smithi084 (mon.0) 277 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-02-15T18:21:11.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:11.161881+0000 mon.smithi084 (mon.0) 278 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:11.515 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:11.164668+0000 mon.smithi084 (mon.0) 279 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:11.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:10.160133+0000 mon.smithi084 (mon.0) 272 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T18:21:11.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:10.160181+0000 mon.smithi084 (mon.0) 273 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-15T18:21:11.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:10.160457+0000 mon.smithi084 (mon.0) 274 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:11.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:10.160681+0000 mon.smithi084 (mon.0) 275 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:21:11.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:11.161734+0000 mon.smithi084 (mon.0) 276 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-02-15T18:21:11.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:11.161790+0000 mon.smithi084 (mon.0) 277 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-02-15T18:21:11.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:11.161881+0000 mon.smithi084 (mon.0) 278 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:11.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:11.164668+0000 mon.smithi084 (mon.0) 279 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:12.229 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:10.366913+0000 mgr.smithi084.hjmnez (mgr.14162) 121 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:12.229 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:12.164724+0000 mon.smithi084 (mon.0) 280 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:12.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:10.366913+0000 mgr.smithi084.hjmnez (mgr.14162) 121 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:12.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:12.164724+0000 mon.smithi084 (mon.0) 280 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.886+0000 7fb300372700 1 -- 172.21.15.84:0/1022360593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f7980 msgr2=0x7fb2f80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.886+0000 7fb300372700 1 --2- 172.21.15.84:0/1022360593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f7980 0x7fb2f80f7de0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb2f4004660 tx=0x7fb2f4009b30).stop 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.886+0000 7fb300372700 1 -- 172.21.15.84:0/1022360593 shutdown_connections 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.886+0000 7fb300372700 1 --2- 172.21.15.84:0/1022360593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f7980 0x7fb2f80f7de0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.886+0000 7fb300372700 1 --2- 172.21.15.84:0/1022360593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f80f66e0 0x7fb2f80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.886+0000 7fb300372700 1 -- 172.21.15.84:0/1022360593 >> 172.21.15.84:0/1022360593 conn(0x7fb2f80f1e40 msgr2=0x7fb2f80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.886+0000 7fb300372700 1 -- 172.21.15.84:0/1022360593 shutdown_connections 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.886+0000 7fb300372700 1 -- 172.21.15.84:0/1022360593 wait complete. 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb300372700 1 Processor -- start 2024-02-15T18:21:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb300372700 1 -- start start 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb300372700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f66e0 0x7fb2f8107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb300372700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f80f7980 0x7fb2f8107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb300372700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8107ba0 con 0x7fb2f80f66e0 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb300372700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8108450 con 0x7fb2f80f7980 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2fe10e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f66e0 0x7fb2f8107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2fe10e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f66e0 0x7fb2f8107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52690/0 (socket says 172.21.15.84:52690) 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2fe10e700 1 -- 172.21.15.84:0/672024492 learned_addr learned my addr 172.21.15.84:0/672024492 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2fd90d700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f80f7980 0x7fb2f8107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2fe10e700 1 -- 172.21.15.84:0/672024492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f80f7980 msgr2=0x7fb2f8107560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2fe10e700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f80f7980 0x7fb2f8107560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2fe10e700 1 -- 172.21.15.84:0/672024492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f4005040 con 0x7fb2f80f66e0 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2fe10e700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f66e0 0x7fb2f8107070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb2e80093f0 tx=0x7fb2e8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2eeffd700 1 -- 172.21.15.84:0/672024492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e8009ea0 con 0x7fb2f80f66e0 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f8108730 con 0x7fb2f80f66e0 2024-02-15T18:21:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2eeffd700 1 -- 172.21.15.84:0/672024492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2e8013b10 con 0x7fb2f80f66e0 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb2eeffd700 1 -- 172.21.15.84:0/672024492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e800dbc0 con 0x7fb2f80f66e0 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.887+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f8108cf0 con 0x7fb2f80f66e0 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.888+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f80f5ad0 con 0x7fb2f80f66e0 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.889+0000 7fb2eeffd700 1 -- 172.21.15.84:0/672024492 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb2e801a060 con 0x7fb2f80f66e0 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.889+0000 7fb2eeffd700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb2e405c2b0 0x7fb2e405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.889+0000 7fb2eeffd700 1 -- 172.21.15.84:0/672024492 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2314+0+0 (secure 0 0 0) 0x7fb2e8075350 con 0x7fb2f80f66e0 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.889+0000 7fb2fd90d700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb2e405c2b0 0x7fb2e405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.889+0000 7fb2fd90d700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb2e405c2b0 0x7fb2e405e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb2f4004e30 tx=0x7fb2f4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:12.893+0000 7fb2eeffd700 1 -- 172.21.15.84:0/672024492 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb2e804c5e0 con 0x7fb2f80f66e0 2024-02-15T18:21:13.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:13.071+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2f80ff140 con 0x7fb2e405c2b0 2024-02-15T18:21:13.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:10.928871+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:21:13.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:10.929064+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:21:13.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:12.174839+0000 mon.smithi084 (mon.0) 281 : cluster [INF] osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] boot 2024-02-15T18:21:13.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:12.174880+0000 mon.smithi084 (mon.0) 282 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-15T18:21:13.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:12.175365+0000 mon.smithi084 (mon.0) 283 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:13.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:13.073505+0000 mon.smithi084 (mon.0) 284 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:21:13.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:13.074668+0000 mon.smithi084 (mon.0) 285 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:21:13.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:13.075146+0000 mon.smithi084 (mon.0) 286 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:13.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:10.928871+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:21:13.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:10.929064+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:21:13.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:12.174839+0000 mon.smithi084 (mon.0) 281 : cluster [INF] osd.1 [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] boot 2024-02-15T18:21:13.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:12.174880+0000 mon.smithi084 (mon.0) 282 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-15T18:21:13.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:12.175365+0000 mon.smithi084 (mon.0) 283 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:21:13.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:13.073505+0000 mon.smithi084 (mon.0) 284 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:21:13.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:13.074668+0000 mon.smithi084 (mon.0) 285 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:21:13.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:13.075146+0000 mon.smithi084 (mon.0) 286 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:14.454 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:12.367254+0000 mgr.smithi084.hjmnez (mgr.14162) 122 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:14.454 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:13.072784+0000 mgr.smithi084.hjmnez (mgr.14162) 123 : audit [DBG] from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:21:14.454 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:21:13.074503+0000 mgr.smithi084.hjmnez (mgr.14162) 124 : cephadm [INF] Applying service osd.None on host smithi084... 2024-02-15T18:21:14.454 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:13.187061+0000 mon.smithi084 (mon.0) 287 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-02-15T18:21:14.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:12.367254+0000 mgr.smithi084.hjmnez (mgr.14162) 122 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:21:14.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:13.072784+0000 mgr.smithi084.hjmnez (mgr.14162) 123 : audit [DBG] from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:21:14.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:21:13.074503+0000 mgr.smithi084.hjmnez (mgr.14162) 124 : cephadm [INF] Applying service osd.None on host smithi084... 2024-02-15T18:21:14.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:13.187061+0000 mon.smithi084 (mon.0) 287 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-02-15T18:21:16.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:14.367549+0000 mgr.smithi084.hjmnez (mgr.14162) 125 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:16.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:15.816054+0000 mon.smithi084 (mon.0) 288 : audit [INF] from='client.? 172.21.15.84:0/3042925833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b905a1ac-93fe-419d-ab8e-4b3a3e08d448"}]: dispatch 2024-02-15T18:21:16.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:15.819794+0000 mon.smithi084 (mon.0) 289 : audit [INF] from='client.? 172.21.15.84:0/3042925833' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b905a1ac-93fe-419d-ab8e-4b3a3e08d448"}]': finished 2024-02-15T18:21:16.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:15.819836+0000 mon.smithi084 (mon.0) 290 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-15T18:21:16.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:15.819929+0000 mon.smithi084 (mon.0) 291 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:16.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:16.135263+0000 mon.smithi084 (mon.0) 292 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:16.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:14.367549+0000 mgr.smithi084.hjmnez (mgr.14162) 125 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:16.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:15.816054+0000 mon.smithi084 (mon.0) 288 : audit [INF] from='client.? 172.21.15.84:0/3042925833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b905a1ac-93fe-419d-ab8e-4b3a3e08d448"}]: dispatch 2024-02-15T18:21:16.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:15.819794+0000 mon.smithi084 (mon.0) 289 : audit [INF] from='client.? 172.21.15.84:0/3042925833' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b905a1ac-93fe-419d-ab8e-4b3a3e08d448"}]': finished 2024-02-15T18:21:16.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:15.819836+0000 mon.smithi084 (mon.0) 290 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-15T18:21:16.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:15.819929+0000 mon.smithi084 (mon.0) 291 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:16.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:16.135263+0000 mon.smithi084 (mon.0) 292 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:17.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:16.256973+0000 mon.smithi084 (mon.0) 293 : audit [DBG] from='client.? 172.21.15.84:0/1259473160' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:21:17.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:16.256973+0000 mon.smithi084 (mon.0) 293 : audit [DBG] from='client.? 172.21.15.84:0/1259473160' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:21:18.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:16.367947+0000 mgr.smithi084.hjmnez (mgr.14162) 126 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:18.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:16.367947+0000 mgr.smithi084.hjmnez (mgr.14162) 126 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:20.470 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:18.368195+0000 mgr.smithi084.hjmnez (mgr.14162) 127 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:20.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:18.368195+0000 mgr.smithi084.hjmnez (mgr.14162) 127 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:22.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:20.368447+0000 mgr.smithi084.hjmnez (mgr.14162) 128 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:22.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:20.368447+0000 mgr.smithi084.hjmnez (mgr.14162) 128 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:24.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:22.368814+0000 mgr.smithi084.hjmnez (mgr.14162) 129 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:24.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:21:22.894698+0000 mgr.smithi084.hjmnez (mgr.14162) 130 : cephadm [INF] Detected new or changed devices on smithi084 2024-02-15T18:21:24.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:22.899661+0000 mon.smithi084 (mon.0) 294 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:24.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:23.201627+0000 mon.smithi084 (mon.0) 295 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:24.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:23.203818+0000 mon.smithi084 (mon.0) 296 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:21:24.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:22.368814+0000 mgr.smithi084.hjmnez (mgr.14162) 129 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:24.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:21:22.894698+0000 mgr.smithi084.hjmnez (mgr.14162) 130 : cephadm [INF] Detected new or changed devices on smithi084 2024-02-15T18:21:24.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:22.899661+0000 mon.smithi084 (mon.0) 294 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:24.157 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:23.201627+0000 mon.smithi084 (mon.0) 295 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:24.157 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:23.203818+0000 mon.smithi084 (mon.0) 296 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:21:25.254 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:24.177847+0000 mon.smithi084 (mon.0) 297 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T18:21:25.255 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:24.178533+0000 mon.smithi084 (mon.0) 298 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:25.255 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:21:24.179074+0000 mgr.smithi084.hjmnez (mgr.14162) 131 : cephadm [INF] Deploying daemon osd.2 on smithi084 2024-02-15T18:21:25.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:24.177847+0000 mon.smithi084 (mon.0) 297 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T18:21:25.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:24.178533+0000 mon.smithi084 (mon.0) 298 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:25.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:21:24.179074+0000 mgr.smithi084.hjmnez (mgr.14162) 131 : cephadm [INF] Deploying daemon osd.2 on smithi084 2024-02-15T18:21:26.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:24.369044+0000 mgr.smithi084.hjmnez (mgr.14162) 132 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:26.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:24.960954+0000 mon.smithi084 (mon.0) 299 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:26.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:24.369044+0000 mgr.smithi084.hjmnez (mgr.14162) 132 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:26.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:24.960954+0000 mon.smithi084 (mon.0) 299 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:28.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:26.369307+0000 mgr.smithi084.hjmnez (mgr.14162) 133 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:28.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:26.369307+0000 mgr.smithi084.hjmnez (mgr.14162) 133 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:29.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:28.479975+0000 mon.smithi084 (mon.0) 300 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:21:29.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:28.480158+0000 mon.smithi084 (mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:21:29.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:28.479975+0000 mon.smithi084 (mon.0) 300 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:21:29.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:28.480158+0000 mon.smithi084 (mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:21:29.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.680+0000 7fb2eeffd700 1 -- 172.21.15.84:0/672024492 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb2f80ff140 con 0x7fb2e405c2b0 2024-02-15T18:21:29.681 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 2 on host 'smithi084' 2024-02-15T18:21:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb2e405c2b0 msgr2=0x7fb2e405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb2e405c2b0 0x7fb2e405e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb2f4004e30 tx=0x7fb2f4009b30).stop 2024-02-15T18:21:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f66e0 msgr2=0x7fb2f8107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f66e0 0x7fb2f8107070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb2e80093f0 tx=0x7fb2e8006ec0).stop 2024-02-15T18:21:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 shutdown_connections 2024-02-15T18:21:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb2e405c2b0 0x7fb2e405e770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2f80f66e0 0x7fb2f8107070 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 --2- 172.21.15.84:0/672024492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f80f7980 0x7fb2f8107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 >> 172.21.15.84:0/672024492 conn(0x7fb2f80f1e40 msgr2=0x7fb2f80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 shutdown_connections 2024-02-15T18:21:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:21:29.683+0000 7fb300372700 1 -- 172.21.15.84:0/672024492 wait complete. 2024-02-15T18:21:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:28.369657+0000 mgr.smithi084.hjmnez (mgr.14162) 134 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:29.676286+0000 mon.smithi084 (mon.0) 302 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:29.680157+0000 mon.smithi084 (mon.0) 303 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:30.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:28.369657+0000 mgr.smithi084.hjmnez (mgr.14162) 134 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:30.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:29.676286+0000 mon.smithi084 (mon.0) 302 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:30.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:29.680157+0000 mon.smithi084 (mon.0) 303 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:30.721 DEBUG:teuthology.orchestra.run.smithi084:osd.2> sudo journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.2.service 2024-02-15T18:21:30.723 INFO:tasks.cephadm:Deploying osd.3 on smithi133 with /dev/vg_nvme/lv_4... 2024-02-15T18:21:30.723 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-15T18:21:30.756 INFO:journalctl@ceph.osd.2.smithi084.stdout:-- Logs begin at Thu 2024-02-15 18:00:24 UTC. -- 2024-02-15T18:21:32.123 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:30.369967+0000 mgr.smithi084.hjmnez (mgr.14162) 135 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:32.123 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:31.520328+0000 mon.smithi084 (mon.0) 304 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:32.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:30.369967+0000 mgr.smithi084.hjmnez (mgr.14162) 135 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:32.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:31.520328+0000 mon.smithi084 (mon.0) 304 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-15T18:21:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-15T18:21:32.870 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2024-02-15T18:21:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2024-02-15T18:21:32.870 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126726 s, 827 MB/s 2024-02-15T18:21:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2024-02-15T18:21:33.546 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi133:vg_nvme/lv_4 2024-02-15T18:21:33.981 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:21:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.2[56624]: debug 2024-02-15T18:21:33.570+0000 7f2513dc9080 -1 osd.2 0 log_to_monitors {default=true} 2024-02-15T18:21:34.253 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:32.370252+0000 mgr.smithi084.hjmnez (mgr.14162) 136 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:34.253 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:33.574396+0000 mon.smithi084 (mon.0) 305 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T18:21:34.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:32.370252+0000 mgr.smithi084.hjmnez (mgr.14162) 136 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:34.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:33.574396+0000 mon.smithi084 (mon.0) 305 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T18:21:35.208 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:33.980513+0000 mon.smithi084 (mon.0) 306 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T18:21:35.208 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:33.980572+0000 mon.smithi084 (mon.0) 307 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-15T18:21:35.208 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:33.980923+0000 mon.smithi084 (mon.0) 308 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:35.208 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:33.981173+0000 mon.smithi084 (mon.0) 309 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:21:35.208 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:34.893636+0000 mon.smithi084 (mon.0) 310 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:35.208 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:34.896496+0000 mon.smithi084 (mon.0) 311 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:35.209 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:34.898598+0000 mon.smithi084 (mon.0) 312 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:21:35.264 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:21:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.2[56624]: debug 2024-02-15T18:21:34.984+0000 7f250a33a700 -1 osd.2 0 waiting for initial osdmap 2024-02-15T18:21:35.264 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:21:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.2[56624]: debug 2024-02-15T18:21:34.991+0000 7f2506ab6700 -1 osd.2 18 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-15T18:21:35.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:33.980513+0000 mon.smithi084 (mon.0) 306 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T18:21:35.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:33.980572+0000 mon.smithi084 (mon.0) 307 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-15T18:21:35.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:33.980923+0000 mon.smithi084 (mon.0) 308 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:35.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:33.981173+0000 mon.smithi084 (mon.0) 309 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:21:35.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:34.893636+0000 mon.smithi084 (mon.0) 310 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:35.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:34.896496+0000 mon.smithi084 (mon.0) 311 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:35.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:34.898598+0000 mon.smithi084 (mon.0) 312 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:21:35.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.462+0000 7fece10cf700 1 -- 172.21.15.133:0/3469247124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecdc0f98a0 msgr2=0x7fecdc0fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:35.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.462+0000 7fece10cf700 1 --2- 172.21.15.133:0/3469247124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecdc0f98a0 0x7fecdc0fbc90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fecd0004660 tx=0x7fecd0009b30).stop 2024-02-15T18:21:35.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.462+0000 7fece10cf700 1 -- 172.21.15.133:0/3469247124 shutdown_connections 2024-02-15T18:21:35.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.462+0000 7fece10cf700 1 --2- 172.21.15.133:0/3469247124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecdc0f98a0 0x7fecdc0fbc90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:35.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.462+0000 7fece10cf700 1 --2- 172.21.15.133:0/3469247124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0603f0 0x7fecdc0f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:35.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.462+0000 7fece10cf700 1 -- 172.21.15.133:0/3469247124 >> 172.21.15.133:0/3469247124 conn(0x7fecdc0f0d20 msgr2=0x7fecdc0f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:35.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.462+0000 7fece10cf700 1 -- 172.21.15.133:0/3469247124 shutdown_connections 2024-02-15T18:21:35.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.462+0000 7fece10cf700 1 -- 172.21.15.133:0/3469247124 wait complete. 2024-02-15T18:21:35.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fece10cf700 1 Processor -- start 2024-02-15T18:21:35.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fece10cf700 1 -- start start 2024-02-15T18:21:35.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fece10cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0603f0 0x7fecdc106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:35.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fece10cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecdc0f98a0 0x7fecdc1074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:35.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fece10cf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc107a90 con 0x7fecdc0f98a0 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fece10cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc107bd0 con 0x7fecdc0603f0 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fecdad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0603f0 0x7fecdc106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fecdad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0603f0 0x7fecdc106ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41448/0 (socket says 172.21.15.133:41448) 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fecdad9d700 1 -- 172.21.15.133:0/2943299130 learned_addr learned my addr 172.21.15.133:0/2943299130 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.463+0000 7fecda59c700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecdc0f98a0 0x7fecdc1074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fecda59c700 1 -- 172.21.15.133:0/2943299130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0603f0 msgr2=0x7fecdc106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fecda59c700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0603f0 0x7fecdc106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fecda59c700 1 -- 172.21.15.133:0/2943299130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc005040 con 0x7fecdc0f98a0 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fecdad9d700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0603f0 0x7fecdc106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fecda59c700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecdc0f98a0 0x7fecdc1074e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fecdc0601c0 tx=0x7fecd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fecc37fe700 1 -- 172.21.15.133:0/2943299130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd0019070 con 0x7fecdc0f98a0 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fecc37fe700 1 -- 172.21.15.133:0/2943299130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecd0007e90 con 0x7fecdc0f98a0 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd0005040 con 0x7fecdc0f98a0 2024-02-15T18:21:35.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fecc37fe700 1 -- 172.21.15.133:0/2943299130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd0014d60 con 0x7fecdc0f98a0 2024-02-15T18:21:35.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.464+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc1088e0 con 0x7fecdc0f98a0 2024-02-15T18:21:35.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.465+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc0f49b0 con 0x7fecdc0f98a0 2024-02-15T18:21:35.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.465+0000 7fecc37fe700 1 -- 172.21.15.133:0/2943299130 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fecd0025070 con 0x7fecdc0f98a0 2024-02-15T18:21:35.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.466+0000 7fecc37fe700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fecc405c2b0 0x7fecc405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:35.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.466+0000 7fecc37fe700 1 -- 172.21.15.133:0/2943299130 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2466+0+0 (secure 0 0 0) 0x7fecd0076190 con 0x7fecdc0f98a0 2024-02-15T18:21:35.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.466+0000 7fecdad9d700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fecc405c2b0 0x7fecc405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:35.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.466+0000 7fecdad9d700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fecc405c2b0 0x7fecc405e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7feccc009fd0 tx=0x7feccc00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:35.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.470+0000 7fecc37fe700 1 -- 172.21.15.133:0/2943299130 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fecd0049930 con 0x7fecdc0f98a0 2024-02-15T18:21:35.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:35.651+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fecdc100f80 con 0x7fecc405c2b0 2024-02-15T18:21:36.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:34.370549+0000 mgr.smithi084.hjmnez (mgr.14162) 137 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:36.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:34.981583+0000 mon.smithi084 (mon.0) 313 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-02-15T18:21:36.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:34.981656+0000 mon.smithi084 (mon.0) 314 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-02-15T18:21:36.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:34.981796+0000 mon.smithi084 (mon.0) 315 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:36.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:34.986817+0000 mon.smithi084 (mon.0) 316 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:36.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:35.654792+0000 mon.smithi084 (mon.0) 317 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:21:36.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:35.656254+0000 mon.smithi084 (mon.0) 318 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:21:36.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:35.656740+0000 mon.smithi084 (mon.0) 319 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:36.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:34.370549+0000 mgr.smithi084.hjmnez (mgr.14162) 137 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:36.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:34.981583+0000 mon.smithi084 (mon.0) 313 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-02-15T18:21:36.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:34.981656+0000 mon.smithi084 (mon.0) 314 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-02-15T18:21:36.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:34.981796+0000 mon.smithi084 (mon.0) 315 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:36.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:34.986817+0000 mon.smithi084 (mon.0) 316 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:36.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:35.654792+0000 mon.smithi084 (mon.0) 317 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:21:36.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:35.656254+0000 mon.smithi084 (mon.0) 318 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:21:36.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:35.656740+0000 mon.smithi084 (mon.0) 319 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:34.608193+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:21:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:34.608384+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:21:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:35.653999+0000 mgr.smithi084.hjmnez (mgr.14162) 138 : audit [DBG] from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:21:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:21:35.656032+0000 mgr.smithi084.hjmnez (mgr.14162) 139 : cephadm [INF] Applying service osd.None on host smithi133... 2024-02-15T18:21:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:35.986996+0000 mon.smithi084 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:35.991724+0000 mon.smithi084 (mon.0) 321 : cluster [INF] osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] boot 2024-02-15T18:21:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:35.991768+0000 mon.smithi084 (mon.0) 322 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-15T18:21:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:35.991987+0000 mon.smithi084 (mon.0) 323 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:37.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:34.608193+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:21:37.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:34.608384+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:21:37.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:35.653999+0000 mgr.smithi084.hjmnez (mgr.14162) 138 : audit [DBG] from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:21:37.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:21:35.656032+0000 mgr.smithi084.hjmnez (mgr.14162) 139 : cephadm [INF] Applying service osd.None on host smithi133... 2024-02-15T18:21:37.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:35.986996+0000 mon.smithi084 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:37.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:35.991724+0000 mon.smithi084 (mon.0) 321 : cluster [INF] osd.2 [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] boot 2024-02-15T18:21:37.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:35.991768+0000 mon.smithi084 (mon.0) 322 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-15T18:21:37.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:35.991987+0000 mon.smithi084 (mon.0) 323 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:21:38.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:36.370741+0000 mgr.smithi084.hjmnez (mgr.14162) 140 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:38.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:36.996433+0000 mon.smithi084 (mon.0) 324 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-15T18:21:38.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:37.547953+0000 mon.smithi084 (mon.0) 325 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:38.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:36.370741+0000 mgr.smithi084.hjmnez (mgr.14162) 140 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:21:38.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:36.996433+0000 mon.smithi084 (mon.0) 324 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-15T18:21:38.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:37.547953+0000 mon.smithi084 (mon.0) 325 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:39.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:38.879865+0000 mon.smithi133 (mon.1) 2 : audit [INF] from='client.? 172.21.15.133:0/680358377' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ece64a41-54ad-420b-aa77-6d226942a19b"}]: dispatch 2024-02-15T18:21:39.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:38.880147+0000 mon.smithi084 (mon.0) 326 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ece64a41-54ad-420b-aa77-6d226942a19b"}]: dispatch 2024-02-15T18:21:39.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:38.883475+0000 mon.smithi084 (mon.0) 327 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ece64a41-54ad-420b-aa77-6d226942a19b"}]': finished 2024-02-15T18:21:39.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:38.883518+0000 mon.smithi084 (mon.0) 328 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2024-02-15T18:21:39.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:38.883593+0000 mon.smithi084 (mon.0) 329 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:39.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:38.879865+0000 mon.smithi133 (mon.1) 2 : audit [INF] from='client.? 172.21.15.133:0/680358377' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ece64a41-54ad-420b-aa77-6d226942a19b"}]: dispatch 2024-02-15T18:21:39.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:38.880147+0000 mon.smithi084 (mon.0) 326 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ece64a41-54ad-420b-aa77-6d226942a19b"}]: dispatch 2024-02-15T18:21:39.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:38.883475+0000 mon.smithi084 (mon.0) 327 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ece64a41-54ad-420b-aa77-6d226942a19b"}]': finished 2024-02-15T18:21:39.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:38.883518+0000 mon.smithi084 (mon.0) 328 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2024-02-15T18:21:39.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:38.883593+0000 mon.smithi084 (mon.0) 329 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:40.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:38.370984+0000 mgr.smithi084.hjmnez (mgr.14162) 141 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:40.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:39.297383+0000 mon.smithi133 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.133:0/4193212217' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:21:40.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:39.310317+0000 mon.smithi084 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:40.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:38.370984+0000 mgr.smithi084.hjmnez (mgr.14162) 141 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:40.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:39.297383+0000 mon.smithi133 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.133:0/4193212217' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:21:40.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:39.310317+0000 mon.smithi084 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:42.158 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:40.371255+0000 mgr.smithi084.hjmnez (mgr.14162) 142 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:42.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:40.371255+0000 mgr.smithi084.hjmnez (mgr.14162) 142 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:43.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:42.371637+0000 mgr.smithi084.hjmnez (mgr.14162) 143 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:43.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:42.685788+0000 mon.smithi084 (mon.0) 331 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:43.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:42.688646+0000 mon.smithi084 (mon.0) 332 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:44.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:42.371637+0000 mgr.smithi084.hjmnez (mgr.14162) 143 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:44.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:42.685788+0000 mon.smithi084 (mon.0) 331 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:44.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:42.688646+0000 mon.smithi084 (mon.0) 332 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:45.982 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:44.372032+0000 mgr.smithi084.hjmnez (mgr.14162) 144 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:46.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:44.372032+0000 mgr.smithi084.hjmnez (mgr.14162) 144 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:46.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:46.000967+0000 mon.smithi084 (mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T18:21:46.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:46.001742+0000 mon.smithi084 (mon.0) 334 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:46.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:21:46.002335+0000 mgr.smithi084.hjmnez (mgr.14162) 145 : cephadm [INF] Deploying daemon osd.3 on smithi133 2024-02-15T18:21:47.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:46.000967+0000 mon.smithi084 (mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T18:21:47.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:46.001742+0000 mon.smithi084 (mon.0) 334 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:47.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:21:46.002335+0000 mgr.smithi084.hjmnez (mgr.14162) 145 : cephadm [INF] Deploying daemon osd.3 on smithi133 2024-02-15T18:21:47.877 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:46.372411+0000 mgr.smithi084.hjmnez (mgr.14162) 146 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:48.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:46.372411+0000 mgr.smithi084.hjmnez (mgr.14162) 146 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:49.545 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 3 on host 'smithi133' 2024-02-15T18:21:49.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.543+0000 7fecc37fe700 1 -- 172.21.15.133:0/2943299130 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fecdc100f80 con 0x7fecc405c2b0 2024-02-15T18:21:49.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fecc405c2b0 msgr2=0x7fecc405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:49.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fecc405c2b0 0x7fecc405e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7feccc009fd0 tx=0x7feccc00b040).stop 2024-02-15T18:21:49.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecdc0f98a0 msgr2=0x7fecdc1074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:49.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecdc0f98a0 0x7fecdc1074e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fecdc0601c0 tx=0x7fecd000b040).stop 2024-02-15T18:21:49.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 shutdown_connections 2024-02-15T18:21:49.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fecc405c2b0 0x7fecc405e770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:49.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0603f0 0x7fecdc106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:49.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 --2- 172.21.15.133:0/2943299130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecdc0f98a0 0x7fecdc1074e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:49.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 >> 172.21.15.133:0/2943299130 conn(0x7fecdc0f0d20 msgr2=0x7fecdc0f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:49.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 shutdown_connections 2024-02-15T18:21:49.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:49.546+0000 7fece10cf700 1 -- 172.21.15.133:0/2943299130 wait complete. 2024-02-15T18:21:50.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:48.372838+0000 mgr.smithi084.hjmnez (mgr.14162) 147 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:50.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:49.536627+0000 mon.smithi084 (mon.0) 335 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:21:50.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:49.539903+0000 mon.smithi084 (mon.0) 336 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:50.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:49.544476+0000 mon.smithi084 (mon.0) 337 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:50.168 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:48.372838+0000 mgr.smithi084.hjmnez (mgr.14162) 147 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:50.168 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:49.536627+0000 mon.smithi084 (mon.0) 335 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:21:50.168 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:49.539903+0000 mon.smithi084 (mon.0) 336 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:50.168 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:49.544476+0000 mon.smithi084 (mon.0) 337 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:50.171 DEBUG:teuthology.orchestra.run.smithi133:osd.3> sudo journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.3.service 2024-02-15T18:21:50.173 INFO:tasks.cephadm:Deploying osd.4 on smithi133 with /dev/vg_nvme/lv_3... 2024-02-15T18:21:50.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-15T18:21:50.204 INFO:journalctl@ceph.osd.3.smithi133.stdout:-- Logs begin at Thu 2024-02-15 18:00:43 UTC. -- 2024-02-15T18:21:51.076 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:49.547362+0000 mon.smithi084 (mon.0) 338 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2024-02-15T18:21:51.076 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:50.549755+0000 mon.smithi084 (mon.0) 339 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2024-02-15T18:21:51.076 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:50.549804+0000 mon.smithi084 (mon.0) 340 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-15T18:21:51.076 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:50.549911+0000 mon.smithi084 (mon.0) 341 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:51.076 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:50.550740+0000 mon.smithi084 (mon.0) 342 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:21:51.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:49.547362+0000 mon.smithi084 (mon.0) 338 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2024-02-15T18:21:51.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:50.549755+0000 mon.smithi084 (mon.0) 339 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2024-02-15T18:21:51.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:50.549804+0000 mon.smithi084 (mon.0) 340 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-15T18:21:51.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:50.549911+0000 mon.smithi084 (mon.0) 341 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:51.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:50.550740+0000 mon.smithi084 (mon.0) 342 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:21:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:50.373114+0000 mgr.smithi084.hjmnez (mgr.14162) 148 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:51.547846+0000 mon.smithi084 (mon.0) 343 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:21:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:51.547923+0000 mon.smithi084 (mon.0) 344 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-15T18:21:52.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:51.548041+0000 mon.smithi084 (mon.0) 345 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:52.136 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:50.373114+0000 mgr.smithi084.hjmnez (mgr.14162) 148 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:52.137 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:51.547846+0000 mon.smithi084 (mon.0) 343 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:21:52.137 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:51.547923+0000 mon.smithi084 (mon.0) 344 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-15T18:21:52.137 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:51.548041+0000 mon.smithi084 (mon.0) 345 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:52.956 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-15T18:21:52.956 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-15T18:21:52.956 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2024-02-15T18:21:52.956 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2024-02-15T18:21:52.956 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128179 s, 818 MB/s 2024-02-15T18:21:52.956 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2024-02-15T18:21:53.896 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:21:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.3[45076]: debug 2024-02-15T18:21:53.407+0000 7f63b3f3d080 -1 osd.3 0 log_to_monitors {default=true} 2024-02-15T18:21:53.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:52.373497+0000 mgr.smithi084.hjmnez (mgr.14162) 149 : cluster [DBG] pgmap v114: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:53.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:52.654242+0000 mon.smithi084 (mon.0) 346 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-15T18:21:53.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:52.654352+0000 mon.smithi084 (mon.0) 347 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:53.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:53.411187+0000 mon.smithi133 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:21:53.897 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:53.411558+0000 mon.smithi084 (mon.0) 348 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:21:53.950 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi133:vg_nvme/lv_3 2024-02-15T18:21:54.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:52.373497+0000 mgr.smithi084.hjmnez (mgr.14162) 149 : cluster [DBG] pgmap v114: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:54.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:52.654242+0000 mon.smithi084 (mon.0) 346 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-15T18:21:54.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:52.654352+0000 mon.smithi084 (mon.0) 347 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:54.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:53.411187+0000 mon.smithi133 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:21:54.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:53.411558+0000 mon.smithi084 (mon.0) 348 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:21:55.146 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:21:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.3[45076]: debug 2024-02-15T18:21:54.831+0000 7f63aa4ae700 -1 osd.3 0 waiting for initial osdmap 2024-02-15T18:21:55.146 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:21:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.3[45076]: debug 2024-02-15T18:21:54.838+0000 7f63a2c22700 -1 osd.3 26 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-15T18:21:55.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:53.828600+0000 mon.smithi084 (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T18:21:55.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:53.828674+0000 mon.smithi084 (mon.0) 350 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-15T18:21:55.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:53.828835+0000 mon.smithi084 (mon.0) 351 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:55.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:53.829554+0000 mon.smithi133 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:21:55.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:53.829868+0000 mon.smithi084 (mon.0) 352 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:21:55.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:53.897053+0000 mon.smithi084 (mon.0) 353 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:55.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:53.981179+0000 mon.smithi084 (mon.0) 354 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:55.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:53.828600+0000 mon.smithi084 (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T18:21:55.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:53.828674+0000 mon.smithi084 (mon.0) 350 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-15T18:21:55.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:53.828835+0000 mon.smithi084 (mon.0) 351 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:55.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:53.829554+0000 mon.smithi133 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:21:55.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:53.829868+0000 mon.smithi084 (mon.0) 352 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:21:55.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:53.897053+0000 mon.smithi084 (mon.0) 353 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:55.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:53.981179+0000 mon.smithi084 (mon.0) 354 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:21:56.088 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:54.373964+0000 mgr.smithi084.hjmnez (mgr.14162) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:56.088 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:54.827717+0000 mon.smithi084 (mon.0) 355 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-02-15T18:21:56.088 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:54.827817+0000 mon.smithi084 (mon.0) 356 : cluster [DBG] osdmap e26: 4 total, 3 up, 4 in 2024-02-15T18:21:56.088 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:54.828332+0000 mon.smithi084 (mon.0) 357 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:56.088 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:54.833223+0000 mon.smithi084 (mon.0) 358 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:56.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:54.373964+0000 mgr.smithi084.hjmnez (mgr.14162) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:21:56.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:54.827717+0000 mon.smithi084 (mon.0) 355 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-02-15T18:21:56.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:54.827817+0000 mon.smithi084 (mon.0) 356 : cluster [DBG] osdmap e26: 4 total, 3 up, 4 in 2024-02-15T18:21:56.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:54.828332+0000 mon.smithi084 (mon.0) 357 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:56.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:54.833223+0000 mon.smithi084 (mon.0) 358 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:57.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:54.376278+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:21:57.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:54.376374+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:21:57.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:55.829981+0000 mon.smithi084 (mon.0) 359 : cluster [INF] osd.3 [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] boot 2024-02-15T18:21:57.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:55.830037+0000 mon.smithi084 (mon.0) 360 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-15T18:21:57.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:55.830287+0000 mon.smithi084 (mon.0) 361 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:57.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:56.656804+0000 mon.smithi084 (mon.0) 362 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-02-15T18:21:57.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:54.376278+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:21:57.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:54.376374+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:21:57.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:55.829981+0000 mon.smithi084 (mon.0) 359 : cluster [INF] osd.3 [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] boot 2024-02-15T18:21:57.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:55.830037+0000 mon.smithi084 (mon.0) 360 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-15T18:21:57.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:55.830287+0000 mon.smithi084 (mon.0) 361 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:21:57.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:56.656804+0000 mon.smithi084 (mon.0) 362 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 -- 172.21.15.133:0/2618438447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 msgr2=0x7f22dc0f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 --2- 172.21.15.133:0/2618438447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 0x7f22dc0f63e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f22c4004660 tx=0x7f22c4009b30).stop 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 -- 172.21.15.133:0/2618438447 shutdown_connections 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 --2- 172.21.15.133:0/2618438447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 0x7f22dc0f63e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 --2- 172.21.15.133:0/2618438447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22dc0f4d60 0x7f22dc0f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 -- 172.21.15.133:0/2618438447 >> 172.21.15.133:0/2618438447 conn(0x7f22dc0f04c0 msgr2=0x7f22dc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 -- 172.21.15.133:0/2618438447 shutdown_connections 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 -- 172.21.15.133:0/2618438447 wait complete. 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 Processor -- start 2024-02-15T18:21:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.169+0000 7f22e3175700 1 -- start start 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22e3175700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22dc0f4d60 0x7f22dc107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22e3175700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 0x7f22dc107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22e3175700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc107b00 con 0x7f22dc0f4d60 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22e3175700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc107c40 con 0x7f22dc0f5f60 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22dbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 0x7f22dc107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22dbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 0x7f22dc107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39282/0 (socket says 172.21.15.133:39282) 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22dbfff700 1 -- 172.21.15.133:0/3897302558 learned_addr learned my addr 172.21.15.133:0/3897302558 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22e0f11700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22dc0f4d60 0x7f22dc107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22dbfff700 1 -- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22dc0f4d60 msgr2=0x7f22dc107060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22dbfff700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22dc0f4d60 0x7f22dc107060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22dbfff700 1 -- 172.21.15.133:0/3897302558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c4005040 con 0x7f22dc0f5f60 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22dbfff700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 0x7f22dc107550 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f22c4009830 tx=0x7f22c4009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.170+0000 7f22d97fa700 1 -- 172.21.15.133:0/3897302558 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c4018070 con 0x7f22dc0f5f60 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.171+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc108580 con 0x7f22dc0f5f60 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.171+0000 7f22d97fa700 1 -- 172.21.15.133:0/3897302558 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22c4007ba0 con 0x7f22dc0f5f60 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.171+0000 7f22d97fa700 1 -- 172.21.15.133:0/3897302558 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c401c3c0 con 0x7f22dc0f5f60 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.171+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc108ae0 con 0x7f22dc0f5f60 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.172+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc045ad0 con 0x7f22dc0f5f60 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.172+0000 7f22d97fa700 1 -- 172.21.15.133:0/3897302558 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f22c401c680 con 0x7f22dc0f5f60 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.172+0000 7f22d97fa700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f22c805c2b0 0x7f22c805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.172+0000 7f22d97fa700 1 -- 172.21.15.133:0/3897302558 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f22c40774a0 con 0x7f22dc0f5f60 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.172+0000 7f22e0f11700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f22c805c2b0 0x7f22c805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.173+0000 7f22e0f11700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f22c805c2b0 0x7f22c805e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f22d4004fd0 tx=0x7f22d4009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.176+0000 7f22d97fa700 1 -- 172.21.15.133:0/3897302558 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f22c404a800 con 0x7f22dc0f5f60 2024-02-15T18:21:57.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:21:57.357+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f22dc0fa350 con 0x7f22c805c2b0 2024-02-15T18:21:58.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:56.374449+0000 mgr.smithi084.hjmnez (mgr.14162) 151 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 19 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:21:58.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:57.359291+0000 mgr.smithi084.hjmnez (mgr.14162) 152 : audit [DBG] from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:21:58.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:57.360231+0000 mon.smithi084 (mon.0) 363 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:21:58.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:21:57.361567+0000 mgr.smithi084.hjmnez (mgr.14162) 153 : cephadm [INF] Applying service osd.None on host smithi133... 2024-02-15T18:21:58.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:57.361849+0000 mon.smithi084 (mon.0) 364 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:21:58.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:57.362620+0000 mon.smithi084 (mon.0) 365 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:58.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:57.655272+0000 mon.smithi084 (mon.0) 366 : cluster [DBG] osdmap e29: 4 total, 4 up, 4 in 2024-02-15T18:21:58.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:56.374449+0000 mgr.smithi084.hjmnez (mgr.14162) 151 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 19 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:21:58.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:57.359291+0000 mgr.smithi084.hjmnez (mgr.14162) 152 : audit [DBG] from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:21:58.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:57.360231+0000 mon.smithi084 (mon.0) 363 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:21:58.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:21:57.361567+0000 mgr.smithi084.hjmnez (mgr.14162) 153 : cephadm [INF] Applying service osd.None on host smithi133... 2024-02-15T18:21:58.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:57.361849+0000 mon.smithi084 (mon.0) 364 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:21:58.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:57.362620+0000 mon.smithi084 (mon.0) 365 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:58.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:57.655272+0000 mon.smithi084 (mon.0) 366 : cluster [DBG] osdmap e29: 4 total, 4 up, 4 in 2024-02-15T18:22:00.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:21:58.374942+0000 mgr.smithi084.hjmnez (mgr.14162) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:00.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:59.396619+0000 mon.smithi084 (mon.0) 367 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:00.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:59.402196+0000 mon.smithi084 (mon.0) 368 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:00.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:21:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:21:59.405134+0000 mon.smithi084 (mon.0) 369 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:21:58.374942+0000 mgr.smithi084.hjmnez (mgr.14162) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:59.396619+0000 mon.smithi084 (mon.0) 367 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:59.402196+0000 mon.smithi084 (mon.0) 368 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:21:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:21:59.405134+0000 mon.smithi084 (mon.0) 369 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:01.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:21:59.391735+0000 mgr.smithi084.hjmnez (mgr.14162) 155 : cephadm [INF] Detected new or changed devices on smithi133 2024-02-15T18:22:01.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:00.121137+0000 mon.smithi133 (mon.1) 6 : audit [INF] from='client.? 172.21.15.133:0/4034797773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65"}]: dispatch 2024-02-15T18:22:01.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:00.121582+0000 mon.smithi084 (mon.0) 370 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65"}]: dispatch 2024-02-15T18:22:01.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:00.125048+0000 mon.smithi084 (mon.0) 371 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65"}]': finished 2024-02-15T18:22:01.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:00.125092+0000 mon.smithi084 (mon.0) 372 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-15T18:22:01.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:00.125172+0000 mon.smithi084 (mon.0) 373 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:01.015 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:00.530622+0000 mon.smithi133 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.133:0/4033191329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:22:01.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:21:59.391735+0000 mgr.smithi084.hjmnez (mgr.14162) 155 : cephadm [INF] Detected new or changed devices on smithi133 2024-02-15T18:22:01.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:00.121137+0000 mon.smithi133 (mon.1) 6 : audit [INF] from='client.? 172.21.15.133:0/4034797773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65"}]: dispatch 2024-02-15T18:22:01.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:00.121582+0000 mon.smithi084 (mon.0) 370 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65"}]: dispatch 2024-02-15T18:22:01.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:00.125048+0000 mon.smithi084 (mon.0) 371 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65"}]': finished 2024-02-15T18:22:01.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:00.125092+0000 mon.smithi084 (mon.0) 372 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-15T18:22:01.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:00.125172+0000 mon.smithi084 (mon.0) 373 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:01.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:00.530622+0000 mon.smithi133 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.133:0/4033191329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:22:02.377 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:00.375249+0000 mgr.smithi084.hjmnez (mgr.14162) 156 : cluster [DBG] pgmap v125: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:02.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:00.375249+0000 mgr.smithi084.hjmnez (mgr.14162) 156 : cluster [DBG] pgmap v125: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:04.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:02.375705+0000 mgr.smithi084.hjmnez (mgr.14162) 157 : cluster [DBG] pgmap v126: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:04.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:03.672364+0000 mon.smithi084 (mon.0) 374 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:04.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:03.677706+0000 mon.smithi084 (mon.0) 375 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:04.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:02.375705+0000 mgr.smithi084.hjmnez (mgr.14162) 157 : cluster [DBG] pgmap v126: 1 pgs: 1 activating; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:04.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:03.672364+0000 mon.smithi084 (mon.0) 374 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:04.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:03.677706+0000 mon.smithi084 (mon.0) 375 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:06.170 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:04.376206+0000 mgr.smithi084.hjmnez (mgr.14162) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:04.376206+0000 mgr.smithi084.hjmnez (mgr.14162) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:07.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:06.376665+0000 mgr.smithi084.hjmnez (mgr.14162) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:07.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:07.128226+0000 mon.smithi084 (mon.0) 376 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T18:22:07.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:07.129062+0000 mon.smithi084 (mon.0) 377 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:22:07.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:22:07.129676+0000 mgr.smithi084.hjmnez (mgr.14162) 160 : cephadm [INF] Deploying daemon osd.4 on smithi133 2024-02-15T18:22:08.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:06.376665+0000 mgr.smithi084.hjmnez (mgr.14162) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:08.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:07.128226+0000 mon.smithi084 (mon.0) 376 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T18:22:08.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:07.129062+0000 mon.smithi084 (mon.0) 377 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:22:08.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:22:07.129676+0000 mgr.smithi084.hjmnez (mgr.14162) 160 : cephadm [INF] Deploying daemon osd.4 on smithi133 2024-02-15T18:22:10.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:08.377122+0000 mgr.smithi084.hjmnez (mgr.14162) 161 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:10.099 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:08.377122+0000 mgr.smithi084.hjmnez (mgr.14162) 161 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:10.874 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 4 on host 'smithi133' 2024-02-15T18:22:10.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.873+0000 7f22d97fa700 1 -- 172.21.15.133:0/3897302558 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f22dc0fa350 con 0x7f22c805c2b0 2024-02-15T18:22:10.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f22c805c2b0 msgr2=0x7f22c805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:10.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f22c805c2b0 0x7f22c805e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f22d4004fd0 tx=0x7f22d4009040).stop 2024-02-15T18:22:10.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 msgr2=0x7f22dc107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:10.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 0x7f22dc107550 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f22c4009830 tx=0x7f22c4009b30).stop 2024-02-15T18:22:10.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 shutdown_connections 2024-02-15T18:22:10.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f22c805c2b0 0x7f22c805e770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:10.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22dc0f4d60 0x7f22dc107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:10.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 --2- 172.21.15.133:0/3897302558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22dc0f5f60 0x7f22dc107550 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:10.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 >> 172.21.15.133:0/3897302558 conn(0x7f22dc0f04c0 msgr2=0x7f22dc0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:10.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 shutdown_connections 2024-02-15T18:22:10.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:10.875+0000 7f22e3175700 1 -- 172.21.15.133:0/3897302558 wait complete. 2024-02-15T18:22:11.564 DEBUG:teuthology.orchestra.run.smithi133:osd.4> sudo journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.4.service 2024-02-15T18:22:11.567 INFO:tasks.cephadm:Deploying osd.5 on smithi133 with /dev/vg_nvme/lv_2... 2024-02-15T18:22:11.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-15T18:22:11.596 INFO:journalctl@ceph.osd.4.smithi133.stdout:-- Logs begin at Thu 2024-02-15 18:00:43 UTC. -- 2024-02-15T18:22:11.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:10.377415+0000 mgr.smithi084.hjmnez (mgr.14162) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:11.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:10.859723+0000 mon.smithi084 (mon.0) 378 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:11.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:10.865810+0000 mon.smithi084 (mon.0) 379 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:11.764 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:10.872853+0000 mon.smithi084 (mon.0) 380 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:11.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:10.377415+0000 mgr.smithi084.hjmnez (mgr.14162) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:11.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:10.859723+0000 mon.smithi084 (mon.0) 378 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:11.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:10.865810+0000 mon.smithi084 (mon.0) 379 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:11.896 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:10.872853+0000 mon.smithi084 (mon.0) 380 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:13.714 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:12.377824+0000 mgr.smithi084.hjmnez (mgr.14162) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:14.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:12.377824+0000 mgr.smithi084.hjmnez (mgr.14162) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:14.229 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-15T18:22:14.229 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-15T18:22:14.229 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2024-02-15T18:22:14.229 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2024-02-15T18:22:14.229 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122962 s, 853 MB/s 2024-02-15T18:22:14.229 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2024-02-15T18:22:15.012 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:22:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.4[48672]: debug 2024-02-15T18:22:14.753+0000 7fcb6003c080 -1 osd.4 0 log_to_monitors {default=true} 2024-02-15T18:22:15.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi133:vg_nvme/lv_2 2024-02-15T18:22:15.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:14.378287+0000 mgr.smithi084.hjmnez (mgr.14162) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:15.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:14.757043+0000 mon.smithi133 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:22:15.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:14.757546+0000 mon.smithi084 (mon.0) 381 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:22:15.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:15.113080+0000 mon.smithi084 (mon.0) 382 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:15.835 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:15.617480+0000 mon.smithi084 (mon.0) 383 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:16.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:14.378287+0000 mgr.smithi084.hjmnez (mgr.14162) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:16.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:14.757043+0000 mon.smithi133 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:22:16.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:14.757546+0000 mon.smithi084 (mon.0) 381 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:22:16.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:15.113080+0000 mon.smithi084 (mon.0) 382 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:16.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:15.617480+0000 mon.smithi084 (mon.0) 383 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:16.797 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:22:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.4[48672]: debug 2024-02-15T18:22:16.679+0000 7fcb565ad700 -1 osd.4 0 waiting for initial osdmap 2024-02-15T18:22:16.797 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:22:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.4[48672]: debug 2024-02-15T18:22:16.686+0000 7fcb50d25700 -1 osd.4 32 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-15T18:22:16.797 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:15.673422+0000 mon.smithi084 (mon.0) 384 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T18:22:16.797 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:15.673478+0000 mon.smithi084 (mon.0) 385 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-02-15T18:22:16.797 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:15.673591+0000 mon.smithi084 (mon.0) 386 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:16.797 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:15.674855+0000 mon.smithi133 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:22:16.797 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:15.675137+0000 mon.smithi084 (mon.0) 387 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:22:17.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:15.673422+0000 mon.smithi084 (mon.0) 384 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T18:22:17.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:15.673478+0000 mon.smithi084 (mon.0) 385 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-02-15T18:22:17.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:15.673591+0000 mon.smithi084 (mon.0) 386 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:17.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:15.674855+0000 mon.smithi133 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:22:17.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:15.675137+0000 mon.smithi084 (mon.0) 387 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:22:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.215+0000 7f5b42acd700 1 -- 172.21.15.133:0/519443620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f66d0 msgr2=0x7f5b3c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.215+0000 7f5b42acd700 1 --2- 172.21.15.133:0/519443620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f66d0 0x7f5b3c0f6b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f5b38004660 tx=0x7f5b38009b30).stop 2024-02-15T18:22:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.215+0000 7f5b42acd700 1 -- 172.21.15.133:0/519443620 shutdown_connections 2024-02-15T18:22:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.215+0000 7f5b42acd700 1 --2- 172.21.15.133:0/519443620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f66d0 0x7f5b3c0f6b30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.215+0000 7f5b42acd700 1 --2- 172.21.15.133:0/519443620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b3c0f5430 0x7f5b3c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.215+0000 7f5b42acd700 1 -- 172.21.15.133:0/519443620 >> 172.21.15.133:0/519443620 conn(0x7f5b3c0f0b90 msgr2=0x7f5b3c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.215+0000 7f5b42acd700 1 -- 172.21.15.133:0/519443620 shutdown_connections 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.215+0000 7f5b42acd700 1 -- 172.21.15.133:0/519443620 wait complete. 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b42acd700 1 Processor -- start 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b42acd700 1 -- start start 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b42acd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f5430 0x7f5b3c109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b42acd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b3c0f66d0 0x7f5b3c10c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b42acd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c060470 con 0x7f5b3c0f66d0 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b42acd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0605b0 con 0x7f5b3c0f5430 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b41acb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f5430 0x7f5b3c109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b41acb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f5430 0x7f5b3c109b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43176/0 (socket says 172.21.15.133:43176) 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b41acb700 1 -- 172.21.15.133:0/2783570851 learned_addr learned my addr 172.21.15.133:0/2783570851 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b41acb700 1 -- 172.21.15.133:0/2783570851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b3c0f66d0 msgr2=0x7f5b3c10c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b41acb700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b3c0f66d0 0x7f5b3c10c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b41acb700 1 -- 172.21.15.133:0/2783570851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b38005040 con 0x7f5b3c0f5430 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b41acb700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f5430 0x7f5b3c109b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5b300093f0 tx=0x7f5b30006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b2e7fc700 1 -- 172.21.15.133:0/2783570851 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b30009ea0 con 0x7f5b3c0f5430 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b2e7fc700 1 -- 172.21.15.133:0/2783570851 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b30013b10 con 0x7f5b3c0f5430 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c10c6e0 con 0x7f5b3c0f5430 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b2e7fc700 1 -- 172.21.15.133:0/2783570851 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3000dbc0 con 0x7f5b3c0f5430 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.216+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c10cc70 con 0x7f5b3c0f5430 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.217+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c059100 con 0x7f5b3c0f5430 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.218+0000 7f5b2e7fc700 1 -- 172.21.15.133:0/2783570851 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5b3001a060 con 0x7f5b3c0f5430 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.218+0000 7f5b2e7fc700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b2805c300 0x7f5b2805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.218+0000 7f5b2e7fc700 1 -- 172.21.15.133:0/2783570851 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f5b30075840 con 0x7f5b3c0f5430 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.218+0000 7f5b412ca700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b2805c300 0x7f5b2805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.219+0000 7f5b412ca700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b2805c300 0x7f5b2805e7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5b38009f50 tx=0x7f5b38009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:17.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.222+0000 7f5b2e7fc700 1 -- 172.21.15.133:0/2783570851 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5b30048b90 con 0x7f5b3c0f5430 2024-02-15T18:22:17.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:17.406+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b3c057f10 con 0x7f5b2805c300 2024-02-15T18:22:17.969 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:16.378607+0000 mgr.smithi084.hjmnez (mgr.14162) 165 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:17.969 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:16.675789+0000 mon.smithi084 (mon.0) 388 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-02-15T18:22:17.969 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:16.675862+0000 mon.smithi084 (mon.0) 389 : cluster [DBG] osdmap e32: 5 total, 4 up, 5 in 2024-02-15T18:22:17.969 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:16.676258+0000 mon.smithi084 (mon.0) 390 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:17.969 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:16.680277+0000 mon.smithi084 (mon.0) 391 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:17.969 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:17.407999+0000 mon.smithi084 (mon.0) 392 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:22:17.969 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:17.409460+0000 mon.smithi084 (mon.0) 393 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:22:17.969 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:17.410101+0000 mon.smithi084 (mon.0) 394 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:22:18.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:16.378607+0000 mgr.smithi084.hjmnez (mgr.14162) 165 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:22:18.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:16.675789+0000 mon.smithi084 (mon.0) 388 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-02-15T18:22:18.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:16.675862+0000 mon.smithi084 (mon.0) 389 : cluster [DBG] osdmap e32: 5 total, 4 up, 5 in 2024-02-15T18:22:18.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:16.676258+0000 mon.smithi084 (mon.0) 390 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:18.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:16.680277+0000 mon.smithi084 (mon.0) 391 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:18.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:17.407999+0000 mon.smithi084 (mon.0) 392 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:22:18.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:17.409460+0000 mon.smithi084 (mon.0) 393 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:22:18.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:17.410101+0000 mon.smithi084 (mon.0) 394 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:22:18.984 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:15.726144+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:22:18.984 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:15.726237+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:22:18.984 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:17.407113+0000 mgr.smithi084.hjmnez (mgr.14162) 166 : audit [DBG] from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:18.985 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:22:17.409201+0000 mgr.smithi084.hjmnez (mgr.14162) 167 : cephadm [INF] Applying service osd.None on host smithi133... 2024-02-15T18:22:18.985 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:17.678414+0000 mon.smithi084 (mon.0) 395 : cluster [INF] osd.4 [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] boot 2024-02-15T18:22:18.985 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:17.678449+0000 mon.smithi084 (mon.0) 396 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-15T18:22:18.985 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:17.678574+0000 mon.smithi084 (mon.0) 397 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:19.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:15.726144+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:22:19.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:15.726237+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:22:19.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:17.407113+0000 mgr.smithi084.hjmnez (mgr.14162) 166 : audit [DBG] from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:19.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:22:17.409201+0000 mgr.smithi084.hjmnez (mgr.14162) 167 : cephadm [INF] Applying service osd.None on host smithi133... 2024-02-15T18:22:19.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:17.678414+0000 mon.smithi084 (mon.0) 395 : cluster [INF] osd.4 [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] boot 2024-02-15T18:22:19.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:17.678449+0000 mon.smithi084 (mon.0) 396 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-15T18:22:19.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:17.678574+0000 mon.smithi084 (mon.0) 397 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:22:19.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:18.379155+0000 mgr.smithi084.hjmnez (mgr.14162) 168 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:19.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:18.687378+0000 mon.smithi084 (mon.0) 398 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-02-15T18:22:20.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:18.379155+0000 mgr.smithi084.hjmnez (mgr.14162) 168 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:20.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:18.687378+0000 mon.smithi084 (mon.0) 398 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-02-15T18:22:21.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:22:20.135626+0000 mgr.smithi084.hjmnez (mgr.14162) 169 : cephadm [INF] Detected new or changed devices on smithi133 2024-02-15T18:22:21.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:20.140567+0000 mon.smithi084 (mon.0) 399 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:21.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:20.507050+0000 mon.smithi084 (mon.0) 400 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:21.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:20.510358+0000 mon.smithi084 (mon.0) 401 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:21.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:22:20.135626+0000 mgr.smithi084.hjmnez (mgr.14162) 169 : cephadm [INF] Detected new or changed devices on smithi133 2024-02-15T18:22:21.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:20.140567+0000 mon.smithi084 (mon.0) 399 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:21.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:20.507050+0000 mon.smithi084 (mon.0) 400 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:21.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:20.510358+0000 mon.smithi084 (mon.0) 401 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:20.379524+0000 mgr.smithi084.hjmnez (mgr.14162) 170 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:21.439419+0000 mon.smithi133 (mon.1) 10 : audit [INF] from='client.? 172.21.15.133:0/3331505825' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af0ca6d-3df7-42a9-9cbf-f41a4132671c"}]: dispatch 2024-02-15T18:22:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:21.439740+0000 mon.smithi084 (mon.0) 402 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af0ca6d-3df7-42a9-9cbf-f41a4132671c"}]: dispatch 2024-02-15T18:22:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:21.444040+0000 mon.smithi084 (mon.0) 403 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0af0ca6d-3df7-42a9-9cbf-f41a4132671c"}]': finished 2024-02-15T18:22:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:21.444089+0000 mon.smithi084 (mon.0) 404 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-15T18:22:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:21.444185+0000 mon.smithi084 (mon.0) 405 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:21.836982+0000 mon.smithi133 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.133:0/4092555101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:22:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:20.379524+0000 mgr.smithi084.hjmnez (mgr.14162) 170 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:21.439419+0000 mon.smithi133 (mon.1) 10 : audit [INF] from='client.? 172.21.15.133:0/3331505825' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af0ca6d-3df7-42a9-9cbf-f41a4132671c"}]: dispatch 2024-02-15T18:22:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:21.439740+0000 mon.smithi084 (mon.0) 402 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af0ca6d-3df7-42a9-9cbf-f41a4132671c"}]: dispatch 2024-02-15T18:22:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:21.444040+0000 mon.smithi084 (mon.0) 403 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0af0ca6d-3df7-42a9-9cbf-f41a4132671c"}]': finished 2024-02-15T18:22:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:21.444089+0000 mon.smithi084 (mon.0) 404 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-15T18:22:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:21.444185+0000 mon.smithi084 (mon.0) 405 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:22.647 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:21.836982+0000 mon.smithi133 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.133:0/4092555101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:22:24.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:22.379875+0000 mgr.smithi084.hjmnez (mgr.14162) 171 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:24.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:22.379875+0000 mgr.smithi084.hjmnez (mgr.14162) 171 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:26.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:24.380205+0000 mgr.smithi084.hjmnez (mgr.14162) 172 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:26.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:24.872223+0000 mon.smithi084 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:26.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:25.118122+0000 mon.smithi084 (mon.0) 407 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:26.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:24.380205+0000 mgr.smithi084.hjmnez (mgr.14162) 172 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:26.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:24.872223+0000 mon.smithi084 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:26.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:25.118122+0000 mon.smithi084 (mon.0) 407 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:28.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:26.380638+0000 mgr.smithi084.hjmnez (mgr.14162) 173 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:28.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:26.380638+0000 mgr.smithi084.hjmnez (mgr.14162) 173 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:29.011 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:28.486237+0000 mon.smithi084 (mon.0) 408 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:22:29.011 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:28.486430+0000 mon.smithi084 (mon.0) 409 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:22:29.011 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:28.733237+0000 mon.smithi084 (mon.0) 410 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T18:22:29.011 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:28.733952+0000 mon.smithi084 (mon.0) 411 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:22:29.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:28.486237+0000 mon.smithi084 (mon.0) 408 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:22:29.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:28.486430+0000 mon.smithi084 (mon.0) 409 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:22:29.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:28.733237+0000 mon.smithi084 (mon.0) 410 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T18:22:29.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:28.733952+0000 mon.smithi084 (mon.0) 411 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:22:30.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:28.381048+0000 mgr.smithi084.hjmnez (mgr.14162) 174 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:30.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:22:28.734529+0000 mgr.smithi084.hjmnez (mgr.14162) 175 : cephadm [INF] Deploying daemon osd.5 on smithi133 2024-02-15T18:22:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:28.381048+0000 mgr.smithi084.hjmnez (mgr.14162) 174 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:22:28.734529+0000 mgr.smithi084.hjmnez (mgr.14162) 175 : cephadm [INF] Deploying daemon osd.5 on smithi133 2024-02-15T18:22:32.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:30.381471+0000 mgr.smithi084.hjmnez (mgr.14162) 176 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:32.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:30.381471+0000 mgr.smithi084.hjmnez (mgr.14162) 176 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:32.424 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 5 on host 'smithi133' 2024-02-15T18:22:32.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.423+0000 7f5b2e7fc700 1 -- 172.21.15.133:0/2783570851 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5b3c057f10 con 0x7f5b2805c300 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b2805c300 msgr2=0x7f5b2805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b2805c300 0x7f5b2805e7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5b38009f50 tx=0x7f5b38009b30).stop 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f5430 msgr2=0x7f5b3c109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f5430 0x7f5b3c109b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5b300093f0 tx=0x7f5b30006ec0).stop 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 shutdown_connections 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f5b2805c300 0x7f5b2805e7c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b3c0f5430 0x7f5b3c109b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 --2- 172.21.15.133:0/2783570851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b3c0f66d0 0x7f5b3c10c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 >> 172.21.15.133:0/2783570851 conn(0x7f5b3c0f0b90 msgr2=0x7f5b3c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 shutdown_connections 2024-02-15T18:22:32.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:32.426+0000 7f5b42acd700 1 -- 172.21.15.133:0/2783570851 wait complete. 2024-02-15T18:22:33.095 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:32.413400+0000 mon.smithi084 (mon.0) 412 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:33.095 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:32.417977+0000 mon.smithi084 (mon.0) 413 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:33.095 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:32.423343+0000 mon.smithi084 (mon.0) 414 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:33.117 DEBUG:teuthology.orchestra.run.smithi133:osd.5> sudo journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.5.service 2024-02-15T18:22:33.119 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-15T18:22:33.119 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd stat -f json 2024-02-15T18:22:33.146 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:32.413400+0000 mon.smithi084 (mon.0) 412 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:33.147 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:32.417977+0000 mon.smithi084 (mon.0) 413 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:33.147 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:32.423343+0000 mon.smithi084 (mon.0) 414 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:33.151 INFO:journalctl@ceph.osd.5.smithi133.stdout:-- Logs begin at Thu 2024-02-15 18:00:43 UTC. -- 2024-02-15T18:22:34.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:32.381985+0000 mgr.smithi084.hjmnez (mgr.14162) 177 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:34.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:32.381985+0000 mgr.smithi084.hjmnez (mgr.14162) 177 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:35.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.633+0000 7f86d99a0700 1 -- 172.21.15.84:0/1666121436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 msgr2=0x7f86d40f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:35.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.633+0000 7f86d99a0700 1 --2- 172.21.15.84:0/1666121436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 0x7f86d40f7920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f86c0004660 tx=0x7f86c0009b30).stop 2024-02-15T18:22:35.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 -- 172.21.15.84:0/1666121436 shutdown_connections 2024-02-15T18:22:35.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 --2- 172.21.15.84:0/1666121436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 0x7f86d40f7920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:35.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 --2- 172.21.15.84:0/1666121436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d40f4800 0x7f86d40f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:35.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 -- 172.21.15.84:0/1666121436 >> 172.21.15.84:0/1666121436 conn(0x7f86d40f0320 msgr2=0x7f86d40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:35.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 -- 172.21.15.84:0/1666121436 shutdown_connections 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 -- 172.21.15.84:0/1666121436 wait complete. 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 Processor -- start 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 -- start start 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d40f4800 0x7f86d4106e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 0x7f86d4107370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d4107920 con 0x7f86d40f51a0 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.634+0000 7f86d99a0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d4107a60 con 0x7f86d40f4800 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 0x7f86d4107370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 0x7f86d4107370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38344/0 (socket says 172.21.15.84:38344) 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d3fff700 1 -- 172.21.15.84:0/2047885063 learned_addr learned my addr 172.21.15.84:0/2047885063 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d899e700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d40f4800 0x7f86d4106e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d3fff700 1 -- 172.21.15.84:0/2047885063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d40f4800 msgr2=0x7f86d4106e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:35.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d3fff700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d40f4800 0x7f86d4106e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d3fff700 1 -- 172.21.15.84:0/2047885063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0005040 con 0x7f86d40f51a0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d3fff700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 0x7f86d4107370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f86c0004e30 tx=0x7f86c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d17fa700 1 -- 172.21.15.84:0/2047885063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86c0018070 con 0x7f86d40f51a0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d17fa700 1 -- 172.21.15.84:0/2047885063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86c0007ba0 con 0x7f86d40f51a0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d41083a0 con 0x7f86d40f51a0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d17fa700 1 -- 172.21.15.84:0/2047885063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86c001c620 con 0x7f86d40f51a0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.635+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d4108900 con 0x7f86d40f51a0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.636+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d4045ad0 con 0x7f86d40f51a0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.636+0000 7f86d17fa700 1 -- 172.21.15.84:0/2047885063 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f86c0007d10 con 0x7f86d40f51a0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.637+0000 7f86d17fa700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f86c405c300 0x7f86c405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.637+0000 7f86d17fa700 1 -- 172.21.15.84:0/2047885063 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4235+0+0 (secure 0 0 0) 0x7f86c0077670 con 0x7f86d40f51a0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.637+0000 7f86d899e700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f86c405c300 0x7f86c405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.637+0000 7f86d899e700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f86c405c300 0x7f86c405e7c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f86d405eb60 tx=0x7f86c8009c00).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:35.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.641+0000 7f86d17fa700 1 -- 172.21.15.84:0/2047885063 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f86c004a830 con 0x7f86d40f51a0 2024-02-15T18:22:35.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.796+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f86d4027a00 con 0x7f86d40f51a0 2024-02-15T18:22:35.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.797+0000 7f86d17fa700 1 -- 172.21.15.84:0/2047885063 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) v1 ==== 74+0+130 (secure 0 0 0) 0x7f86c004de50 con 0x7f86d40f51a0 2024-02-15T18:22:35.797 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f86c405c300 msgr2=0x7f86c405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f86c405c300 0x7f86c405e7c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f86d405eb60 tx=0x7f86c8009c00).stop 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 msgr2=0x7f86d4107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 0x7f86d4107370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f86c0004e30 tx=0x7f86c0009b30).stop 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 shutdown_connections 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f86c405c300 0x7f86c405e7c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d40f4800 0x7f86d4106e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 --2- 172.21.15.84:0/2047885063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d40f51a0 0x7f86d4107370 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 >> 172.21.15.84:0/2047885063 conn(0x7f86d40f0320 msgr2=0x7f86d40fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 shutdown_connections 2024-02-15T18:22:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:35.799+0000 7f86d99a0700 1 -- 172.21.15.84:0/2047885063 wait complete. 2024-02-15T18:22:36.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:34.382270+0000 mgr.smithi084.hjmnez (mgr.14162) 178 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:36.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:34.839648+0000 mon.smithi084 (mon.0) 415 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:36.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:35.797948+0000 mon.smithi084 (mon.0) 416 : audit [DBG] from='client.? 172.21.15.84:0/2047885063' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T18:22:36.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:34.382270+0000 mgr.smithi084.hjmnez (mgr.14162) 178 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:36.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:34.839648+0000 mon.smithi084 (mon.0) 415 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:36.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:35.797948+0000 mon.smithi084 (mon.0) 416 : audit [DBG] from='client.? 172.21.15.84:0/2047885063' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T18:22:36.532 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:22:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.5[52339]: debug 2024-02-15T18:22:36.267+0000 7f5393fc1080 -1 osd.5 0 log_to_monitors {default=true} 2024-02-15T18:22:37.076 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1708021337,"num_in_osds":6,"osd_in_since":1708021341,"num_remapped_pgs":0} 2024-02-15T18:22:37.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:36.271632+0000 mon.smithi133 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:22:37.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:36.271981+0000 mon.smithi084 (mon.0) 417 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:22:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:36.271632+0000 mon.smithi133 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:22:37.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:36.271981+0000 mon.smithi084 (mon.0) 417 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:22:38.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:36.382586+0000 mgr.smithi084.hjmnez (mgr.14162) 179 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:38.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:36.850268+0000 mon.smithi084 (mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T18:22:38.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:36.850339+0000 mon.smithi084 (mon.0) 419 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-15T18:22:38.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:36.850444+0000 mon.smithi084 (mon.0) 420 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:38.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:36.850875+0000 mon.smithi133 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:22:38.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:36.851146+0000 mon.smithi084 (mon.0) 421 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:22:38.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd stat -f json 2024-02-15T18:22:38.128 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:22:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.5[52339]: debug 2024-02-15T18:22:37.853+0000 7f538a532700 -1 osd.5 0 waiting for initial osdmap 2024-02-15T18:22:38.128 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:22:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.5[52339]: debug 2024-02-15T18:22:37.861+0000 7f53864ad700 -1 osd.5 37 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-15T18:22:38.128 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:36.382586+0000 mgr.smithi084.hjmnez (mgr.14162) 179 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:38.129 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:36.850268+0000 mon.smithi084 (mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T18:22:38.129 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:36.850339+0000 mon.smithi084 (mon.0) 419 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-15T18:22:38.129 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:36.850444+0000 mon.smithi084 (mon.0) 420 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:38.129 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:36.850875+0000 mon.smithi133 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:22:38.129 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:36.851146+0000 mon.smithi084 (mon.0) 421 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:22:39.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:37.852196+0000 mon.smithi084 (mon.0) 422 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-02-15T18:22:39.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:37.852274+0000 mon.smithi084 (mon.0) 423 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-02-15T18:22:39.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:37.852858+0000 mon.smithi084 (mon.0) 424 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:39.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:37.855222+0000 mon.smithi084 (mon.0) 425 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:39.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:22:38.346665+0000 mgr.smithi084.hjmnez (mgr.14162) 180 : cephadm [INF] Detected new or changed devices on smithi133 2024-02-15T18:22:39.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:38.350965+0000 mon.smithi084 (mon.0) 426 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:39.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:38.855277+0000 mon.smithi084 (mon.0) 427 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:39.155 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:37.852196+0000 mon.smithi084 (mon.0) 422 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-02-15T18:22:39.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:37.852274+0000 mon.smithi084 (mon.0) 423 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-02-15T18:22:39.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:37.852858+0000 mon.smithi084 (mon.0) 424 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:39.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:37.855222+0000 mon.smithi084 (mon.0) 425 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:39.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:22:38.346665+0000 mgr.smithi084.hjmnez (mgr.14162) 180 : cephadm [INF] Detected new or changed devices on smithi133 2024-02-15T18:22:39.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:38.350965+0000 mon.smithi084 (mon.0) 426 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:39.156 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:38.855277+0000 mon.smithi084 (mon.0) 427 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:40.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:37.273269+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:22:40.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:37.273409+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:22:40.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:38.382909+0000 mgr.smithi084.hjmnez (mgr.14162) 181 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:40.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:38.861905+0000 mon.smithi084 (mon.0) 428 : cluster [INF] osd.5 [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] boot 2024-02-15T18:22:40.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:38.861944+0000 mon.smithi084 (mon.0) 429 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-15T18:22:40.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:38.862100+0000 mon.smithi084 (mon.0) 430 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:40.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:38.918442+0000 mon.smithi084 (mon.0) 431 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:40.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:38.923955+0000 mon.smithi084 (mon.0) 432 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:40.147 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:38.926306+0000 mon.smithi084 (mon.0) 433 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:40.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:37.273269+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:22:40.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:37.273409+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:22:40.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:38.382909+0000 mgr.smithi084.hjmnez (mgr.14162) 181 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:22:40.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:38.861905+0000 mon.smithi084 (mon.0) 428 : cluster [INF] osd.5 [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] boot 2024-02-15T18:22:40.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:38.861944+0000 mon.smithi084 (mon.0) 429 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-15T18:22:40.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:38.862100+0000 mon.smithi084 (mon.0) 430 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:22:40.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:38.918442+0000 mon.smithi084 (mon.0) 431 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:40.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:38.923955+0000 mon.smithi084 (mon.0) 432 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:40.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:38.926306+0000 mon.smithi084 (mon.0) 433 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:40.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 -- 172.21.15.84:0/2538802231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f6860 msgr2=0x7fe7b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:40.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 --2- 172.21.15.84:0/2538802231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f6860 0x7fe7b40f6cc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe7a0004660 tx=0x7fe7a0009b30).stop 2024-02-15T18:22:40.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 -- 172.21.15.84:0/2538802231 shutdown_connections 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 --2- 172.21.15.84:0/2538802231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f6860 0x7fe7b40f6cc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 --2- 172.21.15.84:0/2538802231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b40f55c0 0x7fe7b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 -- 172.21.15.84:0/2538802231 >> 172.21.15.84:0/2538802231 conn(0x7fe7b40f0d40 msgr2=0x7fe7b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 -- 172.21.15.84:0/2538802231 shutdown_connections 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 -- 172.21.15.84:0/2538802231 wait complete. 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 Processor -- start 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.519+0000 7fe7baf57700 1 -- start start 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7baf57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f55c0 0x7fe7b4109d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7baf57700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b40f6860 0x7fe7b410c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7baf57700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40603c0 con 0x7fe7b40f55c0 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7baf57700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b4060500 con 0x7fe7b40f6860 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7b8cf3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f55c0 0x7fe7b4109d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7b8cf3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f55c0 0x7fe7b4109d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38358/0 (socket says 172.21.15.84:38358) 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7b8cf3700 1 -- 172.21.15.84:0/928927619 learned_addr learned my addr 172.21.15.84:0/928927619 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7b3fff700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b40f6860 0x7fe7b410c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7b8cf3700 1 -- 172.21.15.84:0/928927619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b40f6860 msgr2=0x7fe7b410c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7b8cf3700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b40f6860 0x7fe7b410c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7b8cf3700 1 -- 172.21.15.84:0/928927619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0005040 con 0x7fe7b40f55c0 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7b8cf3700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f55c0 0x7fe7b4109d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fe7a800c530 tx=0x7fe7a8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.520+0000 7fe7b17fa700 1 -- 172.21.15.84:0/928927619 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a800f650 con 0x7fe7b40f55c0 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.521+0000 7fe7b17fa700 1 -- 172.21.15.84:0/928927619 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7a800fc80 con 0x7fe7b40f55c0 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.521+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b410c840 con 0x7fe7b40f55c0 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.521+0000 7fe7b17fa700 1 -- 172.21.15.84:0/928927619 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a8012e20 con 0x7fe7b40f55c0 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.521+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b410cdd0 con 0x7fe7b40f55c0 2024-02-15T18:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.521+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b40f49b0 con 0x7fe7b40f55c0 2024-02-15T18:22:40.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.522+0000 7fe7b17fa700 1 -- 172.21.15.84:0/928927619 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe7a8019030 con 0x7fe7b40f55c0 2024-02-15T18:22:40.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.522+0000 7fe7b17fa700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe7a405c2b0 0x7fe7a405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:40.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.522+0000 7fe7b17fa700 1 -- 172.21.15.84:0/928927619 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fe7a8075830 con 0x7fe7b40f55c0 2024-02-15T18:22:40.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.522+0000 7fe7b3fff700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe7a405c2b0 0x7fe7a405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:40.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.522+0000 7fe7b3fff700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe7a405c2b0 0x7fe7a405e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe7a0004e30 tx=0x7fe7a0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:40.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.526+0000 7fe7b17fa700 1 -- 172.21.15.84:0/928927619 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe7a8048880 con 0x7fe7b40f55c0 2024-02-15T18:22:40.696 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:22:40.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.695+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe7b4045ad0 con 0x7fe7b40f55c0 2024-02-15T18:22:40.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.695+0000 7fe7b17fa700 1 -- 172.21.15.84:0/928927619 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7fe7a8017070 con 0x7fe7b40f55c0 2024-02-15T18:22:40.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe7a405c2b0 msgr2=0x7fe7a405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:40.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe7a405c2b0 0x7fe7a405e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe7a0004e30 tx=0x7fe7a0009b30).stop 2024-02-15T18:22:40.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f55c0 msgr2=0x7fe7b4109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:40.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f55c0 0x7fe7b4109d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fe7a800c530 tx=0x7fe7a8007e10).stop 2024-02-15T18:22:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 shutdown_connections 2024-02-15T18:22:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe7a405c2b0 0x7fe7a405e770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7b40f55c0 0x7fe7b4109d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 --2- 172.21.15.84:0/928927619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b40f6860 0x7fe7b410c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 >> 172.21.15.84:0/928927619 conn(0x7fe7b40f0d40 msgr2=0x7fe7b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 shutdown_connections 2024-02-15T18:22:40.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:40.697+0000 7fe7baf57700 1 -- 172.21.15.84:0/928927619 wait complete. 2024-02-15T18:22:41.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:39.930076+0000 mon.smithi084 (mon.0) 434 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-15T18:22:41.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:40.696340+0000 mon.smithi084 (mon.0) 435 : audit [DBG] from='client.? 172.21.15.84:0/928927619' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T18:22:41.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:39.930076+0000 mon.smithi084 (mon.0) 434 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-15T18:22:41.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:40.696340+0000 mon.smithi084 (mon.0) 435 : audit [DBG] from='client.? 172.21.15.84:0/928927619' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T18:22:41.582 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1708021358,"num_in_osds":6,"osd_in_since":1708021341,"num_remapped_pgs":0} 2024-02-15T18:22:41.583 INFO:tasks.cephadm:Setting up client nodes... 2024-02-15T18:22:41.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-15T18:22:42.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:41 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:40.383302+0000 mgr.smithi084.hjmnez (mgr.14162) 182 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:42.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:40.383302+0000 mgr.smithi084.hjmnez (mgr.14162) 182 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:44.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:42.383666+0000 mgr.smithi084.hjmnez (mgr.14162) 183 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:44.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:42.383666+0000 mgr.smithi084.hjmnez (mgr.14162) 183 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:44.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.543+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2016861360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 msgr2=0x7fca880f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:44.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.543+0000 7fca8cf1c700 1 --2- 172.21.15.84:0/2016861360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 0x7fca880f6cb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fca7c004660 tx=0x7fca7c009b30).stop 2024-02-15T18:22:44.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2016861360 shutdown_connections 2024-02-15T18:22:44.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 --2- 172.21.15.84:0/2016861360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 0x7fca880f6cb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 --2- 172.21.15.84:0/2016861360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca880f55b0 0x7fca880f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2016861360 >> 172.21.15.84:0/2016861360 conn(0x7fca880f0d10 msgr2=0x7fca880f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2016861360 shutdown_connections 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2016861360 wait complete. 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 Processor -- start 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 -- start start 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca880f55b0 0x7fca88105f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.544+0000 7fca8cf1c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 0x7fca88106430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca8cf1c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88106a70 con 0x7fca880f6850 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca8cf1c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88107320 con 0x7fca880f55b0 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 0x7fca88106430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 0x7fca88106430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44802/0 (socket says 172.21.15.84:44802) 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca85d9b700 1 -- 172.21.15.84:0/2602494564 learned_addr learned my addr 172.21.15.84:0/2602494564 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca8659c700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca880f55b0 0x7fca88105f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:44.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca85d9b700 1 -- 172.21.15.84:0/2602494564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca880f55b0 msgr2=0x7fca88105f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:44.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca85d9b700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca880f55b0 0x7fca88105f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:44.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca85d9b700 1 -- 172.21.15.84:0/2602494564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c005040 con 0x7fca880f6850 2024-02-15T18:22:44.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca85d9b700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 0x7fca88106430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fca7c009830 tx=0x7fca7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:44.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca76ffd700 1 -- 172.21.15.84:0/2602494564 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca7c018070 con 0x7fca880f6850 2024-02-15T18:22:44.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca88107520 con 0x7fca880f6850 2024-02-15T18:22:44.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca76ffd700 1 -- 172.21.15.84:0/2602494564 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca7c007d70 con 0x7fca880f6850 2024-02-15T18:22:44.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca76ffd700 1 -- 172.21.15.84:0/2602494564 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca7c01c620 con 0x7fca880f6850 2024-02-15T18:22:44.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.545+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca88107a80 con 0x7fca880f6850 2024-02-15T18:22:44.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.546+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca88045ad0 con 0x7fca880f6850 2024-02-15T18:22:44.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.546+0000 7fca76ffd700 1 -- 172.21.15.84:0/2602494564 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fca7c01d980 con 0x7fca880f6850 2024-02-15T18:22:44.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.547+0000 7fca76ffd700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fca7005c2b0 0x7fca7005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:44.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.547+0000 7fca76ffd700 1 -- 172.21.15.84:0/2602494564 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fca7c077a70 con 0x7fca880f6850 2024-02-15T18:22:44.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.547+0000 7fca8659c700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fca7005c2b0 0x7fca7005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:44.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.547+0000 7fca8659c700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fca7005c2b0 0x7fca7005e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fca880f66b0 tx=0x7fca78008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:44.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.551+0000 7fca76ffd700 1 -- 172.21.15.84:0/2602494564 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fca7c04aa10 con 0x7fca880f6850 2024-02-15T18:22:44.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.765+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fca880ff980 con 0x7fca880f6850 2024-02-15T18:22:44.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.769+0000 7fca76ffd700 1 -- 172.21.15.84:0/2602494564 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fca7c077e60 con 0x7fca880f6850 2024-02-15T18:22:44.769 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-02-15T18:22:44.769 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQB0Vs5lDEqwLRAA43ZNj4MItFnLGoeJomYdPQ== 2024-02-15T18:22:44.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.770+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fca7005c2b0 msgr2=0x7fca7005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:44.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.770+0000 7fca8cf1c700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fca7005c2b0 0x7fca7005e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fca880f66b0 tx=0x7fca78008040).stop 2024-02-15T18:22:44.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.770+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 msgr2=0x7fca88106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:44.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.770+0000 7fca8cf1c700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 0x7fca88106430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fca7c009830 tx=0x7fca7c009b30).stop 2024-02-15T18:22:44.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.770+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 shutdown_connections 2024-02-15T18:22:44.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.770+0000 7fca8cf1c700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fca7005c2b0 0x7fca7005e770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:44.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.770+0000 7fca8cf1c700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca880f55b0 0x7fca88105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:44.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.770+0000 7fca8cf1c700 1 --2- 172.21.15.84:0/2602494564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca880f6850 0x7fca88106430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:44.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.770+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 >> 172.21.15.84:0/2602494564 conn(0x7fca880f0d10 msgr2=0x7fca880fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:44.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.771+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 shutdown_connections 2024-02-15T18:22:44.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:44.771+0000 7fca8cf1c700 1 -- 172.21.15.84:0/2602494564 wait complete. 2024-02-15T18:22:45.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:44.766371+0000 mon.smithi084 (mon.0) 436 : audit [INF] from='client.? 172.21.15.84:0/2602494564' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:22:45.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:44.769720+0000 mon.smithi084 (mon.0) 437 : audit [INF] from='client.? 172.21.15.84:0/2602494564' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T18:22:45.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:44.766371+0000 mon.smithi084 (mon.0) 436 : audit [INF] from='client.? 172.21.15.84:0/2602494564' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:22:45.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:44.769720+0000 mon.smithi084 (mon.0) 437 : audit [INF] from='client.? 172.21.15.84:0/2602494564' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T18:22:45.655 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:22:45.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-15T18:22:45.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-15T18:22:45.698 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-15T18:22:46.128 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:44.383939+0000 mgr.smithi084.hjmnez (mgr.14162) 184 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:46.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:44.383939+0000 mgr.smithi084.hjmnez (mgr.14162) 184 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.544+0000 7f487dbee700 1 -- 172.21.15.133:0/2628356862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 msgr2=0x7f48780f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.544+0000 7f487dbee700 1 --2- 172.21.15.133:0/2628356862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 0x7f48780f6af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f486c004660 tx=0x7f486c009b30).stop 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.545+0000 7f487dbee700 1 -- 172.21.15.133:0/2628356862 shutdown_connections 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.545+0000 7f487dbee700 1 --2- 172.21.15.133:0/2628356862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48780f7970 0x7f48780f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.545+0000 7f487dbee700 1 --2- 172.21.15.133:0/2628356862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 0x7f48780f6af0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.545+0000 7f487dbee700 1 -- 172.21.15.133:0/2628356862 >> 172.21.15.133:0/2628356862 conn(0x7f48780f1e30 msgr2=0x7f48780f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.545+0000 7f487dbee700 1 -- 172.21.15.133:0/2628356862 shutdown_connections 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.545+0000 7f487dbee700 1 -- 172.21.15.133:0/2628356862 wait complete. 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.545+0000 7f487dbee700 1 Processor -- start 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.545+0000 7f487dbee700 1 -- start start 2024-02-15T18:22:47.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.545+0000 7f487dbee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 0x7f48781070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f487dbee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48780f7970 0x7f48781075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f487dbee700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4878107b50 con 0x7f48780f7970 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f487dbee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4878107c90 con 0x7f48780f66d0 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f48777fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 0x7f48781070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f48777fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 0x7f48781070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51186/0 (socket says 172.21.15.133:51186) 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f48777fe700 1 -- 172.21.15.133:0/224314698 learned_addr learned my addr 172.21.15.133:0/224314698 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f4876ffd700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48780f7970 0x7f48781075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f48777fe700 1 -- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48780f7970 msgr2=0x7f48781075a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f48777fe700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48780f7970 0x7f48781075a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f48777fe700 1 -- 172.21.15.133:0/224314698 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c005040 con 0x7f48780f66d0 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f48777fe700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 0x7f48781070b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f486c004e30 tx=0x7f486c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:47.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f485ffff700 1 -- 172.21.15.133:0/224314698 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f486c018070 con 0x7f48780f66d0 2024-02-15T18:22:47.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48781085d0 con 0x7f48780f66d0 2024-02-15T18:22:47.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4878108b30 con 0x7f48780f66d0 2024-02-15T18:22:47.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f485ffff700 1 -- 172.21.15.133:0/224314698 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f486c007ba0 con 0x7f48780f66d0 2024-02-15T18:22:47.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.546+0000 7f485ffff700 1 -- 172.21.15.133:0/224314698 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f486c01dd60 con 0x7f48780f66d0 2024-02-15T18:22:47.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.547+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4878045ad0 con 0x7f48780f66d0 2024-02-15T18:22:47.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.547+0000 7f485ffff700 1 -- 172.21.15.133:0/224314698 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f486c027440 con 0x7f48780f66d0 2024-02-15T18:22:47.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.548+0000 7f485ffff700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f486005c2b0 0x7f486005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:47.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.548+0000 7f485ffff700 1 -- 172.21.15.133:0/224314698 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f486c0774f0 con 0x7f48780f66d0 2024-02-15T18:22:47.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.548+0000 7f4876ffd700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f486005c2b0 0x7f486005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:47.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.548+0000 7f4876ffd700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f486005c2b0 0x7f486005e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4868004c40 tx=0x7f486800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:47.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.552+0000 7f485ffff700 1 -- 172.21.15.133:0/224314698 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f486c04a4f0 con 0x7f48780f66d0 2024-02-15T18:22:47.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.757+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f4878027a00 con 0x7f48780f66d0 2024-02-15T18:22:47.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.761+0000 7f485ffff700 1 -- 172.21.15.133:0/224314698 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f486c04db10 con 0x7f48780f66d0 2024-02-15T18:22:47.762 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2024-02-15T18:22:47.762 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQB3Vs5lZr5KLRAAgLuJnewij7+s0R22vq8aKw== 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f486005c2b0 msgr2=0x7f486005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f486005c2b0 0x7f486005e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4868004c40 tx=0x7f486800b040).stop 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 msgr2=0x7f48781070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 0x7f48781070b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f486c004e30 tx=0x7f486c009b30).stop 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 shutdown_connections 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f486005c2b0 0x7f486005e770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48780f66d0 0x7f48781070b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 --2- 172.21.15.133:0/224314698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48780f7970 0x7f48781075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 >> 172.21.15.133:0/224314698 conn(0x7f48780f1e30 msgr2=0x7f48780fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 shutdown_connections 2024-02-15T18:22:47.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:22:47.763+0000 7f487dbee700 1 -- 172.21.15.133:0/224314698 wait complete. 2024-02-15T18:22:48.081 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:46.384190+0000 mgr.smithi084.hjmnez (mgr.14162) 185 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:48.081 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:47.694993+0000 mon.smithi084 (mon.0) 438 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:48.081 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:47.697811+0000 mon.smithi084 (mon.0) 439 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:48.082 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:47.759033+0000 mon.smithi133 (mon.1) 14 : audit [INF] from='client.? 172.21.15.133:0/224314698' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:22:48.082 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:47.759695+0000 mon.smithi084 (mon.0) 440 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:22:48.082 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:47.762560+0000 mon.smithi084 (mon.0) 441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T18:22:48.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:46.384190+0000 mgr.smithi084.hjmnez (mgr.14162) 185 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:48.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:47.694993+0000 mon.smithi084 (mon.0) 438 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:48.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:47.697811+0000 mon.smithi084 (mon.0) 439 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:22:48.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:47.759033+0000 mon.smithi133 (mon.1) 14 : audit [INF] from='client.? 172.21.15.133:0/224314698' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:22:48.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:47.759695+0000 mon.smithi084 (mon.0) 440 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:22:48.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:47.762560+0000 mon.smithi084 (mon.0) 441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T18:22:48.398 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:22:48.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-15T18:22:48.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-15T18:22:48.437 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T18:22:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:22:50.203 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:48.384639+0000 mgr.smithi084.hjmnez (mgr.14162) 186 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:50.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:48.384639+0000 mgr.smithi084.hjmnez (mgr.14162) 186 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 -- 172.21.15.84:0/3425339237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 msgr2=0x7efdd40f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 --2- 172.21.15.84:0/3425339237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 0x7efdd40f5ae0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7efdc8004660 tx=0x7efdc8009b30).stop 2024-02-15T18:22:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 -- 172.21.15.84:0/3425339237 shutdown_connections 2024-02-15T18:22:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 --2- 172.21.15.84:0/3425339237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd40f6960 0x7efdd40f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 --2- 172.21.15.84:0/3425339237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 0x7efdd40f5ae0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 -- 172.21.15.84:0/3425339237 >> 172.21.15.84:0/3425339237 conn(0x7efdd40f0e20 msgr2=0x7efdd40f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 -- 172.21.15.84:0/3425339237 shutdown_connections 2024-02-15T18:22:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 -- 172.21.15.84:0/3425339237 wait complete. 2024-02-15T18:22:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 Processor -- start 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.563+0000 7efdda034700 1 -- start start 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdda034700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 0x7efdd41071d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdda034700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd40f6960 0x7efdd41076c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdda034700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4107c70 con 0x7efdd40f56c0 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdda034700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4107db0 con 0x7efdd40f6960 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdd37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 0x7efdd41071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdd37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 0x7efdd41071d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44816/0 (socket says 172.21.15.84:44816) 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdd37fe700 1 -- 172.21.15.84:0/1002003945 learned_addr learned my addr 172.21.15.84:0/1002003945 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdd2ffd700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd40f6960 0x7efdd41076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdd37fe700 1 -- 172.21.15.84:0/1002003945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd40f6960 msgr2=0x7efdd41076c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdd37fe700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd40f6960 0x7efdd41076c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdd37fe700 1 -- 172.21.15.84:0/1002003945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc8005040 con 0x7efdd40f56c0 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdd37fe700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 0x7efdd41071d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7efdc8009f50 tx=0x7efdc8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdbbfff700 1 -- 172.21.15.84:0/1002003945 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc8018070 con 0x7efdd40f56c0 2024-02-15T18:22:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd41086f0 con 0x7efdd40f56c0 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdbbfff700 1 -- 172.21.15.84:0/1002003945 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdc8007d70 con 0x7efdd40f56c0 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdbbfff700 1 -- 172.21.15.84:0/1002003945 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc801c620 con 0x7efdd40f56c0 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.564+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd4108c50 con 0x7efdd40f56c0 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.565+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd4045ad0 con 0x7efdd40f56c0 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.566+0000 7efdbbfff700 1 -- 172.21.15.84:0/1002003945 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7efdc801c8e0 con 0x7efdd40f56c0 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.566+0000 7efdbbfff700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7efdbc05c2a0 0x7efdbc05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.566+0000 7efdbbfff700 1 -- 172.21.15.84:0/1002003945 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7efdc8077a10 con 0x7efdd40f56c0 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.566+0000 7efdd2ffd700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7efdbc05c2a0 0x7efdbc05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.566+0000 7efdd2ffd700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7efdbc05c2a0 0x7efdbc05e760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efdc40041d0 tx=0x7efdc4009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:50.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.570+0000 7efdbbfff700 1 -- 172.21.15.84:0/1002003945 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7efdc804aa10 con 0x7efdd40f56c0 2024-02-15T18:22:50.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.719+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdd4109410 con 0x7efdd40f56c0 2024-02-15T18:22:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.720+0000 7efdbbfff700 1 -- 172.21.15.84:0/1002003945 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+10884 (secure 0 0 0) 0x7efdc804e030 con 0x7efdd40f56c0 2024-02-15T18:22:50.721 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:22:50.721 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:17:26.592201+0000","modified":"2024-02-15T18:22:39.922732+0000","last_up_change":"2024-02-15T18:22:38.855874+0000","last_in_change":"2024-02-15T18:22:21.440220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:21:49.806275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9ce13286-2da9-4b1e-9121-b14ba88e414c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6803","nonce":2007717102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6805","nonce":2007717102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6809","nonce":2007717102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6807","nonce":2007717102}]},"public_addr":"172.21.15.84:6803/2007717102","cluster_addr":"172.21.15.84:6805/2007717102","heartbeat_back_addr":"172.21.15.84:6809/2007717102","heartbeat_front_addr":"172.21.15.84:6807/2007717102","state":["exists","up"]},{"osd":1,"uuid":"d20fe52a-86d7-421f-ab80-219ad7724f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6811","nonce":2931692549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6813","nonce":2931692549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6817","nonce":2931692549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6815","nonce":2931692549}]},"public_addr":"172.21.15.84:6811/2931692549","cluster_addr":"172.21.15.84:6813/2931692549","heartbeat_back_addr":"172.21.15.84:6817/2931692549","heartbeat_front_addr":"172.21.15.84:6815/2931692549","state":["exists","up"]},{"osd":2,"uuid":"b905a1ac-93fe-419d-ab8e-4b3a3e08d448","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6819","nonce":686993623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6821","nonce":686993623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6825","nonce":686993623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6823","nonce":686993623}]},"public_addr":"172.21.15.84:6819/686993623","cluster_addr":"172.21.15.84:6821/686993623","heartbeat_back_addr":"172.21.15.84:6825/686993623","heartbeat_front_addr":"172.21.15.84:6823/686993623","state":["exists","up"]},{"osd":3,"uuid":"ece64a41-54ad-420b-aa77-6d226942a19b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6801","nonce":1663108677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6803","nonce":1663108677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6807","nonce":1663108677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6805","nonce":1663108677}]},"public_addr":"172.21.15.133:6801/1663108677","cluster_addr":"172.21.15.133:6803/1663108677","heartbeat_back_addr":"172.21.15.133:6807/1663108677","heartbeat_front_addr":"172.21.15.133:6805/1663108677","state":["exists","up"]},{"osd":4,"uuid":"0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6809","nonce":16944871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6811","nonce":16944871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6815","nonce":16944871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6813","nonce":16944871}]},"public_addr":"172.21.15.133:6809/16944871","cluster_addr":"172.21.15.133:6811/16944871","heartbeat_back_addr":"172.21.15.133:6815/16944871","heartbeat_front_addr":"172.21.15.133:6813/16944871","state":["exists","up"]},{"osd":5,"uuid":"0af0ca6d-3df7-42a9-9cbf-f41a4132671c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6817","nonce":212697091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6819","nonce":212697091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6823","nonce":212697091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6821","nonce":212697091}]},"public_addr":"172.21.15.133:6817/212697091","cluster_addr":"172.21.15.133:6819/212697091","heartbeat_back_addr":"172.21.15.133:6823/212697091","heartbeat_front_addr":"172.21.15.133:6821/212697091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:20:44.780626+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:10.929070+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:34.608389+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:54.376377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:15.726240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:37.273413+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/3385940609":"2024-02-16T18:18:28.289514+0000","172.21.15.84:0/855149255":"2024-02-16T18:18:13.388623+0000","172.21.15.84:6800/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6801/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.84:6800/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/3021498954":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/1857689459":"2024-02-16T18:18:28.289514+0000","172.21.15.84:0/448246306":"2024-02-16T18:17:49.286762+0000","172.21.15.84:6801/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6800/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.84:6801/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.84:0/2943993061":"2024-02-16T18:17:49.286762+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:22:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.721+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7efdbc05c2a0 msgr2=0x7efdbc05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.721+0000 7efdda034700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7efdbc05c2a0 0x7efdbc05e760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efdc40041d0 tx=0x7efdc4009040).stop 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.721+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 msgr2=0x7efdd41071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.721+0000 7efdda034700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 0x7efdd41071d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7efdc8009f50 tx=0x7efdc8009b30).stop 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.721+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 shutdown_connections 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.721+0000 7efdda034700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7efdbc05c2a0 0x7efdbc05e760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.721+0000 7efdda034700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdd40f56c0 0x7efdd41071d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.722+0000 7efdda034700 1 --2- 172.21.15.84:0/1002003945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdd40f6960 0x7efdd41076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.722+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 >> 172.21.15.84:0/1002003945 conn(0x7efdd40f0e20 msgr2=0x7efdd40603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.722+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 shutdown_connections 2024-02-15T18:22:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:50.722+0000 7efdda034700 1 -- 172.21.15.84:0/1002003945 wait complete. 2024-02-15T18:22:51.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:50.721554+0000 mon.smithi084 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.84:0/1002003945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:22:51.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:50.721554+0000 mon.smithi084 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.84:0/1002003945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:22:51.403 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-15T18:21:49.806275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-02-15T18:22:51.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-15T18:22:51.628 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:22:52.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:50.385071+0000 mgr.smithi084.hjmnez (mgr.14162) 187 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:52.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:50.385071+0000 mgr.smithi084.hjmnez (mgr.14162) 187 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:53.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.634+0000 7f207198e700 1 -- 172.21.15.84:0/1121184114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f7a60 msgr2=0x7f206c0f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:53.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.634+0000 7f207198e700 1 --2- 172.21.15.84:0/1121184114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f7a60 0x7f206c0f7ec0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f205c004660 tx=0x7f205c009b30).stop 2024-02-15T18:22:53.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.634+0000 7f207198e700 1 -- 172.21.15.84:0/1121184114 shutdown_connections 2024-02-15T18:22:53.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.634+0000 7f207198e700 1 --2- 172.21.15.84:0/1121184114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f7a60 0x7f206c0f7ec0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.634+0000 7f207198e700 1 --2- 172.21.15.84:0/1121184114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f206c0f67c0 0x7f206c0f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.634+0000 7f207198e700 1 -- 172.21.15.84:0/1121184114 >> 172.21.15.84:0/1121184114 conn(0x7f206c0f1f20 msgr2=0x7f206c0f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.634+0000 7f207198e700 1 -- 172.21.15.84:0/1121184114 shutdown_connections 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.634+0000 7f207198e700 1 -- 172.21.15.84:0/1121184114 wait complete. 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f207198e700 1 Processor -- start 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f207198e700 1 -- start start 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f207198e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f67c0 0x7f206c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f207198e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f206c0f7a60 0x7f206c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f207198e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c06a380 con 0x7f206c0f67c0 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f207198e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c06a4c0 con 0x7f206c0f7a60 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f206affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f67c0 0x7f206c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f206affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f67c0 0x7f206c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55226/0 (socket says 172.21.15.84:55226) 2024-02-15T18:22:53.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f206affd700 1 -- 172.21.15.84:0/2454293874 learned_addr learned my addr 172.21.15.84:0/2454293874 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f206a7fc700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f206c0f7a60 0x7f206c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f206affd700 1 -- 172.21.15.84:0/2454293874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f206c0f7a60 msgr2=0x7f206c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f206affd700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f206c0f7a60 0x7f206c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f206affd700 1 -- 172.21.15.84:0/2454293874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c005040 con 0x7f206c0f67c0 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f206affd700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f67c0 0x7f206c06b9a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f206000c530 tx=0x7f2060007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f20537fe700 1 -- 172.21.15.84:0/2454293874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206000f650 con 0x7f206c0f67c0 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f20537fe700 1 -- 172.21.15.84:0/2454293874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f206000fc80 con 0x7f206c0f67c0 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c06a7a0 con 0x7f206c0f67c0 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.635+0000 7f20537fe700 1 -- 172.21.15.84:0/2454293874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2060012d60 con 0x7f206c0f67c0 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.636+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c10f1d0 con 0x7f206c0f67c0 2024-02-15T18:22:53.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.636+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c045ad0 con 0x7f206c0f67c0 2024-02-15T18:22:53.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.637+0000 7f20537fe700 1 -- 172.21.15.84:0/2454293874 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2060019030 con 0x7f206c0f67c0 2024-02-15T18:22:53.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.638+0000 7f20537fe700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f205405c2a0 0x7f205405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:53.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.638+0000 7f20537fe700 1 -- 172.21.15.84:0/2454293874 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f2060075d10 con 0x7f206c0f67c0 2024-02-15T18:22:53.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.638+0000 7f206a7fc700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f205405c2a0 0x7f205405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:53.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.638+0000 7f206a7fc700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f205405c2a0 0x7f205405e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f205c009f50 tx=0x7f205c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:53.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.641+0000 7f20537fe700 1 -- 172.21.15.84:0/2454293874 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2060048de0 con 0x7f206c0f67c0 2024-02-15T18:22:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.793+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f206c0ff210 con 0x7f206c0f67c0 2024-02-15T18:22:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.793+0000 7f20537fe700 1 -- 172.21.15.84:0/2454293874 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v39) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2060017070 con 0x7f206c0f67c0 2024-02-15T18:22:53.795 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-02-15T18:22:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.795+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f205405c2a0 msgr2=0x7f205405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.795+0000 7f207198e700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f205405c2a0 0x7f205405e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f205c009f50 tx=0x7f205c009b30).stop 2024-02-15T18:22:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.795+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f67c0 msgr2=0x7f206c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.795+0000 7f207198e700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f67c0 0x7f206c06b9a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f206000c530 tx=0x7f2060007e10).stop 2024-02-15T18:22:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.795+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 shutdown_connections 2024-02-15T18:22:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.795+0000 7f207198e700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f205405c2a0 0x7f205405e760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.795+0000 7f207198e700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f206c0f67c0 0x7f206c06b9a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.795+0000 7f207198e700 1 --2- 172.21.15.84:0/2454293874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f206c0f7a60 0x7f206c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.795+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 >> 172.21.15.84:0/2454293874 conn(0x7f206c0f1f20 msgr2=0x7f206c0fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.796+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 shutdown_connections 2024-02-15T18:22:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:53.796+0000 7f207198e700 1 -- 172.21.15.84:0/2454293874 wait complete. 2024-02-15T18:22:54.098 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:52.385483+0000 mgr.smithi084.hjmnez (mgr.14162) 188 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:54.098 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:53.795526+0000 mon.smithi084 (mon.0) 443 : audit [DBG] from='client.? 172.21.15.84:0/2454293874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:22:54.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:52.385483+0000 mgr.smithi084.hjmnez (mgr.14162) 188 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:54.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:53.795526+0000 mon.smithi084 (mon.0) 443 : audit [DBG] from='client.? 172.21.15.84:0/2454293874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:22:54.441 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-15T18:22:54.441 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-15T18:22:54.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph mgr dump --format=json 2024-02-15T18:22:54.665 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:22:56.182 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:54.385881+0000 mgr.smithi084.hjmnez (mgr.14162) 189 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:56.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:54.385881+0000 mgr.smithi084.hjmnez (mgr.14162) 189 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.438+0000 7f4388b58700 1 -- 172.21.15.84:0/3515639612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f6980 msgr2=0x7f43840f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.438+0000 7f4388b58700 1 --2- 172.21.15.84:0/3515639612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f6980 0x7f43840f6de0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f4374004660 tx=0x7f4374009b30).stop 2024-02-15T18:22:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.438+0000 7f4388b58700 1 -- 172.21.15.84:0/3515639612 shutdown_connections 2024-02-15T18:22:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.438+0000 7f4388b58700 1 --2- 172.21.15.84:0/3515639612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f6980 0x7f43840f6de0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.438+0000 7f4388b58700 1 --2- 172.21.15.84:0/3515639612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43840f56e0 0x7f43840f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.438+0000 7f4388b58700 1 -- 172.21.15.84:0/3515639612 >> 172.21.15.84:0/3515639612 conn(0x7f43840f0e20 msgr2=0x7f43840f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.438+0000 7f4388b58700 1 -- 172.21.15.84:0/3515639612 shutdown_connections 2024-02-15T18:22:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.438+0000 7f4388b58700 1 -- 172.21.15.84:0/3515639612 wait complete. 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.438+0000 7f4388b58700 1 Processor -- start 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4388b58700 1 -- start start 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4388b58700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f56e0 0x7f4384109eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4388b58700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43840f6980 0x7f438410c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4388b58700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43840609b0 con 0x7f43840f56e0 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4388b58700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4384060af0 con 0x7f43840f6980 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f438259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f56e0 0x7f4384109eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f438259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f56e0 0x7f4384109eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55248/0 (socket says 172.21.15.84:55248) 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f438259c700 1 -- 172.21.15.84:0/3130267414 learned_addr learned my addr 172.21.15.84:0/3130267414 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4381d9b700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43840f6980 0x7f438410c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f438259c700 1 -- 172.21.15.84:0/3130267414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43840f6980 msgr2=0x7f438410c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:56.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f438259c700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43840f6980 0x7f438410c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:56.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f438259c700 1 -- 172.21.15.84:0/3130267414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374005040 con 0x7f43840f56e0 2024-02-15T18:22:56.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f438259c700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f56e0 0x7f4384109eb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f43780093f0 tx=0x7f4378006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:56.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4372ffd700 1 -- 172.21.15.84:0/3130267414 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4378013640 con 0x7f43840f56e0 2024-02-15T18:22:56.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4372ffd700 1 -- 172.21.15.84:0/3130267414 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4378009e40 con 0x7f43840f56e0 2024-02-15T18:22:56.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438410c9c0 con 0x7f43840f56e0 2024-02-15T18:22:56.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4372ffd700 1 -- 172.21.15.84:0/3130267414 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f437800dc90 con 0x7f43840f56e0 2024-02-15T18:22:56.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.439+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438410cf80 con 0x7f43840f56e0 2024-02-15T18:22:56.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.440+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4384045ad0 con 0x7f43840f56e0 2024-02-15T18:22:56.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.441+0000 7f4372ffd700 1 -- 172.21.15.84:0/3130267414 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f437801a060 con 0x7f43840f56e0 2024-02-15T18:22:56.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.441+0000 7f4372ffd700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f436c05c2a0 0x7f436c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:56.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.441+0000 7f4372ffd700 1 -- 172.21.15.84:0/3130267414 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f4378075bc0 con 0x7f43840f56e0 2024-02-15T18:22:56.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.441+0000 7f4381d9b700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f436c05c2a0 0x7f436c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:56.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.441+0000 7f4381d9b700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f436c05c2a0 0x7f436c05e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4374004e30 tx=0x7f4374009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:56.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.445+0000 7f4372ffd700 1 -- 172.21.15.84:0/3130267414 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4378048bc0 con 0x7f43840f56e0 2024-02-15T18:22:56.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.631+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4384027a00 con 0x7f43840f56e0 2024-02-15T18:22:56.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.634+0000 7f4372ffd700 1 -- 172.21.15.84:0/3130267414 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+143497 (secure 0 0 0) 0x7f437804c1e0 con 0x7f43840f56e0 2024-02-15T18:22:56.637 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:22:56.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f436c05c2a0 msgr2=0x7f436c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:56.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f436c05c2a0 0x7f436c05e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4374004e30 tx=0x7f4374009b30).stop 2024-02-15T18:22:56.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f56e0 msgr2=0x7f4384109eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f56e0 0x7f4384109eb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f43780093f0 tx=0x7f4378006ec0).stop 2024-02-15T18:22:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 shutdown_connections 2024-02-15T18:22:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f436c05c2a0 0x7f436c05e760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43840f56e0 0x7f4384109eb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 --2- 172.21.15.84:0/3130267414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43840f6980 0x7f438410c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 >> 172.21.15.84:0/3130267414 conn(0x7f43840f0e20 msgr2=0x7f43840fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 shutdown_connections 2024-02-15T18:22:56.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:56.636+0000 7f4388b58700 1 -- 172.21.15.84:0/3130267414 wait complete. 2024-02-15T18:22:57.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:56.633691+0000 mon.smithi084 (mon.0) 444 : audit [DBG] from='client.? 172.21.15.84:0/3130267414' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-15T18:22:57.383 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"active_gid":14162,"active_name":"smithi084.hjmnez","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":610282832},{"type":"v1","addr":"172.21.15.84:6801","nonce":610282832}]},"active_addr":"172.21.15.84:6801/610282832","active_change":"2024-02-15T18:18:28.289815+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":14206,"name":"smithi133.nxzroj","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi084.front.sepia.ceph.com:8443/","prometheus":"http://smithi084.front.sepia.ceph.com:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":4,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1894268612}]},{"addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1978539770}]}]}} 2024-02-15T18:22:57.389 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-15T18:22:57.389 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-15T18:22:57.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T18:22:57.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:56.633691+0000 mon.smithi084 (mon.0) 444 : audit [DBG] from='client.? 172.21.15.84:0/3130267414' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-15T18:22:57.618 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:22:58.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:56.386194+0000 mgr.smithi084.hjmnez (mgr.14162) 190 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:58.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:56.386194+0000 mgr.smithi084.hjmnez (mgr.14162) 190 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:22:59.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 -- 172.21.15.84:0/1852116806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 msgr2=0x7fb4c40f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 --2- 172.21.15.84:0/1852116806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 0x7fb4c40f7ec0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb4b8004660 tx=0x7fb4b8009b30).stop 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 -- 172.21.15.84:0/1852116806 shutdown_connections 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 --2- 172.21.15.84:0/1852116806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 0x7fb4c40f7ec0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 --2- 172.21.15.84:0/1852116806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4c40f67c0 0x7fb4c40f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 -- 172.21.15.84:0/1852116806 >> 172.21.15.84:0/1852116806 conn(0x7fb4c40f1f20 msgr2=0x7fb4c40f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 -- 172.21.15.84:0/1852116806 shutdown_connections 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 -- 172.21.15.84:0/1852116806 wait complete. 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 Processor -- start 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 -- start start 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4c40f67c0 0x7fb4c4107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 0x7fb4c4107650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4107c90 con 0x7fb4c40f7a60 2024-02-15T18:22:59.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.533+0000 7fb4ca078700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4108540 con 0x7fb4c40f67c0 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4c2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 0x7fb4c4107650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4c2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 0x7fb4c4107650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55268/0 (socket says 172.21.15.84:55268) 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4c2ffd700 1 -- 172.21.15.84:0/873669197 learned_addr learned my addr 172.21.15.84:0/873669197 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4c2ffd700 1 -- 172.21.15.84:0/873669197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4c40f67c0 msgr2=0x7fb4c4107160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4c2ffd700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4c40f67c0 0x7fb4c4107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4c2ffd700 1 -- 172.21.15.84:0/873669197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8005040 con 0x7fb4c40f7a60 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4c2ffd700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 0x7fb4c4107650 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb4b8009830 tx=0x7fb4b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4abfff700 1 -- 172.21.15.84:0/873669197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4b8018070 con 0x7fb4c40f7a60 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4abfff700 1 -- 172.21.15.84:0/873669197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4b8007d70 con 0x7fb4c40f7a60 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c41087c0 con 0x7fb4c40f7a60 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4abfff700 1 -- 172.21.15.84:0/873669197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4b801c620 con 0x7fb4c40f7a60 2024-02-15T18:22:59.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.534+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c4108d20 con 0x7fb4c40f7a60 2024-02-15T18:22:59.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.535+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c4059100 con 0x7fb4c40f7a60 2024-02-15T18:22:59.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.535+0000 7fb4abfff700 1 -- 172.21.15.84:0/873669197 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb4b801c810 con 0x7fb4c40f7a60 2024-02-15T18:22:59.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.536+0000 7fb4abfff700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb4ac05c2a0 0x7fb4ac05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:59.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.536+0000 7fb4abfff700 1 -- 172.21.15.84:0/873669197 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fb4b80779c0 con 0x7fb4c40f7a60 2024-02-15T18:22:59.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.536+0000 7fb4c37fe700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb4ac05c2a0 0x7fb4ac05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:59.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.536+0000 7fb4c37fe700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb4ac05c2a0 0x7fb4ac05e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb4c40f78c0 tx=0x7fb4b4006ab0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:59.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.540+0000 7fb4abfff700 1 -- 172.21.15.84:0/873669197 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb4b804aa40 con 0x7fb4c40f7a60 2024-02-15T18:22:59.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.690+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4c40ff130 con 0x7fb4c40f7a60 2024-02-15T18:22:59.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.690+0000 7fb4abfff700 1 -- 172.21.15.84:0/873669197 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+10884 (secure 0 0 0) 0x7fb4b804e060 con 0x7fb4c40f7a60 2024-02-15T18:22:59.691 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:22:59.691 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:17:26.592201+0000","modified":"2024-02-15T18:22:39.922732+0000","last_up_change":"2024-02-15T18:22:38.855874+0000","last_in_change":"2024-02-15T18:22:21.440220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:21:49.806275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9ce13286-2da9-4b1e-9121-b14ba88e414c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6803","nonce":2007717102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6805","nonce":2007717102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6809","nonce":2007717102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6807","nonce":2007717102}]},"public_addr":"172.21.15.84:6803/2007717102","cluster_addr":"172.21.15.84:6805/2007717102","heartbeat_back_addr":"172.21.15.84:6809/2007717102","heartbeat_front_addr":"172.21.15.84:6807/2007717102","state":["exists","up"]},{"osd":1,"uuid":"d20fe52a-86d7-421f-ab80-219ad7724f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6811","nonce":2931692549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6813","nonce":2931692549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6817","nonce":2931692549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6815","nonce":2931692549}]},"public_addr":"172.21.15.84:6811/2931692549","cluster_addr":"172.21.15.84:6813/2931692549","heartbeat_back_addr":"172.21.15.84:6817/2931692549","heartbeat_front_addr":"172.21.15.84:6815/2931692549","state":["exists","up"]},{"osd":2,"uuid":"b905a1ac-93fe-419d-ab8e-4b3a3e08d448","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6819","nonce":686993623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6821","nonce":686993623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6825","nonce":686993623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6823","nonce":686993623}]},"public_addr":"172.21.15.84:6819/686993623","cluster_addr":"172.21.15.84:6821/686993623","heartbeat_back_addr":"172.21.15.84:6825/686993623","heartbeat_front_addr":"172.21.15.84:6823/686993623","state":["exists","up"]},{"osd":3,"uuid":"ece64a41-54ad-420b-aa77-6d226942a19b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6801","nonce":1663108677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6803","nonce":1663108677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6807","nonce":1663108677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6805","nonce":1663108677}]},"public_addr":"172.21.15.133:6801/1663108677","cluster_addr":"172.21.15.133:6803/1663108677","heartbeat_back_addr":"172.21.15.133:6807/1663108677","heartbeat_front_addr":"172.21.15.133:6805/1663108677","state":["exists","up"]},{"osd":4,"uuid":"0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6809","nonce":16944871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6811","nonce":16944871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6815","nonce":16944871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6813","nonce":16944871}]},"public_addr":"172.21.15.133:6809/16944871","cluster_addr":"172.21.15.133:6811/16944871","heartbeat_back_addr":"172.21.15.133:6815/16944871","heartbeat_front_addr":"172.21.15.133:6813/16944871","state":["exists","up"]},{"osd":5,"uuid":"0af0ca6d-3df7-42a9-9cbf-f41a4132671c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6817","nonce":212697091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6819","nonce":212697091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6823","nonce":212697091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6821","nonce":212697091}]},"public_addr":"172.21.15.133:6817/212697091","cluster_addr":"172.21.15.133:6819/212697091","heartbeat_back_addr":"172.21.15.133:6823/212697091","heartbeat_front_addr":"172.21.15.133:6821/212697091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:20:44.780626+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:10.929070+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:34.608389+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:54.376377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:15.726240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:37.273413+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/3385940609":"2024-02-16T18:18:28.289514+0000","172.21.15.84:0/855149255":"2024-02-16T18:18:13.388623+0000","172.21.15.84:6800/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6801/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.84:6800/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/3021498954":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/1857689459":"2024-02-16T18:18:28.289514+0000","172.21.15.84:0/448246306":"2024-02-16T18:17:49.286762+0000","172.21.15.84:6801/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6800/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.84:6801/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.84:0/2943993061":"2024-02-16T18:17:49.286762+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:22:59.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb4ac05c2a0 msgr2=0x7fb4ac05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:59.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb4ac05c2a0 0x7fb4ac05e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb4c40f78c0 tx=0x7fb4b4006ab0).stop 2024-02-15T18:22:59.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 msgr2=0x7fb4c4107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:59.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 0x7fb4c4107650 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fb4b8009830 tx=0x7fb4b8009b30).stop 2024-02-15T18:22:59.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 shutdown_connections 2024-02-15T18:22:59.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb4ac05c2a0 0x7fb4ac05e760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:59.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4c40f67c0 0x7fb4c4107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:59.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 --2- 172.21.15.84:0/873669197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4c40f7a60 0x7fb4c4107650 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:59.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 >> 172.21.15.84:0/873669197 conn(0x7fb4c40f1f20 msgr2=0x7fb4c40fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:59.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 shutdown_connections 2024-02-15T18:22:59.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:22:59.692+0000 7fb4ca078700 1 -- 172.21.15.84:0/873669197 wait complete. 2024-02-15T18:23:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:22:58.386646+0000 mgr.smithi084.hjmnez (mgr.14162) 191 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:00.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:22:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:22:59.691991+0000 mon.smithi084 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.84:0/873669197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:23:00.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:22:58.386646+0000 mgr.smithi084.hjmnez (mgr.14162) 191 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:00.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:22:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:22:59.691991+0000 mon.smithi084 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.84:0/873669197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:23:00.527 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-15T18:23:00.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T18:23:00.752 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:02.045 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:00.386964+0000 mgr.smithi084.hjmnez (mgr.14162) 192 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:02.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:00.386964+0000 mgr.smithi084.hjmnez (mgr.14162) 192 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 -- 172.21.15.84:0/1556429984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 msgr2=0x7f6e8c0f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 --2- 172.21.15.84:0/1556429984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 0x7f6e8c0f6dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6e78004660 tx=0x7f6e78009b30).stop 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 -- 172.21.15.84:0/1556429984 shutdown_connections 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 --2- 172.21.15.84:0/1556429984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 0x7f6e8c0f6dc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 --2- 172.21.15.84:0/1556429984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c0f56c0 0x7f6e8c0f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 -- 172.21.15.84:0/1556429984 >> 172.21.15.84:0/1556429984 conn(0x7f6e8c0f0e20 msgr2=0x7f6e8c0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 -- 172.21.15.84:0/1556429984 shutdown_connections 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 -- 172.21.15.84:0/1556429984 wait complete. 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 Processor -- start 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.499+0000 7f6e931d3700 1 -- start start 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e931d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c0f56c0 0x7f6e8c0f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e931d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 0x7f6e8c0f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e931d3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0f8290 con 0x7f6e8c0f6960 2024-02-15T18:23:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e931d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0f83d0 con 0x7f6e8c0f56c0 2024-02-15T18:23:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e8bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 0x7f6e8c0f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e8bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 0x7f6e8c0f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55286/0 (socket says 172.21.15.84:55286) 2024-02-15T18:23:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e8bfff700 1 -- 172.21.15.84:0/1298246892 learned_addr learned my addr 172.21.15.84:0/1298246892 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e8bfff700 1 -- 172.21.15.84:0/1298246892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c0f56c0 msgr2=0x7f6e8c0f9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e8bfff700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c0f56c0 0x7f6e8c0f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e8bfff700 1 -- 172.21.15.84:0/1298246892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78005040 con 0x7f6e8c0f6960 2024-02-15T18:23:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e8bfff700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 0x7f6e8c0f7ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f6e78009830 tx=0x7f6e78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e897fa700 1 -- 172.21.15.84:0/1298246892 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e78018070 con 0x7f6e8c0f6960 2024-02-15T18:23:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c0f8650 con 0x7f6e8c0f6960 2024-02-15T18:23:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e897fa700 1 -- 172.21.15.84:0/1298246892 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e78007d70 con 0x7f6e8c0f6960 2024-02-15T18:23:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e897fa700 1 -- 172.21.15.84:0/1298246892 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7801c620 con 0x7f6e8c0f6960 2024-02-15T18:23:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.500+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c10f1e0 con 0x7f6e8c0f6960 2024-02-15T18:23:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.501+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c045ad0 con 0x7f6e8c0f6960 2024-02-15T18:23:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.502+0000 7f6e897fa700 1 -- 172.21.15.84:0/1298246892 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6e7801d980 con 0x7f6e8c0f6960 2024-02-15T18:23:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.502+0000 7f6e897fa700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6e7c05c2a0 0x7f6e7c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.502+0000 7f6e897fa700 1 -- 172.21.15.84:0/1298246892 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f6e78077a70 con 0x7f6e8c0f6960 2024-02-15T18:23:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.502+0000 7f6e90f6f700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6e7c05c2a0 0x7f6e7c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:02.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.502+0000 7f6e90f6f700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6e7c05c2a0 0x7f6e7c05e760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6e8c0f95b0 tx=0x7f6e80006ab0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:02.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.506+0000 7f6e897fa700 1 -- 172.21.15.84:0/1298246892 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6e7804aa10 con 0x7f6e8c0f6960 2024-02-15T18:23:02.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.657+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e8c0fe030 con 0x7f6e8c0f6960 2024-02-15T18:23:02.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.658+0000 7f6e897fa700 1 -- 172.21.15.84:0/1298246892 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+10884 (secure 0 0 0) 0x7f6e8c0fe030 con 0x7f6e8c0f6960 2024-02-15T18:23:02.659 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:23:02.659 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:17:26.592201+0000","modified":"2024-02-15T18:22:39.922732+0000","last_up_change":"2024-02-15T18:22:38.855874+0000","last_in_change":"2024-02-15T18:22:21.440220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:21:49.806275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9ce13286-2da9-4b1e-9121-b14ba88e414c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6803","nonce":2007717102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6805","nonce":2007717102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6809","nonce":2007717102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6807","nonce":2007717102}]},"public_addr":"172.21.15.84:6803/2007717102","cluster_addr":"172.21.15.84:6805/2007717102","heartbeat_back_addr":"172.21.15.84:6809/2007717102","heartbeat_front_addr":"172.21.15.84:6807/2007717102","state":["exists","up"]},{"osd":1,"uuid":"d20fe52a-86d7-421f-ab80-219ad7724f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6811","nonce":2931692549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6813","nonce":2931692549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6817","nonce":2931692549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6815","nonce":2931692549}]},"public_addr":"172.21.15.84:6811/2931692549","cluster_addr":"172.21.15.84:6813/2931692549","heartbeat_back_addr":"172.21.15.84:6817/2931692549","heartbeat_front_addr":"172.21.15.84:6815/2931692549","state":["exists","up"]},{"osd":2,"uuid":"b905a1ac-93fe-419d-ab8e-4b3a3e08d448","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6819","nonce":686993623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6821","nonce":686993623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6825","nonce":686993623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6823","nonce":686993623}]},"public_addr":"172.21.15.84:6819/686993623","cluster_addr":"172.21.15.84:6821/686993623","heartbeat_back_addr":"172.21.15.84:6825/686993623","heartbeat_front_addr":"172.21.15.84:6823/686993623","state":["exists","up"]},{"osd":3,"uuid":"ece64a41-54ad-420b-aa77-6d226942a19b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6801","nonce":1663108677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6803","nonce":1663108677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6807","nonce":1663108677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6805","nonce":1663108677}]},"public_addr":"172.21.15.133:6801/1663108677","cluster_addr":"172.21.15.133:6803/1663108677","heartbeat_back_addr":"172.21.15.133:6807/1663108677","heartbeat_front_addr":"172.21.15.133:6805/1663108677","state":["exists","up"]},{"osd":4,"uuid":"0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6809","nonce":16944871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6811","nonce":16944871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6815","nonce":16944871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6813","nonce":16944871}]},"public_addr":"172.21.15.133:6809/16944871","cluster_addr":"172.21.15.133:6811/16944871","heartbeat_back_addr":"172.21.15.133:6815/16944871","heartbeat_front_addr":"172.21.15.133:6813/16944871","state":["exists","up"]},{"osd":5,"uuid":"0af0ca6d-3df7-42a9-9cbf-f41a4132671c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6817","nonce":212697091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6819","nonce":212697091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6823","nonce":212697091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6821","nonce":212697091}]},"public_addr":"172.21.15.133:6817/212697091","cluster_addr":"172.21.15.133:6819/212697091","heartbeat_back_addr":"172.21.15.133:6823/212697091","heartbeat_front_addr":"172.21.15.133:6821/212697091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:20:44.780626+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:10.929070+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:34.608389+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:54.376377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:15.726240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:37.273413+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/3385940609":"2024-02-16T18:18:28.289514+0000","172.21.15.84:0/855149255":"2024-02-16T18:18:13.388623+0000","172.21.15.84:6800/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6801/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.84:6800/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/3021498954":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/1857689459":"2024-02-16T18:18:28.289514+0000","172.21.15.84:0/448246306":"2024-02-16T18:17:49.286762+0000","172.21.15.84:6801/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6800/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.84:6801/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.84:0/2943993061":"2024-02-16T18:17:49.286762+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.659+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6e7c05c2a0 msgr2=0x7f6e7c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.659+0000 7f6e931d3700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6e7c05c2a0 0x7f6e7c05e760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6e8c0f95b0 tx=0x7f6e80006ab0).stop 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.659+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 msgr2=0x7f6e8c0f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.659+0000 7f6e931d3700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 0x7f6e8c0f7ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f6e78009830 tx=0x7f6e78009b30).stop 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.660+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 shutdown_connections 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.660+0000 7f6e931d3700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f6e7c05c2a0 0x7f6e7c05e760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.660+0000 7f6e931d3700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c0f56c0 0x7f6e8c0f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.660+0000 7f6e931d3700 1 --2- 172.21.15.84:0/1298246892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e8c0f6960 0x7f6e8c0f7ca0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.660+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 >> 172.21.15.84:0/1298246892 conn(0x7f6e8c0f0e20 msgr2=0x7f6e8c060380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.660+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 shutdown_connections 2024-02-15T18:23:02.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:02.660+0000 7f6e931d3700 1 -- 172.21.15.84:0/1298246892 wait complete. 2024-02-15T18:23:03.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:02.659444+0000 mon.smithi084 (mon.0) 446 : audit [DBG] from='client.? 172.21.15.84:0/1298246892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:23:03.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:02.659444+0000 mon.smithi084 (mon.0) 446 : audit [DBG] from='client.? 172.21.15.84:0/1298246892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:23:03.451 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-15T18:23:03.679 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:04.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:02.387533+0000 mgr.smithi084.hjmnez (mgr.14162) 193 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:04.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:02.387533+0000 mgr.smithi084.hjmnez (mgr.14162) 193 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 -- 172.21.15.84:0/208344939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 msgr2=0x7f80000f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 --2- 172.21.15.84:0/208344939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 0x7f80000f6c10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f7ffc004660 tx=0x7f7ffc009b30).stop 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 -- 172.21.15.84:0/208344939 shutdown_connections 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 --2- 172.21.15.84:0/208344939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 0x7f80000f6c10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 --2- 172.21.15.84:0/208344939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80000f5510 0x7f80000f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 -- 172.21.15.84:0/208344939 >> 172.21.15.84:0/208344939 conn(0x7f80000f0c70 msgr2=0x7f80000f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 -- 172.21.15.84:0/208344939 shutdown_connections 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 -- 172.21.15.84:0/208344939 wait complete. 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 Processor -- start 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 -- start start 2024-02-15T18:23:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80000f5510 0x7f8000106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 0x7f8000107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000107a20 con 0x7f80000f67b0 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f8006da1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000107b60 con 0x7f80000f5510 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.606+0000 7f800559e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 0x7f8000107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f800559e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 0x7f8000107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47562/0 (socket says 172.21.15.84:47562) 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f800559e700 1 -- 172.21.15.84:0/4209823101 learned_addr learned my addr 172.21.15.84:0/4209823101 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f8005d9f700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80000f5510 0x7f8000106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f800559e700 1 -- 172.21.15.84:0/4209823101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80000f5510 msgr2=0x7f8000106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f800559e700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80000f5510 0x7f8000106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f800559e700 1 -- 172.21.15.84:0/4209823101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc005040 con 0x7f80000f67b0 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f800559e700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 0x7f8000107470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7ffc009830 tx=0x7f7ffc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f7ff67fc700 1 -- 172.21.15.84:0/4209823101 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ffc018070 con 0x7f80000f67b0 2024-02-15T18:23:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80001084a0 con 0x7f80000f67b0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f7ff67fc700 1 -- 172.21.15.84:0/4209823101 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ffc007ba0 con 0x7f80000f67b0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f7ff67fc700 1 -- 172.21.15.84:0/4209823101 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ffc01c3c0 con 0x7f80000f67b0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.607+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8000108a00 con 0x7f80000f67b0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.608+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f800005db80 con 0x7f80000f67b0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.608+0000 7f7ff67fc700 1 -- 172.21.15.84:0/4209823101 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7ffc007d10 con 0x7f80000f67b0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.609+0000 7f7ff67fc700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f7fec05c2b0 0x7f7fec05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.609+0000 7f7ff67fc700 1 -- 172.21.15.84:0/4209823101 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f7ffc0777c0 con 0x7f80000f67b0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.609+0000 7f8005d9f700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f7fec05c2b0 0x7f7fec05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.609+0000 7f7ff67fc700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] conn(0x7f7fec062040 0x7f7fec0644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.609+0000 7f7ff67fc700 1 -- 172.21.15.84:0/4209823101 --> [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fec064b20 con 0x7f7fec062040 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.609+0000 7f7ff67fc700 1 -- 172.21.15.84:0/4209823101 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ffc07c220 con 0x7f80000f67b0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.609+0000 7f80065a0700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] conn(0x7f7fec062040 0x7f7fec0644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.609+0000 7f8005d9f700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f7fec05c2b0 0x7f7fec05e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f80000f6610 tx=0x7f7ff000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.609+0000 7f80065a0700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] conn(0x7f7fec062040 0x7f7fec0644a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.610+0000 7f7ff67fc700 1 -- 172.21.15.84:0/4209823101 <== osd.0 v2:172.21.15.84:6802/2007717102 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f7fec064b20 con 0x7f7fec062040 2024-02-15T18:23:05.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 --> [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8000108e60 con 0x7f7fec062040 2024-02-15T18:23:05.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f7ff67fc700 1 -- 172.21.15.84:0/4209823101 <== osd.0 v2:172.21.15.84:6802/2007717102 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8000108e60 con 0x7f7fec062040 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] conn(0x7f7fec062040 msgr2=0x7f7fec0644a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] conn(0x7f7fec062040 0x7f7fec0644a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f7fec05c2b0 msgr2=0x7f7fec05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f7fec05c2b0 0x7f7fec05e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f80000f6610 tx=0x7f7ff000b040).stop 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 msgr2=0x7f8000107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 0x7f8000107470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7ffc009830 tx=0x7f7ffc009b30).stop 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 shutdown_connections 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6802/2007717102,v1:172.21.15.84:6803/2007717102] conn(0x7f7fec062040 0x7f7fec0644a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f7fec05c2b0 0x7f7fec05e770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:05.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80000f5510 0x7f8000106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:05.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 --2- 172.21.15.84:0/4209823101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80000f67b0 0x7f8000107470 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:05.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.624+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 >> 172.21.15.84:0/4209823101 conn(0x7f80000f0c70 msgr2=0x7f800005fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:05.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.625+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 shutdown_connections 2024-02-15T18:23:05.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:05.625+0000 7f8006da1700 1 -- 172.21.15.84:0/4209823101 wait complete. 2024-02-15T18:23:06.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:04.387916+0000 mgr.smithi084.hjmnez (mgr.14162) 194 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:06.370 INFO:teuthology.orchestra.run.smithi084.stdout:38654705695 2024-02-15T18:23:06.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-15T18:23:06.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:04.387916+0000 mgr.smithi084.hjmnez (mgr.14162) 194 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:06.596 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:08.125 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:06.388214+0000 mgr.smithi084.hjmnez (mgr.14162) 195 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 -- 172.21.15.84:0/876398298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 msgr2=0x7fda140f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 --2- 172.21.15.84:0/876398298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 0x7fda140f6dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fda04004660 tx=0x7fda04009b30).stop 2024-02-15T18:23:08.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 -- 172.21.15.84:0/876398298 shutdown_connections 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 --2- 172.21.15.84:0/876398298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 0x7fda140f6dc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 --2- 172.21.15.84:0/876398298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda140f56c0 0x7fda140f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 -- 172.21.15.84:0/876398298 >> 172.21.15.84:0/876398298 conn(0x7fda140f0e20 msgr2=0x7fda140f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 -- 172.21.15.84:0/876398298 shutdown_connections 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 -- 172.21.15.84:0/876398298 wait complete. 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 Processor -- start 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.334+0000 7fda1a92f700 1 -- start start 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda1a92f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda140f56c0 0x7fda141071b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda1a92f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 0x7fda141076a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda1a92f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda14107ce0 con 0x7fda140f6960 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda1a92f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda14108590 con 0x7fda140f56c0 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda137fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 0x7fda141076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda137fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 0x7fda141076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47590/0 (socket says 172.21.15.84:47590) 2024-02-15T18:23:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda137fe700 1 -- 172.21.15.84:0/2238175085 learned_addr learned my addr 172.21.15.84:0/2238175085 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda137fe700 1 -- 172.21.15.84:0/2238175085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda140f56c0 msgr2=0x7fda141071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda137fe700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda140f56c0 0x7fda141071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda137fe700 1 -- 172.21.15.84:0/2238175085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04005040 con 0x7fda140f6960 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda137fe700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 0x7fda141076a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fda04009830 tx=0x7fda04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda10ff9700 1 -- 172.21.15.84:0/2238175085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda04018070 con 0x7fda140f6960 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda14108810 con 0x7fda140f6960 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda10ff9700 1 -- 172.21.15.84:0/2238175085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda04007d70 con 0x7fda140f6960 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda10ff9700 1 -- 172.21.15.84:0/2238175085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0401c620 con 0x7fda140f6960 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.335+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda14108d70 con 0x7fda140f6960 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.336+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda1405dd30 con 0x7fda140f6960 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda10ff9700 1 -- 172.21.15.84:0/2238175085 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fda0401d980 con 0x7fda140f6960 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda10ff9700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd9fc05c2a0 0x7fd9fc05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda10ff9700 1 -- 172.21.15.84:0/2238175085 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fda04077e20 con 0x7fda140f6960 2024-02-15T18:23:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda13fff700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd9fc05c2a0 0x7fd9fc05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda10ff9700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] conn(0x7fd9fc062030 0x7fd9fc064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda10ff9700 1 -- 172.21.15.84:0/2238175085 --> [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9fc064b10 con 0x7fd9fc062030 2024-02-15T18:23:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda10ff9700 1 -- 172.21.15.84:0/2238175085 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda04078220 con 0x7fda140f6960 2024-02-15T18:23:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda18ecc700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] conn(0x7fd9fc062030 0x7fd9fc064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda13fff700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd9fc05c2a0 0x7fd9fc05e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fda140f67c0 tx=0x7fda08006ab0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.337+0000 7fda18ecc700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] conn(0x7fd9fc062030 0x7fd9fc064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:08.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.338+0000 7fda10ff9700 1 -- 172.21.15.84:0/2238175085 <== osd.1 v2:172.21.15.84:6810/2931692549 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd9fc064b10 con 0x7fd9fc062030 2024-02-15T18:23:08.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.352+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 --> [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda14109290 con 0x7fd9fc062030 2024-02-15T18:23:08.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.352+0000 7fda10ff9700 1 -- 172.21.15.84:0/2238175085 <== osd.1 v2:172.21.15.84:6810/2931692549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fda14109290 con 0x7fd9fc062030 2024-02-15T18:23:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] conn(0x7fd9fc062030 msgr2=0x7fd9fc064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] conn(0x7fd9fc062030 0x7fd9fc064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd9fc05c2a0 msgr2=0x7fd9fc05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd9fc05c2a0 0x7fd9fc05e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fda140f67c0 tx=0x7fda08006ab0).stop 2024-02-15T18:23:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 msgr2=0x7fda141076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 0x7fda141076a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fda04009830 tx=0x7fda04009b30).stop 2024-02-15T18:23:08.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 shutdown_connections 2024-02-15T18:23:08.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6810/2931692549,v1:172.21.15.84:6811/2931692549] conn(0x7fd9fc062030 0x7fd9fc064490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:08.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd9fc05c2a0 0x7fd9fc05e760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:08.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda140f56c0 0x7fda141071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:08.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 --2- 172.21.15.84:0/2238175085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda140f6960 0x7fda141076a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:08.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 >> 172.21.15.84:0/2238175085 conn(0x7fda140f0e20 msgr2=0x7fda14060380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:08.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 shutdown_connections 2024-02-15T18:23:08.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:08.353+0000 7fda1a92f700 1 -- 172.21.15.84:0/2238175085 wait complete. 2024-02-15T18:23:08.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:06.388214+0000 mgr.smithi084.hjmnez (mgr.14162) 195 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:09.144 INFO:teuthology.orchestra.run.smithi084.stdout:60129542170 2024-02-15T18:23:09.145 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-15T18:23:09.373 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:10.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:08.388524+0000 mgr.smithi084.hjmnez (mgr.14162) 196 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:10.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:08.388524+0000 mgr.smithi084.hjmnez (mgr.14162) 196 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:11.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.228+0000 7f500937e700 1 -- 172.21.15.84:0/2998620531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 msgr2=0x7f50040f4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:11.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.228+0000 7f500937e700 1 --2- 172.21.15.84:0/2998620531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 0x7f50040f4ec0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f4ff4004660 tx=0x7f4ff4009b30).stop 2024-02-15T18:23:11.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.228+0000 7f500937e700 1 -- 172.21.15.84:0/2998620531 shutdown_connections 2024-02-15T18:23:11.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.228+0000 7f500937e700 1 --2- 172.21.15.84:0/2998620531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50040f5440 0x7f50040f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:11.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.228+0000 7f500937e700 1 --2- 172.21.15.84:0/2998620531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 0x7f50040f4ec0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:11.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.228+0000 7f500937e700 1 -- 172.21.15.84:0/2998620531 >> 172.21.15.84:0/2998620531 conn(0x7f50040f05e0 msgr2=0x7f50040f2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:11.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.228+0000 7f500937e700 1 -- 172.21.15.84:0/2998620531 shutdown_connections 2024-02-15T18:23:11.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.228+0000 7f500937e700 1 -- 172.21.15.84:0/2998620531 wait complete. 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f500937e700 1 Processor -- start 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f500937e700 1 -- start start 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f500937e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 0x7f5004107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f500937e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50040f5440 0x7f5004107710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f500937e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004107cc0 con 0x7f50040f4aa0 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f500937e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004107e00 con 0x7f50040f5440 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f5002ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 0x7f5004107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f5002ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 0x7f5004107220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47602/0 (socket says 172.21.15.84:47602) 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f5002ffd700 1 -- 172.21.15.84:0/1907871968 learned_addr learned my addr 172.21.15.84:0/1907871968 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f50027fc700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50040f5440 0x7f5004107710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f5002ffd700 1 -- 172.21.15.84:0/1907871968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50040f5440 msgr2=0x7f5004107710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f5002ffd700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50040f5440 0x7f5004107710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f5002ffd700 1 -- 172.21.15.84:0/1907871968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4005040 con 0x7f50040f4aa0 2024-02-15T18:23:11.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.229+0000 7f50027fc700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50040f5440 0x7f5004107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:23:11.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.230+0000 7f5002ffd700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 0x7f5004107220 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f4ff4004e30 tx=0x7f4ff4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:11.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.230+0000 7f4feb7fe700 1 -- 172.21.15.84:0/1907871968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff4018070 con 0x7f50040f4aa0 2024-02-15T18:23:11.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.230+0000 7f4feb7fe700 1 -- 172.21.15.84:0/1907871968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ff4007ba0 con 0x7f50040f4aa0 2024-02-15T18:23:11.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.230+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5004108740 con 0x7f50040f4aa0 2024-02-15T18:23:11.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.230+0000 7f4feb7fe700 1 -- 172.21.15.84:0/1907871968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff401c620 con 0x7f50040f4aa0 2024-02-15T18:23:11.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.230+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004108ca0 con 0x7f50040f4aa0 2024-02-15T18:23:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.231+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f500405dcf0 con 0x7f50040f4aa0 2024-02-15T18:23:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.231+0000 7f4feb7fe700 1 -- 172.21.15.84:0/1907871968 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4ff4007d10 con 0x7f50040f4aa0 2024-02-15T18:23:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.231+0000 7f4feb7fe700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4fec05c2a0 0x7f4fec05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.232+0000 7f4feb7fe700 1 -- 172.21.15.84:0/1907871968 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f4ff40777b0 con 0x7f50040f4aa0 2024-02-15T18:23:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.232+0000 7f50027fc700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4fec05c2a0 0x7f4fec05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.232+0000 7f4feb7fe700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] conn(0x7f4fec062080 0x7f4fec0644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.232+0000 7f4feb7fe700 1 -- 172.21.15.84:0/1907871968 --> [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4fec064b60 con 0x7f4fec062080 2024-02-15T18:23:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.232+0000 7f4feb7fe700 1 -- 172.21.15.84:0/1907871968 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ff407c220 con 0x7f50040f4aa0 2024-02-15T18:23:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.232+0000 7f50037fe700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] conn(0x7f4fec062080 0x7f4fec0644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.232+0000 7f50027fc700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4fec05c2a0 0x7f4fec05e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f50040f5880 tx=0x7f4ff8009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.232+0000 7f50037fe700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] conn(0x7f4fec062080 0x7f4fec0644e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.233+0000 7f4feb7fe700 1 -- 172.21.15.84:0/1907871968 <== osd.2 v2:172.21.15.84:6818/686993623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f4fec064b60 con 0x7f4fec062080 2024-02-15T18:23:11.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 --> [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5004109150 con 0x7f4fec062080 2024-02-15T18:23:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f4feb7fe700 1 -- 172.21.15.84:0/1907871968 <== osd.2 v2:172.21.15.84:6818/686993623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5004109150 con 0x7f4fec062080 2024-02-15T18:23:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] conn(0x7f4fec062080 msgr2=0x7f4fec0644e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] conn(0x7f4fec062080 0x7f4fec0644e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4fec05c2a0 msgr2=0x7f4fec05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4fec05c2a0 0x7f4fec05e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f50040f5880 tx=0x7f4ff8009be0).stop 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 msgr2=0x7f5004107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 0x7f5004107220 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f4ff4004e30 tx=0x7f4ff4009b30).stop 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 shutdown_connections 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6818/686993623,v1:172.21.15.84:6819/686993623] conn(0x7f4fec062080 0x7f4fec0644e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4fec05c2a0 0x7f4fec05e760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50040f4aa0 0x7f5004107220 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 --2- 172.21.15.84:0/1907871968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50040f5440 0x7f5004107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 >> 172.21.15.84:0/1907871968 conn(0x7f50040f05e0 msgr2=0x7f50040fb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 shutdown_connections 2024-02-15T18:23:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:11.247+0000 7f500937e700 1 -- 172.21.15.84:0/1907871968 wait complete. 2024-02-15T18:23:11.880 INFO:teuthology.orchestra.run.smithi084.stdout:81604378646 2024-02-15T18:23:11.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-15T18:23:12.108 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:12.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:10.388802+0000 mgr.smithi084.hjmnez (mgr.14162) 197 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:12.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:10.388802+0000 mgr.smithi084.hjmnez (mgr.14162) 197 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.869+0000 7f6795f7c700 1 -- 172.21.15.84:0/24908172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 msgr2=0x7f67900f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.869+0000 7f6795f7c700 1 --2- 172.21.15.84:0/24908172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 0x7f67900f7ec0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6780004660 tx=0x7f6780009b30).stop 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.869+0000 7f6795f7c700 1 -- 172.21.15.84:0/24908172 shutdown_connections 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.869+0000 7f6795f7c700 1 --2- 172.21.15.84:0/24908172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 0x7f67900f7ec0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.869+0000 7f6795f7c700 1 --2- 172.21.15.84:0/24908172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67900f67c0 0x7f67900f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.869+0000 7f6795f7c700 1 -- 172.21.15.84:0/24908172 >> 172.21.15.84:0/24908172 conn(0x7f67900f1f20 msgr2=0x7f67900f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.869+0000 7f6795f7c700 1 -- 172.21.15.84:0/24908172 shutdown_connections 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.869+0000 7f6795f7c700 1 -- 172.21.15.84:0/24908172 wait complete. 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.870+0000 7f6795f7c700 1 Processor -- start 2024-02-15T18:23:13.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.870+0000 7f6795f7c700 1 -- start start 2024-02-15T18:23:13.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.870+0000 7f6795f7c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67900f67c0 0x7f6790107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:13.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.870+0000 7f6795f7c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 0x7f6790107650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:13.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.870+0000 7f6795f7c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790107c90 con 0x7f67900f7a60 2024-02-15T18:23:13.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.870+0000 7f6795f7c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790108540 con 0x7f67900f67c0 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.870+0000 7f678effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 0x7f6790107650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.870+0000 7f678effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 0x7f6790107650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47208/0 (socket says 172.21.15.84:47208) 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.870+0000 7f678effd700 1 -- 172.21.15.84:0/3904423054 learned_addr learned my addr 172.21.15.84:0/3904423054 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f678f7fe700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67900f67c0 0x7f6790107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f678effd700 1 -- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67900f67c0 msgr2=0x7f6790107160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f678effd700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67900f67c0 0x7f6790107160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f678effd700 1 -- 172.21.15.84:0/3904423054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780005040 con 0x7f67900f7a60 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f678f7fe700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67900f67c0 0x7f6790107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f678effd700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 0x7f6790107650 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6780009830 tx=0x7f6780009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f6777fff700 1 -- 172.21.15.84:0/3904423054 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6780018070 con 0x7f67900f7a60 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f6777fff700 1 -- 172.21.15.84:0/3904423054 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6780007d70 con 0x7f67900f7a60 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67901087c0 con 0x7f67900f7a60 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f6777fff700 1 -- 172.21.15.84:0/3904423054 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f678001c620 con 0x7f67900f7a60 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.871+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6790108d20 con 0x7f67900f7a60 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.872+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f679005dd30 con 0x7f67900f7a60 2024-02-15T18:23:13.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.872+0000 7f6777fff700 1 -- 172.21.15.84:0/3904423054 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f678001d980 con 0x7f67900f7a60 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.872+0000 7f6777fff700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f677805c2a0 0x7f677805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.873+0000 7f6777fff700 1 -- 172.21.15.84:0/3904423054 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f6780077a70 con 0x7f67900f7a60 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.873+0000 7f678f7fe700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f677805c2a0 0x7f677805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.873+0000 7f6777fff700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] conn(0x7f6778062030 0x7f6778064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.873+0000 7f6777fff700 1 -- 172.21.15.84:0/3904423054 --> [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6778064b10 con 0x7f6778062030 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.873+0000 7f6777fff700 1 -- 172.21.15.84:0/3904423054 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f678007c220 con 0x7f67900f7a60 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.873+0000 7f678f7fe700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f677805c2a0 0x7f677805e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f67900f78c0 tx=0x7f6784008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.873+0000 7f678ffff700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] conn(0x7f6778062030 0x7f6778064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.873+0000 7f678ffff700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] conn(0x7f6778062030 0x7f6778064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:13.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.874+0000 7f6777fff700 1 -- 172.21.15.84:0/3904423054 <== osd.3 v2:172.21.15.133:6800/1663108677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f6778064b10 con 0x7f6778062030 2024-02-15T18:23:13.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.888+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 --> [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6790109200 con 0x7f6778062030 2024-02-15T18:23:13.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6777fff700 1 -- 172.21.15.84:0/3904423054 <== osd.3 v2:172.21.15.133:6800/1663108677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6790109200 con 0x7f6778062030 2024-02-15T18:23:13.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] conn(0x7f6778062030 msgr2=0x7f6778064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] conn(0x7f6778062030 0x7f6778064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f677805c2a0 msgr2=0x7f677805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f677805c2a0 0x7f677805e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f67900f78c0 tx=0x7f6784008040).stop 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 msgr2=0x7f6790107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 0x7f6790107650 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6780009830 tx=0x7f6780009b30).stop 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 shutdown_connections 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:6800/1663108677,v1:172.21.15.133:6801/1663108677] conn(0x7f6778062030 0x7f6778064490 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f677805c2a0 0x7f677805e760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67900f67c0 0x7f6790107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 --2- 172.21.15.84:0/3904423054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67900f7a60 0x7f6790107650 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.889+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 >> 172.21.15.84:0/3904423054 conn(0x7f67900f1f20 msgr2=0x7f67900fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.890+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 shutdown_connections 2024-02-15T18:23:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:13.890+0000 7f6795f7c700 1 -- 172.21.15.84:0/3904423054 wait complete. 2024-02-15T18:23:14.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:12.389070+0000 mgr.smithi084.hjmnez (mgr.14162) 198 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:14.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:12.389070+0000 mgr.smithi084.hjmnez (mgr.14162) 198 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:14.576 INFO:teuthology.orchestra.run.smithi084.stdout:115964117010 2024-02-15T18:23:14.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-15T18:23:14.800 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:16.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:14.389430+0000 mgr.smithi084.hjmnez (mgr.14162) 199 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:16.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:14.389430+0000 mgr.smithi084.hjmnez (mgr.14162) 199 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.686+0000 7fa554c20700 1 -- 172.21.15.84:0/821020976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 msgr2=0x7fa5500f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.686+0000 7fa554c20700 1 --2- 172.21.15.84:0/821020976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 0x7fa5500f5ae0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa538004660 tx=0x7fa538009b30).stop 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.686+0000 7fa554c20700 1 -- 172.21.15.84:0/821020976 shutdown_connections 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.686+0000 7fa554c20700 1 --2- 172.21.15.84:0/821020976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5500f6960 0x7fa5500f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.686+0000 7fa554c20700 1 --2- 172.21.15.84:0/821020976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 0x7fa5500f5ae0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.686+0000 7fa554c20700 1 -- 172.21.15.84:0/821020976 >> 172.21.15.84:0/821020976 conn(0x7fa5500f0e20 msgr2=0x7fa5500f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.686+0000 7fa554c20700 1 -- 172.21.15.84:0/821020976 shutdown_connections 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.686+0000 7fa554c20700 1 -- 172.21.15.84:0/821020976 wait complete. 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa554c20700 1 Processor -- start 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa554c20700 1 -- start start 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa554c20700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 0x7fa5501060f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:16.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa554c20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5500f6960 0x7fa5501065e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa554c20700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa550106b90 con 0x7fa5500f56c0 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa554c20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa550106cd0 con 0x7fa5500f6960 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa54e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 0x7fa5501060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa54e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 0x7fa5501060f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47234/0 (socket says 172.21.15.84:47234) 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa54e59c700 1 -- 172.21.15.84:0/738208935 learned_addr learned my addr 172.21.15.84:0/738208935 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa54dd9b700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5500f6960 0x7fa5501065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa54e59c700 1 -- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5500f6960 msgr2=0x7fa5501065e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa54e59c700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5500f6960 0x7fa5501065e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa54e59c700 1 -- 172.21.15.84:0/738208935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538005040 con 0x7fa5500f56c0 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.687+0000 7fa54e59c700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 0x7fa5501060f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa538004e30 tx=0x7fa538009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.688+0000 7fa546ffd700 1 -- 172.21.15.84:0/738208935 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa538018070 con 0x7fa5500f56c0 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.688+0000 7fa546ffd700 1 -- 172.21.15.84:0/738208935 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa538007ba0 con 0x7fa5500f56c0 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.688+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa550107610 con 0x7fa5500f56c0 2024-02-15T18:23:16.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.688+0000 7fa546ffd700 1 -- 172.21.15.84:0/738208935 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa53801c620 con 0x7fa5500f56c0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.688+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa550107b70 con 0x7fa5500f56c0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.688+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa55005dd30 con 0x7fa5500f56c0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.689+0000 7fa546ffd700 1 -- 172.21.15.84:0/738208935 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa538007d10 con 0x7fa5500f56c0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.689+0000 7fa546ffd700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa53c05c2a0 0x7fa53c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.689+0000 7fa546ffd700 1 -- 172.21.15.84:0/738208935 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fa538077f80 con 0x7fa5500f56c0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.689+0000 7fa54dd9b700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa53c05c2a0 0x7fa53c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.689+0000 7fa546ffd700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] conn(0x7fa53c062030 0x7fa53c064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.689+0000 7fa546ffd700 1 -- 172.21.15.84:0/738208935 --> [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa53c064b10 con 0x7fa53c062030 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.689+0000 7fa546ffd700 1 -- 172.21.15.84:0/738208935 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa538078380 con 0x7fa5500f56c0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.690+0000 7fa54dd9b700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa53c05c2a0 0x7fa53c05e760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa5400096c0 tx=0x7fa540009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.690+0000 7fa54ed9d700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] conn(0x7fa53c062030 0x7fa53c064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.690+0000 7fa54ed9d700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] conn(0x7fa53c062030 0x7fa53c064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:16.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.691+0000 7fa546ffd700 1 -- 172.21.15.84:0/738208935 <== osd.4 v2:172.21.15.133:6808/16944871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa53c064b10 con 0x7fa53c062030 2024-02-15T18:23:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.705+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 --> [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa550108020 con 0x7fa53c062030 2024-02-15T18:23:16.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa546ffd700 1 -- 172.21.15.84:0/738208935 <== osd.4 v2:172.21.15.133:6808/16944871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa550108020 con 0x7fa53c062030 2024-02-15T18:23:16.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] conn(0x7fa53c062030 msgr2=0x7fa53c064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:16.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] conn(0x7fa53c062030 0x7fa53c064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:16.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa53c05c2a0 msgr2=0x7fa53c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:16.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa53c05c2a0 0x7fa53c05e760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa5400096c0 tx=0x7fa540009be0).stop 2024-02-15T18:23:16.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 msgr2=0x7fa5501060f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:16.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 0x7fa5501060f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa538004e30 tx=0x7fa538009b30).stop 2024-02-15T18:23:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 shutdown_connections 2024-02-15T18:23:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:6808/16944871,v1:172.21.15.133:6809/16944871] conn(0x7fa53c062030 0x7fa53c064490 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa53c05c2a0 0x7fa53c05e760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5500f56c0 0x7fa5501060f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 --2- 172.21.15.84:0/738208935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5500f6960 0x7fa5501065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 >> 172.21.15.84:0/738208935 conn(0x7fa5500f0e20 msgr2=0x7fa5500fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 shutdown_connections 2024-02-15T18:23:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:16.706+0000 7fa554c20700 1 -- 172.21.15.84:0/738208935 wait complete. 2024-02-15T18:23:17.519 INFO:teuthology.orchestra.run.smithi084.stdout:141733920782 2024-02-15T18:23:17.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-15T18:23:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:18.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:16.389739+0000 mgr.smithi084.hjmnez (mgr.14162) 200 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:18.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:16.389739+0000 mgr.smithi084.hjmnez (mgr.14162) 200 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:19.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.651+0000 7fbee26fa700 1 -- 172.21.15.84:0/2374464041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 msgr2=0x7fbedc0fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.651+0000 7fbee26fa700 1 --2- 172.21.15.84:0/2374464041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 0x7fbedc0fbd80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fbecc004660 tx=0x7fbecc009b30).stop 2024-02-15T18:23:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.651+0000 7fbee26fa700 1 -- 172.21.15.84:0/2374464041 shutdown_connections 2024-02-15T18:23:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.651+0000 7fbee26fa700 1 --2- 172.21.15.84:0/2374464041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 0x7fbedc0fbd80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.651+0000 7fbee26fa700 1 --2- 172.21.15.84:0/2374464041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbedc0607d0 0x7fbedc0f9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.651+0000 7fbee26fa700 1 -- 172.21.15.84:0/2374464041 >> 172.21.15.84:0/2374464041 conn(0x7fbedc0f0e20 msgr2=0x7fbedc0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.651+0000 7fbee26fa700 1 -- 172.21.15.84:0/2374464041 shutdown_connections 2024-02-15T18:23:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.651+0000 7fbee26fa700 1 -- 172.21.15.84:0/2374464041 wait complete. 2024-02-15T18:23:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbee26fa700 1 Processor -- start 2024-02-15T18:23:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbee26fa700 1 -- start start 2024-02-15T18:23:19.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbee26fa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbedc0607d0 0x7fbedc107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbee26fa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 0x7fbedc107650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbee26fa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc107c00 con 0x7fbedc0f9930 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbee26fa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc107d40 con 0x7fbedc0607d0 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbedb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 0x7fbedc107650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbedb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 0x7fbedc107650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47242/0 (socket says 172.21.15.84:47242) 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbedb7fe700 1 -- 172.21.15.84:0/1493538398 learned_addr learned my addr 172.21.15.84:0/1493538398 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbedbfff700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbedc0607d0 0x7fbedc107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbedb7fe700 1 -- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbedc0607d0 msgr2=0x7fbedc107160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbedb7fe700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbedc0607d0 0x7fbedc107160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.652+0000 7fbedb7fe700 1 -- 172.21.15.84:0/1493538398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc005040 con 0x7fbedc0f9930 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.653+0000 7fbedb7fe700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 0x7fbedc107650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fbecc004e30 tx=0x7fbecc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:19.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.653+0000 7fbed8ff9700 1 -- 172.21.15.84:0/1493538398 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbecc018070 con 0x7fbedc0f9930 2024-02-15T18:23:19.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.653+0000 7fbed8ff9700 1 -- 172.21.15.84:0/1493538398 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbecc007ba0 con 0x7fbedc0f9930 2024-02-15T18:23:19.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.653+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc108680 con 0x7fbedc0f9930 2024-02-15T18:23:19.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.653+0000 7fbed8ff9700 1 -- 172.21.15.84:0/1493538398 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbecc01c3c0 con 0x7fbedc0f9930 2024-02-15T18:23:19.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.653+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc108be0 con 0x7fbedc0f9930 2024-02-15T18:23:19.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.654+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbedc05dd30 con 0x7fbedc0f9930 2024-02-15T18:23:19.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.654+0000 7fbed8ff9700 1 -- 172.21.15.84:0/1493538398 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fbecc007d10 con 0x7fbedc0f9930 2024-02-15T18:23:19.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.654+0000 7fbed8ff9700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbec805c2a0 0x7fbec805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.655+0000 7fbed8ff9700 1 -- 172.21.15.84:0/1493538398 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fbecc077800 con 0x7fbedc0f9930 2024-02-15T18:23:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.655+0000 7fbedbfff700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbec805c2a0 0x7fbec805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.655+0000 7fbed8ff9700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] conn(0x7fbec8062030 0x7fbec8064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.655+0000 7fbed8ff9700 1 -- 172.21.15.84:0/1493538398 --> [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbec8064b10 con 0x7fbec8062030 2024-02-15T18:23:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.655+0000 7fbed8ff9700 1 -- 172.21.15.84:0/1493538398 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbecc07c220 con 0x7fbedc0f9930 2024-02-15T18:23:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.655+0000 7fbedbfff700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbec805c2a0 0x7fbec805e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbec4004c40 tx=0x7fbec400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.655+0000 7fbee0c97700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] conn(0x7fbec8062030 0x7fbec8064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.656+0000 7fbee0c97700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] conn(0x7fbec8062030 0x7fbec8064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:19.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.656+0000 7fbed8ff9700 1 -- 172.21.15.84:0/1493538398 <== osd.5 v2:172.21.15.133:6816/212697091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fbec8064b10 con 0x7fbec8062030 2024-02-15T18:23:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.671+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 --> [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbedc109040 con 0x7fbec8062030 2024-02-15T18:23:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.671+0000 7fbed8ff9700 1 -- 172.21.15.84:0/1493538398 <== osd.5 v2:172.21.15.133:6816/212697091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbedc109040 con 0x7fbec8062030 2024-02-15T18:23:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.671+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] conn(0x7fbec8062030 msgr2=0x7fbec8064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.671+0000 7fbee26fa700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] conn(0x7fbec8062030 0x7fbec8064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.671+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbec805c2a0 msgr2=0x7fbec805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.671+0000 7fbee26fa700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbec805c2a0 0x7fbec805e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbec4004c40 tx=0x7fbec400b040).stop 2024-02-15T18:23:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 msgr2=0x7fbedc107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 0x7fbedc107650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fbecc004e30 tx=0x7fbecc009b30).stop 2024-02-15T18:23:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 shutdown_connections 2024-02-15T18:23:19.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:6816/212697091,v1:172.21.15.133:6817/212697091] conn(0x7fbec8062030 0x7fbec8064490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fbec805c2a0 0x7fbec805e760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbedc0607d0 0x7fbedc107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 --2- 172.21.15.84:0/1493538398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbedc0f9930 0x7fbedc107650 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 >> 172.21.15.84:0/1493538398 conn(0x7fbedc0f0e20 msgr2=0x7fbedc0f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 shutdown_connections 2024-02-15T18:23:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:19.672+0000 7fbee26fa700 1 -- 172.21.15.84:0/1493538398 wait complete. 2024-02-15T18:23:20.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:18.390064+0000 mgr.smithi084.hjmnez (mgr.14162) 201 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:20.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:18.390064+0000 mgr.smithi084.hjmnez (mgr.14162) 201 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:20.498 INFO:teuthology.orchestra.run.smithi084.stdout:163208757259 2024-02-15T18:23:20.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-15T18:23:20.726 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:22.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:20.390345+0000 mgr.smithi084.hjmnez (mgr.14162) 202 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:22.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:20.390345+0000 mgr.smithi084.hjmnez (mgr.14162) 202 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.603+0000 7f4d75144700 1 -- 172.21.15.84:0/2436606076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f67c0 msgr2=0x7f4d700f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 --2- 172.21.15.84:0/2436606076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f67c0 0x7f4d700f6be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f4d64004660 tx=0x7f4d64009b30).stop 2024-02-15T18:23:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 -- 172.21.15.84:0/2436606076 shutdown_connections 2024-02-15T18:23:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 --2- 172.21.15.84:0/2436606076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700f7a60 0x7f4d700f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 --2- 172.21.15.84:0/2436606076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f67c0 0x7f4d700f6be0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 -- 172.21.15.84:0/2436606076 >> 172.21.15.84:0/2436606076 conn(0x7f4d700f1f20 msgr2=0x7f4d700f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 -- 172.21.15.84:0/2436606076 shutdown_connections 2024-02-15T18:23:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 -- 172.21.15.84:0/2436606076 wait complete. 2024-02-15T18:23:22.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 Processor -- start 2024-02-15T18:23:22.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 -- start start 2024-02-15T18:23:22.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700f67c0 0x7f4d70107120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:22.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f7a60 0x7f4d70107610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:22.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70107bc0 con 0x7f4d700f7a60 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.604+0000 7f4d75144700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70107d00 con 0x7f4d700f67c0 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f7a60 0x7f4d70107610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f7a60 0x7f4d70107610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47248/0 (socket says 172.21.15.84:47248) 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d6e59c700 1 -- 172.21.15.84:0/2679952748 learned_addr learned my addr 172.21.15.84:0/2679952748 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d6ed9d700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700f67c0 0x7f4d70107120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d6e59c700 1 -- 172.21.15.84:0/2679952748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700f67c0 msgr2=0x7f4d70107120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d6e59c700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700f67c0 0x7f4d70107120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d6e59c700 1 -- 172.21.15.84:0/2679952748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64005040 con 0x7f4d700f7a60 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d6e59c700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f7a60 0x7f4d70107610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f4d60002700 tx=0x7f4d60009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d577fe700 1 -- 172.21.15.84:0/2679952748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d60009320 con 0x7f4d700f7a60 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d701086a0 con 0x7f4d700f7a60 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d577fe700 1 -- 172.21.15.84:0/2679952748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d6000f040 con 0x7f4d700f7a60 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d577fe700 1 -- 172.21.15.84:0/2679952748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d60014930 con 0x7f4d700f7a60 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.605+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d70108c60 con 0x7f4d700f7a60 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.606+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d70045ad0 con 0x7f4d700f7a60 2024-02-15T18:23:22.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.606+0000 7f4d577fe700 1 -- 172.21.15.84:0/2679952748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4d60009480 con 0x7f4d700f7a60 2024-02-15T18:23:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.607+0000 7f4d577fe700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4d5805c2a0 0x7f4d5805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.607+0000 7f4d577fe700 1 -- 172.21.15.84:0/2679952748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f4d60075ec0 con 0x7f4d700f7a60 2024-02-15T18:23:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.607+0000 7f4d6ed9d700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4d5805c2a0 0x7f4d5805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:22.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.607+0000 7f4d6ed9d700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4d5805c2a0 0x7f4d5805e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f4d64004630 tx=0x7f4d64009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:22.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.611+0000 7f4d577fe700 1 -- 172.21.15.84:0/2679952748 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4d60048ec0 con 0x7f4d700f7a60 2024-02-15T18:23:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.760+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d70027a00 con 0x7f4d700f7a60 2024-02-15T18:23:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.760+0000 7f4d577fe700 1 -- 172.21.15.84:0/2679952748 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d6004c4e0 con 0x7f4d700f7a60 2024-02-15T18:23:22.760 INFO:teuthology.orchestra.run.smithi084.stdout:38654705698 2024-02-15T18:23:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.761+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4d5805c2a0 msgr2=0x7f4d5805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.761+0000 7f4d75144700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4d5805c2a0 0x7f4d5805e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f4d64004630 tx=0x7f4d64009b30).stop 2024-02-15T18:23:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.761+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f7a60 msgr2=0x7f4d70107610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.761+0000 7f4d75144700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f7a60 0x7f4d70107610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f4d60002700 tx=0x7f4d60009e00).stop 2024-02-15T18:23:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.761+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 shutdown_connections 2024-02-15T18:23:22.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.761+0000 7f4d75144700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4d5805c2a0 0x7f4d5805e760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.761+0000 7f4d75144700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700f67c0 0x7f4d70107120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.761+0000 7f4d75144700 1 --2- 172.21.15.84:0/2679952748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d700f7a60 0x7f4d70107610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.761+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 >> 172.21.15.84:0/2679952748 conn(0x7f4d700f1f20 msgr2=0x7f4d700fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.762+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 shutdown_connections 2024-02-15T18:23:22.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:22.762+0000 7f4d75144700 1 -- 172.21.15.84:0/2679952748 wait complete. 2024-02-15T18:23:23.192 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:22.761031+0000 mon.smithi084 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.84:0/2679952748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-15T18:23:23.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:22.761031+0000 mon.smithi084 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.84:0/2679952748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-15T18:23:23.676 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705695 got 38654705698 for osd.0 2024-02-15T18:23:23.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-15T18:23:23.902 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:24.367 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:22.390680+0000 mgr.smithi084.hjmnez (mgr.14162) 203 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:22.390680+0000 mgr.smithi084.hjmnez (mgr.14162) 203 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:25.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.623+0000 7fe450670700 1 -- 172.21.15.84:0/2528345782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f7a70 msgr2=0x7fe4480f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.623+0000 7fe450670700 1 --2- 172.21.15.84:0/2528345782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f7a70 0x7fe4480f7ed0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fe444004660 tx=0x7fe444009b30).stop 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.623+0000 7fe450670700 1 -- 172.21.15.84:0/2528345782 shutdown_connections 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.623+0000 7fe450670700 1 --2- 172.21.15.84:0/2528345782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f7a70 0x7fe4480f7ed0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.623+0000 7fe450670700 1 --2- 172.21.15.84:0/2528345782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4480f67d0 0x7fe4480f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.623+0000 7fe450670700 1 -- 172.21.15.84:0/2528345782 >> 172.21.15.84:0/2528345782 conn(0x7fe4480f1f50 msgr2=0x7fe4480f4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.623+0000 7fe450670700 1 -- 172.21.15.84:0/2528345782 shutdown_connections 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.623+0000 7fe450670700 1 -- 172.21.15.84:0/2528345782 wait complete. 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.623+0000 7fe450670700 1 Processor -- start 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe450670700 1 -- start start 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe450670700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f67d0 0x7fe44806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:25.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe450670700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4480f7a70 0x7fe448069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe450670700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44806a410 con 0x7fe4480f67d0 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe450670700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44806a550 con 0x7fe4480f7a70 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe44e40c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f67d0 0x7fe44806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe44e40c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f67d0 0x7fe44806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57738/0 (socket says 172.21.15.84:57738) 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe44e40c700 1 -- 172.21.15.84:0/1920888503 learned_addr learned my addr 172.21.15.84:0/1920888503 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe44e40c700 1 -- 172.21.15.84:0/1920888503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4480f7a70 msgr2=0x7fe448069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe44e40c700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4480f7a70 0x7fe448069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe44e40c700 1 -- 172.21.15.84:0/1920888503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444005040 con 0x7fe4480f67d0 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe44e40c700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f67d0 0x7fe44806b9a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fe4380093f0 tx=0x7fe438006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe43effd700 1 -- 172.21.15.84:0/1920888503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe438009ea0 con 0x7fe4480f67d0 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44806a830 con 0x7fe4480f67d0 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe43effd700 1 -- 172.21.15.84:0/1920888503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe438013b10 con 0x7fe4480f67d0 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe43effd700 1 -- 172.21.15.84:0/1920888503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe43800dbc0 con 0x7fe4480f67d0 2024-02-15T18:23:25.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.624+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44810f1d0 con 0x7fe4480f67d0 2024-02-15T18:23:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.625+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe430004fa0 con 0x7fe4480f67d0 2024-02-15T18:23:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.626+0000 7fe43effd700 1 -- 172.21.15.84:0/1920888503 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe43801a060 con 0x7fe4480f67d0 2024-02-15T18:23:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.626+0000 7fe43effd700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe43405c2a0 0x7fe43405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:25.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.626+0000 7fe43effd700 1 -- 172.21.15.84:0/1920888503 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fe438075b40 con 0x7fe4480f67d0 2024-02-15T18:23:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.626+0000 7fe44dc0b700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe43405c2a0 0x7fe43405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:25.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.626+0000 7fe44dc0b700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe43405c2a0 0x7fe43405e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe444009f50 tx=0x7fe444009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:25.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.630+0000 7fe43effd700 1 -- 172.21.15.84:0/1920888503 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe438048ae0 con 0x7fe4480f67d0 2024-02-15T18:23:25.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.783+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe430005670 con 0x7fe4480f67d0 2024-02-15T18:23:25.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.783+0000 7fe43effd700 1 -- 172.21.15.84:0/1920888503 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe43804c100 con 0x7fe4480f67d0 2024-02-15T18:23:25.783 INFO:teuthology.orchestra.run.smithi084.stdout:60129542173 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe43405c2a0 msgr2=0x7fe43405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe43405c2a0 0x7fe43405e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe444009f50 tx=0x7fe444009b30).stop 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f67d0 msgr2=0x7fe44806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f67d0 0x7fe44806b9a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fe4380093f0 tx=0x7fe438006ec0).stop 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 shutdown_connections 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe43405c2a0 0x7fe43405e760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4480f67d0 0x7fe44806b9a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 --2- 172.21.15.84:0/1920888503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4480f7a70 0x7fe448069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 >> 172.21.15.84:0/1920888503 conn(0x7fe4480f1f50 msgr2=0x7fe4480fb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 shutdown_connections 2024-02-15T18:23:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:25.785+0000 7fe450670700 1 -- 172.21.15.84:0/1920888503 wait complete. 2024-02-15T18:23:26.081 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:24.390984+0000 mgr.smithi084.hjmnez (mgr.14162) 204 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:26.081 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:25.784109+0000 mon.smithi084 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.84:0/1920888503' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-15T18:23:26.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:24.390984+0000 mgr.smithi084.hjmnez (mgr.14162) 204 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:26.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:25.784109+0000 mon.smithi084 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.84:0/1920888503' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-15T18:23:26.415 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542170 got 60129542173 for osd.1 2024-02-15T18:23:26.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-15T18:23:26.640 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:28.174 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:26.391308+0000 mgr.smithi084.hjmnez (mgr.14162) 205 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:28.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.389+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/1373856820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 msgr2=0x7f8b740f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:28.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.389+0000 7f8b7b8d7700 1 --2- 172.21.15.84:0/1373856820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 0x7f8b740f5ae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8b70004660 tx=0x7f8b70009b30).stop 2024-02-15T18:23:28.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.389+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/1373856820 shutdown_connections 2024-02-15T18:23:28.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.389+0000 7f8b7b8d7700 1 --2- 172.21.15.84:0/1373856820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b740f6960 0x7f8b740f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:28.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.389+0000 7f8b7b8d7700 1 --2- 172.21.15.84:0/1373856820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 0x7f8b740f5ae0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:28.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.389+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/1373856820 >> 172.21.15.84:0/1373856820 conn(0x7f8b740f0e20 msgr2=0x7f8b740f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:28.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/1373856820 shutdown_connections 2024-02-15T18:23:28.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/1373856820 wait complete. 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b7b8d7700 1 Processor -- start 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b7b8d7700 1 -- start start 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b7b8d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 0x7f8b741071d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b7b8d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b740f6960 0x7f8b741076c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b7b8d7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74107c70 con 0x7f8b740f56c0 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b7b8d7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74107db0 con 0x7f8b740f6960 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b79673700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 0x7f8b741071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b79673700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 0x7f8b741071d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57768/0 (socket says 172.21.15.84:57768) 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b79673700 1 -- 172.21.15.84:0/3467612987 learned_addr learned my addr 172.21.15.84:0/3467612987 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.390+0000 7f8b78e72700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b740f6960 0x7f8b741076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:28.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.391+0000 7f8b79673700 1 -- 172.21.15.84:0/3467612987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b740f6960 msgr2=0x7f8b741076c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.391+0000 7f8b79673700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b740f6960 0x7f8b741076c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.391+0000 7f8b79673700 1 -- 172.21.15.84:0/3467612987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70005040 con 0x7f8b740f56c0 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.391+0000 7f8b79673700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 0x7f8b741071d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8b70009f50 tx=0x7f8b70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.391+0000 7f8b69ffb700 1 -- 172.21.15.84:0/3467612987 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b70018070 con 0x7f8b740f56c0 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.391+0000 7f8b69ffb700 1 -- 172.21.15.84:0/3467612987 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b70007c70 con 0x7f8b740f56c0 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.391+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b741086f0 con 0x7f8b740f56c0 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.391+0000 7f8b69ffb700 1 -- 172.21.15.84:0/3467612987 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b7001c620 con 0x7f8b740f56c0 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.391+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b74108c50 con 0x7f8b740f56c0 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.392+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b74045ad0 con 0x7f8b740f56c0 2024-02-15T18:23:28.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.392+0000 7f8b69ffb700 1 -- 172.21.15.84:0/3467612987 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8b7001d420 con 0x7f8b740f56c0 2024-02-15T18:23:28.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.393+0000 7f8b69ffb700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b6005c2a0 0x7f8b6005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:28.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.393+0000 7f8b69ffb700 1 -- 172.21.15.84:0/3467612987 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f8b70077870 con 0x7f8b740f56c0 2024-02-15T18:23:28.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.393+0000 7f8b78e72700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b6005c2a0 0x7f8b6005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:28.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.393+0000 7f8b78e72700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b6005c2a0 0x7f8b6005e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8b640041d0 tx=0x7f8b64009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:28.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:26.391308+0000 mgr.smithi084.hjmnez (mgr.14162) 205 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:28.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.397+0000 7f8b69ffb700 1 -- 172.21.15.84:0/3467612987 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8b7004a8f0 con 0x7f8b740f56c0 2024-02-15T18:23:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.548+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8b741093a0 con 0x7f8b740f56c0 2024-02-15T18:23:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.549+0000 7f8b69ffb700 1 -- 172.21.15.84:0/3467612987 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b7004df10 con 0x7f8b740f56c0 2024-02-15T18:23:28.549 INFO:teuthology.orchestra.run.smithi084.stdout:81604378649 2024-02-15T18:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b6005c2a0 msgr2=0x7f8b6005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b6005c2a0 0x7f8b6005e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8b640041d0 tx=0x7f8b64009040).stop 2024-02-15T18:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 msgr2=0x7f8b741071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 0x7f8b741071d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8b70009f50 tx=0x7f8b70009b30).stop 2024-02-15T18:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 shutdown_connections 2024-02-15T18:23:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b6005c2a0 0x7f8b6005e760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b740f56c0 0x7f8b741071d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 --2- 172.21.15.84:0/3467612987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b740f6960 0x7f8b741076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 >> 172.21.15.84:0/3467612987 conn(0x7f8b740f0e20 msgr2=0x7f8b740603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 shutdown_connections 2024-02-15T18:23:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:28.550+0000 7f8b7b8d7700 1 -- 172.21.15.84:0/3467612987 wait complete. 2024-02-15T18:23:29.214 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:28.487658+0000 mon.smithi084 (mon.0) 449 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:23:29.214 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:28.487961+0000 mon.smithi084 (mon.0) 450 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:23:29.214 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:28.549719+0000 mon.smithi084 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.84:0/3467612987' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-15T18:23:29.233 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378649 for osd.2 2024-02-15T18:23:29.234 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-15T18:23:29.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:28.487658+0000 mon.smithi084 (mon.0) 449 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:23:29.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:28.487961+0000 mon.smithi084 (mon.0) 450 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:23:29.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:28.549719+0000 mon.smithi084 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.84:0/3467612987' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-15T18:23:29.458 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:30.326 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:28.391607+0000 mgr.smithi084.hjmnez (mgr.14162) 206 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:30.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:28.391607+0000 mgr.smithi084.hjmnez (mgr.14162) 206 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 -- 172.21.15.84:0/3000595196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 msgr2=0x7f97700f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 --2- 172.21.15.84:0/3000595196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 0x7f97700f5b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f9764004660 tx=0x7f9764009b30).stop 2024-02-15T18:23:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 -- 172.21.15.84:0/3000595196 shutdown_connections 2024-02-15T18:23:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 --2- 172.21.15.84:0/3000595196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97700f6980 0x7f97700f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 --2- 172.21.15.84:0/3000595196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 0x7f97700f5b00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 -- 172.21.15.84:0/3000595196 >> 172.21.15.84:0/3000595196 conn(0x7f97700f0e20 msgr2=0x7f97700f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:31.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 -- 172.21.15.84:0/3000595196 shutdown_connections 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 -- 172.21.15.84:0/3000595196 wait complete. 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 Processor -- start 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 -- start start 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 0x7f97701071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97700f6980 0x7f9770107690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770107c40 con 0x7f97700f56e0 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.243+0000 7f9776fb9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770107d80 con 0x7f97700f6980 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f9774d55700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 0x7f97701071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f9774d55700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 0x7f97701071a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57792/0 (socket says 172.21.15.84:57792) 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f9774d55700 1 -- 172.21.15.84:0/3256377739 learned_addr learned my addr 172.21.15.84:0/3256377739 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f9774d55700 1 -- 172.21.15.84:0/3256377739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97700f6980 msgr2=0x7f9770107690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f9774d55700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97700f6980 0x7f9770107690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f9774d55700 1 -- 172.21.15.84:0/3256377739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764005040 con 0x7f97700f56e0 2024-02-15T18:23:31.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f9774d55700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 0x7f97701071a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f9764009f50 tx=0x7f9764009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f976d7fa700 1 -- 172.21.15.84:0/3256377739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9764018070 con 0x7f97700f56e0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97701086c0 con 0x7f97700f56e0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f976d7fa700 1 -- 172.21.15.84:0/3256377739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9764007d70 con 0x7f97700f56e0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f976d7fa700 1 -- 172.21.15.84:0/3256377739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976401c620 con 0x7f97700f56e0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.244+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9770108c20 con 0x7f97700f56e0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.245+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9770045ad0 con 0x7f97700f56e0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.245+0000 7f976d7fa700 1 -- 172.21.15.84:0/3256377739 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f976401c8e0 con 0x7f97700f56e0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.246+0000 7f976d7fa700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f976005c2a0 0x7f976005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.246+0000 7f976d7fa700 1 -- 172.21.15.84:0/3256377739 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f9764077a10 con 0x7f97700f56e0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.246+0000 7f976ffff700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f976005c2a0 0x7f976005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.246+0000 7f976ffff700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f976005c2a0 0x7f976005e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f975c0047d0 tx=0x7f975c007a40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.249+0000 7f976d7fa700 1 -- 172.21.15.84:0/3256377739 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f976404aa10 con 0x7f97700f56e0 2024-02-15T18:23:31.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.398+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f97700fdfb0 con 0x7f97700f56e0 2024-02-15T18:23:31.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.399+0000 7f976d7fa700 1 -- 172.21.15.84:0/3256377739 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f976404e030 con 0x7f97700f56e0 2024-02-15T18:23:31.399 INFO:teuthology.orchestra.run.smithi084.stdout:115964117013 2024-02-15T18:23:31.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f976005c2a0 msgr2=0x7f976005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:31.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f976005c2a0 0x7f976005e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f975c0047d0 tx=0x7f975c007a40).stop 2024-02-15T18:23:31.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 msgr2=0x7f97701071a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:31.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 0x7f97701071a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f9764009f50 tx=0x7f9764009b30).stop 2024-02-15T18:23:31.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 shutdown_connections 2024-02-15T18:23:31.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f976005c2a0 0x7f976005e760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:31.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97700f56e0 0x7f97701071a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:31.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 --2- 172.21.15.84:0/3256377739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97700f6980 0x7f9770107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:31.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 >> 172.21.15.84:0/3256377739 conn(0x7f97700f0e20 msgr2=0x7f977005fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:31.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 shutdown_connections 2024-02-15T18:23:31.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:31.400+0000 7f9776fb9700 1 -- 172.21.15.84:0/3256377739 wait complete. 2024-02-15T18:23:32.041 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117010 got 115964117013 for osd.3 2024-02-15T18:23:32.041 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-15T18:23:32.067 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:30.391967+0000 mgr.smithi084.hjmnez (mgr.14162) 207 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:32.067 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:31.399829+0000 mon.smithi084 (mon.0) 452 : audit [DBG] from='client.? 172.21.15.84:0/3256377739' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-15T18:23:32.263 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:32.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:30.391967+0000 mgr.smithi084.hjmnez (mgr.14162) 207 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:32.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:31.399829+0000 mon.smithi084 (mon.0) 452 : audit [DBG] from='client.? 172.21.15.84:0/3256377739' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 -- 172.21.15.84:0/2231977218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f56c0 msgr2=0x7f9a500f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 --2- 172.21.15.84:0/2231977218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f56c0 0x7f9a500f5ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f9a40004660 tx=0x7f9a40009b30).stop 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 -- 172.21.15.84:0/2231977218 shutdown_connections 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 --2- 172.21.15.84:0/2231977218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a500f6960 0x7f9a500f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 --2- 172.21.15.84:0/2231977218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f56c0 0x7f9a500f5ae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 -- 172.21.15.84:0/2231977218 >> 172.21.15.84:0/2231977218 conn(0x7f9a500f0e20 msgr2=0x7f9a500f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 -- 172.21.15.84:0/2231977218 shutdown_connections 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 -- 172.21.15.84:0/2231977218 wait complete. 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 Processor -- start 2024-02-15T18:23:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 -- start start 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a500f56c0 0x7f9a50109380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.078+0000 7f9a54fd5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f6960 0x7f9a50109870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a54fd5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a50109e20 con 0x7f9a500f6960 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a54fd5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a50109f60 con 0x7f9a500f56c0 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a4dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f6960 0x7f9a50109870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a4dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f6960 0x7f9a50109870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54734/0 (socket says 172.21.15.84:54734) 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a4dd9b700 1 -- 172.21.15.84:0/3065862069 learned_addr learned my addr 172.21.15.84:0/3065862069 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a4e59c700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a500f56c0 0x7f9a50109380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a4dd9b700 1 -- 172.21.15.84:0/3065862069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a500f56c0 msgr2=0x7f9a50109380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a4dd9b700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a500f56c0 0x7f9a50109380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a4dd9b700 1 -- 172.21.15.84:0/3065862069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40005040 con 0x7f9a500f6960 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a4dd9b700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f6960 0x7f9a50109870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f9a4400e7f0 tx=0x7f9a4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a3effd700 1 -- 172.21.15.84:0/3065862069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a440092e0 con 0x7f9a500f6960 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a3effd700 1 -- 172.21.15.84:0/3065862069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a4400f040 con 0x7f9a500f6960 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5010a900 con 0x7f9a500f6960 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a3effd700 1 -- 172.21.15.84:0/3065862069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a440147e0 con 0x7f9a500f6960 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.079+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5010aec0 con 0x7f9a500f6960 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.080+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a50045ad0 con 0x7f9a500f6960 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.080+0000 7f9a3effd700 1 -- 172.21.15.84:0/3065862069 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9a4401b030 con 0x7f9a500f6960 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.081+0000 7f9a3effd700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9a3805c2a0 0x7f9a3805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.081+0000 7f9a3effd700 1 -- 172.21.15.84:0/3065862069 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f9a44075900 con 0x7f9a500f6960 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.081+0000 7f9a4e59c700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9a3805c2a0 0x7f9a3805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.081+0000 7f9a4e59c700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9a3805c2a0 0x7f9a3805e760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f9a40004630 tx=0x7f9a4000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.085+0000 7f9a3effd700 1 -- 172.21.15.84:0/3065862069 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9a440489b0 con 0x7f9a500f6960 2024-02-15T18:23:34.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.234+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9a5010f9a0 con 0x7f9a500f6960 2024-02-15T18:23:34.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.234+0000 7f9a3effd700 1 -- 172.21.15.84:0/3065862069 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a44019070 con 0x7f9a500f6960 2024-02-15T18:23:34.234 INFO:teuthology.orchestra.run.smithi084.stdout:141733920785 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9a3805c2a0 msgr2=0x7f9a3805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9a3805c2a0 0x7f9a3805e760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f9a40004630 tx=0x7f9a4000b040).stop 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f6960 msgr2=0x7f9a50109870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f6960 0x7f9a50109870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f9a4400e7f0 tx=0x7f9a4400b040).stop 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 shutdown_connections 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9a3805c2a0 0x7f9a3805e760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a500f56c0 0x7f9a50109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 --2- 172.21.15.84:0/3065862069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a500f6960 0x7f9a50109870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 >> 172.21.15.84:0/3065862069 conn(0x7f9a500f0e20 msgr2=0x7f9a500603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 shutdown_connections 2024-02-15T18:23:34.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:34.236+0000 7f9a54fd5700 1 -- 172.21.15.84:0/3065862069 wait complete. 2024-02-15T18:23:34.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:32.392580+0000 mgr.smithi084.hjmnez (mgr.14162) 208 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:34.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:32.392580+0000 mgr.smithi084.hjmnez (mgr.14162) 208 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:35.029 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920782 got 141733920785 for osd.4 2024-02-15T18:23:35.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-15T18:23:35.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:34.235406+0000 mon.smithi084 (mon.0) 453 : audit [DBG] from='client.? 172.21.15.84:0/3065862069' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-15T18:23:35.294 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:35.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:34.235406+0000 mon.smithi084 (mon.0) 453 : audit [DBG] from='client.? 172.21.15.84:0/3065862069' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-15T18:23:36.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:34.393096+0000 mgr.smithi084.hjmnez (mgr.14162) 209 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:36.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:34.393096+0000 mgr.smithi084.hjmnez (mgr.14162) 209 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:37.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.045+0000 7fa3df6b1700 1 -- 172.21.15.84:0/4033778150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 msgr2=0x7fa3d80f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:37.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.045+0000 7fa3df6b1700 1 --2- 172.21.15.84:0/4033778150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 0x7fa3d80f5ae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fa3d4004660 tx=0x7fa3d4009b30).stop 2024-02-15T18:23:37.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.046+0000 7fa3df6b1700 1 -- 172.21.15.84:0/4033778150 shutdown_connections 2024-02-15T18:23:37.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.046+0000 7fa3df6b1700 1 --2- 172.21.15.84:0/4033778150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80f6960 0x7fa3d80f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:37.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.046+0000 7fa3df6b1700 1 --2- 172.21.15.84:0/4033778150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 0x7fa3d80f5ae0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:37.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.046+0000 7fa3df6b1700 1 -- 172.21.15.84:0/4033778150 >> 172.21.15.84:0/4033778150 conn(0x7fa3d80f0e20 msgr2=0x7fa3d80f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:37.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.046+0000 7fa3df6b1700 1 -- 172.21.15.84:0/4033778150 shutdown_connections 2024-02-15T18:23:37.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.046+0000 7fa3df6b1700 1 -- 172.21.15.84:0/4033778150 wait complete. 2024-02-15T18:23:37.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.046+0000 7fa3df6b1700 1 Processor -- start 2024-02-15T18:23:37.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3df6b1700 1 -- start start 2024-02-15T18:23:37.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3df6b1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 0x7fa3d80f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:37.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3df6b1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80f6960 0x7fa3d80f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:37.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3df6b1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80f8200 con 0x7fa3d80f56c0 2024-02-15T18:23:37.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3df6b1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80f8340 con 0x7fa3d80f6960 2024-02-15T18:23:37.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3dd44d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 0x7fa3d80f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3dd44d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 0x7fa3d80f9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54742/0 (socket says 172.21.15.84:54742) 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3dd44d700 1 -- 172.21.15.84:0/2968630991 learned_addr learned my addr 172.21.15.84:0/2968630991 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3dcc4c700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80f6960 0x7fa3d80f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3dd44d700 1 -- 172.21.15.84:0/2968630991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80f6960 msgr2=0x7fa3d80f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3dd44d700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80f6960 0x7fa3d80f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3dd44d700 1 -- 172.21.15.84:0/2968630991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4005040 con 0x7fa3d80f56c0 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3dcc4c700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80f6960 0x7fa3d80f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.047+0000 7fa3dd44d700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 0x7fa3d80f9820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa3d4009f50 tx=0x7fa3d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.048+0000 7fa3cdffb700 1 -- 172.21.15.84:0/2968630991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d4018070 con 0x7fa3d80f56c0 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.048+0000 7fa3cdffb700 1 -- 172.21.15.84:0/2968630991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3d4007d70 con 0x7fa3d80f56c0 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.048+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d80f85c0 con 0x7fa3d80f56c0 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.048+0000 7fa3cdffb700 1 -- 172.21.15.84:0/2968630991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d401c620 con 0x7fa3d80f56c0 2024-02-15T18:23:37.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.048+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d80f8b20 con 0x7fa3d80f56c0 2024-02-15T18:23:37.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.049+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d8045ad0 con 0x7fa3d80f56c0 2024-02-15T18:23:37.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.049+0000 7fa3cdffb700 1 -- 172.21.15.84:0/2968630991 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa3d401d420 con 0x7fa3d80f56c0 2024-02-15T18:23:37.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.050+0000 7fa3cdffb700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3c405c2a0 0x7fa3c405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:37.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.050+0000 7fa3cdffb700 1 -- 172.21.15.84:0/2968630991 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fa3d4077970 con 0x7fa3d80f56c0 2024-02-15T18:23:37.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.050+0000 7fa3dcc4c700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3c405c2a0 0x7fa3c405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:37.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.050+0000 7fa3dcc4c700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3c405c2a0 0x7fa3c405e760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa3c8004a90 tx=0x7fa3c8009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:37.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.053+0000 7fa3cdffb700 1 -- 172.21.15.84:0/2968630991 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa3d404a9f0 con 0x7fa3d80f56c0 2024-02-15T18:23:37.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.205+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa3d810f8c0 con 0x7fa3d80f56c0 2024-02-15T18:23:37.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.206+0000 7fa3cdffb700 1 -- 172.21.15.84:0/2968630991 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3d404e010 con 0x7fa3d80f56c0 2024-02-15T18:23:37.206 INFO:teuthology.orchestra.run.smithi084.stdout:163208757263 2024-02-15T18:23:37.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3c405c2a0 msgr2=0x7fa3c405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3c405c2a0 0x7fa3c405e760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa3c8004a90 tx=0x7fa3c8009040).stop 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 msgr2=0x7fa3d80f9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 0x7fa3d80f9820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa3d4009f50 tx=0x7fa3d4009b30).stop 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 shutdown_connections 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3c405c2a0 0x7fa3c405e760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3d80f56c0 0x7fa3d80f9820 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 --2- 172.21.15.84:0/2968630991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3d80f6960 0x7fa3d80f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 >> 172.21.15.84:0/2968630991 conn(0x7fa3d80f0e20 msgr2=0x7fa3d80603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 shutdown_connections 2024-02-15T18:23:37.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:37.208+0000 7fa3df6b1700 1 -- 172.21.15.84:0/2968630991 wait complete. 2024-02-15T18:23:37.987 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757259 got 163208757263 for osd.5 2024-02-15T18:23:37.987 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-15T18:23:37.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-15T18:23:38.214 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:38.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:36.393458+0000 mgr.smithi084.hjmnez (mgr.14162) 210 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:38.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:37.206876+0000 mon.smithi084 (mon.0) 454 : audit [DBG] from='client.? 172.21.15.84:0/2968630991' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-15T18:23:38.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:36.393458+0000 mgr.smithi084.hjmnez (mgr.14162) 210 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:38.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:37.206876+0000 mon.smithi084 (mon.0) 454 : audit [DBG] from='client.? 172.21.15.84:0/2968630991' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.195+0000 7fea21435700 1 -- 172.21.15.84:0/4205471542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f56e0 msgr2=0x7fea1c0f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.195+0000 7fea21435700 1 --2- 172.21.15.84:0/4205471542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f56e0 0x7fea1c0f5b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fea10004660 tx=0x7fea10009b30).stop 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.196+0000 7fea21435700 1 -- 172.21.15.84:0/4205471542 shutdown_connections 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.196+0000 7fea21435700 1 --2- 172.21.15.84:0/4205471542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0f6980 0x7fea1c0f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.196+0000 7fea21435700 1 --2- 172.21.15.84:0/4205471542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f56e0 0x7fea1c0f5b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.196+0000 7fea21435700 1 -- 172.21.15.84:0/4205471542 >> 172.21.15.84:0/4205471542 conn(0x7fea1c0f0e20 msgr2=0x7fea1c0f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.196+0000 7fea21435700 1 -- 172.21.15.84:0/4205471542 shutdown_connections 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.196+0000 7fea21435700 1 -- 172.21.15.84:0/4205471542 wait complete. 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.196+0000 7fea21435700 1 Processor -- start 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.196+0000 7fea21435700 1 -- start start 2024-02-15T18:23:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea21435700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0f56e0 0x7fea1c1060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea21435700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f6980 0x7fea1c1065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea21435700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c106b60 con 0x7fea1c0f6980 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea21435700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c106ca0 con 0x7fea1c0f56e0 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea1a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f6980 0x7fea1c1065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea1a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f6980 0x7fea1c1065b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54754/0 (socket says 172.21.15.84:54754) 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea1a7fc700 1 -- 172.21.15.84:0/2594454978 learned_addr learned my addr 172.21.15.84:0/2594454978 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea1affd700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0f56e0 0x7fea1c1060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea1a7fc700 1 -- 172.21.15.84:0/2594454978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0f56e0 msgr2=0x7fea1c1060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea1a7fc700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0f56e0 0x7fea1c1060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea1a7fc700 1 -- 172.21.15.84:0/2594454978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10005040 con 0x7fea1c0f6980 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea1a7fc700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f6980 0x7fea1c1065b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fea0c00c790 tx=0x7fea0c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea037fe700 1 -- 172.21.15.84:0/2594454978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0c002590 con 0x7fea1c0f6980 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea037fe700 1 -- 172.21.15.84:0/2594454978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea0c002bc0 con 0x7fea1c0f6980 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c107640 con 0x7fea1c0f6980 2024-02-15T18:23:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea037fe700 1 -- 172.21.15.84:0/2594454978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0c013e40 con 0x7fea1c0f6980 2024-02-15T18:23:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.197+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c107c00 con 0x7fea1c0f6980 2024-02-15T18:23:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.198+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c045ad0 con 0x7fea1c0f6980 2024-02-15T18:23:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.198+0000 7fea037fe700 1 -- 172.21.15.84:0/2594454978 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fea0c01a060 con 0x7fea1c0f6980 2024-02-15T18:23:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.199+0000 7fea037fe700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fea0405c2a0 0x7fea0405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.199+0000 7fea037fe700 1 -- 172.21.15.84:0/2594454978 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fea0c075e30 con 0x7fea1c0f6980 2024-02-15T18:23:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.199+0000 7fea1affd700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fea0405c2a0 0x7fea0405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.199+0000 7fea1affd700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fea0405c2a0 0x7fea0405e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fea10009f50 tx=0x7fea10009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.203+0000 7fea037fe700 1 -- 172.21.15.84:0/2594454978 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fea0c048e30 con 0x7fea1c0f6980 2024-02-15T18:23:40.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:38.393849+0000 mgr.smithi084.hjmnez (mgr.14162) 211 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:40.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.350+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea1c0fe120 con 0x7fea0405c2a0 2024-02-15T18:23:40.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.351+0000 7fea037fe700 1 -- 172.21.15.84:0/2594454978 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27484 (secure 0 0 0) 0x7fea1c0fe120 con 0x7fea0405c2a0 2024-02-15T18:23:40.352 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fea0405c2a0 msgr2=0x7fea0405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fea0405c2a0 0x7fea0405e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fea10009f50 tx=0x7fea10009b30).stop 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f6980 msgr2=0x7fea1c1065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f6980 0x7fea1c1065b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fea0c00c790 tx=0x7fea0c007d70).stop 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 shutdown_connections 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fea0405c2a0 0x7fea0405e760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0f56e0 0x7fea1c1060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 --2- 172.21.15.84:0/2594454978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1c0f6980 0x7fea1c1065b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 >> 172.21.15.84:0/2594454978 conn(0x7fea1c0f0e20 msgr2=0x7fea1c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 shutdown_connections 2024-02-15T18:23:40.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:40.353+0000 7fea21435700 1 -- 172.21.15.84:0/2594454978 wait complete. 2024-02-15T18:23:40.354 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-02-15T18:23:40.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:38.393849+0000 mgr.smithi084.hjmnez (mgr.14162) 211 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:41.006 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-02-15T18:23:38.393644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31272,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":29184,"kb_avail":562439640,"statfs":{"total":575970213888,"available":575938191360,"internally_reserved":0,"allocated":2088960,"data_stored":786132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29884416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"38","state":"active+clean","last_fresh":"2024-02-15T18:22:39.991784+0000","last_change":"2024-02-15T18:22:17.957046+0000","last_active":"2024-02-15T18:22:39.991784+0000","last_peered":"2024-02-15T18:22:39.991784+0000","last_clean":"2024-02-15T18:22:39.991784+0000","last_became_active":"2024-02-15T18:22:17.956720+0000","last_became_peered":"2024-02-15T18:22:17.956720+0000","last_unstale":"2024-02-15T18:22:39.991784+0000","last_undegraded":"2024-02-15T18:22:39.991784+0000","last_fullsized":"2024-02-15T18:22:39.991784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T18:21:50.542674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T18:21:50.542674+0000","last_clean_scrub_stamp":"2024-02-15T18:21:50.542674+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5084,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740068,"statfs":{"total":95995035648,"available":95989829632,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5084,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740068,"statfs":{"total":95995035648,"available":95989829632,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Feb 15 18:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Feb 15 18:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Feb 15 18:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.30399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5212,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739940,"statfs":{"total":95995035648,"available":95989698560,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:22:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Feb 15 18:22:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.624},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Feb 15 18:22:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Feb 15 18:23:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5276,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739876,"statfs":{"total":95995035648,"available":95989633024,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.193}]},{"osd":1,"last update":"Thu Feb 15 18:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.219}]},{"osd":3,"last update":"Thu Feb 15 18:22:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.44},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Feb 15 18:23:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.37},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5340,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739812,"statfs":{"total":95995035648,"available":95989567488,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 18:23:18 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.312,"15min":0.314},"min":{"1min":0.22700000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Feb 15 18:22:38 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.313},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Feb 15 18:22:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Feb 15 18:23:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5276,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739876,"statfs":{"total":95995035648,"available":95989633024,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:23:12 2024","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.316},"min":{"1min":0.23899999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.46899999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.307,"15min":0.307},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44700000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Feb 15 18:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Feb 15 18:22:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.496}]},{"osd":4,"last update":"Thu Feb 15 18:23:19 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T18:23:41.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-15T18:23:41.232 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:41.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:41 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:40.351246+0000 mgr.smithi084.hjmnez (mgr.14162) 212 : audit [DBG] from='client.14396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:23:41.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:40.351246+0000 mgr.smithi084.hjmnez (mgr.14162) 212 : audit [DBG] from='client.14396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:23:42.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:40.394130+0000 mgr.smithi084.hjmnez (mgr.14162) 213 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:42.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:40.394130+0000 mgr.smithi084.hjmnez (mgr.14162) 213 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.250+0000 7f11dd03c700 1 -- 172.21.15.84:0/3458360789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 msgr2=0x7f11d80f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.250+0000 7f11dd03c700 1 --2- 172.21.15.84:0/3458360789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 0x7f11d80f6c10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f11cc004660 tx=0x7f11cc009b30).stop 2024-02-15T18:23:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.250+0000 7f11dd03c700 1 -- 172.21.15.84:0/3458360789 shutdown_connections 2024-02-15T18:23:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.250+0000 7f11dd03c700 1 --2- 172.21.15.84:0/3458360789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 0x7f11d80f6c10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.250+0000 7f11dd03c700 1 --2- 172.21.15.84:0/3458360789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11d80f5510 0x7f11d80f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.250+0000 7f11dd03c700 1 -- 172.21.15.84:0/3458360789 >> 172.21.15.84:0/3458360789 conn(0x7f11d80f0c70 msgr2=0x7f11d80f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.250+0000 7f11dd03c700 1 -- 172.21.15.84:0/3458360789 shutdown_connections 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.250+0000 7f11dd03c700 1 -- 172.21.15.84:0/3458360789 wait complete. 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11dd03c700 1 Processor -- start 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11dd03c700 1 -- start start 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11dd03c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11d80f5510 0x7f11d80f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11dd03c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 0x7f11d80f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11dd03c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80f80e0 con 0x7f11d80f67b0 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11dd03c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80f8220 con 0x7f11d80f5510 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11d77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 0x7f11d80f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11d77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 0x7f11d80f7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54778/0 (socket says 172.21.15.84:54778) 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11d77fe700 1 -- 172.21.15.84:0/4138965021 learned_addr learned my addr 172.21.15.84:0/4138965021 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11d7fff700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11d80f5510 0x7f11d80f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11d77fe700 1 -- 172.21.15.84:0/4138965021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11d80f5510 msgr2=0x7f11d80f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:43.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11d77fe700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11d80f5510 0x7f11d80f9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.251+0000 7f11d77fe700 1 -- 172.21.15.84:0/4138965021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc005040 con 0x7f11d80f67b0 2024-02-15T18:23:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.252+0000 7f11d77fe700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 0x7f11d80f7af0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f11cc009830 tx=0x7f11cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.252+0000 7f11d4ff9700 1 -- 172.21.15.84:0/4138965021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc018070 con 0x7f11d80f67b0 2024-02-15T18:23:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.252+0000 7f11d4ff9700 1 -- 172.21.15.84:0/4138965021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11cc007d70 con 0x7f11d80f67b0 2024-02-15T18:23:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.252+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d80f84a0 con 0x7f11d80f67b0 2024-02-15T18:23:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.252+0000 7f11d4ff9700 1 -- 172.21.15.84:0/4138965021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc01c620 con 0x7f11d80f67b0 2024-02-15T18:23:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.252+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d810eff0 con 0x7f11d80f67b0 2024-02-15T18:23:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.253+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d8045ad0 con 0x7f11d80f67b0 2024-02-15T18:23:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.253+0000 7f11d4ff9700 1 -- 172.21.15.84:0/4138965021 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f11cc01d980 con 0x7f11d80f67b0 2024-02-15T18:23:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.253+0000 7f11d4ff9700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f11c005c2b0 0x7f11c005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.253+0000 7f11d4ff9700 1 -- 172.21.15.84:0/4138965021 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f11cc077a70 con 0x7f11d80f67b0 2024-02-15T18:23:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.253+0000 7f11d7fff700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f11c005c2b0 0x7f11c005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.254+0000 7f11d7fff700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f11c005c2b0 0x7f11c005e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f11d80f9400 tx=0x7f11c8008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.257+0000 7f11d4ff9700 1 -- 172.21.15.84:0/4138965021 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f11cc04aa10 con 0x7f11d80f67b0 2024-02-15T18:23:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.404+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11d80fabf0 con 0x7f11c005c2b0 2024-02-15T18:23:43.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.405+0000 7f11d4ff9700 1 -- 172.21.15.84:0/4138965021 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28398 (secure 0 0 0) 0x7f11d80fabf0 con 0x7f11c005c2b0 2024-02-15T18:23:43.405 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f11c005c2b0 msgr2=0x7f11c005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f11c005c2b0 0x7f11c005e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f11d80f9400 tx=0x7f11c8008040).stop 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 msgr2=0x7f11d80f7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 0x7f11d80f7af0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f11cc009830 tx=0x7f11cc009b30).stop 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 shutdown_connections 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f11c005c2b0 0x7f11c005e770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11d80f5510 0x7f11d80f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 --2- 172.21.15.84:0/4138965021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11d80f67b0 0x7f11d80f7af0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 >> 172.21.15.84:0/4138965021 conn(0x7f11d80f0c70 msgr2=0x7f11d80603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 shutdown_connections 2024-02-15T18:23:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:43.407+0000 7f11dd03c700 1 -- 172.21.15.84:0/4138965021 wait complete. 2024-02-15T18:23:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-02-15T18:23:44.130 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-02-15T18:23:42.394331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31272,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":29184,"kb_avail":562439640,"statfs":{"total":575970213888,"available":575938191360,"internally_reserved":0,"allocated":2088960,"data_stored":786132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29884416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"38","state":"active+clean","last_fresh":"2024-02-15T18:22:39.991784+0000","last_change":"2024-02-15T18:22:17.957046+0000","last_active":"2024-02-15T18:22:39.991784+0000","last_peered":"2024-02-15T18:22:39.991784+0000","last_clean":"2024-02-15T18:22:39.991784+0000","last_became_active":"2024-02-15T18:22:17.956720+0000","last_became_peered":"2024-02-15T18:22:17.956720+0000","last_unstale":"2024-02-15T18:22:39.991784+0000","last_undegraded":"2024-02-15T18:22:39.991784+0000","last_fullsized":"2024-02-15T18:22:39.991784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T18:21:50.542674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T18:21:50.542674+0000","last_clean_scrub_stamp":"2024-02-15T18:21:50.542674+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5084,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740068,"statfs":{"total":95995035648,"available":95989829632,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":4,"up_from":33,"seq":141733920787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5084,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740068,"statfs":{"total":95995035648,"available":95989829632,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Feb 15 18:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Feb 15 18:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Feb 15 18:23:21 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.30399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5212,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739940,"statfs":{"total":95995035648,"available":95989698560,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:22:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.496},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Feb 15 18:22:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Feb 15 18:22:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Feb 15 18:23:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Feb 15 18:23:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.55700000000000005}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5276,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739876,"statfs":{"total":95995035648,"available":95989633024,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Feb 15 18:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.254},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Feb 15 18:22:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.44},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Feb 15 18:23:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.38},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5340,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739812,"statfs":{"total":95995035648,"available":95989567488,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 18:23:18 2024","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.249},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.312,"15min":0.314},"min":{"1min":0.22700000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Feb 15 18:23:40 2024","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.32900000000000001,"15min":0.33500000000000002},"min":{"1min":0.23999999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.35499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.29799999999999999,"5min":0.33800000000000002,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.34799999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.311}]},{"osd":3,"last update":"Thu Feb 15 18:22:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Feb 15 18:23:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.498},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Feb 15 18:23:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.435},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.48099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5276,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739876,"statfs":{"total":95995035648,"available":95989633024,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:23:12 2024","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.316},"min":{"1min":0.23899999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.46899999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.307,"15min":0.307},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44700000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Feb 15 18:22:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Feb 15 18:22:56 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.496}]},{"osd":4,"last update":"Thu Feb 15 18:23:19 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T18:23:44.131 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-15T18:23:44.131 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-15T18:23:44.131 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-15T18:23:44.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- ceph health --format=json 2024-02-15T18:23:44.355 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/mon.smithi084/config 2024-02-15T18:23:44.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:42.394567+0000 mgr.smithi084.hjmnez (mgr.14162) 214 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:44.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:42.394567+0000 mgr.smithi084.hjmnez (mgr.14162) 214 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:45.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:43.405183+0000 mgr.smithi084.hjmnez (mgr.14162) 215 : audit [DBG] from='client.14400 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:23:45.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:43.405183+0000 mgr.smithi084.hjmnez (mgr.14162) 215 : audit [DBG] from='client.14400 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:23:46.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.148+0000 7f8362abd700 1 -- 172.21.15.84:0/610875551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 msgr2=0x7f835c0f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:46.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.148+0000 7f8362abd700 1 --2- 172.21.15.84:0/610875551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 0x7f835c0f5ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8350004660 tx=0x7f8350009b30).stop 2024-02-15T18:23:46.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.148+0000 7f8362abd700 1 -- 172.21.15.84:0/610875551 shutdown_connections 2024-02-15T18:23:46.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.148+0000 7f8362abd700 1 --2- 172.21.15.84:0/610875551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0f6960 0x7f835c0f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:46.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.148+0000 7f8362abd700 1 --2- 172.21.15.84:0/610875551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 0x7f835c0f5ae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.148+0000 7f8362abd700 1 -- 172.21.15.84:0/610875551 >> 172.21.15.84:0/610875551 conn(0x7f835c0f0e20 msgr2=0x7f835c0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.148+0000 7f8362abd700 1 -- 172.21.15.84:0/610875551 shutdown_connections 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.148+0000 7f8362abd700 1 -- 172.21.15.84:0/610875551 wait complete. 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f8362abd700 1 Processor -- start 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f8362abd700 1 -- start start 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f8362abd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 0x7f835c10c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f8362abd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0f6960 0x7f835c10e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f8362abd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c060810 con 0x7f835c0f56c0 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f8362abd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c060950 con 0x7f835c0f6960 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f8360859700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 0x7f835c10c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f8360859700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 0x7f835c10c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47894/0 (socket says 172.21.15.84:47894) 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f8360859700 1 -- 172.21.15.84:0/1624349862 learned_addr learned my addr 172.21.15.84:0/1624349862 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.149+0000 7f835bfff700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0f6960 0x7f835c10e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f8360859700 1 -- 172.21.15.84:0/1624349862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0f6960 msgr2=0x7f835c10e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f8360859700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0f6960 0x7f835c10e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f8360859700 1 -- 172.21.15.84:0/1624349862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350005040 con 0x7f835c0f56c0 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f835bfff700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0f6960 0x7f835c10e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f8360859700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 0x7f835c10c310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8350004e30 tx=0x7f8350009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f83597fa700 1 -- 172.21.15.84:0/1624349862 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8350018070 con 0x7f835c0f56c0 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c10ed00 con 0x7f835c0f56c0 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f83597fa700 1 -- 172.21.15.84:0/1624349862 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8350007ba0 con 0x7f835c0f56c0 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f83597fa700 1 -- 172.21.15.84:0/1624349862 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f835001c620 con 0x7f835c0f56c0 2024-02-15T18:23:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.150+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c10f050 con 0x7f835c0f56c0 2024-02-15T18:23:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.151+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835c045ad0 con 0x7f835c0f56c0 2024-02-15T18:23:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.151+0000 7f83597fa700 1 -- 172.21.15.84:0/1624349862 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f835001d420 con 0x7f835c0f56c0 2024-02-15T18:23:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.151+0000 7f83597fa700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f834c05c2a0 0x7f834c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.151+0000 7f83597fa700 1 -- 172.21.15.84:0/1624349862 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f83500778d0 con 0x7f835c0f56c0 2024-02-15T18:23:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.152+0000 7f835bfff700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f834c05c2a0 0x7f834c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:46.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.152+0000 7f835bfff700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f834c05c2a0 0x7f834c05e760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f8348009740 tx=0x7f8348009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.155+0000 7f83597fa700 1 -- 172.21.15.84:0/1624349862 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f835004a8d0 con 0x7f835c0f56c0 2024-02-15T18:23:46.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:44.394956+0000 mgr.smithi084.hjmnez (mgr.14162) 216 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:46.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.362+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f835c0fe040 con 0x7f835c0f56c0 2024-02-15T18:23:46.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.362+0000 7f83597fa700 1 -- 172.21.15.84:0/1624349862 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f835004def0 con 0x7f835c0f56c0 2024-02-15T18:23:46.362 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:23:46.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.363+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f834c05c2a0 msgr2=0x7f834c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:46.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.363+0000 7f8362abd700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f834c05c2a0 0x7f834c05e760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f8348009740 tx=0x7f8348009be0).stop 2024-02-15T18:23:46.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.363+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 msgr2=0x7f835c10c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:46.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.363+0000 7f8362abd700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 0x7f835c10c310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8350004e30 tx=0x7f8350009b30).stop 2024-02-15T18:23:46.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.364+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 shutdown_connections 2024-02-15T18:23:46.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.364+0000 7f8362abd700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f834c05c2a0 0x7f834c05e760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:46.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.364+0000 7f8362abd700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f835c0f56c0 0x7f835c10c310 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:46.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.364+0000 7f8362abd700 1 --2- 172.21.15.84:0/1624349862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0f6960 0x7f835c10e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:46.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.364+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 >> 172.21.15.84:0/1624349862 conn(0x7f835c0f0e20 msgr2=0x7f835c0fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:46.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.364+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 shutdown_connections 2024-02-15T18:23:46.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:46.364+0000 7f8362abd700 1 -- 172.21.15.84:0/1624349862 wait complete. 2024-02-15T18:23:46.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:44.394956+0000 mgr.smithi084.hjmnez (mgr.14162) 216 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:47.147 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-15T18:23:47.147 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-15T18:23:47.148 INFO:tasks.cephadm:Setup complete, yielding 2024-02-15T18:23:47.151 INFO:teuthology.run_tasks:Running task print... 2024-02-15T18:23:47.160 INFO:teuthology.task.print:**** done starting v16.2.4 2024-02-15T18:23:47.161 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:23:47.169 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:23:47.170 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch status' 2024-02-15T18:23:47.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:46.362999+0000 mon.smithi084 (mon.0) 455 : audit [DBG] from='client.? 172.21.15.84:0/1624349862' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-15T18:23:47.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:46.362999+0000 mon.smithi084 (mon.0) 455 : audit [DBG] from='client.? 172.21.15.84:0/1624349862' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-15T18:23:48.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:46.395304+0000 mgr.smithi084.hjmnez (mgr.14162) 217 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:48.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:47.700231+0000 mon.smithi084 (mon.0) 456 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:23:48.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:46.395304+0000 mgr.smithi084.hjmnez (mgr.14162) 217 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:48.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:47.700231+0000 mon.smithi084 (mon.0) 456 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:23:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.152+0000 7facf5453700 1 -- 172.21.15.84:0/776528282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 msgr2=0x7facf00f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.152+0000 7facf5453700 1 --2- 172.21.15.84:0/776528282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 0x7facf00f7ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7face0004660 tx=0x7face0009b30).stop 2024-02-15T18:23:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.152+0000 7facf5453700 1 -- 172.21.15.84:0/776528282 shutdown_connections 2024-02-15T18:23:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.152+0000 7facf5453700 1 --2- 172.21.15.84:0/776528282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 0x7facf00f7ac0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.152+0000 7facf5453700 1 --2- 172.21.15.84:0/776528282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf00f49a0 0x7facf00f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.152+0000 7facf5453700 1 -- 172.21.15.84:0/776528282 >> 172.21.15.84:0/776528282 conn(0x7facf00f04c0 msgr2=0x7facf00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.152+0000 7facf5453700 1 -- 172.21.15.84:0/776528282 shutdown_connections 2024-02-15T18:23:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.152+0000 7facf5453700 1 -- 172.21.15.84:0/776528282 wait complete. 2024-02-15T18:23:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facf5453700 1 Processor -- start 2024-02-15T18:23:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facf5453700 1 -- start start 2024-02-15T18:23:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facf5453700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf00f49a0 0x7facf00f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facf5453700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 0x7facf00f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facf5453700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf00f5f30 con 0x7facf00f5340 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facf5453700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf00f6070 con 0x7facf00f49a0 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facee7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 0x7facf00f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facee7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 0x7facf00f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47914/0 (socket says 172.21.15.84:47914) 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facee7fc700 1 -- 172.21.15.84:0/1672144070 learned_addr learned my addr 172.21.15.84:0/1672144070 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7faceeffd700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf00f49a0 0x7facf00f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facee7fc700 1 -- 172.21.15.84:0/1672144070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf00f49a0 msgr2=0x7facf00f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.153+0000 7facee7fc700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf00f49a0 0x7facf00f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.154+0000 7facee7fc700 1 -- 172.21.15.84:0/1672144070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0005040 con 0x7facf00f5340 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.154+0000 7facee7fc700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 0x7facf00f59d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7face0009f50 tx=0x7face0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.154+0000 7facd77fe700 1 -- 172.21.15.84:0/1672144070 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face0018070 con 0x7facf00f5340 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.154+0000 7facd77fe700 1 -- 172.21.15.84:0/1672144070 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7face0007d70 con 0x7facf00f5340 2024-02-15T18:23:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.154+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf00f62f0 con 0x7facf00f5340 2024-02-15T18:23:49.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.154+0000 7facd77fe700 1 -- 172.21.15.84:0/1672144070 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face001c620 con 0x7facf00f5340 2024-02-15T18:23:49.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.154+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf00f6850 con 0x7facf00f5340 2024-02-15T18:23:49.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.155+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf0045ad0 con 0x7facf00f5340 2024-02-15T18:23:49.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.155+0000 7facd77fe700 1 -- 172.21.15.84:0/1672144070 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7face001c8e0 con 0x7facf00f5340 2024-02-15T18:23:49.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.155+0000 7facd77fe700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7facd805c2b0 0x7facd805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:49.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.155+0000 7facd77fe700 1 -- 172.21.15.84:0/1672144070 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7face0077a40 con 0x7facf00f5340 2024-02-15T18:23:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.155+0000 7faceeffd700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7facd805c2b0 0x7facd805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:49.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.156+0000 7faceeffd700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7facd805c2b0 0x7facd805e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7facf00f72e0 tx=0x7face4009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:49.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.159+0000 7facd77fe700 1 -- 172.21.15.84:0/1672144070 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7face004aa40 con 0x7facf00f5340 2024-02-15T18:23:49.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.339+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7facf00008d0 con 0x7facd805c2b0 2024-02-15T18:23:49.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.340+0000 7facd77fe700 1 -- 172.21.15.84:0/1672144070 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7facf00008d0 con 0x7facd805c2b0 2024-02-15T18:23:49.341 INFO:teuthology.orchestra.run.smithi084.stdout:Backend: cephadm 2024-02-15T18:23:49.341 INFO:teuthology.orchestra.run.smithi084.stdout:Available: Yes 2024-02-15T18:23:49.341 INFO:teuthology.orchestra.run.smithi084.stdout:Paused: No 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7facd805c2b0 msgr2=0x7facd805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7facd805c2b0 0x7facd805e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7facf00f72e0 tx=0x7face4009040).stop 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 msgr2=0x7facf00f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 0x7facf00f59d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7face0009f50 tx=0x7face0009b30).stop 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 shutdown_connections 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7facd805c2b0 0x7facd805e770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf00f49a0 0x7facf00f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 --2- 172.21.15.84:0/1672144070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf00f5340 0x7facf00f59d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 >> 172.21.15.84:0/1672144070 conn(0x7facf00f04c0 msgr2=0x7facf00fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 shutdown_connections 2024-02-15T18:23:49.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:49.342+0000 7facf5453700 1 -- 172.21.15.84:0/1672144070 wait complete. 2024-02-15T18:23:50.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-15T18:23:50.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:48.395711+0000 mgr.smithi084.hjmnez (mgr.14162) 218 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:50.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:48.991299+0000 mon.smithi084 (mon.0) 457 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:23:50.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:49.342207+0000 mgr.smithi084.hjmnez (mgr.14162) 219 : audit [DBG] from='client.14408 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:50.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:48.395711+0000 mgr.smithi084.hjmnez (mgr.14162) 218 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:50.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:48.991299+0000 mon.smithi084 (mon.0) 457 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:23:50.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:49.342207+0000 mgr.smithi084.hjmnez (mgr.14162) 219 : audit [DBG] from='client.14408 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:51.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.816+0000 7f5199833700 1 -- 172.21.15.84:0/1021759601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f5430 msgr2=0x7f51940f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:51.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.816+0000 7f5199833700 1 --2- 172.21.15.84:0/1021759601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f5430 0x7f51940f5850 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f5188004660 tx=0x7f5188009b30).stop 2024-02-15T18:23:51.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.816+0000 7f5199833700 1 -- 172.21.15.84:0/1021759601 shutdown_connections 2024-02-15T18:23:51.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.816+0000 7f5199833700 1 --2- 172.21.15.84:0/1021759601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51940f66d0 0x7f51940f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:51.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.816+0000 7f5199833700 1 --2- 172.21.15.84:0/1021759601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f5430 0x7f51940f5850 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:51.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.816+0000 7f5199833700 1 -- 172.21.15.84:0/1021759601 >> 172.21.15.84:0/1021759601 conn(0x7f51940f0b90 msgr2=0x7f51940f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:51.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.817+0000 7f5199833700 1 -- 172.21.15.84:0/1021759601 shutdown_connections 2024-02-15T18:23:51.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.817+0000 7f5199833700 1 -- 172.21.15.84:0/1021759601 wait complete. 2024-02-15T18:23:51.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.817+0000 7f5199833700 1 Processor -- start 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.817+0000 7f5199833700 1 -- start start 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5199833700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51940f5430 0x7f5194109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5199833700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f66d0 0x7f519410c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5199833700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5194060450 con 0x7f51940f66d0 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5199833700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5194060590 con 0x7f51940f5430 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5193fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f66d0 0x7f519410c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5193fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f66d0 0x7f519410c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47942/0 (socket says 172.21.15.84:47942) 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5193fff700 1 -- 172.21.15.84:0/2165228208 learned_addr learned my addr 172.21.15.84:0/2165228208 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5198831700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51940f5430 0x7f5194109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5193fff700 1 -- 172.21.15.84:0/2165228208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51940f5430 msgr2=0x7f5194109bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5193fff700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51940f5430 0x7f5194109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5193fff700 1 -- 172.21.15.84:0/2165228208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5188005040 con 0x7f51940f66d0 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5193fff700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f66d0 0x7f519410c0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f518000b410 tx=0x7f5180006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f51917fa700 1 -- 172.21.15.84:0/2165228208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51800125f0 con 0x7f51940f66d0 2024-02-15T18:23:51.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f51917fa700 1 -- 172.21.15.84:0/2165228208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f518000be80 con 0x7f51940f66d0 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519410c6d0 con 0x7f51940f66d0 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f51917fa700 1 -- 172.21.15.84:0/2165228208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5180002b30 con 0x7f51940f66d0 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.818+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519410cc90 con 0x7f51940f66d0 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.819+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5194045ad0 con 0x7f51940f66d0 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.820+0000 7f51917fa700 1 -- 172.21.15.84:0/2165228208 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f518000f030 con 0x7f51940f66d0 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.820+0000 7f51917fa700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f518405c300 0x7f518405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.820+0000 7f51917fa700 1 -- 172.21.15.84:0/2165228208 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f5180076000 con 0x7f51940f66d0 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.820+0000 7f5198831700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f518405c300 0x7f518405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.820+0000 7f5198831700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f518405c300 0x7f518405e7c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5188009d60 tx=0x7f5188009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:51.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:51.824+0000 7f51917fa700 1 -- 172.21.15.84:0/2165228208 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5180049000 con 0x7f51940f66d0 2024-02-15T18:23:52.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.001+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f51940fdf30 con 0x7f518405c300 2024-02-15T18:23:52.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.007+0000 7f51917fa700 1 -- 172.21.15.84:0/2165228208 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2160 (secure 0 0 0) 0x7f5188009630 con 0x7f518405c300 2024-02-15T18:23:52.008 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2024-02-15T18:23:52.008 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (3m) 64s ago 4m 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:23:52.008 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (4m) 64s ago 4m 16.2.4 8d91d370c2b8 cfe2961e55e3 2024-02-15T18:23:52.008 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (3m) 77s ago 3m 16.2.4 8d91d370c2b8 d52ceb5fe65b 2024-02-15T18:23:52.008 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (3m) 64s ago 4m 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:23:52.008 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:9283 running (6m) 64s ago 6m 16.2.4 8d91d370c2b8 f9dec188dcb9 2024-02-15T18:23:52.008 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (3m) 77s ago 3m 16.2.4 8d91d370c2b8 802b41cf2bac 2024-02-15T18:23:52.008 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (6m) 64s ago 6m 16.2.4 8d91d370c2b8 77f1f72e867c 2024-02-15T18:23:52.008 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (3m) 77s ago 3m 16.2.4 8d91d370c2b8 c65c0defe0dd 2024-02-15T18:23:52.009 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (4m) 64s ago 4m 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:23:52.009 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (3m) 77s ago 3m 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:23:52.009 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (3m) 64s ago 3m 16.2.4 8d91d370c2b8 20023f9a2292 2024-02-15T18:23:52.009 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (2m) 64s ago 2m 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:23:52.009 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (2m) 64s ago 2m 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:23:52.009 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (2m) 77s ago 2m 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:23:52.009 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (101s) 77s ago 101s 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:23:52.009 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (80s) 77s ago 79s 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:23:52.009 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (2m) 64s ago 4m 2.18.1 de242295e225 c3f4635db4df 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f518405c300 msgr2=0x7f518405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f518405c300 0x7f518405e7c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5188009d60 tx=0x7f5188009b30).stop 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f66d0 msgr2=0x7f519410c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f66d0 0x7f519410c0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f518000b410 tx=0x7f5180006ef0).stop 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 shutdown_connections 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f518405c300 0x7f518405e7c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51940f5430 0x7f5194109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 --2- 172.21.15.84:0/2165228208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51940f66d0 0x7f519410c0c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 >> 172.21.15.84:0/2165228208 conn(0x7f51940f0b90 msgr2=0x7f51940fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 shutdown_connections 2024-02-15T18:23:52.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:52.009+0000 7f5199833700 1 -- 172.21.15.84:0/2165228208 wait complete. 2024-02-15T18:23:52.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:50.396019+0000 mgr.smithi084.hjmnez (mgr.14162) 220 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:52.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:50.396019+0000 mgr.smithi084.hjmnez (mgr.14162) 220 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:52.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-15T18:23:53.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:52.003424+0000 mgr.smithi084.hjmnez (mgr.14162) 221 : audit [DBG] from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:53.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:52.003424+0000 mgr.smithi084.hjmnez (mgr.14162) 221 : audit [DBG] from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:54.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:52.396285+0000 mgr.smithi084.hjmnez (mgr.14162) 222 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:54.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:52.396285+0000 mgr.smithi084.hjmnez (mgr.14162) 222 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 -- 172.21.15.84:0/3388351501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e100f9820 msgr2=0x7f4e100fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 --2- 172.21.15.84:0/3388351501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e100f9820 0x7f4e100fbc70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f4e0c004660 tx=0x7f4e0c009b30).stop 2024-02-15T18:23:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 -- 172.21.15.84:0/3388351501 shutdown_connections 2024-02-15T18:23:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 --2- 172.21.15.84:0/3388351501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e100f9820 0x7f4e100fbc70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 --2- 172.21.15.84:0/3388351501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e10060310 0x7f4e100f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 -- 172.21.15.84:0/3388351501 >> 172.21.15.84:0/3388351501 conn(0x7f4e100f0d40 msgr2=0x7f4e100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:54.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 -- 172.21.15.84:0/3388351501 shutdown_connections 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 -- 172.21.15.84:0/3388351501 wait complete. 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 Processor -- start 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.744+0000 7f4e17b32700 1 -- start start 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e17b32700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e10060310 0x7f4e10107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e17b32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e100f9820 0x7f4e10107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e17b32700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10107af0 con 0x7f4e10060310 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e17b32700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10107c30 con 0x7f4e100f9820 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e158ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e10060310 0x7f4e10107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e158ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e10060310 0x7f4e10107050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57104/0 (socket says 172.21.15.84:57104) 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e158ce700 1 -- 172.21.15.84:0/2339678116 learned_addr learned my addr 172.21.15.84:0/2339678116 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e150cd700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e100f9820 0x7f4e10107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e158ce700 1 -- 172.21.15.84:0/2339678116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e100f9820 msgr2=0x7f4e10107540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e158ce700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e100f9820 0x7f4e10107540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e158ce700 1 -- 172.21.15.84:0/2339678116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c005040 con 0x7f4e10060310 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e158ce700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e10060310 0x7f4e10107050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f4e0000c530 tx=0x7f4e00007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:54.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e067fc700 1 -- 172.21.15.84:0/2339678116 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0000f650 con 0x7f4e10060310 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e067fc700 1 -- 172.21.15.84:0/2339678116 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e0000fc80 con 0x7f4e10060310 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e101085d0 con 0x7f4e10060310 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e067fc700 1 -- 172.21.15.84:0/2339678116 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e00012d80 con 0x7f4e10060310 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.745+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e10108b90 con 0x7f4e10060310 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.746+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e10045ad0 con 0x7f4e10060310 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.746+0000 7f4e067fc700 1 -- 172.21.15.84:0/2339678116 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4e00010070 con 0x7f4e10060310 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.747+0000 7f4e067fc700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4dfc05c2b0 0x7f4dfc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.747+0000 7f4e067fc700 1 -- 172.21.15.84:0/2339678116 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f4e00075910 con 0x7f4e10060310 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.747+0000 7f4e150cd700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4dfc05c2b0 0x7f4dfc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.747+0000 7f4e150cd700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4dfc05c2b0 0x7f4dfc05e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4e0c004e30 tx=0x7f4e0c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:54.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.751+0000 7f4e067fc700 1 -- 172.21.15.84:0/2339678116 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4e000452b0 con 0x7f4e10060310 2024-02-15T18:23:54.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.923+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e10108db0 con 0x7f4dfc05c2b0 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.927+0000 7f4e067fc700 1 -- 172.21.15.84:0/2339678116 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1116 (secure 0 0 0) 0x7f4e10108db0 con 0x7f4dfc05c2b0 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager 1/1 67s ago 5m count:1 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:crash 2/2 80s ago 5m * 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:grafana 1/1 67s ago 5m count:1 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:mgr 2/2 80s ago 5m count:2 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:mon 2/2 80s ago 4m smithi084:172.21.15.84=smithi084;smithi133:172.21.15.133=smithi133;count:2 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter 2/2 80s ago 5m * 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:osd.unmanaged 6/6 80s ago - 2024-02-15T18:23:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus 1/1 67s ago 5m count:1 2024-02-15T18:23:54.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4dfc05c2b0 msgr2=0x7f4dfc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:54.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4dfc05c2b0 0x7f4dfc05e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4e0c004e30 tx=0x7f4e0c009b30).stop 2024-02-15T18:23:54.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e10060310 msgr2=0x7f4e10107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e10060310 0x7f4e10107050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f4e0000c530 tx=0x7f4e00007e20).stop 2024-02-15T18:23:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 shutdown_connections 2024-02-15T18:23:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f4dfc05c2b0 0x7f4dfc05e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e10060310 0x7f4e10107050 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 --2- 172.21.15.84:0/2339678116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e100f9820 0x7f4e10107540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 >> 172.21.15.84:0/2339678116 conn(0x7f4e100f0d40 msgr2=0x7f4e100f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 shutdown_connections 2024-02-15T18:23:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:54.929+0000 7f4e17b32700 1 -- 172.21.15.84:0/2339678116 wait complete. 2024-02-15T18:23:55.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-15T18:23:56.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:54.396605+0000 mgr.smithi084.hjmnez (mgr.14162) 223 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:56.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:54.926272+0000 mgr.smithi084.hjmnez (mgr.14162) 224 : audit [DBG] from='client.14416 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:56.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:54.396605+0000 mgr.smithi084.hjmnez (mgr.14162) 223 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:56.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:54.926272+0000 mgr.smithi084.hjmnez (mgr.14162) 224 : audit [DBG] from='client.14416 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:57.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.627+0000 7f27f3fff700 1 -- 172.21.15.84:0/944105300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f6530 msgr2=0x7f27f40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:57.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.627+0000 7f27f3fff700 1 --2- 172.21.15.84:0/944105300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f6530 0x7f27f40f6950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f27e4004660 tx=0x7f27e4009b30).stop 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.627+0000 7f27f3fff700 1 -- 172.21.15.84:0/944105300 shutdown_connections 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.627+0000 7f27f3fff700 1 --2- 172.21.15.84:0/944105300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40f77d0 0x7f27f40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.627+0000 7f27f3fff700 1 --2- 172.21.15.84:0/944105300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f6530 0x7f27f40f6950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.627+0000 7f27f3fff700 1 -- 172.21.15.84:0/944105300 >> 172.21.15.84:0/944105300 conn(0x7f27f40f1c90 msgr2=0x7f27f40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.627+0000 7f27f3fff700 1 -- 172.21.15.84:0/944105300 shutdown_connections 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.627+0000 7f27f3fff700 1 -- 172.21.15.84:0/944105300 wait complete. 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f3fff700 1 Processor -- start 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f3fff700 1 -- start start 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40f6530 0x7f27f4106ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f77d0 0x7f27f4107390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f3fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f41079d0 con 0x7f27f40f77d0 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4108280 con 0x7f27f40f6530 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f77d0 0x7f27f4107390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f77d0 0x7f27f4107390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57120/0 (socket says 172.21.15.84:57120) 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f27fc700 1 -- 172.21.15.84:0/385505264 learned_addr learned my addr 172.21.15.84:0/385505264 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f2ffd700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40f6530 0x7f27f4106ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f27fc700 1 -- 172.21.15.84:0/385505264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40f6530 msgr2=0x7f27f4106ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f27fc700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40f6530 0x7f27f4106ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.628+0000 7f27f27fc700 1 -- 172.21.15.84:0/385505264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e4005040 con 0x7f27f40f77d0 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.629+0000 7f27f27fc700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f77d0 0x7f27f4107390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f27e800b410 tx=0x7f27e8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.629+0000 7f27db7fe700 1 -- 172.21.15.84:0/385505264 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e80125f0 con 0x7f27f40f77d0 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.629+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f4108560 con 0x7f27f40f77d0 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.629+0000 7f27db7fe700 1 -- 172.21.15.84:0/385505264 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27e8012c20 con 0x7f27f40f77d0 2024-02-15T18:23:57.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.629+0000 7f27db7fe700 1 -- 172.21.15.84:0/385505264 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e8002b30 con 0x7f27f40f77d0 2024-02-15T18:23:57.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.629+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f4108b20 con 0x7f27f40f77d0 2024-02-15T18:23:57.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.630+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f4059100 con 0x7f27f40f77d0 2024-02-15T18:23:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.630+0000 7f27db7fe700 1 -- 172.21.15.84:0/385505264 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f27e800f030 con 0x7f27f40f77d0 2024-02-15T18:23:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.630+0000 7f27db7fe700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f27dc05c300 0x7f27dc05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.631+0000 7f27db7fe700 1 -- 172.21.15.84:0/385505264 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f27e8076030 con 0x7f27f40f77d0 2024-02-15T18:23:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.631+0000 7f27f2ffd700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f27dc05c300 0x7f27dc05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.631+0000 7f27f2ffd700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f27dc05c300 0x7f27dc05e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f27e4004e30 tx=0x7f27e4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:57.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.634+0000 7f27db7fe700 1 -- 172.21.15.84:0/385505264 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f27e8049030 con 0x7f27f40f77d0 2024-02-15T18:23:57.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.808+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f27f40fef50 con 0x7f27dc05c300 2024-02-15T18:23:57.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.809+0000 7f27db7fe700 1 -- 172.21.15.84:0/385505264 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+126 (secure 0 0 0) 0x7f27f40fef50 con 0x7f27dc05c300 2024-02-15T18:23:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:HOST ADDR LABELS STATUS 2024-02-15T18:23:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 172.21.15.84 2024-02-15T18:23:57.810 INFO:teuthology.orchestra.run.smithi084.stdout:smithi133 smithi133 2024-02-15T18:23:57.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f27dc05c300 msgr2=0x7f27dc05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:57.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f27dc05c300 0x7f27dc05e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f27e4004e30 tx=0x7f27e4009b30).stop 2024-02-15T18:23:57.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f77d0 msgr2=0x7f27f4107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f77d0 0x7f27f4107390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f27e800b410 tx=0x7f27e8006ef0).stop 2024-02-15T18:23:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 shutdown_connections 2024-02-15T18:23:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f27dc05c300 0x7f27dc05e7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40f6530 0x7f27f4106ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 --2- 172.21.15.84:0/385505264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f40f77d0 0x7f27f4107390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 >> 172.21.15.84:0/385505264 conn(0x7f27f40f1c90 msgr2=0x7f27f40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 shutdown_connections 2024-02-15T18:23:57.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:23:57.811+0000 7f27f3fff700 1 -- 172.21.15.84:0/385505264 wait complete. 2024-02-15T18:23:58.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:56.396998+0000 mgr.smithi084.hjmnez (mgr.14162) 225 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:58.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:56.396998+0000 mgr.smithi084.hjmnez (mgr.14162) 225 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:23:58.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-15T18:23:59.255 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:23:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:23:57.810818+0000 mgr.smithi084.hjmnez (mgr.14162) 226 : audit [DBG] from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:59.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:23:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:23:57.810818+0000 mgr.smithi084.hjmnez (mgr.14162) 226 : audit [DBG] from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:00.254 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:23:58.397423+0000 mgr.smithi084.hjmnez (mgr.14162) 227 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:00.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:23:58.397423+0000 mgr.smithi084.hjmnez (mgr.14162) 227 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 -- 172.21.15.84:0/4229355499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f7980 msgr2=0x7f98940f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 --2- 172.21.15.84:0/4229355499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f7980 0x7f98940f7de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f9884004660 tx=0x7f9884009b30).stop 2024-02-15T18:24:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 -- 172.21.15.84:0/4229355499 shutdown_connections 2024-02-15T18:24:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 --2- 172.21.15.84:0/4229355499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f7980 0x7f98940f7de0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 --2- 172.21.15.84:0/4229355499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940f66e0 0x7f98940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 -- 172.21.15.84:0/4229355499 >> 172.21.15.84:0/4229355499 conn(0x7f98940f1e40 msgr2=0x7f98940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 -- 172.21.15.84:0/4229355499 shutdown_connections 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 -- 172.21.15.84:0/4229355499 wait complete. 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 Processor -- start 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.499+0000 7f9898f74700 1 -- start start 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f9898f74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f66e0 0x7f9894107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f9898f74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940f7980 0x7f9894107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f9898f74700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894107b30 con 0x7f98940f66e0 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f9898f74700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894107c70 con 0x7f98940f7980 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f989259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f66e0 0x7f9894107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f989259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f66e0 0x7f9894107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57128/0 (socket says 172.21.15.84:57128) 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f989259c700 1 -- 172.21.15.84:0/2373243182 learned_addr learned my addr 172.21.15.84:0/2373243182 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f989259c700 1 -- 172.21.15.84:0/2373243182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940f7980 msgr2=0x7f9894107580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f989259c700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940f7980 0x7f9894107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f989259c700 1 -- 172.21.15.84:0/2373243182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884005040 con 0x7f98940f66e0 2024-02-15T18:24:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f989259c700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f66e0 0x7f9894107090 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f988800c530 tx=0x7f9888007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f9882ffd700 1 -- 172.21.15.84:0/2373243182 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988800f650 con 0x7f98940f66e0 2024-02-15T18:24:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f9882ffd700 1 -- 172.21.15.84:0/2373243182 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f988800fc80 con 0x7f98940f66e0 2024-02-15T18:24:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9894108610 con 0x7f98940f66e0 2024-02-15T18:24:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f9882ffd700 1 -- 172.21.15.84:0/2373243182 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9888012e20 con 0x7f98940f66e0 2024-02-15T18:24:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.500+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9894108bd0 con 0x7f98940f66e0 2024-02-15T18:24:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.501+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9894045ad0 con 0x7f98940f66e0 2024-02-15T18:24:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.501+0000 7f9882ffd700 1 -- 172.21.15.84:0/2373243182 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9888019030 con 0x7f98940f66e0 2024-02-15T18:24:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.502+0000 7f9882ffd700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f987c05c2b0 0x7f987c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.502+0000 7f9882ffd700 1 -- 172.21.15.84:0/2373243182 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f9888075820 con 0x7f98940f66e0 2024-02-15T18:24:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.502+0000 7f9891d9b700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f987c05c2b0 0x7f987c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.502+0000 7f9891d9b700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f987c05c2b0 0x7f987c05e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9884009f50 tx=0x7f9884009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:00.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.506+0000 7f9882ffd700 1 -- 172.21.15.84:0/2373243182 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f98880462b0 con 0x7f98940f66e0 2024-02-15T18:24:00.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.682+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9894108e50 con 0x7f987c05c2b0 2024-02-15T18:24:00.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.683+0000 7f9882ffd700 1 -- 172.21.15.84:0/2373243182 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+279 (secure 0 0 0) 0x7f9894108e50 con 0x7f987c05c2b0 2024-02-15T18:24:00.684 INFO:teuthology.orchestra.run.smithi084.stdout:Hostname Path Type Serial Size Health Ident Fault Available 2024-02-15T18:24:00.684 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 /dev/nvme0n1 ssd PHFT620400WF400BGN 400G Unknown N/A N/A No 2024-02-15T18:24:00.684 INFO:teuthology.orchestra.run.smithi084.stdout:smithi133 /dev/nvme0n1 ssd PHFT620401AQ400BGN 400G Unknown N/A N/A No 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f987c05c2b0 msgr2=0x7f987c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f987c05c2b0 0x7f987c05e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9884009f50 tx=0x7f9884009b30).stop 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f66e0 msgr2=0x7f9894107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f66e0 0x7f9894107090 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f988800c530 tx=0x7f9888007e10).stop 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 shutdown_connections 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f987c05c2b0 0x7f987c05e770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98940f66e0 0x7f9894107090 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 --2- 172.21.15.84:0/2373243182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940f7980 0x7f9894107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 >> 172.21.15.84:0/2373243182 conn(0x7f98940f1e40 msgr2=0x7f98940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 shutdown_connections 2024-02-15T18:24:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:00.685+0000 7f9898f74700 1 -- 172.21.15.84:0/2373243182 wait complete. 2024-02-15T18:24:01.308 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:24:01.318 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:24:01.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-15T18:24:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:00.397936+0000 mgr.smithi084.hjmnez (mgr.14162) 228 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:00.684916+0000 mgr.smithi084.hjmnez (mgr.14162) 229 : audit [DBG] from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:02.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:00.397936+0000 mgr.smithi084.hjmnez (mgr.14162) 228 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:02.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:00.684916+0000 mgr.smithi084.hjmnez (mgr.14162) 229 : audit [DBG] from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.229+0000 7f29db511700 1 -- 172.21.15.84:0/40520650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 msgr2=0x7f29d40f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.229+0000 7f29db511700 1 --2- 172.21.15.84:0/40520650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 0x7f29d40f5fd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f29c4004660 tx=0x7f29c4009b30).stop 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.229+0000 7f29db511700 1 -- 172.21.15.84:0/40520650 shutdown_connections 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.229+0000 7f29db511700 1 --2- 172.21.15.84:0/40520650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29d40f6550 0x7f29d40f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.229+0000 7f29db511700 1 --2- 172.21.15.84:0/40520650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 0x7f29d40f5fd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.229+0000 7f29db511700 1 -- 172.21.15.84:0/40520650 >> 172.21.15.84:0/40520650 conn(0x7f29d40f04c0 msgr2=0x7f29d40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.229+0000 7f29db511700 1 -- 172.21.15.84:0/40520650 shutdown_connections 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.229+0000 7f29db511700 1 -- 172.21.15.84:0/40520650 wait complete. 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29db511700 1 Processor -- start 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29db511700 1 -- start start 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29db511700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 0x7f29d4109de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29db511700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29d40f6550 0x7f29d410c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29db511700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40f56a0 con 0x7f29d40f5bb0 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29db511700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40f57e0 con 0x7f29d40f6550 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29d92ad700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 0x7f29d4109de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29d92ad700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 0x7f29d4109de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57142/0 (socket says 172.21.15.84:57142) 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29d92ad700 1 -- 172.21.15.84:0/2192098834 learned_addr learned my addr 172.21.15.84:0/2192098834 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29d8aac700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29d40f6550 0x7f29d410c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29d92ad700 1 -- 172.21.15.84:0/2192098834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29d40f6550 msgr2=0x7f29d410c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29d92ad700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29d40f6550 0x7f29d410c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29d92ad700 1 -- 172.21.15.84:0/2192098834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c4005040 con 0x7f29d40f5bb0 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29d8aac700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29d40f6550 0x7f29d410c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29d92ad700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 0x7f29d4109de0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f29c4009830 tx=0x7f29c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29c9ffb700 1 -- 172.21.15.84:0/2192098834 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29c4018070 con 0x7f29d40f5bb0 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d410c830 con 0x7f29d40f5bb0 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.230+0000 7f29c9ffb700 1 -- 172.21.15.84:0/2192098834 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29c4007ba0 con 0x7f29d40f5bb0 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.231+0000 7f29c9ffb700 1 -- 172.21.15.84:0/2192098834 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29c401c3c0 con 0x7f29d40f5bb0 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.231+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d410cd90 con 0x7f29d40f5bb0 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.232+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d4045ad0 con 0x7f29d40f5bb0 2024-02-15T18:24:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.232+0000 7f29c9ffb700 1 -- 172.21.15.84:0/2192098834 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f29c4007d10 con 0x7f29d40f5bb0 2024-02-15T18:24:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.232+0000 7f29c9ffb700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f29c005c2b0 0x7f29c005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.232+0000 7f29c9ffb700 1 -- 172.21.15.84:0/2192098834 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f29c4077800 con 0x7f29d40f5bb0 2024-02-15T18:24:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.232+0000 7f29d8aac700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f29c005c2b0 0x7f29c005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.232+0000 7f29d8aac700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f29c005c2b0 0x7f29c005e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f29d0009740 tx=0x7f29d0009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.236+0000 7f29c9ffb700 1 -- 172.21.15.84:0/2192098834 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f29c404a800 con 0x7f29d40f5bb0 2024-02-15T18:24:03.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:03.412+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f29d40fe060 con 0x7f29c005c2b0 2024-02-15T18:24:04.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:02.398377+0000 mgr.smithi084.hjmnez (mgr.14162) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:04.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:03.415453+0000 mon.smithi084 (mon.0) 458 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-15T18:24:04.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:02.398377+0000 mgr.smithi084.hjmnez (mgr.14162) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:04.763 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:03.415453+0000 mon.smithi084 (mon.0) 458 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-15T18:24:05.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.053+0000 7f29c9ffb700 1 -- 172.21.15.84:0/2192098834 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f29d0009320 con 0x7f29c005c2b0 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f29c005c2b0 msgr2=0x7f29c005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f29c005c2b0 0x7f29c005e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f29d0009740 tx=0x7f29d0009be0).stop 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 msgr2=0x7f29d4109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 0x7f29d4109de0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f29c4009830 tx=0x7f29c4009b30).stop 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 shutdown_connections 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f29c005c2b0 0x7f29c005e770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29d40f5bb0 0x7f29d4109de0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 --2- 172.21.15.84:0/2192098834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29d40f6550 0x7f29d410c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 >> 172.21.15.84:0/2192098834 conn(0x7f29d40f04c0 msgr2=0x7f29d40fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.056+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 shutdown_connections 2024-02-15T18:24:05.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:05.057+0000 7f29db511700 1 -- 172.21.15.84:0/2192098834 wait complete. 2024-02-15T18:24:05.395 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:24:05.029+0000 7f74bb594700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:03.414978+0000 mgr.smithi084.hjmnez (mgr.14162) 231 : audit [DBG] from='client.14428 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:04.024975+0000 mon.smithi084 (mon.0) 459 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:04.025021+0000 mon.smithi084 (mon.0) 460 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:04.026376+0000 mon.smithi084 (mon.0) 461 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.027308+0000 mon.smithi084 (mon.0) 462 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:05.027497+0000 mon.smithi084 (mon.0) 463 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.029062+0000 mon.smithi084 (mon.0) 464 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:05.029842+0000 mon.smithi084 (mon.0) 465 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:05.029878+0000 mon.smithi084 (mon.0) 466 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:05.039373+0000 mon.smithi084 (mon.0) 467 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.039601+0000 mon.smithi084 (mon.0) 468 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-15T18:24:05.396 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:05.039689+0000 mon.smithi084 (mon.0) 469 : cluster [DBG] fsmap cephfs:0 2024-02-15T18:24:05.397 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.053928+0000 mon.smithi084 (mon.0) 470 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:05.397 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.054817+0000 mon.smithi084 (mon.0) 471 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:05.397 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.063842+0000 mon.smithi084 (mon.0) 472 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:05.397 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.070688+0000 mon.smithi084 (mon.0) 473 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:05.397 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.071506+0000 mon.smithi084 (mon.0) 474 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.mkpnnx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:24:05.397 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.074602+0000 mon.smithi084 (mon.0) 475 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.mkpnnx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:24:05.397 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:05.075262+0000 mon.smithi084 (mon.0) 476 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:05.516 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:03.414978+0000 mgr.smithi084.hjmnez (mgr.14162) 231 : audit [DBG] from='client.14428 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:05.516 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:04.024975+0000 mon.smithi084 (mon.0) 459 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-15T18:24:05.516 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:04.025021+0000 mon.smithi084 (mon.0) 460 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-02-15T18:24:05.516 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:04.026376+0000 mon.smithi084 (mon.0) 461 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-15T18:24:05.516 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.027308+0000 mon.smithi084 (mon.0) 462 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-15T18:24:05.516 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:05.027497+0000 mon.smithi084 (mon.0) 463 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-02-15T18:24:05.516 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.029062+0000 mon.smithi084 (mon.0) 464 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-15T18:24:05.516 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:05.029842+0000 mon.smithi084 (mon.0) 465 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:05.029878+0000 mon.smithi084 (mon.0) 466 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:05.039373+0000 mon.smithi084 (mon.0) 467 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.039601+0000 mon.smithi084 (mon.0) 468 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:05.039689+0000 mon.smithi084 (mon.0) 469 : cluster [DBG] fsmap cephfs:0 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.053928+0000 mon.smithi084 (mon.0) 470 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.054817+0000 mon.smithi084 (mon.0) 471 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.063842+0000 mon.smithi084 (mon.0) 472 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.070688+0000 mon.smithi084 (mon.0) 473 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.071506+0000 mon.smithi084 (mon.0) 474 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.mkpnnx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.074602+0000 mon.smithi084 (mon.0) 475 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.mkpnnx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:24:05.517 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:05.075262+0000 mon.smithi084 (mon.0) 476 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:05.724 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T18:24:06.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:04.398777+0000 mgr.smithi084.hjmnez (mgr.14162) 232 : cluster [DBG] pgmap v197: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:06.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:24:05.042906+0000 mgr.smithi084.hjmnez (mgr.14162) 233 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-02-15T18:24:06.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:24:05.075846+0000 mgr.smithi084.hjmnez (mgr.14162) 234 : cephadm [INF] Deploying daemon mds.cephfs.smithi133.mkpnnx on smithi133 2024-02-15T18:24:06.514 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:06.041307+0000 mon.smithi084 (mon.0) 477 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-02-15T18:24:06.626 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:04.398777+0000 mgr.smithi084.hjmnez (mgr.14162) 232 : cluster [DBG] pgmap v197: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:06.626 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:24:05.042906+0000 mgr.smithi084.hjmnez (mgr.14162) 233 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-02-15T18:24:06.626 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:24:05.075846+0000 mgr.smithi084.hjmnez (mgr.14162) 234 : cephadm [INF] Deploying daemon mds.cephfs.smithi133.mkpnnx on smithi133 2024-02-15T18:24:06.627 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:06.041307+0000 mon.smithi084 (mon.0) 477 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/3267966934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 msgr2=0x7fdbf40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 --2- 172.21.15.84:0/3267966934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 0x7fdbf40f6b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fdbf0004660 tx=0x7fdbf0009b30).stop 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/3267966934 shutdown_connections 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 --2- 172.21.15.84:0/3267966934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbf40f7980 0x7fdbf40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 --2- 172.21.15.84:0/3267966934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 0x7fdbf40f6b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/3267966934 >> 172.21.15.84:0/3267966934 conn(0x7fdbf40f1e40 msgr2=0x7fdbf40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/3267966934 shutdown_connections 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/3267966934 wait complete. 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 Processor -- start 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.623+0000 7fdbfb7a4700 1 -- start start 2024-02-15T18:24:07.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbfb7a4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 0x7fdbf41070a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbfb7a4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbf40f7980 0x7fdbf4107590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbfb7a4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4107b40 con 0x7fdbf40f66e0 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbfb7a4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4107c80 con 0x7fdbf40f7980 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbf9540700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 0x7fdbf41070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbf9540700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 0x7fdbf41070a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36926/0 (socket says 172.21.15.84:36926) 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbf9540700 1 -- 172.21.15.84:0/1763017342 learned_addr learned my addr 172.21.15.84:0/1763017342 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbf8d3f700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbf40f7980 0x7fdbf4107590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbf9540700 1 -- 172.21.15.84:0/1763017342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbf40f7980 msgr2=0x7fdbf4107590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbf9540700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbf40f7980 0x7fdbf4107590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbf9540700 1 -- 172.21.15.84:0/1763017342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0005040 con 0x7fdbf40f66e0 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbf8d3f700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbf40f7980 0x7fdbf4107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:24:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbf9540700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 0x7fdbf41070a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fdbf0004e30 tx=0x7fdbf0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbe9ffb700 1 -- 172.21.15.84:0/1763017342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf0018070 con 0x7fdbf40f66e0 2024-02-15T18:24:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbe9ffb700 1 -- 172.21.15.84:0/1763017342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbf0007ba0 con 0x7fdbf40f66e0 2024-02-15T18:24:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf41085c0 con 0x7fdbf40f66e0 2024-02-15T18:24:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.624+0000 7fdbe9ffb700 1 -- 172.21.15.84:0/1763017342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf001c620 con 0x7fdbf40f66e0 2024-02-15T18:24:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.625+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf4108b20 con 0x7fdbf40f66e0 2024-02-15T18:24:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.626+0000 7fdbe9ffb700 1 -- 172.21.15.84:0/1763017342 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdbf0007d10 con 0x7fdbf40f66e0 2024-02-15T18:24:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.626+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf4045ad0 con 0x7fdbf40f66e0 2024-02-15T18:24:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.626+0000 7fdbe9ffb700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdbe005c300 0x7fdbe005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.626+0000 7fdbe9ffb700 1 -- 172.21.15.84:0/1763017342 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fdbf0077cd0 con 0x7fdbf40f66e0 2024-02-15T18:24:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.626+0000 7fdbf8d3f700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdbe005c300 0x7fdbe005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.627+0000 7fdbf8d3f700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdbe005c300 0x7fdbe005e7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fdbe4009fd0 tx=0x7fdbe400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.631+0000 7fdbe9ffb700 1 -- 172.21.15.84:0/1763017342 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdbf004a8d0 con 0x7fdbf40f66e0 2024-02-15T18:24:07.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.832+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdbf4027a00 con 0x7fdbf40f66e0 2024-02-15T18:24:07.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.833+0000 7fdbe9ffb700 1 -- 172.21.15.84:0/1763017342 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1003 (secure 0 0 0) 0x7fdbf004def0 con 0x7fdbf40f66e0 2024-02-15T18:24:07.832 INFO:teuthology.orchestra.run.smithi084.stdout:e2 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 2 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:24:05.029733+0000 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:24:07.833 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 1 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:in 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:up {} 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:24:07.834 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:24:07.835 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:24:07.835 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:24:07.835 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 0 2024-02-15T18:24:07.835 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:07.835 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdbe005c300 msgr2=0x7fdbe005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdbe005c300 0x7fdbe005e7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fdbe4009fd0 tx=0x7fdbe400b040).stop 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 msgr2=0x7fdbf41070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 0x7fdbf41070a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fdbf0004e30 tx=0x7fdbf0009b30).stop 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 shutdown_connections 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdbe005c300 0x7fdbe005e7c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbf40f66e0 0x7fdbf41070a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 --2- 172.21.15.84:0/1763017342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbf40f7980 0x7fdbf4107590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 >> 172.21.15.84:0/1763017342 conn(0x7fdbf40f1e40 msgr2=0x7fdbf40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 shutdown_connections 2024-02-15T18:24:07.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:07.835+0000 7fdbfb7a4700 1 -- 172.21.15.84:0/1763017342 wait complete. 2024-02-15T18:24:07.837 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2024-02-15T18:24:08.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:06.399084+0000 mgr.smithi084.hjmnez (mgr.14162) 235 : cluster [DBG] pgmap v201: 65 pgs: 10 active+clean, 11 creating+peering, 44 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:08.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:07.041698+0000 mon.smithi084 (mon.0) 478 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-02-15T18:24:08.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:07.544813+0000 mon.smithi084 (mon.0) 479 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:08.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:07.545571+0000 mon.smithi084 (mon.0) 480 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.cuytny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:24:08.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:07.548524+0000 mon.smithi084 (mon.0) 481 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.cuytny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:24:08.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:07.549292+0000 mon.smithi084 (mon.0) 482 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:08.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:07.833910+0000 mon.smithi084 (mon.0) 483 : audit [DBG] from='client.? 172.21.15.84:0/1763017342' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:24:08.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:06.399084+0000 mgr.smithi084.hjmnez (mgr.14162) 235 : cluster [DBG] pgmap v201: 65 pgs: 10 active+clean, 11 creating+peering, 44 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:08.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:07.041698+0000 mon.smithi084 (mon.0) 478 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-02-15T18:24:08.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:07.544813+0000 mon.smithi084 (mon.0) 479 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:08.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:07.545571+0000 mon.smithi084 (mon.0) 480 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.cuytny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:24:08.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:07.548524+0000 mon.smithi084 (mon.0) 481 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.cuytny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:24:08.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:07.549292+0000 mon.smithi084 (mon.0) 482 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:08.423 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:07.833910+0000 mon.smithi084 (mon.0) 483 : audit [DBG] from='client.? 172.21.15.84:0/1763017342' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:24:09.570 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:24:07.550006+0000 mgr.smithi084.hjmnez (mgr.14162) 236 : cephadm [INF] Deploying daemon mds.cephfs.smithi084.cuytny on smithi084 2024-02-15T18:24:09.570 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:08.279603+0000 mon.smithi084 (mon.0) 484 : cluster [DBG] mds.? [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] up:boot 2024-02-15T18:24:09.570 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:08.279645+0000 mon.smithi084 (mon.0) 485 : cluster [INF] daemon mds.cephfs.smithi133.mkpnnx assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-15T18:24:09.570 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:08.279697+0000 mon.smithi084 (mon.0) 486 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T18:24:09.570 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:08.279711+0000 mon.smithi084 (mon.0) 487 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:24:09.570 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:08.279719+0000 mon.smithi084 (mon.0) 488 : cluster [INF] Cluster is now healthy 2024-02-15T18:24:09.571 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:08.279888+0000 mon.smithi084 (mon.0) 489 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-02-15T18:24:09.571 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:08.279976+0000 mon.smithi084 (mon.0) 490 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:24:09.571 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:08.281813+0000 mon.smithi084 (mon.0) 491 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:creating} 2024-02-15T18:24:09.571 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:08.298680+0000 mon.smithi084 (mon.0) 492 : cluster [INF] daemon mds.cephfs.smithi133.mkpnnx is now active in filesystem cephfs as rank 0 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:24:07.550006+0000 mgr.smithi084.hjmnez (mgr.14162) 236 : cephadm [INF] Deploying daemon mds.cephfs.smithi084.cuytny on smithi084 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:08.279603+0000 mon.smithi084 (mon.0) 484 : cluster [DBG] mds.? [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] up:boot 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:08.279645+0000 mon.smithi084 (mon.0) 485 : cluster [INF] daemon mds.cephfs.smithi133.mkpnnx assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:08.279697+0000 mon.smithi084 (mon.0) 486 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:08.279711+0000 mon.smithi084 (mon.0) 487 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:08.279719+0000 mon.smithi084 (mon.0) 488 : cluster [INF] Cluster is now healthy 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:08.279888+0000 mon.smithi084 (mon.0) 489 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:08.279976+0000 mon.smithi084 (mon.0) 490 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:08.281813+0000 mon.smithi084 (mon.0) 491 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:creating} 2024-02-15T18:24:09.646 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:08.298680+0000 mon.smithi084 (mon.0) 492 : cluster [INF] daemon mds.cephfs.smithi133.mkpnnx is now active in filesystem cephfs as rank 0 2024-02-15T18:24:09.732 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:24:09.742 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:24:09.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-15T18:24:10.498 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:08.399496+0000 mgr.smithi084.hjmnez (mgr.14162) 237 : cluster [DBG] pgmap v203: 65 pgs: 46 active+clean, 11 creating+peering, 8 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:10.498 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:09.287129+0000 mon.smithi084 (mon.0) 493 : cluster [DBG] mds.? [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] up:active 2024-02-15T18:24:10.498 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:09.287190+0000 mon.smithi084 (mon.0) 494 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 2024-02-15T18:24:10.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:08.399496+0000 mgr.smithi084.hjmnez (mgr.14162) 237 : cluster [DBG] pgmap v203: 65 pgs: 46 active+clean, 11 creating+peering, 8 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:10.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:09.287129+0000 mon.smithi084 (mon.0) 493 : cluster [DBG] mds.? [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] up:active 2024-02-15T18:24:10.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:09.287190+0000 mon.smithi084 (mon.0) 494 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 2024-02-15T18:24:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.830+0000 7f1fd999d700 1 -- 172.21.15.84:0/1129461833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd4060310 msgr2=0x7f1fd40f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.830+0000 7f1fd999d700 1 --2- 172.21.15.84:0/1129461833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd4060310 0x7f1fd40f9140 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f1fc4004660 tx=0x7f1fc4009b30).stop 2024-02-15T18:24:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.830+0000 7f1fd999d700 1 -- 172.21.15.84:0/1129461833 shutdown_connections 2024-02-15T18:24:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.830+0000 7f1fd999d700 1 --2- 172.21.15.84:0/1129461833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fd40f96c0 0x7f1fd40fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.830+0000 7f1fd999d700 1 --2- 172.21.15.84:0/1129461833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd4060310 0x7f1fd40f9140 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.830+0000 7f1fd999d700 1 -- 172.21.15.84:0/1129461833 >> 172.21.15.84:0/1129461833 conn(0x7f1fd40f0bc0 msgr2=0x7f1fd40f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.830+0000 7f1fd999d700 1 -- 172.21.15.84:0/1129461833 shutdown_connections 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.830+0000 7f1fd999d700 1 -- 172.21.15.84:0/1129461833 wait complete. 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.831+0000 7f1fd999d700 1 Processor -- start 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.831+0000 7f1fd999d700 1 -- start start 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.831+0000 7f1fd999d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fd4060310 0x7f1fd4106e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.831+0000 7f1fd999d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd40f96c0 0x7f1fd4107380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.831+0000 7f1fd999d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd4107930 con 0x7f1fd40f96c0 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.831+0000 7f1fd999d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd4107a70 con 0x7f1fd4060310 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd40f96c0 0x7f1fd4107380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd40f96c0 0x7f1fd4107380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36968/0 (socket says 172.21.15.84:36968) 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd27fc700 1 -- 172.21.15.84:0/3596830228 learned_addr learned my addr 172.21.15.84:0/3596830228 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd2ffd700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fd4060310 0x7f1fd4106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd27fc700 1 -- 172.21.15.84:0/3596830228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fd4060310 msgr2=0x7f1fd4106e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd27fc700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fd4060310 0x7f1fd4106e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd27fc700 1 -- 172.21.15.84:0/3596830228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4005040 con 0x7f1fd40f96c0 2024-02-15T18:24:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd27fc700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd40f96c0 0x7f1fd4107380 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f1fc8002700 tx=0x7f1fc8009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fbb7fe700 1 -- 172.21.15.84:0/3596830228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc80079c0 con 0x7f1fd40f96c0 2024-02-15T18:24:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd4108410 con 0x7f1fd40f96c0 2024-02-15T18:24:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fbb7fe700 1 -- 172.21.15.84:0/3596830228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fc800f040 con 0x7f1fd40f96c0 2024-02-15T18:24:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fbb7fe700 1 -- 172.21.15.84:0/3596830228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc8014840 con 0x7f1fd40f96c0 2024-02-15T18:24:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.832+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd41089d0 con 0x7f1fd40f96c0 2024-02-15T18:24:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.833+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd4045ad0 con 0x7f1fd40f96c0 2024-02-15T18:24:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.834+0000 7f1fbb7fe700 1 -- 172.21.15.84:0/3596830228 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1fc801b060 con 0x7f1fd40f96c0 2024-02-15T18:24:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.834+0000 7f1fbb7fe700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f1fbc05c300 0x7f1fbc05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.834+0000 7f1fbb7fe700 1 -- 172.21.15.84:0/3596830228 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1fc8075ce0 con 0x7f1fd40f96c0 2024-02-15T18:24:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.834+0000 7f1fd2ffd700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f1fbc05c300 0x7f1fbc05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.834+0000 7f1fd2ffd700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f1fbc05c300 0x7f1fbc05e7c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f1fc4004630 tx=0x7f1fc4009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:11.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:11.838+0000 7f1fbb7fe700 1 -- 172.21.15.84:0/3596830228 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1fc80489a0 con 0x7f1fd40f96c0 2024-02-15T18:24:12.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:10.399840+0000 mgr.smithi084.hjmnez (mgr.14162) 238 : cluster [DBG] pgmap v204: 65 pgs: 59 active+clean, 6 creating+peering; 0 B data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:12.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:10.645587+0000 mon.smithi084 (mon.0) 495 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:12.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:10.646272+0000 mon.smithi084 (mon.0) 496 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.ubglfw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:24:12.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:10.648848+0000 mon.smithi084 (mon.0) 497 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.ubglfw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:24:12.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:10.649373+0000 mon.smithi084 (mon.0) 498 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:12.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:24:10.649836+0000 mgr.smithi084.hjmnez (mgr.14162) 239 : cephadm [INF] Deploying daemon mds.cephfs.smithi133.ubglfw on smithi133 2024-02-15T18:24:12.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:11.294006+0000 mon.smithi084 (mon.0) 499 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] up:boot 2024-02-15T18:24:12.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:11.294286+0000 mon.smithi084 (mon.0) 500 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 1 up:standby 2024-02-15T18:24:12.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:11.294398+0000 mon.smithi084 (mon.0) 501 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:24:12.014 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:11.299259+0000 mon.smithi084 (mon.0) 502 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 1 up:standby 2024-02-15T18:24:12.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.027+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f1fd40fee50 con 0x7f1fd40f96c0 2024-02-15T18:24:12.119 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:10.399840+0000 mgr.smithi084.hjmnez (mgr.14162) 238 : cluster [DBG] pgmap v204: 65 pgs: 59 active+clean, 6 creating+peering; 0 B data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:10.645587+0000 mon.smithi084 (mon.0) 495 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:10.646272+0000 mon.smithi084 (mon.0) 496 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.ubglfw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:24:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:10.648848+0000 mon.smithi084 (mon.0) 497 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.ubglfw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:24:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:10.649373+0000 mon.smithi084 (mon.0) 498 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:24:10.649836+0000 mgr.smithi084.hjmnez (mgr.14162) 239 : cephadm [INF] Deploying daemon mds.cephfs.smithi133.ubglfw on smithi133 2024-02-15T18:24:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:11.294006+0000 mon.smithi084 (mon.0) 499 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] up:boot 2024-02-15T18:24:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:11.294286+0000 mon.smithi084 (mon.0) 500 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 1 up:standby 2024-02-15T18:24:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:11.294398+0000 mon.smithi084 (mon.0) 501 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:24:12.120 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:11.299259+0000 mon.smithi084 (mon.0) 502 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 1 up:standby 2024-02-15T18:24:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.689+0000 7f1fbb7fe700 1 -- 172.21.15.84:0/3596830228 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1fc804bfc0 con 0x7f1fd40f96c0 2024-02-15T18:24:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f1fbc05c300 msgr2=0x7f1fbc05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f1fbc05c300 0x7f1fbc05e7c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f1fc4004630 tx=0x7f1fc4009b30).stop 2024-02-15T18:24:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd40f96c0 msgr2=0x7f1fd4107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd40f96c0 0x7f1fd4107380 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f1fc8002700 tx=0x7f1fc8009d60).stop 2024-02-15T18:24:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 shutdown_connections 2024-02-15T18:24:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f1fbc05c300 0x7f1fbc05e7c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fd4060310 0x7f1fd4106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 --2- 172.21.15.84:0/3596830228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fd40f96c0 0x7f1fd4107380 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 >> 172.21.15.84:0/3596830228 conn(0x7f1fd40f0bc0 msgr2=0x7f1fd40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 shutdown_connections 2024-02-15T18:24:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:12.691+0000 7f1fd999d700 1 -- 172.21.15.84:0/3596830228 wait complete. 2024-02-15T18:24:13.000 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:12.028006+0000 mon.smithi084 (mon.0) 503 : audit [INF] from='client.? 172.21.15.84:0/3596830228' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T18:24:13.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:12.028006+0000 mon.smithi084 (mon.0) 503 : audit [INF] from='client.? 172.21.15.84:0/3596830228' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T18:24:13.383 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:24:13.394 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:24:13.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-02-15T18:24:13.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:12.400425+0000 mgr.smithi084.hjmnez (mgr.14162) 240 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 2.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:13.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:12.684567+0000 mon.smithi084 (mon.0) 504 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:24:13.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:12.689949+0000 mon.smithi084 (mon.0) 505 : audit [INF] from='client.? 172.21.15.84:0/3596830228' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T18:24:13.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:12.690027+0000 mon.smithi084 (mon.0) 506 : cluster [INF] daemon mds.cephfs.smithi084.cuytny assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T18:24:13.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:12.690103+0000 mon.smithi084 (mon.0) 507 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T18:24:13.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:12.690119+0000 mon.smithi084 (mon.0) 508 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:24:13.987 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:12.690333+0000 mon.smithi084 (mon.0) 509 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 1 up:standby 2024-02-15T18:24:13.988 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:12.695585+0000 mon.smithi084 (mon.0) 510 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:creating} 2024-02-15T18:24:13.988 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:12.705608+0000 mon.smithi084 (mon.0) 511 : cluster [INF] daemon mds.cephfs.smithi084.cuytny is now active in filesystem cephfs as rank 1 2024-02-15T18:24:13.988 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:13.046928+0000 mon.smithi084 (mon.0) 512 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:13.988 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:13.047759+0000 mon.smithi084 (mon.0) 513 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.spootv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:24:13.988 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:13.050743+0000 mon.smithi084 (mon.0) 514 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.spootv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:24:13.988 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:13.051403+0000 mon.smithi084 (mon.0) 515 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:13.988 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:24:13.052168+0000 mgr.smithi084.hjmnez (mgr.14162) 241 : cephadm [INF] Deploying daemon mds.cephfs.smithi084.spootv on smithi084 2024-02-15T18:24:14.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:12.400425+0000 mgr.smithi084.hjmnez (mgr.14162) 240 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 2.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:14.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:12.684567+0000 mon.smithi084 (mon.0) 504 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:12.689949+0000 mon.smithi084 (mon.0) 505 : audit [INF] from='client.? 172.21.15.84:0/3596830228' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:12.690027+0000 mon.smithi084 (mon.0) 506 : cluster [INF] daemon mds.cephfs.smithi084.cuytny assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:12.690103+0000 mon.smithi084 (mon.0) 507 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:12.690119+0000 mon.smithi084 (mon.0) 508 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:12.690333+0000 mon.smithi084 (mon.0) 509 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 1 up:standby 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:12.695585+0000 mon.smithi084 (mon.0) 510 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:creating} 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:12.705608+0000 mon.smithi084 (mon.0) 511 : cluster [INF] daemon mds.cephfs.smithi084.cuytny is now active in filesystem cephfs as rank 1 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:13.046928+0000 mon.smithi084 (mon.0) 512 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:13.047759+0000 mon.smithi084 (mon.0) 513 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.spootv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:13.050743+0000 mon.smithi084 (mon.0) 514 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.spootv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:13.051403+0000 mon.smithi084 (mon.0) 515 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:14.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:24:13.052168+0000 mgr.smithi084.hjmnez (mgr.14162) 241 : cephadm [INF] Deploying daemon mds.cephfs.smithi084.spootv on smithi084 2024-02-15T18:24:15.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:13.693066+0000 mon.smithi084 (mon.0) 516 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T18:24:15.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:13.693084+0000 mon.smithi084 (mon.0) 517 : cluster [INF] Cluster is now healthy 2024-02-15T18:24:15.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:13.695716+0000 mon.smithi084 (mon.0) 518 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] up:active 2024-02-15T18:24:15.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:13.695761+0000 mon.smithi084 (mon.0) 519 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:boot 2024-02-15T18:24:15.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:13.695817+0000 mon.smithi084 (mon.0) 520 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 1 up:standby 2024-02-15T18:24:15.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:13.695910+0000 mon.smithi084 (mon.0) 521 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:24:15.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:13.693066+0000 mon.smithi084 (mon.0) 516 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T18:24:15.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:13.693084+0000 mon.smithi084 (mon.0) 517 : cluster [INF] Cluster is now healthy 2024-02-15T18:24:15.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:13.695716+0000 mon.smithi084 (mon.0) 518 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] up:active 2024-02-15T18:24:15.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:13.695761+0000 mon.smithi084 (mon.0) 519 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:boot 2024-02-15T18:24:15.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:13.695817+0000 mon.smithi084 (mon.0) 520 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 1 up:standby 2024-02-15T18:24:15.146 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:13.695910+0000 mon.smithi084 (mon.0) 521 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:24:16.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:14.400765+0000 mgr.smithi084.hjmnez (mgr.14162) 242 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 3.4 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s wr, 8 op/s 2024-02-15T18:24:16.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:14.400765+0000 mgr.smithi084.hjmnez (mgr.14162) 242 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 3.4 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s wr, 8 op/s 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.512+0000 7fb991d2e700 1 -- 172.21.15.84:0/3993969878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f66e0 msgr2=0x7fb98c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.512+0000 7fb991d2e700 1 --2- 172.21.15.84:0/3993969878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f66e0 0x7fb98c0f6b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fb980004660 tx=0x7fb980009b30).stop 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.512+0000 7fb991d2e700 1 -- 172.21.15.84:0/3993969878 shutdown_connections 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.512+0000 7fb991d2e700 1 --2- 172.21.15.84:0/3993969878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb98c0f7980 0x7fb98c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.512+0000 7fb991d2e700 1 --2- 172.21.15.84:0/3993969878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f66e0 0x7fb98c0f6b00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.512+0000 7fb991d2e700 1 -- 172.21.15.84:0/3993969878 >> 172.21.15.84:0/3993969878 conn(0x7fb98c0f1e40 msgr2=0x7fb98c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.512+0000 7fb991d2e700 1 -- 172.21.15.84:0/3993969878 shutdown_connections 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.512+0000 7fb991d2e700 1 -- 172.21.15.84:0/3993969878 wait complete. 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb991d2e700 1 Processor -- start 2024-02-15T18:24:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb991d2e700 1 -- start start 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb991d2e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb98c0f66e0 0x7fb98c1070a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb991d2e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f7980 0x7fb98c107590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb991d2e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c107b40 con 0x7fb98c0f7980 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb991d2e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c107c80 con 0x7fb98c0f66e0 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb98affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f7980 0x7fb98c107590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb98affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f7980 0x7fb98c107590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59632/0 (socket says 172.21.15.84:59632) 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb98affd700 1 -- 172.21.15.84:0/1986364479 learned_addr learned my addr 172.21.15.84:0/1986364479 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.513+0000 7fb98b7fe700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb98c0f66e0 0x7fb98c1070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.514+0000 7fb98affd700 1 -- 172.21.15.84:0/1986364479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb98c0f66e0 msgr2=0x7fb98c1070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.514+0000 7fb98affd700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb98c0f66e0 0x7fb98c1070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.514+0000 7fb98affd700 1 -- 172.21.15.84:0/1986364479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980005040 con 0x7fb98c0f7980 2024-02-15T18:24:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.514+0000 7fb98affd700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f7980 0x7fb98c107590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb97c00c530 tx=0x7fb97c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:16.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.514+0000 7fb973fff700 1 -- 172.21.15.84:0/1986364479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb97c00f650 con 0x7fb98c0f7980 2024-02-15T18:24:16.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.514+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98c108620 con 0x7fb98c0f7980 2024-02-15T18:24:16.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.514+0000 7fb973fff700 1 -- 172.21.15.84:0/1986364479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb97c00fc80 con 0x7fb98c0f7980 2024-02-15T18:24:16.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.514+0000 7fb973fff700 1 -- 172.21.15.84:0/1986364479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb97c012d80 con 0x7fb98c0f7980 2024-02-15T18:24:16.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.514+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98c108be0 con 0x7fb98c0f7980 2024-02-15T18:24:16.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.515+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98c045ad0 con 0x7fb98c0f7980 2024-02-15T18:24:16.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.516+0000 7fb973fff700 1 -- 172.21.15.84:0/1986364479 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb97c010070 con 0x7fb98c0f7980 2024-02-15T18:24:16.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.516+0000 7fb973fff700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb97405c2b0 0x7fb97405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:16.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.516+0000 7fb973fff700 1 -- 172.21.15.84:0/1986364479 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb97c076490 con 0x7fb98c0f7980 2024-02-15T18:24:16.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.516+0000 7fb98b7fe700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb97405c2b0 0x7fb97405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:16.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.516+0000 7fb98b7fe700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb97405c2b0 0x7fb97405e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb980004e30 tx=0x7fb980009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:16.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.519+0000 7fb973fff700 1 -- 172.21.15.84:0/1986364479 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb97c0491d0 con 0x7fb98c0f7980 2024-02-15T18:24:16.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:16.715+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb98c027a00 con 0x7fb98c0f7980 2024-02-15T18:24:17.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.704+0000 7fb973fff700 1 -- 172.21.15.84:0/1986364479 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb97c04c7f0 con 0x7fb98c0f7980 2024-02-15T18:24:17.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.705+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb97405c2b0 msgr2=0x7fb97405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.705+0000 7fb991d2e700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb97405c2b0 0x7fb97405e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb980004e30 tx=0x7fb980009b30).stop 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.705+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f7980 msgr2=0x7fb98c107590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.705+0000 7fb991d2e700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f7980 0x7fb98c107590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb97c00c530 tx=0x7fb97c007e20).stop 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.706+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 shutdown_connections 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.706+0000 7fb991d2e700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb97405c2b0 0x7fb97405e770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.706+0000 7fb991d2e700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb98c0f66e0 0x7fb98c1070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.706+0000 7fb991d2e700 1 --2- 172.21.15.84:0/1986364479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb98c0f7980 0x7fb98c107590 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.706+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 >> 172.21.15.84:0/1986364479 conn(0x7fb98c0f1e40 msgr2=0x7fb98c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.706+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 shutdown_connections 2024-02-15T18:24:17.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:17.706+0000 7fb991d2e700 1 -- 172.21.15.84:0/1986364479 wait complete. 2024-02-15T18:24:18.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:16.401346+0000 mgr.smithi084.hjmnez (mgr.14162) 243 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s wr, 10 op/s 2024-02-15T18:24:18.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:16.716917+0000 mon.smithi084 (mon.0) 522 : audit [INF] from='client.? 172.21.15.84:0/1986364479' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-15T18:24:18.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:16.767188+0000 mon.smithi084 (mon.0) 523 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:18.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:16.767846+0000 mon.smithi084 (mon.0) 524 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:18.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:16.401346+0000 mgr.smithi084.hjmnez (mgr.14162) 243 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s wr, 10 op/s 2024-02-15T18:24:18.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:16.716917+0000 mon.smithi084 (mon.0) 522 : audit [INF] from='client.? 172.21.15.84:0/1986364479' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-15T18:24:18.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:16.767188+0000 mon.smithi084 (mon.0) 523 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:18.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:16.767846+0000 mon.smithi084 (mon.0) 524 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:18.412 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:24:18.426 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:24:18.426 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-15T18:24:19.010 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:17.704425+0000 mon.smithi084 (mon.0) 525 : audit [INF] from='client.? 172.21.15.84:0/1986364479' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-15T18:24:19.010 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:17.704495+0000 mon.smithi084 (mon.0) 526 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:standby 2024-02-15T18:24:19.010 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:17.704558+0000 mon.smithi084 (mon.0) 527 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 1 up:standby 2024-02-15T18:24:19.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:17.704425+0000 mon.smithi084 (mon.0) 525 : audit [INF] from='client.? 172.21.15.84:0/1986364479' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-15T18:24:19.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:17.704495+0000 mon.smithi084 (mon.0) 526 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:standby 2024-02-15T18:24:19.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:17.704558+0000 mon.smithi084 (mon.0) 527 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 1 up:standby 2024-02-15T18:24:20.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:18.401801+0000 mgr.smithi084.hjmnez (mgr.14162) 244 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 8 op/s 2024-02-15T18:24:20.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:18.895708+0000 mon.smithi084 (mon.0) 528 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:20.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:18.401801+0000 mgr.smithi084.hjmnez (mgr.14162) 244 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 8 op/s 2024-02-15T18:24:20.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:18.895708+0000 mon.smithi084 (mon.0) 528 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:21.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.855+0000 7fd44baee700 1 -- 172.21.15.84:0/1581452570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f7980 msgr2=0x7fd4440f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:21.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.855+0000 7fd44baee700 1 --2- 172.21.15.84:0/1581452570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f7980 0x7fd4440f7de0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fd440004660 tx=0x7fd440009b30).stop 2024-02-15T18:24:21.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.855+0000 7fd44baee700 1 -- 172.21.15.84:0/1581452570 shutdown_connections 2024-02-15T18:24:21.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.855+0000 7fd44baee700 1 --2- 172.21.15.84:0/1581452570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f7980 0x7fd4440f7de0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:21.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.855+0000 7fd44baee700 1 --2- 172.21.15.84:0/1581452570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4440f66e0 0x7fd4440f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:21.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.855+0000 7fd44baee700 1 -- 172.21.15.84:0/1581452570 >> 172.21.15.84:0/1581452570 conn(0x7fd4440f1e40 msgr2=0x7fd4440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:21.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.855+0000 7fd44baee700 1 -- 172.21.15.84:0/1581452570 shutdown_connections 2024-02-15T18:24:21.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.855+0000 7fd44baee700 1 -- 172.21.15.84:0/1581452570 wait complete. 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44baee700 1 Processor -- start 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44baee700 1 -- start start 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44baee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f66e0 0x7fd444107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44baee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4440f7980 0x7fd444107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44baee700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd444107b30 con 0x7fd4440f66e0 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44baee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd444107c70 con 0x7fd4440f7980 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44988a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f66e0 0x7fd444107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44988a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f66e0 0x7fd444107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59660/0 (socket says 172.21.15.84:59660) 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44988a700 1 -- 172.21.15.84:0/3010291218 learned_addr learned my addr 172.21.15.84:0/3010291218 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd449089700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4440f7980 0x7fd444107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44988a700 1 -- 172.21.15.84:0/3010291218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4440f7980 msgr2=0x7fd444107580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44988a700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4440f7980 0x7fd444107580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:21.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44988a700 1 -- 172.21.15.84:0/3010291218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440005040 con 0x7fd4440f66e0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd44988a700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f66e0 0x7fd444107090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fd434002700 tx=0x7fd434009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.856+0000 7fd43a7fc700 1 -- 172.21.15.84:0/3010291218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd434009320 con 0x7fd4440f66e0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.857+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd444108610 con 0x7fd4440f66e0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.857+0000 7fd43a7fc700 1 -- 172.21.15.84:0/3010291218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd43400f040 con 0x7fd4440f66e0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.857+0000 7fd43a7fc700 1 -- 172.21.15.84:0/3010291218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd434014940 con 0x7fd4440f66e0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.857+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd444108bd0 con 0x7fd4440f66e0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.858+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd444045ad0 con 0x7fd4440f66e0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.858+0000 7fd43a7fc700 1 -- 172.21.15.84:0/3010291218 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd4340077b0 con 0x7fd4440f66e0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.858+0000 7fd43a7fc700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd43005c2b0 0x7fd43005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.858+0000 7fd43a7fc700 1 -- 172.21.15.84:0/3010291218 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd434076120 con 0x7fd4440f66e0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.858+0000 7fd449089700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd43005c2b0 0x7fd43005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.858+0000 7fd449089700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd43005c2b0 0x7fd43005e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd440004e30 tx=0x7fd440009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:21.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:21.862+0000 7fd43a7fc700 1 -- 172.21.15.84:0/3010291218 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd434048de0 con 0x7fd4440f66e0 2024-02-15T18:24:22.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:20.402120+0000 mgr.smithi084.hjmnez (mgr.14162) 245 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 6 op/s 2024-02-15T18:24:22.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:20.904928+0000 mon.smithi084 (mon.0) 529 : cluster [DBG] mds.? [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] up:boot 2024-02-15T18:24:22.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:20.904992+0000 mon.smithi084 (mon.0) 530 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:24:22.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:20.905107+0000 mon.smithi084 (mon.0) 531 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:24:22.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.055+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fd4440ff130 con 0x7fd4440f66e0 2024-02-15T18:24:22.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:20.402120+0000 mgr.smithi084.hjmnez (mgr.14162) 245 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 6 op/s 2024-02-15T18:24:22.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:20.904928+0000 mon.smithi084 (mon.0) 529 : cluster [DBG] mds.? [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] up:boot 2024-02-15T18:24:22.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:20.904992+0000 mon.smithi084 (mon.0) 530 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:24:22.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:20.905107+0000 mon.smithi084 (mon.0) 531 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:24:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.912+0000 7fd43a7fc700 1 -- 172.21.15.84:0/3010291218 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v13) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd43404c400 con 0x7fd4440f66e0 2024-02-15T18:24:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd43005c2b0 msgr2=0x7fd43005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd43005c2b0 0x7fd43005e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd440004e30 tx=0x7fd440009b30).stop 2024-02-15T18:24:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f66e0 msgr2=0x7fd444107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f66e0 0x7fd444107090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fd434002700 tx=0x7fd434009d80).stop 2024-02-15T18:24:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 shutdown_connections 2024-02-15T18:24:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd43005c2b0 0x7fd43005e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4440f66e0 0x7fd444107090 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 --2- 172.21.15.84:0/3010291218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4440f7980 0x7fd444107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 >> 172.21.15.84:0/3010291218 conn(0x7fd4440f1e40 msgr2=0x7fd4440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 shutdown_connections 2024-02-15T18:24:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:22.914+0000 7fd44baee700 1 -- 172.21.15.84:0/3010291218 wait complete. 2024-02-15T18:24:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:inline data disabled 2024-02-15T18:24:23.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:22.056309+0000 mon.smithi084 (mon.0) 532 : audit [INF] from='client.? 172.21.15.84:0/3010291218' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-15T18:24:23.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:22.056309+0000 mon.smithi084 (mon.0) 532 : audit [INF] from='client.? 172.21.15.84:0/3010291218' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-15T18:24:23.957 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:24:23.970 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:24:23.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T18:24:24.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:22.402628+0000 mgr.smithi084.hjmnez (mgr.14162) 246 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-02-15T18:24:24.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:22.913156+0000 mon.smithi084 (mon.0) 533 : audit [INF] from='client.? 172.21.15.84:0/3010291218' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-15T18:24:24.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:22.913211+0000 mon.smithi084 (mon.0) 534 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:24:24.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:22.402628+0000 mgr.smithi084.hjmnez (mgr.14162) 246 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-02-15T18:24:24.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:22.913156+0000 mon.smithi084 (mon.0) 533 : audit [INF] from='client.? 172.21.15.84:0/3010291218' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-15T18:24:24.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:22.913211+0000 mon.smithi084 (mon.0) 534 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:24:25.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:24.110076+0000 mon.smithi084 (mon.0) 535 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:25.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:24.113370+0000 mon.smithi084 (mon.0) 536 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:25.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:24.116257+0000 mon.smithi084 (mon.0) 537 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:25.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:24.110076+0000 mon.smithi084 (mon.0) 535 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:25.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:24.113370+0000 mon.smithi084 (mon.0) 536 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:25.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:24.116257+0000 mon.smithi084 (mon.0) 537 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.028+0000 7fb16d04e700 1 -- 172.21.15.84:0/341501417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 msgr2=0x7fb1680f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.028+0000 7fb16d04e700 1 --2- 172.21.15.84:0/341501417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 0x7fb1680f6950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fb158004660 tx=0x7fb158009b30).stop 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.028+0000 7fb16d04e700 1 -- 172.21.15.84:0/341501417 shutdown_connections 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.028+0000 7fb16d04e700 1 --2- 172.21.15.84:0/341501417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680f77d0 0x7fb1680f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.028+0000 7fb16d04e700 1 --2- 172.21.15.84:0/341501417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 0x7fb1680f6950 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.028+0000 7fb16d04e700 1 -- 172.21.15.84:0/341501417 >> 172.21.15.84:0/341501417 conn(0x7fb1680f1c90 msgr2=0x7fb1680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.028+0000 7fb16d04e700 1 -- 172.21.15.84:0/341501417 shutdown_connections 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.028+0000 7fb16d04e700 1 -- 172.21.15.84:0/341501417 wait complete. 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb16d04e700 1 Processor -- start 2024-02-15T18:24:26.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb16d04e700 1 -- start start 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb16d04e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 0x7fb168106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb16d04e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680f77d0 0x7fb1681073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb16d04e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168107960 con 0x7fb1680f6530 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb16d04e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb168108160 con 0x7fb1680f77d0 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb167fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 0x7fb168106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb167fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 0x7fb168106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59446/0 (socket says 172.21.15.84:59446) 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb167fff700 1 -- 172.21.15.84:0/1430851562 learned_addr learned my addr 172.21.15.84:0/1430851562 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb1677fe700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680f77d0 0x7fb1681073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb167fff700 1 -- 172.21.15.84:0/1430851562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680f77d0 msgr2=0x7fb1681073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb167fff700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680f77d0 0x7fb1681073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb167fff700 1 -- 172.21.15.84:0/1430851562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158005040 con 0x7fb1680f6530 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.029+0000 7fb167fff700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 0x7fb168106ec0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb158004e30 tx=0x7fb158009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.030+0000 7fb164ff9700 1 -- 172.21.15.84:0/1430851562 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb158018070 con 0x7fb1680f6530 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.030+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1681083e0 con 0x7fb1680f6530 2024-02-15T18:24:26.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.030+0000 7fb164ff9700 1 -- 172.21.15.84:0/1430851562 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb158007ba0 con 0x7fb1680f6530 2024-02-15T18:24:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.030+0000 7fb164ff9700 1 -- 172.21.15.84:0/1430851562 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb15801c620 con 0x7fb1680f6530 2024-02-15T18:24:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.030+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb168108940 con 0x7fb1680f6530 2024-02-15T18:24:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.031+0000 7fb164ff9700 1 -- 172.21.15.84:0/1430851562 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb158007d10 con 0x7fb1680f6530 2024-02-15T18:24:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.031+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb168059100 con 0x7fb1680f6530 2024-02-15T18:24:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.031+0000 7fb164ff9700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb15005c350 0x7fb15005e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.031+0000 7fb164ff9700 1 -- 172.21.15.84:0/1430851562 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb158077ca0 con 0x7fb1680f6530 2024-02-15T18:24:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.031+0000 7fb1677fe700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb15005c350 0x7fb15005e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.032+0000 7fb1677fe700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb15005c350 0x7fb15005e810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fb15c009fd0 tx=0x7fb15c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:26.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.035+0000 7fb164ff9700 1 -- 172.21.15.84:0/1430851562 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb15804a8a0 con 0x7fb1680f6530 2024-02-15T18:24:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.228+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb168045ad0 con 0x7fb1680f6530 2024-02-15T18:24:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.228+0000 7fb164ff9700 1 -- 172.21.15.84:0/1430851562 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1626 (secure 0 0 0) 0x7fb15804dec0 con 0x7fb1680f6530 2024-02-15T18:24:26.227 INFO:teuthology.orchestra.run.smithi084.stdout:e14 2024-02-15T18:24:26.227 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:24:26.227 INFO:teuthology.orchestra.run.smithi084.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:24:26.227 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 13 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:24:22.906819+0000 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:24:26.228 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:24:26.229 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261]] 2024-02-15T18:24:26.230 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091]] 2024-02-15T18:24:26.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:26.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:26.230 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:24:26.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:26.230 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317]] 2024-02-15T18:24:26.230 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334]] 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb15005c350 msgr2=0x7fb15005e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb15005c350 0x7fb15005e810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fb15c009fd0 tx=0x7fb15c00b040).stop 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 msgr2=0x7fb168106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 0x7fb168106ec0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fb158004e30 tx=0x7fb158009b30).stop 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 shutdown_connections 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb15005c350 0x7fb15005e810 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1680f6530 0x7fb168106ec0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 --2- 172.21.15.84:0/1430851562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1680f77d0 0x7fb1681073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 >> 172.21.15.84:0/1430851562 conn(0x7fb1680f1c90 msgr2=0x7fb1680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 shutdown_connections 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:26.230+0000 7fb16d04e700 1 -- 172.21.15.84:0/1430851562 wait complete. 2024-02-15T18:24:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-02-15T18:24:26.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:24.403003+0000 mgr.smithi084.hjmnez (mgr.14162) 247 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-02-15T18:24:26.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:25.120166+0000 mon.smithi084 (mon.0) 538 : cluster [DBG] mds.? [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] up:standby 2024-02-15T18:24:26.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:25.120222+0000 mon.smithi084 (mon.0) 539 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:24:26.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:24.403003+0000 mgr.smithi084.hjmnez (mgr.14162) 247 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-02-15T18:24:26.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:25.120166+0000 mon.smithi084 (mon.0) 538 : cluster [DBG] mds.? [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] up:standby 2024-02-15T18:24:26.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:25.120222+0000 mon.smithi084 (mon.0) 539 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:24:27.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-15T18:24:27.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:26.229174+0000 mon.smithi084 (mon.0) 540 : audit [DBG] from='client.? 172.21.15.84:0/1430851562' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:24:27.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:26.356734+0000 mon.smithi084 (mon.0) 541 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:27.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:26.229174+0000 mon.smithi084 (mon.0) 540 : audit [DBG] from='client.? 172.21.15.84:0/1430851562' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:24:27.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:26.356734+0000 mon.smithi084 (mon.0) 541 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:28.620 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:26.403331+0000 mgr.smithi084.hjmnez (mgr.14162) 248 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 2 op/s 2024-02-15T18:24:28.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:26.403331+0000 mgr.smithi084.hjmnez (mgr.14162) 248 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 2 op/s 2024-02-15T18:24:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.479+0000 7f67b9796700 1 -- 172.21.15.84:0/3697459990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f55e0 msgr2=0x7f67b40f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.479+0000 7f67b9796700 1 --2- 172.21.15.84:0/3697459990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f55e0 0x7f67b40f5a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f67a8004660 tx=0x7f67a8009b30).stop 2024-02-15T18:24:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.479+0000 7f67b9796700 1 -- 172.21.15.84:0/3697459990 shutdown_connections 2024-02-15T18:24:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.479+0000 7f67b9796700 1 --2- 172.21.15.84:0/3697459990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40f5ef0 0x7f67b40f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:29.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.479+0000 7f67b9796700 1 --2- 172.21.15.84:0/3697459990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f55e0 0x7f67b40f5a00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.479+0000 7f67b9796700 1 -- 172.21.15.84:0/3697459990 >> 172.21.15.84:0/3697459990 conn(0x7f67b40f0de0 msgr2=0x7f67b40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.479+0000 7f67b9796700 1 -- 172.21.15.84:0/3697459990 shutdown_connections 2024-02-15T18:24:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.479+0000 7f67b9796700 1 -- 172.21.15.84:0/3697459990 wait complete. 2024-02-15T18:24:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b9796700 1 Processor -- start 2024-02-15T18:24:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b9796700 1 -- start start 2024-02-15T18:24:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b9796700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40f55e0 0x7f67b4105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b9796700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f5ef0 0x7f67b4106450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:29.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b9796700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b4106a90 con 0x7f67b40f5ef0 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b9796700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b4107340 con 0x7f67b40f55e0 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f5ef0 0x7f67b4106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f5ef0 0x7f67b4106450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59460/0 (socket says 172.21.15.84:59460) 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b27fc700 1 -- 172.21.15.84:0/3727034732 learned_addr learned my addr 172.21.15.84:0/3727034732 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b2ffd700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40f55e0 0x7f67b4105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b27fc700 1 -- 172.21.15.84:0/3727034732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40f55e0 msgr2=0x7f67b4105f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b27fc700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40f55e0 0x7f67b4105f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b27fc700 1 -- 172.21.15.84:0/3727034732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a8005040 con 0x7f67b40f5ef0 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.480+0000 7f67b2ffd700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40f55e0 0x7f67b4105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.481+0000 7f67b27fc700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f5ef0 0x7f67b4106450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f67a400b410 tx=0x7f67a4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.481+0000 7f679b7fe700 1 -- 172.21.15.84:0/3727034732 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a40125f0 con 0x7f67b40f5ef0 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.481+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b4107620 con 0x7f67b40f5ef0 2024-02-15T18:24:29.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.481+0000 7f679b7fe700 1 -- 172.21.15.84:0/3727034732 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f67a4012c20 con 0x7f67b40f5ef0 2024-02-15T18:24:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.481+0000 7f679b7fe700 1 -- 172.21.15.84:0/3727034732 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a4002b30 con 0x7f67b40f5ef0 2024-02-15T18:24:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.481+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b4107be0 con 0x7f67b40f5ef0 2024-02-15T18:24:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.482+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b40f4a70 con 0x7f67b40f5ef0 2024-02-15T18:24:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.482+0000 7f679b7fe700 1 -- 172.21.15.84:0/3727034732 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f67a400f030 con 0x7f67b40f5ef0 2024-02-15T18:24:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.482+0000 7f679b7fe700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f679c05c2b0 0x7f679c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.482+0000 7f679b7fe700 1 -- 172.21.15.84:0/3727034732 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f67a4076370 con 0x7f67b40f5ef0 2024-02-15T18:24:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.482+0000 7f67b2ffd700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f679c05c2b0 0x7f679c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:29.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.483+0000 7f67b2ffd700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f679c05c2b0 0x7f679c05e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f67a8004630 tx=0x7f67a8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:29.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.486+0000 7f679b7fe700 1 -- 172.21.15.84:0/3727034732 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f67a4049030 con 0x7f67b40f5ef0 2024-02-15T18:24:29.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:28.492653+0000 mon.smithi084 (mon.0) 542 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:24:29.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:28.492828+0000 mon.smithi084 (mon.0) 543 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:24:29.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.676+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67b4045ad0 con 0x7f67b40f5ef0 2024-02-15T18:24:29.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.677+0000 7f679b7fe700 1 -- 172.21.15.84:0/3727034732 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2942 (secure 0 0 0) 0x7f67a404c650 con 0x7f67b40f5ef0 2024-02-15T18:24:29.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.678+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f679c05c2b0 msgr2=0x7f679c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:29.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.678+0000 7f67b9796700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f679c05c2b0 0x7f679c05e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f67a8004630 tx=0x7f67a8009b30).stop 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.678+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f5ef0 msgr2=0x7f67b4106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.678+0000 7f67b9796700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f5ef0 0x7f67b4106450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f67a400b410 tx=0x7f67a4006ef0).stop 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.678+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 shutdown_connections 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.678+0000 7f67b9796700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f679c05c2b0 0x7f679c05e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.678+0000 7f67b9796700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40f55e0 0x7f67b4105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.678+0000 7f67b9796700 1 --2- 172.21.15.84:0/3727034732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67b40f5ef0 0x7f67b4106450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.678+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 >> 172.21.15.84:0/3727034732 conn(0x7f67b40f0de0 msgr2=0x7f67b40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.679+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 shutdown_connections 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:29.679+0000 7f67b9796700 1 -- 172.21.15.84:0/3727034732 wait complete. 2024-02-15T18:24:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-02-15T18:24:29.687 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:24:29.700 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:28.492653+0000 mon.smithi084 (mon.0) 542 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:24:29.700 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:28.492828+0000 mon.smithi084 (mon.0) 543 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:24:30.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:28.403889+0000 mgr.smithi084.hjmnez (mgr.14162) 249 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-15T18:24:30.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:29.677668+0000 mon.smithi084 (mon.0) 544 : audit [DBG] from='client.? 172.21.15.84:0/3727034732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:24:30.677 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:28.403889+0000 mgr.smithi084.hjmnez (mgr.14162) 249 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-15T18:24:30.677 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:29.677668+0000 mon.smithi084 (mon.0) 544 : audit [DBG] from='client.? 172.21.15.84:0/3727034732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:24:31.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-15T18:24:32.644 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:30.404463+0000 mgr.smithi084.hjmnez (mgr.14162) 250 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:32.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:30.404463+0000 mgr.smithi084.hjmnez (mgr.14162) 250 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:33.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 -- 172.21.15.84:0/195844119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 msgr2=0x7f62a40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:33.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 --2- 172.21.15.84:0/195844119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 0x7f62a40f6cc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f62a0004660 tx=0x7f62a0009b30).stop 2024-02-15T18:24:33.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 -- 172.21.15.84:0/195844119 shutdown_connections 2024-02-15T18:24:33.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 --2- 172.21.15.84:0/195844119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 0x7f62a40f6cc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:33.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 --2- 172.21.15.84:0/195844119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62a40f55c0 0x7f62a40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:33.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 -- 172.21.15.84:0/195844119 >> 172.21.15.84:0/195844119 conn(0x7f62a40f0d40 msgr2=0x7f62a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 -- 172.21.15.84:0/195844119 shutdown_connections 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 -- 172.21.15.84:0/195844119 wait complete. 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 Processor -- start 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 -- start start 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.723+0000 7f62abf82700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62a40f55c0 0x7f62a4109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62abf82700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 0x7f62a410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62abf82700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40603e0 con 0x7f62a40f6860 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62abf82700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4060520 con 0x7f62a40f55c0 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62a951d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 0x7f62a410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62a951d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 0x7f62a410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41350/0 (socket says 172.21.15.84:41350) 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62a951d700 1 -- 172.21.15.84:0/1844625790 learned_addr learned my addr 172.21.15.84:0/1844625790 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62a9d1e700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62a40f55c0 0x7f62a4109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62a951d700 1 -- 172.21.15.84:0/1844625790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62a40f55c0 msgr2=0x7f62a4109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62a951d700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62a40f55c0 0x7f62a4109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:33.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62a951d700 1 -- 172.21.15.84:0/1844625790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0005040 con 0x7f62a40f6860 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62a9d1e700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62a40f55c0 0x7f62a4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62a951d700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 0x7f62a410c1b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f62a0000c00 tx=0x7f62a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f629a7fc700 1 -- 172.21.15.84:0/1844625790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a0019070 con 0x7f62a40f6860 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a410c700 con 0x7f62a40f6860 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f629a7fc700 1 -- 172.21.15.84:0/1844625790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62a0007e90 con 0x7f62a40f6860 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f629a7fc700 1 -- 172.21.15.84:0/1844625790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a0014d90 con 0x7f62a40f6860 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.724+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a410cc60 con 0x7f62a40f6860 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.725+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a4045ad0 con 0x7f62a40f6860 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.725+0000 7f629a7fc700 1 -- 172.21.15.84:0/1844625790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f62a0025070 con 0x7f62a40f6860 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.726+0000 7f629a7fc700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f629005c2b0 0x7f629005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.726+0000 7f629a7fc700 1 -- 172.21.15.84:0/1844625790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f62a0076ee0 con 0x7f62a40f6860 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.726+0000 7f62a9d1e700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f629005c2b0 0x7f629005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.726+0000 7f62a9d1e700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f629005c2b0 0x7f629005e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f62a4060060 tx=0x7f629400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.730+0000 7f629a7fc700 1 -- 172.21.15.84:0/1844625790 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f62a0049b20 con 0x7f62a40f6860 2024-02-15T18:24:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.979+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f62a40fdf30 con 0x7f62a40f6860 2024-02-15T18:24:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.979+0000 7f629a7fc700 1 -- 172.21.15.84:0/1844625790 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+86 (secure 0 0 0) 0x7f62a004d140 con 0x7f62a40f6860 2024-02-15T18:24:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f629005c2b0 msgr2=0x7f629005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f629005c2b0 0x7f629005e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f62a4060060 tx=0x7f629400b040).stop 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 msgr2=0x7f62a410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 0x7f62a410c1b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f62a0000c00 tx=0x7f62a000b040).stop 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 shutdown_connections 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f629005c2b0 0x7f629005e770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62a40f55c0 0x7f62a4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 --2- 172.21.15.84:0/1844625790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a40f6860 0x7f62a410c1b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 >> 172.21.15.84:0/1844625790 conn(0x7f62a40f0d40 msgr2=0x7f62a40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 shutdown_connections 2024-02-15T18:24:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:33.981+0000 7f62abf82700 1 -- 172.21.15.84:0/1844625790 wait complete. 2024-02-15T18:24:33.989 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:24:34.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:32.404885+0000 mgr.smithi084.hjmnez (mgr.14162) 251 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:34.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:33.944351+0000 mon.smithi084 (mon.0) 545 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:34.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:33.948695+0000 mon.smithi084 (mon.0) 546 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:34.513 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:33.980183+0000 mon.smithi084 (mon.0) 547 : audit [DBG] from='client.? 172.21.15.84:0/1844625790' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-15T18:24:34.645 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-15T18:24:34.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T18:24:34.658 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:32.404885+0000 mgr.smithi084.hjmnez (mgr.14162) 251 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:34.658 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:33.944351+0000 mon.smithi084 (mon.0) 545 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:34.659 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:33.948695+0000 mon.smithi084 (mon.0) 546 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:34.659 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:33.980183+0000 mon.smithi084 (mon.0) 547 : audit [DBG] from='client.? 172.21.15.84:0/1844625790' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-15T18:24:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 -- 172.21.15.84:0/282391007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f5cc0 msgr2=0x7ff7540f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 --2- 172.21.15.84:0/282391007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f5cc0 0x7ff7540f66f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7ff748004660 tx=0x7ff748009b30).stop 2024-02-15T18:24:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 -- 172.21.15.84:0/282391007 shutdown_connections 2024-02-15T18:24:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 --2- 172.21.15.84:0/282391007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f5cc0 0x7ff7540f66f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 --2- 172.21.15.84:0/282391007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7540f53b0 0x7ff7540f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 -- 172.21.15.84:0/282391007 >> 172.21.15.84:0/282391007 conn(0x7ff7540f0bd0 msgr2=0x7ff7540f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 -- 172.21.15.84:0/282391007 shutdown_connections 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 -- 172.21.15.84:0/282391007 wait complete. 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 Processor -- start 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 -- start start 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f53b0 0x7ff754106c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7540f5cc0 0x7ff754107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.862+0000 7ff7599dc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff754107780 con 0x7ff7540f53b0 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff7599dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7541078f0 con 0x7ff7540f5cc0 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff752ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f53b0 0x7ff754106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff752ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f53b0 0x7ff754106c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41372/0 (socket says 172.21.15.84:41372) 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff752ffd700 1 -- 172.21.15.84:0/2881403732 learned_addr learned my addr 172.21.15.84:0/2881403732 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff752ffd700 1 -- 172.21.15.84:0/2881403732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7540f5cc0 msgr2=0x7ff754107180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff7527fc700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7540f5cc0 0x7ff754107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff752ffd700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7540f5cc0 0x7ff754107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff752ffd700 1 -- 172.21.15.84:0/2881403732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff748005040 con 0x7ff7540f53b0 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff752ffd700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f53b0 0x7ff754106c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7ff7440026d0 tx=0x7ff744009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff73b7fe700 1 -- 172.21.15.84:0/2881403732 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff744009320 con 0x7ff7540f53b0 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff73b7fe700 1 -- 172.21.15.84:0/2881403732 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff74400f040 con 0x7ff7540f53b0 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75410c360 con 0x7ff7540f53b0 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff73b7fe700 1 -- 172.21.15.84:0/2881403732 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff744014910 con 0x7ff7540f53b0 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.863+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75410c8f0 con 0x7ff7540f53b0 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.864+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff754046330 con 0x7ff7540f53b0 2024-02-15T18:24:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.864+0000 7ff73b7fe700 1 -- 172.21.15.84:0/2881403732 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff7440077b0 con 0x7ff7540f53b0 2024-02-15T18:24:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.865+0000 7ff73b7fe700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff73c05c370 0x7ff73c05e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.865+0000 7ff73b7fe700 1 -- 172.21.15.84:0/2881403732 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff744076460 con 0x7ff7540f53b0 2024-02-15T18:24:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.865+0000 7ff7527fc700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff73c05c370 0x7ff73c05e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.865+0000 7ff7527fc700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff73c05c370 0x7ff73c05e830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff748009d60 tx=0x7ff748009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:34.869+0000 7ff73b7fe700 1 -- 172.21.15.84:0/2881403732 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff744049120 con 0x7ff7540f53b0 2024-02-15T18:24:35.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.016+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7540fdcb0 con 0x7ff7540f53b0 2024-02-15T18:24:35.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.016+0000 7ff73b7fe700 1 -- 172.21.15.84:0/2881403732 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+14059 (secure 0 0 0) 0x7ff74404c740 con 0x7ff7540f53b0 2024-02-15T18:24:35.015 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:35.015 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:17:26.592201+0000","modified":"2024-02-15T18:24:07.036543+0000","last_up_change":"2024-02-15T18:22:38.855874+0000","last_in_change":"2024-02-15T18:22:21.440220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:21:49.806275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T18:24:03.651276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T18:24:04.264343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ce13286-2da9-4b1e-9121-b14ba88e414c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6803","nonce":2007717102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6805","nonce":2007717102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6809","nonce":2007717102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":2007717102},{"type":"v1","addr":"172.21.15.84:6807","nonce":2007717102}]},"public_addr":"172.21.15.84:6803/2007717102","cluster_addr":"172.21.15.84:6805/2007717102","heartbeat_back_addr":"172.21.15.84:6809/2007717102","heartbeat_front_addr":"172.21.15.84:6807/2007717102","state":["exists","up"]},{"osd":1,"uuid":"d20fe52a-86d7-421f-ab80-219ad7724f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6811","nonce":2931692549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6813","nonce":2931692549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6817","nonce":2931692549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2931692549},{"type":"v1","addr":"172.21.15.84:6815","nonce":2931692549}]},"public_addr":"172.21.15.84:6811/2931692549","cluster_addr":"172.21.15.84:6813/2931692549","heartbeat_back_addr":"172.21.15.84:6817/2931692549","heartbeat_front_addr":"172.21.15.84:6815/2931692549","state":["exists","up"]},{"osd":2,"uuid":"b905a1ac-93fe-419d-ab8e-4b3a3e08d448","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6819","nonce":686993623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6821","nonce":686993623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6825","nonce":686993623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":686993623},{"type":"v1","addr":"172.21.15.84:6823","nonce":686993623}]},"public_addr":"172.21.15.84:6819/686993623","cluster_addr":"172.21.15.84:6821/686993623","heartbeat_back_addr":"172.21.15.84:6825/686993623","heartbeat_front_addr":"172.21.15.84:6823/686993623","state":["exists","up"]},{"osd":3,"uuid":"ece64a41-54ad-420b-aa77-6d226942a19b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6801","nonce":1663108677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6803","nonce":1663108677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6807","nonce":1663108677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":1663108677},{"type":"v1","addr":"172.21.15.133:6805","nonce":1663108677}]},"public_addr":"172.21.15.133:6801/1663108677","cluster_addr":"172.21.15.133:6803/1663108677","heartbeat_back_addr":"172.21.15.133:6807/1663108677","heartbeat_front_addr":"172.21.15.133:6805/1663108677","state":["exists","up"]},{"osd":4,"uuid":"0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6809","nonce":16944871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6811","nonce":16944871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6815","nonce":16944871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":16944871},{"type":"v1","addr":"172.21.15.133:6813","nonce":16944871}]},"public_addr":"172.21.15.133:6809/16944871","cluster_addr":"172.21.15.133:6811/16944871","heartbeat_back_addr":"172.21.15.133:6815/16944871","heartbeat_front_addr":"172.21.15.133:6813/16944871","state":["exists","up"]},{"osd":5,"uuid":"0af0ca6d-3df7-42a9-9cbf-f41a4132671c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6817","nonce":212697091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6819","nonce":212697091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6823","nonce":212697091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":212697091},{"type":"v1","addr":"172.21.15.133:6821","nonce":212697091}]},"public_addr":"172.21.15.133:6817/212697091","cluster_addr":"172.21.15.133:6819/212697091","heartbeat_back_addr":"172.21.15.133:6823/212697091","heartbeat_front_addr":"172.21.15.133:6821/212697091","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:20:44.780626+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:10.929070+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:34.608389+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:54.376377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:15.726240+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:37.273413+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:0/3385940609":"2024-02-16T18:18:28.289514+0000","172.21.15.84:0/855149255":"2024-02-16T18:18:13.388623+0000","172.21.15.84:6800/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6801/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.84:6800/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/3021498954":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/1857689459":"2024-02-16T18:18:28.289514+0000","172.21.15.84:0/448246306":"2024-02-16T18:17:49.286762+0000","172.21.15.84:6801/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6800/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.84:6801/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.84:0/2943993061":"2024-02-16T18:17:49.286762+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:24:35.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff73c05c370 msgr2=0x7ff73c05e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff73c05c370 0x7ff73c05e830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff748009d60 tx=0x7ff748009b30).stop 2024-02-15T18:24:35.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f53b0 msgr2=0x7ff754106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f53b0 0x7ff754106c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7ff7440026d0 tx=0x7ff744009de0).stop 2024-02-15T18:24:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 shutdown_connections 2024-02-15T18:24:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ff73c05c370 0x7ff73c05e830 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7540f53b0 0x7ff754106c90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 --2- 172.21.15.84:0/2881403732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7540f5cc0 0x7ff754107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 >> 172.21.15.84:0/2881403732 conn(0x7ff7540f0bd0 msgr2=0x7ff75405fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 shutdown_connections 2024-02-15T18:24:35.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.018+0000 7ff7599dc700 1 -- 172.21.15.84:0/2881403732 wait complete. 2024-02-15T18:24:35.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-15T18:21:49.806275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T18:24:03.651276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T18:24:04.264343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-15T18:24:35.029 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-15T18:24:35.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.149+0000 7f3a52180700 1 -- 172.21.15.84:0/2083459064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 msgr2=0x7f3a4c0f7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.149+0000 7f3a52180700 1 --2- 172.21.15.84:0/2083459064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 0x7f3a4c0f7870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f3a3c004660 tx=0x7f3a3c009b30).stop 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.149+0000 7f3a52180700 1 -- 172.21.15.84:0/2083459064 shutdown_connections 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.149+0000 7f3a52180700 1 --2- 172.21.15.84:0/2083459064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 0x7f3a4c0f7870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.149+0000 7f3a52180700 1 --2- 172.21.15.84:0/2083459064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a4c0f4750 0x7f3a4c0f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.149+0000 7f3a52180700 1 -- 172.21.15.84:0/2083459064 >> 172.21.15.84:0/2083459064 conn(0x7f3a4c0f0250 msgr2=0x7f3a4c0f2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.149+0000 7f3a52180700 1 -- 172.21.15.84:0/2083459064 shutdown_connections 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.149+0000 7f3a52180700 1 -- 172.21.15.84:0/2083459064 wait complete. 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a52180700 1 Processor -- start 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a52180700 1 -- start start 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a52180700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a4c0f4750 0x7f3a4c106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a52180700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 0x7f3a4c107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a52180700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c107870 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a52180700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c1079b0 con 0x7f3a4c0f4750 2024-02-15T18:24:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a4affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 0x7f3a4c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a4affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 0x7f3a4c107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41390/0 (socket says 172.21.15.84:41390) 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a4affd700 1 -- 172.21.15.84:0/2195208927 learned_addr learned my addr 172.21.15.84:0/2195208927 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.150+0000 7f3a4b7fe700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a4c0f4750 0x7f3a4c106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a4affd700 1 -- 172.21.15.84:0/2195208927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a4c0f4750 msgr2=0x7f3a4c106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a4affd700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a4c0f4750 0x7f3a4c106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a4affd700 1 -- 172.21.15.84:0/2195208927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c005040 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a4b7fe700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a4c0f4750 0x7f3a4c106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a4affd700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 0x7f3a4c107270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f3a3c004e30 tx=0x7f3a3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a33fff700 1 -- 172.21.15.84:0/2195208927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3c018070 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c10c360 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a33fff700 1 -- 172.21.15.84:0/2195208927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a3c007ba0 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a33fff700 1 -- 172.21.15.84:0/2195208927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3c01c620 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.151+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c10c8c0 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.152+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c027a00 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.152+0000 7f3a33fff700 1 -- 172.21.15.84:0/2195208927 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3a3c007d10 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.152+0000 7f3a33fff700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3a3405c2b0 0x7f3a3405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:35.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.152+0000 7f3a33fff700 1 -- 172.21.15.84:0/2195208927 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3a3c077c10 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.152+0000 7f3a4b7fe700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3a3405c2b0 0x7f3a3405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.153+0000 7f3a4b7fe700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3a3405c2b0 0x7f3a3405e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f3a4c108270 tx=0x7f3a40009c00).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:35.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.156+0000 7f3a33fff700 1 -- 172.21.15.84:0/2195208927 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3a3c04a8d0 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.302+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3a4c0fed80 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.303+0000 7f3a33fff700 1 -- 172.21.15.84:0/2195208927 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v44) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3a3c04def0 con 0x7f3a4c0f50f0 2024-02-15T18:24:35.302 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-02-15T18:24:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3a3405c2b0 msgr2=0x7f3a3405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3a3405c2b0 0x7f3a3405e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f3a4c108270 tx=0x7f3a40009c00).stop 2024-02-15T18:24:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 msgr2=0x7f3a4c107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 0x7f3a4c107270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f3a3c004e30 tx=0x7f3a3c009b30).stop 2024-02-15T18:24:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 shutdown_connections 2024-02-15T18:24:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f3a3405c2b0 0x7f3a3405e770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a4c0f4750 0x7f3a4c106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 --2- 172.21.15.84:0/2195208927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a4c0f50f0 0x7f3a4c107270 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 >> 172.21.15.84:0/2195208927 conn(0x7f3a4c0f0250 msgr2=0x7f3a4c0fb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 shutdown_connections 2024-02-15T18:24:35.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.304+0000 7f3a52180700 1 -- 172.21.15.84:0/2195208927 wait complete. 2024-02-15T18:24:35.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T18:24:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/1128364799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f7730 msgr2=0x7fa0d80f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 --2- 172.21.15.84:0/1128364799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f7730 0x7fa0d80f7b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fa0c8004660 tx=0x7fa0c8009b30).stop 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/1128364799 shutdown_connections 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 --2- 172.21.15.84:0/1128364799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f7730 0x7fa0d80f7b90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 --2- 172.21.15.84:0/1128364799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0d80f6490 0x7fa0d80f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/1128364799 >> 172.21.15.84:0/1128364799 conn(0x7fa0d80f1bd0 msgr2=0x7fa0d80f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/1128364799 shutdown_connections 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/1128364799 wait complete. 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 Processor -- start 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 -- start start 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f6490 0x7fa0d8106cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0d80f7730 0x7fa0d81071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d81077c0 con 0x7fa0d80f6490 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0dcd4e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8107900 con 0x7fa0d80f7730 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0d659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f6490 0x7fa0d8106cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0d659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f6490 0x7fa0d8106cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41404/0 (socket says 172.21.15.84:41404) 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.436+0000 7fa0d659c700 1 -- 172.21.15.84:0/2127551281 learned_addr learned my addr 172.21.15.84:0/2127551281 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.437+0000 7fa0d659c700 1 -- 172.21.15.84:0/2127551281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0d80f7730 msgr2=0x7fa0d81071c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.437+0000 7fa0d659c700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0d80f7730 0x7fa0d81071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.437+0000 7fa0d659c700 1 -- 172.21.15.84:0/2127551281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c8005040 con 0x7fa0d80f6490 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.437+0000 7fa0d659c700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f6490 0x7fa0d8106cd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa0cc002700 tx=0x7fa0cc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.437+0000 7fa0c6ffd700 1 -- 172.21.15.84:0/2127551281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0cc009320 con 0x7fa0d80f6490 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.437+0000 7fa0c6ffd700 1 -- 172.21.15.84:0/2127551281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0cc00f040 con 0x7fa0d80f6490 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.437+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d810c310 con 0x7fa0d80f6490 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.437+0000 7fa0c6ffd700 1 -- 172.21.15.84:0/2127551281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0cc014930 con 0x7fa0d80f6490 2024-02-15T18:24:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.437+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d810c8d0 con 0x7fa0d80f6490 2024-02-15T18:24:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.438+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d8027a00 con 0x7fa0d80f6490 2024-02-15T18:24:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.438+0000 7fa0c6ffd700 1 -- 172.21.15.84:0/2127551281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa0cc009480 con 0x7fa0d80f6490 2024-02-15T18:24:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.439+0000 7fa0c6ffd700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa0c005c2b0 0x7fa0c005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.439+0000 7fa0d5d9b700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa0c005c2b0 0x7fa0c005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.439+0000 7fa0c6ffd700 1 -- 172.21.15.84:0/2127551281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa0cc076200 con 0x7fa0d80f6490 2024-02-15T18:24:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.439+0000 7fa0d5d9b700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa0c005c2b0 0x7fa0c005e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fa0c8009f50 tx=0x7fa0c8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:35.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.443+0000 7fa0c6ffd700 1 -- 172.21.15.84:0/2127551281 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa0cc048ec0 con 0x7fa0d80f6490 2024-02-15T18:24:35.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.591+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa0d80fed60 con 0x7fa0d80f6490 2024-02-15T18:24:35.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.591+0000 7fa0c6ffd700 1 -- 172.21.15.84:0/2127551281 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa0cc04c4e0 con 0x7fa0d80f6490 2024-02-15T18:24:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa0c005c2b0 msgr2=0x7fa0c005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa0c005c2b0 0x7fa0c005e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fa0c8009f50 tx=0x7fa0c8009b30).stop 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f6490 msgr2=0x7fa0d8106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f6490 0x7fa0d8106cd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fa0cc002700 tx=0x7fa0cc009e00).stop 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 shutdown_connections 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa0c005c2b0 0x7fa0c005e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0d80f6490 0x7fa0d8106cd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 --2- 172.21.15.84:0/2127551281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0d80f7730 0x7fa0d81071c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 >> 172.21.15.84:0/2127551281 conn(0x7fa0d80f1bd0 msgr2=0x7fa0d80fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 shutdown_connections 2024-02-15T18:24:35.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.593+0000 7fa0dcd4e700 1 -- 172.21.15.84:0/2127551281 wait complete. 2024-02-15T18:24:35.602 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:35.017153+0000 mon.smithi084 (mon.0) 548 : audit [DBG] from='client.? 172.21.15.84:0/2881403732' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:24:35.602 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:35.303656+0000 mon.smithi084 (mon.0) 549 : audit [DBG] from='client.? 172.21.15.84:0/2195208927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:24:35.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T18:24:35.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:35.017153+0000 mon.smithi084 (mon.0) 548 : audit [DBG] from='client.? 172.21.15.84:0/2881403732' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:24:35.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:35.303656+0000 mon.smithi084 (mon.0) 549 : audit [DBG] from='client.? 172.21.15.84:0/2195208927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.722+0000 7ffb9463d700 1 -- 172.21.15.84:0/1940078893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f6680 msgr2=0x7ffb8c0f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.722+0000 7ffb9463d700 1 --2- 172.21.15.84:0/1940078893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f6680 0x7ffb8c0f6ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7ffb88004660 tx=0x7ffb88009b30).stop 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.722+0000 7ffb9463d700 1 -- 172.21.15.84:0/1940078893 shutdown_connections 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.722+0000 7ffb9463d700 1 --2- 172.21.15.84:0/1940078893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f6680 0x7ffb8c0f6ae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.722+0000 7ffb9463d700 1 --2- 172.21.15.84:0/1940078893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c0f53e0 0x7ffb8c0f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.722+0000 7ffb9463d700 1 -- 172.21.15.84:0/1940078893 >> 172.21.15.84:0/1940078893 conn(0x7ffb8c0f0b60 msgr2=0x7ffb8c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.722+0000 7ffb9463d700 1 -- 172.21.15.84:0/1940078893 shutdown_connections 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.722+0000 7ffb9463d700 1 -- 172.21.15.84:0/1940078893 wait complete. 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb9463d700 1 Processor -- start 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb9463d700 1 -- start start 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb9463d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f53e0 0x7ffb8c108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb9463d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c0f6680 0x7ffb8c1093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb9463d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c1099a0 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb9463d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c109ae0 con 0x7ffb8c0f6680 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb923d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f53e0 0x7ffb8c108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb923d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f53e0 0x7ffb8c108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41430/0 (socket says 172.21.15.84:41430) 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb923d9700 1 -- 172.21.15.84:0/1588732324 learned_addr learned my addr 172.21.15.84:0/1588732324 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.723+0000 7ffb91bd8700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c0f6680 0x7ffb8c1093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb923d9700 1 -- 172.21.15.84:0/1588732324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c0f6680 msgr2=0x7ffb8c1093f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb923d9700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c0f6680 0x7ffb8c1093f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb923d9700 1 -- 172.21.15.84:0/1588732324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb88005040 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb91bd8700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c0f6680 0x7ffb8c1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb923d9700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f53e0 0x7ffb8c108f00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ffb7c002700 tx=0x7ffb7c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb82ffd700 1 -- 172.21.15.84:0/1588732324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c009320 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb82ffd700 1 -- 172.21.15.84:0/1588732324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb7c00f040 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c10e580 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb82ffd700 1 -- 172.21.15.84:0/1588732324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c014940 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.724+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c10eb40 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.725+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c0fdcb0 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.725+0000 7ffb82ffd700 1 -- 172.21.15.84:0/1588732324 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ffb7c0077b0 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.725+0000 7ffb82ffd700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ffb7805c2b0 0x7ffb7805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:35.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.726+0000 7ffb82ffd700 1 -- 172.21.15.84:0/1588732324 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ffb7c076270 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.726+0000 7ffb91bd8700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ffb7805c2b0 0x7ffb7805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:35.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.726+0000 7ffb91bd8700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ffb7805c2b0 0x7ffb7805e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ffb88005010 tx=0x7ffb88009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:35.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.729+0000 7ffb82ffd700 1 -- 172.21.15.84:0/1588732324 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ffb7c048e70 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.880+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ffb8c10f240 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.880+0000 7ffb82ffd700 1 -- 172.21.15.84:0/1588732324 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7ffb7c04c490 con 0x7ffb8c0f53e0 2024-02-15T18:24:35.879 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-02-15T18:24:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ffb7805c2b0 msgr2=0x7ffb7805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ffb7805c2b0 0x7ffb7805e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ffb88005010 tx=0x7ffb88009b30).stop 2024-02-15T18:24:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f53e0 msgr2=0x7ffb8c108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f53e0 0x7ffb8c108f00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ffb7c002700 tx=0x7ffb7c009d80).stop 2024-02-15T18:24:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 shutdown_connections 2024-02-15T18:24:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7ffb7805c2b0 0x7ffb7805e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb8c0f53e0 0x7ffb8c108f00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 --2- 172.21.15.84:0/1588732324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb8c0f6680 0x7ffb8c1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 >> 172.21.15.84:0/1588732324 conn(0x7ffb8c0f0b60 msgr2=0x7ffb8c05fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 shutdown_connections 2024-02-15T18:24:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:35.882+0000 7ffb9463d700 1 -- 172.21.15.84:0/1588732324 wait complete. 2024-02-15T18:24:35.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-15T18:24:36.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.008+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/1255892580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 msgr2=0x7fa9e00f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.008+0000 7fa9e5bb4700 1 --2- 172.21.15.84:0/1255892580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 0x7fa9e00f57d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fa9d4004660 tx=0x7fa9d4009b30).stop 2024-02-15T18:24:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.008+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/1255892580 shutdown_connections 2024-02-15T18:24:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.008+0000 7fa9e5bb4700 1 --2- 172.21.15.84:0/1255892580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e00f5cc0 0x7fa9e00f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.008+0000 7fa9e5bb4700 1 --2- 172.21.15.84:0/1255892580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 0x7fa9e00f57d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.008+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/1255892580 >> 172.21.15.84:0/1255892580 conn(0x7fa9e00f0bd0 msgr2=0x7fa9e00f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.008+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/1255892580 shutdown_connections 2024-02-15T18:24:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/1255892580 wait complete. 2024-02-15T18:24:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9e5bb4700 1 Processor -- start 2024-02-15T18:24:36.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9e5bb4700 1 -- start start 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9e5bb4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 0x7fa9e0105bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9e5bb4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e00f5cc0 0x7fa9e01060b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9e5bb4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e01066f0 con 0x7fa9e00f53b0 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9e5bb4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0106830 con 0x7fa9e00f5cc0 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 0x7fa9e0105bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 0x7fa9e0105bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41450/0 (socket says 172.21.15.84:41450) 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.009+0000 7fa9df7fe700 1 -- 172.21.15.84:0/42132805 learned_addr learned my addr 172.21.15.84:0/42132805 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9df7fe700 1 -- 172.21.15.84:0/42132805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e00f5cc0 msgr2=0x7fa9e01060b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9deffd700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e00f5cc0 0x7fa9e01060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9df7fe700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e00f5cc0 0x7fa9e01060b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9df7fe700 1 -- 172.21.15.84:0/42132805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4005040 con 0x7fa9e00f53b0 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9df7fe700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 0x7fa9e0105bc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fa9d4009830 tx=0x7fa9d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:36.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9c7fff700 1 -- 172.21.15.84:0/42132805 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9d4018070 con 0x7fa9e00f53b0 2024-02-15T18:24:36.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9c7fff700 1 -- 172.21.15.84:0/42132805 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9d4007d70 con 0x7fa9e00f53b0 2024-02-15T18:24:36.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9c7fff700 1 -- 172.21.15.84:0/42132805 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9d401c620 con 0x7fa9e00f53b0 2024-02-15T18:24:36.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e010b270 con 0x7fa9e00f53b0 2024-02-15T18:24:36.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.010+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e010b780 con 0x7fa9e00f53b0 2024-02-15T18:24:36.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.011+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e0027a00 con 0x7fa9e00f53b0 2024-02-15T18:24:36.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.011+0000 7fa9c7fff700 1 -- 172.21.15.84:0/42132805 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa9d401d9f0 con 0x7fa9e00f53b0 2024-02-15T18:24:36.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.012+0000 7fa9c7fff700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa9c805c370 0x7fa9c805e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:36.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.012+0000 7fa9deffd700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa9c805c370 0x7fa9c805e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:36.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.012+0000 7fa9c7fff700 1 -- 172.21.15.84:0/42132805 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa9d4077e10 con 0x7fa9e00f53b0 2024-02-15T18:24:36.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.012+0000 7fa9deffd700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa9c805c370 0x7fa9c805e830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fa9d000a6f0 tx=0x7fa9d0008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:36.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.016+0000 7fa9c7fff700 1 -- 172.21.15.84:0/42132805 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa9d404aad0 con 0x7fa9e00f53b0 2024-02-15T18:24:36.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.199+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9e00fdd30 con 0x7fa9e00f53b0 2024-02-15T18:24:36.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.200+0000 7fa9c7fff700 1 -- 172.21.15.84:0/42132805 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2942 (secure 0 0 0) 0x7fa9d404e0f0 con 0x7fa9e00f53b0 2024-02-15T18:24:36.199 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:36.199 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:24:22.906819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24239,"mds_1":14438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi084.cuytny","rank":1,"incarnation":9,"state":"up:active","state_seq":2,"addr":"172.21.15.84:6827/1573509091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1573509091},{"type":"v1","addr":"172.21.15.84:6827","nonce":1573509091}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:24:36.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa9c805c370 msgr2=0x7fa9c805e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:36.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa9c805c370 0x7fa9c805e830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fa9d000a6f0 tx=0x7fa9d0008040).stop 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 msgr2=0x7fa9e0105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 0x7fa9e0105bc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fa9d4009830 tx=0x7fa9d4009b30).stop 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 shutdown_connections 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa9c805c370 0x7fa9c805e830 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e00f53b0 0x7fa9e0105bc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 --2- 172.21.15.84:0/42132805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e00f5cc0 0x7fa9e01060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 >> 172.21.15.84:0/42132805 conn(0x7fa9e00f0bd0 msgr2=0x7fa9e00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 shutdown_connections 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.201+0000 7fa9e5bb4700 1 -- 172.21.15.84:0/42132805 wait complete. 2024-02-15T18:24:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-02-15T18:24:36.212 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 2, 'flags': 18} 2024-02-15T18:24:36.212 INFO:teuthology.run_tasks:Running task kclient... 2024-02-15T18:24:36.233 INFO:tasks.kclient:Mounting kernel clients... 2024-02-15T18:24:36.233 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-02-15T18:24:36.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:36.234 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-02-15T18:24:36.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:36.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-02-15T18:24:36.321 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2024-02-15T18:24:36.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:24:36.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:36.323 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-02-15T18:24:36.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:36.348 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-02-15T18:24:36.426 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-02-15T18:24:36.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:24:36.428 INFO:tasks.kclient:client.0 config is {} 2024-02-15T18:24:36.428 DEBUG:teuthology.orchestra.run.smithi084:> ceph fs ls 2024-02-15T18:24:36.512 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:34.405242+0000 mgr.smithi084.hjmnez (mgr.14162) 252 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:36.512 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:35.592103+0000 mon.smithi084 (mon.0) 550 : audit [DBG] from='client.? 172.21.15.84:0/2127551281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T18:24:36.512 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:35.880988+0000 mon.smithi084 (mon.0) 551 : audit [DBG] from='client.? 172.21.15.84:0/1588732324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T18:24:36.512 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:36.200663+0000 mon.smithi084 (mon.0) 552 : audit [DBG] from='client.? 172.21.15.84:0/42132805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:24:36.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.534+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/2710376179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f69b0 msgr2=0x7fb0e40f6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:36.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.534+0000 7fb0ebd6c700 1 --2- 172.21.15.84:0/2710376179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f69b0 0x7fb0e40f6dd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fb0d4004660 tx=0x7fb0d4009b30).stop 2024-02-15T18:24:36.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.534+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/2710376179 shutdown_connections 2024-02-15T18:24:36.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.534+0000 7fb0ebd6c700 1 --2- 172.21.15.84:0/2710376179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e40f56b0 0x7fb0e40f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.534+0000 7fb0ebd6c700 1 --2- 172.21.15.84:0/2710376179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f69b0 0x7fb0e40f6dd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.534+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/2710376179 >> 172.21.15.84:0/2710376179 conn(0x7fb0e40f02c0 msgr2=0x7fb0e40f26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:36.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.534+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/2710376179 shutdown_connections 2024-02-15T18:24:36.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.534+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/2710376179 wait complete. 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0ebd6c700 1 Processor -- start 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0ebd6c700 1 -- start start 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0ebd6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f56b0 0x7fb0e4105c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0ebd6c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e40f69b0 0x7fb0e4106180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0ebd6c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e4106780 con 0x7fb0e40f56b0 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0ebd6c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e41068f0 con 0x7fb0e40f69b0 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0e9b08700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f56b0 0x7fb0e4105c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0e9b08700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f56b0 0x7fb0e4105c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41468/0 (socket says 172.21.15.84:41468) 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0e9b08700 1 -- 172.21.15.84:0/3230267243 learned_addr learned my addr 172.21.15.84:0/3230267243 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0e9307700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e40f69b0 0x7fb0e4106180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0e9b08700 1 -- 172.21.15.84:0/3230267243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e40f69b0 msgr2=0x7fb0e4106180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0e9b08700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e40f69b0 0x7fb0e4106180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.535+0000 7fb0e9b08700 1 -- 172.21.15.84:0/3230267243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4005040 con 0x7fb0e40f56b0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.536+0000 7fb0e9b08700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f56b0 0x7fb0e4105c90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fb0d4009f50 tx=0x7fb0d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.536+0000 7fb0da7fc700 1 -- 172.21.15.84:0/3230267243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d4018070 con 0x7fb0e40f56b0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.536+0000 7fb0da7fc700 1 -- 172.21.15.84:0/3230267243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0d4007d70 con 0x7fb0e40f56b0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.536+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e410b300 con 0x7fb0e40f56b0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.536+0000 7fb0da7fc700 1 -- 172.21.15.84:0/3230267243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0d401c620 con 0x7fb0e40f56b0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.536+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e410b830 con 0x7fb0e40f56b0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.537+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e4046330 con 0x7fb0e40f56b0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.537+0000 7fb0da7fc700 1 -- 172.21.15.84:0/3230267243 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb0d401d420 con 0x7fb0e40f56b0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.537+0000 7fb0da7fc700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb0d005c2b0 0x7fb0d005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.537+0000 7fb0da7fc700 1 -- 172.21.15.84:0/3230267243 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb0d4077cb0 con 0x7fb0e40f56b0 2024-02-15T18:24:36.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.537+0000 7fb0e9307700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb0d005c2b0 0x7fb0d005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:36.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.538+0000 7fb0e9307700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb0d005c2b0 0x7fb0d005e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fb0e41071b0 tx=0x7fb0e0009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:36.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.541+0000 7fb0da7fc700 1 -- 172.21.15.84:0/3230267243 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb0d404a9f0 con 0x7fb0e40f56b0 2024-02-15T18:24:36.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:34.405242+0000 mgr.smithi084.hjmnez (mgr.14162) 252 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:36.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:35.592103+0000 mon.smithi084 (mon.0) 550 : audit [DBG] from='client.? 172.21.15.84:0/2127551281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T18:24:36.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:35.880988+0000 mon.smithi084 (mon.0) 551 : audit [DBG] from='client.? 172.21.15.84:0/1588732324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T18:24:36.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:36.200663+0000 mon.smithi084 (mon.0) 552 : audit [DBG] from='client.? 172.21.15.84:0/42132805' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:24:36.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.725+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0e4058710 con 0x7fb0e40f56b0 2024-02-15T18:24:36.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.725+0000 7fb0da7fc700 1 -- 172.21.15.84:0/3230267243 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fb0d404e010 con 0x7fb0e40f56b0 2024-02-15T18:24:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb0d005c2b0 msgr2=0x7fb0d005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb0d005c2b0 0x7fb0d005e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fb0e41071b0 tx=0x7fb0e0009040).stop 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f56b0 msgr2=0x7fb0e4105c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f56b0 0x7fb0e4105c90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fb0d4009f50 tx=0x7fb0d4009b30).stop 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 shutdown_connections 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fb0d005c2b0 0x7fb0d005e770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0e40f56b0 0x7fb0e4105c90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 --2- 172.21.15.84:0/3230267243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e40f69b0 0x7fb0e4106180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 >> 172.21.15.84:0/3230267243 conn(0x7fb0e40f02c0 msgr2=0x7fb0e40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 shutdown_connections 2024-02-15T18:24:36.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:36.727+0000 7fb0ebd6c700 1 -- 172.21.15.84:0/3230267243 wait complete. 2024-02-15T18:24:36.736 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-15T18:24:36.736 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-15T18:24:36.736 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-02-15T18:24:36.736 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-15T18:24:36.736 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-15T18:24:36.736 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-15T18:24:36.736 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-15T18:24:36.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-15T18:24:36.737 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-15T18:24:36.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:36.737 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:24:36.755 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:24:36.756 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-15T18:24:36.756 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:24:36.756 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-15T18:24:36.756 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41762sec preferred_lft 41762sec 2024-02-15T18:24:36.756 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-02-15T18:24:36.756 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:24:36.756 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-15T18:24:36.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:36.756 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-02-15T18:24:36.756 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-02-15T18:24:36.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2024-02-15T18:24:36.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2024-02-15T18:24:36.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2024-02-15T18:24:36.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-15T18:24:36.757 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-02-15T18:24:36.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:36.913 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-15T18:24:36.942 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-02-15T18:24:36.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:36.943 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-02-15T18:24:37.013 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-02-15T18:24:37.013 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-15T18:24:37.013 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-15T18:24:37.013 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-15T18:24:37.013 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-15T18:24:37.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:37.014 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-02-15T18:24:37.014 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-02-15T18:24:37.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-15T18:24:37.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-15T18:24:37.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-15T18:24:37.014 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-02-15T18:24:37.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:37.326 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-02-15T18:24:37.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:37.344 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-02-15T18:24:37.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:37.403 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-02-15T18:24:37.403 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-02-15T18:24:37.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-15T18:24:37.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-15T18:24:37.403 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-02-15T18:24:37.496 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-15T18:24:37.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:37.497 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-02-15T18:24:37.497 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-02-15T18:24:37.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-15T18:24:37.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-15T18:24:37.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-15T18:24:37.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-15T18:24:37.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-15T18:24:37.497 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-02-15T18:24:37.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:37.671 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2024-02-15T18:24:37.671 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-02-15T18:24:37.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-02-15T18:24:37.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2024-02-15T18:24:37.671 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-02-15T18:24:37.732 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:36.405638+0000 mgr.smithi084.hjmnez (mgr.14162) 253 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:37.732 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:36.726257+0000 mon.smithi084 (mon.0) 553 : audit [DBG] from='client.? 172.21.15.84:0/3230267243' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T18:24:37.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:37.769 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-02-15T18:24:37.786 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-02-15T18:24:37.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:24:37.893 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:24:37.893 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-02-15T18:24:37.915 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:24:37.915 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-02-15T18:24:37.917 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-15T18:24:37.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:37.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-15T18:24:37.946 INFO:tasks.kclient:client.1 config is {} 2024-02-15T18:24:37.946 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-02-15T18:24:38.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.131+0000 7f63a958d700 1 -- 172.21.15.133:0/423771551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 msgr2=0x7f63a40f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:38.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.131+0000 7f63a958d700 1 --2- 172.21.15.133:0/423771551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 0x7f63a40f6de0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6394004660 tx=0x7f6394009b30).stop 2024-02-15T18:24:38.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.131+0000 7f63a958d700 1 -- 172.21.15.133:0/423771551 shutdown_connections 2024-02-15T18:24:38.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.131+0000 7f63a958d700 1 --2- 172.21.15.133:0/423771551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63a40f7360 0x7f63a40f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:38.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.131+0000 7f63a958d700 1 --2- 172.21.15.133:0/423771551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 0x7f63a40f6de0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:38.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.131+0000 7f63a958d700 1 -- 172.21.15.133:0/423771551 >> 172.21.15.133:0/423771551 conn(0x7f63a40f02c0 msgr2=0x7f63a40f26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:38.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.131+0000 7f63a958d700 1 -- 172.21.15.133:0/423771551 shutdown_connections 2024-02-15T18:24:38.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.131+0000 7f63a958d700 1 -- 172.21.15.133:0/423771551 wait complete. 2024-02-15T18:24:38.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a958d700 1 Processor -- start 2024-02-15T18:24:38.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a958d700 1 -- start start 2024-02-15T18:24:38.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a958d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 0x7f63a4106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a958d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63a40f7360 0x7f63a4107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a958d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a41077e0 con 0x7f63a40f7360 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a958d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4107920 con 0x7f63a40f69c0 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 0x7f63a4106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 0x7f63a4106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60072/0 (socket says 172.21.15.133:60072) 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a2ffd700 1 -- 172.21.15.133:0/3333790862 learned_addr learned my addr 172.21.15.133:0/3333790862 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a27fc700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63a40f7360 0x7f63a4107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a2ffd700 1 -- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63a40f7360 msgr2=0x7f63a4107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a2ffd700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63a40f7360 0x7f63a4107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a2ffd700 1 -- 172.21.15.133:0/3333790862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6394005040 con 0x7f63a40f69c0 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.132+0000 7f63a2ffd700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 0x7f63a4106d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6394000c00 tx=0x7f639400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.133+0000 7f638b7fe700 1 -- 172.21.15.133:0/3333790862 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6394019070 con 0x7f63a40f69c0 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.133+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a410c360 con 0x7f63a40f69c0 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.133+0000 7f638b7fe700 1 -- 172.21.15.133:0/3333790862 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6394007e90 con 0x7f63a40f69c0 2024-02-15T18:24:38.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.133+0000 7f638b7fe700 1 -- 172.21.15.133:0/3333790862 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6394014db0 con 0x7f63a40f69c0 2024-02-15T18:24:38.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.133+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a410c920 con 0x7f63a40f69c0 2024-02-15T18:24:38.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.134+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a40fdcf0 con 0x7f63a40f69c0 2024-02-15T18:24:38.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.134+0000 7f638b7fe700 1 -- 172.21.15.133:0/3333790862 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6394025070 con 0x7f63a40f69c0 2024-02-15T18:24:38.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.134+0000 7f638b7fe700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f638c05c2b0 0x7f638c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:38.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.135+0000 7f638b7fe700 1 -- 172.21.15.133:0/3333790862 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f6394076ec0 con 0x7f63a40f69c0 2024-02-15T18:24:38.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.135+0000 7f63a27fc700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f638c05c2b0 0x7f638c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:38.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.135+0000 7f63a27fc700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f638c05c2b0 0x7f638c05e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f6398009fd0 tx=0x7f639800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:38.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.139+0000 7f638b7fe700 1 -- 172.21.15.133:0/3333790862 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6394049ac0 con 0x7f63a40f69c0 2024-02-15T18:24:38.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:36.405638+0000 mgr.smithi084.hjmnez (mgr.14162) 253 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:38.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:36.726257+0000 mon.smithi084 (mon.0) 553 : audit [DBG] from='client.? 172.21.15.84:0/3230267243' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T18:24:38.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.324+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f63a410d020 con 0x7f63a40f69c0 2024-02-15T18:24:38.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.325+0000 7f638b7fe700 1 -- 172.21.15.133:0/3333790862 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f639404d0e0 con 0x7f63a40f69c0 2024-02-15T18:24:38.324 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f638c05c2b0 msgr2=0x7f638c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f638c05c2b0 0x7f638c05e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f6398009fd0 tx=0x7f639800b040).stop 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 msgr2=0x7f63a4106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 0x7f63a4106d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6394000c00 tx=0x7f639400b040).stop 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 shutdown_connections 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f638c05c2b0 0x7f638c05e770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63a40f69c0 0x7f63a4106d40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 --2- 172.21.15.133:0/3333790862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63a40f7360 0x7f63a4107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 >> 172.21.15.133:0/3333790862 conn(0x7f63a40f02c0 msgr2=0x7f63a40f4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 shutdown_connections 2024-02-15T18:24:38.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-02-15T18:24:38.326+0000 7f63a958d700 1 -- 172.21.15.133:0/3333790862 wait complete. 2024-02-15T18:24:38.336 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-15T18:24:38.336 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-15T18:24:38.336 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-02-15T18:24:38.336 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-15T18:24:38.336 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-15T18:24:38.336 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-15T18:24:38.336 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-15T18:24:38.336 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-15T18:24:38.336 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-15T18:24:38.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:38.337 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:24:38.355 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-02-15T18:24:38.356 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:24:38.356 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:24:38.356 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-15T18:24:38.356 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:24:38.356 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-15T18:24:38.356 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41778sec preferred_lft 41778sec 2024-02-15T18:24:38.356 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2024-02-15T18:24:38.356 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:24:38.356 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-15T18:24:38.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:38.357 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-02-15T18:24:38.357 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-02-15T18:24:38.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2024-02-15T18:24:38.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2024-02-15T18:24:38.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2024-02-15T18:24:38.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-15T18:24:38.357 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-02-15T18:24:38.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:38.522 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-15T18:24:38.550 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-02-15T18:24:38.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:38.552 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-02-15T18:24:38.652 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-02-15T18:24:38.652 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-15T18:24:38.652 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-15T18:24:38.652 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-15T18:24:38.652 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-15T18:24:38.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:38.653 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-02-15T18:24:38.653 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-02-15T18:24:38.653 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-15T18:24:38.653 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-15T18:24:38.653 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-15T18:24:38.653 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-02-15T18:24:38.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:38.891 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-02-15T18:24:38.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:38.909 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2024-02-15T18:24:38.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:38.967 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-02-15T18:24:38.967 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-02-15T18:24:38.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-15T18:24:38.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-15T18:24:38.967 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-02-15T18:24:39.009 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:38.326111+0000 mon.smithi133 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.133:0/3333790862' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T18:24:39.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:38.326111+0000 mon.smithi133 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.133:0/3333790862' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T18:24:39.061 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-15T18:24:39.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:39.061 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-02-15T18:24:39.061 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-02-15T18:24:39.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-15T18:24:39.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-15T18:24:39.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-15T18:24:39.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-15T18:24:39.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-15T18:24:39.062 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-02-15T18:24:39.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:39.246 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-02-15T18:24:39.246 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-02-15T18:24:39.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-02-15T18:24:39.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2024-02-15T18:24:39.246 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-02-15T18:24:39.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:39.344 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.1 2024-02-15T18:24:39.361 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-02-15T18:24:39.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:24:39.469 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:24:39.469 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-02-15T18:24:39.490 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:24:39.490 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-02-15T18:24:39.493 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-15T18:24:39.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:24:39.493 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-15T18:24:40.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:38.406025+0000 mgr.smithi084.hjmnez (mgr.14162) 254 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:40.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:38.406025+0000 mgr.smithi084.hjmnez (mgr.14162) 254 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:24:42.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:41 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:40.406608+0000 mgr.smithi084.hjmnez (mgr.14162) 255 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:24:42.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:40.406608+0000 mgr.smithi084.hjmnez (mgr.14162) 255 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:24:42.402 INFO:teuthology.run_tasks:Running task print... 2024-02-15T18:24:42.413 INFO:teuthology.task.print:**** done client 2024-02-15T18:24:42.413 INFO:teuthology.run_tasks:Running task parallel... 2024-02-15T18:24:42.423 INFO:teuthology.task.parallel:starting parallel... 2024-02-15T18:24:42.423 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-15T18:24:42.424 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T18:24:42.424 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:24:42.424 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-15T18:24:42.425 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-15T18:24:42.425 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-15T18:24:42.428 INFO:tasks.workunit:Pulling workunits from ref bedfc49c6a823fb0ff75911e476e1f3cb464ad3e 2024-02-15T18:24:42.428 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-15T18:24:42.428 INFO:tasks.workunit:timeout=3h 2024-02-15T18:24:42.429 INFO:tasks.workunit:cleanup=True 2024-02-15T18:24:42.429 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-15T18:24:42.452 INFO:teuthology.orchestra.run.smithi084.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-15T18:24:42.452 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-15T18:24:42.452 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 95h/149d Inode: 1 Links: 2 2024-02-15T18:24:42.452 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:42.452 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:cephfs_t:s0 2024-02-15T18:24:42.452 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-15T18:24:42.452 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-02-15 18:24:08.283322422 +0000 2024-02-15T18:24:42.452 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-02-15 18:24:37.944166113 +0000 2024-02-15T18:24:42.452 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-02-15 18:24:08.283322422 +0000 2024-02-15T18:24:42.453 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-15T18:24:42.453 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-15T18:24:42.526 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-15T18:24:42.550 INFO:teuthology.orchestra.run.smithi133.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-15T18:24:42.550 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-02-15T18:24:42.550 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 7dh/125d Inode: 1 Links: 3 2024-02-15T18:24:42.550 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:42.550 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:cephfs_t:s0 2024-02-15T18:24:42.550 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-15T18:24:42.550 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-02-15 18:24:42.521087767 +0000 2024-02-15T18:24:42.550 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-02-15 18:24:42.521087767 +0000 2024-02-15T18:24:42.550 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-02-15T18:24:42.550 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-15T18:24:42.551 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-15T18:24:42.630 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ljflores/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bedfc49c6a823fb0ff75911e476e1f3cb464ad3e 2024-02-15T18:24:42.630 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ljflores/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout bedfc49c6a823fb0ff75911e476e1f3cb464ad3e 2024-02-15T18:24:42.649 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-15T18:24:42.691 INFO:tasks.workunit.client.1.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-15T18:24:44.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:42.407093+0000 mgr.smithi084.hjmnez (mgr.14162) 256 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 3.8 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-15T18:24:44.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:42.407093+0000 mgr.smithi084.hjmnez (mgr.14162) 256 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 3.8 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-15T18:24:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.641+0000 7f9cd9646700 1 -- 172.21.15.84:0/242554767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 msgr2=0x7f9cd40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.641+0000 7f9cd9646700 1 --2- 172.21.15.84:0/242554767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 0x7f9cd40f7de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f9cc4004660 tx=0x7f9cc4009b30).stop 2024-02-15T18:24:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.641+0000 7f9cd9646700 1 -- 172.21.15.84:0/242554767 shutdown_connections 2024-02-15T18:24:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.641+0000 7f9cd9646700 1 --2- 172.21.15.84:0/242554767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 0x7f9cd40f7de0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.641+0000 7f9cd9646700 1 --2- 172.21.15.84:0/242554767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd40f66e0 0x7f9cd40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.641+0000 7f9cd9646700 1 -- 172.21.15.84:0/242554767 >> 172.21.15.84:0/242554767 conn(0x7f9cd40f1e40 msgr2=0x7f9cd40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.641+0000 7f9cd9646700 1 -- 172.21.15.84:0/242554767 shutdown_connections 2024-02-15T18:24:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.641+0000 7f9cd9646700 1 -- 172.21.15.84:0/242554767 wait complete. 2024-02-15T18:24:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.642+0000 7f9cd9646700 1 Processor -- start 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.642+0000 7f9cd9646700 1 -- start start 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.642+0000 7f9cd9646700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd40f66e0 0x7f9cd4107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.642+0000 7f9cd9646700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 0x7f9cd4107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.642+0000 7f9cd9646700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4107ba0 con 0x7f9cd40f7980 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.642+0000 7f9cd9646700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4108450 con 0x7f9cd40f66e0 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.642+0000 7f9cd27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 0x7f9cd4107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.642+0000 7f9cd27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 0x7f9cd4107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48432/0 (socket says 172.21.15.84:48432) 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.642+0000 7f9cd27fc700 1 -- 172.21.15.84:0/2342796441 learned_addr learned my addr 172.21.15.84:0/2342796441 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.643+0000 7f9cd27fc700 1 -- 172.21.15.84:0/2342796441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd40f66e0 msgr2=0x7f9cd4107070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.643+0000 7f9cd27fc700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd40f66e0 0x7f9cd4107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.643+0000 7f9cd27fc700 1 -- 172.21.15.84:0/2342796441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4005040 con 0x7f9cd40f7980 2024-02-15T18:24:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.643+0000 7f9cd27fc700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 0x7f9cd4107560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f9cc4009830 tx=0x7f9cc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.643+0000 7f9cbb7fe700 1 -- 172.21.15.84:0/2342796441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc4018070 con 0x7f9cd40f7980 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.643+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd41086d0 con 0x7f9cd40f7980 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.643+0000 7f9cbb7fe700 1 -- 172.21.15.84:0/2342796441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cc4007d70 con 0x7f9cd40f7980 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.643+0000 7f9cbb7fe700 1 -- 172.21.15.84:0/2342796441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc401c620 con 0x7f9cd40f7980 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.643+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd4108c30 con 0x7f9cd40f7980 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.644+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd40f5ad0 con 0x7f9cd40f7980 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.644+0000 7f9cbb7fe700 1 -- 172.21.15.84:0/2342796441 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9cc401d980 con 0x7f9cd40f7980 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.645+0000 7f9cbb7fe700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cbc05c2b0 0x7f9cbc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.645+0000 7f9cbb7fe700 1 -- 172.21.15.84:0/2342796441 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9cc4077db0 con 0x7f9cd40f7980 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.645+0000 7f9cd2ffd700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cbc05c2b0 0x7f9cbc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.645+0000 7f9cd2ffd700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cbc05c2b0 0x7f9cbc05e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9cd40f77e0 tx=0x7f9cc8006ab0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.649+0000 7f9cbb7fe700 1 -- 172.21.15.84:0/2342796441 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9cc404aa10 con 0x7f9cd40f7980 2024-02-15T18:24:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.805+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f9cd4045ad0 con 0x7f9cd40f7980 2024-02-15T18:24:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.805+0000 7f9cbb7fe700 1 -- 172.21.15.84:0/2342796441 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v16)=0 v16) v1 ==== 155+0+0 (secure 0 0 0) 0x7f9cc404e030 con 0x7f9cd40f7980 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cbc05c2b0 msgr2=0x7f9cbc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cbc05c2b0 0x7f9cbc05e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9cd40f77e0 tx=0x7f9cc8006ab0).stop 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 msgr2=0x7f9cd4107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 0x7f9cd4107560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f9cc4009830 tx=0x7f9cc4009b30).stop 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 shutdown_connections 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cbc05c2b0 0x7f9cbc05e770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cd40f66e0 0x7f9cd4107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 --2- 172.21.15.84:0/2342796441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cd40f7980 0x7f9cd4107560 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 >> 172.21.15.84:0/2342796441 conn(0x7f9cd40f1e40 msgr2=0x7f9cd40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 shutdown_connections 2024-02-15T18:24:44.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:44.807+0000 7f9cd9646700 1 -- 172.21.15.84:0/2342796441 wait complete. 2024-02-15T18:24:45.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-15T18:24:45.968 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:44.407581+0000 mgr.smithi084.hjmnez (mgr.14162) 257 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 4.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:24:46.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:44.407581+0000 mgr.smithi084.hjmnez (mgr.14162) 257 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 4.1 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:24:47.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.628+0000 7fa417b06700 1 -- 172.21.15.84:0/3486759185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 msgr2=0x7fa4100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.628+0000 7fa417b06700 1 --2- 172.21.15.84:0/3486759185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 0x7fa4100f6cc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fa400004660 tx=0x7fa400009b30).stop 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.628+0000 7fa417b06700 1 -- 172.21.15.84:0/3486759185 shutdown_connections 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.628+0000 7fa417b06700 1 --2- 172.21.15.84:0/3486759185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 0x7fa4100f6cc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.628+0000 7fa417b06700 1 --2- 172.21.15.84:0/3486759185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4100f55c0 0x7fa4100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.628+0000 7fa417b06700 1 -- 172.21.15.84:0/3486759185 >> 172.21.15.84:0/3486759185 conn(0x7fa4100f0d40 msgr2=0x7fa4100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.628+0000 7fa417b06700 1 -- 172.21.15.84:0/3486759185 shutdown_connections 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.628+0000 7fa417b06700 1 -- 172.21.15.84:0/3486759185 wait complete. 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa417b06700 1 Processor -- start 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa417b06700 1 -- start start 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa417b06700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4100f55c0 0x7fa4100f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa417b06700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 0x7fa4100f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa417b06700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100f8100 con 0x7fa4100f6860 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa417b06700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100f8240 con 0x7fa4100f55c0 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa4150a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 0x7fa4100f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa4158a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4100f55c0 0x7fa4100f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa4150a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 0x7fa4100f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48450/0 (socket says 172.21.15.84:48450) 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa4150a1700 1 -- 172.21.15.84:0/234460580 learned_addr learned my addr 172.21.15.84:0/234460580 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa4150a1700 1 -- 172.21.15.84:0/234460580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4100f55c0 msgr2=0x7fa4100f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa4150a1700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4100f55c0 0x7fa4100f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa4150a1700 1 -- 172.21.15.84:0/234460580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400005040 con 0x7fa4100f6860 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.629+0000 7fa4150a1700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 0x7fa4100f7ba0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fa400009830 tx=0x7fa400009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.630+0000 7fa4067fc700 1 -- 172.21.15.84:0/234460580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa400018070 con 0x7fa4100f6860 2024-02-15T18:24:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.630+0000 7fa4067fc700 1 -- 172.21.15.84:0/234460580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa400007ba0 con 0x7fa4100f6860 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.630+0000 7fa4067fc700 1 -- 172.21.15.84:0/234460580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa40001c3c0 con 0x7fa4100f6860 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.630+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4100f84c0 con 0x7fa4100f6860 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.630+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4100f8a20 con 0x7fa4100f6860 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.631+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa410045ad0 con 0x7fa4100f6860 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.631+0000 7fa4067fc700 1 -- 172.21.15.84:0/234460580 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa400007d10 con 0x7fa4100f6860 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.631+0000 7fa4067fc700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3fc05c2b0 0x7fa3fc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.631+0000 7fa4067fc700 1 -- 172.21.15.84:0/234460580 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa400077b40 con 0x7fa4100f6860 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.631+0000 7fa4158a2700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3fc05c2b0 0x7fa3fc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.632+0000 7fa4158a2700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3fc05c2b0 0x7fa3fc05e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa4100f94b0 tx=0x7fa40c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:47.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.639+0000 7fa4067fc700 1 -- 172.21.15.84:0/234460580 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa40004a7a0 con 0x7fa4100f6860 2024-02-15T18:24:47.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.799+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fa4100fde90 con 0x7fa4100f6860 2024-02-15T18:24:47.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.799+0000 7fa4067fc700 1 -- 172.21.15.84:0/234460580 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v16)=0 v16) v1 ==== 163+0+0 (secure 0 0 0) 0x7fa40004ddc0 con 0x7fa4100f6860 2024-02-15T18:24:47.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3fc05c2b0 msgr2=0x7fa3fc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:47.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3fc05c2b0 0x7fa3fc05e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa4100f94b0 tx=0x7fa40c00b040).stop 2024-02-15T18:24:47.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 msgr2=0x7fa4100f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:47.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 0x7fa4100f7ba0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fa400009830 tx=0x7fa400009b30).stop 2024-02-15T18:24:47.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 shutdown_connections 2024-02-15T18:24:47.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fa3fc05c2b0 0x7fa3fc05e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:47.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4100f55c0 0x7fa4100f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:47.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 --2- 172.21.15.84:0/234460580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4100f6860 0x7fa4100f7ba0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:47.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 >> 172.21.15.84:0/234460580 conn(0x7fa4100f0d40 msgr2=0x7fa41005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:47.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 shutdown_connections 2024-02-15T18:24:47.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:47.801+0000 7fa417b06700 1 -- 172.21.15.84:0/234460580 wait complete. 2024-02-15T18:24:48.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:46.407945+0000 mgr.smithi084.hjmnez (mgr.14162) 258 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 9.2 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-15T18:24:48.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:46.407945+0000 mgr.smithi084.hjmnez (mgr.14162) 258 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 9.2 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-15T18:24:48.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-15T18:24:50.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:48.408312+0000 mgr.smithi084.hjmnez (mgr.14162) 259 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-15T18:24:50.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:48.408312+0000 mgr.smithi084.hjmnez (mgr.14162) 259 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-15T18:24:50.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.598+0000 7fdffc409700 1 -- 172.21.15.84:0/2786537088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 msgr2=0x7fdff40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:50.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.598+0000 7fdffc409700 1 --2- 172.21.15.84:0/2786537088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 0x7fdff40f7de0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fdfe8004660 tx=0x7fdfe8009b30).stop 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.598+0000 7fdffc409700 1 -- 172.21.15.84:0/2786537088 shutdown_connections 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.598+0000 7fdffc409700 1 --2- 172.21.15.84:0/2786537088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 0x7fdff40f7de0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.598+0000 7fdffc409700 1 --2- 172.21.15.84:0/2786537088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdff40f66e0 0x7fdff40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.598+0000 7fdffc409700 1 -- 172.21.15.84:0/2786537088 >> 172.21.15.84:0/2786537088 conn(0x7fdff40f1e40 msgr2=0x7fdff40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.598+0000 7fdffc409700 1 -- 172.21.15.84:0/2786537088 shutdown_connections 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.598+0000 7fdffc409700 1 -- 172.21.15.84:0/2786537088 wait complete. 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.598+0000 7fdffc409700 1 Processor -- start 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdffc409700 1 -- start start 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdffc409700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdff40f66e0 0x7fdff4107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdffc409700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 0x7fdff4107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdffc409700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4107b30 con 0x7fdff40f7980 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdffc409700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4107c70 con 0x7fdff40f66e0 2024-02-15T18:24:50.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff99a4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 0x7fdff4107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff99a4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 0x7fdff4107580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48464/0 (socket says 172.21.15.84:48464) 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff99a4700 1 -- 172.21.15.84:0/3501679191 learned_addr learned my addr 172.21.15.84:0/3501679191 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdffa1a5700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdff40f66e0 0x7fdff4107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff99a4700 1 -- 172.21.15.84:0/3501679191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdff40f66e0 msgr2=0x7fdff4107090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff99a4700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdff40f66e0 0x7fdff4107090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff99a4700 1 -- 172.21.15.84:0/3501679191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe8005040 con 0x7fdff40f7980 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdffa1a5700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdff40f66e0 0x7fdff4107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff99a4700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 0x7fdff4107580 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdfe8009830 tx=0x7fdfe8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff2ffd700 1 -- 172.21.15.84:0/3501679191 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe8018070 con 0x7fdff40f7980 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff41085b0 con 0x7fdff40f7980 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff2ffd700 1 -- 172.21.15.84:0/3501679191 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfe8007ba0 con 0x7fdff40f7980 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdff2ffd700 1 -- 172.21.15.84:0/3501679191 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe801c440 con 0x7fdff40f7980 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.599+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff4108b10 con 0x7fdff40f7980 2024-02-15T18:24:50.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.600+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff4045ad0 con 0x7fdff40f7980 2024-02-15T18:24:50.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.601+0000 7fdff2ffd700 1 -- 172.21.15.84:0/3501679191 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdfe801d420 con 0x7fdff40f7980 2024-02-15T18:24:50.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.601+0000 7fdff2ffd700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdfdc05c2b0 0x7fdfdc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:50.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.601+0000 7fdff2ffd700 1 -- 172.21.15.84:0/3501679191 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fdfe8077d30 con 0x7fdff40f7980 2024-02-15T18:24:50.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.601+0000 7fdffa1a5700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdfdc05c2b0 0x7fdfdc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:50.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.601+0000 7fdffa1a5700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdfdc05c2b0 0x7fdfdc05e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdff40f77e0 tx=0x7fdfec009c00).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:50.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.605+0000 7fdff2ffd700 1 -- 172.21.15.84:0/3501679191 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdfe804a9f0 con 0x7fdff40f7980 2024-02-15T18:24:50.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.761+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fdff4027a00 con 0x7fdff40f7980 2024-02-15T18:24:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.765+0000 7fdff2ffd700 1 -- 172.21.15.84:0/3501679191 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fdfe804a9f0 con 0x7fdff40f7980 2024-02-15T18:24:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.765+0000 7fdff2ffd700 1 -- 172.21.15.84:0/3501679191 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v17)=0 v17) v1 ==== 135+0+0 (secure 0 0 0) 0x7fdfe804e010 con 0x7fdff40f7980 2024-02-15T18:24:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.767+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdfdc05c2b0 msgr2=0x7fdfdc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.767+0000 7fdffc409700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdfdc05c2b0 0x7fdfdc05e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fdff40f77e0 tx=0x7fdfec009c00).stop 2024-02-15T18:24:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.767+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 msgr2=0x7fdff4107580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.767+0000 7fdffc409700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 0x7fdff4107580 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdfe8009830 tx=0x7fdfe8009b30).stop 2024-02-15T18:24:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.768+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 shutdown_connections 2024-02-15T18:24:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.768+0000 7fdffc409700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fdfdc05c2b0 0x7fdfdc05e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.768+0000 7fdffc409700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdff40f66e0 0x7fdff4107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.768+0000 7fdffc409700 1 --2- 172.21.15.84:0/3501679191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff40f7980 0x7fdff4107580 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.768+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 >> 172.21.15.84:0/3501679191 conn(0x7fdff40f1e40 msgr2=0x7fdff40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.768+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 shutdown_connections 2024-02-15T18:24:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:50.768+0000 7fdffc409700 1 -- 172.21.15.84:0/3501679191 wait complete. 2024-02-15T18:24:51.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-15T18:24:52.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:50.408615+0000 mgr.smithi084.hjmnez (mgr.14162) 260 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-15T18:24:52.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:50.766975+0000 mon.smithi084 (mon.0) 554 : audit [INF] from='client.? 172.21.15.84:0/3501679191' entity='client.admin' 2024-02-15T18:24:52.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:50.770198+0000 mon.smithi084 (mon.0) 555 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:52.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:51.130638+0000 mon.smithi084 (mon.0) 556 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:52.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:50.408615+0000 mgr.smithi084.hjmnez (mgr.14162) 260 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-15T18:24:52.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:50.766975+0000 mon.smithi084 (mon.0) 554 : audit [INF] from='client.? 172.21.15.84:0/3501679191' entity='client.admin' 2024-02-15T18:24:52.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:50.770198+0000 mon.smithi084 (mon.0) 555 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:52.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:51.130638+0000 mon.smithi084 (mon.0) 556 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.515+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3488169767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 msgr2=0x7f9cc80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.515+0000 7f9cce7b7700 1 --2- 172.21.15.84:0/3488169767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 0x7f9cc80f59e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9cb8004660 tx=0x7f9cb8009b30).stop 2024-02-15T18:24:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.515+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3488169767 shutdown_connections 2024-02-15T18:24:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.515+0000 7f9cce7b7700 1 --2- 172.21.15.84:0/3488169767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc80f6860 0x7f9cc80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.515+0000 7f9cce7b7700 1 --2- 172.21.15.84:0/3488169767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 0x7f9cc80f59e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.515+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3488169767 >> 172.21.15.84:0/3488169767 conn(0x7f9cc80f0d40 msgr2=0x7f9cc80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.515+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3488169767 shutdown_connections 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.515+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3488169767 wait complete. 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.516+0000 7f9cce7b7700 1 Processor -- start 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.516+0000 7f9cce7b7700 1 -- start start 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.516+0000 7f9cce7b7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 0x7f9cc8109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.516+0000 7f9cce7b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc80f6860 0x7f9cc810c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.516+0000 7f9cce7b7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80603e0 con 0x7f9cc80f55c0 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.516+0000 7f9cce7b7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8060520 con 0x7f9cc80f6860 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.516+0000 7f9cc7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 0x7f9cc8109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.516+0000 7f9cc7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 0x7f9cc8109d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36934/0 (socket says 172.21.15.84:36934) 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.516+0000 7f9cc7fff700 1 -- 172.21.15.84:0/3002596639 learned_addr learned my addr 172.21.15.84:0/3002596639 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cc77fe700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc80f6860 0x7f9cc810c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cc7fff700 1 -- 172.21.15.84:0/3002596639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc80f6860 msgr2=0x7f9cc810c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cc7fff700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc80f6860 0x7f9cc810c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cc7fff700 1 -- 172.21.15.84:0/3002596639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8005040 con 0x7f9cc80f55c0 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cc7fff700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 0x7f9cc8109d00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f9cb8013fd0 tx=0x7f9cb8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cc4ff9700 1 -- 172.21.15.84:0/3002596639 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb8018070 con 0x7f9cc80f55c0 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc810c750 con 0x7f9cc80f55c0 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cc4ff9700 1 -- 172.21.15.84:0/3002596639 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9cb8007d70 con 0x7f9cc80f55c0 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cc4ff9700 1 -- 172.21.15.84:0/3002596639 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb801c620 con 0x7f9cc80f55c0 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.517+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc810ccb0 con 0x7f9cc80f55c0 2024-02-15T18:24:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.518+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc8045ad0 con 0x7f9cc80f55c0 2024-02-15T18:24:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.518+0000 7f9cc4ff9700 1 -- 172.21.15.84:0/3002596639 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9cb801d420 con 0x7f9cc80f55c0 2024-02-15T18:24:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.519+0000 7f9cc4ff9700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cb005c2b0 0x7f9cb005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.519+0000 7f9cc4ff9700 1 -- 172.21.15.84:0/3002596639 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9cb8077d60 con 0x7f9cc80f55c0 2024-02-15T18:24:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.519+0000 7f9cc77fe700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cb005c2b0 0x7f9cb005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.519+0000 7f9cc77fe700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cb005c2b0 0x7f9cb005e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9cbc007fd0 tx=0x7f9cbc009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:53.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.523+0000 7f9cc4ff9700 1 -- 172.21.15.84:0/3002596639 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9cb804aa20 con 0x7f9cc80f55c0 2024-02-15T18:24:53.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.708+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cc80fe040 con 0x7f9cb005c2b0 2024-02-15T18:24:53.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.713+0000 7f9cc4ff9700 1 -- 172.21.15.84:0/3002596639 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f9cbc0045e0 con 0x7f9cb005c2b0 2024-02-15T18:24:53.712 INFO:teuthology.orchestra.run.smithi084.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:24:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.714+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cb005c2b0 msgr2=0x7f9cb005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.714+0000 7f9cce7b7700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cb005c2b0 0x7f9cb005e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9cbc007fd0 tx=0x7f9cbc009040).stop 2024-02-15T18:24:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.714+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 msgr2=0x7f9cc8109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.714+0000 7f9cce7b7700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 0x7f9cc8109d00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f9cb8013fd0 tx=0x7f9cb8009b30).stop 2024-02-15T18:24:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.714+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 shutdown_connections 2024-02-15T18:24:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.715+0000 7f9cce7b7700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f9cb005c2b0 0x7f9cb005e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.715+0000 7f9cce7b7700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc80f55c0 0x7f9cc8109d00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:53.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.715+0000 7f9cce7b7700 1 --2- 172.21.15.84:0/3002596639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc80f6860 0x7f9cc810c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.715+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 >> 172.21.15.84:0/3002596639 conn(0x7f9cc80f0d40 msgr2=0x7f9cc80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.715+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 shutdown_connections 2024-02-15T18:24:53.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:53.715+0000 7f9cce7b7700 1 -- 172.21.15.84:0/3002596639 wait complete. 2024-02-15T18:24:54.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:52.409046+0000 mgr.smithi084.hjmnez (mgr.14162) 261 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-15T18:24:54.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:53.714636+0000 mon.smithi084 (mon.0) 557 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:54.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:53.715144+0000 mon.smithi084 (mon.0) 558 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:54.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:53.719801+0000 mon.smithi084 (mon.0) 559 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:54.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:52.409046+0000 mgr.smithi084.hjmnez (mgr.14162) 261 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-15T18:24:54.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:53.714636+0000 mon.smithi084 (mon.0) 557 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:54.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:53.715144+0000 mon.smithi084 (mon.0) 558 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:54.145 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:53.719801+0000 mon.smithi084 (mon.0) 559 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:24:54.511 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T18:24:54.511 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:24:54.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; sleep 30 ; done' 2024-02-15T18:24:55.026 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:53.711017+0000 mgr.smithi084.hjmnez (mgr.14162) 262 : audit [DBG] from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:55.026 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:24:53.711550+0000 mgr.smithi084.hjmnez (mgr.14162) 263 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:24:55.026 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:24:53.722655+0000 mgr.smithi084.hjmnez (mgr.14162) 264 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:24:55.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:53.711017+0000 mgr.smithi084.hjmnez (mgr.14162) 262 : audit [DBG] from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:55.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:24:53.711550+0000 mgr.smithi084.hjmnez (mgr.14162) 263 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:24:55.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:24:53.722655+0000 mgr.smithi084.hjmnez (mgr.14162) 264 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:24:56.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:54.409572+0000 mgr.smithi084.hjmnez (mgr.14162) 265 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-15T18:24:56.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:54.409572+0000 mgr.smithi084.hjmnez (mgr.14162) 265 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-15T18:24:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.581+0000 7f48b9617700 1 -- 172.21.15.84:0/3755250825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f6860 msgr2=0x7f48b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.581+0000 7f48b9617700 1 --2- 172.21.15.84:0/3755250825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f6860 0x7f48b40f6cc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f48a8004660 tx=0x7f48a8009b30).stop 2024-02-15T18:24:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.581+0000 7f48b9617700 1 -- 172.21.15.84:0/3755250825 shutdown_connections 2024-02-15T18:24:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.581+0000 7f48b9617700 1 --2- 172.21.15.84:0/3755250825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f6860 0x7f48b40f6cc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.581+0000 7f48b9617700 1 --2- 172.21.15.84:0/3755250825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b40f55c0 0x7f48b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.581+0000 7f48b9617700 1 -- 172.21.15.84:0/3755250825 >> 172.21.15.84:0/3755250825 conn(0x7f48b40f0d40 msgr2=0x7f48b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.581+0000 7f48b9617700 1 -- 172.21.15.84:0/3755250825 shutdown_connections 2024-02-15T18:24:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.581+0000 7f48b9617700 1 -- 172.21.15.84:0/3755250825 wait complete. 2024-02-15T18:24:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.582+0000 7f48b9617700 1 Processor -- start 2024-02-15T18:24:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.582+0000 7f48b9617700 1 -- start start 2024-02-15T18:24:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.582+0000 7f48b9617700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f55c0 0x7f48b4109da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.582+0000 7f48b9617700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b40f6860 0x7f48b410c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.582+0000 7f48b9617700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4060450 con 0x7f48b40f55c0 2024-02-15T18:24:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.582+0000 7f48b9617700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4060590 con 0x7f48b40f6860 2024-02-15T18:24:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.582+0000 7f48b2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f55c0 0x7f48b4109da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.582+0000 7f48b2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f55c0 0x7f48b4109da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36956/0 (socket says 172.21.15.84:36956) 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.582+0000 7f48b2ffd700 1 -- 172.21.15.84:0/554162628 learned_addr learned my addr 172.21.15.84:0/554162628 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f48b27fc700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b40f6860 0x7f48b410c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f48b2ffd700 1 -- 172.21.15.84:0/554162628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b40f6860 msgr2=0x7f48b410c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f48b2ffd700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b40f6860 0x7f48b410c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f48b2ffd700 1 -- 172.21.15.84:0/554162628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8005040 con 0x7f48b40f55c0 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f48b2ffd700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f55c0 0x7f48b4109da0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f48a40093f0 tx=0x7f48a4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f489b7fe700 1 -- 172.21.15.84:0/554162628 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a4013640 con 0x7f48b40f55c0 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b410c8b0 con 0x7f48b40f55c0 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f489b7fe700 1 -- 172.21.15.84:0/554162628 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f48a4013c90 con 0x7f48b40f55c0 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f489b7fe700 1 -- 172.21.15.84:0/554162628 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a4012e70 con 0x7f48b40f55c0 2024-02-15T18:24:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.583+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b410cdf0 con 0x7f48b40f55c0 2024-02-15T18:24:56.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.585+0000 7f489b7fe700 1 -- 172.21.15.84:0/554162628 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f48a401a060 con 0x7f48b40f55c0 2024-02-15T18:24:56.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.585+0000 7f489b7fe700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f489c05c2b0 0x7f489c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:56.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.586+0000 7f489b7fe700 1 -- 172.21.15.84:0/554162628 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f48a4075430 con 0x7f48b40f55c0 2024-02-15T18:24:56.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.586+0000 7f48b27fc700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f489c05c2b0 0x7f489c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:56.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.586+0000 7f48b27fc700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f489c05c2b0 0x7f489c05e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f48a8009f50 tx=0x7f48a8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:56.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.587+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4894004fa0 con 0x7f48b40f55c0 2024-02-15T18:24:56.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.591+0000 7f489b7fe700 1 -- 172.21.15.84:0/554162628 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f48a404ba90 con 0x7f48b40f55c0 2024-02-15T18:24:56.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.833+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4894002a40 con 0x7f489c05c2b0 2024-02-15T18:24:56.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.834+0000 7f489b7fe700 1 -- 172.21.15.84:0/554162628 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f4894002a40 con 0x7f489c05c2b0 2024-02-15T18:24:56.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.836+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f489c05c2b0 msgr2=0x7f489c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:56.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.836+0000 7f48b9617700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f489c05c2b0 0x7f489c05e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f48a8009f50 tx=0x7f48a8009b30).stop 2024-02-15T18:24:56.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.837+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f55c0 msgr2=0x7f48b4109da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:56.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.837+0000 7f48b9617700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f55c0 0x7f48b4109da0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f48a40093f0 tx=0x7f48a4006ec0).stop 2024-02-15T18:24:56.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.837+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 shutdown_connections 2024-02-15T18:24:56.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.837+0000 7f48b9617700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f489c05c2b0 0x7f489c05e770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:56.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.837+0000 7f48b9617700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48b40f55c0 0x7f48b4109da0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:56.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.837+0000 7f48b9617700 1 --2- 172.21.15.84:0/554162628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b40f6860 0x7f48b410c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:56.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.837+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 >> 172.21.15.84:0/554162628 conn(0x7f48b40f0d40 msgr2=0x7f48b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:56.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.837+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 shutdown_connections 2024-02-15T18:24:56.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.837+0000 7f48b9617700 1 -- 172.21.15.84:0/554162628 wait complete. 2024-02-15T18:24:56.847 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:24:56.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.960+0000 7f706a99a700 1 -- 172.21.15.84:0/1166336006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f55c0 msgr2=0x7f70640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.960+0000 7f706a99a700 1 --2- 172.21.15.84:0/1166336006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f55c0 0x7f70640f59e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f7054004660 tx=0x7f7054009b30).stop 2024-02-15T18:24:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.960+0000 7f706a99a700 1 -- 172.21.15.84:0/1166336006 shutdown_connections 2024-02-15T18:24:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.960+0000 7f706a99a700 1 --2- 172.21.15.84:0/1166336006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70640f6860 0x7f70640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.960+0000 7f706a99a700 1 --2- 172.21.15.84:0/1166336006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f55c0 0x7f70640f59e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.960+0000 7f706a99a700 1 -- 172.21.15.84:0/1166336006 >> 172.21.15.84:0/1166336006 conn(0x7f70640f0d40 msgr2=0x7f70640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.960+0000 7f706a99a700 1 -- 172.21.15.84:0/1166336006 shutdown_connections 2024-02-15T18:24:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.960+0000 7f706a99a700 1 -- 172.21.15.84:0/1166336006 wait complete. 2024-02-15T18:24:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.960+0000 7f706a99a700 1 Processor -- start 2024-02-15T18:24:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f706a99a700 1 -- start start 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f706a99a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70640f55c0 0x7f706410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f706a99a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f6860 0x7f706410e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f706a99a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640602b0 con 0x7f70640f6860 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f706a99a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640603f0 con 0x7f70640f55c0 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f70637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f6860 0x7f706410e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f70637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f6860 0x7f706410e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36982/0 (socket says 172.21.15.84:36982) 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f70637fe700 1 -- 172.21.15.84:0/2292795870 learned_addr learned my addr 172.21.15.84:0/2292795870 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f7063fff700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70640f55c0 0x7f706410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f70637fe700 1 -- 172.21.15.84:0/2292795870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70640f55c0 msgr2=0x7f706410c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f70637fe700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70640f55c0 0x7f706410c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.961+0000 7f70637fe700 1 -- 172.21.15.84:0/2292795870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054005040 con 0x7f70640f6860 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.962+0000 7f70637fe700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f6860 0x7f706410e6b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f705800b410 tx=0x7f7058006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.962+0000 7f7060ff9700 1 -- 172.21.15.84:0/2292795870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70580125f0 con 0x7f70640f6860 2024-02-15T18:24:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.962+0000 7f7060ff9700 1 -- 172.21.15.84:0/2292795870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f705800be30 con 0x7f70640f6860 2024-02-15T18:24:56.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.962+0000 7f7060ff9700 1 -- 172.21.15.84:0/2292795870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7058002b70 con 0x7f70640f6860 2024-02-15T18:24:56.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.962+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706410eba0 con 0x7f70640f6860 2024-02-15T18:24:56.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.962+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706410f000 con 0x7f70640f6860 2024-02-15T18:24:56.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.963+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70640f49b0 con 0x7f70640f6860 2024-02-15T18:24:56.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.970+0000 7f7060ff9700 1 -- 172.21.15.84:0/2292795870 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f705800f030 con 0x7f70640f6860 2024-02-15T18:24:56.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.971+0000 7f7060ff9700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f704c05c2b0 0x7f704c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:56.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.971+0000 7f7060ff9700 1 -- 172.21.15.84:0/2292795870 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7058076630 con 0x7f70640f6860 2024-02-15T18:24:56.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.971+0000 7f7063fff700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f704c05c2b0 0x7f704c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:56.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.971+0000 7f7063fff700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f704c05c2b0 0x7f704c05e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7064060040 tx=0x7f7054009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:56.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:56.972+0000 7f7060ff9700 1 -- 172.21.15.84:0/2292795870 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7058049320 con 0x7f70640f6860 2024-02-15T18:24:57.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.237+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70640fdff0 con 0x7f704c05c2b0 2024-02-15T18:24:57.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.238+0000 7f7060ff9700 1 -- 172.21.15.84:0/2292795870 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f70640fdff0 con 0x7f704c05c2b0 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.239+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f704c05c2b0 msgr2=0x7f704c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.239+0000 7f706a99a700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f704c05c2b0 0x7f704c05e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7064060040 tx=0x7f7054009b30).stop 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.240+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f6860 msgr2=0x7f706410e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.240+0000 7f706a99a700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f6860 0x7f706410e6b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f705800b410 tx=0x7f7058006ef0).stop 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.240+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 shutdown_connections 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.240+0000 7f706a99a700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f704c05c2b0 0x7f704c05e770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.240+0000 7f706a99a700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70640f55c0 0x7f706410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.240+0000 7f706a99a700 1 --2- 172.21.15.84:0/2292795870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70640f6860 0x7f706410e6b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.240+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 >> 172.21.15.84:0/2292795870 conn(0x7f70640f0d40 msgr2=0x7f70640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:57.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.240+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 shutdown_connections 2024-02-15T18:24:57.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.240+0000 7f706a99a700 1 -- 172.21.15.84:0/2292795870 wait complete. 2024-02-15T18:24:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.361+0000 7f42fb20e700 1 -- 172.21.15.84:0/175563781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 msgr2=0x7f42f40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.361+0000 7f42fb20e700 1 --2- 172.21.15.84:0/175563781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 0x7f42f40f5850 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f42f0004660 tx=0x7f42f0009b30).stop 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.361+0000 7f42fb20e700 1 -- 172.21.15.84:0/175563781 shutdown_connections 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.361+0000 7f42fb20e700 1 --2- 172.21.15.84:0/175563781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f40f66d0 0x7f42f40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.361+0000 7f42fb20e700 1 --2- 172.21.15.84:0/175563781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 0x7f42f40f5850 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.361+0000 7f42fb20e700 1 -- 172.21.15.84:0/175563781 >> 172.21.15.84:0/175563781 conn(0x7f42f40f0b90 msgr2=0x7f42f40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.362+0000 7f42fb20e700 1 -- 172.21.15.84:0/175563781 shutdown_connections 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.362+0000 7f42fb20e700 1 -- 172.21.15.84:0/175563781 wait complete. 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.362+0000 7f42fb20e700 1 Processor -- start 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.362+0000 7f42fb20e700 1 -- start start 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.362+0000 7f42fb20e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 0x7f42f4106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.362+0000 7f42fb20e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f40f66d0 0x7f42f41073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.362+0000 7f42fb20e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4107960 con 0x7f42f40f5430 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fb20e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4108160 con 0x7f42f40f66d0 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fa20c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 0x7f42f4106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fa20c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 0x7f42f4106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37004/0 (socket says 172.21.15.84:37004) 2024-02-15T18:24:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fa20c700 1 -- 172.21.15.84:0/3189902424 learned_addr learned my addr 172.21.15.84:0/3189902424 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fa20c700 1 -- 172.21.15.84:0/3189902424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f40f66d0 msgr2=0x7f42f41073b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-15T18:24:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fa20c700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f40f66d0 0x7f42f41073b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fa20c700 1 -- 172.21.15.84:0/3189902424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0005040 con 0x7f42f40f5430 2024-02-15T18:24:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fa20c700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 0x7f42f4106ec0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f42f0004e30 tx=0x7f42f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42eaffd700 1 -- 172.21.15.84:0/3189902424 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f0018070 con 0x7f42f40f5430 2024-02-15T18:24:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f41083e0 con 0x7f42f40f5430 2024-02-15T18:24:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42eaffd700 1 -- 172.21.15.84:0/3189902424 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f42f0007ba0 con 0x7f42f40f5430 2024-02-15T18:24:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42eaffd700 1 -- 172.21.15.84:0/3189902424 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f001c620 con 0x7f42f40f5430 2024-02-15T18:24:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.363+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f4108940 con 0x7f42f40f5430 2024-02-15T18:24:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.364+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f4059100 con 0x7f42f40f5430 2024-02-15T18:24:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.365+0000 7f42eaffd700 1 -- 172.21.15.84:0/3189902424 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f42f001d9a0 con 0x7f42f40f5430 2024-02-15T18:24:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.366+0000 7f42eaffd700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f42e005c300 0x7f42e005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.366+0000 7f42eaffd700 1 -- 172.21.15.84:0/3189902424 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f42f0078280 con 0x7f42f40f5430 2024-02-15T18:24:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.366+0000 7f42f9a0b700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f42e005c300 0x7f42e005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:57.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.366+0000 7f42f9a0b700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f42e005c300 0x7f42e005e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f42e4004a10 tx=0x7f42e40099e0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:57.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.370+0000 7f42eaffd700 1 -- 172.21.15.84:0/3189902424 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f42f004b030 con 0x7f42f40f5430 2024-02-15T18:24:57.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.636+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f42f405fd30 con 0x7f42e005c300 2024-02-15T18:24:57.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.644+0000 7f42eaffd700 1 -- 172.21.15.84:0/3189902424 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7f42f405fd30 con 0x7f42e005c300 2024-02-15T18:24:57.644 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2024-02-15T18:24:57.644 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (4m) 23s ago 6m 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:24:57.644 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (5m) 23s ago 5m 16.2.4 8d91d370c2b8 cfe2961e55e3 2024-02-15T18:24:57.644 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (5m) 31s ago 5m 16.2.4 8d91d370c2b8 d52ceb5fe65b 2024-02-15T18:24:57.644 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (4m) 23s ago 5m 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:24:57.644 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (47s) 23s ago 47s 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:24:57.644 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (41s) 23s ago 40s 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:24:57.644 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (50s) 31s ago 50s 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:24:57.644 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (45s) 31s ago 44s 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:9283 running (7m) 23s ago 7m 16.2.4 8d91d370c2b8 f9dec188dcb9 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (5m) 31s ago 4m 16.2.4 8d91d370c2b8 802b41cf2bac 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (7m) 23s ago 7m 16.2.4 8d91d370c2b8 77f1f72e867c 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (4m) 31s ago 4m 16.2.4 8d91d370c2b8 c65c0defe0dd 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (5m) 23s ago 5m 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (4m) 31s ago 4m 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 23s ago 4m 16.2.4 8d91d370c2b8 20023f9a2292 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 23s ago 3m 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 23s ago 3m 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (3m) 31s ago 3m 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (2m) 31s ago 2m 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:24:57.645 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (2m) 31s ago 2m 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:24:57.646 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (4m) 23s ago 5m 2.18.1 de242295e225 c3f4635db4df 2024-02-15T18:24:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f42e005c300 msgr2=0x7f42e005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f42e005c300 0x7f42e005e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f42e4004a10 tx=0x7f42e40099e0).stop 2024-02-15T18:24:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 msgr2=0x7f42f4106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 0x7f42f4106ec0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f42f0004e30 tx=0x7f42f0009b30).stop 2024-02-15T18:24:57.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 shutdown_connections 2024-02-15T18:24:57.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f42e005c300 0x7f42e005e7c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42f40f5430 0x7f42f4106ec0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 --2- 172.21.15.84:0/3189902424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f40f66d0 0x7f42f41073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:57.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 >> 172.21.15.84:0/3189902424 conn(0x7f42f40f0b90 msgr2=0x7f42f405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:57.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 shutdown_connections 2024-02-15T18:24:57.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.646+0000 7f42fb20e700 1 -- 172.21.15.84:0/3189902424 wait complete. 2024-02-15T18:24:57.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.769+0000 7fe639dde700 1 -- 172.21.15.84:0/1000140289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 msgr2=0x7fe6340f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:57.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.769+0000 7fe639dde700 1 --2- 172.21.15.84:0/1000140289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 0x7fe6340f63e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe628004770 tx=0x7fe62800ac40).stop 2024-02-15T18:24:57.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.769+0000 7fe639dde700 1 -- 172.21.15.84:0/1000140289 shutdown_connections 2024-02-15T18:24:57.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.769+0000 7fe639dde700 1 --2- 172.21.15.84:0/1000140289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 0x7fe6340f63e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.769+0000 7fe639dde700 1 --2- 172.21.15.84:0/1000140289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6340f4d60 0x7fe6340f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.769+0000 7fe639dde700 1 -- 172.21.15.84:0/1000140289 >> 172.21.15.84:0/1000140289 conn(0x7fe6340f04c0 msgr2=0x7fe6340f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.770+0000 7fe639dde700 1 -- 172.21.15.84:0/1000140289 shutdown_connections 2024-02-15T18:24:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.770+0000 7fe639dde700 1 -- 172.21.15.84:0/1000140289 wait complete. 2024-02-15T18:24:57.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.770+0000 7fe639dde700 1 Processor -- start 2024-02-15T18:24:57.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.770+0000 7fe639dde700 1 -- start start 2024-02-15T18:24:57.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe639dde700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6340f4d60 0x7fe634104e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe639dde700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 0x7fe634105380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe639dde700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe634105930 con 0x7fe6340f5f60 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe639dde700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe634105a70 con 0x7fe6340f4d60 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe632ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 0x7fe634105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe632ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 0x7fe634105380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37012/0 (socket says 172.21.15.84:37012) 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe632ffd700 1 -- 172.21.15.84:0/1619257278 learned_addr learned my addr 172.21.15.84:0/1619257278 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe6337fe700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6340f4d60 0x7fe634104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe632ffd700 1 -- 172.21.15.84:0/1619257278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6340f4d60 msgr2=0x7fe634104e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe632ffd700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6340f4d60 0x7fe634104e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe632ffd700 1 -- 172.21.15.84:0/1619257278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628005040 con 0x7fe6340f5f60 2024-02-15T18:24:57.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe632ffd700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 0x7fe634105380 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe628000c00 tx=0x7fe62800ac40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe61bfff700 1 -- 172.21.15.84:0/1619257278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe62800f030 con 0x7fe6340f5f60 2024-02-15T18:24:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6341063b0 con 0x7fe6340f5f60 2024-02-15T18:24:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe61bfff700 1 -- 172.21.15.84:0/1619257278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fe628004180 con 0x7fe6340f5f60 2024-02-15T18:24:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.771+0000 7fe61bfff700 1 -- 172.21.15.84:0/1619257278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe628019070 con 0x7fe6340f5f60 2024-02-15T18:24:57.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.772+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe634106910 con 0x7fe6340f5f60 2024-02-15T18:24:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.773+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe634045ad0 con 0x7fe6340f5f60 2024-02-15T18:24:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.773+0000 7fe61bfff700 1 -- 172.21.15.84:0/1619257278 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe628025060 con 0x7fe6340f5f60 2024-02-15T18:24:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.774+0000 7fe61bfff700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe61c05e500 0x7fe61c0609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.774+0000 7fe61bfff700 1 -- 172.21.15.84:0/1619257278 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe628077590 con 0x7fe6340f5f60 2024-02-15T18:24:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.774+0000 7fe6337fe700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe61c05e500 0x7fe61c0609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.774+0000 7fe6337fe700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe61c05e500 0x7fe61c0609c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe624007fd0 tx=0x7fe624009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:57.778+0000 7fe61bfff700 1 -- 172.21.15.84:0/1619257278 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe62804a250 con 0x7fe6340f5f60 2024-02-15T18:24:58.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:56.409961+0000 mgr.smithi084.hjmnez (mgr.14162) 266 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-15T18:24:58.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:56.836350+0000 mgr.smithi084.hjmnez (mgr.14162) 267 : audit [DBG] from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:58.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:57.239677+0000 mgr.smithi084.hjmnez (mgr.14162) 268 : audit [DBG] from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:58.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.047+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe634027a00 con 0x7fe6340f5f60 2024-02-15T18:24:58.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.048+0000 7fe61bfff700 1 -- 172.21.15.84:0/1619257278 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7fe62804d870 con 0x7fe6340f5f60 2024-02-15T18:24:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:24:58.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:24:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:24:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2024-02-15T18:24:58.049 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:24:58.049 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:24:58.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe61c05e500 msgr2=0x7fe61c0609c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe61c05e500 0x7fe61c0609c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fe624007fd0 tx=0x7fe624009040).stop 2024-02-15T18:24:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 msgr2=0x7fe634105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 0x7fe634105380 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe628000c00 tx=0x7fe62800ac40).stop 2024-02-15T18:24:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 shutdown_connections 2024-02-15T18:24:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fe61c05e500 0x7fe61c0609c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6340f4d60 0x7fe634104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 --2- 172.21.15.84:0/1619257278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6340f5f60 0x7fe634105380 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 >> 172.21.15.84:0/1619257278 conn(0x7fe6340f04c0 msgr2=0x7fe6340f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 shutdown_connections 2024-02-15T18:24:58.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.050+0000 7fe639dde700 1 -- 172.21.15.84:0/1619257278 wait complete. 2024-02-15T18:24:58.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:56.409961+0000 mgr.smithi084.hjmnez (mgr.14162) 266 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-15T18:24:58.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:56.836350+0000 mgr.smithi084.hjmnez (mgr.14162) 267 : audit [DBG] from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:58.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:57.239677+0000 mgr.smithi084.hjmnez (mgr.14162) 268 : audit [DBG] from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.167+0000 7fde20557700 1 -- 172.21.15.84:0/3525319221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f49a0 msgr2=0x7fde180f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.167+0000 7fde20557700 1 --2- 172.21.15.84:0/3525319221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f49a0 0x7fde180f4dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fde14004660 tx=0x7fde14009b30).stop 2024-02-15T18:24:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.167+0000 7fde20557700 1 -- 172.21.15.84:0/3525319221 shutdown_connections 2024-02-15T18:24:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.167+0000 7fde20557700 1 --2- 172.21.15.84:0/3525319221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde180f5340 0x7fde180f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.167+0000 7fde20557700 1 --2- 172.21.15.84:0/3525319221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f49a0 0x7fde180f4dc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.167+0000 7fde20557700 1 -- 172.21.15.84:0/3525319221 >> 172.21.15.84:0/3525319221 conn(0x7fde180f04c0 msgr2=0x7fde180f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.167+0000 7fde20557700 1 -- 172.21.15.84:0/3525319221 shutdown_connections 2024-02-15T18:24:58.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde20557700 1 -- 172.21.15.84:0/3525319221 wait complete. 2024-02-15T18:24:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde20557700 1 Processor -- start 2024-02-15T18:24:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde20557700 1 -- start start 2024-02-15T18:24:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde20557700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde180f49a0 0x7fde18107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde20557700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f5340 0x7fde18107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde20557700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18107b00 con 0x7fde180f5340 2024-02-15T18:24:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde20557700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18107c40 con 0x7fde180f49a0 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde1daf2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f5340 0x7fde18107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde1daf2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f5340 0x7fde18107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37036/0 (socket says 172.21.15.84:37036) 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde1daf2700 1 -- 172.21.15.84:0/1148498508 learned_addr learned my addr 172.21.15.84:0/1148498508 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.168+0000 7fde1e2f3700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde180f49a0 0x7fde18107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.169+0000 7fde1daf2700 1 -- 172.21.15.84:0/1148498508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde180f49a0 msgr2=0x7fde18107060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.169+0000 7fde1daf2700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde180f49a0 0x7fde18107060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.169+0000 7fde1daf2700 1 -- 172.21.15.84:0/1148498508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde14005040 con 0x7fde180f5340 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.169+0000 7fde1daf2700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f5340 0x7fde18107550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fde08002700 tx=0x7fde08009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.169+0000 7fde0effd700 1 -- 172.21.15.84:0/1148498508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde080079c0 con 0x7fde180f5340 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.169+0000 7fde0effd700 1 -- 172.21.15.84:0/1148498508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fde0800f040 con 0x7fde180f5340 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.169+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde181085e0 con 0x7fde180f5340 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.169+0000 7fde0effd700 1 -- 172.21.15.84:0/1148498508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde080148c0 con 0x7fde180f5340 2024-02-15T18:24:58.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.169+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde18108ba0 con 0x7fde180f5340 2024-02-15T18:24:58.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.170+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde18045ad0 con 0x7fde180f5340 2024-02-15T18:24:58.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.171+0000 7fde0effd700 1 -- 172.21.15.84:0/1148498508 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fde0801b060 con 0x7fde180f5340 2024-02-15T18:24:58.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.171+0000 7fde0effd700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fde0405c2b0 0x7fde0405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:58.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.172+0000 7fde0effd700 1 -- 172.21.15.84:0/1148498508 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fde08075c50 con 0x7fde180f5340 2024-02-15T18:24:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.172+0000 7fde1e2f3700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fde0405c2b0 0x7fde0405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.172+0000 7fde1e2f3700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fde0405c2b0 0x7fde0405e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fde14004630 tx=0x7fde14009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:58.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.179+0000 7fde0effd700 1 -- 172.21.15.84:0/1148498508 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fde08048990 con 0x7fde180f5340 2024-02-15T18:24:58.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.418+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fde18108770 con 0x7fde180f5340 2024-02-15T18:24:58.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.418+0000 7fde0effd700 1 -- 172.21.15.84:0/1148498508 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1626 (secure 0 0 0) 0x7fde18108770 con 0x7fde180f5340 2024-02-15T18:24:58.418 INFO:teuthology.orchestra.run.smithi084.stdout:e14 2024-02-15T18:24:58.418 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:24:58.418 INFO:teuthology.orchestra.run.smithi084.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:24:58.418 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:24:58.418 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:58.418 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 13 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:24:22.906819+0000 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:24:58.419 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261]] 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091]] 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:58.420 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:24:58.421 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:24:58.421 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317]] 2024-02-15T18:24:58.421 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334]] 2024-02-15T18:24:58.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fde0405c2b0 msgr2=0x7fde0405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fde0405c2b0 0x7fde0405e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fde14004630 tx=0x7fde14009b30).stop 2024-02-15T18:24:58.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f5340 msgr2=0x7fde18107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f5340 0x7fde18107550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fde08002700 tx=0x7fde08009d60).stop 2024-02-15T18:24:58.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 shutdown_connections 2024-02-15T18:24:58.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fde0405c2b0 0x7fde0405e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde180f49a0 0x7fde18107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 --2- 172.21.15.84:0/1148498508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde180f5340 0x7fde18107550 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 >> 172.21.15.84:0/1148498508 conn(0x7fde180f04c0 msgr2=0x7fde180fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:58.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 shutdown_connections 2024-02-15T18:24:58.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.420+0000 7fde20557700 1 -- 172.21.15.84:0/1148498508 wait complete. 2024-02-15T18:24:58.422 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.544+0000 7fd4c167b700 1 -- 172.21.15.84:0/864896751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 msgr2=0x7fd4bc0f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.544+0000 7fd4c167b700 1 --2- 172.21.15.84:0/864896751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 0x7fd4bc0f6b60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fd4b0004660 tx=0x7fd4b0009b30).stop 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.544+0000 7fd4c167b700 1 -- 172.21.15.84:0/864896751 shutdown_connections 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.544+0000 7fd4c167b700 1 --2- 172.21.15.84:0/864896751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 0x7fd4bc0f6b60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.544+0000 7fd4c167b700 1 --2- 172.21.15.84:0/864896751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f5460 0x7fd4bc0f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.544+0000 7fd4c167b700 1 -- 172.21.15.84:0/864896751 >> 172.21.15.84:0/864896751 conn(0x7fd4bc0f0bc0 msgr2=0x7fd4bc0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.544+0000 7fd4c167b700 1 -- 172.21.15.84:0/864896751 shutdown_connections 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.544+0000 7fd4c167b700 1 -- 172.21.15.84:0/864896751 wait complete. 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4c167b700 1 Processor -- start 2024-02-15T18:24:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4c167b700 1 -- start start 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4c167b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f5460 0x7fd4bc10bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4c167b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 0x7fd4bc10e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4c167b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0602b0 con 0x7fd4bc0f6700 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4c167b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0603f0 con 0x7fd4bc0f5460 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4ba7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 0x7fd4bc10e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4ba7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 0x7fd4bc10e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37052/0 (socket says 172.21.15.84:37052) 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4ba7fc700 1 -- 172.21.15.84:0/1441306190 learned_addr learned my addr 172.21.15.84:0/1441306190 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4baffd700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f5460 0x7fd4bc10bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4ba7fc700 1 -- 172.21.15.84:0/1441306190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f5460 msgr2=0x7fd4bc10bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4ba7fc700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f5460 0x7fd4bc10bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4ba7fc700 1 -- 172.21.15.84:0/1441306190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b0005040 con 0x7fd4bc0f6700 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4baffd700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f5460 0x7fd4bc10bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.545+0000 7fd4ba7fc700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 0x7fd4bc10e400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd4b0009f50 tx=0x7fd4b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.546+0000 7fd4a37fe700 1 -- 172.21.15.84:0/1441306190 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b0018070 con 0x7fd4bc0f6700 2024-02-15T18:24:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.546+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc10e8f0 con 0x7fd4bc0f6700 2024-02-15T18:24:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.546+0000 7fd4a37fe700 1 -- 172.21.15.84:0/1441306190 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd4b0007ba0 con 0x7fd4bc0f6700 2024-02-15T18:24:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.546+0000 7fd4a37fe700 1 -- 172.21.15.84:0/1441306190 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b001c620 con 0x7fd4bc0f6700 2024-02-15T18:24:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.546+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc10ec40 con 0x7fd4bc0f6700 2024-02-15T18:24:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.547+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc045ad0 con 0x7fd4bc0f6700 2024-02-15T18:24:58.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.547+0000 7fd4a37fe700 1 -- 172.21.15.84:0/1441306190 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd4b001c890 con 0x7fd4bc0f6700 2024-02-15T18:24:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.547+0000 7fd4a37fe700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd4a405c300 0x7fd4a405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.547+0000 7fd4a37fe700 1 -- 172.21.15.84:0/1441306190 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd4b0077d30 con 0x7fd4bc0f6700 2024-02-15T18:24:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.547+0000 7fd4baffd700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd4a405c300 0x7fd4a405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.548+0000 7fd4baffd700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd4a405c300 0x7fd4a405e7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd4bc060040 tx=0x7fd4ac009c80).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.552+0000 7fd4a37fe700 1 -- 172.21.15.84:0/1441306190 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd4b004a9f0 con 0x7fd4bc0f6700 2024-02-15T18:24:58.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.827+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4bc057f10 con 0x7fd4a405c300 2024-02-15T18:24:58.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.829+0000 7fd4a37fe700 1 -- 172.21.15.84:0/1441306190 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7fd4bc057f10 con 0x7fd4a405c300 2024-02-15T18:24:58.828 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:24:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-15T18:24:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:24:58.828 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-02-15T18:24:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "", 2024-02-15T18:24:58.829 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 image" 2024-02-15T18:24:58.829 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd4a405c300 msgr2=0x7fd4a405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd4a405c300 0x7fd4a405e7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd4bc060040 tx=0x7fd4ac009c80).stop 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 msgr2=0x7fd4bc10e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 0x7fd4bc10e400 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd4b0009f50 tx=0x7fd4b0009b30).stop 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 shutdown_connections 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd4a405c300 0x7fd4a405e7c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f5460 0x7fd4bc10bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 --2- 172.21.15.84:0/1441306190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6700 0x7fd4bc10e400 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 >> 172.21.15.84:0/1441306190 conn(0x7fd4bc0f0bc0 msgr2=0x7fd4bc0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:58.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.830+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 shutdown_connections 2024-02-15T18:24:58.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:24:58.831+0000 7fd4c167b700 1 -- 172.21.15.84:0/1441306190 wait complete. 2024-02-15T18:24:59.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:57.639178+0000 mgr.smithi084.hjmnez (mgr.14162) 269 : audit [DBG] from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:59.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:58.049936+0000 mon.smithi084 (mon.0) 560 : audit [DBG] from='client.? 172.21.15.84:0/1619257278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:24:59.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:58.420405+0000 mon.smithi084 (mon.0) 561 : audit [DBG] from='client.? 172.21.15.84:0/1148498508' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:24:59.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:57.639178+0000 mgr.smithi084.hjmnez (mgr.14162) 269 : audit [DBG] from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:59.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:58.049936+0000 mon.smithi084 (mon.0) 560 : audit [DBG] from='client.? 172.21.15.84:0/1619257278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:24:59.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:58.420405+0000 mon.smithi084 (mon.0) 561 : audit [DBG] from='client.? 172.21.15.84:0/1148498508' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:25:00.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:24:58.410356+0000 mgr.smithi084.hjmnez (mgr.14162) 270 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-15T18:25:00.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:24:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:24:58.830367+0000 mgr.smithi084.hjmnez (mgr.14162) 271 : audit [DBG] from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:00.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:24:58.410356+0000 mgr.smithi084.hjmnez (mgr.14162) 270 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-15T18:25:00.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:24:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:24:58.830367+0000 mgr.smithi084.hjmnez (mgr.14162) 271 : audit [DBG] from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:02.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:00.410680+0000 mgr.smithi084.hjmnez (mgr.14162) 272 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:02.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:00.410680+0000 mgr.smithi084.hjmnez (mgr.14162) 272 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:04.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:02.410999+0000 mgr.smithi084.hjmnez (mgr.14162) 273 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:04.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:02.410999+0000 mgr.smithi084.hjmnez (mgr.14162) 273 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:06.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:04.411378+0000 mgr.smithi084.hjmnez (mgr.14162) 274 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:06.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:04.411378+0000 mgr.smithi084.hjmnez (mgr.14162) 274 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:08.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:06.411761+0000 mgr.smithi084.hjmnez (mgr.14162) 275 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:08.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:06.411761+0000 mgr.smithi084.hjmnez (mgr.14162) 275 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:10.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:08.412137+0000 mgr.smithi084.hjmnez (mgr.14162) 276 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:10.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:08.412137+0000 mgr.smithi084.hjmnez (mgr.14162) 276 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:12.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:10.412459+0000 mgr.smithi084.hjmnez (mgr.14162) 277 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:12.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:10.412459+0000 mgr.smithi084.hjmnez (mgr.14162) 277 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:14.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:12.412934+0000 mgr.smithi084.hjmnez (mgr.14162) 278 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:14.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:12.412934+0000 mgr.smithi084.hjmnez (mgr.14162) 278 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:16.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:14.413392+0000 mgr.smithi084.hjmnez (mgr.14162) 279 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:16.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:14.413392+0000 mgr.smithi084.hjmnez (mgr.14162) 279 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 9.2 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:18.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:16.413815+0000 mgr.smithi084.hjmnez (mgr.14162) 280 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-15T18:25:18.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:16.413815+0000 mgr.smithi084.hjmnez (mgr.14162) 280 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-15T18:25:20.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:18.414234+0000 mgr.smithi084.hjmnez (mgr.14162) 281 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:25:20.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:18.755533+0000 mon.smithi084 (mon.0) 562 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:20.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:25:18.755941+0000 mgr.smithi084.hjmnez (mgr.14162) 282 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-15T18:25:20.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:25:18.755994+0000 mgr.smithi084.hjmnez (mgr.14162) 283 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-15T18:25:20.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:18.756636+0000 mon.smithi084 (mon.0) 563 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:20.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:25:18.757424+0000 mgr.smithi084.hjmnez (mgr.14162) 284 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi084.hjmnez) 2024-02-15T18:25:20.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:25:18.987661+0000 mgr.smithi084.hjmnez (mgr.14162) 285 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc on smithi133 2024-02-15T18:25:20.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:18.414234+0000 mgr.smithi084.hjmnez (mgr.14162) 281 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:25:20.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:18.755533+0000 mon.smithi084 (mon.0) 562 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:20.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:25:18.755941+0000 mgr.smithi084.hjmnez (mgr.14162) 282 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-15T18:25:20.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:25:18.755994+0000 mgr.smithi084.hjmnez (mgr.14162) 283 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-15T18:25:20.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:18.756636+0000 mon.smithi084 (mon.0) 563 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:20.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:25:18.757424+0000 mgr.smithi084.hjmnez (mgr.14162) 284 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi084.hjmnez) 2024-02-15T18:25:20.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:25:18.987661+0000 mgr.smithi084.hjmnez (mgr.14162) 285 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc on smithi133 2024-02-15T18:25:22.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:20.414778+0000 mgr.smithi084.hjmnez (mgr.14162) 286 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:25:22.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:20.414778+0000 mgr.smithi084.hjmnez (mgr.14162) 286 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:25:24.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:22.415127+0000 mgr.smithi084.hjmnez (mgr.14162) 287 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-15T18:25:24.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:22.415127+0000 mgr.smithi084.hjmnez (mgr.14162) 287 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-15T18:25:26.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:24.415458+0000 mgr.smithi084.hjmnez (mgr.14162) 288 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:25:26.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:24.415458+0000 mgr.smithi084.hjmnez (mgr.14162) 288 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:25:28.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:26.415795+0000 mgr.smithi084.hjmnez (mgr.14162) 289 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:25:28.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:26.415795+0000 mgr.smithi084.hjmnez (mgr.14162) 289 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:25:28.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.941+0000 7f0b80b11700 1 -- 172.21.15.84:0/2733290370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f66d0 msgr2=0x7f0b7c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:28.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.941+0000 7f0b80b11700 1 --2- 172.21.15.84:0/2733290370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f66d0 0x7f0b7c0f6b30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f0b70004660 tx=0x7f0b70009b30).stop 2024-02-15T18:25:28.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.941+0000 7f0b80b11700 1 -- 172.21.15.84:0/2733290370 shutdown_connections 2024-02-15T18:25:28.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.941+0000 7f0b80b11700 1 --2- 172.21.15.84:0/2733290370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f66d0 0x7f0b7c0f6b30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:28.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.941+0000 7f0b80b11700 1 --2- 172.21.15.84:0/2733290370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0f5430 0x7f0b7c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:28.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.941+0000 7f0b80b11700 1 -- 172.21.15.84:0/2733290370 >> 172.21.15.84:0/2733290370 conn(0x7f0b7c0f0b90 msgr2=0x7f0b7c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:28.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.941+0000 7f0b80b11700 1 -- 172.21.15.84:0/2733290370 shutdown_connections 2024-02-15T18:25:28.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.941+0000 7f0b80b11700 1 -- 172.21.15.84:0/2733290370 wait complete. 2024-02-15T18:25:28.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b80b11700 1 Processor -- start 2024-02-15T18:25:28.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b80b11700 1 -- start start 2024-02-15T18:25:28.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b80b11700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f5430 0x7f0b7c106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:28.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b80b11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0f66d0 0x7f0b7c107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:28.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b80b11700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c107920 con 0x7f0b7c0f5430 2024-02-15T18:25:28.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b80b11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c108130 con 0x7f0b7c0f66d0 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b7b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f5430 0x7f0b7c106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b7b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f5430 0x7f0b7c106e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39344/0 (socket says 172.21.15.84:39344) 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b7b7fe700 1 -- 172.21.15.84:0/258510565 learned_addr learned my addr 172.21.15.84:0/258510565 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.942+0000 7f0b7affd700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0f66d0 0x7f0b7c107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.943+0000 7f0b7b7fe700 1 -- 172.21.15.84:0/258510565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0f66d0 msgr2=0x7f0b7c107320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.943+0000 7f0b7b7fe700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0f66d0 0x7f0b7c107320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.943+0000 7f0b7b7fe700 1 -- 172.21.15.84:0/258510565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b70005040 con 0x7f0b7c0f5430 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.943+0000 7f0b7b7fe700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f5430 0x7f0b7c106e30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f0b6c00e7c0 tx=0x7f0b6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.943+0000 7f0b63fff700 1 -- 172.21.15.84:0/258510565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b6c0092e0 con 0x7f0b7c0f5430 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.943+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c1083b0 con 0x7f0b7c0f5430 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.943+0000 7f0b63fff700 1 -- 172.21.15.84:0/258510565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0b6c00f040 con 0x7f0b7c0f5430 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.943+0000 7f0b63fff700 1 -- 172.21.15.84:0/258510565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b6c014920 con 0x7f0b7c0f5430 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.943+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c108970 con 0x7f0b7c0f5430 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.944+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c059100 con 0x7f0b7c0f5430 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.944+0000 7f0b63fff700 1 -- 172.21.15.84:0/258510565 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0b6c01b030 con 0x7f0b7c0f5430 2024-02-15T18:25:28.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.945+0000 7f0b63fff700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0b6405c300 0x7f0b6405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:28.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.945+0000 7f0b63fff700 1 -- 172.21.15.84:0/258510565 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0b6c075d50 con 0x7f0b7c0f5430 2024-02-15T18:25:28.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.945+0000 7f0b7affd700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0b6405c300 0x7f0b6405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:28.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.945+0000 7f0b7affd700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0b6405c300 0x7f0b6405e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0b70009720 tx=0x7f0b70016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:28.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:28.949+0000 7f0b63fff700 1 -- 172.21.15.84:0/258510565 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0b6c048a10 con 0x7f0b7c0f5430 2024-02-15T18:25:29.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.139+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b7c0fab10 con 0x7f0b6405c300 2024-02-15T18:25:29.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.140+0000 7f0b63fff700 1 -- 172.21.15.84:0/258510565 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7f0b7c0fab10 con 0x7f0b6405c300 2024-02-15T18:25:29.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0b6405c300 msgr2=0x7f0b6405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0b6405c300 0x7f0b6405e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0b70009720 tx=0x7f0b70016040).stop 2024-02-15T18:25:29.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f5430 msgr2=0x7f0b7c106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f5430 0x7f0b7c106e30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f0b6c00e7c0 tx=0x7f0b6c00b040).stop 2024-02-15T18:25:29.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 shutdown_connections 2024-02-15T18:25:29.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0b6405c300 0x7f0b6405e7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c0f5430 0x7f0b7c106e30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 --2- 172.21.15.84:0/258510565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0f66d0 0x7f0b7c107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 >> 172.21.15.84:0/258510565 conn(0x7f0b7c0f0b90 msgr2=0x7f0b7c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:29.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.141+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 shutdown_connections 2024-02-15T18:25:29.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.142+0000 7f0b80b11700 1 -- 172.21.15.84:0/258510565 wait complete. 2024-02-15T18:25:29.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:28.494668+0000 mon.smithi084 (mon.0) 564 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:25:29.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:28.494848+0000 mon.smithi084 (mon.0) 565 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:25:29.149 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:25:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.242+0000 7f8b65691700 1 -- 172.21.15.84:0/2486988147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 msgr2=0x7f8b600f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.242+0000 7f8b65691700 1 --2- 172.21.15.84:0/2486988147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 0x7f8b600f5850 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f8b50004660 tx=0x7f8b50009b30).stop 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.242+0000 7f8b65691700 1 -- 172.21.15.84:0/2486988147 shutdown_connections 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.242+0000 7f8b65691700 1 --2- 172.21.15.84:0/2486988147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b600f66d0 0x7f8b600f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.242+0000 7f8b65691700 1 --2- 172.21.15.84:0/2486988147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 0x7f8b600f5850 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.242+0000 7f8b65691700 1 -- 172.21.15.84:0/2486988147 >> 172.21.15.84:0/2486988147 conn(0x7f8b600f0b90 msgr2=0x7f8b600f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.242+0000 7f8b65691700 1 -- 172.21.15.84:0/2486988147 shutdown_connections 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.242+0000 7f8b65691700 1 -- 172.21.15.84:0/2486988147 wait complete. 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b65691700 1 Processor -- start 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b65691700 1 -- start start 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b65691700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 0x7f8b60106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b65691700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b600f66d0 0x7f8b601073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b65691700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60107960 con 0x7f8b600f5430 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b65691700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60108160 con 0x7f8b600f66d0 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 0x7f8b60106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:29.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 0x7f8b60106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39358/0 (socket says 172.21.15.84:39358) 2024-02-15T18:25:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b5ffff700 1 -- 172.21.15.84:0/1187795630 learned_addr learned my addr 172.21.15.84:0/1187795630 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:25:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.243+0000 7f8b5f7fe700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b600f66d0 0x7f8b601073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.244+0000 7f8b5ffff700 1 -- 172.21.15.84:0/1187795630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b600f66d0 msgr2=0x7f8b601073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.244+0000 7f8b5ffff700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b600f66d0 0x7f8b601073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.244+0000 7f8b5ffff700 1 -- 172.21.15.84:0/1187795630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50005040 con 0x7f8b600f5430 2024-02-15T18:25:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.244+0000 7f8b5ffff700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 0x7f8b60106ec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f8b50002040 tx=0x7f8b5000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:29.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.244+0000 7f8b5cff9700 1 -- 172.21.15.84:0/1187795630 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b50019070 con 0x7f8b600f5430 2024-02-15T18:25:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.244+0000 7f8b5cff9700 1 -- 172.21.15.84:0/1187795630 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f8b50007e80 con 0x7f8b600f5430 2024-02-15T18:25:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.244+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b601083e0 con 0x7f8b600f5430 2024-02-15T18:25:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.244+0000 7f8b5cff9700 1 -- 172.21.15.84:0/1187795630 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b50014db0 con 0x7f8b600f5430 2024-02-15T18:25:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.244+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b60108940 con 0x7f8b600f5430 2024-02-15T18:25:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.245+0000 7f8b5cff9700 1 -- 172.21.15.84:0/1187795630 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8b50025070 con 0x7f8b600f5430 2024-02-15T18:25:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.245+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60059100 con 0x7f8b600f5430 2024-02-15T18:25:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.245+0000 7f8b5cff9700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b4805c2a0 0x7f8b4805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.246+0000 7f8b5cff9700 1 -- 172.21.15.84:0/1187795630 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8b50076dd0 con 0x7f8b600f5430 2024-02-15T18:25:29.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.246+0000 7f8b5f7fe700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b4805c2a0 0x7f8b4805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:29.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.246+0000 7f8b5f7fe700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b4805c2a0 0x7f8b4805e760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f8b54009fd0 tx=0x7f8b5400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.250+0000 7f8b5cff9700 1 -- 172.21.15.84:0/1187795630 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8b50049a30 con 0x7f8b600f5430 2024-02-15T18:25:29.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:28.494668+0000 mon.smithi084 (mon.0) 564 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:25:29.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:28.494848+0000 mon.smithi084 (mon.0) 565 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:25:29.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.433+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b600fab10 con 0x7f8b4805c2a0 2024-02-15T18:25:29.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.435+0000 7f8b5cff9700 1 -- 172.21.15.84:0/1187795630 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7f8b600fab10 con 0x7f8b4805c2a0 2024-02-15T18:25:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b4805c2a0 msgr2=0x7f8b4805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b4805c2a0 0x7f8b4805e760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f8b54009fd0 tx=0x7f8b5400b040).stop 2024-02-15T18:25:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 msgr2=0x7f8b60106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 0x7f8b60106ec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f8b50002040 tx=0x7f8b5000b040).stop 2024-02-15T18:25:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 shutdown_connections 2024-02-15T18:25:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f8b4805c2a0 0x7f8b4805e760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b600f5430 0x7f8b60106ec0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 --2- 172.21.15.84:0/1187795630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b600f66d0 0x7f8b601073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 >> 172.21.15.84:0/1187795630 conn(0x7f8b600f0b90 msgr2=0x7f8b6005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 shutdown_connections 2024-02-15T18:25:29.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.436+0000 7f8b65691700 1 -- 172.21.15.84:0/1187795630 wait complete. 2024-02-15T18:25:29.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.536+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/2109996971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f77d0 msgr2=0x7fd3a00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.536+0000 7fd3a4a4e700 1 --2- 172.21.15.84:0/2109996971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f77d0 0x7fd3a00f7c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd394004660 tx=0x7fd394009b30).stop 2024-02-15T18:25:29.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.536+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/2109996971 shutdown_connections 2024-02-15T18:25:29.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.536+0000 7fd3a4a4e700 1 --2- 172.21.15.84:0/2109996971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f77d0 0x7fd3a00f7c30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.536+0000 7fd3a4a4e700 1 --2- 172.21.15.84:0/2109996971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a00f6530 0x7fd3a00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.536+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/2109996971 >> 172.21.15.84:0/2109996971 conn(0x7fd3a00f1c90 msgr2=0x7fd3a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:29.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.536+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/2109996971 shutdown_connections 2024-02-15T18:25:29.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.536+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/2109996971 wait complete. 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd3a4a4e700 1 Processor -- start 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd3a4a4e700 1 -- start start 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd3a4a4e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f6530 0x7fd3a0106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd3a4a4e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a00f77d0 0x7fd3a01072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd3a4a4e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01078a0 con 0x7fd3a00f6530 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd3a4a4e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01080e0 con 0x7fd3a00f77d0 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd39ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f6530 0x7fd3a0106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd39ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f6530 0x7fd3a0106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39372/0 (socket says 172.21.15.84:39372) 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd39ed9d700 1 -- 172.21.15.84:0/1651241730 learned_addr learned my addr 172.21.15.84:0/1651241730 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.537+0000 7fd39e59c700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a00f77d0 0x7fd3a01072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.538+0000 7fd39ed9d700 1 -- 172.21.15.84:0/1651241730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a00f77d0 msgr2=0x7fd3a01072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.538+0000 7fd39ed9d700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a00f77d0 0x7fd3a01072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.538+0000 7fd39ed9d700 1 -- 172.21.15.84:0/1651241730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd394005040 con 0x7fd3a00f6530 2024-02-15T18:25:29.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.538+0000 7fd39ed9d700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f6530 0x7fd3a0106db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd39000e7c0 tx=0x7fd39000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:29.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.538+0000 7fd3877fe700 1 -- 172.21.15.84:0/1651241730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3900092e0 con 0x7fd3a00f6530 2024-02-15T18:25:29.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.538+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a01083c0 con 0x7fd3a00f6530 2024-02-15T18:25:29.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.538+0000 7fd3877fe700 1 -- 172.21.15.84:0/1651241730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd39000f040 con 0x7fd3a00f6530 2024-02-15T18:25:29.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.538+0000 7fd3877fe700 1 -- 172.21.15.84:0/1651241730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd390014920 con 0x7fd3a00f6530 2024-02-15T18:25:29.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.538+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a0108900 con 0x7fd3a00f6530 2024-02-15T18:25:29.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.539+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a0059100 con 0x7fd3a00f6530 2024-02-15T18:25:29.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.539+0000 7fd3877fe700 1 -- 172.21.15.84:0/1651241730 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd39001b030 con 0x7fd3a00f6530 2024-02-15T18:25:29.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.540+0000 7fd3877fe700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd38805c300 0x7fd38805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:29.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.540+0000 7fd3877fe700 1 -- 172.21.15.84:0/1651241730 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd390075e50 con 0x7fd3a00f6530 2024-02-15T18:25:29.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.540+0000 7fd39e59c700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd38805c300 0x7fd38805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:29.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.540+0000 7fd39e59c700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd38805c300 0x7fd38805e7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd394009720 tx=0x7fd394016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:29.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.544+0000 7fd3877fe700 1 -- 172.21.15.84:0/1651241730 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd390048b10 con 0x7fd3a00f6530 2024-02-15T18:25:29.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.745+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3a00fef10 con 0x7fd38805c300 2024-02-15T18:25:29.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.753+0000 7fd3877fe700 1 -- 172.21.15.84:0/1651241730 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7fd3a00fef10 con 0x7fd38805c300 2024-02-15T18:25:29.751 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2024-02-15T18:25:29.751 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (4m) 55s ago 6m 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:25:29.751 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (6m) 55s ago 6m 16.2.4 8d91d370c2b8 cfe2961e55e3 2024-02-15T18:25:29.751 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (5m) 63s ago 5m 16.2.4 8d91d370c2b8 d52ceb5fe65b 2024-02-15T18:25:29.751 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (4m) 55s ago 6m 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:25:29.751 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (79s) 55s ago 79s 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (73s) 55s ago 73s 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (82s) 63s ago 82s 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (77s) 63s ago 76s 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:9283 running (7m) 55s ago 7m 16.2.4 8d91d370c2b8 f9dec188dcb9 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (5m) 63s ago 5m 16.2.4 8d91d370c2b8 802b41cf2bac 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (7m) 55s ago 8m 16.2.4 8d91d370c2b8 77f1f72e867c 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (5m) 63s ago 5m 16.2.4 8d91d370c2b8 c65c0defe0dd 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (6m) 55s ago 6m 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (5m) 63s ago 5m 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 55s ago 4m 16.2.4 8d91d370c2b8 20023f9a2292 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 55s ago 4m 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 55s ago 4m 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:25:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (3m) 63s ago 3m 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:25:29.753 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (3m) 63s ago 3m 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:25:29.753 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (2m) 63s ago 2m 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:25:29.753 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (4m) 55s ago 5m 2.18.1 de242295e225 c3f4635db4df 2024-02-15T18:25:29.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd38805c300 msgr2=0x7fd38805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd38805c300 0x7fd38805e7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd394009720 tx=0x7fd394016040).stop 2024-02-15T18:25:29.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f6530 msgr2=0x7fd3a0106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f6530 0x7fd3a0106db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd39000e7c0 tx=0x7fd39000b040).stop 2024-02-15T18:25:29.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 shutdown_connections 2024-02-15T18:25:29.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fd38805c300 0x7fd38805e7c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3a00f6530 0x7fd3a0106db0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 --2- 172.21.15.84:0/1651241730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a00f77d0 0x7fd3a01072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 >> 172.21.15.84:0/1651241730 conn(0x7fd3a00f1c90 msgr2=0x7fd3a00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:29.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 shutdown_connections 2024-02-15T18:25:29.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.755+0000 7fd3a4a4e700 1 -- 172.21.15.84:0/1651241730 wait complete. 2024-02-15T18:25:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.854+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3054917028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f6530 msgr2=0x7f0d540f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 --2- 172.21.15.84:0/3054917028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f6530 0x7f0d540f6950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f0d50004660 tx=0x7f0d50009b30).stop 2024-02-15T18:25:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3054917028 shutdown_connections 2024-02-15T18:25:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 --2- 172.21.15.84:0/3054917028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d540f77d0 0x7f0d540f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 --2- 172.21.15.84:0/3054917028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f6530 0x7f0d540f6950 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3054917028 >> 172.21.15.84:0/3054917028 conn(0x7f0d540f1c90 msgr2=0x7f0d540f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3054917028 shutdown_connections 2024-02-15T18:25:29.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3054917028 wait complete. 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 Processor -- start 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 -- start start 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d540f6530 0x7f0d54106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f77d0 0x7f0d541073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54107960 con 0x7f0d540f77d0 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.855+0000 7f0d5ad72700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54108160 con 0x7f0d540f6530 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d5956f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f77d0 0x7f0d541073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d59d70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d540f6530 0x7f0d54106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d5956f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f77d0 0x7f0d541073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39380/0 (socket says 172.21.15.84:39380) 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d5956f700 1 -- 172.21.15.84:0/3527368241 learned_addr learned my addr 172.21.15.84:0/3527368241 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d5956f700 1 -- 172.21.15.84:0/3527368241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d540f6530 msgr2=0x7f0d54106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d5956f700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d540f6530 0x7f0d54106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d5956f700 1 -- 172.21.15.84:0/3527368241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50005040 con 0x7f0d540f77d0 2024-02-15T18:25:29.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d5956f700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f77d0 0x7f0d541073b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f0d4400e7f0 tx=0x7f0d4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d4a7fc700 1 -- 172.21.15.84:0/3527368241 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d440092e0 con 0x7f0d540f77d0 2024-02-15T18:25:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d54108440 con 0x7f0d540f77d0 2024-02-15T18:25:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d4a7fc700 1 -- 172.21.15.84:0/3527368241 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0d4400f040 con 0x7f0d540f77d0 2024-02-15T18:25:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d4a7fc700 1 -- 172.21.15.84:0/3527368241 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d44014850 con 0x7f0d540f77d0 2024-02-15T18:25:29.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.856+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d54108a00 con 0x7f0d540f77d0 2024-02-15T18:25:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.857+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d54059100 con 0x7f0d540f77d0 2024-02-15T18:25:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.857+0000 7f0d4a7fc700 1 -- 172.21.15.84:0/3527368241 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0d4401b030 con 0x7f0d540f77d0 2024-02-15T18:25:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.858+0000 7f0d4a7fc700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0d4005c300 0x7f0d4005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.858+0000 7f0d4a7fc700 1 -- 172.21.15.84:0/3527368241 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0d44075b50 con 0x7f0d540f77d0 2024-02-15T18:25:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.858+0000 7f0d59d70700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0d4005c300 0x7f0d4005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:29.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.858+0000 7f0d59d70700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0d4005c300 0x7f0d4005e7c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f0d50009720 tx=0x7f0d50016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:29.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:29.862+0000 7f0d4a7fc700 1 -- 172.21.15.84:0/3527368241 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0d440488c0 con 0x7f0d540f77d0 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.088+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d540feea0 con 0x7f0d540f77d0 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.088+0000 7f0d4a7fc700 1 -- 172.21.15.84:0/3527368241 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7f0d44019020 con 0x7f0d540f77d0 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:25:30.086 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:25:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:25:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:25:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:25:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:25:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:25:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:25:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2024-02-15T18:25:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:25:30.087 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0d4005c300 msgr2=0x7f0d4005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0d4005c300 0x7f0d4005e7c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f0d50009720 tx=0x7f0d50016040).stop 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f77d0 msgr2=0x7f0d541073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f77d0 0x7f0d541073b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f0d4400e7f0 tx=0x7f0d4400b040).stop 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 shutdown_connections 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f0d4005c300 0x7f0d4005e7c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d540f6530 0x7f0d54106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 --2- 172.21.15.84:0/3527368241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d540f77d0 0x7f0d541073b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 >> 172.21.15.84:0/3527368241 conn(0x7f0d540f1c90 msgr2=0x7f0d540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:30.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 shutdown_connections 2024-02-15T18:25:30.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.090+0000 7f0d5ad72700 1 -- 172.21.15.84:0/3527368241 wait complete. 2024-02-15T18:25:30.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:28.416127+0000 mgr.smithi084.hjmnez (mgr.14162) 290 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-15T18:25:30.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:29.140394+0000 mgr.smithi084.hjmnez (mgr.14162) 291 : audit [DBG] from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:30.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.190+0000 7f2d0d36a700 1 -- 172.21.15.84:0/4215862384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f66d0 msgr2=0x7f2d080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.190+0000 7f2d0d36a700 1 --2- 172.21.15.84:0/4215862384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f66d0 0x7f2d080f6b30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2cfc004660 tx=0x7f2cfc009b30).stop 2024-02-15T18:25:30.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.190+0000 7f2d0d36a700 1 -- 172.21.15.84:0/4215862384 shutdown_connections 2024-02-15T18:25:30.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.190+0000 7f2d0d36a700 1 --2- 172.21.15.84:0/4215862384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f66d0 0x7f2d080f6b30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.190+0000 7f2d0d36a700 1 --2- 172.21.15.84:0/4215862384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d080f5430 0x7f2d080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.190+0000 7f2d0d36a700 1 -- 172.21.15.84:0/4215862384 >> 172.21.15.84:0/4215862384 conn(0x7f2d080f0b90 msgr2=0x7f2d080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:30.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.190+0000 7f2d0d36a700 1 -- 172.21.15.84:0/4215862384 shutdown_connections 2024-02-15T18:25:30.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.190+0000 7f2d0d36a700 1 -- 172.21.15.84:0/4215862384 wait complete. 2024-02-15T18:25:30.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.190+0000 7f2d0d36a700 1 Processor -- start 2024-02-15T18:25:30.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d0d36a700 1 -- start start 2024-02-15T18:25:30.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d0d36a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f5430 0x7f2d08108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:30.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d0d36a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d080f66d0 0x7f2d081094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d0d36a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08109a60 con 0x7f2d080f5430 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d0d36a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08109ba0 con 0x7f2d080f66d0 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d07fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f5430 0x7f2d08108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d07fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f5430 0x7f2d08108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39400/0 (socket says 172.21.15.84:39400) 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d07fff700 1 -- 172.21.15.84:0/1509688828 learned_addr learned my addr 172.21.15.84:0/1509688828 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d077fe700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d080f66d0 0x7f2d081094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d07fff700 1 -- 172.21.15.84:0/1509688828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d080f66d0 msgr2=0x7f2d081094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d07fff700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d080f66d0 0x7f2d081094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d07fff700 1 -- 172.21.15.84:0/1509688828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc005040 con 0x7f2d080f5430 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.191+0000 7f2d07fff700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f5430 0x7f2d08108fc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f2cf8002700 tx=0x7f2cf8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.192+0000 7f2d04ff9700 1 -- 172.21.15.84:0/1509688828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf80079c0 con 0x7f2d080f5430 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.192+0000 7f2d04ff9700 1 -- 172.21.15.84:0/1509688828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f2cf800f040 con 0x7f2d080f5430 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.192+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0810a540 con 0x7f2d080f5430 2024-02-15T18:25:30.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.192+0000 7f2d04ff9700 1 -- 172.21.15.84:0/1509688828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf8014990 con 0x7f2d080f5430 2024-02-15T18:25:30.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.192+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0810aa80 con 0x7f2d080f5430 2024-02-15T18:25:30.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.193+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d08045ad0 con 0x7f2d080f5430 2024-02-15T18:25:30.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.193+0000 7f2d04ff9700 1 -- 172.21.15.84:0/1509688828 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2cf801b060 con 0x7f2d080f5430 2024-02-15T18:25:30.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.193+0000 7f2d04ff9700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2cf005c300 0x7f2cf005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:30.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.193+0000 7f2d04ff9700 1 -- 172.21.15.84:0/1509688828 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f2cf8075c90 con 0x7f2d080f5430 2024-02-15T18:25:30.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.193+0000 7f2d077fe700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2cf005c300 0x7f2cf005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:30.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.194+0000 7f2d077fe700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2cf005c300 0x7f2cf005e7c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2cfc004630 tx=0x7f2cfc009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:30.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.197+0000 7f2d04ff9700 1 -- 172.21.15.84:0/1509688828 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2cf80489d0 con 0x7f2d080f5430 2024-02-15T18:25:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:28.416127+0000 mgr.smithi084.hjmnez (mgr.14162) 290 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-15T18:25:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:29.140394+0000 mgr.smithi084.hjmnez (mgr.14162) 291 : audit [DBG] from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:30.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.390+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2d0810f5e0 con 0x7f2d080f5430 2024-02-15T18:25:30.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.390+0000 7f2d04ff9700 1 -- 172.21.15.84:0/1509688828 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1626 (secure 0 0 0) 0x7f2cf804bff0 con 0x7f2d080f5430 2024-02-15T18:25:30.388 INFO:teuthology.orchestra.run.smithi084.stdout:e14 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 13 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:24:22.906819+0000 2024-02-15T18:25:30.389 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:25:30.390 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261]] 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091]] 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:25:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317]] 2024-02-15T18:25:30.392 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334]] 2024-02-15T18:25:30.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2cf005c300 msgr2=0x7f2cf005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2cf005c300 0x7f2cf005e7c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2cfc004630 tx=0x7f2cfc009b30).stop 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f5430 msgr2=0x7f2d08108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f5430 0x7f2d08108fc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f2cf8002700 tx=0x7f2cf8009e00).stop 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 shutdown_connections 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7f2cf005c300 0x7f2cf005e7c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d080f5430 0x7f2d08108fc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 --2- 172.21.15.84:0/1509688828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d080f66d0 0x7f2d081094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 >> 172.21.15.84:0/1509688828 conn(0x7f2d080f0b90 msgr2=0x7f2d0805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 shutdown_connections 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.392+0000 7f2d0d36a700 1 -- 172.21.15.84:0/1509688828 wait complete. 2024-02-15T18:25:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-02-15T18:25:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.492+0000 7fc05747f700 1 -- 172.21.15.84:0/3537342131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 msgr2=0x7fc0500f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.492+0000 7fc05747f700 1 --2- 172.21.15.84:0/3537342131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 0x7fc0500f5850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fc04c004660 tx=0x7fc04c009b30).stop 2024-02-15T18:25:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.492+0000 7fc05747f700 1 -- 172.21.15.84:0/3537342131 shutdown_connections 2024-02-15T18:25:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.493+0000 7fc05747f700 1 --2- 172.21.15.84:0/3537342131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500f66d0 0x7fc0500f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.493+0000 7fc05747f700 1 --2- 172.21.15.84:0/3537342131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 0x7fc0500f5850 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.493+0000 7fc05747f700 1 -- 172.21.15.84:0/3537342131 >> 172.21.15.84:0/3537342131 conn(0x7fc0500f0b90 msgr2=0x7fc0500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.493+0000 7fc05747f700 1 -- 172.21.15.84:0/3537342131 shutdown_connections 2024-02-15T18:25:30.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.493+0000 7fc05747f700 1 -- 172.21.15.84:0/3537342131 wait complete. 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.493+0000 7fc05747f700 1 Processor -- start 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.493+0000 7fc05747f700 1 -- start start 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05747f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 0x7fc050105d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05747f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500f66d0 0x7fc050106280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05747f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc050106880 con 0x7fc0500f5430 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05747f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc050107090 con 0x7fc0500f66d0 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05647d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 0x7fc050105d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05647d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 0x7fc050105d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39406/0 (socket says 172.21.15.84:39406) 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05647d700 1 -- 172.21.15.84:0/1258208847 learned_addr learned my addr 172.21.15.84:0/1258208847 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc055c7c700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500f66d0 0x7fc050106280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:30.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05647d700 1 -- 172.21.15.84:0/1258208847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500f66d0 msgr2=0x7fc050106280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05647d700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500f66d0 0x7fc050106280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05647d700 1 -- 172.21.15.84:0/1258208847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c005040 con 0x7fc0500f5430 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc055c7c700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500f66d0 0x7fc050106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05647d700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 0x7fc050105d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fc04c002040 tx=0x7fc04c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc046ffd700 1 -- 172.21.15.84:0/1258208847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc04c019070 con 0x7fc0500f5430 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc046ffd700 1 -- 172.21.15.84:0/1258208847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fc04c014420 con 0x7fc0500f5430 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0501072b0 con 0x7fc0500f5430 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc046ffd700 1 -- 172.21.15.84:0/1258208847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc04c01d5c0 con 0x7fc0500f5430 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.494+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc050107730 con 0x7fc0500f5430 2024-02-15T18:25:30.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.495+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc050045ad0 con 0x7fc0500f5430 2024-02-15T18:25:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.496+0000 7fc046ffd700 1 -- 172.21.15.84:0/1258208847 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc04c025070 con 0x7fc0500f5430 2024-02-15T18:25:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.496+0000 7fc046ffd700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc03c05c300 0x7fc03c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.496+0000 7fc046ffd700 1 -- 172.21.15.84:0/1258208847 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc04c0771e0 con 0x7fc0500f5430 2024-02-15T18:25:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.496+0000 7fc055c7c700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc03c05c300 0x7fc03c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:30.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.497+0000 7fc055c7c700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc03c05c300 0x7fc03c05e7c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc040009da0 tx=0x7fc04000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:30.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.500+0000 7fc046ffd700 1 -- 172.21.15.84:0/1258208847 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc04c04de60 con 0x7fc0500f5430 2024-02-15T18:25:30.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.686+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 --> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc05005f620 con 0x7fc03c05c300 2024-02-15T18:25:30.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.688+0000 7fc046ffd700 1 -- 172.21.15.84:0/1258208847 <== mgr.14162 v2:172.21.15.84:6800/610282832 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7fc05005f620 con 0x7fc03c05c300 2024-02-15T18:25:30.685 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:25:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:25:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:25:30.685 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-02-15T18:25:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "0/21 ceph daemons upgraded", 2024-02-15T18:25:30.686 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc image on host smithi133" 2024-02-15T18:25:30.686 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:25:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.689+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc03c05c300 msgr2=0x7fc03c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.689+0000 7fc05747f700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc03c05c300 0x7fc03c05e7c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fc040009da0 tx=0x7fc04000b040).stop 2024-02-15T18:25:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.689+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 msgr2=0x7fc050105d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.689+0000 7fc05747f700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 0x7fc050105d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fc04c002040 tx=0x7fc04c00b040).stop 2024-02-15T18:25:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.689+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 shutdown_connections 2024-02-15T18:25:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.689+0000 7fc05747f700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:6800/610282832,v1:172.21.15.84:6801/610282832] conn(0x7fc03c05c300 0x7fc03c05e7c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.689+0000 7fc05747f700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0500f5430 0x7fc050105d90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.689+0000 7fc05747f700 1 --2- 172.21.15.84:0/1258208847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500f66d0 0x7fc050106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.689+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 >> 172.21.15.84:0/1258208847 conn(0x7fc0500f0b90 msgr2=0x7fc0500fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.690+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 shutdown_connections 2024-02-15T18:25:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:25:30.690+0000 7fc05747f700 1 -- 172.21.15.84:0/1258208847 wait complete. 2024-02-15T18:25:31.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:29.435341+0000 mgr.smithi084.hjmnez (mgr.14162) 292 : audit [DBG] from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:31.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:29.747291+0000 mgr.smithi084.hjmnez (mgr.14162) 293 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:31.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:30.089055+0000 mon.smithi084 (mon.0) 566 : audit [DBG] from='client.? 172.21.15.84:0/3527368241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:25:31.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:30.391389+0000 mon.smithi084 (mon.0) 567 : audit [DBG] from='client.? 172.21.15.84:0/1509688828' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:25:31.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:29.435341+0000 mgr.smithi084.hjmnez (mgr.14162) 292 : audit [DBG] from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:31.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:29.747291+0000 mgr.smithi084.hjmnez (mgr.14162) 293 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:31.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:30.089055+0000 mon.smithi084 (mon.0) 566 : audit [DBG] from='client.? 172.21.15.84:0/3527368241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:25:31.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:30.391389+0000 mon.smithi084 (mon.0) 567 : audit [DBG] from='client.? 172.21.15.84:0/1509688828' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:25:32.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:30.416448+0000 mgr.smithi084.hjmnez (mgr.14162) 294 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:25:32.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:30.688343+0000 mgr.smithi084.hjmnez (mgr.14162) 295 : audit [DBG] from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:32.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:30.416448+0000 mgr.smithi084.hjmnez (mgr.14162) 294 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:25:32.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:30.688343+0000 mgr.smithi084.hjmnez (mgr.14162) 295 : audit [DBG] from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:34.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:32.416822+0000 mgr.smithi084.hjmnez (mgr.14162) 296 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:25:34.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:32.416822+0000 mgr.smithi084.hjmnez (mgr.14162) 296 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:25:36.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:34.417128+0000 mgr.smithi084.hjmnez (mgr.14162) 297 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-15T18:25:36.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:34.417128+0000 mgr.smithi084.hjmnez (mgr.14162) 297 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-15T18:25:38.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:36.417452+0000 mgr.smithi084.hjmnez (mgr.14162) 298 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:25:38.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:36.417452+0000 mgr.smithi084.hjmnez (mgr.14162) 298 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:25:40.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:38.417838+0000 mgr.smithi084.hjmnez (mgr.14162) 299 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:25:40.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:38.417838+0000 mgr.smithi084.hjmnez (mgr.14162) 299 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:25:42.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:40.418163+0000 mgr.smithi084.hjmnez (mgr.14162) 300 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:42.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:41 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:40.418163+0000 mgr.smithi084.hjmnez (mgr.14162) 300 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:44.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:42.418500+0000 mgr.smithi084.hjmnez (mgr.14162) 301 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:44.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:42.418500+0000 mgr.smithi084.hjmnez (mgr.14162) 301 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:46.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:44.418858+0000 mgr.smithi084.hjmnez (mgr.14162) 302 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:46.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:44.418858+0000 mgr.smithi084.hjmnez (mgr.14162) 302 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:48.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:46.419207+0000 mgr.smithi084.hjmnez (mgr.14162) 303 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:48.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:25:47.310568+0000 mgr.smithi084.hjmnez (mgr.14162) 304 : cephadm [INF] Upgrade: Updating mgr.smithi133.nxzroj 2024-02-15T18:25:48.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:47.314567+0000 mon.smithi084 (mon.0) 568 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:48.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:47.315209+0000 mon.smithi084 (mon.0) 569 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.nxzroj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:25:48.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:47.315788+0000 mon.smithi084 (mon.0) 570 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:25:48.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:47.316284+0000 mon.smithi084 (mon.0) 571 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:48.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:25:47.316743+0000 mgr.smithi084.hjmnez (mgr.14162) 305 : cephadm [INF] Deploying daemon mgr.smithi133.nxzroj on smithi133 2024-02-15T18:25:48.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:46.419207+0000 mgr.smithi084.hjmnez (mgr.14162) 303 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:48.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:25:47.310568+0000 mgr.smithi084.hjmnez (mgr.14162) 304 : cephadm [INF] Upgrade: Updating mgr.smithi133.nxzroj 2024-02-15T18:25:48.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:47.314567+0000 mon.smithi084 (mon.0) 568 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:48.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:47.315209+0000 mon.smithi084 (mon.0) 569 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.nxzroj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:25:48.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:47.315788+0000 mon.smithi084 (mon.0) 570 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:25:48.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:47.316284+0000 mon.smithi084 (mon.0) 571 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:48.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:25:47.316743+0000 mgr.smithi084.hjmnez (mgr.14162) 305 : cephadm [INF] Deploying daemon mgr.smithi133.nxzroj on smithi133 2024-02-15T18:25:50.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:48.419646+0000 mgr.smithi084.hjmnez (mgr.14162) 306 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:50.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:48.419646+0000 mgr.smithi084.hjmnez (mgr.14162) 306 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:52.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:50.420026+0000 mgr.smithi084.hjmnez (mgr.14162) 307 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:52.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:50.420026+0000 mgr.smithi084.hjmnez (mgr.14162) 307 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:54.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:52.420473+0000 mgr.smithi084.hjmnez (mgr.14162) 308 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:54.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:53.862471+0000 mon.smithi084 (mon.0) 572 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:54.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:53.863330+0000 mon.smithi084 (mon.0) 573 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:54.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:52.420473+0000 mgr.smithi084.hjmnez (mgr.14162) 308 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:54.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:53.862471+0000 mon.smithi084 (mon.0) 572 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:54.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:53.863330+0000 mon.smithi084 (mon.0) 573 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:56.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:54.420872+0000 mgr.smithi084.hjmnez (mgr.14162) 309 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:56.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:54.420872+0000 mgr.smithi084.hjmnez (mgr.14162) 309 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:58.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:56.421261+0000 mgr.smithi084.hjmnez (mgr.14162) 310 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:58.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:57.030217+0000 mon.smithi084 (mon.0) 574 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:58.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:57.364366+0000 mon.smithi084 (mon.0) 575 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:58.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:57.367914+0000 mon.smithi084 (mon.0) 576 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:58.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:25:57.369129+0000 mgr.smithi084.hjmnez (mgr.14162) 311 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi084.hjmnez) 2024-02-15T18:25:58.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:25:57.372047+0000 mgr.smithi084.hjmnez (mgr.14162) 312 : cephadm [INF] Failing over to other MGR 2024-02-15T18:25:58.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:57.372387+0000 mon.smithi084 (mon.0) 577 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr fail", "who": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:25:58.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:57.376160+0000 mon.smithi084 (mon.0) 578 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-02-15T18:25:58.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:56.421261+0000 mgr.smithi084.hjmnez (mgr.14162) 310 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:25:58.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:57.030217+0000 mon.smithi084 (mon.0) 574 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:58.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:57.364366+0000 mon.smithi084 (mon.0) 575 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' 2024-02-15T18:25:58.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:57.367914+0000 mon.smithi084 (mon.0) 576 : audit [DBG] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:58.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:25:57.369129+0000 mgr.smithi084.hjmnez (mgr.14162) 311 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi084.hjmnez) 2024-02-15T18:25:58.365 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:25:57.372047+0000 mgr.smithi084.hjmnez (mgr.14162) 312 : cephadm [INF] Failing over to other MGR 2024-02-15T18:25:58.366 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:57.372387+0000 mon.smithi084 (mon.0) 577 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr fail", "who": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:25:58.366 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:57.376160+0000 mon.smithi084 (mon.0) 578 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-02-15T18:25:59.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:25:58.370004+0000 mon.smithi084 (mon.0) 579 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "mgr fail", "who": "smithi084.hjmnez"}]': finished 2024-02-15T18:25:59.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:25:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:25:58.370070+0000 mon.smithi084 (mon.0) 580 : cluster [DBG] mgrmap e19: smithi133.nxzroj(active, starting, since 0.996951s) 2024-02-15T18:25:59.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:25:58.370004+0000 mon.smithi084 (mon.0) 579 : audit [INF] from='mgr.14162 172.21.15.84:0/2171279808' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "mgr fail", "who": "smithi084.hjmnez"}]': finished 2024-02-15T18:25:59.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:25:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:25:58.370070+0000 mon.smithi084 (mon.0) 580 : cluster [DBG] mgrmap e19: smithi133.nxzroj(active, starting, since 0.996951s) 2024-02-15T18:26:00.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.812+0000 7fa0f916a700 1 -- 172.21.15.84:0/1346392139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0f40f7490 msgr2=0x7fa0f40f9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:00.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.812+0000 7fa0f916a700 1 --2- 172.21.15.84:0/1346392139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0f40f7490 0x7fa0f40f9920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fa0e4004660 tx=0x7fa0e4009b30).stop 2024-02-15T18:26:00.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.813+0000 7fa0f916a700 1 -- 172.21.15.84:0/1346392139 shutdown_connections 2024-02-15T18:26:00.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.813+0000 7fa0f916a700 1 --2- 172.21.15.84:0/1346392139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0f40f7490 0x7fa0f40f9920 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:00.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.813+0000 7fa0f916a700 1 --2- 172.21.15.84:0/1346392139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4060310 0x7fa0f40f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:00.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.813+0000 7fa0f916a700 1 -- 172.21.15.84:0/1346392139 >> 172.21.15.84:0/1346392139 conn(0x7fa0f40f0ba0 msgr2=0x7fa0f40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:00.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.813+0000 7fa0f916a700 1 -- 172.21.15.84:0/1346392139 shutdown_connections 2024-02-15T18:26:00.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.813+0000 7fa0f916a700 1 -- 172.21.15.84:0/1346392139 wait complete. 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.813+0000 7fa0f916a700 1 Processor -- start 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f916a700 1 -- start start 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f916a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4060310 0x7fa0f410d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f916a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0f40f7490 0x7fa0f410d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f916a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f410de10 con 0x7fa0f40f7490 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f916a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f410df50 con 0x7fa0f4060310 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4060310 0x7fa0f410d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4060310 0x7fa0f410d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.84:35740/0 (socket says 172.21.15.84:35740) 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f3fff700 1 -- 172.21.15.84:0/3079280544 learned_addr learned my addr 172.21.15.84:0/3079280544 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:00.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f3fff700 1 -- 172.21.15.84:0/3079280544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0f40f7490 msgr2=0x7fa0f410d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:00.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f3fff700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0f40f7490 0x7fa0f410d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:00.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.814+0000 7fa0f3fff700 1 -- 172.21.15.84:0/3079280544 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4005040 con 0x7fa0f4060310 2024-02-15T18:26:00.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.815+0000 7fa0f3fff700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4060310 0x7fa0f410d370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa0dc00e7f0 tx=0x7fa0dc00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:00.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.815+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0dc0092e0 con 0x7fa0f4060310 2024-02-15T18:26:00.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.815+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa0dc00f040 con 0x7fa0f4060310 2024-02-15T18:26:00.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.815+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0dc014880 con 0x7fa0f4060310 2024-02-15T18:26:00.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.815+0000 7fa0f916a700 1 -- 172.21.15.84:0/3079280544 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f410e8f0 con 0x7fa0f4060310 2024-02-15T18:26:00.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.816+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 19) v1 ==== 35997+0+0 (secure 0 0 0) 0x7fa0dc01b030 con 0x7fa0f4060310 2024-02-15T18:26:00.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.816+0000 7fa0f916a700 1 -- 172.21.15.84:0/3079280544 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f410eeb0 con 0x7fa0f4060310 2024-02-15T18:26:00.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.817+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa0dc01cbc0 con 0x7fa0f4060310 2024-02-15T18:26:00.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.817+0000 7fa0f916a700 1 -- 172.21.15.84:0/3079280544 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f4045ad0 con 0x7fa0f4060310 2024-02-15T18:26:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.825+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa0dc019030 con 0x7fa0f4060310 2024-02-15T18:26:00.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:00.893+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 20) v1 ==== 38472+0+0 (secure 0 0 0) 0x7fa0dc014b40 con 0x7fa0f4060310 2024-02-15T18:26:01.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:00.832995+0000 mon.smithi084 (mon.0) 581 : cluster [INF] Active manager daemon smithi133.nxzroj restarted 2024-02-15T18:26:01.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:00.833813+0000 mon.smithi084 (mon.0) 582 : cluster [INF] Activating manager daemon smithi133.nxzroj 2024-02-15T18:26:01.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:00.836961+0000 mon.smithi084 (mon.0) 583 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-02-15T18:26:01.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.837579+0000 mon.smithi133 (mon.1) 16 : audit [DBG] from='mgr.? 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/crt"}]: dispatch 2024-02-15T18:26:01.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.840104+0000 mon.smithi133 (mon.1) 17 : audit [DBG] from='mgr.? 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:26:01.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.841595+0000 mon.smithi133 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/key"}]: dispatch 2024-02-15T18:26:01.144 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.842069+0000 mon.smithi133 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:26:01.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:00.832995+0000 mon.smithi084 (mon.0) 581 : cluster [INF] Active manager daemon smithi133.nxzroj restarted 2024-02-15T18:26:01.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:00.833813+0000 mon.smithi084 (mon.0) 582 : cluster [INF] Activating manager daemon smithi133.nxzroj 2024-02-15T18:26:01.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:00.836961+0000 mon.smithi084 (mon.0) 583 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-02-15T18:26:01.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.837579+0000 mon.smithi133 (mon.1) 16 : audit [DBG] from='mgr.? 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/crt"}]: dispatch 2024-02-15T18:26:01.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.840104+0000 mon.smithi133 (mon.1) 17 : audit [DBG] from='mgr.? 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:26:01.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.841595+0000 mon.smithi133 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/key"}]: dispatch 2024-02-15T18:26:01.186 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.842069+0000 mon.smithi133 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:26:01.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.912+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 <== mon.1 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 21) v1 ==== 38542+0+0 (secure 0 0 0) 0x7fa0dc0138e0 con 0x7fa0f4060310 2024-02-15T18:26:01.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.912+0000 7fa0f0ff9700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fa0e000d7b0 0x7fa0e002e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:01.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.912+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 --> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0e0002ac0 con 0x7fa0e000d7b0 2024-02-15T18:26:01.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.921+0000 7fa0f37fe700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fa0e000d7b0 0x7fa0e002e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:01.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.922+0000 7fa0f37fe700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fa0e000d7b0 0x7fa0e002e110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa0e4005010 tx=0x7fa0e400b040).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:01.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.929+0000 7fa0f0ff9700 1 -- 172.21.15.84:0/3079280544 <== mgr.24343 v2:172.21.15.133:6828/3317013208 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa0e0002ac0 con 0x7fa0e000d7b0 2024-02-15T18:26:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.937+0000 7fa0f916a700 1 -- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fa0e000d7b0 msgr2=0x7fa0e002e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.937+0000 7fa0f916a700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fa0e000d7b0 0x7fa0e002e110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa0e4005010 tx=0x7fa0e400b040).stop 2024-02-15T18:26:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.937+0000 7fa0f916a700 1 -- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4060310 msgr2=0x7fa0f410d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.937+0000 7fa0f916a700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4060310 0x7fa0f410d370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa0dc00e7f0 tx=0x7fa0dc00b040).stop 2024-02-15T18:26:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.939+0000 7fa0f916a700 1 -- 172.21.15.84:0/3079280544 shutdown_connections 2024-02-15T18:26:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.939+0000 7fa0f916a700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fa0e000d7b0 0x7fa0e002e110 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.939+0000 7fa0f916a700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4060310 0x7fa0f410d370 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.939+0000 7fa0f916a700 1 --2- 172.21.15.84:0/3079280544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0f40f7490 0x7fa0f410d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.939+0000 7fa0f916a700 1 -- 172.21.15.84:0/3079280544 >> 172.21.15.84:0/3079280544 conn(0x7fa0f40f0ba0 msgr2=0x7fa0f40f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.939+0000 7fa0f916a700 1 -- 172.21.15.84:0/3079280544 shutdown_connections 2024-02-15T18:26:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:01.939+0000 7fa0f916a700 1 -- 172.21.15.84:0/3079280544 wait complete. 2024-02-15T18:26:01.956 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.110+0000 7f9624e4f700 1 -- 172.21.15.84:0/514168461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 msgr2=0x7f96200686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.110+0000 7f9624e4f700 1 --2- 172.21.15.84:0/514168461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 0x7f96200686d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9610004660 tx=0x7f9610009b30).stop 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.111+0000 7f9624e4f700 1 -- 172.21.15.84:0/514168461 shutdown_connections 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.111+0000 7f9624e4f700 1 --2- 172.21.15.84:0/514168461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 0x7f96200686d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.111+0000 7f9624e4f700 1 --2- 172.21.15.84:0/514168461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96200696d0 0x7f9620067d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.111+0000 7f9624e4f700 1 -- 172.21.15.84:0/514168461 >> 172.21.15.84:0/514168461 conn(0x7f96200636c0 msgr2=0x7f9620065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.111+0000 7f9624e4f700 1 -- 172.21.15.84:0/514168461 shutdown_connections 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.111+0000 7f9624e4f700 1 -- 172.21.15.84:0/514168461 wait complete. 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.112+0000 7f9624e4f700 1 Processor -- start 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.112+0000 7f9624e4f700 1 -- start start 2024-02-15T18:26:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.112+0000 7f9624e4f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 0x7f962010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.112+0000 7f9624e4f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96200696d0 0x7f962010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.112+0000 7f9624e4f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962010e150 con 0x7f96200696d0 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.112+0000 7f9624e4f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962010ea00 con 0x7f9620068250 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.112+0000 7f961e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 0x7f962010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.112+0000 7f961e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 0x7f962010d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.84:35756/0 (socket says 172.21.15.84:35756) 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.112+0000 7f961e59c700 1 -- 172.21.15.84:0/2866532570 learned_addr learned my addr 172.21.15.84:0/2866532570 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.113+0000 7f961e59c700 1 -- 172.21.15.84:0/2866532570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96200696d0 msgr2=0x7f962010dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.113+0000 7f961e59c700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96200696d0 0x7f962010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.113+0000 7f961e59c700 1 -- 172.21.15.84:0/2866532570 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610005040 con 0x7f9620068250 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.113+0000 7f961e59c700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 0x7f962010d5d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f96080093f0 tx=0x7f9608006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.113+0000 7f96177fe700 1 -- 172.21.15.84:0/2866532570 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9608009ea0 con 0x7f9620068250 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.113+0000 7f96177fe700 1 -- 172.21.15.84:0/2866532570 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9608013b30 con 0x7f9620068250 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.113+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962010ecb0 con 0x7f9620068250 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.113+0000 7f96177fe700 1 -- 172.21.15.84:0/2866532570 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960800dc60 con 0x7f9620068250 2024-02-15T18:26:02.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.113+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962010f1f0 con 0x7f9620068250 2024-02-15T18:26:02.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.114+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9620045ad0 con 0x7f9620068250 2024-02-15T18:26:02.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.115+0000 7f96177fe700 1 -- 172.21.15.84:0/2866532570 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 38542+0+0 (secure 0 0 0) 0x7f960800f070 con 0x7f9620068250 2024-02-15T18:26:02.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.115+0000 7f96177fe700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f960c0323d0 0x7f960c034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:02.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.116+0000 7f96177fe700 1 -- 172.21.15.84:0/2866532570 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9608043e90 con 0x7f9620068250 2024-02-15T18:26:02.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.116+0000 7f9615d9b700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f960c0323d0 0x7f960c034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:02.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.116+0000 7f9615d9b700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f960c0323d0 0x7f960c034890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9610009f50 tx=0x7f9610009b30).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:02.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.123+0000 7f96177fe700 1 -- 172.21.15.84:0/2866532570 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f960800d3d0 con 0x7f9620068250 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:00.889752+0000 mon.smithi084 (mon.0) 584 : cluster [DBG] mgrmap e20: smithi133.nxzroj(active, starting, since 0.0561607s) 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.900139+0000 mon.smithi084 (mon.0) 585 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.900283+0000 mon.smithi084 (mon.0) 586 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.900406+0000 mon.smithi084 (mon.0) 587 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.900620+0000 mon.smithi084 (mon.0) 588 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.900828+0000 mon.smithi084 (mon.0) 589 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.901360+0000 mon.smithi084 (mon.0) 590 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.901783+0000 mon.smithi084 (mon.0) 591 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mgr metadata", "who": "smithi133.nxzroj", "id": "smithi133.nxzroj"}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.901962+0000 mon.smithi084 (mon.0) 592 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.902166+0000 mon.smithi084 (mon.0) 593 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.902344+0000 mon.smithi084 (mon.0) 594 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:02.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.902518+0000 mon.smithi084 (mon.0) 595 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.902704+0000 mon.smithi084 (mon.0) 596 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.902895+0000 mon.smithi084 (mon.0) 597 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.904015+0000 mon.smithi084 (mon.0) 598 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.904343+0000 mon.smithi084 (mon.0) 599 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:00.904805+0000 mon.smithi084 (mon.0) 600 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:00.999208+0000 mon.smithi084 (mon.0) 601 : cluster [INF] Manager daemon smithi133.nxzroj is now available 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:01.120799+0000 mon.smithi084 (mon.0) 602 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:01.122670+0000 mon.smithi084 (mon.0) 603 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:01.160280+0000 mon.smithi084 (mon.0) 604 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:01.204901+0000 mon.smithi084 (mon.0) 605 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.nxzroj/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:26:02.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:01.208218+0000 mon.smithi084 (mon.0) 606 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.nxzroj/trash_purge_schedule"}]: dispatch 2024-02-15T18:26:02.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:00.889752+0000 mon.smithi084 (mon.0) 584 : cluster [DBG] mgrmap e20: smithi133.nxzroj(active, starting, since 0.0561607s) 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.900139+0000 mon.smithi084 (mon.0) 585 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.900283+0000 mon.smithi084 (mon.0) 586 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.900406+0000 mon.smithi084 (mon.0) 587 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.900620+0000 mon.smithi084 (mon.0) 588 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.900828+0000 mon.smithi084 (mon.0) 589 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.901360+0000 mon.smithi084 (mon.0) 590 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.901783+0000 mon.smithi084 (mon.0) 591 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mgr metadata", "who": "smithi133.nxzroj", "id": "smithi133.nxzroj"}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.901962+0000 mon.smithi084 (mon.0) 592 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.902166+0000 mon.smithi084 (mon.0) 593 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.902344+0000 mon.smithi084 (mon.0) 594 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.902518+0000 mon.smithi084 (mon.0) 595 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.902704+0000 mon.smithi084 (mon.0) 596 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.902895+0000 mon.smithi084 (mon.0) 597 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.904015+0000 mon.smithi084 (mon.0) 598 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:26:02.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.904343+0000 mon.smithi084 (mon.0) 599 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:26:02.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:00.904805+0000 mon.smithi084 (mon.0) 600 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:26:02.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:00.999208+0000 mon.smithi084 (mon.0) 601 : cluster [INF] Manager daemon smithi133.nxzroj is now available 2024-02-15T18:26:02.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:01.120799+0000 mon.smithi084 (mon.0) 602 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:02.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:01.122670+0000 mon.smithi084 (mon.0) 603 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:02.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:01.160280+0000 mon.smithi084 (mon.0) 604 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:02.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:01.204901+0000 mon.smithi084 (mon.0) 605 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.nxzroj/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:26:02.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:01.208218+0000 mon.smithi084 (mon.0) 606 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi133.nxzroj/trash_purge_schedule"}]: dispatch 2024-02-15T18:26:02.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.472+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 --> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96201033f0 con 0x7f960c0323d0 2024-02-15T18:26:02.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.474+0000 7f96177fe700 1 -- 172.21.15.84:0/2866532570 <== mgr.24343 v2:172.21.15.133:6828/3317013208 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f96201033f0 con 0x7f960c0323d0 2024-02-15T18:26:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f960c0323d0 msgr2=0x7f960c034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f960c0323d0 0x7f960c034890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9610009f50 tx=0x7f9610009b30).stop 2024-02-15T18:26:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 msgr2=0x7f962010d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 0x7f962010d5d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f96080093f0 tx=0x7f9608006ec0).stop 2024-02-15T18:26:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 shutdown_connections 2024-02-15T18:26:02.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f960c0323d0 0x7f960c034890 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:02.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9620068250 0x7f962010d5d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:02.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 --2- 172.21.15.84:0/2866532570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96200696d0 0x7f962010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:02.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 >> 172.21.15.84:0/2866532570 conn(0x7f96200636c0 msgr2=0x7f9620100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:02.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 shutdown_connections 2024-02-15T18:26:02.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.477+0000 7f9624e4f700 1 -- 172.21.15.84:0/2866532570 wait complete. 2024-02-15T18:26:02.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.640+0000 7f64d8f6e700 1 -- 172.21.15.84:0/1466997062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d40fcce0 msgr2=0x7f64d40fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:02.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.640+0000 7f64d8f6e700 1 --2- 172.21.15.84:0/1466997062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d40fcce0 0x7f64d40fd100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f64cc0045a0 tx=0x7f64cc009b30).stop 2024-02-15T18:26:02.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.641+0000 7f64d8f6e700 1 -- 172.21.15.84:0/1466997062 shutdown_connections 2024-02-15T18:26:02.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.641+0000 7f64d8f6e700 1 --2- 172.21.15.84:0/1466997062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64d40fdf80 0x7f64d40fe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:02.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.641+0000 7f64d8f6e700 1 --2- 172.21.15.84:0/1466997062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d40fcce0 0x7f64d40fd100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:02.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.641+0000 7f64d8f6e700 1 -- 172.21.15.84:0/1466997062 >> 172.21.15.84:0/1466997062 conn(0x7f64d406c000 msgr2=0x7f64d406e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:02.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.642+0000 7f64d8f6e700 1 -- 172.21.15.84:0/1466997062 shutdown_connections 2024-02-15T18:26:02.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.642+0000 7f64d8f6e700 1 -- 172.21.15.84:0/1466997062 wait complete. 2024-02-15T18:26:02.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.642+0000 7f64d8f6e700 1 Processor -- start 2024-02-15T18:26:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.647+0000 7f64d8f6e700 1 -- start start 2024-02-15T18:26:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.648+0000 7f64d8f6e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64d40fcce0 0x7f64d4077af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.648+0000 7f64d8f6e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d40fdf80 0x7f64d4077fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.648+0000 7f64d8f6e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40785e0 con 0x7f64d40fcce0 2024-02-15T18:26:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.648+0000 7f64d8f6e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4117150 con 0x7f64d40fdf80 2024-02-15T18:26:02.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.648+0000 7f64d259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64d40fcce0 0x7f64d4077af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:02.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.648+0000 7f64d1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d40fdf80 0x7f64d4077fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:02.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.648+0000 7f64d259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64d40fcce0 0x7f64d4077af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45872/0 (socket says 172.21.15.84:45872) 2024-02-15T18:26:02.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.648+0000 7f64d259c700 1 -- 172.21.15.84:0/2438733799 learned_addr learned my addr 172.21.15.84:0/2438733799 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:02.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.649+0000 7f64d1d9b700 1 -- 172.21.15.84:0/2438733799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64d40fcce0 msgr2=0x7f64d4077af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:02.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.649+0000 7f64d1d9b700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64d40fcce0 0x7f64d4077af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:02.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.649+0000 7f64d1d9b700 1 -- 172.21.15.84:0/2438733799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc005040 con 0x7f64d40fdf80 2024-02-15T18:26:02.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.649+0000 7f64d1d9b700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d40fdf80 0x7f64d4077fe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f64c800e7c0 tx=0x7f64c800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:02.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.651+0000 7f64c2ffd700 1 -- 172.21.15.84:0/2438733799 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c80092e0 con 0x7f64d40fdf80 2024-02-15T18:26:02.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.651+0000 7f64c2ffd700 1 -- 172.21.15.84:0/2438733799 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f64c800f040 con 0x7f64d40fdf80 2024-02-15T18:26:02.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.651+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d41173d0 con 0x7f64d40fdf80 2024-02-15T18:26:02.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.651+0000 7f64c2ffd700 1 -- 172.21.15.84:0/2438733799 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c8014920 con 0x7f64d40fdf80 2024-02-15T18:26:02.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.651+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d41178c0 con 0x7f64d40fdf80 2024-02-15T18:26:02.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.652+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d4045ad0 con 0x7f64d40fdf80 2024-02-15T18:26:02.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.653+0000 7f64c2ffd700 1 -- 172.21.15.84:0/2438733799 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 38542+0+0 (secure 0 0 0) 0x7f64c8014a80 con 0x7f64d40fdf80 2024-02-15T18:26:02.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.653+0000 7f64c2ffd700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f64bc032470 0x7f64bc034930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:02.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.653+0000 7f64c2ffd700 1 -- 172.21.15.84:0/2438733799 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f64c80441c0 con 0x7f64d40fdf80 2024-02-15T18:26:02.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.654+0000 7f64d259c700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f64bc032470 0x7f64bc034930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:02.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.654+0000 7f64d259c700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f64bc032470 0x7f64bc034930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f64cc009d60 tx=0x7f64cc016040).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:02.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.661+0000 7f64c2ffd700 1 -- 172.21.15.84:0/2438733799 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f64c8012770 con 0x7f64d40fdf80 2024-02-15T18:26:02.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.903+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 --> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64d4117ba0 con 0x7f64bc032470 2024-02-15T18:26:02.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.919+0000 7f64c2ffd700 1 -- 172.21.15.84:0/2438733799 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 22) v1 ==== 38790+0+0 (secure 0 0 0) 0x7f64c8007cd0 con 0x7f64d40fdf80 2024-02-15T18:26:02.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.922+0000 7f64c2ffd700 1 -- 172.21.15.84:0/2438733799 <== mgr.24343 v2:172.21.15.133:6828/3317013208 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f64d4117ba0 con 0x7f64bc032470 2024-02-15T18:26:02.920 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (5m) 88s ago 7m 16.1M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (7m) 88s ago 7m 6387k - 16.2.4 8d91d370c2b8 cfe2961e55e3 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (6m) 5s ago 6m 6400k - 16.2.4 8d91d370c2b8 d52ceb5fe65b 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (5m) 88s ago 6m 29.3M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (113s) 88s ago 112s 14.3M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (107s) 88s ago 106s 11.3M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (115s) 5s ago 115s 18.7M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (110s) 5s ago 109s 12.5M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:9283 running (8m) 88s ago 8m 407M - 16.2.4 8d91d370c2b8 f9dec188dcb9 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (11s) 5s ago 6m 40.6M - 16.2.14-521-g0e714d9a 1fbc92c859dc db78861bd359 2024-02-15T18:26:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (8m) 88s ago 8m 60.2M 2048M 16.2.4 8d91d370c2b8 77f1f72e867c 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (6m) 5s ago 5m 40.1M 2048M 16.2.4 8d91d370c2b8 c65c0defe0dd 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (6m) 88s ago 6m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (5m) 5s ago 5m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 88s ago 5m 43.4M 4096M 16.2.4 8d91d370c2b8 20023f9a2292 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 88s ago 4m 42.8M 4096M 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 88s ago 4m 38.7M 4096M 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (4m) 5s ago 4m 43.7M 4096M 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (3m) 5s ago 3m 41.0M 4096M 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (3m) 5s ago 3m 39.4M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:26:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (5m) 88s ago 6m 28.7M - 2.18.1 de242295e225 c3f4635db4df 2024-02-15T18:26:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.924+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f64bc032470 msgr2=0x7f64bc034930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.924+0000 7f64d8f6e700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f64bc032470 0x7f64bc034930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f64cc009d60 tx=0x7f64cc016040).stop 2024-02-15T18:26:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.924+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d40fdf80 msgr2=0x7f64d4077fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.924+0000 7f64d8f6e700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d40fdf80 0x7f64d4077fe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f64c800e7c0 tx=0x7f64c800b040).stop 2024-02-15T18:26:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.925+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 shutdown_connections 2024-02-15T18:26:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.925+0000 7f64d8f6e700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f64bc032470 0x7f64bc034930 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.925+0000 7f64d8f6e700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64d40fcce0 0x7f64d4077af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.925+0000 7f64d8f6e700 1 --2- 172.21.15.84:0/2438733799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d40fdf80 0x7f64d4077fe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.925+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 >> 172.21.15.84:0/2438733799 conn(0x7f64d406c000 msgr2=0x7f64d41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.925+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 shutdown_connections 2024-02-15T18:26:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:02.925+0000 7f64d8f6e700 1 -- 172.21.15.84:0/2438733799 wait complete. 2024-02-15T18:26:03.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:01.908882+0000 mon.smithi084 (mon.0) 607 : cluster [DBG] mgrmap e21: smithi133.nxzroj(active, since 1.0753s) 2024-02-15T18:26:03.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:01.924180+0000 mgr.smithi133.nxzroj (mgr.24343) 1 : audit [DBG] from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:03.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:01.935918+0000 mgr.smithi133.nxzroj (mgr.24343) 2 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:03.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:02.474697+0000 mgr.smithi133.nxzroj (mgr.24343) 3 : audit [DBG] from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.078+0000 7f6180d58700 1 -- 172.21.15.84:0/223259083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c060310 msgr2=0x7f617c0f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.078+0000 7f6180d58700 1 --2- 172.21.15.84:0/223259083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c060310 0x7f617c0f7090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6170004660 tx=0x7f6170009b30).stop 2024-02-15T18:26:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.081+0000 7f6180d58700 1 -- 172.21.15.84:0/223259083 shutdown_connections 2024-02-15T18:26:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.081+0000 7f6180d58700 1 --2- 172.21.15.84:0/223259083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c0f7610 0x7f617c0f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.081+0000 7f6180d58700 1 --2- 172.21.15.84:0/223259083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c060310 0x7f617c0f7090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.081+0000 7f6180d58700 1 -- 172.21.15.84:0/223259083 >> 172.21.15.84:0/223259083 conn(0x7f617c0f0d40 msgr2=0x7f617c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.081+0000 7f6180d58700 1 -- 172.21.15.84:0/223259083 shutdown_connections 2024-02-15T18:26:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.081+0000 7f6180d58700 1 -- 172.21.15.84:0/223259083 wait complete. 2024-02-15T18:26:03.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.082+0000 7f6180d58700 1 Processor -- start 2024-02-15T18:26:03.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.082+0000 7f6180d58700 1 -- start start 2024-02-15T18:26:03.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.082+0000 7f6180d58700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c060310 0x7f617c102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:03.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.082+0000 7f6180d58700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c0f7610 0x7f617c103310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:03.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.082+0000 7f6180d58700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1039a0 con 0x7f617c060310 2024-02-15T18:26:03.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.082+0000 7f6180d58700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c117150 con 0x7f617c0f7610 2024-02-15T18:26:03.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.084+0000 7f6179d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c0f7610 0x7f617c103310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:03.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.084+0000 7f6179d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c0f7610 0x7f617c103310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.84:35798/0 (socket says 172.21.15.84:35798) 2024-02-15T18:26:03.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.084+0000 7f6179d9b700 1 -- 172.21.15.84:0/3409296385 learned_addr learned my addr 172.21.15.84:0/3409296385 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:03.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.084+0000 7f6179d9b700 1 -- 172.21.15.84:0/3409296385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c060310 msgr2=0x7f617c102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:03.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.084+0000 7f6179d9b700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c060310 0x7f617c102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:03.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.084+0000 7f6179d9b700 1 -- 172.21.15.84:0/3409296385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170005040 con 0x7f617c0f7610 2024-02-15T18:26:03.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.084+0000 7f6179d9b700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c0f7610 0x7f617c103310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f616c00b410 tx=0x7f616c006ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:03.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.085+0000 7f616affd700 1 -- 172.21.15.84:0/3409296385 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f616c0125f0 con 0x7f617c0f7610 2024-02-15T18:26:03.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.085+0000 7f616affd700 1 -- 172.21.15.84:0/3409296385 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f616c012c40 con 0x7f617c0f7610 2024-02-15T18:26:03.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.085+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c117430 con 0x7f617c0f7610 2024-02-15T18:26:03.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.085+0000 7f616affd700 1 -- 172.21.15.84:0/3409296385 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f616c002b80 con 0x7f617c0f7610 2024-02-15T18:26:03.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.085+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c117970 con 0x7f617c0f7610 2024-02-15T18:26:03.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.086+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c045ad0 con 0x7f617c0f7610 2024-02-15T18:26:03.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.088+0000 7f616affd700 1 -- 172.21.15.84:0/3409296385 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) v1 ==== 38790+0+0 (secure 0 0 0) 0x7f616c00f030 con 0x7f617c0f7610 2024-02-15T18:26:03.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.088+0000 7f616affd700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f6164032680 0x7f6164034b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:03.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.088+0000 7f616affd700 1 -- 172.21.15.84:0/3409296385 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f616c043d60 con 0x7f617c0f7610 2024-02-15T18:26:03.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.092+0000 7f617a59c700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f6164032680 0x7f6164034b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:03.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.093+0000 7f617a59c700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f6164032680 0x7f6164034b40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6170009f50 tx=0x7f6170009b30).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:03.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.093+0000 7f616affd700 1 -- 172.21.15.84:0/3409296385 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f616c048070 con 0x7f617c0f7610 2024-02-15T18:26:03.241 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:01.908882+0000 mon.smithi084 (mon.0) 607 : cluster [DBG] mgrmap e21: smithi133.nxzroj(active, since 1.0753s) 2024-02-15T18:26:03.241 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:01.924180+0000 mgr.smithi133.nxzroj (mgr.24343) 1 : audit [DBG] from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:03.242 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:01.935918+0000 mgr.smithi133.nxzroj (mgr.24343) 2 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:03.242 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:02.474697+0000 mgr.smithi133.nxzroj (mgr.24343) 3 : audit [DBG] from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:03.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.543+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f617c1056a0 con 0x7f617c0f7610 2024-02-15T18:26:03.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.544+0000 7f616affd700 1 -- 172.21.15.84:0/3409296385 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+697 (secure 0 0 0) 0x7f616c019b60 con 0x7f617c0f7610 2024-02-15T18:26:03.542 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:26:03.543 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:26:03.544 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12 2024-02-15T18:26:03.544 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:26:03.544 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:26:03.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f6164032680 msgr2=0x7f6164034b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:03.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f6164032680 0x7f6164034b40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6170009f50 tx=0x7f6170009b30).stop 2024-02-15T18:26:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c0f7610 msgr2=0x7f617c103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c0f7610 0x7f617c103310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f616c00b410 tx=0x7f616c006ef0).stop 2024-02-15T18:26:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 shutdown_connections 2024-02-15T18:26:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f6164032680 0x7f6164034b40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f617c060310 0x7f617c102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 --2- 172.21.15.84:0/3409296385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f617c0f7610 0x7f617c103310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 >> 172.21.15.84:0/3409296385 conn(0x7f617c0f0d40 msgr2=0x7f617c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 shutdown_connections 2024-02-15T18:26:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.547+0000 7f6180d58700 1 -- 172.21.15.84:0/3409296385 wait complete. 2024-02-15T18:26:03.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.700+0000 7f839759e700 1 -- 172.21.15.84:0/411744855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 msgr2=0x7f83980f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.700+0000 7f839759e700 1 --2- 172.21.15.84:0/411744855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 0x7f83980f6b40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f8388004660 tx=0x7f8388009b30).stop 2024-02-15T18:26:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.700+0000 7f839759e700 1 -- 172.21.15.84:0/411744855 shutdown_connections 2024-02-15T18:26:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.700+0000 7f839759e700 1 --2- 172.21.15.84:0/411744855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 0x7f83980f6b40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.700+0000 7f839759e700 1 --2- 172.21.15.84:0/411744855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83980f5440 0x7f83980f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.700+0000 7f839759e700 1 -- 172.21.15.84:0/411744855 >> 172.21.15.84:0/411744855 conn(0x7f83980f0ba0 msgr2=0x7f83980f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.700+0000 7f839759e700 1 -- 172.21.15.84:0/411744855 shutdown_connections 2024-02-15T18:26:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.700+0000 7f839759e700 1 -- 172.21.15.84:0/411744855 wait complete. 2024-02-15T18:26:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.701+0000 7f839759e700 1 Processor -- start 2024-02-15T18:26:03.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.701+0000 7f839759e700 1 -- start start 2024-02-15T18:26:03.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f839759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83980f5440 0x7f8398104b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:03.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f839759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 0x7f8398105070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:03.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f839759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8398105670 con 0x7f83980f66e0 2024-02-15T18:26:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f839759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83981057b0 con 0x7f83980f5440 2024-02-15T18:26:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f8395d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 0x7f8398105070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f8395d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 0x7f8398105070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60970/0 (socket says 172.21.15.84:60970) 2024-02-15T18:26:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f8395d9b700 1 -- 172.21.15.84:0/2197175595 learned_addr learned my addr 172.21.15.84:0/2197175595 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f839659c700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83980f5440 0x7f8398104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f8395d9b700 1 -- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83980f5440 msgr2=0x7f8398104b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f8395d9b700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83980f5440 0x7f8398104b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f8395d9b700 1 -- 172.21.15.84:0/2197175595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388005040 con 0x7f83980f66e0 2024-02-15T18:26:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.702+0000 7f8395d9b700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 0x7f8398105070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f83880043a0 tx=0x7f838800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.703+0000 7f8386ffd700 1 -- 172.21.15.84:0/2197175595 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8388019070 con 0x7f83980f66e0 2024-02-15T18:26:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.703+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83981060c0 con 0x7f83980f66e0 2024-02-15T18:26:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.703+0000 7f8386ffd700 1 -- 172.21.15.84:0/2197175595 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f8388014420 con 0x7f83980f66e0 2024-02-15T18:26:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.703+0000 7f8386ffd700 1 -- 172.21.15.84:0/2197175595 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f838801d600 con 0x7f83980f66e0 2024-02-15T18:26:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.703+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8398106620 con 0x7f83980f66e0 2024-02-15T18:26:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.705+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398045ad0 con 0x7f83980f66e0 2024-02-15T18:26:03.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.705+0000 7f8386ffd700 1 -- 172.21.15.84:0/2197175595 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) v1 ==== 38790+0+0 (secure 0 0 0) 0x7f8388014a70 con 0x7f83980f66e0 2024-02-15T18:26:03.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.705+0000 7f8386ffd700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8380032680 0x7f8380034b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:03.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.706+0000 7f839659c700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8380032680 0x7f8380034b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:03.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.706+0000 7f839659c700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8380032680 0x7f8380034b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8398104910 tx=0x7f838c00b040).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:03.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.708+0000 7f8386ffd700 1 -- 172.21.15.84:0/2197175595 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f838800fe30 con 0x7f83980f66e0 2024-02-15T18:26:03.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:03.713+0000 7f8386ffd700 1 -- 172.21.15.84:0/2197175595 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f8388049060 con 0x7f83980f66e0 2024-02-15T18:26:04.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.119+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f83980fee20 con 0x7f83980f66e0 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:e14 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 13 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:24:22.906819+0000 2024-02-15T18:26:04.118 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:26:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261]] 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091]] 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317]] 2024-02-15T18:26:04.120 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334]] 2024-02-15T18:26:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.120+0000 7f8386ffd700 1 -- 172.21.15.84:0/2197175595 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1626 (secure 0 0 0) 0x7f8388049030 con 0x7f83980f66e0 2024-02-15T18:26:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8380032680 msgr2=0x7f8380034b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:04.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8380032680 0x7f8380034b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8398104910 tx=0x7f838c00b040).stop 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 msgr2=0x7f8398105070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 0x7f8398105070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f83880043a0 tx=0x7f838800b040).stop 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 shutdown_connections 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8380032680 0x7f8380034b40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83980f5440 0x7f8398104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 --2- 172.21.15.84:0/2197175595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83980f66e0 0x7f8398105070 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 >> 172.21.15.84:0/2197175595 conn(0x7f83980f0ba0 msgr2=0x7f83980f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 shutdown_connections 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.123+0000 7f839759e700 1 -- 172.21.15.84:0/2197175595 wait complete. 2024-02-15T18:26:04.122 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-02-15T18:26:04.197 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:02.903653+0000 mgr.smithi133.nxzroj (mgr.24343) 4 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:04.197 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:02.904819+0000 mgr.smithi133.nxzroj (mgr.24343) 5 : audit [DBG] from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:04.197 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:02.918871+0000 mon.smithi084 (mon.0) 608 : cluster [DBG] mgrmap e22: smithi133.nxzroj(active, since 2s) 2024-02-15T18:26:04.197 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:03.545044+0000 mon.smithi133 (mon.1) 20 : audit [DBG] from='client.? 172.21.15.84:0/3409296385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:26:04.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:02.903653+0000 mgr.smithi133.nxzroj (mgr.24343) 4 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:04.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:02.904819+0000 mgr.smithi133.nxzroj (mgr.24343) 5 : audit [DBG] from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:04.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:02.918871+0000 mon.smithi084 (mon.0) 608 : cluster [DBG] mgrmap e22: smithi133.nxzroj(active, since 2s) 2024-02-15T18:26:04.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:03.545044+0000 mon.smithi133 (mon.1) 20 : audit [DBG] from='client.? 172.21.15.84:0/3409296385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:26:04.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.269+0000 7f50377c7700 1 -- 172.21.15.84:0/2515675656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f47a0 msgr2=0x7f50300f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:04.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.269+0000 7f50377c7700 1 --2- 172.21.15.84:0/2515675656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f47a0 0x7f50300f4c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f502c0099e0 tx=0x7f502c004d10).stop 2024-02-15T18:26:04.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.269+0000 7f50377c7700 1 -- 172.21.15.84:0/2515675656 shutdown_connections 2024-02-15T18:26:04.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.269+0000 7f50377c7700 1 --2- 172.21.15.84:0/2515675656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f47a0 0x7f50300f4c20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.269+0000 7f50377c7700 1 --2- 172.21.15.84:0/2515675656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50300f5a50 0x7f50300f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.269+0000 7f50377c7700 1 -- 172.21.15.84:0/2515675656 >> 172.21.15.84:0/2515675656 conn(0x7f50300f04c0 msgr2=0x7f50300f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.269+0000 7f50377c7700 1 -- 172.21.15.84:0/2515675656 shutdown_connections 2024-02-15T18:26:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.269+0000 7f50377c7700 1 -- 172.21.15.84:0/2515675656 wait complete. 2024-02-15T18:26:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.270+0000 7f50377c7700 1 Processor -- start 2024-02-15T18:26:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.270+0000 7f50377c7700 1 -- start start 2024-02-15T18:26:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.270+0000 7f50377c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50300f47a0 0x7f5030068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.270+0000 7f50377c7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f5a50 0x7f5030069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.270+0000 7f50377c7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5030069930 con 0x7f50300f5a50 2024-02-15T18:26:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.270+0000 7f50377c7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5030069a70 con 0x7f50300f47a0 2024-02-15T18:26:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.271+0000 7f5034d62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f5a50 0x7f5030069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.271+0000 7f5034d62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f5a50 0x7f5030069380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60984/0 (socket says 172.21.15.84:60984) 2024-02-15T18:26:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.271+0000 7f5034d62700 1 -- 172.21.15.84:0/73075335 learned_addr learned my addr 172.21.15.84:0/73075335 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.271+0000 7f5034d62700 1 -- 172.21.15.84:0/73075335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50300f47a0 msgr2=0x7f5030068e90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-15T18:26:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.271+0000 7f5034d62700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50300f47a0 0x7f5030068e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.271+0000 7f5034d62700 1 -- 172.21.15.84:0/73075335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c009640 con 0x7f50300f5a50 2024-02-15T18:26:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.271+0000 7f5034d62700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f5a50 0x7f5030069380 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f502c00b3b0 tx=0x7f502c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.272+0000 7f5021ffb700 1 -- 172.21.15.84:0/73075335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f502c00e070 con 0x7f50300f5a50 2024-02-15T18:26:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.272+0000 7f5021ffb700 1 -- 172.21.15.84:0/73075335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f502c007be0 con 0x7f50300f5a50 2024-02-15T18:26:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.272+0000 7f5021ffb700 1 -- 172.21.15.84:0/73075335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f502c018070 con 0x7f50300f5a50 2024-02-15T18:26:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.272+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5030117560 con 0x7f50300f5a50 2024-02-15T18:26:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.272+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5030117ac0 con 0x7f50300f5a50 2024-02-15T18:26:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.275+0000 7f5021ffb700 1 -- 172.21.15.84:0/73075335 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) v1 ==== 38790+0+0 (secure 0 0 0) 0x7f502c007d50 con 0x7f50300f5a50 2024-02-15T18:26:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.275+0000 7f5021ffb700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f501c0326e0 0x7f501c034ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.275+0000 7f5021ffb700 1 -- 172.21.15.84:0/73075335 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f502c045620 con 0x7f50300f5a50 2024-02-15T18:26:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.275+0000 7f5035563700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f501c0326e0 0x7f501c034ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.276+0000 7f5035563700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f501c0326e0 0x7f501c034ba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5024004a10 tx=0x7f50240099e0).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.277+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5030045ad0 con 0x7f50300f5a50 2024-02-15T18:26:04.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.285+0000 7f5021ffb700 1 -- 172.21.15.84:0/73075335 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f502c011d30 con 0x7f50300f5a50 2024-02-15T18:26:04.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.620+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 --> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5030105660 con 0x7f501c0326e0 2024-02-15T18:26:04.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.622+0000 7f5021ffb700 1 -- 172.21.15.84:0/73075335 <== mgr.24343 v2:172.21.15.133:6828/3317013208 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f5030105660 con 0x7f501c0326e0 2024-02-15T18:26:04.620 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:26:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:26:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:26:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:26:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [], 2024-02-15T18:26:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "1/21 daemons upgraded", 2024-02-15T18:26:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2024-02-15T18:26:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:26:04.621 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:26:04.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.625+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f501c0326e0 msgr2=0x7f501c034ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:04.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.625+0000 7f50377c7700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f501c0326e0 0x7f501c034ba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f5024004a10 tx=0x7f50240099e0).stop 2024-02-15T18:26:04.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.625+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f5a50 msgr2=0x7f5030069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:04.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.625+0000 7f50377c7700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f5a50 0x7f5030069380 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f502c00b3b0 tx=0x7f502c004d10).stop 2024-02-15T18:26:04.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.626+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 shutdown_connections 2024-02-15T18:26:04.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.626+0000 7f50377c7700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f501c0326e0 0x7f501c034ba0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.626+0000 7f50377c7700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50300f47a0 0x7f5030068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:04.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.626+0000 7f50377c7700 1 --2- 172.21.15.84:0/73075335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50300f5a50 0x7f5030069380 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.626+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 >> 172.21.15.84:0/73075335 conn(0x7f50300f04c0 msgr2=0x7f50300f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:04.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.626+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 shutdown_connections 2024-02-15T18:26:04.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:04.626+0000 7f50377c7700 1 -- 172.21.15.84:0/73075335 wait complete. 2024-02-15T18:26:05.232 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:04.121097+0000 mon.smithi084 (mon.0) 609 : audit [DBG] from='client.? 172.21.15.84:0/2197175595' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:26:05.233 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:04.622833+0000 mgr.smithi133.nxzroj (mgr.24343) 6 : audit [DBG] from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:05.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:04.121097+0000 mon.smithi084 (mon.0) 609 : audit [DBG] from='client.? 172.21.15.84:0/2197175595' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:26:05.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:04.622833+0000 mgr.smithi133.nxzroj (mgr.24343) 6 : audit [DBG] from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:06.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:04.904040+0000 mgr.smithi133.nxzroj (mgr.24343) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:06.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:05.130853+0000 mon.smithi084 (mon.0) 610 : cluster [DBG] Standby manager daemon smithi084.hjmnez started 2024-02-15T18:26:06.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:05.133022+0000 mon.smithi084 (mon.0) 611 : audit [DBG] from='mgr.? 172.21.15.84:0/4227943134' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.hjmnez/crt"}]: dispatch 2024-02-15T18:26:06.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:05.134127+0000 mon.smithi084 (mon.0) 612 : audit [DBG] from='mgr.? 172.21.15.84:0/4227943134' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:26:06.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:05.136581+0000 mon.smithi084 (mon.0) 613 : audit [DBG] from='mgr.? 172.21.15.84:0/4227943134' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.hjmnez/key"}]: dispatch 2024-02-15T18:26:06.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:05.136915+0000 mon.smithi084 (mon.0) 614 : audit [DBG] from='mgr.? 172.21.15.84:0/4227943134' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:26:06.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:05.468211+0000 mon.smithi084 (mon.0) 615 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:06.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:04.904040+0000 mgr.smithi133.nxzroj (mgr.24343) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:06.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:05.130853+0000 mon.smithi084 (mon.0) 610 : cluster [DBG] Standby manager daemon smithi084.hjmnez started 2024-02-15T18:26:06.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:05.133022+0000 mon.smithi084 (mon.0) 611 : audit [DBG] from='mgr.? 172.21.15.84:0/4227943134' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.hjmnez/crt"}]: dispatch 2024-02-15T18:26:06.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:05.134127+0000 mon.smithi084 (mon.0) 612 : audit [DBG] from='mgr.? 172.21.15.84:0/4227943134' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:26:06.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:05.136581+0000 mon.smithi084 (mon.0) 613 : audit [DBG] from='mgr.? 172.21.15.84:0/4227943134' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.hjmnez/key"}]: dispatch 2024-02-15T18:26:06.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:05.136915+0000 mon.smithi084 (mon.0) 614 : audit [DBG] from='mgr.? 172.21.15.84:0/4227943134' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:26:06.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:05.468211+0000 mon.smithi084 (mon.0) 615 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:07.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:05.941643+0000 mon.smithi084 (mon.0) 616 : cluster [DBG] mgrmap e23: smithi133.nxzroj(active, since 5s), standbys: smithi084.hjmnez 2024-02-15T18:26:07.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:05.943099+0000 mon.smithi084 (mon.0) 617 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mgr metadata", "who": "smithi084.hjmnez", "id": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:26:07.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:05.941643+0000 mon.smithi084 (mon.0) 616 : cluster [DBG] mgrmap e23: smithi133.nxzroj(active, since 5s), standbys: smithi084.hjmnez 2024-02-15T18:26:07.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:05.943099+0000 mon.smithi084 (mon.0) 617 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mgr metadata", "who": "smithi084.hjmnez", "id": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:26:08.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:06.904431+0000 mgr.smithi133.nxzroj (mgr.24343) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:08.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:08.037348+0000 mon.smithi084 (mon.0) 618 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:08.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:08.378299+0000 mon.smithi084 (mon.0) 619 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:08.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:08.382005+0000 mon.smithi084 (mon.0) 620 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:08.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:08.387709+0000 mon.smithi084 (mon.0) 621 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:08.894 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:08.391946+0000 mon.smithi084 (mon.0) 622 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:08.894 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:08.398884+0000 mon.smithi084 (mon.0) 623 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:09.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:06.904431+0000 mgr.smithi133.nxzroj (mgr.24343) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:09.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:08.037348+0000 mon.smithi084 (mon.0) 618 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:09.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:08.378299+0000 mon.smithi084 (mon.0) 619 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:09.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:08.382005+0000 mon.smithi084 (mon.0) 620 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:09.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:08.387709+0000 mon.smithi084 (mon.0) 621 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:09.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:08.391946+0000 mon.smithi084 (mon.0) 622 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:09.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:08.398884+0000 mon.smithi084 (mon.0) 623 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:10.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:08.406696+0000 mgr.smithi133.nxzroj (mgr.24343) 9 : cephadm [INF] Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-02-15T18:26:10.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:08.420360+0000 mgr.smithi133.nxzroj (mgr.24343) 10 : cephadm [INF] Reconfiguring daemon prometheus.smithi084 on smithi084 2024-02-15T18:26:10.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:08.406696+0000 mgr.smithi133.nxzroj (mgr.24343) 9 : cephadm [INF] Reconfiguring prometheus.smithi084 (dependencies changed)... 2024-02-15T18:26:10.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:08.420360+0000 mgr.smithi133.nxzroj (mgr.24343) 10 : cephadm [INF] Reconfiguring daemon prometheus.smithi084 on smithi084 2024-02-15T18:26:11.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:08.904851+0000 mgr.smithi133.nxzroj (mgr.24343) 11 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:11.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:08.904851+0000 mgr.smithi133.nxzroj (mgr.24343) 11 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:13.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:10.905144+0000 mgr.smithi133.nxzroj (mgr.24343) 12 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:13.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:10.905144+0000 mgr.smithi133.nxzroj (mgr.24343) 12 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:15.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:12.905631+0000 mgr.smithi133.nxzroj (mgr.24343) 13 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:15.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:12.905631+0000 mgr.smithi133.nxzroj (mgr.24343) 13 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:17.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:14.905968+0000 mgr.smithi133.nxzroj (mgr.24343) 14 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr:Note: switching to 'bedfc49c6a823fb0ff75911e476e1f3cb464ad3e'. 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr: 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr:state without impacting any branches by switching back to a branch. 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr: 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr: 2024-02-15T18:26:17.076 INFO:tasks.workunit.client.1.smithi133.stderr: git switch -c 2024-02-15T18:26:17.077 INFO:tasks.workunit.client.1.smithi133.stderr: 2024-02-15T18:26:17.077 INFO:tasks.workunit.client.1.smithi133.stderr:Or undo this operation with: 2024-02-15T18:26:17.077 INFO:tasks.workunit.client.1.smithi133.stderr: 2024-02-15T18:26:17.077 INFO:tasks.workunit.client.1.smithi133.stderr: git switch - 2024-02-15T18:26:17.077 INFO:tasks.workunit.client.1.smithi133.stderr: 2024-02-15T18:26:17.077 INFO:tasks.workunit.client.1.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-15T18:26:17.077 INFO:tasks.workunit.client.1.smithi133.stderr: 2024-02-15T18:26:17.077 INFO:tasks.workunit.client.1.smithi133.stderr:HEAD is now at bedfc49c6a8 qa/suites/orch: whitelist warnings that are expected in test environments 2024-02-15T18:26:17.081 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-15T18:26:17.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:14.905968+0000 mgr.smithi133.nxzroj (mgr.24343) 14 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:17.354 INFO:tasks.workunit.client.1.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-15T18:26:17.356 INFO:tasks.workunit.client.1.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-15T18:26:17.356 INFO:tasks.workunit.client.1.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-15T18:26:17.650 INFO:tasks.workunit.client.0.smithi084.stderr:Note: switching to 'bedfc49c6a823fb0ff75911e476e1f3cb464ad3e'. 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr:state without impacting any branches by switching back to a branch. 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr: git switch -c 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr:Or undo this operation with: 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr: git switch - 2024-02-15T18:26:17.651 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-02-15T18:26:17.652 INFO:tasks.workunit.client.0.smithi084.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-15T18:26:17.652 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-02-15T18:26:17.652 INFO:tasks.workunit.client.0.smithi084.stderr:HEAD is now at bedfc49c6a8 qa/suites/orch: whitelist warnings that are expected in test environments 2024-02-15T18:26:17.655 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-15T18:26:17.711 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-15T18:26:17.713 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-15T18:26:17.713 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-15T18:26:18.766 INFO:tasks.workunit.client.1.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-15T18:26:18.858 INFO:tasks.workunit.client.1.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-15T18:26:18.898 INFO:tasks.workunit.client.1.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-15T18:26:18.900 INFO:tasks.workunit.client.1.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-15T18:26:18.900 INFO:tasks.workunit.client.1.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-15T18:26:18.917 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:16.906346+0000 mgr.smithi133.nxzroj (mgr.24343) 15 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:18.937 INFO:tasks.workunit.client.1.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-15T18:26:18.940 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-02-15T18:26:18.940 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-15T18:26:18.998 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-15T18:26:19.000 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-15T18:26:19.000 DEBUG:teuthology.orchestra.run.smithi133:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedfc49c6a823fb0ff75911e476e1f3cb464ad3e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-15T18:26:19.008 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:16.906346+0000 mgr.smithi133.nxzroj (mgr.24343) 15 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:19.030 INFO:tasks.workunit.client.1.smithi133.stderr:+ mkdir -p fsstress 2024-02-15T18:26:19.032 INFO:tasks.workunit.client.1.smithi133.stderr:+ pushd fsstress 2024-02-15T18:26:19.032 INFO:tasks.workunit.client.1.smithi133.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T18:26:19.033 INFO:tasks.workunit.client.1.smithi133.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-15T18:26:19.079 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-15T18:26:19.273 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-15T18:26:19.310 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-15T18:26:19.311 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-15T18:26:19.311 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-15T18:26:19.348 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-15T18:26:19.352 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-02-15T18:26:19.352 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-15T18:26:19.370 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-15T18:26:19.371 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-15T18:26:19.371 DEBUG:teuthology.orchestra.run.smithi084:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedfc49c6a823fb0ff75911e476e1f3cb464ad3e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-15T18:26:19.432 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir -p fsstress 2024-02-15T18:26:19.434 INFO:tasks.workunit.client.0.smithi084.stderr:+ pushd fsstress 2024-02-15T18:26:19.435 INFO:tasks.workunit.client.0.smithi084.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T18:26:19.435 INFO:tasks.workunit.client.0.smithi084.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-15T18:26:20.035 INFO:tasks.workunit.client.1.smithi133.stderr:+ tar xzf ltp-full.tgz 2024-02-15T18:26:20.474 INFO:tasks.workunit.client.0.smithi084.stderr:+ tar xzf ltp-full.tgz 2024-02-15T18:26:21.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:18.906794+0000 mgr.smithi133.nxzroj (mgr.24343) 16 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:21.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:18.906794+0000 mgr.smithi133.nxzroj (mgr.24343) 16 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:22.987 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:20.907142+0000 mgr.smithi133.nxzroj (mgr.24343) 17 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:23.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:20.907142+0000 mgr.smithi133.nxzroj (mgr.24343) 17 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 14 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:24.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:22.907668+0000 mgr.smithi133.nxzroj (mgr.24343) 18 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 4.0 MiB data, 44 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-02-15T18:26:24.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:22.975937+0000 mon.smithi084 (mon.0) 624 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:24.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:22.979927+0000 mon.smithi084 (mon.0) 625 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:26:24.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:22.980521+0000 mgr.smithi133.nxzroj (mgr.24343) 19 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:26:24.251 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:22.981543+0000 mon.smithi084 (mon.0) 626 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi084.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T18:26:24.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:22.981992+0000 mgr.smithi133.nxzroj (mgr.24343) 20 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi084.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T18:26:24.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:22.985087+0000 mon.smithi084 (mon.0) 627 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:24.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:22.987814+0000 mon.smithi084 (mon.0) 628 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:24.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:22.992401+0000 mon.smithi084 (mon.0) 629 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:24.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:22.993340+0000 mgr.smithi133.nxzroj (mgr.24343) 21 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi133.nxzroj) 2024-02-15T18:26:24.252 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:22.993870+0000 mgr.smithi133.nxzroj (mgr.24343) 22 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi133.nxzroj) 2024-02-15T18:26:24.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:22.907668+0000 mgr.smithi133.nxzroj (mgr.24343) 18 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 4.0 MiB data, 44 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-02-15T18:26:24.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:22.975937+0000 mon.smithi084 (mon.0) 624 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:22.979927+0000 mon.smithi084 (mon.0) 625 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:26:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:22.980521+0000 mgr.smithi133.nxzroj (mgr.24343) 19 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:26:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:22.981543+0000 mon.smithi084 (mon.0) 626 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi084.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T18:26:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:22.981992+0000 mgr.smithi133.nxzroj (mgr.24343) 20 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi084.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T18:26:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:22.985087+0000 mon.smithi084 (mon.0) 627 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:22.987814+0000 mon.smithi084 (mon.0) 628 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:22.992401+0000 mon.smithi084 (mon.0) 629 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:22.993340+0000 mgr.smithi133.nxzroj (mgr.24343) 21 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi133.nxzroj) 2024-02-15T18:26:24.396 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:22.993870+0000 mgr.smithi133.nxzroj (mgr.24343) 22 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi133.nxzroj) 2024-02-15T18:26:25.992 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:24.726811+0000 mgr.smithi133.nxzroj (mgr.24343) 23 : cephadm [INF] Upgrade: Updating mgr.smithi084.hjmnez 2024-02-15T18:26:25.993 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:24.733547+0000 mon.smithi084 (mon.0) 630 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:25.993 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:24.737772+0000 mon.smithi084 (mon.0) 631 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.hjmnez", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:26:25.993 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:24.746011+0000 mon.smithi084 (mon.0) 632 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:26:25.993 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:24.754603+0000 mon.smithi084 (mon.0) 633 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:26.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:24.726811+0000 mgr.smithi133.nxzroj (mgr.24343) 23 : cephadm [INF] Upgrade: Updating mgr.smithi084.hjmnez 2024-02-15T18:26:26.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:24.733547+0000 mon.smithi084 (mon.0) 630 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:26.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:24.737772+0000 mon.smithi084 (mon.0) 631 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi084.hjmnez", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:26:26.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:24.746011+0000 mon.smithi084 (mon.0) 632 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:26:26.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:24.754603+0000 mon.smithi084 (mon.0) 633 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:27.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:24.760554+0000 mgr.smithi133.nxzroj (mgr.24343) 24 : cephadm [INF] Deploying daemon mgr.smithi084.hjmnez on smithi084 2024-02-15T18:26:27.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:24.913383+0000 mgr.smithi133.nxzroj (mgr.24343) 25 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 4.0 MiB data, 44 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-02-15T18:26:27.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:24.760554+0000 mgr.smithi133.nxzroj (mgr.24343) 24 : cephadm [INF] Deploying daemon mgr.smithi084.hjmnez on smithi084 2024-02-15T18:26:27.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:24.913383+0000 mgr.smithi133.nxzroj (mgr.24343) 25 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 4.0 MiB data, 44 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-02-15T18:26:29.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:26.913761+0000 mgr.smithi133.nxzroj (mgr.24343) 26 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 4.0 MiB data, 44 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-02-15T18:26:29.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:26.913761+0000 mgr.smithi133.nxzroj (mgr.24343) 26 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 4.0 MiB data, 44 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-02-15T18:26:30.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:28.798390+0000 mon.smithi084 (mon.0) 634 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:30.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:28.799275+0000 mon.smithi084 (mon.0) 635 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:30.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:28.914313+0000 mgr.smithi133.nxzroj (mgr.24343) 27 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 55 MiB data, 243 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s wr, 407 op/s 2024-02-15T18:26:30.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:28.798390+0000 mon.smithi084 (mon.0) 634 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:30.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:28.799275+0000 mon.smithi084 (mon.0) 635 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:30.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:28.914313+0000 mgr.smithi133.nxzroj (mgr.24343) 27 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 55 MiB data, 243 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s wr, 407 op/s 2024-02-15T18:26:32.974 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:30.914692+0000 mgr.smithi133.nxzroj (mgr.24343) 28 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 55 MiB data, 243 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s wr, 407 op/s 2024-02-15T18:26:33.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:30.914692+0000 mgr.smithi133.nxzroj (mgr.24343) 28 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 55 MiB data, 243 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s wr, 407 op/s 2024-02-15T18:26:33.931 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:32.717101+0000 mon.smithi084 (mon.0) 636 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:26:34.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:32.717101+0000 mon.smithi084 (mon.0) 636 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:26:34.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.738+0000 7f51389f8700 1 -- 172.21.15.84:0/1899777944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51340f55c0 msgr2=0x7f51340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.738+0000 7f51389f8700 1 --2- 172.21.15.84:0/1899777944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51340f55c0 0x7f51340f59e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f5124004660 tx=0x7f5124009b30).stop 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.738+0000 7f51389f8700 1 -- 172.21.15.84:0/1899777944 shutdown_connections 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.738+0000 7f51389f8700 1 --2- 172.21.15.84:0/1899777944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51340f6860 0x7f51340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.738+0000 7f51389f8700 1 --2- 172.21.15.84:0/1899777944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51340f55c0 0x7f51340f59e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.738+0000 7f51389f8700 1 -- 172.21.15.84:0/1899777944 >> 172.21.15.84:0/1899777944 conn(0x7f51340f0d40 msgr2=0x7f51340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.738+0000 7f51389f8700 1 -- 172.21.15.84:0/1899777944 shutdown_connections 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.738+0000 7f51389f8700 1 -- 172.21.15.84:0/1899777944 wait complete. 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f51389f8700 1 Processor -- start 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f51389f8700 1 -- start start 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f51389f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51340f55c0 0x7f51341091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f51389f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51340f6860 0x7f51341096a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f51389f8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5134109c50 con 0x7f51340f55c0 2024-02-15T18:26:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f51389f8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5134109d90 con 0x7f51340f6860 2024-02-15T18:26:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f5131d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51340f6860 0x7f51341096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f513259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51340f55c0 0x7f51341091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f5131d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51340f6860 0x7f51341096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.84:40378/0 (socket says 172.21.15.84:40378) 2024-02-15T18:26:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f5131d9b700 1 -- 172.21.15.84:0/302919672 learned_addr learned my addr 172.21.15.84:0/302919672 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f5131d9b700 1 -- 172.21.15.84:0/302919672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51340f55c0 msgr2=0x7f51341091b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f5131d9b700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51340f55c0 0x7f51341091b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f5131d9b700 1 -- 172.21.15.84:0/302919672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124005040 con 0x7f51340f6860 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.739+0000 7f513259c700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51340f55c0 0x7f51341091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.740+0000 7f5131d9b700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51340f6860 0x7f51341096a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f512800e7f0 tx=0x7f512800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.740+0000 7f5122ffd700 1 -- 172.21.15.84:0/302919672 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51280092e0 con 0x7f51340f6860 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.740+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513410a730 con 0x7f51340f6860 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.740+0000 7f5122ffd700 1 -- 172.21.15.84:0/302919672 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f512800f040 con 0x7f51340f6860 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.740+0000 7f5122ffd700 1 -- 172.21.15.84:0/302919672 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5128014850 con 0x7f51340f6860 2024-02-15T18:26:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.740+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513410acf0 con 0x7f51340f6860 2024-02-15T18:26:34.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.741+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5134045ad0 con 0x7f51340f6860 2024-02-15T18:26:34.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.741+0000 7f5122ffd700 1 -- 172.21.15.84:0/302919672 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 77196+0+0 (secure 0 0 0) 0x7f512801b030 con 0x7f51340f6860 2024-02-15T18:26:34.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.742+0000 7f5122ffd700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f511c060fb0 0x7f511c063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:34.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.742+0000 7f5122ffd700 1 -- 172.21.15.84:0/302919672 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f512807bdf0 con 0x7f51340f6860 2024-02-15T18:26:34.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.742+0000 7f513259c700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f511c060fb0 0x7f511c063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:34.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.742+0000 7f513259c700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f511c060fb0 0x7f511c063470 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5124005010 tx=0x7f5124016040).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:34.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.747+0000 7f5122ffd700 1 -- 172.21.15.84:0/302919672 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f512804fdc0 con 0x7f51340f6860 2024-02-15T18:26:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.958+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 --> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51340faaa0 con 0x7f511c060fb0 2024-02-15T18:26:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.960+0000 7f5122ffd700 1 -- 172.21.15.84:0/302919672 <== mgr.24343 v2:172.21.15.133:6828/3317013208 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f51340faaa0 con 0x7f511c060fb0 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f511c060fb0 msgr2=0x7f511c063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f511c060fb0 0x7f511c063470 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5124005010 tx=0x7f5124016040).stop 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51340f6860 msgr2=0x7f51341096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51340f6860 0x7f51341096a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f512800e7f0 tx=0x7f512800b040).stop 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 shutdown_connections 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f511c060fb0 0x7f511c063470 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51340f55c0 0x7f51341091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 --2- 172.21.15.84:0/302919672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51340f6860 0x7f51341096a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 >> 172.21.15.84:0/302919672 conn(0x7f51340f0d40 msgr2=0x7f513405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 shutdown_connections 2024-02-15T18:26:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:34.962+0000 7f51389f8700 1 -- 172.21.15.84:0/302919672 wait complete. 2024-02-15T18:26:34.969 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:26:35.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:32.915118+0000 mgr.smithi133.nxzroj (mgr.24343) 29 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 70 MiB data, 290 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s wr, 417 op/s 2024-02-15T18:26:35.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:34.529695+0000 mon.smithi084 (mon.0) 637 : cluster [DBG] Standby manager daemon smithi084.hjmnez restarted 2024-02-15T18:26:35.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:34.529830+0000 mon.smithi084 (mon.0) 638 : cluster [DBG] Standby manager daemon smithi084.hjmnez started 2024-02-15T18:26:35.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:34.531684+0000 mon.smithi084 (mon.0) 639 : audit [DBG] from='mgr.? 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.hjmnez/crt"}]: dispatch 2024-02-15T18:26:35.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:34.532108+0000 mon.smithi084 (mon.0) 640 : audit [DBG] from='mgr.? 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:26:35.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:34.534379+0000 mon.smithi084 (mon.0) 641 : audit [DBG] from='mgr.? 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.hjmnez/key"}]: dispatch 2024-02-15T18:26:35.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:34.535559+0000 mon.smithi084 (mon.0) 642 : audit [DBG] from='mgr.? 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:26:35.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.081+0000 7f55b5f10700 1 -- 172.21.15.84:0/2227854224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b00f55c0 msgr2=0x7f55b00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.081+0000 7f55b5f10700 1 --2- 172.21.15.84:0/2227854224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b00f55c0 0x7f55b00f59e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f55a0004660 tx=0x7f55a0009b30).stop 2024-02-15T18:26:35.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.081+0000 7f55b5f10700 1 -- 172.21.15.84:0/2227854224 shutdown_connections 2024-02-15T18:26:35.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.081+0000 7f55b5f10700 1 --2- 172.21.15.84:0/2227854224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b00f6860 0x7f55b00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.081+0000 7f55b5f10700 1 --2- 172.21.15.84:0/2227854224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b00f55c0 0x7f55b00f59e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.081+0000 7f55b5f10700 1 -- 172.21.15.84:0/2227854224 >> 172.21.15.84:0/2227854224 conn(0x7f55b00f0d40 msgr2=0x7f55b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:35.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.082+0000 7f55b5f10700 1 -- 172.21.15.84:0/2227854224 shutdown_connections 2024-02-15T18:26:35.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.082+0000 7f55b5f10700 1 -- 172.21.15.84:0/2227854224 wait complete. 2024-02-15T18:26:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.082+0000 7f55b5f10700 1 Processor -- start 2024-02-15T18:26:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.082+0000 7f55b5f10700 1 -- start start 2024-02-15T18:26:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55b5f10700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b00f55c0 0x7f55b010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55b5f10700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b00f6860 0x7f55b010e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55b5f10700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00602b0 con 0x7f55b00f55c0 2024-02-15T18:26:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55b5f10700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00603f0 con 0x7f55b00f6860 2024-02-15T18:26:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b00f55c0 0x7f55b010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55af7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b00f55c0 0x7f55b010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32838/0 (socket says 172.21.15.84:32838) 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55af7fe700 1 -- 172.21.15.84:0/323435138 learned_addr learned my addr 172.21.15.84:0/323435138 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55aeffd700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b00f6860 0x7f55b010e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55af7fe700 1 -- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b00f6860 msgr2=0x7f55b010e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55af7fe700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b00f6860 0x7f55b010e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55af7fe700 1 -- 172.21.15.84:0/323435138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4005040 con 0x7f55b00f55c0 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f55af7fe700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b00f55c0 0x7f55b010c170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f55a0002040 tx=0x7f55a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.083+0000 7f5597fff700 1 -- 172.21.15.84:0/323435138 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55a0019070 con 0x7f55b00f55c0 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.084+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a0005040 con 0x7f55b00f55c0 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.084+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b010eda0 con 0x7f55b00f55c0 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.084+0000 7f5597fff700 1 -- 172.21.15.84:0/323435138 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f55a0014420 con 0x7f55b00f55c0 2024-02-15T18:26:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.084+0000 7f5597fff700 1 -- 172.21.15.84:0/323435138 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55a001d5c0 con 0x7f55b00f55c0 2024-02-15T18:26:35.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.084+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5590004fa0 con 0x7f55b00f55c0 2024-02-15T18:26:35.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.085+0000 7f5597fff700 1 -- 172.21.15.84:0/323435138 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) v1 ==== 77196+0+0 (secure 0 0 0) 0x7f55a0025070 con 0x7f55b00f55c0 2024-02-15T18:26:35.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.086+0000 7f5597fff700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5598061000 0x7f55980634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:35.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.086+0000 7f5597fff700 1 -- 172.21.15.84:0/323435138 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f55a007cfa0 con 0x7f55b00f55c0 2024-02-15T18:26:35.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.086+0000 7f55aeffd700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5598061000 0x7f55980634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:35.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.086+0000 7f55aeffd700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5598061000 0x7f55980634c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f55a4007f80 tx=0x7f55a4009b30).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:35.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.090+0000 7f5597fff700 1 -- 172.21.15.84:0/323435138 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f55a004d450 con 0x7f55b00f55c0 2024-02-15T18:26:35.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:32.915118+0000 mgr.smithi133.nxzroj (mgr.24343) 29 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 70 MiB data, 290 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s wr, 417 op/s 2024-02-15T18:26:35.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:34.529695+0000 mon.smithi084 (mon.0) 637 : cluster [DBG] Standby manager daemon smithi084.hjmnez restarted 2024-02-15T18:26:35.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:34.529830+0000 mon.smithi084 (mon.0) 638 : cluster [DBG] Standby manager daemon smithi084.hjmnez started 2024-02-15T18:26:35.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:34.531684+0000 mon.smithi084 (mon.0) 639 : audit [DBG] from='mgr.? 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.hjmnez/crt"}]: dispatch 2024-02-15T18:26:35.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:34.532108+0000 mon.smithi084 (mon.0) 640 : audit [DBG] from='mgr.? 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:26:35.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:34.534379+0000 mon.smithi084 (mon.0) 641 : audit [DBG] from='mgr.? 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi084.hjmnez/key"}]: dispatch 2024-02-15T18:26:35.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:34.535559+0000 mon.smithi084 (mon.0) 642 : audit [DBG] from='mgr.? 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:26:35.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.343+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 --> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5590000bc0 con 0x7f5598061000 2024-02-15T18:26:35.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.344+0000 7f5597fff700 1 -- 172.21.15.84:0/323435138 <== mgr.24343 v2:172.21.15.133:6828/3317013208 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f5590000bc0 con 0x7f5598061000 2024-02-15T18:26:35.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.346+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5598061000 msgr2=0x7f55980634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.346+0000 7f55b5f10700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5598061000 0x7f55980634c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f55a4007f80 tx=0x7f55a4009b30).stop 2024-02-15T18:26:35.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.346+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b00f55c0 msgr2=0x7f55b010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.346+0000 7f55b5f10700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b00f55c0 0x7f55b010c170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f55a0002040 tx=0x7f55a000b040).stop 2024-02-15T18:26:35.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.347+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 shutdown_connections 2024-02-15T18:26:35.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.347+0000 7f55b5f10700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5598061000 0x7f55980634c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.347+0000 7f55b5f10700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b00f55c0 0x7f55b010c170 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.347+0000 7f55b5f10700 1 --2- 172.21.15.84:0/323435138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55b00f6860 0x7f55b010e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.347+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 >> 172.21.15.84:0/323435138 conn(0x7f55b00f0d40 msgr2=0x7f55b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:35.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.347+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 shutdown_connections 2024-02-15T18:26:35.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.347+0000 7f55b5f10700 1 -- 172.21.15.84:0/323435138 wait complete. 2024-02-15T18:26:35.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.478+0000 7f5f8e250700 1 -- 172.21.15.84:0/2286332243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f880f6860 msgr2=0x7f5f880f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.478+0000 7f5f8e250700 1 --2- 172.21.15.84:0/2286332243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f880f6860 0x7f5f880f6cc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f5f780099e0 tx=0x7f5f78004d10).stop 2024-02-15T18:26:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.481+0000 7f5f8e250700 1 -- 172.21.15.84:0/2286332243 shutdown_connections 2024-02-15T18:26:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.481+0000 7f5f8e250700 1 --2- 172.21.15.84:0/2286332243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f880f6860 0x7f5f880f6cc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.481+0000 7f5f8e250700 1 --2- 172.21.15.84:0/2286332243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880f55c0 0x7f5f880f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.481+0000 7f5f8e250700 1 -- 172.21.15.84:0/2286332243 >> 172.21.15.84:0/2286332243 conn(0x7f5f880f0d40 msgr2=0x7f5f880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.481+0000 7f5f8e250700 1 -- 172.21.15.84:0/2286332243 shutdown_connections 2024-02-15T18:26:35.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.482+0000 7f5f8e250700 1 -- 172.21.15.84:0/2286332243 wait complete. 2024-02-15T18:26:35.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.482+0000 7f5f8e250700 1 Processor -- start 2024-02-15T18:26:35.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.482+0000 7f5f8e250700 1 -- start start 2024-02-15T18:26:35.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f8e250700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880f55c0 0x7f5f88107130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f8e250700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f880f6860 0x7f5f88107620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f8e250700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f88107bd0 con 0x7f5f880f6860 2024-02-15T18:26:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f8e250700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f88107d10 con 0x7f5f880f55c0 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f877fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880f55c0 0x7f5f88107130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f877fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880f55c0 0x7f5f88107130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.84:40420/0 (socket says 172.21.15.84:40420) 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f877fe700 1 -- 172.21.15.84:0/1249418863 learned_addr learned my addr 172.21.15.84:0/1249418863 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f86ffd700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f880f6860 0x7f5f88107620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f877fe700 1 -- 172.21.15.84:0/1249418863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f880f6860 msgr2=0x7f5f88107620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f877fe700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f880f6860 0x7f5f88107620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f877fe700 1 -- 172.21.15.84:0/1249418863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c005040 con 0x7f5f880f55c0 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.483+0000 7f5f877fe700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880f55c0 0x7f5f88107130 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5f7c0048a0 tx=0x7f5f7c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.484+0000 7f5f6ffff700 1 -- 172.21.15.84:0/1249418863 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7c00e030 con 0x7f5f880f55c0 2024-02-15T18:26:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.484+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f78009640 con 0x7f5f880f55c0 2024-02-15T18:26:35.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.484+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f88108ae0 con 0x7f5f880f55c0 2024-02-15T18:26:35.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.484+0000 7f5f6ffff700 1 -- 172.21.15.84:0/1249418863 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f5f7c00f040 con 0x7f5f880f55c0 2024-02-15T18:26:35.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.484+0000 7f5f6ffff700 1 -- 172.21.15.84:0/1249418863 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7c014690 con 0x7f5f880f55c0 2024-02-15T18:26:35.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.485+0000 7f5f6ffff700 1 -- 172.21.15.84:0/1249418863 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 77196+0+0 (secure 0 0 0) 0x7f5f7c0147f0 con 0x7f5f880f55c0 2024-02-15T18:26:35.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.485+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f68004fa0 con 0x7f5f880f55c0 2024-02-15T18:26:35.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.485+0000 7f5f6ffff700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5f70060fb0 0x7f5f70063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:35.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.486+0000 7f5f6ffff700 1 -- 172.21.15.84:0/1249418863 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5f7c07c3b0 con 0x7f5f880f55c0 2024-02-15T18:26:35.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.486+0000 7f5f86ffd700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5f70060fb0 0x7f5f70063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:35.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.486+0000 7f5f86ffd700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5f70060fb0 0x7f5f70063470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f5f78003380 tx=0x7f5f78015040).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:35.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.490+0000 7f5f6ffff700 1 -- 172.21.15.84:0/1249418863 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f5f7c050210 con 0x7f5f880f55c0 2024-02-15T18:26:35.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.731+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 --> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f68000bc0 con 0x7f5f70060fb0 2024-02-15T18:26:35.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.741+0000 7f5f6ffff700 1 -- 172.21.15.84:0/1249418863 <== mgr.24343 v2:172.21.15.133:6828/3317013208 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f5f68000bc0 con 0x7f5f70060fb0 2024-02-15T18:26:35.738 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:26:35.738 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (6m) 0s ago 7m 15.4M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:26:35.738 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (7m) 0s ago 7m 6387k - 16.2.4 8d91d370c2b8 cfe2961e55e3 2024-02-15T18:26:35.738 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (6m) 30s ago 6m 6400k - 16.2.4 8d91d370c2b8 d52ceb5fe65b 2024-02-15T18:26:35.738 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (5m) 0s ago 7m 34.4M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:26:35.738 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (2m) 0s ago 2m 18.7M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:26:35.738 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (2m) 0s ago 2m 12.3M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:26:35.738 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (2m) 30s ago 2m 19.5M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (2m) 30s ago 2m 12.6M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (7s) 0s ago 9m 44.4M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (43s) 30s ago 6m 412M - 16.2.14-521-g0e714d9a 1fbc92c859dc db78861bd359 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (9m) 0s ago 9m 49.9M 2048M 16.2.4 8d91d370c2b8 77f1f72e867c 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (6m) 30s ago 6m 41.7M 2048M 16.2.4 8d91d370c2b8 c65c0defe0dd 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (7m) 0s ago 7m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (6m) 30s ago 6m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 0s ago 5m 80.0M 4096M 16.2.4 8d91d370c2b8 20023f9a2292 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 0s ago 5m 79.0M 4096M 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 0s ago 5m 71.7M 4096M 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (4m) 30s ago 4m 44.0M 4096M 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (4m) 30s ago 4m 41.5M 4096M 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (4m) 30s ago 4m 39.7M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:26:35.739 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (13s) 0s ago 6m 39.3M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:26:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.743+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5f70060fb0 msgr2=0x7f5f70063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.743+0000 7f5f8e250700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5f70060fb0 0x7f5f70063470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f5f78003380 tx=0x7f5f78015040).stop 2024-02-15T18:26:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.743+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880f55c0 msgr2=0x7f5f88107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.743+0000 7f5f8e250700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880f55c0 0x7f5f88107130 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5f7c0048a0 tx=0x7f5f7c009b30).stop 2024-02-15T18:26:35.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.743+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 shutdown_connections 2024-02-15T18:26:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.743+0000 7f5f8e250700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f5f70060fb0 0x7f5f70063470 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.743+0000 7f5f8e250700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880f55c0 0x7f5f88107130 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.743+0000 7f5f8e250700 1 --2- 172.21.15.84:0/1249418863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f880f6860 0x7f5f88107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.743+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 >> 172.21.15.84:0/1249418863 conn(0x7f5f880f0d40 msgr2=0x7f5f880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.745+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 shutdown_connections 2024-02-15T18:26:35.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.745+0000 7f5f8e250700 1 -- 172.21.15.84:0/1249418863 wait complete. 2024-02-15T18:26:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.864+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/819022028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f6860 msgr2=0x7f8b680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.864+0000 7f8b6ed2a700 1 --2- 172.21.15.84:0/819022028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f6860 0x7f8b680f6cc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f8b54004660 tx=0x7f8b54009b30).stop 2024-02-15T18:26:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.864+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/819022028 shutdown_connections 2024-02-15T18:26:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.864+0000 7f8b6ed2a700 1 --2- 172.21.15.84:0/819022028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f6860 0x7f8b680f6cc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.864+0000 7f8b6ed2a700 1 --2- 172.21.15.84:0/819022028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b680f55c0 0x7f8b680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.864+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/819022028 >> 172.21.15.84:0/819022028 conn(0x7f8b680f0d40 msgr2=0x7f8b680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.864+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/819022028 shutdown_connections 2024-02-15T18:26:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.864+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/819022028 wait complete. 2024-02-15T18:26:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.865+0000 7f8b6ed2a700 1 Processor -- start 2024-02-15T18:26:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.865+0000 7f8b6ed2a700 1 -- start start 2024-02-15T18:26:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6ed2a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f55c0 0x7f8b68109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6ed2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b680f6860 0x7f8b6810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6ed2a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680603e0 con 0x7f8b680f55c0 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6ed2a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b68060520 con 0x7f8b680f6860 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6cac6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f55c0 0x7f8b68109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6cac6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f55c0 0x7f8b68109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32866/0 (socket says 172.21.15.84:32866) 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6cac6700 1 -- 172.21.15.84:0/3379587181 learned_addr learned my addr 172.21.15.84:0/3379587181 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b67fff700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b680f6860 0x7f8b6810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6cac6700 1 -- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b680f6860 msgr2=0x7f8b6810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6cac6700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b680f6860 0x7f8b6810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6cac6700 1 -- 172.21.15.84:0/3379587181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b54005040 con 0x7f8b680f55c0 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6cac6700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f55c0 0x7f8b68109cb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f8b5c00e7c0 tx=0x7f8b5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b657fa700 1 -- 172.21.15.84:0/3379587181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5c0092e0 con 0x7f8b680f55c0 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6810c760 con 0x7f8b680f55c0 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b657fa700 1 -- 172.21.15.84:0/3379587181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f8b5c00f040 con 0x7f8b680f55c0 2024-02-15T18:26:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b657fa700 1 -- 172.21.15.84:0/3379587181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5c014920 con 0x7f8b680f55c0 2024-02-15T18:26:35.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.866+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6810cd20 con 0x7f8b680f55c0 2024-02-15T18:26:35.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.867+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b68045ad0 con 0x7f8b680f55c0 2024-02-15T18:26:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.868+0000 7f8b657fa700 1 -- 172.21.15.84:0/3379587181 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) v1 ==== 77196+0+0 (secure 0 0 0) 0x7f8b5c01b030 con 0x7f8b680f55c0 2024-02-15T18:26:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.868+0000 7f8b657fa700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8b58060fb0 0x7f8b58063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.868+0000 7f8b657fa700 1 -- 172.21.15.84:0/3379587181 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8b5c07c0d0 con 0x7f8b680f55c0 2024-02-15T18:26:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.868+0000 7f8b67fff700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8b58060fb0 0x7f8b58063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.869+0000 7f8b67fff700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8b58060fb0 0x7f8b58063470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8b54009720 tx=0x7f8b54016040).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:35.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:35.872+0000 7f8b657fa700 1 -- 172.21.15.84:0/3379587181 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f8b5c04c4c0 con 0x7f8b680f55c0 2024-02-15T18:26:36.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:34.730669+0000 mon.smithi084 (mon.0) 643 : cluster [DBG] mgrmap e24: smithi133.nxzroj(active, since 33s), standbys: smithi084.hjmnez 2024-02-15T18:26:36.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.664831+0000 mon.smithi084 (mon.0) 644 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:36.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.665735+0000 mon.smithi084 (mon.0) 645 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:36.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.666578+0000 mon.smithi084 (mon.0) 646 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:26:36.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.670540+0000 mon.smithi084 (mon.0) 647 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:36.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.675456+0000 mon.smithi084 (mon.0) 648 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:36.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.679928+0000 mon.smithi084 (mon.0) 649 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mgr fail", "who": "smithi133.nxzroj"}]: dispatch 2024-02-15T18:26:36.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:35.683740+0000 mon.smithi084 (mon.0) 650 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-02-15T18:26:36.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.686392+0000 mon.smithi084 (mon.0) 651 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:26:36.011 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.688166+0000 mon.smithi084 (mon.0) 652 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:34.730669+0000 mon.smithi084 (mon.0) 643 : cluster [DBG] mgrmap e24: smithi133.nxzroj(active, since 33s), standbys: smithi084.hjmnez 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.664831+0000 mon.smithi084 (mon.0) 644 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.665735+0000 mon.smithi084 (mon.0) 645 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.666578+0000 mon.smithi084 (mon.0) 646 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.670540+0000 mon.smithi084 (mon.0) 647 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.675456+0000 mon.smithi084 (mon.0) 648 : audit [DBG] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.679928+0000 mon.smithi084 (mon.0) 649 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "mgr fail", "who": "smithi133.nxzroj"}]: dispatch 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:35.683740+0000 mon.smithi084 (mon.0) 650 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.686392+0000 mon.smithi084 (mon.0) 651 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:26:36.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.688166+0000 mon.smithi084 (mon.0) 652 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:26:36.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.168+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b68027a00 con 0x7f8b680f55c0 2024-02-15T18:26:36.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.169+0000 7f8b657fa700 1 -- 172.21.15.84:0/3379587181 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+697 (secure 0 0 0) 0x7f8b5c019070 con 0x7f8b680f55c0 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:26:36.166 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:26:36.167 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2, 2024-02-15T18:26:36.167 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12 2024-02-15T18:26:36.167 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:26:36.167 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:26:36.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8b58060fb0 msgr2=0x7f8b58063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8b58060fb0 0x7f8b58063470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8b54009720 tx=0x7f8b54016040).stop 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f55c0 msgr2=0x7f8b68109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f55c0 0x7f8b68109cb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f8b5c00e7c0 tx=0x7f8b5c00b040).stop 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 shutdown_connections 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f8b58060fb0 0x7f8b58063470 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b680f55c0 0x7f8b68109cb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 --2- 172.21.15.84:0/3379587181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b680f6860 0x7f8b6810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 >> 172.21.15.84:0/3379587181 conn(0x7f8b680f0d40 msgr2=0x7f8b680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 shutdown_connections 2024-02-15T18:26:36.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.171+0000 7f8b6ed2a700 1 -- 172.21.15.84:0/3379587181 wait complete. 2024-02-15T18:26:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.279+0000 7f749ec97700 1 -- 172.21.15.84:0/3125303694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f6860 msgr2=0x7f74980f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.279+0000 7f749ec97700 1 --2- 172.21.15.84:0/3125303694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f6860 0x7f74980f6cc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f7484004660 tx=0x7f7484009b30).stop 2024-02-15T18:26:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.279+0000 7f749ec97700 1 -- 172.21.15.84:0/3125303694 shutdown_connections 2024-02-15T18:26:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.279+0000 7f749ec97700 1 --2- 172.21.15.84:0/3125303694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f6860 0x7f74980f6cc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.279+0000 7f749ec97700 1 --2- 172.21.15.84:0/3125303694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74980f55c0 0x7f74980f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.279+0000 7f749ec97700 1 -- 172.21.15.84:0/3125303694 >> 172.21.15.84:0/3125303694 conn(0x7f74980f0d40 msgr2=0x7f74980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.279+0000 7f749ec97700 1 -- 172.21.15.84:0/3125303694 shutdown_connections 2024-02-15T18:26:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.279+0000 7f749ec97700 1 -- 172.21.15.84:0/3125303694 wait complete. 2024-02-15T18:26:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f749ec97700 1 Processor -- start 2024-02-15T18:26:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f749ec97700 1 -- start start 2024-02-15T18:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f749ec97700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f55c0 0x7f749810c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f749ec97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74980f6860 0x7f749810e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f749ec97700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980602b0 con 0x7f74980f55c0 2024-02-15T18:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f749ec97700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980603f0 con 0x7f74980f6860 2024-02-15T18:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f749ca33700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f55c0 0x7f749810c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f749ca33700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f55c0 0x7f749810c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32892/0 (socket says 172.21.15.84:32892) 2024-02-15T18:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f749ca33700 1 -- 172.21.15.84:0/1277610331 learned_addr learned my addr 172.21.15.84:0/1277610331 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.280+0000 7f7497fff700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74980f6860 0x7f749810e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.281+0000 7f749ca33700 1 -- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74980f6860 msgr2=0x7f749810e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.281+0000 7f749ca33700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74980f6860 0x7f749810e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.281+0000 7f749ca33700 1 -- 172.21.15.84:0/1277610331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484005040 con 0x7f74980f55c0 2024-02-15T18:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.281+0000 7f749ca33700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f55c0 0x7f749810c0d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f748c00e7c0 tx=0x7f748c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.281+0000 7f74957fa700 1 -- 172.21.15.84:0/1277610331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f748c0092e0 con 0x7f74980f55c0 2024-02-15T18:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.281+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749810eac0 con 0x7f74980f55c0 2024-02-15T18:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.281+0000 7f74957fa700 1 -- 172.21.15.84:0/1277610331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f748c00f040 con 0x7f74980f55c0 2024-02-15T18:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.281+0000 7f74957fa700 1 -- 172.21.15.84:0/1277610331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f748c014920 con 0x7f74980f55c0 2024-02-15T18:26:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.281+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749810ef40 con 0x7f74980f55c0 2024-02-15T18:26:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.282+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7498045ad0 con 0x7f74980f55c0 2024-02-15T18:26:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.282+0000 7f74957fa700 1 -- 172.21.15.84:0/1277610331 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) v1 ==== 77196+0+0 (secure 0 0 0) 0x7f748c01b030 con 0x7f74980f55c0 2024-02-15T18:26:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.283+0000 7f74957fa700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f7488060fb0 0x7f7488063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.283+0000 7f74957fa700 1 -- 172.21.15.84:0/1277610331 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f748c07bed0 con 0x7f74980f55c0 2024-02-15T18:26:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.283+0000 7f7497fff700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f7488060fb0 0x7f7488063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:36.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.283+0000 7f7497fff700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f7488060fb0 0x7f7488063470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7484009720 tx=0x7f7484016040).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.287+0000 7f74957fa700 1 -- 172.21.15.84:0/1277610331 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f748c04c370 con 0x7f74980f55c0 2024-02-15T18:26:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.519+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f74980fdf90 con 0x7f74980f55c0 2024-02-15T18:26:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.520+0000 7f74957fa700 1 -- 172.21.15.84:0/1277610331 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1643 (secure 0 0 0) 0x7f748c019070 con 0x7f74980f55c0 2024-02-15T18:26:36.516 INFO:teuthology.orchestra.run.smithi084.stdout:e15 2024-02-15T18:26:36.516 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 15 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:26:32.713494+0000 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:26:36.517 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261]] 2024-02-15T18:26:36.518 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091]] 2024-02-15T18:26:36.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:26:36.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:26:36.519 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:26:36.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:26:36.519 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317]] 2024-02-15T18:26:36.519 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334]] 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f7488060fb0 msgr2=0x7f7488063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f7488060fb0 0x7f7488063470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7484009720 tx=0x7f7484016040).stop 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f55c0 msgr2=0x7f749810c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f55c0 0x7f749810c0d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f748c00e7c0 tx=0x7f748c00b040).stop 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 shutdown_connections 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7f7488060fb0 0x7f7488063470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74980f55c0 0x7f749810c0d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 --2- 172.21.15.84:0/1277610331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74980f6860 0x7f749810e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 >> 172.21.15.84:0/1277610331 conn(0x7f74980f0d40 msgr2=0x7f74980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 shutdown_connections 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.522+0000 7f749ec97700 1 -- 172.21.15.84:0/1277610331 wait complete. 2024-02-15T18:26:36.520 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1350542907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 msgr2=0x7fddf40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 --2- 172.21.15.84:0/1350542907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 0x7fddf40f6b00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fddf0004660 tx=0x7fddf0009b30).stop 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1350542907 shutdown_connections 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 --2- 172.21.15.84:0/1350542907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf40f7980 0x7fddf40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 --2- 172.21.15.84:0/1350542907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 0x7fddf40f6b00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1350542907 >> 172.21.15.84:0/1350542907 conn(0x7fddf40f1e40 msgr2=0x7fddf40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1350542907 shutdown_connections 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1350542907 wait complete. 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 Processor -- start 2024-02-15T18:26:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 -- start start 2024-02-15T18:26:36.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 0x7fddf4109250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:36.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf40f7980 0x7fddf4109740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4109cf0 con 0x7fddf40f66e0 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.632+0000 7fddfc2ee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4109e30 con 0x7fddf40f7980 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddfa08a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 0x7fddf4109250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddfa08a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 0x7fddf4109250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32910/0 (socket says 172.21.15.84:32910) 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddfa08a700 1 -- 172.21.15.84:0/1869902389 learned_addr learned my addr 172.21.15.84:0/1869902389 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddf9889700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf40f7980 0x7fddf4109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddfa08a700 1 -- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf40f7980 msgr2=0x7fddf4109740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddfa08a700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf40f7980 0x7fddf4109740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddfa08a700 1 -- 172.21.15.84:0/1869902389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0005040 con 0x7fddf40f66e0 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddfa08a700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 0x7fddf4109250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fddf0002040 tx=0x7fddf000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddf0019070 con 0x7fddf40f66e0 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fddf0007e80 con 0x7fddf40f66e0 2024-02-15T18:26:36.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddf0014db0 con 0x7fddf40f66e0 2024-02-15T18:26:36.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1869902389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf410a770 con 0x7fddf40f66e0 2024-02-15T18:26:36.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.633+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1869902389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf410acd0 con 0x7fddf40f66e0 2024-02-15T18:26:36.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.634+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1869902389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf4045ad0 con 0x7fddf40f66e0 2024-02-15T18:26:36.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.635+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) v1 ==== 77196+0+0 (secure 0 0 0) 0x7fddf0025070 con 0x7fddf40f66e0 2024-02-15T18:26:36.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.636+0000 7fddeaffd700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fdde0060f50 0x7fdde0063410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:36.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.636+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fddf007d0b0 con 0x7fddf40f66e0 2024-02-15T18:26:36.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.636+0000 7fddf9889700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fdde0060f50 0x7fdde0063410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:36.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.636+0000 7fddf9889700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fdde0060f50 0x7fdde0063410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fdde4009fd0 tx=0x7fdde400b040).ready entity=mgr.24343 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:36.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.640+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7fddf0050e70 con 0x7fddf40f66e0 2024-02-15T18:26:36.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.671+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 25) v1 ==== 38472+0+0 (secure 0 0 0) 0x7fddf007b000 con 0x7fddf40f66e0 2024-02-15T18:26:36.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.672+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fdde0060f50 msgr2=0x7fdde0063410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:36.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:36.672+0000 7fddeaffd700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fdde0060f50 0x7fdde0063410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fdde4009fd0 tx=0x7fdde400b040).stop 2024-02-15T18:26:36.946 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:34.915430+0000 mgr.smithi133.nxzroj (mgr.24343) 30 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 70 MiB data, 290 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s wr, 417 op/s 2024-02-15T18:26:36.946 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:34.960474+0000 mgr.smithi133.nxzroj (mgr.24343) 31 : audit [DBG] from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:36.946 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.345020+0000 mgr.smithi133.nxzroj (mgr.24343) 32 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:36.946 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:35.667240+0000 mgr.smithi133.nxzroj (mgr.24343) 33 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:26:36.946 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:35.677258+0000 mgr.smithi133.nxzroj (mgr.24343) 34 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi133.nxzroj) 2024-02-15T18:26:36.946 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:35.677586+0000 mgr.smithi133.nxzroj (mgr.24343) 35 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi133.nxzroj) 2024-02-15T18:26:36.946 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:35.679680+0000 mgr.smithi133.nxzroj (mgr.24343) 36 : cephadm [INF] Failing over to other MGR 2024-02-15T18:26:36.946 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:35.733138+0000 mgr.smithi133.nxzroj (mgr.24343) 37 : audit [DBG] from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.169881+0000 mon.smithi084 (mon.0) 653 : audit [DBG] from='client.? 172.21.15.84:0/3379587181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.520635+0000 mon.smithi084 (mon.0) 654 : audit [DBG] from='client.? 172.21.15.84:0/1277610331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.673648+0000 mon.smithi084 (mon.0) 655 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd='[{"prefix": "mgr fail", "who": "smithi133.nxzroj"}]': finished 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:36.673695+0000 mon.smithi084 (mon.0) 656 : cluster [DBG] mgrmap e25: smithi084.hjmnez(active, starting, since 0.993001s) 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.676974+0000 mon.smithi084 (mon.0) 657 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.677119+0000 mon.smithi084 (mon.0) 658 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.677735+0000 mon.smithi084 (mon.0) 659 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.678054+0000 mon.smithi084 (mon.0) 660 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.678322+0000 mon.smithi084 (mon.0) 661 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.678525+0000 mon.smithi084 (mon.0) 662 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.678667+0000 mon.smithi084 (mon.0) 663 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi084.hjmnez", "id": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.678780+0000 mon.smithi084 (mon.0) 664 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.678957+0000 mon.smithi084 (mon.0) 665 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.679133+0000 mon.smithi084 (mon.0) 666 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:36.947 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.679245+0000 mon.smithi084 (mon.0) 667 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:36.948 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.679358+0000 mon.smithi084 (mon.0) 668 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:36.948 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.679473+0000 mon.smithi084 (mon.0) 669 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:26:36.948 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.680194+0000 mon.smithi084 (mon.0) 670 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:26:36.948 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.680588+0000 mon.smithi084 (mon.0) 671 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:26:36.948 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.681137+0000 mon.smithi084 (mon.0) 672 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:26:36.948 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.687210+0000 mon.smithi084 (mon.0) 673 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:26:36.948 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:36.687288+0000 mon.smithi084 (mon.0) 674 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-02-15T18:26:36.948 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:36.708632+0000 mon.smithi084 (mon.0) 675 : cluster [INF] Manager daemon smithi084.hjmnez is now available 2024-02-15T18:26:36.948 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.726236+0000 mon.smithi084 (mon.0) 676 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:34.915430+0000 mgr.smithi133.nxzroj (mgr.24343) 30 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 70 MiB data, 290 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s wr, 417 op/s 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:34.960474+0000 mgr.smithi133.nxzroj (mgr.24343) 31 : audit [DBG] from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.345020+0000 mgr.smithi133.nxzroj (mgr.24343) 32 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:35.667240+0000 mgr.smithi133.nxzroj (mgr.24343) 33 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:35.677258+0000 mgr.smithi133.nxzroj (mgr.24343) 34 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi133.nxzroj) 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:35.677586+0000 mgr.smithi133.nxzroj (mgr.24343) 35 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi133.nxzroj) 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:35.679680+0000 mgr.smithi133.nxzroj (mgr.24343) 36 : cephadm [INF] Failing over to other MGR 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:35.733138+0000 mgr.smithi133.nxzroj (mgr.24343) 37 : audit [DBG] from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.169881+0000 mon.smithi084 (mon.0) 653 : audit [DBG] from='client.? 172.21.15.84:0/3379587181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.520635+0000 mon.smithi084 (mon.0) 654 : audit [DBG] from='client.? 172.21.15.84:0/1277610331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.673648+0000 mon.smithi084 (mon.0) 655 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd='[{"prefix": "mgr fail", "who": "smithi133.nxzroj"}]': finished 2024-02-15T18:26:36.949 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:36.673695+0000 mon.smithi084 (mon.0) 656 : cluster [DBG] mgrmap e25: smithi084.hjmnez(active, starting, since 0.993001s) 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.676974+0000 mon.smithi084 (mon.0) 657 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.677119+0000 mon.smithi084 (mon.0) 658 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.677735+0000 mon.smithi084 (mon.0) 659 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.678054+0000 mon.smithi084 (mon.0) 660 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.678322+0000 mon.smithi084 (mon.0) 661 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.678525+0000 mon.smithi084 (mon.0) 662 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.678667+0000 mon.smithi084 (mon.0) 663 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi084.hjmnez", "id": "smithi084.hjmnez"}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.678780+0000 mon.smithi084 (mon.0) 664 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.678957+0000 mon.smithi084 (mon.0) 665 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.679133+0000 mon.smithi084 (mon.0) 666 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.679245+0000 mon.smithi084 (mon.0) 667 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.679358+0000 mon.smithi084 (mon.0) 668 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.679473+0000 mon.smithi084 (mon.0) 669 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.680194+0000 mon.smithi084 (mon.0) 670 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.680588+0000 mon.smithi084 (mon.0) 671 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:26:36.950 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.681137+0000 mon.smithi084 (mon.0) 672 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:26:36.951 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.687210+0000 mon.smithi084 (mon.0) 673 : audit [INF] from='mgr.24343 172.21.15.133:0/2593263862' entity='mgr.smithi133.nxzroj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:26:36.951 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:36.687288+0000 mon.smithi084 (mon.0) 674 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-02-15T18:26:36.951 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:36.708632+0000 mon.smithi084 (mon.0) 675 : cluster [INF] Manager daemon smithi084.hjmnez is now available 2024-02-15T18:26:36.951 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.726236+0000 mon.smithi084 (mon.0) 676 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:26:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.687+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mgrmap(e 26) v1 ==== 38542+0+0 (secure 0 0 0) 0x7fddf007b380 con 0x7fddf40f66e0 2024-02-15T18:26:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.687+0000 7fddeaffd700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdde000dc00 0x7fdde0008430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.687+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdde0009300 con 0x7fdde000dc00 2024-02-15T18:26:37.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.693+0000 7fddf9889700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdde000dc00 0x7fdde0008430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:37.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.693+0000 7fddf9889700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdde000dc00 0x7fdde0008430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fdde4009fd0 tx=0x7fdde400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:37.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.696+0000 7fddeaffd700 1 -- 172.21.15.84:0/1869902389 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fdde0009300 con 0x7fdde000dc00 2024-02-15T18:26:37.693 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:26:37.693 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:26:37.693 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:26:37.693 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:26:37.693 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:26:37.693 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:26:37.693 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:26:37.693 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "2/21 daemons upgraded", 2024-02-15T18:26:37.694 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2024-02-15T18:26:37.694 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:26:37.694 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:26:37.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.698+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdde000dc00 msgr2=0x7fdde0008430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:37.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.698+0000 7fddfc2ee700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdde000dc00 0x7fdde0008430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fdde4009fd0 tx=0x7fdde400b040).stop 2024-02-15T18:26:37.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 msgr2=0x7fddf4109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:37.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 0x7fddf4109250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fddf0002040 tx=0x7fddf000b040).stop 2024-02-15T18:26:37.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1869902389 shutdown_connections 2024-02-15T18:26:37.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdde000dc00 0x7fdde0008430 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0x7fdde4009fd0 tx=0x7fdde400b040).stop 2024-02-15T18:26:37.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:6828/3317013208,v1:172.21.15.133:6829/3317013208] conn(0x7fdde0060f50 0x7fdde0063410 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:37.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf40f66e0 0x7fddf4109250 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:37.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 --2- 172.21.15.84:0/1869902389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddf40f7980 0x7fddf4109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:37.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1869902389 >> 172.21.15.84:0/1869902389 conn(0x7fddf40f1e40 msgr2=0x7fddf406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:37.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1869902389 shutdown_connections 2024-02-15T18:26:37.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:26:37.699+0000 7fddfc2ee700 1 -- 172.21.15.84:0/1869902389 wait complete. 2024-02-15T18:26:37.736 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:36.721305+0000 mgr.smithi084.hjmnez (mgr.14596) 1 : cephadm [INF] inventory: adjusted host smithi133 addr 'smithi133' -> '172.21.15.133' 2024-02-15T18:26:37.736 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.838360+0000 mon.smithi084 (mon.0) 677 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:37.736 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.840388+0000 mon.smithi084 (mon.0) 678 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:37.736 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.894813+0000 mon.smithi084 (mon.0) 679 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:26:37.736 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:36.901687+0000 mon.smithi084 (mon.0) 680 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:26:37.736 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:37.688546+0000 mon.smithi084 (mon.0) 681 : cluster [DBG] mgrmap e26: smithi084.hjmnez(active, since 2s) 2024-02-15T18:26:37.963 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:36.721305+0000 mgr.smithi084.hjmnez (mgr.14596) 1 : cephadm [INF] inventory: adjusted host smithi133 addr 'smithi133' -> '172.21.15.133' 2024-02-15T18:26:37.963 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.838360+0000 mon.smithi084 (mon.0) 677 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:37.963 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.840388+0000 mon.smithi084 (mon.0) 678 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:37.963 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.894813+0000 mon.smithi084 (mon.0) 679 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:26:37.963 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:36.901687+0000 mon.smithi084 (mon.0) 680 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi084.hjmnez/trash_purge_schedule"}]: dispatch 2024-02-15T18:26:37.963 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:37.688546+0000 mon.smithi084 (mon.0) 681 : cluster [DBG] mgrmap e26: smithi084.hjmnez(active, since 2s) 2024-02-15T18:26:39.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:37.696581+0000 mgr.smithi084.hjmnez (mgr.14596) 2 : audit [DBG] from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:39.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:37.698355+0000 mgr.smithi084.hjmnez (mgr.14596) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 89 MiB data, 352 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:39.046 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:37.696581+0000 mgr.smithi084.hjmnez (mgr.14596) 2 : audit [DBG] from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:39.046 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:37.698355+0000 mgr.smithi084.hjmnez (mgr.14596) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 89 MiB data, 352 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:40.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:38.679280+0000 mgr.smithi084.hjmnez (mgr.14596) 4 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 89 MiB data, 352 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:40.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:38.743292+0000 mon.smithi084 (mon.0) 682 : cluster [DBG] mgrmap e27: smithi084.hjmnez(active, since 3s) 2024-02-15T18:26:40.038 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:38.679280+0000 mgr.smithi084.hjmnez (mgr.14596) 4 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 89 MiB data, 352 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:40.038 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:38.743292+0000 mon.smithi084 (mon.0) 682 : cluster [DBG] mgrmap e27: smithi084.hjmnez(active, since 3s) 2024-02-15T18:26:42.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:41 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:40.679627+0000 mgr.smithi084.hjmnez (mgr.14596) 5 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 89 MiB data, 352 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:42.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:40.679627+0000 mgr.smithi084.hjmnez (mgr.14596) 5 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 89 MiB data, 352 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:42.965 INFO:tasks.workunit.client.1.smithi133.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-15T18:26:42.969 INFO:tasks.workunit.client.1.smithi133.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T18:26:42.969 INFO:tasks.workunit.client.1.smithi133.stderr:+ make 2024-02-15T18:26:42.985 INFO:tasks.workunit.client.1.smithi133.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-15T18:26:43.237 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:42.171708+0000 mon.smithi084 (mon.0) 683 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:26:43.238 INFO:tasks.workunit.client.1.smithi133.stderr:++ readlink -f fsstress 2024-02-15T18:26:43.239 INFO:tasks.workunit.client.1.smithi133.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-15T18:26:43.239 INFO:tasks.workunit.client.1.smithi133.stderr:+ popd 2024-02-15T18:26:43.241 INFO:tasks.workunit.client.1.smithi133.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T18:26:43.241 INFO:tasks.workunit.client.1.smithi133.stderr:+ popd 2024-02-15T18:26:43.242 INFO:tasks.workunit.client.1.smithi133.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-15T18:26:43.242 INFO:tasks.workunit.client.1.smithi133.stderr:++ mktemp -d -p . 2024-02-15T18:26:43.243 INFO:tasks.workunit.client.1.smithi133.stderr:+ T=./tmp.6uK42qkLLg 2024-02-15T18:26:43.243 INFO:tasks.workunit.client.1.smithi133.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.6uK42qkLLg -l 1 -n 1000 -p 10 -v 2024-02-15T18:26:43.244 INFO:tasks.workunit.client.1.smithi133.stdout:seed = 1707973149 2024-02-15T18:26:43.246 INFO:tasks.workunit.client.1.smithi133.stdout:0/0: link - no file 2024-02-15T18:26:43.247 INFO:tasks.workunit.client.1.smithi133.stdout:1/0: chown . 57 1 2024-02-15T18:26:43.247 INFO:tasks.workunit.client.1.smithi133.stdout:1/1: stat - no entries 2024-02-15T18:26:43.247 INFO:tasks.workunit.client.1.smithi133.stdout:0/1: creat f0 x:0 0 0 2024-02-15T18:26:43.248 INFO:tasks.workunit.client.1.smithi133.stdout:2/0: stat - no entries 2024-02-15T18:26:43.248 INFO:tasks.workunit.client.1.smithi133.stdout:1/2: creat f0 x:0 0 0 2024-02-15T18:26:43.249 INFO:tasks.workunit.client.1.smithi133.stdout:0/2: symlink l1 0 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/0: fsync - no filename 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/1: dread - no filename 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/2: rename - no filename 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/3: write - no filename 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/4: chown . 6648 1 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/5: chown . 668 1 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/6: dwrite - no filename 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/7: dread - no filename 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/8: dread - no filename 2024-02-15T18:26:43.250 INFO:tasks.workunit.client.1.smithi133.stdout:3/9: dwrite - no filename 2024-02-15T18:26:43.251 INFO:tasks.workunit.client.1.smithi133.stdout:3/10: chown . 31164771 1 2024-02-15T18:26:43.251 INFO:tasks.workunit.client.1.smithi133.stdout:3/11: read - no filename 2024-02-15T18:26:43.251 INFO:tasks.workunit.client.1.smithi133.stdout:3/12: chown . 972 1 2024-02-15T18:26:43.251 INFO:tasks.workunit.client.1.smithi133.stdout:3/13: write - no filename 2024-02-15T18:26:43.251 INFO:tasks.workunit.client.1.smithi133.stdout:3/14: chown . 7 1 2024-02-15T18:26:43.251 INFO:tasks.workunit.client.1.smithi133.stdout:3/15: dwrite - no filename 2024-02-15T18:26:43.252 INFO:tasks.workunit.client.1.smithi133.stdout:2/1: creat f0 x:0 0 0 2024-02-15T18:26:43.252 INFO:tasks.workunit.client.1.smithi133.stdout:2/2: rmdir - no directory 2024-02-15T18:26:43.252 INFO:tasks.workunit.client.1.smithi133.stdout:2/3: dread - f0 zero size 2024-02-15T18:26:43.252 INFO:tasks.workunit.client.1.smithi133.stdout:2/4: write f0 [765058,35122] 0 2024-02-15T18:26:43.252 INFO:tasks.workunit.client.1.smithi133.stdout:1/3: rename f0 to f1 0 2024-02-15T18:26:43.252 INFO:tasks.workunit.client.1.smithi133.stdout:0/3: symlink l2 0 2024-02-15T18:26:43.252 INFO:tasks.workunit.client.1.smithi133.stdout:0/4: dread - f0 zero size 2024-02-15T18:26:43.254 INFO:tasks.workunit.client.1.smithi133.stdout:3/16: mkdir d0 0 2024-02-15T18:26:43.254 INFO:tasks.workunit.client.1.smithi133.stdout:2/5: rename f0 to f1 0 2024-02-15T18:26:43.254 INFO:tasks.workunit.client.1.smithi133.stdout:4/0: read - no filename 2024-02-15T18:26:43.254 INFO:tasks.workunit.client.1.smithi133.stdout:4/1: dread - no filename 2024-02-15T18:26:43.255 INFO:tasks.workunit.client.1.smithi133.stdout:4/2: rename - no filename 2024-02-15T18:26:43.256 INFO:tasks.workunit.client.1.smithi133.stdout:4/3: creat f0 x:0 0 0 2024-02-15T18:26:43.256 INFO:tasks.workunit.client.1.smithi133.stdout:4/4: dread - f0 zero size 2024-02-15T18:26:43.276 INFO:tasks.workunit.client.1.smithi133.stdout:1/4: getdents . 0 2024-02-15T18:26:43.276 INFO:tasks.workunit.client.1.smithi133.stdout:1/5: write f1 [650920,65694] 0 2024-02-15T18:26:43.276 INFO:tasks.workunit.client.1.smithi133.stdout:1/6: chown f1 276762423 1 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:1/7: chown f1 457761 1 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:2/6: mknod c2 0 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/0: truncate - no filename 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/1: getdents . 0 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/2: chown . 101103106 1 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/3: chown . 635071146 1 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/4: rename - no filename 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/5: rmdir - no directory 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/6: unlink - no file 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/7: unlink - no file 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/8: write - no filename 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/9: dread - no filename 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/10: dwrite - no filename 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:4/5: mknod c1 0 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:5/0: creat f0 x:0 0 0 2024-02-15T18:26:43.277 INFO:tasks.workunit.client.1.smithi133.stdout:1/8: link f1 f2 0 2024-02-15T18:26:43.278 INFO:tasks.workunit.client.1.smithi133.stdout:3/17: mknod d0/c1 0 2024-02-15T18:26:43.278 INFO:tasks.workunit.client.1.smithi133.stdout:3/18: chown d0 2527 1 2024-02-15T18:26:43.278 INFO:tasks.workunit.client.1.smithi133.stdout:3/19: truncate - no filename 2024-02-15T18:26:43.284 INFO:tasks.workunit.client.1.smithi133.stdout:4/6: mkdir d2 0 2024-02-15T18:26:43.284 INFO:tasks.workunit.client.1.smithi133.stdout:4/7: getdents d2 0 2024-02-15T18:26:43.284 INFO:tasks.workunit.client.1.smithi133.stdout:4/8: read - f0 zero size 2024-02-15T18:26:43.284 INFO:tasks.workunit.client.1.smithi133.stdout:6/11: mkdir d0 0 2024-02-15T18:26:43.285 INFO:tasks.workunit.client.1.smithi133.stdout:7/0: dread - no filename 2024-02-15T18:26:43.285 INFO:tasks.workunit.client.1.smithi133.stdout:5/1: symlink l1 0 2024-02-15T18:26:43.285 INFO:tasks.workunit.client.1.smithi133.stdout:3/20: link d0/c1 d0/c2 0 2024-02-15T18:26:43.285 INFO:tasks.workunit.client.1.smithi133.stdout:3/21: dread - no filename 2024-02-15T18:26:43.285 INFO:tasks.workunit.client.1.smithi133.stdout:3/22: dwrite - no filename 2024-02-15T18:26:43.292 INFO:tasks.workunit.client.1.smithi133.stdout:3/23: creat d0/f3 x:0 0 0 2024-02-15T18:26:43.292 INFO:tasks.workunit.client.1.smithi133.stdout:6/12: symlink d0/l1 0 2024-02-15T18:26:43.292 INFO:tasks.workunit.client.1.smithi133.stdout:6/13: dwrite - no filename 2024-02-15T18:26:43.292 INFO:tasks.workunit.client.1.smithi133.stdout:6/14: stat d0/l1 0 2024-02-15T18:26:43.292 INFO:tasks.workunit.client.1.smithi133.stdout:6/15: write - no filename 2024-02-15T18:26:43.292 INFO:tasks.workunit.client.1.smithi133.stdout:6/16: fsync - no filename 2024-02-15T18:26:43.292 INFO:tasks.workunit.client.1.smithi133.stdout:7/1: creat f0 x:0 0 0 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:8/0: mknod c0 0 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:8/1: dread - no filename 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:8/2: dwrite - no filename 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:8/3: fsync - no filename 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:8/4: dread - no filename 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:6/17: rmdir d0 39 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:6/18: write - no filename 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:6/19: fdatasync - no filename 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:6/20: write - no filename 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:6/21: fdatasync - no filename 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:9/0: rename - no filename 2024-02-15T18:26:43.310 INFO:tasks.workunit.client.1.smithi133.stdout:9/1: truncate - no filename 2024-02-15T18:26:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:8/5: link c0 c1 0 2024-02-15T18:26:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:8/6: chown c1 2339 1 2024-02-15T18:26:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:6/22: creat d0/f2 x:0 0 0 2024-02-15T18:26:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:6/23: chown d0/f2 217901 1 2024-02-15T18:26:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:6/24: dread - d0/f2 zero size 2024-02-15T18:26:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:6/25: stat d0 0 2024-02-15T18:26:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:6/26: truncate d0/f2 251724 0 2024-02-15T18:26:43.314 INFO:tasks.workunit.client.1.smithi133.stdout:9/2: mkdir d0 0 2024-02-15T18:26:43.319 INFO:tasks.workunit.client.1.smithi133.stdout:8/7: creat f2 x:0 0 0 2024-02-15T18:26:43.328 INFO:tasks.workunit.client.1.smithi133.stdout:9/3: creat d0/f1 x:0 0 0 2024-02-15T18:26:43.328 INFO:tasks.workunit.client.1.smithi133.stdout:9/4: dread - d0/f1 zero size 2024-02-15T18:26:43.328 INFO:tasks.workunit.client.1.smithi133.stdout:9/5: read - d0/f1 zero size 2024-02-15T18:26:43.512 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:42.171708+0000 mon.smithi084 (mon.0) 683 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:26:43.770 INFO:tasks.workunit.client.1.smithi133.stdout:8/8: fsync f2 0 2024-02-15T18:26:44.031 INFO:tasks.workunit.client.1.smithi133.stdout:7/2: dwrite f0 [0,4194304] 0 2024-02-15T18:26:44.244 INFO:tasks.workunit.client.1.smithi133.stdout:3/24: dwrite d0/f3 [0,4194304] 0 2024-02-15T18:26:44.312 INFO:tasks.workunit.client.1.smithi133.stdout:8/9: mkdir d3 0 2024-02-15T18:26:44.315 INFO:tasks.workunit.client.1.smithi133.stdout:5/2: dwrite f0 [0,4194304] 0 2024-02-15T18:26:44.315 INFO:tasks.workunit.client.1.smithi133.stdout:5/3: truncate f0 5221930 0 2024-02-15T18:26:44.315 INFO:tasks.workunit.client.1.smithi133.stdout:5/4: fdatasync f0 0 2024-02-15T18:26:44.338 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:42.679956+0000 mgr.smithi084.hjmnez (mgr.14596) 6 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 89 MiB data, 352 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:44.512 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:42.679956+0000 mgr.smithi084.hjmnez (mgr.14596) 6 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 89 MiB data, 352 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:26:44.525 INFO:tasks.workunit.client.1.smithi133.stdout:7/3: dwrite f0 [0,4194304] 0 2024-02-15T18:26:44.958 INFO:tasks.workunit.client.1.smithi133.stdout:9/6: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:26:44.976 INFO:tasks.workunit.client.1.smithi133.stdout:5/5: dwrite f0 [0,4194304] 0 2024-02-15T18:26:45.083 INFO:tasks.workunit.client.1.smithi133.stdout:6/27: dwrite d0/f2 [0,4194304] 0 2024-02-15T18:26:45.122 INFO:tasks.workunit.client.1.smithi133.stdout:2/7: dwrite f1 [0,4194304] 0 2024-02-15T18:26:45.122 INFO:tasks.workunit.client.1.smithi133.stdout:3/25: write d0/f3 [3078804,47572] 0 2024-02-15T18:26:45.136 INFO:tasks.workunit.client.1.smithi133.stdout:8/10: write f2 [104516,60557] 0 2024-02-15T18:26:45.136 INFO:tasks.workunit.client.1.smithi133.stdout:7/4: stat f0 0 2024-02-15T18:26:45.204 INFO:tasks.workunit.client.1.smithi133.stdout:1/9: dread f1 [0,4194304] 0 2024-02-15T18:26:45.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:44.235731+0000 mon.smithi084 (mon.0) 684 : cluster [DBG] Standby manager daemon smithi133.nxzroj started 2024-02-15T18:26:45.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:44.245424+0000 mon.smithi133 (mon.1) 21 : audit [DBG] from='mgr.? 172.21.15.133:0/1397506959' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/crt"}]: dispatch 2024-02-15T18:26:45.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:44.250736+0000 mon.smithi133 (mon.1) 22 : audit [DBG] from='mgr.? 172.21.15.133:0/1397506959' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:26:45.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:44.252737+0000 mon.smithi133 (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.133:0/1397506959' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/key"}]: dispatch 2024-02-15T18:26:45.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:44.253396+0000 mon.smithi133 (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.133:0/1397506959' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:26:45.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:45.199674+0000 mon.smithi084 (mon.0) 685 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:26:45.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:44.235731+0000 mon.smithi084 (mon.0) 684 : cluster [DBG] Standby manager daemon smithi133.nxzroj started 2024-02-15T18:26:45.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:44.245424+0000 mon.smithi133 (mon.1) 21 : audit [DBG] from='mgr.? 172.21.15.133:0/1397506959' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/crt"}]: dispatch 2024-02-15T18:26:45.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:44.250736+0000 mon.smithi133 (mon.1) 22 : audit [DBG] from='mgr.? 172.21.15.133:0/1397506959' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:26:45.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:44.252737+0000 mon.smithi133 (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.133:0/1397506959' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/key"}]: dispatch 2024-02-15T18:26:45.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:44.253396+0000 mon.smithi133 (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.133:0/1397506959' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:26:45.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:45.199674+0000 mon.smithi084 (mon.0) 685 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:26:46.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:44.680516+0000 mgr.smithi084.hjmnez (mgr.14596) 7 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 147 MiB data, 627 MiB used, 536 GiB / 536 GiB avail; 9.0 MiB/s wr, 1.16k op/s 2024-02-15T18:26:46.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:45.227457+0000 mon.smithi084 (mon.0) 686 : cluster [DBG] mgrmap e28: smithi084.hjmnez(active, since 9s), standbys: smithi133.nxzroj 2024-02-15T18:26:46.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:45.227602+0000 mon.smithi084 (mon.0) 687 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi133.nxzroj", "id": "smithi133.nxzroj"}]: dispatch 2024-02-15T18:26:46.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:45.548029+0000 mon.smithi084 (mon.0) 688 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:46.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:45.548825+0000 mon.smithi084 (mon.0) 689 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:26:46.511 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:45.549464+0000 mgr.smithi084.hjmnez (mgr.14596) 8 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:26:46.511 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:45.552958+0000 mon.smithi084 (mon.0) 690 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:26:46.511 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:45.557882+0000 mon.smithi084 (mon.0) 691 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:46.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:44.680516+0000 mgr.smithi084.hjmnez (mgr.14596) 7 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 147 MiB data, 627 MiB used, 536 GiB / 536 GiB avail; 9.0 MiB/s wr, 1.16k op/s 2024-02-15T18:26:46.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:45.227457+0000 mon.smithi084 (mon.0) 686 : cluster [DBG] mgrmap e28: smithi084.hjmnez(active, since 9s), standbys: smithi133.nxzroj 2024-02-15T18:26:46.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:45.227602+0000 mon.smithi084 (mon.0) 687 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr metadata", "who": "smithi133.nxzroj", "id": "smithi133.nxzroj"}]: dispatch 2024-02-15T18:26:46.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:45.548029+0000 mon.smithi084 (mon.0) 688 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:46.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:45.548825+0000 mon.smithi084 (mon.0) 689 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:26:46.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:45.549464+0000 mgr.smithi084.hjmnez (mgr.14596) 8 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:26:46.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:45.552958+0000 mon.smithi084 (mon.0) 690 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:26:46.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:45.557882+0000 mon.smithi084 (mon.0) 691 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:48.201 INFO:tasks.workunit.client.0.smithi084.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-15T18:26:48.201 INFO:tasks.workunit.client.0.smithi084.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T18:26:48.202 INFO:tasks.workunit.client.0.smithi084.stderr:+ make 2024-02-15T18:26:48.222 INFO:tasks.workunit.client.0.smithi084.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-15T18:26:48.462 INFO:tasks.workunit.client.0.smithi084.stderr:++ readlink -f fsstress 2024-02-15T18:26:48.462 INFO:tasks.workunit.client.0.smithi084.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-15T18:26:48.462 INFO:tasks.workunit.client.0.smithi084.stderr:+ popd 2024-02-15T18:26:48.463 INFO:tasks.workunit.client.0.smithi084.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T18:26:48.463 INFO:tasks.workunit.client.0.smithi084.stderr:+ popd 2024-02-15T18:26:48.463 INFO:tasks.workunit.client.0.smithi084.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-15T18:26:48.463 INFO:tasks.workunit.client.0.smithi084.stderr:++ mktemp -d -p . 2024-02-15T18:26:48.464 INFO:tasks.workunit.client.0.smithi084.stderr:+ T=./tmp.mCFWx7f6z5 2024-02-15T18:26:48.464 INFO:tasks.workunit.client.0.smithi084.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.mCFWx7f6z5 -l 1 -n 1000 -p 10 -v 2024-02-15T18:26:48.465 INFO:tasks.workunit.client.0.smithi084.stdout:seed = 1707702825 2024-02-15T18:26:48.467 INFO:tasks.workunit.client.0.smithi084.stdout:0/0: link - no file 2024-02-15T18:26:48.467 INFO:tasks.workunit.client.0.smithi084.stdout:0/1: rename - no filename 2024-02-15T18:26:48.467 INFO:tasks.workunit.client.0.smithi084.stdout:0/2: link - no file 2024-02-15T18:26:48.468 INFO:tasks.workunit.client.0.smithi084.stdout:1/0: chown . 7935254 1 2024-02-15T18:26:48.468 INFO:tasks.workunit.client.0.smithi084.stdout:1/1: dread - no filename 2024-02-15T18:26:48.468 INFO:tasks.workunit.client.0.smithi084.stdout:1/2: truncate - no filename 2024-02-15T18:26:48.468 INFO:tasks.workunit.client.0.smithi084.stdout:1/3: dwrite - no filename 2024-02-15T18:26:48.468 INFO:tasks.workunit.client.0.smithi084.stdout:1/4: read - no filename 2024-02-15T18:26:48.468 INFO:tasks.workunit.client.0.smithi084.stdout:1/5: read - no filename 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:0/3: mkdir d0 0 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:0/4: write - no filename 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:0/5: unlink - no file 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:0/6: truncate - no filename 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:0/7: dread - no filename 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:0/8: chown d0 229 1 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:0/9: write - no filename 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:2/0: truncate - no filename 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:2/1: fdatasync - no filename 2024-02-15T18:26:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:2/2: readlink - no filename 2024-02-15T18:26:48.470 INFO:tasks.workunit.client.0.smithi084.stdout:2/3: readlink - no filename 2024-02-15T18:26:48.470 INFO:tasks.workunit.client.0.smithi084.stdout:1/6: mknod c0 0 2024-02-15T18:26:48.472 INFO:tasks.workunit.client.0.smithi084.stdout:0/10: mknod d0/c1 0 2024-02-15T18:26:48.472 INFO:tasks.workunit.client.0.smithi084.stdout:2/4: creat f0 x:0 0 0 2024-02-15T18:26:48.472 INFO:tasks.workunit.client.0.smithi084.stdout:2/5: stat f0 0 2024-02-15T18:26:48.472 INFO:tasks.workunit.client.0.smithi084.stdout:2/6: rmdir - no directory 2024-02-15T18:26:48.473 INFO:tasks.workunit.client.0.smithi084.stdout:2/7: chown f0 1195002 1 2024-02-15T18:26:48.473 INFO:tasks.workunit.client.0.smithi084.stdout:2/8: write f0 [1028062,30654] 0 2024-02-15T18:26:48.473 INFO:tasks.workunit.client.0.smithi084.stdout:1/7: symlink l1 0 2024-02-15T18:26:48.473 INFO:tasks.workunit.client.0.smithi084.stdout:1/8: readlink l1 0 2024-02-15T18:26:48.473 INFO:tasks.workunit.client.0.smithi084.stdout:1/9: dwrite - no filename 2024-02-15T18:26:48.473 INFO:tasks.workunit.client.0.smithi084.stdout:0/11: rmdir d0 39 2024-02-15T18:26:48.473 INFO:tasks.workunit.client.0.smithi084.stdout:0/12: write - no filename 2024-02-15T18:26:48.473 INFO:tasks.workunit.client.0.smithi084.stdout:3/0: creat f0 x:0 0 0 2024-02-15T18:26:48.474 INFO:tasks.workunit.client.0.smithi084.stdout:1/10: mknod c2 0 2024-02-15T18:26:48.474 INFO:tasks.workunit.client.0.smithi084.stdout:1/11: dwrite - no filename 2024-02-15T18:26:48.474 INFO:tasks.workunit.client.0.smithi084.stdout:1/12: dread - no filename 2024-02-15T18:26:48.475 INFO:tasks.workunit.client.0.smithi084.stdout:0/13: creat d0/f2 x:0 0 0 2024-02-15T18:26:48.475 INFO:tasks.workunit.client.0.smithi084.stdout:5/0: write - no filename 2024-02-15T18:26:48.475 INFO:tasks.workunit.client.0.smithi084.stdout:5/1: write - no filename 2024-02-15T18:26:48.476 INFO:tasks.workunit.client.0.smithi084.stdout:5/2: truncate - no filename 2024-02-15T18:26:48.476 INFO:tasks.workunit.client.0.smithi084.stdout:5/3: chown . 12 1 2024-02-15T18:26:48.476 INFO:tasks.workunit.client.0.smithi084.stdout:5/4: dwrite - no filename 2024-02-15T18:26:48.476 INFO:tasks.workunit.client.0.smithi084.stdout:5/5: truncate - no filename 2024-02-15T18:26:48.476 INFO:tasks.workunit.client.0.smithi084.stdout:5/6: truncate - no filename 2024-02-15T18:26:48.476 INFO:tasks.workunit.client.0.smithi084.stdout:4/0: symlink l0 0 2024-02-15T18:26:48.476 INFO:tasks.workunit.client.0.smithi084.stdout:4/1: rmdir - no directory 2024-02-15T18:26:48.476 INFO:tasks.workunit.client.0.smithi084.stdout:4/2: dread - no filename 2024-02-15T18:26:48.477 INFO:tasks.workunit.client.0.smithi084.stdout:4/3: dread - no filename 2024-02-15T18:26:48.477 INFO:tasks.workunit.client.0.smithi084.stdout:4/4: dwrite - no filename 2024-02-15T18:26:48.484 INFO:tasks.workunit.client.0.smithi084.stdout:5/7: mkdir d0 0 2024-02-15T18:26:48.484 INFO:tasks.workunit.client.0.smithi084.stdout:0/14: unlink d0/f2 0 2024-02-15T18:26:48.484 INFO:tasks.workunit.client.0.smithi084.stdout:5/8: chown d0 212 1 2024-02-15T18:26:48.484 INFO:tasks.workunit.client.0.smithi084.stdout:5/9: dread - no filename 2024-02-15T18:26:48.484 INFO:tasks.workunit.client.0.smithi084.stdout:5/10: rename d0 to d0/d1 22 2024-02-15T18:26:48.484 INFO:tasks.workunit.client.0.smithi084.stdout:4/5: creat f1 x:0 0 0 2024-02-15T18:26:48.485 INFO:tasks.workunit.client.0.smithi084.stdout:4/6: dread - f1 zero size 2024-02-15T18:26:48.498 INFO:tasks.workunit.client.0.smithi084.stdout:0/15: creat d0/f3 x:0 0 0 2024-02-15T18:26:48.498 INFO:tasks.workunit.client.0.smithi084.stdout:5/11: rmdir d0 0 2024-02-15T18:26:48.501 INFO:tasks.workunit.client.0.smithi084.stdout:0/16: mkdir d0/d4 0 2024-02-15T18:26:48.503 INFO:tasks.workunit.client.0.smithi084.stdout:0/17: unlink d0/c1 0 2024-02-15T18:26:48.505 INFO:tasks.workunit.client.0.smithi084.stdout:0/18: creat d0/d4/f5 x:0 0 0 2024-02-15T18:26:48.505 INFO:tasks.workunit.client.0.smithi084.stdout:0/19: write d0/f3 [242303,17022] 0 2024-02-15T18:26:48.506 INFO:tasks.workunit.client.0.smithi084.stdout:2/9: dread f0 [0,4194304] 0 2024-02-15T18:26:48.511 INFO:tasks.workunit.client.0.smithi084.stdout:0/20: unlink d0/d4/f5 0 2024-02-15T18:26:48.511 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:46.680807+0000 mgr.smithi084.hjmnez (mgr.14596) 9 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 147 MiB data, 627 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s wr, 902 op/s 2024-02-15T18:26:48.512 INFO:tasks.workunit.client.0.smithi084.stdout:2/10: creat f1 x:0 0 0 2024-02-15T18:26:48.512 INFO:tasks.workunit.client.0.smithi084.stdout:2/11: stat f1 0 2024-02-15T18:26:48.512 INFO:tasks.workunit.client.0.smithi084.stdout:2/12: readlink - no filename 2024-02-15T18:26:48.514 INFO:tasks.workunit.client.0.smithi084.stdout:0/21: unlink d0/f3 0 2024-02-15T18:26:48.516 INFO:tasks.workunit.client.0.smithi084.stdout:2/13: link f0 f2 0 2024-02-15T18:26:48.518 INFO:tasks.workunit.client.0.smithi084.stdout:0/22: creat d0/d4/f6 x:0 0 0 2024-02-15T18:26:48.539 INFO:tasks.workunit.client.0.smithi084.stdout:3/1: rename f0 to f1 0 2024-02-15T18:26:48.539 INFO:tasks.workunit.client.0.smithi084.stdout:6/0: dread - no filename 2024-02-15T18:26:48.539 INFO:tasks.workunit.client.0.smithi084.stdout:6/1: write - no filename 2024-02-15T18:26:48.539 INFO:tasks.workunit.client.0.smithi084.stdout:6/2: read - no filename 2024-02-15T18:26:48.539 INFO:tasks.workunit.client.0.smithi084.stdout:6/3: readlink - no filename 2024-02-15T18:26:48.539 INFO:tasks.workunit.client.0.smithi084.stdout:6/4: rmdir - no directory 2024-02-15T18:26:48.540 INFO:tasks.workunit.client.0.smithi084.stdout:7/0: dwrite - no filename 2024-02-15T18:26:48.540 INFO:tasks.workunit.client.0.smithi084.stdout:7/1: stat - no entries 2024-02-15T18:26:48.540 INFO:tasks.workunit.client.0.smithi084.stdout:9/0: read - no filename 2024-02-15T18:26:48.556 INFO:tasks.workunit.client.0.smithi084.stdout:6/5: mknod c0 0 2024-02-15T18:26:48.556 INFO:tasks.workunit.client.0.smithi084.stdout:9/1: creat f0 x:0 0 0 2024-02-15T18:26:48.556 INFO:tasks.workunit.client.0.smithi084.stdout:6/6: chown c0 1860026 1 2024-02-15T18:26:48.556 INFO:tasks.workunit.client.0.smithi084.stdout:9/2: stat f0 0 2024-02-15T18:26:48.556 INFO:tasks.workunit.client.0.smithi084.stdout:9/3: dread - f0 zero size 2024-02-15T18:26:48.556 INFO:tasks.workunit.client.0.smithi084.stdout:9/4: dread - f0 zero size 2024-02-15T18:26:48.556 INFO:tasks.workunit.client.0.smithi084.stdout:8/0: symlink l0 0 2024-02-15T18:26:48.557 INFO:tasks.workunit.client.0.smithi084.stdout:7/2: creat f0 x:0 0 0 2024-02-15T18:26:48.557 INFO:tasks.workunit.client.0.smithi084.stdout:8/1: read - no filename 2024-02-15T18:26:48.557 INFO:tasks.workunit.client.0.smithi084.stdout:7/3: chown f0 1712 1 2024-02-15T18:26:48.574 INFO:tasks.workunit.client.0.smithi084.stdout:0/23: dwrite d0/d4/f6 [0,4194304] 0 2024-02-15T18:26:48.588 INFO:tasks.workunit.client.0.smithi084.stdout:3/2: rename f1 to f2 0 2024-02-15T18:26:48.588 INFO:tasks.workunit.client.0.smithi084.stdout:3/3: chown f2 365066457 1 2024-02-15T18:26:48.590 INFO:tasks.workunit.client.0.smithi084.stdout:0/24: dwrite d0/d4/f6 [0,4194304] 0 2024-02-15T18:26:48.590 INFO:tasks.workunit.client.0.smithi084.stdout:0/25: chown d0/d4/f6 17738442 1 2024-02-15T18:26:48.590 INFO:tasks.workunit.client.0.smithi084.stdout:0/26: stat d0 0 2024-02-15T18:26:48.596 INFO:tasks.workunit.client.0.smithi084.stdout:0/27: dread d0/d4/f6 [0,4194304] 0 2024-02-15T18:26:48.597 INFO:tasks.workunit.client.0.smithi084.stdout:0/28: write d0/d4/f6 [2117060,38756] 0 2024-02-15T18:26:48.632 INFO:tasks.workunit.client.0.smithi084.stdout:6/7: rename c0 to c1 0 2024-02-15T18:26:48.632 INFO:tasks.workunit.client.0.smithi084.stdout:6/8: dwrite - no filename 2024-02-15T18:26:48.635 INFO:tasks.workunit.client.0.smithi084.stdout:8/2: creat f1 x:0 0 0 2024-02-15T18:26:48.636 INFO:tasks.workunit.client.0.smithi084.stdout:7/4: mknod c1 0 2024-02-15T18:26:48.636 INFO:tasks.workunit.client.0.smithi084.stdout:7/5: chown f0 58100 1 2024-02-15T18:26:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:46.680807+0000 mgr.smithi084.hjmnez (mgr.14596) 9 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 147 MiB data, 627 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s wr, 902 op/s 2024-02-15T18:26:48.715 INFO:tasks.workunit.client.1.smithi133.stdout:9/7: creat d0/f2 x:0 0 0 2024-02-15T18:26:48.822 INFO:tasks.workunit.client.0.smithi084.stdout:3/4: rename f2 to f3 0 2024-02-15T18:26:48.822 INFO:tasks.workunit.client.0.smithi084.stdout:3/5: dread - f3 zero size 2024-02-15T18:26:48.823 INFO:tasks.workunit.client.0.smithi084.stdout:6/9: symlink l2 0 2024-02-15T18:26:48.823 INFO:tasks.workunit.client.0.smithi084.stdout:6/10: chown l2 0 1 2024-02-15T18:26:48.823 INFO:tasks.workunit.client.0.smithi084.stdout:8/3: symlink l2 0 2024-02-15T18:26:48.824 INFO:tasks.workunit.client.0.smithi084.stdout:7/6: symlink l2 0 2024-02-15T18:26:48.833 INFO:tasks.workunit.client.0.smithi084.stdout:3/6: unlink f3 0 2024-02-15T18:26:48.833 INFO:tasks.workunit.client.0.smithi084.stdout:3/7: write - no filename 2024-02-15T18:26:48.833 INFO:tasks.workunit.client.0.smithi084.stdout:3/8: write - no filename 2024-02-15T18:26:48.833 INFO:tasks.workunit.client.0.smithi084.stdout:3/9: truncate - no filename 2024-02-15T18:26:48.835 INFO:tasks.workunit.client.0.smithi084.stdout:6/11: creat f3 x:0 0 0 2024-02-15T18:26:48.836 INFO:tasks.workunit.client.0.smithi084.stdout:8/4: mknod c3 0 2024-02-15T18:26:48.836 INFO:tasks.workunit.client.0.smithi084.stdout:8/5: readlink l0 0 2024-02-15T18:26:48.838 INFO:tasks.workunit.client.0.smithi084.stdout:0/29: truncate d0/d4/f6 3605803 0 2024-02-15T18:26:48.838 INFO:tasks.workunit.client.0.smithi084.stdout:7/7: creat f3 x:0 0 0 2024-02-15T18:26:48.839 INFO:tasks.workunit.client.0.smithi084.stdout:7/8: write f0 [625146,117101] 0 2024-02-15T18:26:48.839 INFO:tasks.workunit.client.0.smithi084.stdout:3/10: mknod c4 0 2024-02-15T18:26:48.839 INFO:tasks.workunit.client.0.smithi084.stdout:3/11: dwrite - no filename 2024-02-15T18:26:48.839 INFO:tasks.workunit.client.0.smithi084.stdout:3/12: dread - no filename 2024-02-15T18:26:48.839 INFO:tasks.workunit.client.0.smithi084.stdout:3/13: chown c4 97166910 1 2024-02-15T18:26:48.839 INFO:tasks.workunit.client.0.smithi084.stdout:6/12: creat f4 x:0 0 0 2024-02-15T18:26:48.839 INFO:tasks.workunit.client.0.smithi084.stdout:6/13: chown c1 382064542 1 2024-02-15T18:26:48.840 INFO:tasks.workunit.client.0.smithi084.stdout:6/14: chown l2 2443 1 2024-02-15T18:26:48.840 INFO:tasks.workunit.client.0.smithi084.stdout:8/6: symlink l4 0 2024-02-15T18:26:48.842 INFO:tasks.workunit.client.0.smithi084.stdout:0/30: mknod d0/c7 0 2024-02-15T18:26:48.842 INFO:tasks.workunit.client.0.smithi084.stdout:3/14: mknod c5 0 2024-02-15T18:26:48.842 INFO:tasks.workunit.client.0.smithi084.stdout:3/15: readlink - no filename 2024-02-15T18:26:48.842 INFO:tasks.workunit.client.0.smithi084.stdout:3/16: dwrite - no filename 2024-02-15T18:26:48.842 INFO:tasks.workunit.client.0.smithi084.stdout:3/17: chown c5 1 1 2024-02-15T18:26:48.843 INFO:tasks.workunit.client.0.smithi084.stdout:6/15: link l2 l5 0 2024-02-15T18:26:48.844 INFO:tasks.workunit.client.0.smithi084.stdout:7/9: dread f0 [0,4194304] 0 2024-02-15T18:26:48.844 INFO:tasks.workunit.client.0.smithi084.stdout:7/10: stat f0 0 2024-02-15T18:26:48.844 INFO:tasks.workunit.client.0.smithi084.stdout:8/7: symlink l5 0 2024-02-15T18:26:48.846 INFO:tasks.workunit.client.0.smithi084.stdout:3/18: rename c5 to c6 0 2024-02-15T18:26:48.846 INFO:tasks.workunit.client.0.smithi084.stdout:6/16: mknod c6 0 2024-02-15T18:26:48.850 INFO:tasks.workunit.client.0.smithi084.stdout:8/8: rename c3 to c6 0 2024-02-15T18:26:48.851 INFO:tasks.workunit.client.0.smithi084.stdout:8/9: write f1 [866723,62990] 0 2024-02-15T18:26:48.851 INFO:tasks.workunit.client.0.smithi084.stdout:3/19: mknod c7 0 2024-02-15T18:26:48.851 INFO:tasks.workunit.client.0.smithi084.stdout:3/20: chown c6 1981 1 2024-02-15T18:26:48.851 INFO:tasks.workunit.client.0.smithi084.stdout:3/21: dwrite - no filename 2024-02-15T18:26:48.851 INFO:tasks.workunit.client.0.smithi084.stdout:3/22: truncate - no filename 2024-02-15T18:26:48.851 INFO:tasks.workunit.client.0.smithi084.stdout:3/23: write - no filename 2024-02-15T18:26:48.852 INFO:tasks.workunit.client.0.smithi084.stdout:6/17: symlink l7 0 2024-02-15T18:26:48.852 INFO:tasks.workunit.client.0.smithi084.stdout:6/18: dread - f3 zero size 2024-02-15T18:26:48.853 INFO:tasks.workunit.client.0.smithi084.stdout:3/24: mkdir d8 0 2024-02-15T18:26:48.853 INFO:tasks.workunit.client.0.smithi084.stdout:6/19: mknod c8 0 2024-02-15T18:26:48.853 INFO:tasks.workunit.client.0.smithi084.stdout:3/25: symlink d8/l9 0 2024-02-15T18:26:48.855 INFO:tasks.workunit.client.0.smithi084.stdout:6/20: link f3 f9 0 2024-02-15T18:26:48.855 INFO:tasks.workunit.client.0.smithi084.stdout:6/21: mknod ca 0 2024-02-15T18:26:48.857 INFO:tasks.workunit.client.0.smithi084.stdout:6/22: link f4 fb 0 2024-02-15T18:26:48.857 INFO:tasks.workunit.client.0.smithi084.stdout:6/23: truncate f9 520441 0 2024-02-15T18:26:48.857 INFO:tasks.workunit.client.0.smithi084.stdout:6/24: creat fc x:0 0 0 2024-02-15T18:26:48.859 INFO:tasks.workunit.client.0.smithi084.stdout:6/25: dread f3 [0,4194304] 0 2024-02-15T18:26:48.860 INFO:tasks.workunit.client.0.smithi084.stdout:0/31: dwrite d0/d4/f6 [0,4194304] 0 2024-02-15T18:26:48.860 INFO:tasks.workunit.client.0.smithi084.stdout:0/32: chown d0/d4/f6 71661 1 2024-02-15T18:26:48.861 INFO:tasks.workunit.client.0.smithi084.stdout:0/33: read d0/d4/f6 [2022514,100687] 0 2024-02-15T18:26:48.861 INFO:tasks.workunit.client.0.smithi084.stdout:3/26: getdents d8 0 2024-02-15T18:26:48.862 INFO:tasks.workunit.client.0.smithi084.stdout:3/27: chown c4 1323944435 1 2024-02-15T18:26:48.863 INFO:tasks.workunit.client.0.smithi084.stdout:0/34: symlink d0/d4/l8 0 2024-02-15T18:26:48.863 INFO:tasks.workunit.client.0.smithi084.stdout:0/35: chown d0/c7 169 1 2024-02-15T18:26:48.864 INFO:tasks.workunit.client.0.smithi084.stdout:3/28: link d8/l9 d8/la 0 2024-02-15T18:26:48.864 INFO:tasks.workunit.client.0.smithi084.stdout:3/29: dread - no filename 2024-02-15T18:26:48.864 INFO:tasks.workunit.client.0.smithi084.stdout:3/30: readlink d8/la 0 2024-02-15T18:26:48.865 INFO:tasks.workunit.client.0.smithi084.stdout:3/31: creat d8/fb x:0 0 0 2024-02-15T18:26:48.871 INFO:tasks.workunit.client.0.smithi084.stdout:0/36: dread d0/d4/f6 [0,4194304] 0 2024-02-15T18:26:48.882 INFO:tasks.workunit.client.0.smithi084.stdout:3/32: dwrite d8/fb [0,4194304] 0 2024-02-15T18:26:48.883 INFO:tasks.workunit.client.0.smithi084.stdout:8/10: dwrite f1 [0,4194304] 0 2024-02-15T18:26:48.884 INFO:tasks.workunit.client.0.smithi084.stdout:3/33: readlink d8/l9 0 2024-02-15T18:26:48.885 INFO:tasks.workunit.client.0.smithi084.stdout:3/34: write d8/fb [3953815,16379] 0 2024-02-15T18:26:48.885 INFO:tasks.workunit.client.0.smithi084.stdout:8/11: symlink l7 0 2024-02-15T18:26:48.887 INFO:tasks.workunit.client.0.smithi084.stdout:8/12: mknod c8 0 2024-02-15T18:26:48.887 INFO:tasks.workunit.client.0.smithi084.stdout:3/35: fdatasync d8/fb 0 2024-02-15T18:26:48.888 INFO:tasks.workunit.client.0.smithi084.stdout:3/36: read d8/fb [2687047,124909] 0 2024-02-15T18:26:48.888 INFO:tasks.workunit.client.0.smithi084.stdout:3/37: stat c4 0 2024-02-15T18:26:48.892 INFO:tasks.workunit.client.0.smithi084.stdout:3/38: creat d8/fc x:0 0 0 2024-02-15T18:26:48.900 INFO:tasks.workunit.client.0.smithi084.stdout:3/39: dread d8/fb [0,4194304] 0 2024-02-15T18:26:48.900 INFO:tasks.workunit.client.0.smithi084.stdout:3/40: dread - d8/fc zero size 2024-02-15T18:26:48.900 INFO:tasks.workunit.client.0.smithi084.stdout:3/41: readlink d8/la 0 2024-02-15T18:26:48.902 INFO:tasks.workunit.client.0.smithi084.stdout:3/42: mkdir d8/dd 0 2024-02-15T18:26:48.902 INFO:tasks.workunit.client.0.smithi084.stdout:3/43: mknod d8/dd/ce 0 2024-02-15T18:26:48.903 INFO:tasks.workunit.client.0.smithi084.stdout:3/44: read d8/fb [2947697,78488] 0 2024-02-15T18:26:48.903 INFO:tasks.workunit.client.0.smithi084.stdout:3/45: chown d8/la 2004403 1 2024-02-15T18:26:48.905 INFO:tasks.workunit.client.0.smithi084.stdout:8/13: dwrite f1 [0,4194304] 0 2024-02-15T18:26:48.920 INFO:tasks.workunit.client.1.smithi133.stdout:5/6: getdents . 0 2024-02-15T18:26:48.921 INFO:tasks.workunit.client.0.smithi084.stdout:3/46: dwrite d8/fc [0,4194304] 0 2024-02-15T18:26:48.922 INFO:tasks.workunit.client.1.smithi133.stdout:5/7: write f0 [1423433,3977] 0 2024-02-15T18:26:48.922 INFO:tasks.workunit.client.0.smithi084.stdout:8/14: dread f1 [0,4194304] 0 2024-02-15T18:26:48.929 INFO:tasks.workunit.client.0.smithi084.stdout:8/15: truncate f1 1721278 0 2024-02-15T18:26:48.938 INFO:tasks.workunit.client.0.smithi084.stdout:3/47: dwrite d8/fc [0,4194304] 0 2024-02-15T18:26:48.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/48: getdents d8 0 2024-02-15T18:26:48.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/49: chown d8/l9 4 1 2024-02-15T18:26:48.940 INFO:tasks.workunit.client.0.smithi084.stdout:8/16: write f1 [1668664,91887] 0 2024-02-15T18:26:48.943 INFO:tasks.workunit.client.0.smithi084.stdout:3/50: dread d8/fb [0,4194304] 0 2024-02-15T18:26:48.947 INFO:tasks.workunit.client.0.smithi084.stdout:3/51: dread d8/fb [0,4194304] 0 2024-02-15T18:26:48.947 INFO:tasks.workunit.client.0.smithi084.stdout:8/17: dread f1 [0,4194304] 0 2024-02-15T18:26:48.947 INFO:tasks.workunit.client.0.smithi084.stdout:3/52: write d8/fc [5086421,40892] 0 2024-02-15T18:26:48.948 INFO:tasks.workunit.client.0.smithi084.stdout:8/18: getdents . 0 2024-02-15T18:26:48.948 INFO:tasks.workunit.client.0.smithi084.stdout:3/53: symlink d8/lf 0 2024-02-15T18:26:48.949 INFO:tasks.workunit.client.0.smithi084.stdout:8/19: creat f9 x:0 0 0 2024-02-15T18:26:48.975 INFO:tasks.workunit.client.0.smithi084.stdout:8/20: dwrite f9 [0,4194304] 0 2024-02-15T18:26:48.976 INFO:tasks.workunit.client.0.smithi084.stdout:8/21: write f9 [3457239,57846] 0 2024-02-15T18:26:48.978 INFO:tasks.workunit.client.0.smithi084.stdout:8/22: rename f1 to fa 0 2024-02-15T18:26:48.980 INFO:tasks.workunit.client.0.smithi084.stdout:8/23: mkdir db 0 2024-02-15T18:26:48.981 INFO:tasks.workunit.client.0.smithi084.stdout:8/24: write f9 [1977672,28965] 0 2024-02-15T18:26:49.002 INFO:tasks.workunit.client.0.smithi084.stdout:8/25: dwrite f9 [0,4194304] 0 2024-02-15T18:26:49.004 INFO:tasks.workunit.client.0.smithi084.stdout:8/26: dread fa [0,4194304] 0 2024-02-15T18:26:49.018 INFO:tasks.workunit.client.0.smithi084.stdout:8/27: dwrite f9 [4194304,4194304] 0 2024-02-15T18:26:49.021 INFO:tasks.workunit.client.0.smithi084.stdout:8/28: dread fa [0,4194304] 0 2024-02-15T18:26:49.022 INFO:tasks.workunit.client.0.smithi084.stdout:8/29: creat db/fc x:0 0 0 2024-02-15T18:26:49.022 INFO:tasks.workunit.client.0.smithi084.stdout:8/30: readlink l4 0 2024-02-15T18:26:49.023 INFO:tasks.workunit.client.0.smithi084.stdout:8/31: mkdir db/dd 0 2024-02-15T18:26:49.024 INFO:tasks.workunit.client.0.smithi084.stdout:8/32: readlink l0 0 2024-02-15T18:26:49.024 INFO:tasks.workunit.client.0.smithi084.stdout:8/33: chown l5 8653 1 2024-02-15T18:26:49.025 INFO:tasks.workunit.client.0.smithi084.stdout:8/34: dread - db/fc zero size 2024-02-15T18:26:49.025 INFO:tasks.workunit.client.0.smithi084.stdout:8/35: creat db/fe x:0 0 0 2024-02-15T18:26:49.025 INFO:tasks.workunit.client.0.smithi084.stdout:8/36: chown c6 5666 1 2024-02-15T18:26:49.034 INFO:tasks.workunit.client.0.smithi084.stdout:8/37: dread f9 [0,4194304] 0 2024-02-15T18:26:49.050 INFO:tasks.workunit.client.0.smithi084.stdout:8/38: dwrite f9 [4194304,4194304] 0 2024-02-15T18:26:49.052 INFO:tasks.workunit.client.0.smithi084.stdout:8/39: rename l2 to db/lf 0 2024-02-15T18:26:49.052 INFO:tasks.workunit.client.0.smithi084.stdout:8/40: dread - db/fe zero size 2024-02-15T18:26:49.052 INFO:tasks.workunit.client.0.smithi084.stdout:8/41: dread - db/fc zero size 2024-02-15T18:26:49.057 INFO:tasks.workunit.client.0.smithi084.stdout:8/42: dread f9 [0,4194304] 0 2024-02-15T18:26:49.057 INFO:tasks.workunit.client.0.smithi084.stdout:8/43: dread - db/fe zero size 2024-02-15T18:26:49.058 INFO:tasks.workunit.client.0.smithi084.stdout:8/44: rename f9 to db/dd/f10 0 2024-02-15T18:26:49.064 INFO:tasks.workunit.client.0.smithi084.stdout:8/45: rmdir db 39 2024-02-15T18:26:49.079 INFO:tasks.workunit.client.0.smithi084.stdout:8/46: dwrite fa [0,4194304] 0 2024-02-15T18:26:49.097 INFO:tasks.workunit.client.0.smithi084.stdout:8/47: dwrite db/fe [0,4194304] 0 2024-02-15T18:26:49.099 INFO:tasks.workunit.client.0.smithi084.stdout:8/48: creat db/f11 x:0 0 0 2024-02-15T18:26:49.099 INFO:tasks.workunit.client.0.smithi084.stdout:8/49: write fa [4883454,18462] 0 2024-02-15T18:26:49.099 INFO:tasks.workunit.client.0.smithi084.stdout:8/50: stat db/fc 0 2024-02-15T18:26:49.099 INFO:tasks.workunit.client.0.smithi084.stdout:8/51: creat db/dd/f12 x:0 0 0 2024-02-15T18:26:49.100 INFO:tasks.workunit.client.0.smithi084.stdout:8/52: mkdir db/dd/d13 0 2024-02-15T18:26:49.101 INFO:tasks.workunit.client.0.smithi084.stdout:8/53: creat db/dd/f14 x:0 0 0 2024-02-15T18:26:49.244 INFO:tasks.workunit.client.1.smithi133.stdout:6/28: creat d0/f3 x:0 0 0 2024-02-15T18:26:49.479 INFO:tasks.workunit.client.1.smithi133.stdout:2/8: mknod c3 0 2024-02-15T18:26:49.480 INFO:tasks.workunit.client.1.smithi133.stdout:3/26: rmdir d0 39 2024-02-15T18:26:49.480 INFO:tasks.workunit.client.1.smithi133.stdout:3/27: write d0/f3 [4152213,73891] 0 2024-02-15T18:26:49.482 INFO:tasks.workunit.client.1.smithi133.stdout:3/28: read d0/f3 [732673,97297] 0 2024-02-15T18:26:49.546 INFO:tasks.workunit.client.1.smithi133.stdout:8/11: creat d3/f4 x:0 0 0 2024-02-15T18:26:49.546 INFO:tasks.workunit.client.1.smithi133.stdout:7/5: mknod c1 0 2024-02-15T18:26:49.546 INFO:tasks.workunit.client.1.smithi133.stdout:7/6: stat f0 0 2024-02-15T18:26:49.551 INFO:tasks.workunit.client.1.smithi133.stdout:8/12: dread f2 [0,4194304] 0 2024-02-15T18:26:49.551 INFO:tasks.workunit.client.1.smithi133.stdout:8/13: write d3/f4 [791805,85985] 0 2024-02-15T18:26:49.551 INFO:tasks.workunit.client.1.smithi133.stdout:8/14: chown d3 0 1 2024-02-15T18:26:49.551 INFO:tasks.workunit.client.1.smithi133.stdout:8/15: read d3/f4 [495317,100316] 0 2024-02-15T18:26:49.569 INFO:tasks.workunit.client.1.smithi133.stdout:8/16: dwrite d3/f4 [0,4194304] 0 2024-02-15T18:26:49.570 INFO:tasks.workunit.client.1.smithi133.stdout:8/17: write f2 [826919,78151] 0 2024-02-15T18:26:49.594 INFO:tasks.workunit.client.1.smithi133.stdout:8/18: dwrite f2 [0,4194304] 0 2024-02-15T18:26:49.595 INFO:tasks.workunit.client.1.smithi133.stdout:8/19: write f2 [3247216,106969] 0 2024-02-15T18:26:49.639 INFO:tasks.workunit.client.1.smithi133.stdout:1/10: symlink l3 0 2024-02-15T18:26:49.754 INFO:tasks.workunit.client.1.smithi133.stdout:9/8: creat d0/f3 x:0 0 0 2024-02-15T18:26:49.754 INFO:tasks.workunit.client.1.smithi133.stdout:5/8: rename f0 to f2 0 2024-02-15T18:26:49.755 INFO:tasks.workunit.client.1.smithi133.stdout:6/29: symlink d0/l4 0 2024-02-15T18:26:49.756 INFO:tasks.workunit.client.1.smithi133.stdout:2/9: link c3 c4 0 2024-02-15T18:26:49.756 INFO:tasks.workunit.client.1.smithi133.stdout:6/30: write d0/f2 [405992,35621] 0 2024-02-15T18:26:49.757 INFO:tasks.workunit.client.1.smithi133.stdout:6/31: read d0/f2 [758030,2600] 0 2024-02-15T18:26:49.757 INFO:tasks.workunit.client.1.smithi133.stdout:3/29: rmdir d0 39 2024-02-15T18:26:49.758 INFO:tasks.workunit.client.1.smithi133.stdout:7/7: mknod c2 0 2024-02-15T18:26:49.759 INFO:tasks.workunit.client.1.smithi133.stdout:7/8: write f0 [2889493,123903] 0 2024-02-15T18:26:49.760 INFO:tasks.workunit.client.1.smithi133.stdout:7/9: read f0 [1693281,55943] 0 2024-02-15T18:26:49.761 INFO:tasks.workunit.client.1.smithi133.stdout:8/20: link f2 d3/f5 0 2024-02-15T18:26:49.761 INFO:tasks.workunit.client.1.smithi133.stdout:8/21: chown d3 0 1 2024-02-15T18:26:49.762 INFO:tasks.workunit.client.1.smithi133.stdout:1/11: mknod c4 0 2024-02-15T18:26:49.764 INFO:tasks.workunit.client.1.smithi133.stdout:9/9: mknod d0/c4 0 2024-02-15T18:26:49.766 INFO:tasks.workunit.client.1.smithi133.stdout:6/32: mkdir d0/d5 0 2024-02-15T18:26:49.766 INFO:tasks.workunit.client.1.smithi133.stdout:6/33: dread - d0/f3 zero size 2024-02-15T18:26:49.766 INFO:tasks.workunit.client.1.smithi133.stdout:6/34: truncate d0/f3 1001098 0 2024-02-15T18:26:49.767 INFO:tasks.workunit.client.1.smithi133.stdout:3/30: rename d0/f3 to d0/f4 0 2024-02-15T18:26:49.768 INFO:tasks.workunit.client.1.smithi133.stdout:3/31: chown d0 11540 1 2024-02-15T18:26:49.769 INFO:tasks.workunit.client.1.smithi133.stdout:8/22: symlink d3/l6 0 2024-02-15T18:26:49.769 INFO:tasks.workunit.client.1.smithi133.stdout:8/23: chown c0 3 1 2024-02-15T18:26:49.770 INFO:tasks.workunit.client.1.smithi133.stdout:1/12: link c4 c5 0 2024-02-15T18:26:49.770 INFO:tasks.workunit.client.1.smithi133.stdout:1/13: write f1 [276306,11270] 0 2024-02-15T18:26:49.771 INFO:tasks.workunit.client.1.smithi133.stdout:1/14: truncate f2 1476295 0 2024-02-15T18:26:49.779 INFO:tasks.workunit.client.1.smithi133.stdout:5/9: link f2 f3 0 2024-02-15T18:26:49.779 INFO:tasks.workunit.client.1.smithi133.stdout:9/10: dread d0/f1 [0,4194304] 0 2024-02-15T18:26:49.779 INFO:tasks.workunit.client.1.smithi133.stdout:9/11: dread - d0/f3 zero size 2024-02-15T18:26:49.781 INFO:tasks.workunit.client.1.smithi133.stdout:6/35: creat d0/d5/f6 x:0 0 0 2024-02-15T18:26:49.783 INFO:tasks.workunit.client.1.smithi133.stdout:2/10: dwrite f1 [0,4194304] 0 2024-02-15T18:26:49.785 INFO:tasks.workunit.client.1.smithi133.stdout:8/24: mkdir d3/d7 0 2024-02-15T18:26:49.786 INFO:tasks.workunit.client.1.smithi133.stdout:1/15: mkdir d6 0 2024-02-15T18:26:49.787 INFO:tasks.workunit.client.1.smithi133.stdout:2/11: read f1 [2539700,17934] 0 2024-02-15T18:26:49.788 INFO:tasks.workunit.client.1.smithi133.stdout:8/25: write f2 [1552712,81926] 0 2024-02-15T18:26:49.788 INFO:tasks.workunit.client.1.smithi133.stdout:3/32: link d0/f4 d0/f5 0 2024-02-15T18:26:49.791 INFO:tasks.workunit.client.1.smithi133.stdout:5/10: creat f4 x:0 0 0 2024-02-15T18:26:49.793 INFO:tasks.workunit.client.1.smithi133.stdout:9/12: unlink d0/f3 0 2024-02-15T18:26:49.793 INFO:tasks.workunit.client.1.smithi133.stdout:9/13: fsync d0/f2 0 2024-02-15T18:26:49.793 INFO:tasks.workunit.client.1.smithi133.stdout:9/14: chown d0/c4 12685 1 2024-02-15T18:26:49.793 INFO:tasks.workunit.client.1.smithi133.stdout:9/15: stat d0/f2 0 2024-02-15T18:26:49.794 INFO:tasks.workunit.client.1.smithi133.stdout:6/36: mknod d0/c7 0 2024-02-15T18:26:49.794 INFO:tasks.workunit.client.1.smithi133.stdout:6/37: rename d0/d5 to d0/d5/d8 22 2024-02-15T18:26:49.794 INFO:tasks.workunit.client.1.smithi133.stdout:6/38: stat d0/f2 0 2024-02-15T18:26:49.795 INFO:tasks.workunit.client.1.smithi133.stdout:1/16: creat d6/f7 x:0 0 0 2024-02-15T18:26:49.797 INFO:tasks.workunit.client.1.smithi133.stdout:8/26: link d3/f5 d3/f8 0 2024-02-15T18:26:49.798 INFO:tasks.workunit.client.1.smithi133.stdout:5/11: creat f5 x:0 0 0 2024-02-15T18:26:49.799 INFO:tasks.workunit.client.1.smithi133.stdout:9/16: dread d0/f1 [0,4194304] 0 2024-02-15T18:26:49.799 INFO:tasks.workunit.client.1.smithi133.stdout:6/39: creat d0/f9 x:0 0 0 2024-02-15T18:26:49.799 INFO:tasks.workunit.client.1.smithi133.stdout:6/40: write d0/f3 [1392146,93258] 0 2024-02-15T18:26:49.801 INFO:tasks.workunit.client.1.smithi133.stdout:3/33: fsync d0/f4 0 2024-02-15T18:26:49.806 INFO:tasks.workunit.client.1.smithi133.stdout:2/12: truncate f1 3971926 0 2024-02-15T18:26:49.806 INFO:tasks.workunit.client.1.smithi133.stdout:5/12: creat f6 x:0 0 0 2024-02-15T18:26:49.806 INFO:tasks.workunit.client.1.smithi133.stdout:9/17: creat d0/f5 x:0 0 0 2024-02-15T18:26:49.807 INFO:tasks.workunit.client.1.smithi133.stdout:6/41: symlink d0/la 0 2024-02-15T18:26:49.808 INFO:tasks.workunit.client.1.smithi133.stdout:3/34: unlink d0/c2 0 2024-02-15T18:26:49.808 INFO:tasks.workunit.client.1.smithi133.stdout:3/35: write d0/f5 [4989757,123208] 0 2024-02-15T18:26:49.809 INFO:tasks.workunit.client.1.smithi133.stdout:2/13: rename c2 to c5 0 2024-02-15T18:26:49.810 INFO:tasks.workunit.client.1.smithi133.stdout:5/13: mknod c7 0 2024-02-15T18:26:49.810 INFO:tasks.workunit.client.1.smithi133.stdout:5/14: stat f5 0 2024-02-15T18:26:49.810 INFO:tasks.workunit.client.1.smithi133.stdout:5/15: chown c7 351753 1 2024-02-15T18:26:49.811 INFO:tasks.workunit.client.1.smithi133.stdout:9/18: creat d0/f6 x:0 0 0 2024-02-15T18:26:49.812 INFO:tasks.workunit.client.1.smithi133.stdout:6/42: mkdir d0/db 0 2024-02-15T18:26:49.812 INFO:tasks.workunit.client.1.smithi133.stdout:6/43: truncate d0/f9 384295 0 2024-02-15T18:26:49.812 INFO:tasks.workunit.client.1.smithi133.stdout:5/16: symlink l8 0 2024-02-15T18:26:49.812 INFO:tasks.workunit.client.1.smithi133.stdout:5/17: fsync f3 0 2024-02-15T18:26:49.813 INFO:tasks.workunit.client.1.smithi133.stdout:9/19: link d0/f2 d0/f7 0 2024-02-15T18:26:49.813 INFO:tasks.workunit.client.1.smithi133.stdout:9/20: stat d0 0 2024-02-15T18:26:49.814 INFO:tasks.workunit.client.1.smithi133.stdout:6/44: mknod d0/cc 0 2024-02-15T18:26:49.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/17: dwrite d6/f7 [0,4194304] 0 2024-02-15T18:26:49.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/18: chown c5 199711 1 2024-02-15T18:26:49.815 INFO:tasks.workunit.client.1.smithi133.stdout:5/18: rename f6 to f9 0 2024-02-15T18:26:49.815 INFO:tasks.workunit.client.1.smithi133.stdout:1/19: write d6/f7 [2251004,76976] 0 2024-02-15T18:26:49.815 INFO:tasks.workunit.client.1.smithi133.stdout:1/20: chown d6 1958148526 1 2024-02-15T18:26:49.817 INFO:tasks.workunit.client.1.smithi133.stdout:9/21: unlink d0/c4 0 2024-02-15T18:26:49.818 INFO:tasks.workunit.client.1.smithi133.stdout:6/45: creat d0/fd x:0 0 0 2024-02-15T18:26:49.818 INFO:tasks.workunit.client.1.smithi133.stdout:8/27: dread d3/f5 [0,4194304] 0 2024-02-15T18:26:49.819 INFO:tasks.workunit.client.1.smithi133.stdout:1/21: creat d6/f8 x:0 0 0 2024-02-15T18:26:49.821 INFO:tasks.workunit.client.1.smithi133.stdout:9/22: mkdir d0/d8 0 2024-02-15T18:26:49.821 INFO:tasks.workunit.client.1.smithi133.stdout:9/23: write d0/f2 [793622,118659] 0 2024-02-15T18:26:49.821 INFO:tasks.workunit.client.1.smithi133.stdout:9/24: write d0/f5 [308770,52306] 0 2024-02-15T18:26:49.821 INFO:tasks.workunit.client.1.smithi133.stdout:9/25: chown d0/f6 29771 1 2024-02-15T18:26:49.821 INFO:tasks.workunit.client.1.smithi133.stdout:9/26: fdatasync d0/f1 0 2024-02-15T18:26:49.822 INFO:tasks.workunit.client.1.smithi133.stdout:9/27: truncate d0/f2 1279379 0 2024-02-15T18:26:49.822 INFO:tasks.workunit.client.1.smithi133.stdout:9/28: chown d0/f7 344329897 1 2024-02-15T18:26:49.822 INFO:tasks.workunit.client.1.smithi133.stdout:9/29: chown d0/f1 3326 1 2024-02-15T18:26:49.822 INFO:tasks.workunit.client.1.smithi133.stdout:3/36: dread d0/f5 [0,4194304] 0 2024-02-15T18:26:49.823 INFO:tasks.workunit.client.1.smithi133.stdout:6/46: unlink d0/f2 0 2024-02-15T18:26:49.830 INFO:tasks.workunit.client.1.smithi133.stdout:8/28: mknod d3/c9 0 2024-02-15T18:26:49.830 INFO:tasks.workunit.client.1.smithi133.stdout:9/30: mkdir d0/d8/d9 0 2024-02-15T18:26:49.830 INFO:tasks.workunit.client.1.smithi133.stdout:8/29: readlink d3/l6 0 2024-02-15T18:26:49.831 INFO:tasks.workunit.client.1.smithi133.stdout:3/37: link d0/c1 d0/c6 0 2024-02-15T18:26:49.831 INFO:tasks.workunit.client.1.smithi133.stdout:3/38: readlink - no filename 2024-02-15T18:26:49.835 INFO:tasks.workunit.client.1.smithi133.stdout:3/39: creat d0/f7 x:0 0 0 2024-02-15T18:26:49.836 INFO:tasks.workunit.client.1.smithi133.stdout:3/40: write d0/f5 [1704729,46288] 0 2024-02-15T18:26:49.836 INFO:tasks.workunit.client.1.smithi133.stdout:3/41: chown d0 3705121 1 2024-02-15T18:26:49.841 INFO:tasks.workunit.client.1.smithi133.stdout:5/19: dwrite f3 [0,4194304] 0 2024-02-15T18:26:49.841 INFO:tasks.workunit.client.1.smithi133.stdout:5/20: dread - f4 zero size 2024-02-15T18:26:49.842 INFO:tasks.workunit.client.1.smithi133.stdout:2/14: dread f1 [0,4194304] 0 2024-02-15T18:26:49.842 INFO:tasks.workunit.client.1.smithi133.stdout:8/30: read f2 [2111966,53673] 0 2024-02-15T18:26:49.843 INFO:tasks.workunit.client.1.smithi133.stdout:2/15: creat f6 x:0 0 0 2024-02-15T18:26:49.844 INFO:tasks.workunit.client.1.smithi133.stdout:6/47: dwrite d0/d5/f6 [0,4194304] 0 2024-02-15T18:26:49.846 INFO:tasks.workunit.client.1.smithi133.stdout:2/16: mkdir d7 0 2024-02-15T18:26:49.848 INFO:tasks.workunit.client.1.smithi133.stdout:6/48: symlink d0/d5/le 0 2024-02-15T18:26:49.848 INFO:tasks.workunit.client.1.smithi133.stdout:6/49: truncate d0/fd 664396 0 2024-02-15T18:26:49.849 INFO:tasks.workunit.client.1.smithi133.stdout:2/17: symlink d7/l8 0 2024-02-15T18:26:49.849 INFO:tasks.workunit.client.1.smithi133.stdout:6/50: creat d0/ff x:0 0 0 2024-02-15T18:26:49.850 INFO:tasks.workunit.client.1.smithi133.stdout:6/51: fdatasync d0/f3 0 2024-02-15T18:26:49.851 INFO:tasks.workunit.client.1.smithi133.stdout:2/18: truncate f1 2786130 0 2024-02-15T18:26:49.851 INFO:tasks.workunit.client.1.smithi133.stdout:2/19: chown d7 293 1 2024-02-15T18:26:49.852 INFO:tasks.workunit.client.1.smithi133.stdout:6/52: creat d0/f10 x:0 0 0 2024-02-15T18:26:49.852 INFO:tasks.workunit.client.1.smithi133.stdout:6/53: chown d0/d5/f6 3997 1 2024-02-15T18:26:49.854 INFO:tasks.workunit.client.1.smithi133.stdout:6/54: mknod d0/db/c11 0 2024-02-15T18:26:49.855 INFO:tasks.workunit.client.1.smithi133.stdout:3/42: getdents d0 0 2024-02-15T18:26:49.855 INFO:tasks.workunit.client.1.smithi133.stdout:3/43: read - d0/f7 zero size 2024-02-15T18:26:49.856 INFO:tasks.workunit.client.1.smithi133.stdout:8/31: truncate f2 4039302 0 2024-02-15T18:26:49.868 INFO:tasks.workunit.client.1.smithi133.stdout:9/31: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:26:49.868 INFO:tasks.workunit.client.1.smithi133.stdout:5/21: dwrite f9 [0,4194304] 0 2024-02-15T18:26:49.870 INFO:tasks.workunit.client.1.smithi133.stdout:5/22: write f9 [1155013,75151] 0 2024-02-15T18:26:49.874 INFO:tasks.workunit.client.1.smithi133.stdout:2/20: read f1 [908619,40701] 0 2024-02-15T18:26:49.875 INFO:tasks.workunit.client.1.smithi133.stdout:5/23: symlink la 0 2024-02-15T18:26:49.876 INFO:tasks.workunit.client.1.smithi133.stdout:2/21: mknod d7/c9 0 2024-02-15T18:26:49.878 INFO:tasks.workunit.client.1.smithi133.stdout:2/22: creat d7/fa x:0 0 0 2024-02-15T18:26:49.879 INFO:tasks.workunit.client.1.smithi133.stdout:5/24: read f2 [3362932,108047] 0 2024-02-15T18:26:49.879 INFO:tasks.workunit.client.1.smithi133.stdout:5/25: chown f9 560531 1 2024-02-15T18:26:49.881 INFO:tasks.workunit.client.1.smithi133.stdout:2/23: unlink f6 0 2024-02-15T18:26:49.891 INFO:tasks.workunit.client.1.smithi133.stdout:8/32: dread d3/f8 [0,4194304] 0 2024-02-15T18:26:49.894 INFO:tasks.workunit.client.1.smithi133.stdout:2/24: dread f1 [0,4194304] 0 2024-02-15T18:26:49.895 INFO:tasks.workunit.client.1.smithi133.stdout:2/25: mkdir d7/db 0 2024-02-15T18:26:49.895 INFO:tasks.workunit.client.1.smithi133.stdout:2/26: write d7/fa [222703,32729] 0 2024-02-15T18:26:49.896 INFO:tasks.workunit.client.1.smithi133.stdout:2/27: creat d7/db/fc x:0 0 0 2024-02-15T18:26:49.896 INFO:tasks.workunit.client.1.smithi133.stdout:2/28: readlink d7/l8 0 2024-02-15T18:26:49.899 INFO:tasks.workunit.client.1.smithi133.stdout:5/26: dwrite f4 [0,4194304] 0 2024-02-15T18:26:49.899 INFO:tasks.workunit.client.1.smithi133.stdout:3/44: dwrite d0/f4 [4194304,4194304] 0 2024-02-15T18:26:49.900 INFO:tasks.workunit.client.1.smithi133.stdout:5/27: stat f3 0 2024-02-15T18:26:49.900 INFO:tasks.workunit.client.1.smithi133.stdout:5/28: fdatasync f2 0 2024-02-15T18:26:49.900 INFO:tasks.workunit.client.1.smithi133.stdout:5/29: stat f5 0 2024-02-15T18:26:49.900 INFO:tasks.workunit.client.1.smithi133.stdout:3/45: write d0/f4 [2669983,19516] 0 2024-02-15T18:26:49.900 INFO:tasks.workunit.client.1.smithi133.stdout:9/32: dwrite d0/f6 [0,4194304] 0 2024-02-15T18:26:49.901 INFO:tasks.workunit.client.1.smithi133.stdout:9/33: write d0/f7 [1686560,90738] 0 2024-02-15T18:26:49.901 INFO:tasks.workunit.client.1.smithi133.stdout:9/34: readlink - no filename 2024-02-15T18:26:49.902 INFO:tasks.workunit.client.1.smithi133.stdout:9/35: write d0/f1 [3664879,37053] 0 2024-02-15T18:26:49.902 INFO:tasks.workunit.client.1.smithi133.stdout:9/36: stat d0 0 2024-02-15T18:26:49.903 INFO:tasks.workunit.client.1.smithi133.stdout:5/30: rename f4 to fb 0 2024-02-15T18:26:49.906 INFO:tasks.workunit.client.1.smithi133.stdout:3/46: dread d0/f4 [0,4194304] 0 2024-02-15T18:26:49.907 INFO:tasks.workunit.client.1.smithi133.stdout:3/47: stat d0/f4 0 2024-02-15T18:26:49.910 INFO:tasks.workunit.client.1.smithi133.stdout:3/48: rename d0/f4 to d0/f8 0 2024-02-15T18:26:49.922 INFO:tasks.workunit.client.1.smithi133.stdout:2/29: dwrite f1 [0,4194304] 0 2024-02-15T18:26:49.923 INFO:tasks.workunit.client.1.smithi133.stdout:2/30: symlink d7/ld 0 2024-02-15T18:26:49.923 INFO:tasks.workunit.client.1.smithi133.stdout:2/31: chown c3 555 1 2024-02-15T18:26:49.924 INFO:tasks.workunit.client.1.smithi133.stdout:2/32: readlink d7/ld 0 2024-02-15T18:26:49.924 INFO:tasks.workunit.client.1.smithi133.stdout:2/33: symlink d7/le 0 2024-02-15T18:26:49.926 INFO:tasks.workunit.client.1.smithi133.stdout:2/34: creat d7/ff x:0 0 0 2024-02-15T18:26:49.938 INFO:tasks.workunit.client.1.smithi133.stdout:3/49: dwrite d0/f8 [0,4194304] 0 2024-02-15T18:26:49.939 INFO:tasks.workunit.client.1.smithi133.stdout:5/31: dwrite f3 [0,4194304] 0 2024-02-15T18:26:49.939 INFO:tasks.workunit.client.1.smithi133.stdout:5/32: dread - f5 zero size 2024-02-15T18:26:49.939 INFO:tasks.workunit.client.1.smithi133.stdout:9/37: dwrite d0/f5 [0,4194304] 0 2024-02-15T18:26:49.940 INFO:tasks.workunit.client.1.smithi133.stdout:5/33: rename f9 to fc 0 2024-02-15T18:26:49.941 INFO:tasks.workunit.client.1.smithi133.stdout:5/34: dread f3 [4194304,4194304] 0 2024-02-15T18:26:49.943 INFO:tasks.workunit.client.1.smithi133.stdout:5/35: mknod cd 0 2024-02-15T18:26:49.943 INFO:tasks.workunit.client.1.smithi133.stdout:5/36: rmdir - no directory 2024-02-15T18:26:49.943 INFO:tasks.workunit.client.1.smithi133.stdout:5/37: readlink l1 0 2024-02-15T18:26:49.943 INFO:tasks.workunit.client.1.smithi133.stdout:5/38: write f5 [11964,111900] 0 2024-02-15T18:26:49.944 INFO:tasks.workunit.client.1.smithi133.stdout:5/39: readlink l1 0 2024-02-15T18:26:49.944 INFO:tasks.workunit.client.1.smithi133.stdout:5/40: symlink le 0 2024-02-15T18:26:49.947 INFO:tasks.workunit.client.1.smithi133.stdout:5/41: creat ff x:0 0 0 2024-02-15T18:26:49.947 INFO:tasks.workunit.client.1.smithi133.stdout:5/42: readlink le 0 2024-02-15T18:26:49.947 INFO:tasks.workunit.client.1.smithi133.stdout:9/38: dread d0/f2 [0,4194304] 0 2024-02-15T18:26:49.948 INFO:tasks.workunit.client.1.smithi133.stdout:9/39: write d0/f2 [59444,71116] 0 2024-02-15T18:26:49.948 INFO:tasks.workunit.client.1.smithi133.stdout:3/50: truncate d0/f5 6230215 0 2024-02-15T18:26:49.948 INFO:tasks.workunit.client.1.smithi133.stdout:3/51: fsync d0/f7 0 2024-02-15T18:26:49.950 INFO:tasks.workunit.client.1.smithi133.stdout:5/43: creat f10 x:0 0 0 2024-02-15T18:26:49.950 INFO:tasks.workunit.client.1.smithi133.stdout:3/52: symlink d0/l9 0 2024-02-15T18:26:49.951 INFO:tasks.workunit.client.1.smithi133.stdout:2/35: dwrite d7/db/fc [0,4194304] 0 2024-02-15T18:26:49.951 INFO:tasks.workunit.client.1.smithi133.stdout:5/44: symlink l11 0 2024-02-15T18:26:49.951 INFO:tasks.workunit.client.1.smithi133.stdout:5/45: chown f2 140809173 1 2024-02-15T18:26:49.952 INFO:tasks.workunit.client.1.smithi133.stdout:5/46: read f2 [3234915,80575] 0 2024-02-15T18:26:49.955 INFO:tasks.workunit.client.1.smithi133.stdout:2/36: mknod d7/db/c10 0 2024-02-15T18:26:49.979 INFO:tasks.workunit.client.1.smithi133.stdout:9/40: dwrite d0/f7 [0,4194304] 0 2024-02-15T18:26:49.979 INFO:tasks.workunit.client.1.smithi133.stdout:5/47: dwrite f3 [4194304,4194304] 0 2024-02-15T18:26:49.980 INFO:tasks.workunit.client.1.smithi133.stdout:3/53: dwrite d0/f7 [0,4194304] 0 2024-02-15T18:26:49.981 INFO:tasks.workunit.client.1.smithi133.stdout:2/37: rmdir d7 39 2024-02-15T18:26:49.981 INFO:tasks.workunit.client.1.smithi133.stdout:2/38: readlink d7/ld 0 2024-02-15T18:26:49.981 INFO:tasks.workunit.client.1.smithi133.stdout:2/39: chown c3 7091982 1 2024-02-15T18:26:49.981 INFO:tasks.workunit.client.1.smithi133.stdout:3/54: read d0/f8 [1422957,10259] 0 2024-02-15T18:26:49.984 INFO:tasks.workunit.client.1.smithi133.stdout:9/41: rename d0/f2 to d0/d8/d9/fa 0 2024-02-15T18:26:49.985 INFO:tasks.workunit.client.1.smithi133.stdout:5/48: mknod c12 0 2024-02-15T18:26:49.985 INFO:tasks.workunit.client.1.smithi133.stdout:5/49: stat c7 0 2024-02-15T18:26:49.985 INFO:tasks.workunit.client.1.smithi133.stdout:5/50: chown cd 52592955 1 2024-02-15T18:26:49.985 INFO:tasks.workunit.client.1.smithi133.stdout:5/51: readlink l1 0 2024-02-15T18:26:49.986 INFO:tasks.workunit.client.1.smithi133.stdout:9/42: fsync d0/f1 0 2024-02-15T18:26:49.988 INFO:tasks.workunit.client.1.smithi133.stdout:2/40: mknod d7/db/c11 0 2024-02-15T18:26:49.989 INFO:tasks.workunit.client.1.smithi133.stdout:3/55: dread d0/f7 [0,4194304] 0 2024-02-15T18:26:49.990 INFO:tasks.workunit.client.1.smithi133.stdout:5/52: mknod c13 0 2024-02-15T18:26:49.990 INFO:tasks.workunit.client.1.smithi133.stdout:5/53: readlink le 0 2024-02-15T18:26:49.990 INFO:tasks.workunit.client.1.smithi133.stdout:3/56: creat d0/fa x:0 0 0 2024-02-15T18:26:49.993 INFO:tasks.workunit.client.1.smithi133.stdout:3/57: symlink d0/lb 0 2024-02-15T18:26:49.995 INFO:tasks.workunit.client.1.smithi133.stdout:2/41: truncate f1 2184014 0 2024-02-15T18:26:49.995 INFO:tasks.workunit.client.1.smithi133.stdout:2/42: chown d7 0 1 2024-02-15T18:26:49.996 INFO:tasks.workunit.client.1.smithi133.stdout:2/43: unlink d7/fa 0 2024-02-15T18:26:49.996 INFO:tasks.workunit.client.1.smithi133.stdout:2/44: write d7/ff [178900,99881] 0 2024-02-15T18:26:49.997 INFO:tasks.workunit.client.1.smithi133.stdout:2/45: link d7/l8 d7/l12 0 2024-02-15T18:26:49.998 INFO:tasks.workunit.client.1.smithi133.stdout:2/46: creat d7/f13 x:0 0 0 2024-02-15T18:26:49.999 INFO:tasks.workunit.client.1.smithi133.stdout:2/47: creat d7/f14 x:0 0 0 2024-02-15T18:26:50.000 INFO:tasks.workunit.client.1.smithi133.stdout:2/48: chown d7/l12 2708545 1 2024-02-15T18:26:50.000 INFO:tasks.workunit.client.1.smithi133.stdout:2/49: fdatasync d7/f13 0 2024-02-15T18:26:50.000 INFO:tasks.workunit.client.1.smithi133.stdout:2/50: creat d7/f15 x:0 0 0 2024-02-15T18:26:50.001 INFO:tasks.workunit.client.1.smithi133.stdout:2/51: creat d7/f16 x:0 0 0 2024-02-15T18:26:50.014 INFO:tasks.workunit.client.1.smithi133.stdout:2/52: dwrite d7/f13 [0,4194304] 0 2024-02-15T18:26:50.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:48.681341+0000 mgr.smithi084.hjmnez (mgr.14596) 10 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 241 MiB data, 1001 MiB used, 535 GiB / 536 GiB avail; 64 KiB/s rd, 15 MiB/s wr, 1.49k op/s 2024-02-15T18:26:50.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:48.681341+0000 mgr.smithi084.hjmnez (mgr.14596) 10 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 241 MiB data, 1001 MiB used, 535 GiB / 536 GiB avail; 64 KiB/s rd, 15 MiB/s wr, 1.49k op/s 2024-02-15T18:26:52.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:50.681798+0000 mgr.smithi084.hjmnez (mgr.14596) 11 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 241 MiB data, 1001 MiB used, 535 GiB / 536 GiB avail; 59 KiB/s rd, 14 MiB/s wr, 1.36k op/s 2024-02-15T18:26:52.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:50.681798+0000 mgr.smithi084.hjmnez (mgr.14596) 11 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 241 MiB data, 1001 MiB used, 535 GiB / 536 GiB avail; 59 KiB/s rd, 14 MiB/s wr, 1.36k op/s 2024-02-15T18:26:54.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:52.682351+0000 mgr.smithi084.hjmnez (mgr.14596) 12 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 241 MiB data, 1001 MiB used, 535 GiB / 536 GiB avail; 59 KiB/s rd, 14 MiB/s wr, 1.36k op/s 2024-02-15T18:26:54.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:52.682351+0000 mgr.smithi084.hjmnez (mgr.14596) 12 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 241 MiB data, 1001 MiB used, 535 GiB / 536 GiB avail; 59 KiB/s rd, 14 MiB/s wr, 1.36k op/s 2024-02-15T18:26:56.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:54.683049+0000 mgr.smithi084.hjmnez (mgr.14596) 13 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 27 MiB/s wr, 1.43k op/s 2024-02-15T18:26:56.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:54.683049+0000 mgr.smithi084.hjmnez (mgr.14596) 13 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 27 MiB/s wr, 1.43k op/s 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:7/11: sync 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:0/37: sync 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:9/5: sync 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:9/6: write f0 [73666,28489] 0 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:4/7: sync 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:3/54: sync 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:4/8: chown f1 1765298149 1 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:6/26: sync 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:2/14: sync 2024-02-15T18:26:57.510 INFO:tasks.workunit.client.0.smithi084.stdout:5/12: sync 2024-02-15T18:26:57.511 INFO:tasks.workunit.client.0.smithi084.stdout:5/13: write - no filename 2024-02-15T18:26:57.511 INFO:tasks.workunit.client.0.smithi084.stdout:5/14: fsync - no filename 2024-02-15T18:26:57.511 INFO:tasks.workunit.client.0.smithi084.stdout:5/15: rmdir - no directory 2024-02-15T18:26:57.511 INFO:tasks.workunit.client.0.smithi084.stdout:5/16: dread - no filename 2024-02-15T18:26:57.511 INFO:tasks.workunit.client.0.smithi084.stdout:5/17: rename - no filename 2024-02-15T18:26:57.511 INFO:tasks.workunit.client.0.smithi084.stdout:1/13: sync 2024-02-15T18:26:57.511 INFO:tasks.workunit.client.0.smithi084.stdout:8/54: sync 2024-02-15T18:26:57.513 INFO:tasks.workunit.client.0.smithi084.stdout:0/38: unlink d0/d4/l8 0 2024-02-15T18:26:57.520 INFO:tasks.workunit.client.0.smithi084.stdout:7/12: getdents . 0 2024-02-15T18:26:57.525 INFO:tasks.workunit.client.0.smithi084.stdout:9/7: creat f1 x:0 0 0 2024-02-15T18:26:57.525 INFO:tasks.workunit.client.0.smithi084.stdout:9/8: truncate f0 936346 0 2024-02-15T18:26:57.526 INFO:tasks.workunit.client.0.smithi084.stdout:4/9: mkdir d2 0 2024-02-15T18:26:57.531 INFO:tasks.workunit.client.0.smithi084.stdout:3/55: truncate d8/fc 3527823 0 2024-02-15T18:26:57.532 INFO:tasks.workunit.client.0.smithi084.stdout:6/27: dread f3 [0,4194304] 0 2024-02-15T18:26:57.532 INFO:tasks.workunit.client.0.smithi084.stdout:6/28: truncate f4 78958 0 2024-02-15T18:26:57.533 INFO:tasks.workunit.client.0.smithi084.stdout:2/15: mkdir d3 0 2024-02-15T18:26:57.533 INFO:tasks.workunit.client.0.smithi084.stdout:6/29: dread f9 [0,4194304] 0 2024-02-15T18:26:57.534 INFO:tasks.workunit.client.0.smithi084.stdout:2/16: write f2 [361746,60299] 0 2024-02-15T18:26:57.534 INFO:tasks.workunit.client.0.smithi084.stdout:2/17: stat d3 0 2024-02-15T18:26:57.534 INFO:tasks.workunit.client.0.smithi084.stdout:2/18: rename d3 to d3/d4 22 2024-02-15T18:26:57.534 INFO:tasks.workunit.client.0.smithi084.stdout:5/18: creat f2 x:0 0 0 2024-02-15T18:26:57.536 INFO:tasks.workunit.client.0.smithi084.stdout:1/14: creat f3 x:0 0 0 2024-02-15T18:26:57.536 INFO:tasks.workunit.client.0.smithi084.stdout:1/15: stat f3 0 2024-02-15T18:26:57.537 INFO:tasks.workunit.client.0.smithi084.stdout:0/39: symlink d0/l9 0 2024-02-15T18:26:57.540 INFO:tasks.workunit.client.0.smithi084.stdout:7/13: dwrite f3 [0,4194304] 0 2024-02-15T18:26:57.540 INFO:tasks.workunit.client.0.smithi084.stdout:9/9: symlink l2 0 2024-02-15T18:26:57.540 INFO:tasks.workunit.client.0.smithi084.stdout:9/10: dread - f1 zero size 2024-02-15T18:26:57.540 INFO:tasks.workunit.client.0.smithi084.stdout:9/11: write f1 [952031,58198] 0 2024-02-15T18:26:57.541 INFO:tasks.workunit.client.0.smithi084.stdout:4/10: creat d2/f3 x:0 0 0 2024-02-15T18:26:57.541 INFO:tasks.workunit.client.0.smithi084.stdout:4/11: dread - f1 zero size 2024-02-15T18:26:57.543 INFO:tasks.workunit.client.0.smithi084.stdout:7/14: write f3 [2466578,71051] 0 2024-02-15T18:26:57.544 INFO:tasks.workunit.client.0.smithi084.stdout:6/30: unlink l7 0 2024-02-15T18:26:57.544 INFO:tasks.workunit.client.0.smithi084.stdout:3/56: read d8/fb [929170,20739] 0 2024-02-15T18:26:57.545 INFO:tasks.workunit.client.0.smithi084.stdout:2/19: mkdir d3/d5 0 2024-02-15T18:26:57.545 INFO:tasks.workunit.client.0.smithi084.stdout:2/20: chown f1 76 1 2024-02-15T18:26:57.545 INFO:tasks.workunit.client.0.smithi084.stdout:5/19: creat f3 x:0 0 0 2024-02-15T18:26:57.546 INFO:tasks.workunit.client.0.smithi084.stdout:1/16: symlink l4 0 2024-02-15T18:26:57.546 INFO:tasks.workunit.client.0.smithi084.stdout:1/17: dread - f3 zero size 2024-02-15T18:26:57.546 INFO:tasks.workunit.client.0.smithi084.stdout:1/18: truncate f3 312749 0 2024-02-15T18:26:57.547 INFO:tasks.workunit.client.0.smithi084.stdout:8/55: link l7 db/dd/l15 0 2024-02-15T18:26:57.547 INFO:tasks.workunit.client.0.smithi084.stdout:7/15: dread f0 [0,4194304] 0 2024-02-15T18:26:57.550 INFO:tasks.workunit.client.0.smithi084.stdout:4/12: mkdir d2/d4 0 2024-02-15T18:26:57.556 INFO:tasks.workunit.client.0.smithi084.stdout:2/21: symlink d3/d5/l6 0 2024-02-15T18:26:57.559 INFO:tasks.workunit.client.0.smithi084.stdout:1/19: symlink l5 0 2024-02-15T18:26:57.567 INFO:tasks.workunit.client.0.smithi084.stdout:8/56: creat db/f16 x:0 0 0 2024-02-15T18:26:57.567 INFO:tasks.workunit.client.0.smithi084.stdout:5/20: unlink f3 0 2024-02-15T18:26:57.567 INFO:tasks.workunit.client.0.smithi084.stdout:5/21: write f2 [63677,114211] 0 2024-02-15T18:26:57.574 INFO:tasks.workunit.client.0.smithi084.stdout:7/16: rename f3 to f4 0 2024-02-15T18:26:57.574 INFO:tasks.workunit.client.0.smithi084.stdout:5/22: mknod c4 0 2024-02-15T18:26:57.574 INFO:tasks.workunit.client.0.smithi084.stdout:5/23: write f2 [221957,30613] 0 2024-02-15T18:26:57.575 INFO:tasks.workunit.client.0.smithi084.stdout:7/17: truncate f4 929680 0 2024-02-15T18:26:57.577 INFO:tasks.workunit.client.0.smithi084.stdout:7/18: creat f5 x:0 0 0 2024-02-15T18:26:57.578 INFO:tasks.workunit.client.0.smithi084.stdout:9/12: dwrite f1 [0,4194304] 0 2024-02-15T18:26:57.578 INFO:tasks.workunit.client.0.smithi084.stdout:9/13: stat f0 0 2024-02-15T18:26:57.579 INFO:tasks.workunit.client.0.smithi084.stdout:7/19: dread f0 [0,4194304] 0 2024-02-15T18:26:57.579 INFO:tasks.workunit.client.0.smithi084.stdout:7/20: fdatasync f4 0 2024-02-15T18:26:57.581 INFO:tasks.workunit.client.0.smithi084.stdout:2/22: dwrite f1 [0,4194304] 0 2024-02-15T18:26:57.584 INFO:tasks.workunit.client.0.smithi084.stdout:9/14: symlink l3 0 2024-02-15T18:26:57.585 INFO:tasks.workunit.client.0.smithi084.stdout:9/15: stat l3 0 2024-02-15T18:26:57.589 INFO:tasks.workunit.client.0.smithi084.stdout:2/23: mknod d3/d5/c7 0 2024-02-15T18:26:57.591 INFO:tasks.workunit.client.0.smithi084.stdout:9/16: unlink l2 0 2024-02-15T18:26:57.593 INFO:tasks.workunit.client.0.smithi084.stdout:4/13: dwrite d2/f3 [0,4194304] 0 2024-02-15T18:26:57.593 INFO:tasks.workunit.client.0.smithi084.stdout:3/57: dread d8/fc [0,4194304] 0 2024-02-15T18:26:57.593 INFO:tasks.workunit.client.0.smithi084.stdout:3/58: fsync d8/fb 0 2024-02-15T18:26:57.598 INFO:tasks.workunit.client.0.smithi084.stdout:4/14: rename f1 to d2/d4/f5 0 2024-02-15T18:26:57.598 INFO:tasks.workunit.client.0.smithi084.stdout:4/15: dread - d2/d4/f5 zero size 2024-02-15T18:26:57.599 INFO:tasks.workunit.client.0.smithi084.stdout:6/31: dwrite fb [0,4194304] 0 2024-02-15T18:26:57.600 INFO:tasks.workunit.client.0.smithi084.stdout:6/32: write f4 [2346852,22895] 0 2024-02-15T18:26:57.602 INFO:tasks.workunit.client.0.smithi084.stdout:6/33: creat fd x:0 0 0 2024-02-15T18:26:57.603 INFO:tasks.workunit.client.0.smithi084.stdout:6/34: creat fe x:0 0 0 2024-02-15T18:26:57.603 INFO:tasks.workunit.client.0.smithi084.stdout:6/35: chown f3 0 1 2024-02-15T18:26:57.603 INFO:tasks.workunit.client.0.smithi084.stdout:6/36: chown fb 41963 1 2024-02-15T18:26:57.612 INFO:tasks.workunit.client.0.smithi084.stdout:1/20: dwrite f3 [0,4194304] 0 2024-02-15T18:26:57.613 INFO:tasks.workunit.client.0.smithi084.stdout:8/57: dwrite fa [0,4194304] 0 2024-02-15T18:26:57.613 INFO:tasks.workunit.client.0.smithi084.stdout:8/58: chown db/dd/f10 53094386 1 2024-02-15T18:26:57.616 INFO:tasks.workunit.client.0.smithi084.stdout:1/21: symlink l6 0 2024-02-15T18:26:57.616 INFO:tasks.workunit.client.0.smithi084.stdout:7/21: write f0 [1469768,127301] 0 2024-02-15T18:26:57.617 INFO:tasks.workunit.client.0.smithi084.stdout:8/59: mknod db/dd/c17 0 2024-02-15T18:26:57.617 INFO:tasks.workunit.client.0.smithi084.stdout:8/60: dread - db/f11 zero size 2024-02-15T18:26:57.617 INFO:tasks.workunit.client.0.smithi084.stdout:5/24: dwrite f2 [0,4194304] 0 2024-02-15T18:26:57.618 INFO:tasks.workunit.client.0.smithi084.stdout:7/22: mknod c6 0 2024-02-15T18:26:57.619 INFO:tasks.workunit.client.0.smithi084.stdout:8/61: mknod db/dd/d13/c18 0 2024-02-15T18:26:57.620 INFO:tasks.workunit.client.0.smithi084.stdout:6/37: dread fb [0,4194304] 0 2024-02-15T18:26:57.620 INFO:tasks.workunit.client.0.smithi084.stdout:6/38: dread - fd zero size 2024-02-15T18:26:57.620 INFO:tasks.workunit.client.0.smithi084.stdout:2/24: getdents d3/d5 0 2024-02-15T18:26:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:3/59: truncate d8/fb 1776486 0 2024-02-15T18:26:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:5/25: mknod c5 0 2024-02-15T18:26:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:7/23: link f5 f7 0 2024-02-15T18:26:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:9/17: dwrite f1 [4194304,4194304] 0 2024-02-15T18:26:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:9/18: chown f1 1785403279 1 2024-02-15T18:26:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:9/19: rmdir - no directory 2024-02-15T18:26:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:8/62: mknod db/c19 0 2024-02-15T18:26:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:7/24: fdatasync f0 0 2024-02-15T18:26:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:2/25: creat d3/f8 x:0 0 0 2024-02-15T18:26:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:7/25: write f7 [558611,89281] 0 2024-02-15T18:26:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:7/26: write f7 [812381,98456] 0 2024-02-15T18:26:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:7/27: rmdir - no directory 2024-02-15T18:26:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:7/28: chown l2 504310528 1 2024-02-15T18:26:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:1/22: truncate f3 2417628 0 2024-02-15T18:26:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:4/16: dread d2/f3 [0,4194304] 0 2024-02-15T18:26:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:3/60: rename d8/dd/ce to d8/c10 0 2024-02-15T18:26:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:5/26: symlink l6 0 2024-02-15T18:26:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:6/39: write f3 [235993,79478] 0 2024-02-15T18:26:57.639 INFO:tasks.workunit.client.0.smithi084.stdout:9/20: mkdir d4 0 2024-02-15T18:26:57.641 INFO:tasks.workunit.client.0.smithi084.stdout:8/63: mkdir db/d1a 0 2024-02-15T18:26:57.643 INFO:tasks.workunit.client.0.smithi084.stdout:1/23: link c2 c7 0 2024-02-15T18:26:57.645 INFO:tasks.workunit.client.0.smithi084.stdout:3/61: creat d8/f11 x:0 0 0 2024-02-15T18:26:57.646 INFO:tasks.workunit.client.0.smithi084.stdout:5/27: mknod c7 0 2024-02-15T18:26:57.647 INFO:tasks.workunit.client.0.smithi084.stdout:6/40: mknod cf 0 2024-02-15T18:26:57.647 INFO:tasks.workunit.client.0.smithi084.stdout:6/41: write f4 [4504199,40593] 0 2024-02-15T18:26:57.649 INFO:tasks.workunit.client.0.smithi084.stdout:6/42: write fb [4359292,83084] 0 2024-02-15T18:26:57.649 INFO:tasks.workunit.client.0.smithi084.stdout:6/43: chown f3 77 1 2024-02-15T18:26:57.649 INFO:tasks.workunit.client.0.smithi084.stdout:6/44: chown c6 0 1 2024-02-15T18:26:57.649 INFO:tasks.workunit.client.0.smithi084.stdout:9/21: creat d4/f5 x:0 0 0 2024-02-15T18:26:57.649 INFO:tasks.workunit.client.0.smithi084.stdout:9/22: readlink l3 0 2024-02-15T18:26:57.651 INFO:tasks.workunit.client.0.smithi084.stdout:5/28: write f2 [682382,90331] 0 2024-02-15T18:26:57.651 INFO:tasks.workunit.client.0.smithi084.stdout:6/45: link fc f10 0 2024-02-15T18:26:57.651 INFO:tasks.workunit.client.0.smithi084.stdout:6/46: truncate fc 174300 0 2024-02-15T18:26:57.652 INFO:tasks.workunit.client.0.smithi084.stdout:1/24: dread f3 [0,4194304] 0 2024-02-15T18:26:57.652 INFO:tasks.workunit.client.0.smithi084.stdout:1/25: write f3 [3397496,56098] 0 2024-02-15T18:26:57.652 INFO:tasks.workunit.client.0.smithi084.stdout:1/26: chown c2 237775 1 2024-02-15T18:26:57.652 INFO:tasks.workunit.client.0.smithi084.stdout:1/27: truncate f3 3518188 0 2024-02-15T18:26:57.653 INFO:tasks.workunit.client.0.smithi084.stdout:2/26: dwrite f0 [0,4194304] 0 2024-02-15T18:26:57.656 INFO:tasks.workunit.client.0.smithi084.stdout:6/47: link l2 l11 0 2024-02-15T18:26:57.656 INFO:tasks.workunit.client.0.smithi084.stdout:1/28: creat f8 x:0 0 0 2024-02-15T18:26:57.656 INFO:tasks.workunit.client.0.smithi084.stdout:1/29: fdatasync f8 0 2024-02-15T18:26:57.660 INFO:tasks.workunit.client.0.smithi084.stdout:7/29: truncate f0 143627 0 2024-02-15T18:26:57.660 INFO:tasks.workunit.client.0.smithi084.stdout:7/30: chown c1 39468 1 2024-02-15T18:26:57.660 INFO:tasks.workunit.client.0.smithi084.stdout:2/27: read f1 [1494573,15118] 0 2024-02-15T18:26:57.661 INFO:tasks.workunit.client.0.smithi084.stdout:6/48: link l5 l12 0 2024-02-15T18:26:57.664 INFO:tasks.workunit.client.0.smithi084.stdout:7/31: getdents . 0 2024-02-15T18:26:57.664 INFO:tasks.workunit.client.0.smithi084.stdout:8/64: dwrite db/f16 [0,4194304] 0 2024-02-15T18:26:57.664 INFO:tasks.workunit.client.0.smithi084.stdout:9/23: dread f1 [0,4194304] 0 2024-02-15T18:26:57.664 INFO:tasks.workunit.client.0.smithi084.stdout:9/24: write f0 [1668226,22123] 0 2024-02-15T18:26:57.664 INFO:tasks.workunit.client.0.smithi084.stdout:4/17: dwrite d2/d4/f5 [0,4194304] 0 2024-02-15T18:26:57.667 INFO:tasks.workunit.client.0.smithi084.stdout:7/32: write f0 [121108,52506] 0 2024-02-15T18:26:57.668 INFO:tasks.workunit.client.0.smithi084.stdout:6/49: creat f13 x:0 0 0 2024-02-15T18:26:57.668 INFO:tasks.workunit.client.0.smithi084.stdout:6/50: readlink l5 0 2024-02-15T18:26:57.668 INFO:tasks.workunit.client.0.smithi084.stdout:6/51: fsync f9 0 2024-02-15T18:26:57.670 INFO:tasks.workunit.client.0.smithi084.stdout:5/29: dread f2 [0,4194304] 0 2024-02-15T18:26:57.671 INFO:tasks.workunit.client.0.smithi084.stdout:8/65: mknod db/c1b 0 2024-02-15T18:26:57.672 INFO:tasks.workunit.client.0.smithi084.stdout:9/25: creat d4/f6 x:0 0 0 2024-02-15T18:26:57.675 INFO:tasks.workunit.client.0.smithi084.stdout:1/30: truncate f3 1897850 0 2024-02-15T18:26:57.677 INFO:tasks.workunit.client.0.smithi084.stdout:2/28: truncate f2 1084213 0 2024-02-15T18:26:57.677 INFO:tasks.workunit.client.0.smithi084.stdout:2/29: write d3/f8 [299561,85304] 0 2024-02-15T18:26:57.677 INFO:tasks.workunit.client.0.smithi084.stdout:6/52: dread f4 [0,4194304] 0 2024-02-15T18:26:57.678 INFO:tasks.workunit.client.0.smithi084.stdout:7/33: symlink l8 0 2024-02-15T18:26:57.678 INFO:tasks.workunit.client.0.smithi084.stdout:7/34: truncate f7 1634434 0 2024-02-15T18:26:57.681 INFO:tasks.workunit.client.0.smithi084.stdout:5/30: creat f8 x:0 0 0 2024-02-15T18:26:57.681 INFO:tasks.workunit.client.0.smithi084.stdout:5/31: chown c5 57 1 2024-02-15T18:26:57.681 INFO:tasks.workunit.client.0.smithi084.stdout:5/32: stat c7 0 2024-02-15T18:26:57.684 INFO:tasks.workunit.client.0.smithi084.stdout:6/53: mkdir d14 0 2024-02-15T18:26:57.685 INFO:tasks.workunit.client.0.smithi084.stdout:6/54: write f9 [1296517,81931] 0 2024-02-15T18:26:57.685 INFO:tasks.workunit.client.0.smithi084.stdout:7/35: creat f9 x:0 0 0 2024-02-15T18:26:57.685 INFO:tasks.workunit.client.0.smithi084.stdout:7/36: truncate f9 744167 0 2024-02-15T18:26:57.685 INFO:tasks.workunit.client.0.smithi084.stdout:7/37: read f0 [113260,309] 0 2024-02-15T18:26:57.686 INFO:tasks.workunit.client.0.smithi084.stdout:7/38: write f0 [566033,18332] 0 2024-02-15T18:26:57.686 INFO:tasks.workunit.client.0.smithi084.stdout:7/39: creat fa x:0 0 0 2024-02-15T18:26:57.688 INFO:tasks.workunit.client.0.smithi084.stdout:2/30: read f2 [495238,64851] 0 2024-02-15T18:26:57.694 INFO:tasks.workunit.client.0.smithi084.stdout:1/31: read f3 [160777,69318] 0 2024-02-15T18:26:57.694 INFO:tasks.workunit.client.0.smithi084.stdout:6/55: dread f4 [0,4194304] 0 2024-02-15T18:26:57.694 INFO:tasks.workunit.client.0.smithi084.stdout:6/56: readlink l12 0 2024-02-15T18:26:57.694 INFO:tasks.workunit.client.0.smithi084.stdout:6/57: fdatasync fc 0 2024-02-15T18:26:57.694 INFO:tasks.workunit.client.0.smithi084.stdout:6/58: write fc [811994,130704] 0 2024-02-15T18:26:57.697 INFO:tasks.workunit.client.0.smithi084.stdout:6/59: symlink d14/l15 0 2024-02-15T18:26:57.697 INFO:tasks.workunit.client.0.smithi084.stdout:1/32: mkdir d9 0 2024-02-15T18:26:57.697 INFO:tasks.workunit.client.0.smithi084.stdout:8/66: dwrite db/dd/f12 [0,4194304] 0 2024-02-15T18:26:57.697 INFO:tasks.workunit.client.0.smithi084.stdout:8/67: fsync db/dd/f12 0 2024-02-15T18:26:57.697 INFO:tasks.workunit.client.0.smithi084.stdout:9/26: dwrite d4/f6 [0,4194304] 0 2024-02-15T18:26:57.697 INFO:tasks.workunit.client.0.smithi084.stdout:9/27: truncate f1 9214920 0 2024-02-15T18:26:57.700 INFO:tasks.workunit.client.0.smithi084.stdout:1/33: unlink f8 0 2024-02-15T18:26:57.701 INFO:tasks.workunit.client.0.smithi084.stdout:4/18: dread d2/d4/f5 [0,4194304] 0 2024-02-15T18:26:57.701 INFO:tasks.workunit.client.0.smithi084.stdout:6/60: unlink fe 0 2024-02-15T18:26:57.703 INFO:tasks.workunit.client.0.smithi084.stdout:1/34: mknod d9/ca 0 2024-02-15T18:26:57.703 INFO:tasks.workunit.client.0.smithi084.stdout:1/35: fsync f3 0 2024-02-15T18:26:57.705 INFO:tasks.workunit.client.0.smithi084.stdout:1/36: creat d9/fb x:0 0 0 2024-02-15T18:26:57.708 INFO:tasks.workunit.client.0.smithi084.stdout:8/68: dread db/dd/f12 [0,4194304] 0 2024-02-15T18:26:57.710 INFO:tasks.workunit.client.0.smithi084.stdout:1/37: symlink d9/lc 0 2024-02-15T18:26:57.710 INFO:tasks.workunit.client.0.smithi084.stdout:1/38: chown d9/fb 351 1 2024-02-15T18:26:57.710 INFO:tasks.workunit.client.0.smithi084.stdout:1/39: chown d9/ca 119 1 2024-02-15T18:26:57.710 INFO:tasks.workunit.client.0.smithi084.stdout:1/40: write f3 [2485166,96127] 0 2024-02-15T18:26:57.712 INFO:tasks.workunit.client.0.smithi084.stdout:8/69: mkdir db/d1c 0 2024-02-15T18:26:57.712 INFO:tasks.workunit.client.0.smithi084.stdout:2/31: dwrite f2 [0,4194304] 0 2024-02-15T18:26:57.713 INFO:tasks.workunit.client.0.smithi084.stdout:1/41: unlink c0 0 2024-02-15T18:26:57.713 INFO:tasks.workunit.client.0.smithi084.stdout:1/42: truncate d9/fb 760286 0 2024-02-15T18:26:57.714 INFO:tasks.workunit.client.0.smithi084.stdout:8/70: creat db/d1a/f1d x:0 0 0 2024-02-15T18:26:57.716 INFO:tasks.workunit.client.0.smithi084.stdout:5/33: dwrite f2 [0,4194304] 0 2024-02-15T18:26:57.716 INFO:tasks.workunit.client.0.smithi084.stdout:7/40: truncate f7 665537 0 2024-02-15T18:26:57.718 INFO:tasks.workunit.client.0.smithi084.stdout:2/32: getdents d3 0 2024-02-15T18:26:57.722 INFO:tasks.workunit.client.0.smithi084.stdout:1/43: mkdir d9/dd 0 2024-02-15T18:26:57.723 INFO:tasks.workunit.client.0.smithi084.stdout:5/34: mkdir d9 0 2024-02-15T18:26:57.723 INFO:tasks.workunit.client.0.smithi084.stdout:1/44: readlink l1 0 2024-02-15T18:26:57.723 INFO:tasks.workunit.client.0.smithi084.stdout:1/45: dread d9/fb [0,4194304] 0 2024-02-15T18:26:57.724 INFO:tasks.workunit.client.0.smithi084.stdout:7/41: creat fb x:0 0 0 2024-02-15T18:26:57.725 INFO:tasks.workunit.client.0.smithi084.stdout:7/42: creat fc x:0 0 0 2024-02-15T18:26:57.726 INFO:tasks.workunit.client.0.smithi084.stdout:7/43: creat fd x:0 0 0 2024-02-15T18:26:57.731 INFO:tasks.workunit.client.0.smithi084.stdout:6/61: truncate fc 32289 0 2024-02-15T18:26:57.735 INFO:tasks.workunit.client.0.smithi084.stdout:5/35: dread f2 [0,4194304] 0 2024-02-15T18:26:57.737 INFO:tasks.workunit.client.0.smithi084.stdout:9/28: dwrite f1 [4194304,4194304] 0 2024-02-15T18:26:57.737 INFO:tasks.workunit.client.0.smithi084.stdout:9/29: write d4/f5 [832815,47753] 0 2024-02-15T18:26:57.744 INFO:tasks.workunit.client.0.smithi084.stdout:6/62: creat d14/f16 x:0 0 0 2024-02-15T18:26:57.744 INFO:tasks.workunit.client.0.smithi084.stdout:8/71: dwrite db/fc [0,4194304] 0 2024-02-15T18:26:57.744 INFO:tasks.workunit.client.0.smithi084.stdout:7/44: read f7 [472416,127169] 0 2024-02-15T18:26:57.744 INFO:tasks.workunit.client.0.smithi084.stdout:5/36: unlink f2 0 2024-02-15T18:26:57.746 INFO:tasks.workunit.client.0.smithi084.stdout:4/19: dwrite d2/f3 [0,4194304] 0 2024-02-15T18:26:57.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/33: dwrite f2 [0,4194304] 0 2024-02-15T18:26:57.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/34: stat f2 0 2024-02-15T18:26:57.748 INFO:tasks.workunit.client.0.smithi084.stdout:9/30: truncate d4/f6 2892136 0 2024-02-15T18:26:57.748 INFO:tasks.workunit.client.0.smithi084.stdout:1/46: dread f3 [0,4194304] 0 2024-02-15T18:26:57.748 INFO:tasks.workunit.client.0.smithi084.stdout:8/72: creat db/d1c/f1e x:0 0 0 2024-02-15T18:26:57.750 INFO:tasks.workunit.client.0.smithi084.stdout:5/37: unlink c7 0 2024-02-15T18:26:57.751 INFO:tasks.workunit.client.0.smithi084.stdout:4/20: creat d2/f6 x:0 0 0 2024-02-15T18:26:57.751 INFO:tasks.workunit.client.0.smithi084.stdout:9/31: write f0 [1506472,32622] 0 2024-02-15T18:26:57.760 INFO:tasks.workunit.client.0.smithi084.stdout:1/47: rename l4 to d9/le 0 2024-02-15T18:26:57.763 INFO:tasks.workunit.client.0.smithi084.stdout:4/21: creat d2/d4/f7 x:0 0 0 2024-02-15T18:26:57.763 INFO:tasks.workunit.client.0.smithi084.stdout:4/22: chown d2/f6 217933282 1 2024-02-15T18:26:57.763 INFO:tasks.workunit.client.0.smithi084.stdout:4/23: fdatasync d2/f6 0 2024-02-15T18:26:57.763 INFO:tasks.workunit.client.0.smithi084.stdout:4/24: truncate d2/d4/f7 181696 0 2024-02-15T18:26:57.764 INFO:tasks.workunit.client.0.smithi084.stdout:1/48: symlink d9/lf 0 2024-02-15T18:26:57.764 INFO:tasks.workunit.client.0.smithi084.stdout:5/38: mkdir d9/da 0 2024-02-15T18:26:57.764 INFO:tasks.workunit.client.0.smithi084.stdout:5/39: fdatasync f8 0 2024-02-15T18:26:57.767 INFO:tasks.workunit.client.0.smithi084.stdout:1/49: rename c2 to d9/dd/c10 0 2024-02-15T18:26:57.779 INFO:tasks.workunit.client.0.smithi084.stdout:7/45: dwrite f5 [0,4194304] 0 2024-02-15T18:26:57.779 INFO:tasks.workunit.client.0.smithi084.stdout:6/63: dwrite f13 [0,4194304] 0 2024-02-15T18:26:57.780 INFO:tasks.workunit.client.0.smithi084.stdout:6/64: readlink l12 0 2024-02-15T18:26:57.780 INFO:tasks.workunit.client.0.smithi084.stdout:7/46: readlink l8 0 2024-02-15T18:26:57.780 INFO:tasks.workunit.client.0.smithi084.stdout:6/65: truncate fd 146215 0 2024-02-15T18:26:57.780 INFO:tasks.workunit.client.0.smithi084.stdout:6/66: read - d14/f16 zero size 2024-02-15T18:26:57.780 INFO:tasks.workunit.client.0.smithi084.stdout:8/73: dwrite db/dd/f12 [0,4194304] 0 2024-02-15T18:26:57.781 INFO:tasks.workunit.client.0.smithi084.stdout:9/32: dwrite d4/f6 [0,4194304] 0 2024-02-15T18:26:57.781 INFO:tasks.workunit.client.0.smithi084.stdout:9/33: chown d4/f5 3631 1 2024-02-15T18:26:57.782 INFO:tasks.workunit.client.0.smithi084.stdout:5/40: getdents d9 0 2024-02-15T18:26:57.784 INFO:tasks.workunit.client.0.smithi084.stdout:2/35: truncate f0 3442243 0 2024-02-15T18:26:57.784 INFO:tasks.workunit.client.0.smithi084.stdout:4/25: getdents d2/d4 0 2024-02-15T18:26:57.785 INFO:tasks.workunit.client.0.smithi084.stdout:8/74: dread db/fc [0,4194304] 0 2024-02-15T18:26:57.786 INFO:tasks.workunit.client.0.smithi084.stdout:8/75: write db/fe [5164610,52144] 0 2024-02-15T18:26:57.786 INFO:tasks.workunit.client.0.smithi084.stdout:1/50: rmdir d9 39 2024-02-15T18:26:57.787 INFO:tasks.workunit.client.0.smithi084.stdout:7/47: truncate f9 589624 0 2024-02-15T18:26:57.790 INFO:tasks.workunit.client.0.smithi084.stdout:7/48: read f5 [2801371,121498] 0 2024-02-15T18:26:57.790 INFO:tasks.workunit.client.0.smithi084.stdout:2/36: write f0 [3813834,124709] 0 2024-02-15T18:26:57.790 INFO:tasks.workunit.client.0.smithi084.stdout:2/37: getdents d3 0 2024-02-15T18:26:57.790 INFO:tasks.workunit.client.0.smithi084.stdout:2/38: stat d3 0 2024-02-15T18:26:57.790 INFO:tasks.workunit.client.0.smithi084.stdout:2/39: chown d3/f8 9531249 1 2024-02-15T18:26:57.790 INFO:tasks.workunit.client.0.smithi084.stdout:6/67: creat d14/f17 x:0 0 0 2024-02-15T18:26:57.793 INFO:tasks.workunit.client.0.smithi084.stdout:6/68: dread f10 [0,4194304] 0 2024-02-15T18:26:57.795 INFO:tasks.workunit.client.0.smithi084.stdout:9/34: mknod d4/c7 0 2024-02-15T18:26:57.796 INFO:tasks.workunit.client.0.smithi084.stdout:5/41: symlink d9/da/lb 0 2024-02-15T18:26:57.798 INFO:tasks.workunit.client.0.smithi084.stdout:4/26: creat d2/d4/f8 x:0 0 0 2024-02-15T18:26:57.800 INFO:tasks.workunit.client.0.smithi084.stdout:7/49: dread f7 [0,4194304] 0 2024-02-15T18:26:57.803 INFO:tasks.workunit.client.0.smithi084.stdout:2/40: mknod d3/c9 0 2024-02-15T18:26:57.803 INFO:tasks.workunit.client.0.smithi084.stdout:6/69: symlink d14/l18 0 2024-02-15T18:26:57.803 INFO:tasks.workunit.client.0.smithi084.stdout:6/70: rename d14 to d14/d19 22 2024-02-15T18:26:57.803 INFO:tasks.workunit.client.0.smithi084.stdout:0/40: sync 2024-02-15T18:26:57.803 INFO:tasks.workunit.client.0.smithi084.stdout:0/41: stat d0/l9 0 2024-02-15T18:26:57.804 INFO:tasks.workunit.client.0.smithi084.stdout:9/35: symlink d4/l8 0 2024-02-15T18:26:57.804 INFO:tasks.workunit.client.0.smithi084.stdout:5/42: mknod d9/cc 0 2024-02-15T18:26:57.805 INFO:tasks.workunit.client.0.smithi084.stdout:8/76: dwrite db/f16 [0,4194304] 0 2024-02-15T18:26:57.805 INFO:tasks.workunit.client.0.smithi084.stdout:8/77: readlink l7 0 2024-02-15T18:26:57.805 INFO:tasks.workunit.client.0.smithi084.stdout:8/78: fsync db/d1a/f1d 0 2024-02-15T18:26:57.805 INFO:tasks.workunit.client.0.smithi084.stdout:7/50: creat fe x:0 0 0 2024-02-15T18:26:57.805 INFO:tasks.workunit.client.0.smithi084.stdout:7/51: rmdir - no directory 2024-02-15T18:26:57.806 INFO:tasks.workunit.client.0.smithi084.stdout:7/52: stat fa 0 2024-02-15T18:26:57.806 INFO:tasks.workunit.client.0.smithi084.stdout:7/53: chown fd 646 1 2024-02-15T18:26:57.806 INFO:tasks.workunit.client.0.smithi084.stdout:8/79: write db/fe [5473503,69995] 0 2024-02-15T18:26:57.812 INFO:tasks.workunit.client.0.smithi084.stdout:8/80: dread db/fc [0,4194304] 0 2024-02-15T18:26:57.812 INFO:tasks.workunit.client.0.smithi084.stdout:8/81: write db/d1c/f1e [297237,55011] 0 2024-02-15T18:26:57.812 INFO:tasks.workunit.client.0.smithi084.stdout:0/42: truncate d0/d4/f6 4084125 0 2024-02-15T18:26:57.812 INFO:tasks.workunit.client.0.smithi084.stdout:7/54: mkdir df 0 2024-02-15T18:26:57.814 INFO:tasks.workunit.client.0.smithi084.stdout:5/43: rename c5 to d9/da/cd 0 2024-02-15T18:26:57.814 INFO:tasks.workunit.client.0.smithi084.stdout:5/44: dread - f8 zero size 2024-02-15T18:26:57.814 INFO:tasks.workunit.client.0.smithi084.stdout:0/43: mknod d0/ca 0 2024-02-15T18:26:57.814 INFO:tasks.workunit.client.0.smithi084.stdout:7/55: creat df/f10 x:0 0 0 2024-02-15T18:26:57.815 INFO:tasks.workunit.client.0.smithi084.stdout:5/45: creat d9/fe x:0 0 0 2024-02-15T18:26:57.815 INFO:tasks.workunit.client.0.smithi084.stdout:0/44: mkdir d0/db 0 2024-02-15T18:26:57.816 INFO:tasks.workunit.client.0.smithi084.stdout:7/56: link c1 df/c11 0 2024-02-15T18:26:57.819 INFO:tasks.workunit.client.0.smithi084.stdout:5/46: rename c4 to d9/da/cf 0 2024-02-15T18:26:57.819 INFO:tasks.workunit.client.0.smithi084.stdout:5/47: chown d9/da/lb 10553675 1 2024-02-15T18:26:57.819 INFO:tasks.workunit.client.0.smithi084.stdout:0/45: rename d0 to d0/db/dc 22 2024-02-15T18:26:57.821 INFO:tasks.workunit.client.0.smithi084.stdout:1/51: dwrite f3 [0,4194304] 0 2024-02-15T18:26:57.821 INFO:tasks.workunit.client.0.smithi084.stdout:1/52: truncate f3 4813749 0 2024-02-15T18:26:57.822 INFO:tasks.workunit.client.0.smithi084.stdout:2/41: getdents d3 0 2024-02-15T18:26:57.822 INFO:tasks.workunit.client.0.smithi084.stdout:2/42: stat f0 0 2024-02-15T18:26:57.822 INFO:tasks.workunit.client.0.smithi084.stdout:2/43: truncate d3/f8 1072433 0 2024-02-15T18:26:57.827 INFO:tasks.workunit.client.0.smithi084.stdout:1/53: symlink d9/dd/l11 0 2024-02-15T18:26:57.827 INFO:tasks.workunit.client.0.smithi084.stdout:3/62: sync 2024-02-15T18:26:57.829 INFO:tasks.workunit.client.0.smithi084.stdout:2/44: rename d3/f8 to d3/d5/fa 0 2024-02-15T18:26:57.836 INFO:tasks.workunit.client.0.smithi084.stdout:1/54: mkdir d9/dd/d12 0 2024-02-15T18:26:57.837 INFO:tasks.workunit.client.0.smithi084.stdout:2/45: rename d3 to d3/d5/db 22 2024-02-15T18:26:57.839 INFO:tasks.workunit.client.0.smithi084.stdout:1/55: creat d9/dd/f13 x:0 0 0 2024-02-15T18:26:57.840 INFO:tasks.workunit.client.0.smithi084.stdout:1/56: getdents d9 0 2024-02-15T18:26:57.842 INFO:tasks.workunit.client.0.smithi084.stdout:3/63: rmdir d8/dd 0 2024-02-15T18:26:57.842 INFO:tasks.workunit.client.0.smithi084.stdout:3/64: fdatasync d8/fc 0 2024-02-15T18:26:57.844 INFO:tasks.workunit.client.0.smithi084.stdout:3/65: creat d8/f12 x:0 0 0 2024-02-15T18:26:57.845 INFO:tasks.workunit.client.0.smithi084.stdout:3/66: creat d8/f13 x:0 0 0 2024-02-15T18:26:57.845 INFO:tasks.workunit.client.0.smithi084.stdout:3/67: chown d8/f12 457248 1 2024-02-15T18:26:57.845 INFO:tasks.workunit.client.0.smithi084.stdout:3/68: chown d8/fc 108 1 2024-02-15T18:26:57.845 INFO:tasks.workunit.client.0.smithi084.stdout:9/36: dwrite d4/f6 [0,4194304] 0 2024-02-15T18:26:57.846 INFO:tasks.workunit.client.0.smithi084.stdout:3/69: link c7 d8/c14 0 2024-02-15T18:26:57.852 INFO:tasks.workunit.client.0.smithi084.stdout:3/70: write d8/fc [1259279,58209] 0 2024-02-15T18:26:57.852 INFO:tasks.workunit.client.0.smithi084.stdout:3/71: write d8/f11 [573718,53089] 0 2024-02-15T18:26:57.853 INFO:tasks.workunit.client.0.smithi084.stdout:6/71: dwrite d14/f17 [0,4194304] 0 2024-02-15T18:26:57.853 INFO:tasks.workunit.client.0.smithi084.stdout:6/72: chown l5 147904612 1 2024-02-15T18:26:57.853 INFO:tasks.workunit.client.0.smithi084.stdout:3/72: creat d8/f15 x:0 0 0 2024-02-15T18:26:57.853 INFO:tasks.workunit.client.0.smithi084.stdout:3/73: write d8/f13 [49922,21200] 0 2024-02-15T18:26:57.853 INFO:tasks.workunit.client.0.smithi084.stdout:3/74: rename d8 to d8/d16 22 2024-02-15T18:26:57.855 INFO:tasks.workunit.client.0.smithi084.stdout:7/57: dwrite fc [0,4194304] 0 2024-02-15T18:26:57.855 INFO:tasks.workunit.client.0.smithi084.stdout:7/58: truncate df/f10 685404 0 2024-02-15T18:26:57.855 INFO:tasks.workunit.client.0.smithi084.stdout:5/48: dwrite f8 [0,4194304] 0 2024-02-15T18:26:57.855 INFO:tasks.workunit.client.0.smithi084.stdout:0/46: dwrite d0/d4/f6 [0,4194304] 0 2024-02-15T18:26:57.855 INFO:tasks.workunit.client.0.smithi084.stdout:4/27: dwrite d2/d4/f8 [0,4194304] 0 2024-02-15T18:26:57.855 INFO:tasks.workunit.client.0.smithi084.stdout:4/28: chown d2/f6 10 1 2024-02-15T18:26:57.856 INFO:tasks.workunit.client.0.smithi084.stdout:6/73: mkdir d14/d1a 0 2024-02-15T18:26:57.856 INFO:tasks.workunit.client.0.smithi084.stdout:6/74: readlink l12 0 2024-02-15T18:26:57.856 INFO:tasks.workunit.client.0.smithi084.stdout:9/37: fsync f0 0 2024-02-15T18:26:57.857 INFO:tasks.workunit.client.0.smithi084.stdout:2/46: write f2 [872375,11079] 0 2024-02-15T18:26:57.858 INFO:tasks.workunit.client.0.smithi084.stdout:2/47: chown d3/d5/c7 1884 1 2024-02-15T18:26:57.859 INFO:tasks.workunit.client.0.smithi084.stdout:3/75: fsync d8/f13 0 2024-02-15T18:26:57.861 INFO:tasks.workunit.client.0.smithi084.stdout:7/59: symlink df/l12 0 2024-02-15T18:26:57.861 INFO:tasks.workunit.client.0.smithi084.stdout:7/60: fdatasync fd 0 2024-02-15T18:26:57.862 INFO:tasks.workunit.client.0.smithi084.stdout:7/61: write fd [77986,114115] 0 2024-02-15T18:26:57.863 INFO:tasks.workunit.client.0.smithi084.stdout:6/75: dread fb [0,4194304] 0 2024-02-15T18:26:57.864 INFO:tasks.workunit.client.0.smithi084.stdout:5/49: creat d9/f10 x:0 0 0 2024-02-15T18:26:57.864 INFO:tasks.workunit.client.0.smithi084.stdout:6/76: dread f10 [0,4194304] 0 2024-02-15T18:26:57.864 INFO:tasks.workunit.client.0.smithi084.stdout:9/38: dread f1 [0,4194304] 0 2024-02-15T18:26:57.866 INFO:tasks.workunit.client.0.smithi084.stdout:0/47: rename d0/d4/f6 to d0/fd 0 2024-02-15T18:26:57.871 INFO:tasks.workunit.client.0.smithi084.stdout:4/29: dread d2/f3 [0,4194304] 0 2024-02-15T18:26:57.871 INFO:tasks.workunit.client.0.smithi084.stdout:3/76: symlink d8/l17 0 2024-02-15T18:26:57.871 INFO:tasks.workunit.client.0.smithi084.stdout:3/77: truncate d8/f11 1234665 0 2024-02-15T18:26:57.871 INFO:tasks.workunit.client.0.smithi084.stdout:5/50: creat d9/da/f11 x:0 0 0 2024-02-15T18:26:57.872 INFO:tasks.workunit.client.0.smithi084.stdout:6/77: symlink d14/d1a/l1b 0 2024-02-15T18:26:57.873 INFO:tasks.workunit.client.0.smithi084.stdout:9/39: rename d4/c7 to d4/c9 0 2024-02-15T18:26:57.873 INFO:tasks.workunit.client.0.smithi084.stdout:9/40: chown d4/f6 1547256766 1 2024-02-15T18:26:57.873 INFO:tasks.workunit.client.0.smithi084.stdout:9/41: write d4/f5 [1697432,70694] 0 2024-02-15T18:26:57.873 INFO:tasks.workunit.client.0.smithi084.stdout:9/42: chown d4/f6 116026769 1 2024-02-15T18:26:57.874 INFO:tasks.workunit.client.0.smithi084.stdout:4/30: write d2/d4/f5 [4998459,115471] 0 2024-02-15T18:26:57.876 INFO:tasks.workunit.client.0.smithi084.stdout:6/78: symlink d14/l1c 0 2024-02-15T18:26:57.877 INFO:tasks.workunit.client.0.smithi084.stdout:6/79: fdatasync fc 0 2024-02-15T18:26:57.879 INFO:tasks.workunit.client.0.smithi084.stdout:8/82: dwrite db/fe [4194304,4194304] 0 2024-02-15T18:26:57.880 INFO:tasks.workunit.client.0.smithi084.stdout:2/48: rename f0 to d3/fc 0 2024-02-15T18:26:57.880 INFO:tasks.workunit.client.0.smithi084.stdout:7/62: dwrite f0 [0,4194304] 0 2024-02-15T18:26:57.881 INFO:tasks.workunit.client.0.smithi084.stdout:8/83: mkdir db/dd/d1f 0 2024-02-15T18:26:57.881 INFO:tasks.workunit.client.0.smithi084.stdout:8/84: chown db/dd/f12 398612 1 2024-02-15T18:26:57.883 INFO:tasks.workunit.client.0.smithi084.stdout:4/31: mkdir d2/d4/d9 0 2024-02-15T18:26:57.883 INFO:tasks.workunit.client.0.smithi084.stdout:4/32: chown d2/d4/d9 15157 1 2024-02-15T18:26:57.886 INFO:tasks.workunit.client.0.smithi084.stdout:3/78: getdents d8 0 2024-02-15T18:26:57.887 INFO:tasks.workunit.client.0.smithi084.stdout:2/49: write f2 [1938506,2459] 0 2024-02-15T18:26:57.887 INFO:tasks.workunit.client.0.smithi084.stdout:3/79: write d8/fb [427327,1499] 0 2024-02-15T18:26:57.888 INFO:tasks.workunit.client.0.smithi084.stdout:0/48: truncate d0/fd 1694118 0 2024-02-15T18:26:57.888 INFO:tasks.workunit.client.0.smithi084.stdout:5/51: dwrite d9/da/f11 [0,4194304] 0 2024-02-15T18:26:57.890 INFO:tasks.workunit.client.0.smithi084.stdout:7/63: symlink df/l13 0 2024-02-15T18:26:57.890 INFO:tasks.workunit.client.0.smithi084.stdout:7/64: write fc [4545520,51150] 0 2024-02-15T18:26:57.891 INFO:tasks.workunit.client.0.smithi084.stdout:8/85: rename db/dd/f12 to db/f20 0 2024-02-15T18:26:57.893 INFO:tasks.workunit.client.0.smithi084.stdout:4/33: rmdir d2/d4/d9 0 2024-02-15T18:26:57.897 INFO:tasks.workunit.client.0.smithi084.stdout:2/50: symlink d3/d5/ld 0 2024-02-15T18:26:57.897 INFO:tasks.workunit.client.0.smithi084.stdout:3/80: symlink d8/l18 0 2024-02-15T18:26:57.897 INFO:tasks.workunit.client.0.smithi084.stdout:0/49: getdents d0 0 2024-02-15T18:26:57.899 INFO:tasks.workunit.client.0.smithi084.stdout:7/65: creat df/f14 x:0 0 0 2024-02-15T18:26:57.899 INFO:tasks.workunit.client.0.smithi084.stdout:7/66: dread - fb zero size 2024-02-15T18:26:57.900 INFO:tasks.workunit.client.0.smithi084.stdout:8/86: symlink db/dd/d1f/l21 0 2024-02-15T18:26:57.900 INFO:tasks.workunit.client.0.smithi084.stdout:4/34: mknod d2/ca 0 2024-02-15T18:26:57.902 INFO:tasks.workunit.client.0.smithi084.stdout:3/81: mknod d8/c19 0 2024-02-15T18:26:57.904 INFO:tasks.workunit.client.0.smithi084.stdout:8/87: dread db/d1c/f1e [0,4194304] 0 2024-02-15T18:26:57.904 INFO:tasks.workunit.client.0.smithi084.stdout:8/88: chown db/f16 9002 1 2024-02-15T18:26:57.904 INFO:tasks.workunit.client.0.smithi084.stdout:7/67: write fc [878544,79596] 0 2024-02-15T18:26:57.905 INFO:tasks.workunit.client.0.smithi084.stdout:7/68: write df/f14 [489844,382] 0 2024-02-15T18:26:57.911 INFO:tasks.workunit.client.0.smithi084.stdout:4/35: creat d2/d4/fb x:0 0 0 2024-02-15T18:26:57.912 INFO:tasks.workunit.client.0.smithi084.stdout:3/82: symlink d8/l1a 0 2024-02-15T18:26:57.912 INFO:tasks.workunit.client.0.smithi084.stdout:3/83: truncate d8/f12 1031584 0 2024-02-15T18:26:57.912 INFO:tasks.workunit.client.0.smithi084.stdout:8/89: truncate db/fc 176687 0 2024-02-15T18:26:57.913 INFO:tasks.workunit.client.0.smithi084.stdout:7/69: dread f5 [0,4194304] 0 2024-02-15T18:26:57.914 INFO:tasks.workunit.client.0.smithi084.stdout:3/84: creat d8/f1b x:0 0 0 2024-02-15T18:26:57.914 INFO:tasks.workunit.client.0.smithi084.stdout:8/90: truncate db/d1c/f1e 38997 0 2024-02-15T18:26:57.915 INFO:tasks.workunit.client.0.smithi084.stdout:3/85: creat d8/f1c x:0 0 0 2024-02-15T18:26:57.926 INFO:tasks.workunit.client.0.smithi084.stdout:7/70: rmdir df 39 2024-02-15T18:26:57.926 INFO:tasks.workunit.client.0.smithi084.stdout:7/71: write fa [259223,75872] 0 2024-02-15T18:26:57.928 INFO:tasks.workunit.client.0.smithi084.stdout:8/91: dread fa [0,4194304] 0 2024-02-15T18:26:57.929 INFO:tasks.workunit.client.0.smithi084.stdout:8/92: dread - db/dd/f14 zero size 2024-02-15T18:26:57.929 INFO:tasks.workunit.client.0.smithi084.stdout:8/93: write db/fc [549520,120248] 0 2024-02-15T18:26:57.929 INFO:tasks.workunit.client.0.smithi084.stdout:8/94: dread - db/d1a/f1d zero size 2024-02-15T18:26:57.930 INFO:tasks.workunit.client.0.smithi084.stdout:7/72: creat df/f15 x:0 0 0 2024-02-15T18:26:57.933 INFO:tasks.workunit.client.0.smithi084.stdout:0/50: dwrite d0/fd [0,4194304] 0 2024-02-15T18:26:57.933 INFO:tasks.workunit.client.0.smithi084.stdout:0/51: truncate d0/fd 4402980 0 2024-02-15T18:26:57.933 INFO:tasks.workunit.client.0.smithi084.stdout:5/52: dwrite d9/fe [0,4194304] 0 2024-02-15T18:26:57.940 INFO:tasks.workunit.client.0.smithi084.stdout:4/36: dwrite d2/d4/fb [0,4194304] 0 2024-02-15T18:26:57.940 INFO:tasks.workunit.client.0.smithi084.stdout:4/37: chown d2/f3 31497 1 2024-02-15T18:26:57.940 INFO:tasks.workunit.client.0.smithi084.stdout:4/38: readlink l0 0 2024-02-15T18:26:57.944 INFO:tasks.workunit.client.0.smithi084.stdout:4/39: truncate d2/d4/f5 1216609 0 2024-02-15T18:26:57.945 INFO:tasks.workunit.client.0.smithi084.stdout:4/40: rename d2/f6 to d2/fc 0 2024-02-15T18:26:57.970 INFO:tasks.workunit.client.0.smithi084.stdout:5/53: dwrite d9/da/f11 [4194304,4194304] 0 2024-02-15T18:26:57.970 INFO:tasks.workunit.client.0.smithi084.stdout:4/41: dwrite d2/fc [0,4194304] 0 2024-02-15T18:26:57.973 INFO:tasks.workunit.client.0.smithi084.stdout:4/42: creat d2/d4/fd x:0 0 0 2024-02-15T18:26:57.974 INFO:tasks.workunit.client.0.smithi084.stdout:4/43: creat d2/d4/fe x:0 0 0 2024-02-15T18:26:57.978 INFO:tasks.workunit.client.0.smithi084.stdout:4/44: rmdir d2 39 2024-02-15T18:26:57.987 INFO:tasks.workunit.client.0.smithi084.stdout:4/45: dread d2/fc [0,4194304] 0 2024-02-15T18:26:57.987 INFO:tasks.workunit.client.0.smithi084.stdout:4/46: chown d2/d4/fe 26401 1 2024-02-15T18:26:57.988 INFO:tasks.workunit.client.0.smithi084.stdout:2/51: dwrite d3/d5/fa [0,4194304] 0 2024-02-15T18:26:57.989 INFO:tasks.workunit.client.0.smithi084.stdout:9/43: dwrite d4/f5 [0,4194304] 0 2024-02-15T18:26:57.989 INFO:tasks.workunit.client.0.smithi084.stdout:2/52: readlink d3/d5/ld 0 2024-02-15T18:26:57.993 INFO:tasks.workunit.client.0.smithi084.stdout:9/44: mknod d4/ca 0 2024-02-15T18:26:57.997 INFO:tasks.workunit.client.0.smithi084.stdout:5/54: dread d9/da/f11 [0,4194304] 0 2024-02-15T18:26:58.000 INFO:tasks.workunit.client.0.smithi084.stdout:5/55: getdents d9 0 2024-02-15T18:26:58.000 INFO:tasks.workunit.client.0.smithi084.stdout:5/56: chown d9/da 685670 1 2024-02-15T18:26:58.000 INFO:tasks.workunit.client.0.smithi084.stdout:5/57: fsync d9/da/f11 0 2024-02-15T18:26:58.000 INFO:tasks.workunit.client.0.smithi084.stdout:5/58: readlink d9/da/lb 0 2024-02-15T18:26:58.000 INFO:tasks.workunit.client.0.smithi084.stdout:2/53: dread f1 [0,4194304] 0 2024-02-15T18:26:58.002 INFO:tasks.workunit.client.0.smithi084.stdout:5/59: creat d9/f12 x:0 0 0 2024-02-15T18:26:58.003 INFO:tasks.workunit.client.0.smithi084.stdout:2/54: creat d3/d5/fe x:0 0 0 2024-02-15T18:26:58.004 INFO:tasks.workunit.client.0.smithi084.stdout:5/60: mknod d9/da/c13 0 2024-02-15T18:26:58.004 INFO:tasks.workunit.client.0.smithi084.stdout:5/61: dread - d9/f12 zero size 2024-02-15T18:26:58.005 INFO:tasks.workunit.client.0.smithi084.stdout:5/62: rename d9/da to d9/da/d14 22 2024-02-15T18:26:58.005 INFO:tasks.workunit.client.0.smithi084.stdout:2/55: creat d3/ff x:0 0 0 2024-02-15T18:26:58.005 INFO:tasks.workunit.client.0.smithi084.stdout:2/56: chown f1 1001366522 1 2024-02-15T18:26:58.006 INFO:tasks.workunit.client.0.smithi084.stdout:5/63: creat d9/f15 x:0 0 0 2024-02-15T18:26:58.007 INFO:tasks.workunit.client.0.smithi084.stdout:5/64: chown d9/f12 1183 1 2024-02-15T18:26:58.007 INFO:tasks.workunit.client.0.smithi084.stdout:5/65: chown d9/f15 844 1 2024-02-15T18:26:58.008 INFO:tasks.workunit.client.0.smithi084.stdout:5/66: mknod d9/da/c16 0 2024-02-15T18:26:58.008 INFO:tasks.workunit.client.0.smithi084.stdout:5/67: truncate d9/f15 456942 0 2024-02-15T18:26:58.008 INFO:tasks.workunit.client.0.smithi084.stdout:5/68: readlink l6 0 2024-02-15T18:26:58.009 INFO:tasks.workunit.client.0.smithi084.stdout:5/69: chown d9/da/lb 145715 1 2024-02-15T18:26:58.009 INFO:tasks.workunit.client.0.smithi084.stdout:9/45: dread d4/f5 [0,4194304] 0 2024-02-15T18:26:58.010 INFO:tasks.workunit.client.0.smithi084.stdout:5/70: rename d9/da/cf to d9/c17 0 2024-02-15T18:26:58.010 INFO:tasks.workunit.client.0.smithi084.stdout:2/57: link d3/c9 d3/c10 0 2024-02-15T18:26:58.011 INFO:tasks.workunit.client.0.smithi084.stdout:0/52: dwrite d0/fd [0,4194304] 0 2024-02-15T18:26:58.011 INFO:tasks.workunit.client.0.smithi084.stdout:2/58: creat d3/f11 x:0 0 0 2024-02-15T18:26:58.012 INFO:tasks.workunit.client.0.smithi084.stdout:9/46: write d4/f6 [33933,85536] 0 2024-02-15T18:26:58.013 INFO:tasks.workunit.client.0.smithi084.stdout:8/95: dwrite db/d1c/f1e [0,4194304] 0 2024-02-15T18:26:58.013 INFO:tasks.workunit.client.0.smithi084.stdout:8/96: write db/fe [9121000,123613] 0 2024-02-15T18:26:58.013 INFO:tasks.workunit.client.0.smithi084.stdout:2/59: mknod d3/c12 0 2024-02-15T18:26:58.014 INFO:tasks.workunit.client.0.smithi084.stdout:9/47: creat d4/fb x:0 0 0 2024-02-15T18:26:58.014 INFO:tasks.workunit.client.0.smithi084.stdout:9/48: truncate d4/fb 28292 0 2024-02-15T18:26:58.015 INFO:tasks.workunit.client.0.smithi084.stdout:5/71: write d9/fe [3627077,87703] 0 2024-02-15T18:26:58.018 INFO:tasks.workunit.client.0.smithi084.stdout:4/47: dwrite d2/d4/f5 [0,4194304] 0 2024-02-15T18:26:58.020 INFO:tasks.workunit.client.0.smithi084.stdout:0/53: truncate d0/fd 1719802 0 2024-02-15T18:26:58.020 INFO:tasks.workunit.client.0.smithi084.stdout:0/54: getdents d0 0 2024-02-15T18:26:58.020 INFO:tasks.workunit.client.0.smithi084.stdout:0/55: readlink d0/l9 0 2024-02-15T18:26:58.021 INFO:tasks.workunit.client.0.smithi084.stdout:2/60: creat d3/f13 x:0 0 0 2024-02-15T18:26:58.021 INFO:tasks.workunit.client.0.smithi084.stdout:2/61: readlink d3/d5/l6 0 2024-02-15T18:26:58.022 INFO:tasks.workunit.client.0.smithi084.stdout:0/56: getdents d0/d4 0 2024-02-15T18:26:58.026 INFO:tasks.workunit.client.0.smithi084.stdout:0/57: creat d0/fe x:0 0 0 2024-02-15T18:26:58.029 INFO:tasks.workunit.client.0.smithi084.stdout:0/58: mknod d0/cf 0 2024-02-15T18:26:58.029 INFO:tasks.workunit.client.0.smithi084.stdout:0/59: fsync d0/fd 0 2024-02-15T18:26:58.029 INFO:tasks.workunit.client.0.smithi084.stdout:0/60: write d0/fd [2546365,14927] 0 2024-02-15T18:26:58.032 INFO:tasks.workunit.client.0.smithi084.stdout:0/61: creat d0/f10 x:0 0 0 2024-02-15T18:26:58.032 INFO:tasks.workunit.client.0.smithi084.stdout:0/62: chown d0/d4 7 1 2024-02-15T18:26:58.058 INFO:tasks.workunit.client.0.smithi084.stdout:8/97: dwrite db/dd/f14 [0,4194304] 0 2024-02-15T18:26:58.058 INFO:tasks.workunit.client.0.smithi084.stdout:8/98: write db/f11 [601223,21059] 0 2024-02-15T18:26:58.059 INFO:tasks.workunit.client.0.smithi084.stdout:2/62: dwrite f2 [0,4194304] 0 2024-02-15T18:26:58.059 INFO:tasks.workunit.client.0.smithi084.stdout:4/48: dwrite d2/f3 [0,4194304] 0 2024-02-15T18:26:58.059 INFO:tasks.workunit.client.0.smithi084.stdout:4/49: fsync d2/d4/f5 0 2024-02-15T18:26:58.059 INFO:tasks.workunit.client.0.smithi084.stdout:4/50: stat d2/d4/f5 0 2024-02-15T18:26:58.059 INFO:tasks.workunit.client.0.smithi084.stdout:5/72: dwrite d9/da/f11 [4194304,4194304] 0 2024-02-15T18:26:58.059 INFO:tasks.workunit.client.0.smithi084.stdout:0/63: dwrite d0/f10 [0,4194304] 0 2024-02-15T18:26:58.060 INFO:tasks.workunit.client.0.smithi084.stdout:8/99: truncate db/dd/f10 4349095 0 2024-02-15T18:26:58.060 INFO:tasks.workunit.client.0.smithi084.stdout:5/73: dread d9/f15 [0,4194304] 0 2024-02-15T18:26:58.063 INFO:tasks.workunit.client.0.smithi084.stdout:8/100: creat db/d1a/f22 x:0 0 0 2024-02-15T18:26:58.068 INFO:tasks.workunit.client.0.smithi084.stdout:4/51: symlink d2/d4/lf 0 2024-02-15T18:26:58.068 INFO:tasks.workunit.client.0.smithi084.stdout:4/52: write d2/fc [4952936,106632] 0 2024-02-15T18:26:58.068 INFO:tasks.workunit.client.0.smithi084.stdout:4/53: readlink l0 0 2024-02-15T18:26:58.071 INFO:tasks.workunit.client.0.smithi084.stdout:0/64: dread d0/fd [0,4194304] 0 2024-02-15T18:26:58.072 INFO:tasks.workunit.client.0.smithi084.stdout:4/54: mknod d2/d4/c10 0 2024-02-15T18:26:58.073 INFO:tasks.workunit.client.0.smithi084.stdout:0/65: unlink d0/fe 0 2024-02-15T18:26:58.075 INFO:tasks.workunit.client.0.smithi084.stdout:2/63: truncate d3/fc 3092935 0 2024-02-15T18:26:58.075 INFO:tasks.workunit.client.0.smithi084.stdout:2/64: dread - d3/f13 zero size 2024-02-15T18:26:58.076 INFO:tasks.workunit.client.0.smithi084.stdout:0/66: dread d0/fd [0,4194304] 0 2024-02-15T18:26:58.076 INFO:tasks.workunit.client.0.smithi084.stdout:0/67: fdatasync d0/fd 0 2024-02-15T18:26:58.076 INFO:tasks.workunit.client.0.smithi084.stdout:0/68: fdatasync d0/fd 0 2024-02-15T18:26:58.077 INFO:tasks.workunit.client.0.smithi084.stdout:4/55: rmdir d2/d4 39 2024-02-15T18:26:58.078 INFO:tasks.workunit.client.0.smithi084.stdout:0/69: unlink d0/fd 0 2024-02-15T18:26:58.083 INFO:tasks.workunit.client.0.smithi084.stdout:0/70: write d0/f10 [2846578,82202] 0 2024-02-15T18:26:58.083 INFO:tasks.workunit.client.0.smithi084.stdout:5/74: dwrite d9/f10 [0,4194304] 0 2024-02-15T18:26:58.084 INFO:tasks.workunit.client.0.smithi084.stdout:8/101: dwrite db/f16 [0,4194304] 0 2024-02-15T18:26:58.084 INFO:tasks.workunit.client.0.smithi084.stdout:8/102: readlink l7 0 2024-02-15T18:26:58.087 INFO:tasks.workunit.client.0.smithi084.stdout:5/75: stat d9/c17 0 2024-02-15T18:26:58.087 INFO:tasks.workunit.client.0.smithi084.stdout:5/76: write f8 [3229449,124152] 0 2024-02-15T18:26:58.087 INFO:tasks.workunit.client.0.smithi084.stdout:0/71: fsync d0/f10 0 2024-02-15T18:26:58.088 INFO:tasks.workunit.client.0.smithi084.stdout:5/77: dread d9/f15 [0,4194304] 0 2024-02-15T18:26:58.089 INFO:tasks.workunit.client.0.smithi084.stdout:5/78: stat d9/da/c13 0 2024-02-15T18:26:58.089 INFO:tasks.workunit.client.0.smithi084.stdout:4/56: dread d2/fc [0,4194304] 0 2024-02-15T18:26:58.090 INFO:tasks.workunit.client.0.smithi084.stdout:0/72: symlink d0/d4/l11 0 2024-02-15T18:26:58.090 INFO:tasks.workunit.client.0.smithi084.stdout:0/73: fsync d0/f10 0 2024-02-15T18:26:58.090 INFO:tasks.workunit.client.0.smithi084.stdout:0/74: stat d0/cf 0 2024-02-15T18:26:58.090 INFO:tasks.workunit.client.0.smithi084.stdout:0/75: fdatasync d0/f10 0 2024-02-15T18:26:58.090 INFO:tasks.workunit.client.0.smithi084.stdout:4/57: rmdir d2/d4 39 2024-02-15T18:26:58.093 INFO:tasks.workunit.client.0.smithi084.stdout:0/76: write d0/f10 [1717006,18570] 0 2024-02-15T18:26:58.093 INFO:tasks.workunit.client.0.smithi084.stdout:0/77: chown d0/c7 178 1 2024-02-15T18:26:58.094 INFO:tasks.workunit.client.0.smithi084.stdout:0/78: write d0/f10 [988815,4428] 0 2024-02-15T18:26:58.096 INFO:tasks.workunit.client.0.smithi084.stdout:2/65: dwrite d3/d5/fe [0,4194304] 0 2024-02-15T18:26:58.099 INFO:tasks.workunit.client.0.smithi084.stdout:4/58: truncate d2/fc 2433494 0 2024-02-15T18:26:58.099 INFO:tasks.workunit.client.0.smithi084.stdout:4/59: fsync d2/d4/f8 0 2024-02-15T18:26:58.099 INFO:tasks.workunit.client.0.smithi084.stdout:4/60: dread - d2/d4/fe zero size 2024-02-15T18:26:58.104 INFO:tasks.workunit.client.0.smithi084.stdout:5/79: dwrite d9/f10 [0,4194304] 0 2024-02-15T18:26:58.105 INFO:tasks.workunit.client.0.smithi084.stdout:4/61: creat d2/f11 x:0 0 0 2024-02-15T18:26:58.105 INFO:tasks.workunit.client.0.smithi084.stdout:4/62: readlink l0 0 2024-02-15T18:26:58.106 INFO:tasks.workunit.client.0.smithi084.stdout:8/103: write db/dd/f10 [3279797,54949] 0 2024-02-15T18:26:58.106 INFO:tasks.workunit.client.0.smithi084.stdout:2/66: rename d3/d5/fa to d3/f14 0 2024-02-15T18:26:58.106 INFO:tasks.workunit.client.0.smithi084.stdout:5/80: creat d9/da/f18 x:0 0 0 2024-02-15T18:26:58.107 INFO:tasks.workunit.client.0.smithi084.stdout:0/79: truncate d0/f10 3626006 0 2024-02-15T18:26:58.109 INFO:tasks.workunit.client.0.smithi084.stdout:4/63: truncate d2/d4/f8 1793831 0 2024-02-15T18:26:58.110 INFO:tasks.workunit.client.0.smithi084.stdout:8/104: getdents db/dd 0 2024-02-15T18:26:58.110 INFO:tasks.workunit.client.0.smithi084.stdout:0/80: fdatasync d0/f10 0 2024-02-15T18:26:58.110 INFO:tasks.workunit.client.0.smithi084.stdout:8/105: read db/fc [442469,108776] 0 2024-02-15T18:26:58.111 INFO:tasks.workunit.client.0.smithi084.stdout:8/106: truncate db/d1c/f1e 5074118 0 2024-02-15T18:26:58.112 INFO:tasks.workunit.client.0.smithi084.stdout:2/67: truncate d3/fc 2185352 0 2024-02-15T18:26:58.116 INFO:tasks.workunit.client.0.smithi084.stdout:5/81: rename l6 to d9/l19 0 2024-02-15T18:26:58.119 INFO:tasks.workunit.client.0.smithi084.stdout:0/81: getdents d0 0 2024-02-15T18:26:58.122 INFO:tasks.workunit.client.0.smithi084.stdout:5/82: creat d9/da/f1a x:0 0 0 2024-02-15T18:26:58.123 INFO:tasks.workunit.client.0.smithi084.stdout:2/68: mknod d3/c15 0 2024-02-15T18:26:58.124 INFO:tasks.workunit.client.0.smithi084.stdout:4/64: read d2/d4/f8 [260639,118832] 0 2024-02-15T18:26:58.126 INFO:tasks.workunit.client.0.smithi084.stdout:2/69: creat d3/d5/f16 x:0 0 0 2024-02-15T18:26:58.126 INFO:tasks.workunit.client.0.smithi084.stdout:5/83: creat d9/da/f1b x:0 0 0 2024-02-15T18:26:58.126 INFO:tasks.workunit.client.0.smithi084.stdout:5/84: chown d9/c17 1595 1 2024-02-15T18:26:58.128 INFO:tasks.workunit.client.0.smithi084.stdout:4/65: unlink d2/d4/f5 0 2024-02-15T18:26:58.128 INFO:tasks.workunit.client.0.smithi084.stdout:2/70: link d3/f11 d3/d5/f17 0 2024-02-15T18:26:58.129 INFO:tasks.workunit.client.0.smithi084.stdout:2/71: stat d3/d5/f16 0 2024-02-15T18:26:58.129 INFO:tasks.workunit.client.0.smithi084.stdout:2/72: fsync d3/f13 0 2024-02-15T18:26:58.130 INFO:tasks.workunit.client.0.smithi084.stdout:2/73: creat d3/d5/f18 x:0 0 0 2024-02-15T18:26:58.130 INFO:tasks.workunit.client.0.smithi084.stdout:4/66: mknod d2/d4/c12 0 2024-02-15T18:26:58.131 INFO:tasks.workunit.client.0.smithi084.stdout:4/67: truncate d2/d4/fd 758375 0 2024-02-15T18:26:58.131 INFO:tasks.workunit.client.0.smithi084.stdout:4/68: fdatasync d2/d4/fb 0 2024-02-15T18:26:58.132 INFO:tasks.workunit.client.0.smithi084.stdout:2/74: mkdir d3/d19 0 2024-02-15T18:26:58.133 INFO:tasks.workunit.client.0.smithi084.stdout:2/75: mkdir d3/d5/d1a 0 2024-02-15T18:26:58.133 INFO:tasks.workunit.client.0.smithi084.stdout:2/76: chown f1 1070 1 2024-02-15T18:26:58.139 INFO:tasks.workunit.client.0.smithi084.stdout:8/107: dwrite db/dd/f10 [4194304,4194304] 0 2024-02-15T18:26:58.139 INFO:tasks.workunit.client.0.smithi084.stdout:8/108: chown db/d1c 57886 1 2024-02-15T18:26:58.139 INFO:tasks.workunit.client.0.smithi084.stdout:8/109: truncate db/d1a/f22 177063 0 2024-02-15T18:26:58.139 INFO:tasks.workunit.client.0.smithi084.stdout:8/110: truncate db/d1a/f22 186605 0 2024-02-15T18:26:58.144 INFO:tasks.workunit.client.0.smithi084.stdout:0/82: dwrite d0/f10 [0,4194304] 0 2024-02-15T18:26:58.144 INFO:tasks.workunit.client.0.smithi084.stdout:0/83: stat d0/d4 0 2024-02-15T18:26:58.145 INFO:tasks.workunit.client.0.smithi084.stdout:4/69: dread d2/f3 [0,4194304] 0 2024-02-15T18:26:58.145 INFO:tasks.workunit.client.0.smithi084.stdout:4/70: write d2/d4/fe [197101,128301] 0 2024-02-15T18:26:58.145 INFO:tasks.workunit.client.0.smithi084.stdout:4/71: fsync d2/f11 0 2024-02-15T18:26:58.146 INFO:tasks.workunit.client.0.smithi084.stdout:4/72: truncate d2/fc 1705988 0 2024-02-15T18:26:58.146 INFO:tasks.workunit.client.0.smithi084.stdout:4/73: chown d2/f3 3228 1 2024-02-15T18:26:58.146 INFO:tasks.workunit.client.0.smithi084.stdout:5/85: dwrite d9/f12 [0,4194304] 0 2024-02-15T18:26:58.146 INFO:tasks.workunit.client.0.smithi084.stdout:5/86: fdatasync d9/da/f1b 0 2024-02-15T18:26:58.147 INFO:tasks.workunit.client.0.smithi084.stdout:4/74: write d2/d4/f7 [166522,11747] 0 2024-02-15T18:26:58.150 INFO:tasks.workunit.client.0.smithi084.stdout:4/75: rename d2/d4/lf to d2/d4/l13 0 2024-02-15T18:26:58.150 INFO:tasks.workunit.client.0.smithi084.stdout:4/76: chown d2/d4/fe 14593 1 2024-02-15T18:26:58.153 INFO:tasks.workunit.client.0.smithi084.stdout:8/111: dread db/dd/f14 [0,4194304] 0 2024-02-15T18:26:58.154 INFO:tasks.workunit.client.0.smithi084.stdout:4/77: getdents d2 0 2024-02-15T18:26:58.156 INFO:tasks.workunit.client.0.smithi084.stdout:5/87: dread f8 [0,4194304] 0 2024-02-15T18:26:58.156 INFO:tasks.workunit.client.0.smithi084.stdout:5/88: truncate d9/da/f11 9037257 0 2024-02-15T18:26:58.157 INFO:tasks.workunit.client.0.smithi084.stdout:0/84: dread d0/f10 [0,4194304] 0 2024-02-15T18:26:58.158 INFO:tasks.workunit.client.0.smithi084.stdout:0/85: chown d0/ca 770949 1 2024-02-15T18:26:58.158 INFO:tasks.workunit.client.0.smithi084.stdout:0/86: chown d0/ca 955496 1 2024-02-15T18:26:58.158 INFO:tasks.workunit.client.0.smithi084.stdout:0/87: fsync d0/f10 0 2024-02-15T18:26:58.158 INFO:tasks.workunit.client.0.smithi084.stdout:5/89: unlink d9/da/c13 0 2024-02-15T18:26:58.158 INFO:tasks.workunit.client.0.smithi084.stdout:5/90: chown d9/l19 7820056 1 2024-02-15T18:26:58.160 INFO:tasks.workunit.client.0.smithi084.stdout:5/91: creat d9/f1c x:0 0 0 2024-02-15T18:26:58.161 INFO:tasks.workunit.client.0.smithi084.stdout:4/78: dread d2/d4/f7 [0,4194304] 0 2024-02-15T18:26:58.161 INFO:tasks.workunit.client.0.smithi084.stdout:4/79: write d2/d4/fe [792382,53601] 0 2024-02-15T18:26:58.161 INFO:tasks.workunit.client.0.smithi084.stdout:4/80: chown l0 8345736 1 2024-02-15T18:26:58.161 INFO:tasks.workunit.client.0.smithi084.stdout:4/81: fdatasync d2/d4/f8 0 2024-02-15T18:26:58.162 INFO:tasks.workunit.client.0.smithi084.stdout:0/88: dread d0/f10 [0,4194304] 0 2024-02-15T18:26:58.163 INFO:tasks.workunit.client.0.smithi084.stdout:0/89: write d0/f10 [2426930,97970] 0 2024-02-15T18:26:58.165 INFO:tasks.workunit.client.0.smithi084.stdout:4/82: truncate d2/f3 3905021 0 2024-02-15T18:26:58.165 INFO:tasks.workunit.client.0.smithi084.stdout:4/83: chown d2/d4/f7 269604 1 2024-02-15T18:26:58.165 INFO:tasks.workunit.client.0.smithi084.stdout:5/92: rmdir d9 39 2024-02-15T18:26:58.172 INFO:tasks.workunit.client.0.smithi084.stdout:4/84: dread d2/d4/fb [0,4194304] 0 2024-02-15T18:26:58.173 INFO:tasks.workunit.client.0.smithi084.stdout:5/93: creat d9/f1d x:0 0 0 2024-02-15T18:26:58.173 INFO:tasks.workunit.client.0.smithi084.stdout:5/94: write d9/da/f1a [956375,115856] 0 2024-02-15T18:26:58.173 INFO:tasks.workunit.client.0.smithi084.stdout:5/95: chown d9/da/f1b 6 1 2024-02-15T18:26:58.173 INFO:tasks.workunit.client.0.smithi084.stdout:5/96: dread - d9/da/f18 zero size 2024-02-15T18:26:58.173 INFO:tasks.workunit.client.0.smithi084.stdout:0/90: truncate d0/f10 1389435 0 2024-02-15T18:26:58.174 INFO:tasks.workunit.client.0.smithi084.stdout:5/97: creat d9/f1e x:0 0 0 2024-02-15T18:26:58.174 INFO:tasks.workunit.client.0.smithi084.stdout:5/98: stat d9/f15 0 2024-02-15T18:26:58.174 INFO:tasks.workunit.client.0.smithi084.stdout:0/91: mknod d0/db/c12 0 2024-02-15T18:26:58.176 INFO:tasks.workunit.client.0.smithi084.stdout:4/85: symlink d2/d4/l14 0 2024-02-15T18:26:58.177 INFO:tasks.workunit.client.0.smithi084.stdout:8/112: dwrite db/d1a/f1d [0,4194304] 0 2024-02-15T18:26:58.178 INFO:tasks.workunit.client.0.smithi084.stdout:4/86: creat d2/f15 x:0 0 0 2024-02-15T18:26:58.178 INFO:tasks.workunit.client.0.smithi084.stdout:4/87: write d2/f15 [770855,127950] 0 2024-02-15T18:26:58.178 INFO:tasks.workunit.client.0.smithi084.stdout:4/88: chown d2/d4/c10 2708417 1 2024-02-15T18:26:58.180 INFO:tasks.workunit.client.0.smithi084.stdout:4/89: read d2/d4/f8 [304921,117665] 0 2024-02-15T18:26:58.189 INFO:tasks.workunit.client.0.smithi084.stdout:5/99: dwrite f8 [4194304,4194304] 0 2024-02-15T18:26:58.200 INFO:tasks.workunit.client.0.smithi084.stdout:4/90: dwrite d2/fc [0,4194304] 0 2024-02-15T18:26:58.200 INFO:tasks.workunit.client.0.smithi084.stdout:4/91: mknod d2/c16 0 2024-02-15T18:26:58.200 INFO:tasks.workunit.client.0.smithi084.stdout:4/92: write d2/f11 [325956,117748] 0 2024-02-15T18:26:58.201 INFO:tasks.workunit.client.0.smithi084.stdout:4/93: creat d2/f17 x:0 0 0 2024-02-15T18:26:58.202 INFO:tasks.workunit.client.0.smithi084.stdout:4/94: mkdir d2/d18 0 2024-02-15T18:26:58.202 INFO:tasks.workunit.client.0.smithi084.stdout:4/95: chown d2/f15 340 1 2024-02-15T18:26:58.207 INFO:tasks.workunit.client.0.smithi084.stdout:4/96: dread d2/f11 [0,4194304] 0 2024-02-15T18:26:58.207 INFO:tasks.workunit.client.0.smithi084.stdout:4/97: truncate d2/d4/f8 891782 0 2024-02-15T18:26:58.211 INFO:tasks.workunit.client.0.smithi084.stdout:4/98: rmdir d2 39 2024-02-15T18:26:58.213 INFO:tasks.workunit.client.0.smithi084.stdout:4/99: dread d2/d4/f7 [0,4194304] 0 2024-02-15T18:26:58.214 INFO:tasks.workunit.client.0.smithi084.stdout:4/100: creat d2/d4/f19 x:0 0 0 2024-02-15T18:26:58.214 INFO:tasks.workunit.client.0.smithi084.stdout:4/101: truncate d2/d4/f7 670579 0 2024-02-15T18:26:58.239 INFO:tasks.workunit.client.0.smithi084.stdout:1/57: sync 2024-02-15T18:26:58.240 INFO:tasks.workunit.client.0.smithi084.stdout:6/80: sync 2024-02-15T18:26:58.240 INFO:tasks.workunit.client.0.smithi084.stdout:6/81: fsync f9 0 2024-02-15T18:26:58.240 INFO:tasks.workunit.client.0.smithi084.stdout:1/58: write d9/dd/f13 [879738,82227] 0 2024-02-15T18:26:58.246 INFO:tasks.workunit.client.0.smithi084.stdout:1/59: dread f3 [0,4194304] 0 2024-02-15T18:26:58.246 INFO:tasks.workunit.client.0.smithi084.stdout:1/60: chown l6 69 1 2024-02-15T18:26:58.266 INFO:tasks.workunit.client.0.smithi084.stdout:1/61: dwrite d9/fb [0,4194304] 0 2024-02-15T18:26:58.286 INFO:tasks.workunit.client.0.smithi084.stdout:1/62: dwrite d9/fb [4194304,4194304] 0 2024-02-15T18:26:58.289 INFO:tasks.workunit.client.0.smithi084.stdout:1/63: rename d9/fb to d9/f14 0 2024-02-15T18:26:58.290 INFO:tasks.workunit.client.0.smithi084.stdout:1/64: creat d9/f15 x:0 0 0 2024-02-15T18:26:58.307 INFO:tasks.workunit.client.0.smithi084.stdout:1/65: dwrite f3 [4194304,4194304] 0 2024-02-15T18:26:58.307 INFO:tasks.workunit.client.0.smithi084.stdout:1/66: chown l6 1385636 1 2024-02-15T18:26:58.307 INFO:tasks.workunit.client.0.smithi084.stdout:1/67: chown d9/lc 1 1 2024-02-15T18:26:58.308 INFO:tasks.workunit.client.0.smithi084.stdout:1/68: unlink f3 0 2024-02-15T18:26:58.309 INFO:tasks.workunit.client.0.smithi084.stdout:1/69: rmdir d9/dd 39 2024-02-15T18:26:58.309 INFO:tasks.workunit.client.0.smithi084.stdout:1/70: stat d9/lc 0 2024-02-15T18:26:58.311 INFO:tasks.workunit.client.0.smithi084.stdout:1/71: mkdir d9/dd/d12/d16 0 2024-02-15T18:26:58.311 INFO:tasks.workunit.client.0.smithi084.stdout:1/72: readlink d9/dd/l11 0 2024-02-15T18:26:58.313 INFO:tasks.workunit.client.0.smithi084.stdout:1/73: dread d9/dd/f13 [0,4194304] 0 2024-02-15T18:26:58.313 INFO:tasks.workunit.client.0.smithi084.stdout:1/74: write d9/dd/f13 [1685314,62612] 0 2024-02-15T18:26:58.313 INFO:tasks.workunit.client.0.smithi084.stdout:1/75: write d9/dd/f13 [2789870,15896] 0 2024-02-15T18:26:58.313 INFO:tasks.workunit.client.0.smithi084.stdout:1/76: write d9/f15 [741188,15152] 0 2024-02-15T18:26:58.315 INFO:tasks.workunit.client.0.smithi084.stdout:1/77: fdatasync d9/dd/f13 0 2024-02-15T18:26:58.316 INFO:tasks.workunit.client.0.smithi084.stdout:1/78: mkdir d9/dd/d12/d16/d17 0 2024-02-15T18:26:58.320 INFO:tasks.workunit.client.0.smithi084.stdout:1/79: truncate d9/f15 152064 0 2024-02-15T18:26:58.339 INFO:tasks.workunit.client.0.smithi084.stdout:1/80: dwrite d9/f15 [0,4194304] 0 2024-02-15T18:26:58.341 INFO:tasks.workunit.client.0.smithi084.stdout:1/81: mknod d9/dd/d12/c18 0 2024-02-15T18:26:58.345 INFO:tasks.workunit.client.0.smithi084.stdout:1/82: truncate d9/f14 1954822 0 2024-02-15T18:26:58.345 INFO:tasks.workunit.client.0.smithi084.stdout:1/83: read d9/dd/f13 [750164,114527] 0 2024-02-15T18:26:58.346 INFO:tasks.workunit.client.0.smithi084.stdout:1/84: write d9/f15 [873938,105674] 0 2024-02-15T18:26:58.355 INFO:tasks.workunit.client.0.smithi084.stdout:1/85: rename l6 to d9/dd/l19 0 2024-02-15T18:26:58.372 INFO:tasks.workunit.client.0.smithi084.stdout:1/86: dwrite d9/dd/f13 [0,4194304] 0 2024-02-15T18:26:58.374 INFO:tasks.workunit.client.0.smithi084.stdout:1/87: write d9/f14 [136392,56053] 0 2024-02-15T18:26:58.375 INFO:tasks.workunit.client.0.smithi084.stdout:1/88: rename d9/dd/d12/d16/d17 to d9/dd/d12/d16/d1a 0 2024-02-15T18:26:58.376 INFO:tasks.workunit.client.0.smithi084.stdout:1/89: mkdir d9/dd/d12/d1b 0 2024-02-15T18:26:58.399 INFO:tasks.workunit.client.0.smithi084.stdout:1/90: dwrite d9/f14 [0,4194304] 0 2024-02-15T18:26:58.465 INFO:tasks.workunit.client.0.smithi084.stdout:1/91: rmdir d9/dd/d12/d16/d1a 0 2024-02-15T18:26:58.468 INFO:tasks.workunit.client.0.smithi084.stdout:1/92: truncate d9/f15 2088710 0 2024-02-15T18:26:58.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:26:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:56.683581+0000 mgr.smithi084.hjmnez (mgr.14596) 14 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 22 MiB/s wr, 752 op/s 2024-02-15T18:26:58.546 INFO:tasks.workunit.client.0.smithi084.stdout:1/93: mknod d9/dd/d12/d1b/c1c 0 2024-02-15T18:26:58.548 INFO:tasks.workunit.client.0.smithi084.stdout:1/94: creat d9/dd/d12/d1b/f1d x:0 0 0 2024-02-15T18:26:58.549 INFO:tasks.workunit.client.0.smithi084.stdout:9/49: sync 2024-02-15T18:26:58.549 INFO:tasks.workunit.client.0.smithi084.stdout:3/86: sync 2024-02-15T18:26:58.549 INFO:tasks.workunit.client.0.smithi084.stdout:7/73: sync 2024-02-15T18:26:58.550 INFO:tasks.workunit.client.0.smithi084.stdout:3/87: creat d8/f1d x:0 0 0 2024-02-15T18:26:58.551 INFO:tasks.workunit.client.0.smithi084.stdout:3/88: link c6 d8/c1e 0 2024-02-15T18:26:58.553 INFO:tasks.workunit.client.0.smithi084.stdout:3/89: mkdir d8/d1f 0 2024-02-15T18:26:58.553 INFO:tasks.workunit.client.0.smithi084.stdout:3/90: dread - d8/f1d zero size 2024-02-15T18:26:58.553 INFO:tasks.workunit.client.0.smithi084.stdout:7/74: dread df/f14 [0,4194304] 0 2024-02-15T18:26:58.553 INFO:tasks.workunit.client.0.smithi084.stdout:3/91: write d8/f15 [748597,53623] 0 2024-02-15T18:26:58.554 INFO:tasks.workunit.client.0.smithi084.stdout:7/75: mkdir df/d16 0 2024-02-15T18:26:58.555 INFO:tasks.workunit.client.0.smithi084.stdout:2/77: sync 2024-02-15T18:26:58.555 INFO:tasks.workunit.client.0.smithi084.stdout:4/102: sync 2024-02-15T18:26:58.555 INFO:tasks.workunit.client.0.smithi084.stdout:8/113: sync 2024-02-15T18:26:58.556 INFO:tasks.workunit.client.0.smithi084.stdout:0/92: sync 2024-02-15T18:26:58.556 INFO:tasks.workunit.client.0.smithi084.stdout:6/82: sync 2024-02-15T18:26:58.556 INFO:tasks.workunit.client.0.smithi084.stdout:6/83: truncate f10 903305 0 2024-02-15T18:26:58.556 INFO:tasks.workunit.client.0.smithi084.stdout:5/100: sync 2024-02-15T18:26:58.556 INFO:tasks.workunit.client.0.smithi084.stdout:5/101: stat d9/da 0 2024-02-15T18:26:58.557 INFO:tasks.workunit.client.0.smithi084.stdout:9/50: dread d4/f6 [0,4194304] 0 2024-02-15T18:26:58.558 INFO:tasks.workunit.client.0.smithi084.stdout:2/78: creat d3/f1b x:0 0 0 2024-02-15T18:26:58.559 INFO:tasks.workunit.client.0.smithi084.stdout:4/103: mknod d2/c1a 0 2024-02-15T18:26:58.560 INFO:tasks.workunit.client.0.smithi084.stdout:0/93: creat d0/d4/f13 x:0 0 0 2024-02-15T18:26:58.561 INFO:tasks.workunit.client.0.smithi084.stdout:8/114: creat db/dd/d1f/f23 x:0 0 0 2024-02-15T18:26:58.561 INFO:tasks.workunit.client.0.smithi084.stdout:8/115: truncate db/dd/f10 8529390 0 2024-02-15T18:26:58.561 INFO:tasks.workunit.client.0.smithi084.stdout:8/116: stat l0 0 2024-02-15T18:26:58.562 INFO:tasks.workunit.client.0.smithi084.stdout:5/102: symlink d9/l1f 0 2024-02-15T18:26:58.563 INFO:tasks.workunit.client.0.smithi084.stdout:9/51: rename d4/c9 to d4/cc 0 2024-02-15T18:26:58.563 INFO:tasks.workunit.client.0.smithi084.stdout:9/52: rename d4 to d4/dd 22 2024-02-15T18:26:58.563 INFO:tasks.workunit.client.0.smithi084.stdout:9/53: write d4/f6 [727116,106094] 0 2024-02-15T18:26:58.564 INFO:tasks.workunit.client.0.smithi084.stdout:9/54: read d4/fb [22364,3602] 0 2024-02-15T18:26:58.564 INFO:tasks.workunit.client.0.smithi084.stdout:2/79: getdents d3/d5 0 2024-02-15T18:26:58.566 INFO:tasks.workunit.client.0.smithi084.stdout:0/94: rename d0/db/c12 to d0/db/c14 0 2024-02-15T18:26:58.567 INFO:tasks.workunit.client.0.smithi084.stdout:0/95: fsync d0/f10 0 2024-02-15T18:26:58.567 INFO:tasks.workunit.client.0.smithi084.stdout:8/117: getdents db/dd/d13 0 2024-02-15T18:26:58.568 INFO:tasks.workunit.client.0.smithi084.stdout:8/118: write db/d1c/f1e [1224690,47546] 0 2024-02-15T18:26:58.569 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:26:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:56.683581+0000 mgr.smithi084.hjmnez (mgr.14596) 14 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 22 MiB/s wr, 752 op/s 2024-02-15T18:26:58.569 INFO:tasks.workunit.client.0.smithi084.stdout:5/103: creat d9/da/f20 x:0 0 0 2024-02-15T18:26:58.570 INFO:tasks.workunit.client.0.smithi084.stdout:2/80: symlink d3/d19/l1c 0 2024-02-15T18:26:58.571 INFO:tasks.workunit.client.0.smithi084.stdout:4/104: symlink d2/d4/l1b 0 2024-02-15T18:26:58.572 INFO:tasks.workunit.client.0.smithi084.stdout:0/96: link d0/d4/f13 d0/f15 0 2024-02-15T18:26:58.573 INFO:tasks.workunit.client.0.smithi084.stdout:0/97: chown d0/f15 67493165 1 2024-02-15T18:26:58.573 INFO:tasks.workunit.client.0.smithi084.stdout:8/119: symlink db/dd/l24 0 2024-02-15T18:26:58.573 INFO:tasks.workunit.client.0.smithi084.stdout:1/95: dwrite d9/f14 [0,4194304] 0 2024-02-15T18:26:58.574 INFO:tasks.workunit.client.0.smithi084.stdout:5/104: mknod d9/c21 0 2024-02-15T18:26:58.574 INFO:tasks.workunit.client.0.smithi084.stdout:4/105: creat d2/d4/f1c x:0 0 0 2024-02-15T18:26:58.575 INFO:tasks.workunit.client.0.smithi084.stdout:4/106: fsync d2/d4/f8 0 2024-02-15T18:26:58.578 INFO:tasks.workunit.client.0.smithi084.stdout:9/55: dread f1 [4194304,4194304] 0 2024-02-15T18:26:58.578 INFO:tasks.workunit.client.0.smithi084.stdout:9/56: readlink d4/l8 0 2024-02-15T18:26:58.580 INFO:tasks.workunit.client.0.smithi084.stdout:0/98: getdents d0/d4 0 2024-02-15T18:26:58.580 INFO:tasks.workunit.client.0.smithi084.stdout:8/120: truncate db/fe 7475971 0 2024-02-15T18:26:58.580 INFO:tasks.workunit.client.0.smithi084.stdout:8/121: stat fa 0 2024-02-15T18:26:58.580 INFO:tasks.workunit.client.0.smithi084.stdout:8/122: truncate db/dd/d1f/f23 1000489 0 2024-02-15T18:26:58.582 INFO:tasks.workunit.client.0.smithi084.stdout:1/96: mknod d9/dd/d12/c1e 0 2024-02-15T18:26:58.584 INFO:tasks.workunit.client.0.smithi084.stdout:5/105: rename d9/da/f11 to d9/da/f22 0 2024-02-15T18:26:58.585 INFO:tasks.workunit.client.0.smithi084.stdout:4/107: unlink d2/ca 0 2024-02-15T18:26:58.585 INFO:tasks.workunit.client.0.smithi084.stdout:5/106: write f8 [1417247,104321] 0 2024-02-15T18:26:58.586 INFO:tasks.workunit.client.0.smithi084.stdout:9/57: dread f1 [4194304,4194304] 0 2024-02-15T18:26:58.586 INFO:tasks.workunit.client.0.smithi084.stdout:1/97: link d9/le d9/dd/d12/d16/l1f 0 2024-02-15T18:26:58.588 INFO:tasks.workunit.client.0.smithi084.stdout:5/107: mkdir d9/d23 0 2024-02-15T18:26:58.588 INFO:tasks.workunit.client.0.smithi084.stdout:1/98: write d9/f14 [1206062,24250] 0 2024-02-15T18:26:58.589 INFO:tasks.workunit.client.0.smithi084.stdout:9/58: mkdir d4/de 0 2024-02-15T18:26:58.589 INFO:tasks.workunit.client.0.smithi084.stdout:9/59: chown d4/cc 156 1 2024-02-15T18:26:58.590 INFO:tasks.workunit.client.0.smithi084.stdout:4/108: mknod d2/d4/c1d 0 2024-02-15T18:26:58.593 INFO:tasks.workunit.client.0.smithi084.stdout:9/60: dread f1 [0,4194304] 0 2024-02-15T18:26:58.593 INFO:tasks.workunit.client.0.smithi084.stdout:6/84: dwrite d14/f16 [0,4194304] 0 2024-02-15T18:26:58.597 INFO:tasks.workunit.client.0.smithi084.stdout:2/81: dwrite d3/f14 [0,4194304] 0 2024-02-15T18:26:58.598 INFO:tasks.workunit.client.1.smithi133.stdout:0/5: sync 2024-02-15T18:26:58.598 INFO:tasks.workunit.client.1.smithi133.stdout:4/9: sync 2024-02-15T18:26:58.599 INFO:tasks.workunit.client.1.smithi133.stdout:0/6: rename l2 to l3 0 2024-02-15T18:26:58.600 INFO:tasks.workunit.client.0.smithi084.stdout:9/61: rename f0 to d4/de/ff 0 2024-02-15T18:26:58.601 INFO:tasks.workunit.client.1.smithi133.stdout:4/10: symlink d2/l3 0 2024-02-15T18:26:58.602 INFO:tasks.workunit.client.1.smithi133.stdout:0/7: creat f4 x:0 0 0 2024-02-15T18:26:58.603 INFO:tasks.workunit.client.1.smithi133.stdout:0/8: creat f5 x:0 0 0 2024-02-15T18:26:58.605 INFO:tasks.workunit.client.0.smithi084.stdout:6/85: getdents d14 0 2024-02-15T18:26:58.606 INFO:tasks.workunit.client.1.smithi133.stdout:0/9: creat f6 x:0 0 0 2024-02-15T18:26:58.606 INFO:tasks.workunit.client.1.smithi133.stdout:0/10: rmdir - no directory 2024-02-15T18:26:58.606 INFO:tasks.workunit.client.1.smithi133.stdout:0/11: chown f0 3 1 2024-02-15T18:26:58.606 INFO:tasks.workunit.client.1.smithi133.stdout:0/12: dread - f0 zero size 2024-02-15T18:26:58.606 INFO:tasks.workunit.client.0.smithi084.stdout:2/82: symlink d3/d19/l1d 0 2024-02-15T18:26:58.606 INFO:tasks.workunit.client.0.smithi084.stdout:2/83: dread - d3/d5/f17 zero size 2024-02-15T18:26:58.609 INFO:tasks.workunit.client.0.smithi084.stdout:2/84: mkdir d3/d5/d1a/d1e 0 2024-02-15T18:26:58.609 INFO:tasks.workunit.client.0.smithi084.stdout:2/85: write d3/fc [2664367,63715] 0 2024-02-15T18:26:58.613 INFO:tasks.workunit.client.0.smithi084.stdout:2/86: rename d3/d5/ld to d3/d5/d1a/d1e/l1f 0 2024-02-15T18:26:58.613 INFO:tasks.workunit.client.0.smithi084.stdout:2/87: write d3/d5/f17 [31072,87055] 0 2024-02-15T18:26:58.619 INFO:tasks.workunit.client.0.smithi084.stdout:2/88: rename d3/d5/fe to d3/d19/f20 0 2024-02-15T18:26:58.622 INFO:tasks.workunit.client.0.smithi084.stdout:4/109: dwrite d2/f3 [0,4194304] 0 2024-02-15T18:26:58.629 INFO:tasks.workunit.client.0.smithi084.stdout:1/99: dwrite d9/f14 [0,4194304] 0 2024-02-15T18:26:58.629 INFO:tasks.workunit.client.0.smithi084.stdout:1/100: rename d9 to d9/dd/d20 22 2024-02-15T18:26:58.629 INFO:tasks.workunit.client.0.smithi084.stdout:1/101: dread - d9/dd/d12/d1b/f1d zero size 2024-02-15T18:26:58.630 INFO:tasks.workunit.client.0.smithi084.stdout:1/102: symlink d9/dd/l21 0 2024-02-15T18:26:58.631 INFO:tasks.workunit.client.0.smithi084.stdout:1/103: rename d9/dd/l11 to d9/dd/d12/d1b/l22 0 2024-02-15T18:26:58.631 INFO:tasks.workunit.client.0.smithi084.stdout:1/104: write d9/f14 [4712800,28093] 0 2024-02-15T18:26:58.632 INFO:tasks.workunit.client.0.smithi084.stdout:1/105: creat d9/dd/d12/d16/f23 x:0 0 0 2024-02-15T18:26:58.633 INFO:tasks.workunit.client.0.smithi084.stdout:1/106: chown d9/f14 4279 1 2024-02-15T18:26:58.687 INFO:tasks.workunit.client.0.smithi084.stdout:1/107: read d9/dd/f13 [1233927,25553] 0 2024-02-15T18:26:58.687 INFO:tasks.workunit.client.0.smithi084.stdout:1/108: write d9/f15 [2117612,6951] 0 2024-02-15T18:26:58.687 INFO:tasks.workunit.client.0.smithi084.stdout:8/123: dwrite db/dd/d1f/f23 [0,4194304] 0 2024-02-15T18:26:58.688 INFO:tasks.workunit.client.0.smithi084.stdout:0/99: dwrite d0/f10 [0,4194304] 0 2024-02-15T18:26:58.688 INFO:tasks.workunit.client.0.smithi084.stdout:9/62: write d4/f6 [2123567,57585] 0 2024-02-15T18:26:58.688 INFO:tasks.workunit.client.0.smithi084.stdout:1/109: creat d9/dd/d12/d16/f24 x:0 0 0 2024-02-15T18:26:58.691 INFO:tasks.workunit.client.0.smithi084.stdout:8/124: creat db/f25 x:0 0 0 2024-02-15T18:26:58.692 INFO:tasks.workunit.client.0.smithi084.stdout:0/100: mknod d0/d4/c16 0 2024-02-15T18:26:58.692 INFO:tasks.workunit.client.0.smithi084.stdout:0/101: dread - d0/d4/f13 zero size 2024-02-15T18:26:58.694 INFO:tasks.workunit.client.0.smithi084.stdout:5/108: dwrite d9/f10 [4194304,4194304] 0 2024-02-15T18:26:58.696 INFO:tasks.workunit.client.0.smithi084.stdout:6/86: dwrite f9 [0,4194304] 0 2024-02-15T18:26:58.696 INFO:tasks.workunit.client.0.smithi084.stdout:6/87: readlink l11 0 2024-02-15T18:26:58.697 INFO:tasks.workunit.client.0.smithi084.stdout:6/88: dread f10 [0,4194304] 0 2024-02-15T18:26:58.700 INFO:tasks.workunit.client.0.smithi084.stdout:2/89: getdents d3/d19 0 2024-02-15T18:26:58.704 INFO:tasks.workunit.client.0.smithi084.stdout:1/110: dread d9/f15 [0,4194304] 0 2024-02-15T18:26:58.704 INFO:tasks.workunit.client.0.smithi084.stdout:1/111: chown d9/dd/d12/c18 16024 1 2024-02-15T18:26:58.704 INFO:tasks.workunit.client.0.smithi084.stdout:1/112: chown d9/dd/d12/d1b/f1d 12559 1 2024-02-15T18:26:58.704 INFO:tasks.workunit.client.0.smithi084.stdout:1/113: write d9/dd/d12/d16/f23 [80580,86164] 0 2024-02-15T18:26:58.711 INFO:tasks.workunit.client.0.smithi084.stdout:9/63: truncate d4/f5 213138 0 2024-02-15T18:26:58.712 INFO:tasks.workunit.client.0.smithi084.stdout:9/64: write d4/f6 [3996848,44738] 0 2024-02-15T18:26:58.713 INFO:tasks.workunit.client.0.smithi084.stdout:5/109: symlink d9/da/l24 0 2024-02-15T18:26:58.716 INFO:tasks.workunit.client.0.smithi084.stdout:6/89: symlink d14/d1a/l1d 0 2024-02-15T18:26:58.717 INFO:tasks.workunit.client.0.smithi084.stdout:1/114: creat d9/dd/d12/d1b/f25 x:0 0 0 2024-02-15T18:26:58.718 INFO:tasks.workunit.client.0.smithi084.stdout:9/65: symlink d4/de/l10 0 2024-02-15T18:26:58.718 INFO:tasks.workunit.client.0.smithi084.stdout:9/66: chown f1 1 1 2024-02-15T18:26:58.718 INFO:tasks.workunit.client.0.smithi084.stdout:8/125: dwrite db/d1a/f1d [0,4194304] 0 2024-02-15T18:26:58.720 INFO:tasks.workunit.client.0.smithi084.stdout:0/102: dwrite d0/f15 [0,4194304] 0 2024-02-15T18:26:58.720 INFO:tasks.workunit.client.0.smithi084.stdout:2/90: dwrite f2 [0,4194304] 0 2024-02-15T18:26:58.721 INFO:tasks.workunit.client.0.smithi084.stdout:8/126: write db/f16 [2613096,128426] 0 2024-02-15T18:26:58.721 INFO:tasks.workunit.client.0.smithi084.stdout:6/90: rename d14/d1a/l1d to d14/l1e 0 2024-02-15T18:26:58.721 INFO:tasks.workunit.client.0.smithi084.stdout:0/103: write d0/d4/f13 [3241518,16648] 0 2024-02-15T18:26:58.726 INFO:tasks.workunit.client.0.smithi084.stdout:1/115: unlink d9/dd/d12/c1e 0 2024-02-15T18:26:58.726 INFO:tasks.workunit.client.0.smithi084.stdout:9/67: stat d4/cc 0 2024-02-15T18:26:58.729 INFO:tasks.workunit.client.0.smithi084.stdout:5/110: rmdir d9 39 2024-02-15T18:26:58.735 INFO:tasks.workunit.client.0.smithi084.stdout:2/91: rmdir d3 39 2024-02-15T18:26:58.737 INFO:tasks.workunit.client.0.smithi084.stdout:8/127: rmdir db 39 2024-02-15T18:26:58.738 INFO:tasks.workunit.client.0.smithi084.stdout:5/111: dread d9/da/f22 [4194304,4194304] 0 2024-02-15T18:26:58.738 INFO:tasks.workunit.client.0.smithi084.stdout:0/104: dwrite d0/f15 [0,4194304] 0 2024-02-15T18:26:58.740 INFO:tasks.workunit.client.0.smithi084.stdout:6/91: link c6 d14/d1a/c1f 0 2024-02-15T18:26:58.740 INFO:tasks.workunit.client.0.smithi084.stdout:6/92: read fc [836813,59583] 0 2024-02-15T18:26:58.740 INFO:tasks.workunit.client.0.smithi084.stdout:1/116: getdents d9 0 2024-02-15T18:26:58.741 INFO:tasks.workunit.client.0.smithi084.stdout:6/93: dread fc [0,4194304] 0 2024-02-15T18:26:58.743 INFO:tasks.workunit.client.0.smithi084.stdout:9/68: creat d4/de/f11 x:0 0 0 2024-02-15T18:26:58.743 INFO:tasks.workunit.client.0.smithi084.stdout:4/110: sync 2024-02-15T18:26:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:7/76: sync 2024-02-15T18:26:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:3/92: sync 2024-02-15T18:26:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:7/77: chown f9 118037 1 2024-02-15T18:26:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:7/78: truncate fe 405703 0 2024-02-15T18:26:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:7/79: stat f9 0 2024-02-15T18:26:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:2/92: creat d3/d5/f21 x:0 0 0 2024-02-15T18:26:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:2/93: readlink d3/d19/l1d 0 2024-02-15T18:26:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:2/94: write d3/ff [382300,118197] 0 2024-02-15T18:26:58.744 INFO:tasks.workunit.client.0.smithi084.stdout:2/95: write d3/d5/f21 [740244,23826] 0 2024-02-15T18:26:58.745 INFO:tasks.workunit.client.0.smithi084.stdout:0/105: creat d0/db/f17 x:0 0 0 2024-02-15T18:26:58.745 INFO:tasks.workunit.client.0.smithi084.stdout:8/128: write db/f16 [1144422,85212] 0 2024-02-15T18:26:58.745 INFO:tasks.workunit.client.0.smithi084.stdout:1/117: mknod d9/dd/c26 0 2024-02-15T18:26:58.745 INFO:tasks.workunit.client.0.smithi084.stdout:1/118: readlink l1 0 2024-02-15T18:26:58.746 INFO:tasks.workunit.client.0.smithi084.stdout:1/119: write d9/dd/f13 [2893320,116137] 0 2024-02-15T18:26:58.746 INFO:tasks.workunit.client.0.smithi084.stdout:1/120: readlink d9/lf 0 2024-02-15T18:26:58.747 INFO:tasks.workunit.client.0.smithi084.stdout:9/69: link d4/de/f11 d4/de/f12 0 2024-02-15T18:26:58.747 INFO:tasks.workunit.client.0.smithi084.stdout:9/70: truncate d4/de/f12 938752 0 2024-02-15T18:26:58.747 INFO:tasks.workunit.client.0.smithi084.stdout:4/111: mknod d2/c1e 0 2024-02-15T18:26:58.747 INFO:tasks.workunit.client.0.smithi084.stdout:3/93: creat d8/d1f/f20 x:0 0 0 2024-02-15T18:26:58.748 INFO:tasks.workunit.client.0.smithi084.stdout:4/112: dread - d2/f17 zero size 2024-02-15T18:26:58.749 INFO:tasks.workunit.client.0.smithi084.stdout:5/112: dread f8 [4194304,4194304] 0 2024-02-15T18:26:58.749 INFO:tasks.workunit.client.0.smithi084.stdout:5/113: write d9/f1e [250097,31463] 0 2024-02-15T18:26:58.749 INFO:tasks.workunit.client.0.smithi084.stdout:6/94: dread f4 [0,4194304] 0 2024-02-15T18:26:58.749 INFO:tasks.workunit.client.0.smithi084.stdout:2/96: unlink d3/d5/l6 0 2024-02-15T18:26:58.749 INFO:tasks.workunit.client.0.smithi084.stdout:7/80: creat df/d16/f17 x:0 0 0 2024-02-15T18:26:58.749 INFO:tasks.workunit.client.0.smithi084.stdout:7/81: write fe [440362,55605] 0 2024-02-15T18:26:58.749 INFO:tasks.workunit.client.0.smithi084.stdout:7/82: stat df/d16/f17 0 2024-02-15T18:26:58.750 INFO:tasks.workunit.client.0.smithi084.stdout:0/106: mknod d0/d4/c18 0 2024-02-15T18:26:58.751 INFO:tasks.workunit.client.0.smithi084.stdout:8/129: mknod db/c26 0 2024-02-15T18:26:58.754 INFO:tasks.workunit.client.0.smithi084.stdout:9/71: creat d4/de/f13 x:0 0 0 2024-02-15T18:26:58.754 INFO:tasks.workunit.client.0.smithi084.stdout:4/113: creat d2/d18/f1f x:0 0 0 2024-02-15T18:26:58.755 INFO:tasks.workunit.client.0.smithi084.stdout:3/94: getdents d8 0 2024-02-15T18:26:58.755 INFO:tasks.workunit.client.0.smithi084.stdout:3/95: getdents d8 0 2024-02-15T18:26:58.755 INFO:tasks.workunit.client.0.smithi084.stdout:3/96: write d8/f1d [470200,66646] 0 2024-02-15T18:26:58.756 INFO:tasks.workunit.client.0.smithi084.stdout:5/114: dread d9/f1e [0,4194304] 0 2024-02-15T18:26:58.756 INFO:tasks.workunit.client.0.smithi084.stdout:5/115: fdatasync d9/da/f1a 0 2024-02-15T18:26:58.756 INFO:tasks.workunit.client.0.smithi084.stdout:5/116: write d9/da/f1b [990277,71782] 0 2024-02-15T18:26:58.757 INFO:tasks.workunit.client.0.smithi084.stdout:6/95: unlink l12 0 2024-02-15T18:26:58.757 INFO:tasks.workunit.client.0.smithi084.stdout:2/97: creat d3/d5/f22 x:0 0 0 2024-02-15T18:26:58.758 INFO:tasks.workunit.client.0.smithi084.stdout:7/83: creat df/d16/f18 x:0 0 0 2024-02-15T18:26:58.759 INFO:tasks.workunit.client.0.smithi084.stdout:8/130: symlink db/l27 0 2024-02-15T18:26:58.759 INFO:tasks.workunit.client.0.smithi084.stdout:8/131: write db/fc [1511675,100996] 0 2024-02-15T18:26:58.761 INFO:tasks.workunit.client.0.smithi084.stdout:4/114: creat d2/d4/f20 x:0 0 0 2024-02-15T18:26:58.761 INFO:tasks.workunit.client.0.smithi084.stdout:4/115: dread - d2/d4/f19 zero size 2024-02-15T18:26:58.761 INFO:tasks.workunit.client.0.smithi084.stdout:4/116: chown d2/d4/fb 13079 1 2024-02-15T18:26:58.763 INFO:tasks.workunit.client.0.smithi084.stdout:3/97: rmdir d8 39 2024-02-15T18:26:58.763 INFO:tasks.workunit.client.0.smithi084.stdout:3/98: readlink d8/l17 0 2024-02-15T18:26:58.767 INFO:tasks.workunit.client.0.smithi084.stdout:3/99: dread d8/f13 [0,4194304] 0 2024-02-15T18:26:58.770 INFO:tasks.workunit.client.0.smithi084.stdout:5/117: mknod d9/d23/c25 0 2024-02-15T18:26:58.770 INFO:tasks.workunit.client.0.smithi084.stdout:5/118: chown d9/f15 14481832 1 2024-02-15T18:26:58.770 INFO:tasks.workunit.client.0.smithi084.stdout:5/119: read d9/f15 [129750,87976] 0 2024-02-15T18:26:58.771 INFO:tasks.workunit.client.0.smithi084.stdout:5/120: fsync d9/f12 0 2024-02-15T18:26:58.771 INFO:tasks.workunit.client.0.smithi084.stdout:1/121: dwrite d9/f14 [4194304,4194304] 0 2024-02-15T18:26:58.772 INFO:tasks.workunit.client.0.smithi084.stdout:6/96: rename c8 to d14/d1a/c20 0 2024-02-15T18:26:58.773 INFO:tasks.workunit.client.0.smithi084.stdout:2/98: mknod d3/d5/d1a/c23 0 2024-02-15T18:26:58.773 INFO:tasks.workunit.client.0.smithi084.stdout:2/99: write d3/d5/f21 [1376040,2618] 0 2024-02-15T18:26:58.774 INFO:tasks.workunit.client.0.smithi084.stdout:2/100: fsync f1 0 2024-02-15T18:26:58.775 INFO:tasks.workunit.client.0.smithi084.stdout:8/132: unlink db/fc 0 2024-02-15T18:26:58.775 INFO:tasks.workunit.client.0.smithi084.stdout:4/117: creat d2/f21 x:0 0 0 2024-02-15T18:26:58.776 INFO:tasks.workunit.client.0.smithi084.stdout:3/100: rmdir d8 39 2024-02-15T18:26:58.777 INFO:tasks.workunit.client.0.smithi084.stdout:5/121: truncate d9/f10 2311947 0 2024-02-15T18:26:58.778 INFO:tasks.workunit.client.0.smithi084.stdout:2/101: write d3/f14 [4079869,73199] 0 2024-02-15T18:26:58.782 INFO:tasks.workunit.client.0.smithi084.stdout:1/122: unlink c7 0 2024-02-15T18:26:58.782 INFO:tasks.workunit.client.0.smithi084.stdout:1/123: chown d9/ca 2145 1 2024-02-15T18:26:58.782 INFO:tasks.workunit.client.0.smithi084.stdout:1/124: read d9/dd/d12/d16/f23 [81743,127800] 0 2024-02-15T18:26:58.783 INFO:tasks.workunit.client.0.smithi084.stdout:9/72: dwrite d4/de/ff [0,4194304] 0 2024-02-15T18:26:58.783 INFO:tasks.workunit.client.0.smithi084.stdout:7/84: dwrite df/f10 [0,4194304] 0 2024-02-15T18:26:58.783 INFO:tasks.workunit.client.0.smithi084.stdout:7/85: stat fb 0 2024-02-15T18:26:58.783 INFO:tasks.workunit.client.0.smithi084.stdout:7/86: chown f4 24225982 1 2024-02-15T18:26:58.783 INFO:tasks.workunit.client.0.smithi084.stdout:7/87: stat df/l12 0 2024-02-15T18:26:58.784 INFO:tasks.workunit.client.0.smithi084.stdout:6/97: symlink d14/l21 0 2024-02-15T18:26:58.784 INFO:tasks.workunit.client.0.smithi084.stdout:8/133: creat db/d1c/f28 x:0 0 0 2024-02-15T18:26:58.785 INFO:tasks.workunit.client.0.smithi084.stdout:3/101: rename d8/f13 to d8/f21 0 2024-02-15T18:26:58.785 INFO:tasks.workunit.client.0.smithi084.stdout:3/102: stat d8/f21 0 2024-02-15T18:26:58.791 INFO:tasks.workunit.client.0.smithi084.stdout:2/102: mkdir d3/d19/d24 0 2024-02-15T18:26:58.795 INFO:tasks.workunit.client.0.smithi084.stdout:5/122: dwrite f8 [0,4194304] 0 2024-02-15T18:26:58.795 INFO:tasks.workunit.client.0.smithi084.stdout:1/125: creat d9/f27 x:0 0 0 2024-02-15T18:26:58.797 INFO:tasks.workunit.client.0.smithi084.stdout:9/73: creat d4/de/f14 x:0 0 0 2024-02-15T18:26:58.800 INFO:tasks.workunit.client.0.smithi084.stdout:7/88: unlink f9 0 2024-02-15T18:26:58.801 INFO:tasks.workunit.client.0.smithi084.stdout:4/118: dwrite d2/d4/fd [0,4194304] 0 2024-02-15T18:26:58.801 INFO:tasks.workunit.client.0.smithi084.stdout:6/98: mkdir d14/d22 0 2024-02-15T18:26:58.801 INFO:tasks.workunit.client.0.smithi084.stdout:6/99: readlink d14/l15 0 2024-02-15T18:26:58.803 INFO:tasks.workunit.client.0.smithi084.stdout:6/100: write f13 [3241110,42298] 0 2024-02-15T18:26:58.804 INFO:tasks.workunit.client.0.smithi084.stdout:6/101: read f13 [3922986,82697] 0 2024-02-15T18:26:58.804 INFO:tasks.workunit.client.0.smithi084.stdout:6/102: stat d14/d22 0 2024-02-15T18:26:58.804 INFO:tasks.workunit.client.0.smithi084.stdout:6/103: chown d14/l18 37370 1 2024-02-15T18:26:58.804 INFO:tasks.workunit.client.0.smithi084.stdout:8/134: symlink db/dd/d1f/l29 0 2024-02-15T18:26:58.805 INFO:tasks.workunit.client.0.smithi084.stdout:8/135: write db/d1c/f28 [25179,53887] 0 2024-02-15T18:26:58.806 INFO:tasks.workunit.client.0.smithi084.stdout:3/103: mkdir d8/d22 0 2024-02-15T18:26:58.808 INFO:tasks.workunit.client.0.smithi084.stdout:2/103: creat d3/d19/f25 x:0 0 0 2024-02-15T18:26:58.808 INFO:tasks.workunit.client.0.smithi084.stdout:2/104: write d3/f13 [689645,86612] 0 2024-02-15T18:26:58.809 INFO:tasks.workunit.client.0.smithi084.stdout:5/123: creat d9/f26 x:0 0 0 2024-02-15T18:26:58.811 INFO:tasks.workunit.client.0.smithi084.stdout:1/126: rename d9/dd/d12/d16/l1f to d9/dd/d12/d16/l28 0 2024-02-15T18:26:58.811 INFO:tasks.workunit.client.0.smithi084.stdout:9/74: truncate f1 45327 0 2024-02-15T18:26:58.813 INFO:tasks.workunit.client.0.smithi084.stdout:7/89: rename df/l12 to df/d16/l19 0 2024-02-15T18:26:58.813 INFO:tasks.workunit.client.0.smithi084.stdout:7/90: fdatasync fa 0 2024-02-15T18:26:58.819 INFO:tasks.workunit.client.0.smithi084.stdout:4/119: symlink d2/d18/l22 0 2024-02-15T18:26:58.822 INFO:tasks.workunit.client.0.smithi084.stdout:6/104: unlink f4 0 2024-02-15T18:26:58.824 INFO:tasks.workunit.client.0.smithi084.stdout:5/124: truncate d9/da/f1a 19662 0 2024-02-15T18:26:58.824 INFO:tasks.workunit.client.0.smithi084.stdout:1/127: mknod d9/c29 0 2024-02-15T18:26:58.825 INFO:tasks.workunit.client.0.smithi084.stdout:1/128: dread - d9/dd/d12/d16/f24 zero size 2024-02-15T18:26:58.825 INFO:tasks.workunit.client.0.smithi084.stdout:9/75: mkdir d4/de/d15 0 2024-02-15T18:26:58.829 INFO:tasks.workunit.client.0.smithi084.stdout:8/136: rename db/dd/d13/c18 to db/dd/d1f/c2a 0 2024-02-15T18:26:58.829 INFO:tasks.workunit.client.0.smithi084.stdout:6/105: symlink d14/l23 0 2024-02-15T18:26:58.831 INFO:tasks.workunit.client.0.smithi084.stdout:1/129: link d9/lc d9/dd/d12/d16/l2a 0 2024-02-15T18:26:58.831 INFO:tasks.workunit.client.0.smithi084.stdout:1/130: fdatasync d9/f14 0 2024-02-15T18:26:58.831 INFO:tasks.workunit.client.0.smithi084.stdout:9/76: creat d4/de/d15/f16 x:0 0 0 2024-02-15T18:26:58.833 INFO:tasks.workunit.client.0.smithi084.stdout:3/104: dwrite d8/f12 [0,4194304] 0 2024-02-15T18:26:58.835 INFO:tasks.workunit.client.0.smithi084.stdout:6/106: getdents d14/d1a 0 2024-02-15T18:26:58.836 INFO:tasks.workunit.client.0.smithi084.stdout:6/107: dread fc [0,4194304] 0 2024-02-15T18:26:58.837 INFO:tasks.workunit.client.0.smithi084.stdout:1/131: rename d9/dd/c26 to d9/dd/d12/d1b/c2b 0 2024-02-15T18:26:58.838 INFO:tasks.workunit.client.0.smithi084.stdout:9/77: creat d4/de/d15/f17 x:0 0 0 2024-02-15T18:26:58.840 INFO:tasks.workunit.client.0.smithi084.stdout:3/105: mknod d8/d22/c23 0 2024-02-15T18:26:58.852 INFO:tasks.workunit.client.0.smithi084.stdout:7/91: dwrite f4 [0,4194304] 0 2024-02-15T18:26:58.852 INFO:tasks.workunit.client.0.smithi084.stdout:1/132: dread d9/f14 [4194304,4194304] 0 2024-02-15T18:26:58.852 INFO:tasks.workunit.client.0.smithi084.stdout:2/105: dwrite d3/ff [0,4194304] 0 2024-02-15T18:26:58.853 INFO:tasks.workunit.client.0.smithi084.stdout:5/125: dwrite d9/f1d [0,4194304] 0 2024-02-15T18:26:58.854 INFO:tasks.workunit.client.0.smithi084.stdout:2/106: write d3/f14 [2138912,58224] 0 2024-02-15T18:26:58.856 INFO:tasks.workunit.client.0.smithi084.stdout:2/107: dread d3/d5/f21 [0,4194304] 0 2024-02-15T18:26:58.856 INFO:tasks.workunit.client.0.smithi084.stdout:2/108: stat d3/d5/d1a 0 2024-02-15T18:26:58.861 INFO:tasks.workunit.client.0.smithi084.stdout:7/92: dread fc [0,4194304] 0 2024-02-15T18:26:58.862 INFO:tasks.workunit.client.0.smithi084.stdout:1/133: mkdir d9/dd/d12/d1b/d2c 0 2024-02-15T18:26:58.866 INFO:tasks.workunit.client.0.smithi084.stdout:5/126: mknod d9/da/c27 0 2024-02-15T18:26:58.866 INFO:tasks.workunit.client.0.smithi084.stdout:3/106: dwrite d8/fc [4194304,4194304] 0 2024-02-15T18:26:58.867 INFO:tasks.workunit.client.0.smithi084.stdout:5/127: creat d9/f28 x:0 0 0 2024-02-15T18:26:58.867 INFO:tasks.workunit.client.0.smithi084.stdout:1/134: write d9/dd/f13 [1445145,96604] 0 2024-02-15T18:26:58.869 INFO:tasks.workunit.client.0.smithi084.stdout:3/107: creat d8/d22/f24 x:0 0 0 2024-02-15T18:26:58.871 INFO:tasks.workunit.client.0.smithi084.stdout:5/128: creat d9/f29 x:0 0 0 2024-02-15T18:26:58.871 INFO:tasks.workunit.client.0.smithi084.stdout:5/129: truncate d9/f1c 676087 0 2024-02-15T18:26:58.872 INFO:tasks.workunit.client.0.smithi084.stdout:7/93: dread f5 [0,4194304] 0 2024-02-15T18:26:58.872 INFO:tasks.workunit.client.0.smithi084.stdout:7/94: write df/f15 [548620,85766] 0 2024-02-15T18:26:58.872 INFO:tasks.workunit.client.0.smithi084.stdout:7/95: chown fd 1377465 1 2024-02-15T18:26:58.874 INFO:tasks.workunit.client.0.smithi084.stdout:1/135: creat d9/dd/d12/d1b/d2c/f2d x:0 0 0 2024-02-15T18:26:58.875 INFO:tasks.workunit.client.0.smithi084.stdout:3/108: rmdir d8/d1f 39 2024-02-15T18:26:58.875 INFO:tasks.workunit.client.0.smithi084.stdout:3/109: readlink d8/la 0 2024-02-15T18:26:58.876 INFO:tasks.workunit.client.0.smithi084.stdout:5/130: creat d9/d23/f2a x:0 0 0 2024-02-15T18:26:58.876 INFO:tasks.workunit.client.0.smithi084.stdout:5/131: chown d9/fe 65092 1 2024-02-15T18:26:58.878 INFO:tasks.workunit.client.0.smithi084.stdout:0/107: sync 2024-02-15T18:26:58.878 INFO:tasks.workunit.client.0.smithi084.stdout:0/108: readlink d0/d4/l11 0 2024-02-15T18:26:58.879 INFO:tasks.workunit.client.0.smithi084.stdout:3/110: mkdir d8/d1f/d25 0 2024-02-15T18:26:58.879 INFO:tasks.workunit.client.0.smithi084.stdout:6/108: dwrite f13 [4194304,4194304] 0 2024-02-15T18:26:58.880 INFO:tasks.workunit.client.0.smithi084.stdout:2/109: dwrite f1 [0,4194304] 0 2024-02-15T18:26:58.880 INFO:tasks.workunit.client.0.smithi084.stdout:1/136: truncate d9/dd/f13 825549 0 2024-02-15T18:26:58.880 INFO:tasks.workunit.client.0.smithi084.stdout:1/137: chown d9/dd/d12/d16/l2a 215 1 2024-02-15T18:26:58.880 INFO:tasks.workunit.client.0.smithi084.stdout:0/109: getdents d0/d4 0 2024-02-15T18:26:58.882 INFO:tasks.workunit.client.0.smithi084.stdout:0/110: write d0/d4/f13 [2110026,17555] 0 2024-02-15T18:26:58.884 INFO:tasks.workunit.client.0.smithi084.stdout:3/111: unlink d8/f11 0 2024-02-15T18:26:58.884 INFO:tasks.workunit.client.0.smithi084.stdout:3/112: truncate d8/f21 941858 0 2024-02-15T18:26:58.884 INFO:tasks.workunit.client.0.smithi084.stdout:6/109: write fb [4879051,121470] 0 2024-02-15T18:26:58.884 INFO:tasks.workunit.client.0.smithi084.stdout:1/138: symlink d9/dd/d12/d16/l2e 0 2024-02-15T18:26:58.886 INFO:tasks.workunit.client.0.smithi084.stdout:0/111: symlink d0/l19 0 2024-02-15T18:26:58.886 INFO:tasks.workunit.client.0.smithi084.stdout:0/112: stat d0/d4/c16 0 2024-02-15T18:26:58.888 INFO:tasks.workunit.client.0.smithi084.stdout:3/113: creat d8/d22/f26 x:0 0 0 2024-02-15T18:26:58.888 INFO:tasks.workunit.client.0.smithi084.stdout:6/110: write fd [329581,96425] 0 2024-02-15T18:26:58.888 INFO:tasks.workunit.client.0.smithi084.stdout:3/114: write d8/f1c [534037,106939] 0 2024-02-15T18:26:58.889 INFO:tasks.workunit.client.0.smithi084.stdout:1/139: unlink d9/c29 0 2024-02-15T18:26:58.894 INFO:tasks.workunit.client.0.smithi084.stdout:0/113: dread d0/f10 [0,4194304] 0 2024-02-15T18:26:58.894 INFO:tasks.workunit.client.0.smithi084.stdout:3/115: symlink d8/d22/l27 0 2024-02-15T18:26:58.895 INFO:tasks.workunit.client.0.smithi084.stdout:0/114: creat d0/f1a x:0 0 0 2024-02-15T18:26:58.897 INFO:tasks.workunit.client.0.smithi084.stdout:0/115: mkdir d0/d4/d1b 0 2024-02-15T18:26:58.899 INFO:tasks.workunit.client.0.smithi084.stdout:2/110: dread d3/d19/f20 [0,4194304] 0 2024-02-15T18:26:58.900 INFO:tasks.workunit.client.0.smithi084.stdout:2/111: creat d3/d19/d24/f26 x:0 0 0 2024-02-15T18:26:58.900 INFO:tasks.workunit.client.0.smithi084.stdout:6/111: dread d14/f17 [0,4194304] 0 2024-02-15T18:26:58.903 INFO:tasks.workunit.client.0.smithi084.stdout:6/112: link d14/l21 d14/d1a/l24 0 2024-02-15T18:26:58.905 INFO:tasks.workunit.client.0.smithi084.stdout:7/96: dwrite df/d16/f18 [0,4194304] 0 2024-02-15T18:26:58.905 INFO:tasks.workunit.client.0.smithi084.stdout:6/113: mkdir d14/d22/d25 0 2024-02-15T18:26:58.908 INFO:tasks.workunit.client.0.smithi084.stdout:7/97: mkdir df/d16/d1a 0 2024-02-15T18:26:58.908 INFO:tasks.workunit.client.0.smithi084.stdout:2/112: dread d3/f11 [0,4194304] 0 2024-02-15T18:26:58.908 INFO:tasks.workunit.client.0.smithi084.stdout:6/114: write f13 [8477044,76149] 0 2024-02-15T18:26:58.911 INFO:tasks.workunit.client.0.smithi084.stdout:2/113: creat d3/d5/d1a/f27 x:0 0 0 2024-02-15T18:26:58.913 INFO:tasks.workunit.client.0.smithi084.stdout:5/132: dwrite d9/f29 [0,4194304] 0 2024-02-15T18:26:58.913 INFO:tasks.workunit.client.0.smithi084.stdout:5/133: fdatasync d9/f15 0 2024-02-15T18:26:58.919 INFO:tasks.workunit.client.0.smithi084.stdout:5/134: write f8 [212199,66448] 0 2024-02-15T18:26:58.922 INFO:tasks.workunit.client.0.smithi084.stdout:5/135: unlink d9/da/f1a 0 2024-02-15T18:26:58.922 INFO:tasks.workunit.client.0.smithi084.stdout:5/136: chown d9/f1c 3774971 1 2024-02-15T18:26:58.929 INFO:tasks.workunit.client.0.smithi084.stdout:1/140: dwrite d9/f15 [0,4194304] 0 2024-02-15T18:26:58.929 INFO:tasks.workunit.client.0.smithi084.stdout:1/141: chown d9/dd/d12/d1b/l22 17816990 1 2024-02-15T18:26:58.930 INFO:tasks.workunit.client.0.smithi084.stdout:5/137: dread d9/f10 [0,4194304] 0 2024-02-15T18:26:58.931 INFO:tasks.workunit.client.0.smithi084.stdout:1/142: creat d9/dd/f2f x:0 0 0 2024-02-15T18:26:58.934 INFO:tasks.workunit.client.0.smithi084.stdout:7/98: dread df/f15 [0,4194304] 0 2024-02-15T18:26:58.936 INFO:tasks.workunit.client.0.smithi084.stdout:0/116: dwrite d0/f15 [0,4194304] 0 2024-02-15T18:26:58.936 INFO:tasks.workunit.client.0.smithi084.stdout:3/116: dwrite d8/d1f/f20 [0,4194304] 0 2024-02-15T18:26:58.937 INFO:tasks.workunit.client.0.smithi084.stdout:2/114: dwrite d3/f1b [0,4194304] 0 2024-02-15T18:26:58.937 INFO:tasks.workunit.client.0.smithi084.stdout:3/117: read d8/f15 [302547,82058] 0 2024-02-15T18:26:58.939 INFO:tasks.workunit.client.0.smithi084.stdout:9/78: sync 2024-02-15T18:26:58.939 INFO:tasks.workunit.client.0.smithi084.stdout:4/120: sync 2024-02-15T18:26:58.940 INFO:tasks.workunit.client.0.smithi084.stdout:8/137: sync 2024-02-15T18:26:58.940 INFO:tasks.workunit.client.0.smithi084.stdout:9/79: dread - d4/de/d15/f16 zero size 2024-02-15T18:26:58.940 INFO:tasks.workunit.client.0.smithi084.stdout:4/121: dread - d2/f21 zero size 2024-02-15T18:26:58.942 INFO:tasks.workunit.client.0.smithi084.stdout:7/99: rename df/f10 to df/f1b 0 2024-02-15T18:26:58.943 INFO:tasks.workunit.client.0.smithi084.stdout:0/117: unlink d0/d4/l11 0 2024-02-15T18:26:58.946 INFO:tasks.workunit.client.0.smithi084.stdout:8/138: mkdir db/d1a/d2b 0 2024-02-15T18:26:58.948 INFO:tasks.workunit.client.0.smithi084.stdout:5/138: dwrite d9/f1c [0,4194304] 0 2024-02-15T18:26:58.949 INFO:tasks.workunit.client.0.smithi084.stdout:9/80: link d4/de/ff d4/de/d15/f18 0 2024-02-15T18:26:58.952 INFO:tasks.workunit.client.0.smithi084.stdout:7/100: rmdir df/d16 39 2024-02-15T18:26:58.956 INFO:tasks.workunit.client.0.smithi084.stdout:2/115: mkdir d3/d28 0 2024-02-15T18:26:58.956 INFO:tasks.workunit.client.0.smithi084.stdout:2/116: truncate d3/d5/f18 717896 0 2024-02-15T18:26:58.957 INFO:tasks.workunit.client.0.smithi084.stdout:4/122: link d2/d4/fb d2/d4/f23 0 2024-02-15T18:26:58.959 INFO:tasks.workunit.client.0.smithi084.stdout:9/81: creat d4/f19 x:0 0 0 2024-02-15T18:26:58.960 INFO:tasks.workunit.client.0.smithi084.stdout:7/101: rename fe to df/f1c 0 2024-02-15T18:26:58.961 INFO:tasks.workunit.client.0.smithi084.stdout:2/117: mknod d3/d5/d1a/c29 0 2024-02-15T18:26:58.961 INFO:tasks.workunit.client.0.smithi084.stdout:4/123: symlink d2/d18/l24 0 2024-02-15T18:26:58.962 INFO:tasks.workunit.client.0.smithi084.stdout:9/82: mkdir d4/de/d15/d1a 0 2024-02-15T18:26:58.963 INFO:tasks.workunit.client.0.smithi084.stdout:7/102: truncate f5 3229990 0 2024-02-15T18:26:58.963 INFO:tasks.workunit.client.0.smithi084.stdout:7/103: write f0 [4528118,3414] 0 2024-02-15T18:26:58.964 INFO:tasks.workunit.client.0.smithi084.stdout:4/124: truncate d2/f3 2785187 0 2024-02-15T18:26:58.964 INFO:tasks.workunit.client.0.smithi084.stdout:4/125: write d2/f11 [1000721,21693] 0 2024-02-15T18:26:58.967 INFO:tasks.workunit.client.0.smithi084.stdout:7/104: dread df/f1c [0,4194304] 0 2024-02-15T18:26:58.970 INFO:tasks.workunit.client.0.smithi084.stdout:7/105: rename df/d16 to df/d1d 0 2024-02-15T18:26:58.971 INFO:tasks.workunit.client.0.smithi084.stdout:4/126: dread d2/f11 [0,4194304] 0 2024-02-15T18:26:58.971 INFO:tasks.workunit.client.0.smithi084.stdout:9/83: fsync d4/f19 0 2024-02-15T18:26:58.972 INFO:tasks.workunit.client.0.smithi084.stdout:5/139: dread d9/f12 [0,4194304] 0 2024-02-15T18:26:58.972 INFO:tasks.workunit.client.0.smithi084.stdout:8/139: dwrite db/f11 [0,4194304] 0 2024-02-15T18:26:58.975 INFO:tasks.workunit.client.0.smithi084.stdout:9/84: symlink d4/de/l1b 0 2024-02-15T18:26:58.975 INFO:tasks.workunit.client.0.smithi084.stdout:9/85: write d4/f5 [91156,1140] 0 2024-02-15T18:26:58.978 INFO:tasks.workunit.client.0.smithi084.stdout:5/140: symlink d9/d23/l2b 0 2024-02-15T18:26:58.978 INFO:tasks.workunit.client.0.smithi084.stdout:2/118: dwrite d3/f1b [0,4194304] 0 2024-02-15T18:26:58.979 INFO:tasks.workunit.client.0.smithi084.stdout:8/140: creat db/d1c/f2c x:0 0 0 2024-02-15T18:26:58.980 INFO:tasks.workunit.client.0.smithi084.stdout:7/106: dread df/f1b [0,4194304] 0 2024-02-15T18:26:58.981 INFO:tasks.workunit.client.0.smithi084.stdout:4/127: mkdir d2/d4/d25 0 2024-02-15T18:26:58.981 INFO:tasks.workunit.client.0.smithi084.stdout:4/128: chown l0 162194376 1 2024-02-15T18:26:58.981 INFO:tasks.workunit.client.0.smithi084.stdout:4/129: stat d2/d18/f1f 0 2024-02-15T18:26:58.981 INFO:tasks.workunit.client.0.smithi084.stdout:7/107: dread df/f15 [0,4194304] 0 2024-02-15T18:26:58.982 INFO:tasks.workunit.client.0.smithi084.stdout:9/86: creat d4/de/f1c x:0 0 0 2024-02-15T18:26:58.982 INFO:tasks.workunit.client.0.smithi084.stdout:9/87: read - d4/de/f1c zero size 2024-02-15T18:26:58.983 INFO:tasks.workunit.client.0.smithi084.stdout:5/141: creat d9/f2c x:0 0 0 2024-02-15T18:26:58.983 INFO:tasks.workunit.client.0.smithi084.stdout:5/142: write d9/fe [2334861,2127] 0 2024-02-15T18:26:58.984 INFO:tasks.workunit.client.0.smithi084.stdout:2/119: truncate d3/f11 60500 0 2024-02-15T18:26:58.984 INFO:tasks.workunit.client.0.smithi084.stdout:2/120: chown d3/d5/f17 40286018 1 2024-02-15T18:26:58.986 INFO:tasks.workunit.client.0.smithi084.stdout:8/141: link db/dd/d1f/c2a db/d1a/d2b/c2d 0 2024-02-15T18:26:58.987 INFO:tasks.workunit.client.0.smithi084.stdout:4/130: mkdir d2/d26 0 2024-02-15T18:26:58.991 INFO:tasks.workunit.client.0.smithi084.stdout:9/88: rmdir d4/de/d15 39 2024-02-15T18:26:58.991 INFO:tasks.workunit.client.0.smithi084.stdout:9/89: fdatasync f1 0 2024-02-15T18:26:58.993 INFO:tasks.workunit.client.0.smithi084.stdout:5/143: rename d9/da/lb to d9/da/l2d 0 2024-02-15T18:26:58.997 INFO:tasks.workunit.client.0.smithi084.stdout:2/121: getdents d3/d19 0 2024-02-15T18:26:58.999 INFO:tasks.workunit.client.0.smithi084.stdout:8/142: link db/d1a/d2b/c2d db/d1c/c2e 0 2024-02-15T18:26:58.999 INFO:tasks.workunit.client.0.smithi084.stdout:8/143: write db/d1c/f28 [836467,108552] 0 2024-02-15T18:26:58.999 INFO:tasks.workunit.client.0.smithi084.stdout:8/144: dread db/d1a/f22 [0,4194304] 0 2024-02-15T18:26:59.000 INFO:tasks.workunit.client.0.smithi084.stdout:8/145: write db/d1c/f28 [652146,77944] 0 2024-02-15T18:26:59.001 INFO:tasks.workunit.client.0.smithi084.stdout:5/144: truncate d9/f1c 4025322 0 2024-02-15T18:26:59.001 INFO:tasks.workunit.client.0.smithi084.stdout:5/145: readlink d9/l1f 0 2024-02-15T18:26:59.003 INFO:tasks.workunit.client.0.smithi084.stdout:2/122: unlink d3/d5/f17 0 2024-02-15T18:26:59.003 INFO:tasks.workunit.client.0.smithi084.stdout:6/115: sync 2024-02-15T18:26:59.004 INFO:tasks.workunit.client.0.smithi084.stdout:8/146: rename db/d1a/d2b/c2d to db/c2f 0 2024-02-15T18:26:59.006 INFO:tasks.workunit.client.0.smithi084.stdout:5/146: symlink d9/d23/l2e 0 2024-02-15T18:26:59.009 INFO:tasks.workunit.client.0.smithi084.stdout:6/116: rename d14/l1e to d14/l26 0 2024-02-15T18:26:59.011 INFO:tasks.workunit.client.0.smithi084.stdout:8/147: rmdir db/d1c 39 2024-02-15T18:26:59.013 INFO:tasks.workunit.client.0.smithi084.stdout:5/147: getdents d9 0 2024-02-15T18:26:59.015 INFO:tasks.workunit.client.0.smithi084.stdout:1/143: sync 2024-02-15T18:26:59.016 INFO:tasks.workunit.client.0.smithi084.stdout:2/123: link d3/d5/f18 d3/f2a 0 2024-02-15T18:26:59.017 INFO:tasks.workunit.client.0.smithi084.stdout:6/117: rmdir d14/d22 39 2024-02-15T18:26:59.018 INFO:tasks.workunit.client.0.smithi084.stdout:8/148: rename l5 to db/dd/d13/l30 0 2024-02-15T18:26:59.019 INFO:tasks.workunit.client.0.smithi084.stdout:5/148: unlink d9/da/f22 0 2024-02-15T18:26:59.020 INFO:tasks.workunit.client.0.smithi084.stdout:2/124: symlink d3/d5/d1a/l2b 0 2024-02-15T18:26:59.020 INFO:tasks.workunit.client.0.smithi084.stdout:6/118: getdents d14 0 2024-02-15T18:26:59.021 INFO:tasks.workunit.client.0.smithi084.stdout:5/149: truncate d9/f1c 169353 0 2024-02-15T18:26:59.022 INFO:tasks.workunit.client.0.smithi084.stdout:6/119: creat d14/d1a/f27 x:0 0 0 2024-02-15T18:26:59.023 INFO:tasks.workunit.client.0.smithi084.stdout:2/125: dread d3/f11 [0,4194304] 0 2024-02-15T18:26:59.023 INFO:tasks.workunit.client.0.smithi084.stdout:2/126: readlink d3/d19/l1c 0 2024-02-15T18:26:59.023 INFO:tasks.workunit.client.0.smithi084.stdout:5/150: symlink d9/d23/l2f 0 2024-02-15T18:26:59.023 INFO:tasks.workunit.client.0.smithi084.stdout:5/151: stat d9/d23/l2e 0 2024-02-15T18:26:59.024 INFO:tasks.workunit.client.0.smithi084.stdout:6/120: mkdir d14/d22/d25/d28 0 2024-02-15T18:26:59.025 INFO:tasks.workunit.client.0.smithi084.stdout:5/152: read d9/fe [3974166,90799] 0 2024-02-15T18:26:59.025 INFO:tasks.workunit.client.0.smithi084.stdout:6/121: creat d14/d22/d25/d28/f29 x:0 0 0 2024-02-15T18:26:59.029 INFO:tasks.workunit.client.0.smithi084.stdout:2/127: dread f2 [0,4194304] 0 2024-02-15T18:26:59.030 INFO:tasks.workunit.client.0.smithi084.stdout:2/128: mknod d3/d19/c2c 0 2024-02-15T18:26:59.031 INFO:tasks.workunit.client.0.smithi084.stdout:2/129: mkdir d3/d5/d1a/d2d 0 2024-02-15T18:26:59.031 INFO:tasks.workunit.client.0.smithi084.stdout:5/153: write d9/f1c [49420,88758] 0 2024-02-15T18:26:59.033 INFO:tasks.workunit.client.0.smithi084.stdout:2/130: link d3/d19/f25 d3/d19/d24/f2e 0 2024-02-15T18:26:59.037 INFO:tasks.workunit.client.0.smithi084.stdout:5/154: creat d9/d23/f30 x:0 0 0 2024-02-15T18:26:59.056 INFO:tasks.workunit.client.0.smithi084.stdout:5/155: dwrite f8 [0,4194304] 0 2024-02-15T18:26:59.058 INFO:tasks.workunit.client.0.smithi084.stdout:5/156: rmdir d9/da 39 2024-02-15T18:26:59.059 INFO:tasks.workunit.client.0.smithi084.stdout:2/131: dwrite d3/d19/f20 [0,4194304] 0 2024-02-15T18:26:59.060 INFO:tasks.workunit.client.0.smithi084.stdout:2/132: truncate d3/d19/d24/f26 224002 0 2024-02-15T18:26:59.060 INFO:tasks.workunit.client.0.smithi084.stdout:2/133: dread - d3/d19/d24/f2e zero size 2024-02-15T18:26:59.060 INFO:tasks.workunit.client.0.smithi084.stdout:5/157: mknod d9/da/c31 0 2024-02-15T18:26:59.060 INFO:tasks.workunit.client.0.smithi084.stdout:2/134: creat d3/d19/d24/f2f x:0 0 0 2024-02-15T18:26:59.061 INFO:tasks.workunit.client.0.smithi084.stdout:2/135: chown d3/f14 3307369 1 2024-02-15T18:26:59.061 INFO:tasks.workunit.client.0.smithi084.stdout:2/136: chown d3/d19/d24/f2f 95126 1 2024-02-15T18:26:59.061 INFO:tasks.workunit.client.0.smithi084.stdout:5/158: symlink d9/l32 0 2024-02-15T18:26:59.062 INFO:tasks.workunit.client.0.smithi084.stdout:5/159: mkdir d9/d23/d33 0 2024-02-15T18:26:59.066 INFO:tasks.workunit.client.0.smithi084.stdout:5/160: getdents d9/d23 0 2024-02-15T18:26:59.067 INFO:tasks.workunit.client.0.smithi084.stdout:5/161: creat d9/d23/d33/f34 x:0 0 0 2024-02-15T18:26:59.068 INFO:tasks.workunit.client.0.smithi084.stdout:5/162: unlink d9/f1c 0 2024-02-15T18:26:59.069 INFO:tasks.workunit.client.0.smithi084.stdout:5/163: mkdir d9/d35 0 2024-02-15T18:26:59.069 INFO:tasks.workunit.client.0.smithi084.stdout:5/164: symlink d9/d23/d33/l36 0 2024-02-15T18:26:59.081 INFO:tasks.workunit.client.0.smithi084.stdout:5/165: dread d9/fe [0,4194304] 0 2024-02-15T18:26:59.081 INFO:tasks.workunit.client.0.smithi084.stdout:5/166: readlink d9/l19 0 2024-02-15T18:26:59.085 INFO:tasks.workunit.client.0.smithi084.stdout:2/137: dwrite f1 [0,4194304] 0 2024-02-15T18:26:59.087 INFO:tasks.workunit.client.0.smithi084.stdout:2/138: mkdir d3/d5/d1a/d1e/d30 0 2024-02-15T18:26:59.088 INFO:tasks.workunit.client.0.smithi084.stdout:2/139: read d3/d5/f21 [939572,50720] 0 2024-02-15T18:26:59.088 INFO:tasks.workunit.client.0.smithi084.stdout:2/140: write d3/d19/d24/f26 [431754,7098] 0 2024-02-15T18:26:59.088 INFO:tasks.workunit.client.0.smithi084.stdout:2/141: readlink d3/d5/d1a/d1e/l1f 0 2024-02-15T18:26:59.093 INFO:tasks.workunit.client.0.smithi084.stdout:5/167: dwrite d9/da/f18 [0,4194304] 0 2024-02-15T18:26:59.095 INFO:tasks.workunit.client.0.smithi084.stdout:3/118: sync 2024-02-15T18:26:59.095 INFO:tasks.workunit.client.0.smithi084.stdout:0/118: sync 2024-02-15T18:26:59.095 INFO:tasks.workunit.client.0.smithi084.stdout:0/119: dread - d0/f1a zero size 2024-02-15T18:26:59.096 INFO:tasks.workunit.client.0.smithi084.stdout:5/168: link d9/fe d9/d23/f37 0 2024-02-15T18:26:59.096 INFO:tasks.workunit.client.0.smithi084.stdout:5/169: write d9/f2c [610050,33612] 0 2024-02-15T18:26:59.097 INFO:tasks.workunit.client.0.smithi084.stdout:5/170: read d9/f12 [471988,29253] 0 2024-02-15T18:26:59.097 INFO:tasks.workunit.client.0.smithi084.stdout:3/119: mkdir d8/d1f/d28 0 2024-02-15T18:26:59.097 INFO:tasks.workunit.client.0.smithi084.stdout:3/120: fdatasync d8/f15 0 2024-02-15T18:26:59.097 INFO:tasks.workunit.client.0.smithi084.stdout:0/120: mknod d0/db/c1c 0 2024-02-15T18:26:59.099 INFO:tasks.workunit.client.0.smithi084.stdout:0/121: mkdir d0/d1d 0 2024-02-15T18:26:59.099 INFO:tasks.workunit.client.0.smithi084.stdout:0/122: fsync d0/f15 0 2024-02-15T18:26:59.099 INFO:tasks.workunit.client.0.smithi084.stdout:5/171: dread d9/da/f1b [0,4194304] 0 2024-02-15T18:26:59.100 INFO:tasks.workunit.client.0.smithi084.stdout:5/172: read f8 [5824625,89223] 0 2024-02-15T18:26:59.100 INFO:tasks.workunit.client.0.smithi084.stdout:5/173: stat d9/d23/f30 0 2024-02-15T18:26:59.101 INFO:tasks.workunit.client.0.smithi084.stdout:0/123: write d0/f15 [3952865,71226] 0 2024-02-15T18:26:59.101 INFO:tasks.workunit.client.0.smithi084.stdout:0/124: chown d0/l19 23 1 2024-02-15T18:26:59.102 INFO:tasks.workunit.client.0.smithi084.stdout:5/174: dread d9/f10 [0,4194304] 0 2024-02-15T18:26:59.102 INFO:tasks.workunit.client.0.smithi084.stdout:0/125: mkdir d0/d1e 0 2024-02-15T18:26:59.103 INFO:tasks.workunit.client.0.smithi084.stdout:5/175: creat d9/da/f38 x:0 0 0 2024-02-15T18:26:59.104 INFO:tasks.workunit.client.0.smithi084.stdout:5/176: symlink d9/d23/l39 0 2024-02-15T18:26:59.105 INFO:tasks.workunit.client.0.smithi084.stdout:5/177: mkdir d9/d3a 0 2024-02-15T18:26:59.106 INFO:tasks.workunit.client.0.smithi084.stdout:3/121: dread d8/f12 [0,4194304] 0 2024-02-15T18:26:59.106 INFO:tasks.workunit.client.0.smithi084.stdout:5/178: unlink d9/l19 0 2024-02-15T18:26:59.108 INFO:tasks.workunit.client.0.smithi084.stdout:5/179: rename d9/da/f20 to d9/f3b 0 2024-02-15T18:26:59.110 INFO:tasks.workunit.client.0.smithi084.stdout:5/180: creat d9/d23/d33/f3c x:0 0 0 2024-02-15T18:26:59.110 INFO:tasks.workunit.client.0.smithi084.stdout:5/181: truncate d9/f15 928200 0 2024-02-15T18:26:59.110 INFO:tasks.workunit.client.0.smithi084.stdout:5/182: read - d9/f26 zero size 2024-02-15T18:26:59.110 INFO:tasks.workunit.client.0.smithi084.stdout:5/183: mkdir d9/da/d3d 0 2024-02-15T18:26:59.111 INFO:tasks.workunit.client.0.smithi084.stdout:5/184: write d9/d23/d33/f3c [988547,92220] 0 2024-02-15T18:26:59.111 INFO:tasks.workunit.client.0.smithi084.stdout:2/142: dwrite f1 [0,4194304] 0 2024-02-15T18:26:59.112 INFO:tasks.workunit.client.0.smithi084.stdout:2/143: stat d3/c9 0 2024-02-15T18:26:59.115 INFO:tasks.workunit.client.0.smithi084.stdout:2/144: rename d3/d19/l1d to d3/d28/l31 0 2024-02-15T18:26:59.115 INFO:tasks.workunit.client.0.smithi084.stdout:2/145: chown d3/f13 1266 1 2024-02-15T18:26:59.116 INFO:tasks.workunit.client.0.smithi084.stdout:2/146: creat d3/d19/d24/f32 x:0 0 0 2024-02-15T18:26:59.119 INFO:tasks.workunit.client.0.smithi084.stdout:2/147: link d3/f14 d3/d19/f33 0 2024-02-15T18:26:59.119 INFO:tasks.workunit.client.0.smithi084.stdout:2/148: chown f2 10931030 1 2024-02-15T18:26:59.120 INFO:tasks.workunit.client.0.smithi084.stdout:0/126: dread d0/f15 [0,4194304] 0 2024-02-15T18:26:59.121 INFO:tasks.workunit.client.0.smithi084.stdout:0/127: mknod d0/db/c1f 0 2024-02-15T18:26:59.123 INFO:tasks.workunit.client.0.smithi084.stdout:0/128: mknod d0/db/c20 0 2024-02-15T18:26:59.123 INFO:tasks.workunit.client.0.smithi084.stdout:0/129: fdatasync d0/d4/f13 0 2024-02-15T18:26:59.124 INFO:tasks.workunit.client.0.smithi084.stdout:0/130: rename d0/db/c20 to d0/db/c21 0 2024-02-15T18:26:59.124 INFO:tasks.workunit.client.0.smithi084.stdout:0/131: dread - d0/db/f17 zero size 2024-02-15T18:26:59.125 INFO:tasks.workunit.client.0.smithi084.stdout:0/132: mknod d0/d4/c22 0 2024-02-15T18:26:59.130 INFO:tasks.workunit.client.0.smithi084.stdout:5/185: dwrite d9/d23/f2a [0,4194304] 0 2024-02-15T18:26:59.130 INFO:tasks.workunit.client.0.smithi084.stdout:3/122: dwrite d8/f15 [0,4194304] 0 2024-02-15T18:26:59.133 INFO:tasks.workunit.client.0.smithi084.stdout:3/123: dread d8/f21 [0,4194304] 0 2024-02-15T18:26:59.134 INFO:tasks.workunit.client.0.smithi084.stdout:5/186: write d9/d23/f37 [775993,94425] 0 2024-02-15T18:26:59.137 INFO:tasks.workunit.client.0.smithi084.stdout:2/149: getdents d3/d19/d24 0 2024-02-15T18:26:59.144 INFO:tasks.workunit.client.0.smithi084.stdout:3/124: rmdir d8 39 2024-02-15T18:26:59.144 INFO:tasks.workunit.client.0.smithi084.stdout:0/133: dwrite d0/f15 [0,4194304] 0 2024-02-15T18:26:59.145 INFO:tasks.workunit.client.0.smithi084.stdout:5/187: creat d9/d23/d33/f3e x:0 0 0 2024-02-15T18:26:59.146 INFO:tasks.workunit.client.0.smithi084.stdout:5/188: write d9/f12 [1875571,106412] 0 2024-02-15T18:26:59.146 INFO:tasks.workunit.client.0.smithi084.stdout:5/189: truncate d9/da/f38 21698 0 2024-02-15T18:26:59.146 INFO:tasks.workunit.client.0.smithi084.stdout:3/125: link d8/c1e d8/d1f/d28/c29 0 2024-02-15T18:26:59.148 INFO:tasks.workunit.client.0.smithi084.stdout:0/134: link d0/d4/c16 d0/d1e/c23 0 2024-02-15T18:26:59.151 INFO:tasks.workunit.client.0.smithi084.stdout:0/135: write d0/f10 [1893892,91806] 0 2024-02-15T18:26:59.152 INFO:tasks.workunit.client.0.smithi084.stdout:5/190: symlink d9/d23/d33/l3f 0 2024-02-15T18:26:59.152 INFO:tasks.workunit.client.0.smithi084.stdout:5/191: dread - d9/f26 zero size 2024-02-15T18:26:59.152 INFO:tasks.workunit.client.0.smithi084.stdout:5/192: stat d9/f3b 0 2024-02-15T18:26:59.152 INFO:tasks.workunit.client.0.smithi084.stdout:3/126: creat d8/d1f/d28/f2a x:0 0 0 2024-02-15T18:26:59.153 INFO:tasks.workunit.client.0.smithi084.stdout:2/150: dwrite f2 [0,4194304] 0 2024-02-15T18:26:59.153 INFO:tasks.workunit.client.0.smithi084.stdout:7/108: sync 2024-02-15T18:26:59.153 INFO:tasks.workunit.client.0.smithi084.stdout:4/131: sync 2024-02-15T18:26:59.153 INFO:tasks.workunit.client.0.smithi084.stdout:1/144: sync 2024-02-15T18:26:59.153 INFO:tasks.workunit.client.0.smithi084.stdout:9/90: sync 2024-02-15T18:26:59.154 INFO:tasks.workunit.client.0.smithi084.stdout:7/109: truncate df/d1d/f17 593302 0 2024-02-15T18:26:59.154 INFO:tasks.workunit.client.0.smithi084.stdout:7/110: chown f5 2819946 1 2024-02-15T18:26:59.154 INFO:tasks.workunit.client.0.smithi084.stdout:9/91: getdents d4/de/d15/d1a 0 2024-02-15T18:26:59.154 INFO:tasks.workunit.client.0.smithi084.stdout:6/122: sync 2024-02-15T18:26:59.154 INFO:tasks.workunit.client.0.smithi084.stdout:8/149: sync 2024-02-15T18:26:59.154 INFO:tasks.workunit.client.0.smithi084.stdout:8/150: chown db/c26 23467095 1 2024-02-15T18:26:59.157 INFO:tasks.workunit.client.0.smithi084.stdout:0/136: symlink d0/d1d/l24 0 2024-02-15T18:26:59.157 INFO:tasks.workunit.client.0.smithi084.stdout:0/137: chown d0/db/c21 10979908 1 2024-02-15T18:26:59.157 INFO:tasks.workunit.client.0.smithi084.stdout:8/151: write db/fe [5377178,37046] 0 2024-02-15T18:26:59.160 INFO:tasks.workunit.client.0.smithi084.stdout:5/193: mknod d9/d23/c40 0 2024-02-15T18:26:59.160 INFO:tasks.workunit.client.0.smithi084.stdout:2/151: mkdir d3/d19/d34 0 2024-02-15T18:26:59.161 INFO:tasks.workunit.client.0.smithi084.stdout:9/92: mkdir d4/d1d 0 2024-02-15T18:26:59.161 INFO:tasks.workunit.client.0.smithi084.stdout:6/123: creat d14/d22/d25/d28/f2a x:0 0 0 2024-02-15T18:26:59.161 INFO:tasks.workunit.client.0.smithi084.stdout:9/93: truncate d4/f19 494149 0 2024-02-15T18:26:59.162 INFO:tasks.workunit.client.0.smithi084.stdout:8/152: creat db/d1a/d2b/f31 x:0 0 0 2024-02-15T18:26:59.162 INFO:tasks.workunit.client.0.smithi084.stdout:6/124: write f13 [315705,92585] 0 2024-02-15T18:26:59.163 INFO:tasks.workunit.client.0.smithi084.stdout:5/194: mknod d9/c41 0 2024-02-15T18:26:59.163 INFO:tasks.workunit.client.0.smithi084.stdout:9/94: mknod d4/c1e 0 2024-02-15T18:26:59.165 INFO:tasks.workunit.client.0.smithi084.stdout:8/153: mknod db/dd/d13/c32 0 2024-02-15T18:26:59.166 INFO:tasks.workunit.client.0.smithi084.stdout:5/195: creat d9/d35/f42 x:0 0 0 2024-02-15T18:26:59.166 INFO:tasks.workunit.client.0.smithi084.stdout:5/196: fdatasync d9/da/f38 0 2024-02-15T18:26:59.168 INFO:tasks.workunit.client.0.smithi084.stdout:6/125: dread fb [4194304,4194304] 0 2024-02-15T18:26:59.168 INFO:tasks.workunit.client.0.smithi084.stdout:6/126: chown d14/l23 40355 1 2024-02-15T18:26:59.168 INFO:tasks.workunit.client.0.smithi084.stdout:8/154: rename db/c19 to db/dd/d1f/c33 0 2024-02-15T18:26:59.170 INFO:tasks.workunit.client.0.smithi084.stdout:0/138: dread d0/d4/f13 [0,4194304] 0 2024-02-15T18:26:59.177 INFO:tasks.workunit.client.0.smithi084.stdout:0/139: mkdir d0/d25 0 2024-02-15T18:26:59.182 INFO:tasks.workunit.client.0.smithi084.stdout:6/127: link fc d14/d22/d25/f2b 0 2024-02-15T18:26:59.182 INFO:tasks.workunit.client.0.smithi084.stdout:6/128: write fd [540388,68766] 0 2024-02-15T18:26:59.183 INFO:tasks.workunit.client.0.smithi084.stdout:6/129: dread d14/d22/d25/f2b [0,4194304] 0 2024-02-15T18:26:59.183 INFO:tasks.workunit.client.0.smithi084.stdout:6/130: chown d14/l23 97766 1 2024-02-15T18:26:59.185 INFO:tasks.workunit.client.0.smithi084.stdout:6/131: creat d14/d22/f2c x:0 0 0 2024-02-15T18:26:59.222 INFO:tasks.workunit.client.0.smithi084.stdout:7/111: dwrite df/f15 [0,4194304] 0 2024-02-15T18:26:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:7/112: chown c6 246763408 1 2024-02-15T18:26:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:7/113: write fd [546769,113732] 0 2024-02-15T18:26:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:7/114: chown c1 12590 1 2024-02-15T18:26:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:4/132: dwrite d2/f15 [0,4194304] 0 2024-02-15T18:26:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:3/127: dwrite d8/f12 [0,4194304] 0 2024-02-15T18:26:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:3/128: readlink d8/d22/l27 0 2024-02-15T18:26:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:8/155: dwrite db/dd/d1f/f23 [4194304,4194304] 0 2024-02-15T18:26:59.223 INFO:tasks.workunit.client.0.smithi084.stdout:8/156: chown db/fe 125221 1 2024-02-15T18:26:59.224 INFO:tasks.workunit.client.0.smithi084.stdout:2/152: dwrite d3/d19/f25 [0,4194304] 0 2024-02-15T18:26:59.224 INFO:tasks.workunit.client.0.smithi084.stdout:5/197: dwrite d9/f10 [0,4194304] 0 2024-02-15T18:26:59.226 INFO:tasks.workunit.client.0.smithi084.stdout:8/157: write db/dd/d1f/f23 [5126076,41358] 0 2024-02-15T18:26:59.226 INFO:tasks.workunit.client.0.smithi084.stdout:6/132: dwrite f3 [0,4194304] 0 2024-02-15T18:26:59.227 INFO:tasks.workunit.client.0.smithi084.stdout:5/198: write d9/f12 [3265535,30929] 0 2024-02-15T18:26:59.227 INFO:tasks.workunit.client.0.smithi084.stdout:5/199: truncate f8 8966763 0 2024-02-15T18:26:59.227 INFO:tasks.workunit.client.0.smithi084.stdout:7/115: rmdir df 39 2024-02-15T18:26:59.229 INFO:tasks.workunit.client.0.smithi084.stdout:5/200: fdatasync d9/f12 0 2024-02-15T18:26:59.230 INFO:tasks.workunit.client.0.smithi084.stdout:0/140: rename d0/d1d to d0/d4/d1b/d26 0 2024-02-15T18:26:59.237 INFO:tasks.workunit.client.0.smithi084.stdout:4/133: dwrite d2/d4/fe [0,4194304] 0 2024-02-15T18:26:59.241 INFO:tasks.workunit.client.0.smithi084.stdout:2/153: rmdir d3/d5/d1a 39 2024-02-15T18:26:59.241 INFO:tasks.workunit.client.0.smithi084.stdout:2/154: chown d3/d5/c7 0 1 2024-02-15T18:26:59.242 INFO:tasks.workunit.client.0.smithi084.stdout:8/158: symlink db/dd/d13/l34 0 2024-02-15T18:26:59.242 INFO:tasks.workunit.client.0.smithi084.stdout:8/159: fdatasync db/f11 0 2024-02-15T18:26:59.243 INFO:tasks.workunit.client.0.smithi084.stdout:6/133: creat d14/f2d x:0 0 0 2024-02-15T18:26:59.244 INFO:tasks.workunit.client.0.smithi084.stdout:7/116: mknod df/d1d/c1e 0 2024-02-15T18:26:59.245 INFO:tasks.workunit.client.0.smithi084.stdout:5/201: symlink d9/d3a/l43 0 2024-02-15T18:26:59.245 INFO:tasks.workunit.client.0.smithi084.stdout:5/202: chown f8 692851035 1 2024-02-15T18:26:59.245 INFO:tasks.workunit.client.0.smithi084.stdout:5/203: truncate d9/f3b 688162 0 2024-02-15T18:26:59.245 INFO:tasks.workunit.client.0.smithi084.stdout:5/204: dread f8 [8388608,4194304] 0 2024-02-15T18:26:59.247 INFO:tasks.workunit.client.0.smithi084.stdout:3/129: rename d8/fb to d8/d1f/d28/f2b 0 2024-02-15T18:26:59.248 INFO:tasks.workunit.client.0.smithi084.stdout:3/130: truncate d8/f1b 627202 0 2024-02-15T18:26:59.248 INFO:tasks.workunit.client.0.smithi084.stdout:3/131: chown d8/d1f/d28/f2b 885 1 2024-02-15T18:26:59.250 INFO:tasks.workunit.client.0.smithi084.stdout:0/141: symlink d0/d4/d1b/d26/l27 0 2024-02-15T18:26:59.250 INFO:tasks.workunit.client.0.smithi084.stdout:0/142: truncate d0/f1a 613383 0 2024-02-15T18:26:59.251 INFO:tasks.workunit.client.0.smithi084.stdout:5/205: dread d9/f10 [0,4194304] 0 2024-02-15T18:26:59.253 INFO:tasks.workunit.client.0.smithi084.stdout:4/134: creat d2/d4/f27 x:0 0 0 2024-02-15T18:26:59.253 INFO:tasks.workunit.client.0.smithi084.stdout:4/135: write d2/f3 [3069773,19402] 0 2024-02-15T18:26:59.254 INFO:tasks.workunit.client.0.smithi084.stdout:2/155: creat d3/d5/f35 x:0 0 0 2024-02-15T18:26:59.254 INFO:tasks.workunit.client.0.smithi084.stdout:2/156: chown d3/d19/l1c 1106 1 2024-02-15T18:26:59.254 INFO:tasks.workunit.client.0.smithi084.stdout:2/157: dread - d3/d19/d24/f2f zero size 2024-02-15T18:26:59.255 INFO:tasks.workunit.client.0.smithi084.stdout:2/158: write d3/d5/f22 [1034912,74250] 0 2024-02-15T18:26:59.255 INFO:tasks.workunit.client.0.smithi084.stdout:2/159: chown d3/d19/d34 805279232 1 2024-02-15T18:26:59.255 INFO:tasks.workunit.client.0.smithi084.stdout:8/160: mknod db/c35 0 2024-02-15T18:26:59.255 INFO:tasks.workunit.client.0.smithi084.stdout:2/160: dread d3/d5/f18 [0,4194304] 0 2024-02-15T18:26:59.256 INFO:tasks.workunit.client.0.smithi084.stdout:6/134: mknod d14/d22/d25/d28/c2e 0 2024-02-15T18:26:59.260 INFO:tasks.workunit.client.0.smithi084.stdout:1/145: sync 2024-02-15T18:26:59.260 INFO:tasks.workunit.client.0.smithi084.stdout:1/146: readlink l5 0 2024-02-15T18:26:59.260 INFO:tasks.workunit.client.0.smithi084.stdout:1/147: chown d9/dd/d12/d16/l2e 105692466 1 2024-02-15T18:26:59.261 INFO:tasks.workunit.client.0.smithi084.stdout:7/117: unlink df/d1d/f17 0 2024-02-15T18:26:59.261 INFO:tasks.workunit.client.0.smithi084.stdout:3/132: mkdir d8/d1f/d2c 0 2024-02-15T18:26:59.263 INFO:tasks.workunit.client.0.smithi084.stdout:0/143: rename d0/f10 to d0/d25/f28 0 2024-02-15T18:26:59.267 INFO:tasks.workunit.client.0.smithi084.stdout:8/161: mknod db/dd/d1f/c36 0 2024-02-15T18:26:59.267 INFO:tasks.workunit.client.0.smithi084.stdout:8/162: fdatasync db/d1a/d2b/f31 0 2024-02-15T18:26:59.268 INFO:tasks.workunit.client.0.smithi084.stdout:2/161: mkdir d3/d19/d36 0 2024-02-15T18:26:59.268 INFO:tasks.workunit.client.0.smithi084.stdout:2/162: chown d3/d5/f16 28584859 1 2024-02-15T18:26:59.269 INFO:tasks.workunit.client.0.smithi084.stdout:6/135: mkdir d14/d22/d25/d2f 0 2024-02-15T18:26:59.269 INFO:tasks.workunit.client.0.smithi084.stdout:6/136: dread - d14/d22/d25/d28/f2a zero size 2024-02-15T18:26:59.270 INFO:tasks.workunit.client.0.smithi084.stdout:6/137: write fd [133064,36796] 0 2024-02-15T18:26:59.270 INFO:tasks.workunit.client.0.smithi084.stdout:6/138: chown d14/d22 201 1 2024-02-15T18:26:59.275 INFO:tasks.workunit.client.0.smithi084.stdout:8/163: dread db/d1c/f28 [0,4194304] 0 2024-02-15T18:26:59.275 INFO:tasks.workunit.client.0.smithi084.stdout:8/164: dread - db/d1a/d2b/f31 zero size 2024-02-15T18:26:59.275 INFO:tasks.workunit.client.0.smithi084.stdout:8/165: truncate db/d1a/f22 308022 0 2024-02-15T18:26:59.275 INFO:tasks.workunit.client.0.smithi084.stdout:9/95: sync 2024-02-15T18:26:59.276 INFO:tasks.workunit.client.0.smithi084.stdout:7/118: link f7 df/d1d/f1f 0 2024-02-15T18:26:59.276 INFO:tasks.workunit.client.0.smithi084.stdout:0/144: mknod d0/d4/d1b/c29 0 2024-02-15T18:26:59.277 INFO:tasks.workunit.client.0.smithi084.stdout:4/136: mkdir d2/d4/d28 0 2024-02-15T18:26:59.278 INFO:tasks.workunit.client.0.smithi084.stdout:0/145: dread d0/f1a [0,4194304] 0 2024-02-15T18:26:59.278 INFO:tasks.workunit.client.0.smithi084.stdout:2/163: symlink d3/d5/d1a/d1e/l37 0 2024-02-15T18:26:59.278 INFO:tasks.workunit.client.0.smithi084.stdout:2/164: truncate d3/d19/d24/f2f 155078 0 2024-02-15T18:26:59.278 INFO:tasks.workunit.client.0.smithi084.stdout:2/165: readlink d3/d5/d1a/d1e/l37 0 2024-02-15T18:26:59.280 INFO:tasks.workunit.client.0.smithi084.stdout:8/166: rename db/f11 to db/d1a/d2b/f37 0 2024-02-15T18:26:59.280 INFO:tasks.workunit.client.0.smithi084.stdout:8/167: fsync db/f20 0 2024-02-15T18:26:59.282 INFO:tasks.workunit.client.0.smithi084.stdout:9/96: rmdir d4/d1d 0 2024-02-15T18:26:59.283 INFO:tasks.workunit.client.0.smithi084.stdout:4/137: mkdir d2/d29 0 2024-02-15T18:26:59.283 INFO:tasks.workunit.client.0.smithi084.stdout:4/138: readlink d2/d4/l14 0 2024-02-15T18:26:59.284 INFO:tasks.workunit.client.0.smithi084.stdout:0/146: rename d0/d25/f28 to d0/d25/f2a 0 2024-02-15T18:26:59.285 INFO:tasks.workunit.client.0.smithi084.stdout:2/166: rmdir d3/d5/d1a/d1e 39 2024-02-15T18:26:59.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/168: creat db/dd/d1f/f38 x:0 0 0 2024-02-15T18:26:59.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/169: write db/d1a/d2b/f37 [4894878,100975] 0 2024-02-15T18:26:59.286 INFO:tasks.workunit.client.0.smithi084.stdout:9/97: creat d4/de/f1f x:0 0 0 2024-02-15T18:26:59.287 INFO:tasks.workunit.client.0.smithi084.stdout:4/139: mknod d2/d26/c2a 0 2024-02-15T18:26:59.288 INFO:tasks.workunit.client.0.smithi084.stdout:9/98: dread d4/f19 [0,4194304] 0 2024-02-15T18:26:59.288 INFO:tasks.workunit.client.0.smithi084.stdout:0/147: link d0/db/c21 d0/d4/c2b 0 2024-02-15T18:26:59.290 INFO:tasks.workunit.client.0.smithi084.stdout:7/119: dread f7 [0,4194304] 0 2024-02-15T18:26:59.290 INFO:tasks.workunit.client.0.smithi084.stdout:7/120: chown f5 9 1 2024-02-15T18:26:59.290 INFO:tasks.workunit.client.0.smithi084.stdout:7/121: readlink l2 0 2024-02-15T18:26:59.290 INFO:tasks.workunit.client.0.smithi084.stdout:2/167: creat d3/d5/d1a/d2d/f38 x:0 0 0 2024-02-15T18:26:59.291 INFO:tasks.workunit.client.0.smithi084.stdout:1/148: dwrite d9/dd/f13 [0,4194304] 0 2024-02-15T18:26:59.294 INFO:tasks.workunit.client.0.smithi084.stdout:3/133: dwrite d8/d22/f24 [0,4194304] 0 2024-02-15T18:26:59.296 INFO:tasks.workunit.client.0.smithi084.stdout:8/170: creat db/f39 x:0 0 0 2024-02-15T18:26:59.298 INFO:tasks.workunit.client.0.smithi084.stdout:2/168: read d3/d5/f18 [358497,5356] 0 2024-02-15T18:26:59.300 INFO:tasks.workunit.client.0.smithi084.stdout:3/134: write d8/f12 [4146202,127608] 0 2024-02-15T18:26:59.300 INFO:tasks.workunit.client.0.smithi084.stdout:3/135: stat d8/d1f/f20 0 2024-02-15T18:26:59.300 INFO:tasks.workunit.client.0.smithi084.stdout:8/171: creat db/f3a x:0 0 0 2024-02-15T18:26:59.301 INFO:tasks.workunit.client.0.smithi084.stdout:6/139: dwrite f10 [0,4194304] 0 2024-02-15T18:26:59.301 INFO:tasks.workunit.client.0.smithi084.stdout:6/140: dread - d14/d22/d25/d28/f29 zero size 2024-02-15T18:26:59.301 INFO:tasks.workunit.client.0.smithi084.stdout:2/169: creat d3/d19/d36/f39 x:0 0 0 2024-02-15T18:26:59.302 INFO:tasks.workunit.client.0.smithi084.stdout:3/136: mkdir d8/d1f/d2d 0 2024-02-15T18:26:59.306 INFO:tasks.workunit.client.0.smithi084.stdout:8/172: unlink db/d1c/f1e 0 2024-02-15T18:26:59.308 INFO:tasks.workunit.client.0.smithi084.stdout:7/122: dread df/d1d/f18 [0,4194304] 0 2024-02-15T18:26:59.310 INFO:tasks.workunit.client.0.smithi084.stdout:1/149: dread d9/dd/f13 [0,4194304] 0 2024-02-15T18:26:59.310 INFO:tasks.workunit.client.0.smithi084.stdout:1/150: dread - d9/dd/d12/d1b/f25 zero size 2024-02-15T18:26:59.313 INFO:tasks.workunit.client.0.smithi084.stdout:6/141: mkdir d14/d1a/d30 0 2024-02-15T18:26:59.316 INFO:tasks.workunit.client.0.smithi084.stdout:2/170: rename d3/f13 to d3/d19/d24/f3a 0 2024-02-15T18:26:59.318 INFO:tasks.workunit.client.0.smithi084.stdout:7/123: mknod df/c20 0 2024-02-15T18:26:59.318 INFO:tasks.workunit.client.0.smithi084.stdout:4/140: dwrite d2/d4/f7 [0,4194304] 0 2024-02-15T18:26:59.318 INFO:tasks.workunit.client.0.smithi084.stdout:0/148: dwrite d0/d25/f2a [0,4194304] 0 2024-02-15T18:26:59.320 INFO:tasks.workunit.client.0.smithi084.stdout:9/99: dwrite d4/de/f13 [0,4194304] 0 2024-02-15T18:26:59.321 INFO:tasks.workunit.client.0.smithi084.stdout:1/151: getdents d9/dd 0 2024-02-15T18:26:59.321 INFO:tasks.workunit.client.0.smithi084.stdout:1/152: truncate d9/dd/d12/d16/f24 780923 0 2024-02-15T18:26:59.325 INFO:tasks.workunit.client.0.smithi084.stdout:6/142: rename d14/d1a to d14/d22/d25/d2f/d31 0 2024-02-15T18:26:59.325 INFO:tasks.workunit.client.0.smithi084.stdout:6/143: write d14/f2d [349744,12254] 0 2024-02-15T18:26:59.325 INFO:tasks.workunit.client.0.smithi084.stdout:6/144: chown d14/l26 14 1 2024-02-15T18:26:59.329 INFO:tasks.workunit.client.0.smithi084.stdout:4/141: unlink d2/d4/c12 0 2024-02-15T18:26:59.329 INFO:tasks.workunit.client.0.smithi084.stdout:0/149: mknod d0/d4/c2c 0 2024-02-15T18:26:59.330 INFO:tasks.workunit.client.0.smithi084.stdout:2/171: dread d3/fc [0,4194304] 0 2024-02-15T18:26:59.332 INFO:tasks.workunit.client.0.smithi084.stdout:6/145: creat d14/d22/d25/f32 x:0 0 0 2024-02-15T18:26:59.334 INFO:tasks.workunit.client.0.smithi084.stdout:1/153: dread d9/f14 [0,4194304] 0 2024-02-15T18:26:59.334 INFO:tasks.workunit.client.0.smithi084.stdout:1/154: readlink d9/le 0 2024-02-15T18:26:59.334 INFO:tasks.workunit.client.0.smithi084.stdout:4/142: rename d2/d18 to d2/d2b 0 2024-02-15T18:26:59.336 INFO:tasks.workunit.client.0.smithi084.stdout:2/172: dread d3/d5/f22 [0,4194304] 0 2024-02-15T18:26:59.336 INFO:tasks.workunit.client.0.smithi084.stdout:2/173: stat d3/f2a 0 2024-02-15T18:26:59.336 INFO:tasks.workunit.client.0.smithi084.stdout:0/150: creat d0/d4/d1b/d26/f2d x:0 0 0 2024-02-15T18:26:59.337 INFO:tasks.workunit.client.0.smithi084.stdout:1/155: rename d9/dd/d12/d16/f24 to d9/dd/d12/d16/f30 0 2024-02-15T18:26:59.338 INFO:tasks.workunit.client.0.smithi084.stdout:0/151: dread d0/f1a [0,4194304] 0 2024-02-15T18:26:59.341 INFO:tasks.workunit.client.0.smithi084.stdout:5/206: sync 2024-02-15T18:26:59.343 INFO:tasks.workunit.client.0.smithi084.stdout:0/152: rename d0/f15 to d0/d4/d1b/d26/f2e 0 2024-02-15T18:26:59.343 INFO:tasks.workunit.client.0.smithi084.stdout:5/207: mkdir d9/da/d3d/d44 0 2024-02-15T18:26:59.345 INFO:tasks.workunit.client.0.smithi084.stdout:5/208: symlink d9/d23/l45 0 2024-02-15T18:26:59.348 INFO:tasks.workunit.client.0.smithi084.stdout:2/174: dread d3/f1b [0,4194304] 0 2024-02-15T18:26:59.349 INFO:tasks.workunit.client.0.smithi084.stdout:2/175: symlink d3/d5/d1a/d1e/d30/l3b 0 2024-02-15T18:26:59.349 INFO:tasks.workunit.client.0.smithi084.stdout:2/176: chown d3/d19/d24/f3a 62 1 2024-02-15T18:26:59.350 INFO:tasks.workunit.client.0.smithi084.stdout:2/177: creat d3/d19/d34/f3c x:0 0 0 2024-02-15T18:26:59.350 INFO:tasks.workunit.client.0.smithi084.stdout:2/178: write d3/d19/f20 [4562621,105518] 0 2024-02-15T18:26:59.351 INFO:tasks.workunit.client.0.smithi084.stdout:2/179: write d3/f1b [721224,83959] 0 2024-02-15T18:26:59.351 INFO:tasks.workunit.client.0.smithi084.stdout:8/173: dwrite db/d1c/f2c [0,4194304] 0 2024-02-15T18:26:59.351 INFO:tasks.workunit.client.0.smithi084.stdout:8/174: write db/d1c/f28 [585640,106368] 0 2024-02-15T18:26:59.353 INFO:tasks.workunit.client.0.smithi084.stdout:0/153: getdents d0 0 2024-02-15T18:26:59.353 INFO:tasks.workunit.client.0.smithi084.stdout:0/154: readlink d0/l9 0 2024-02-15T18:26:59.353 INFO:tasks.workunit.client.0.smithi084.stdout:0/155: chown d0/d4/d1b/d26 2359 1 2024-02-15T18:26:59.355 INFO:tasks.workunit.client.0.smithi084.stdout:7/124: dwrite f4 [0,4194304] 0 2024-02-15T18:26:59.355 INFO:tasks.workunit.client.0.smithi084.stdout:6/146: dwrite d14/d22/f2c [0,4194304] 0 2024-02-15T18:26:59.355 INFO:tasks.workunit.client.0.smithi084.stdout:2/180: creat d3/d19/f3d x:0 0 0 2024-02-15T18:26:59.356 INFO:tasks.workunit.client.0.smithi084.stdout:1/156: dwrite d9/dd/f2f [0,4194304] 0 2024-02-15T18:26:59.357 INFO:tasks.workunit.client.0.smithi084.stdout:8/175: getdents db/dd 0 2024-02-15T18:26:59.358 INFO:tasks.workunit.client.0.smithi084.stdout:0/156: rmdir d0/d4/d1b/d26 39 2024-02-15T18:26:59.359 INFO:tasks.workunit.client.0.smithi084.stdout:2/181: write d3/ff [3650012,11505] 0 2024-02-15T18:26:59.360 INFO:tasks.workunit.client.0.smithi084.stdout:7/125: truncate df/f1b 2267876 0 2024-02-15T18:26:59.362 INFO:tasks.workunit.client.0.smithi084.stdout:7/126: dread fd [0,4194304] 0 2024-02-15T18:26:59.362 INFO:tasks.workunit.client.0.smithi084.stdout:7/127: fsync f0 0 2024-02-15T18:26:59.366 INFO:tasks.workunit.client.0.smithi084.stdout:1/157: unlink d9/dd/d12/d1b/f1d 0 2024-02-15T18:26:59.366 INFO:tasks.workunit.client.0.smithi084.stdout:1/158: truncate d9/dd/d12/d1b/f25 454397 0 2024-02-15T18:26:59.367 INFO:tasks.workunit.client.0.smithi084.stdout:6/147: dread d14/f16 [0,4194304] 0 2024-02-15T18:26:59.368 INFO:tasks.workunit.client.0.smithi084.stdout:8/176: creat db/d1c/f3b x:0 0 0 2024-02-15T18:26:59.370 INFO:tasks.workunit.client.0.smithi084.stdout:0/157: unlink d0/d4/f13 0 2024-02-15T18:26:59.370 INFO:tasks.workunit.client.0.smithi084.stdout:0/158: chown d0/d4/d1b/c29 17919667 1 2024-02-15T18:26:59.372 INFO:tasks.workunit.client.0.smithi084.stdout:2/182: rename d3/d19/d34 to d3/d19/d24/d3e 0 2024-02-15T18:26:59.373 INFO:tasks.workunit.client.0.smithi084.stdout:7/128: mknod df/d1d/c21 0 2024-02-15T18:26:59.377 INFO:tasks.workunit.client.0.smithi084.stdout:7/129: dread f7 [0,4194304] 0 2024-02-15T18:26:59.380 INFO:tasks.workunit.client.0.smithi084.stdout:1/159: creat d9/dd/d12/d1b/d2c/f31 x:0 0 0 2024-02-15T18:26:59.380 INFO:tasks.workunit.client.0.smithi084.stdout:1/160: chown d9/dd/d12/c18 4868150 1 2024-02-15T18:26:59.381 INFO:tasks.workunit.client.0.smithi084.stdout:6/148: mknod d14/d22/d25/d2f/d31/c33 0 2024-02-15T18:26:59.381 INFO:tasks.workunit.client.0.smithi084.stdout:6/149: fsync d14/d22/f2c 0 2024-02-15T18:26:59.381 INFO:tasks.workunit.client.0.smithi084.stdout:6/150: write d14/d22/d25/d28/f29 [896123,14517] 0 2024-02-15T18:26:59.381 INFO:tasks.workunit.client.0.smithi084.stdout:6/151: read fd [330704,103462] 0 2024-02-15T18:26:59.382 INFO:tasks.workunit.client.0.smithi084.stdout:3/137: sync 2024-02-15T18:26:59.383 INFO:tasks.workunit.client.0.smithi084.stdout:8/177: mknod db/d1c/c3c 0 2024-02-15T18:26:59.384 INFO:tasks.workunit.client.0.smithi084.stdout:0/159: mkdir d0/d2f 0 2024-02-15T18:26:59.384 INFO:tasks.workunit.client.0.smithi084.stdout:0/160: truncate d0/d25/f2a 5149091 0 2024-02-15T18:26:59.384 INFO:tasks.workunit.client.0.smithi084.stdout:8/178: write db/dd/d1f/f23 [7595842,120781] 0 2024-02-15T18:26:59.384 INFO:tasks.workunit.client.0.smithi084.stdout:8/179: write db/d1c/f28 [1066941,85490] 0 2024-02-15T18:26:59.386 INFO:tasks.workunit.client.0.smithi084.stdout:2/183: link d3/d5/f21 d3/d5/d1a/f3f 0 2024-02-15T18:26:59.386 INFO:tasks.workunit.client.0.smithi084.stdout:7/130: mknod df/d1d/d1a/c22 0 2024-02-15T18:26:59.387 INFO:tasks.workunit.client.0.smithi084.stdout:1/161: dread d9/dd/f2f [0,4194304] 0 2024-02-15T18:26:59.387 INFO:tasks.workunit.client.0.smithi084.stdout:7/131: chown df 83351344 1 2024-02-15T18:26:59.387 INFO:tasks.workunit.client.0.smithi084.stdout:2/184: read d3/d19/d24/f2f [92341,53916] 0 2024-02-15T18:26:59.387 INFO:tasks.workunit.client.0.smithi084.stdout:2/185: chown d3/d19/d24/f2f 21125 1 2024-02-15T18:26:59.388 INFO:tasks.workunit.client.0.smithi084.stdout:6/152: chown c1 2845 1 2024-02-15T18:26:59.389 INFO:tasks.workunit.client.0.smithi084.stdout:0/161: creat d0/db/f30 x:0 0 0 2024-02-15T18:26:59.391 INFO:tasks.workunit.client.0.smithi084.stdout:8/180: symlink db/dd/d1f/l3d 0 2024-02-15T18:26:59.392 INFO:tasks.workunit.client.0.smithi084.stdout:3/138: dread d8/f12 [0,4194304] 0 2024-02-15T18:26:59.393 INFO:tasks.workunit.client.0.smithi084.stdout:6/153: write f3 [1530710,20382] 0 2024-02-15T18:26:59.393 INFO:tasks.workunit.client.0.smithi084.stdout:7/132: mkdir df/d1d/d23 0 2024-02-15T18:26:59.395 INFO:tasks.workunit.client.0.smithi084.stdout:1/162: mkdir d9/dd/d12/d32 0 2024-02-15T18:26:59.396 INFO:tasks.workunit.client.0.smithi084.stdout:2/186: creat d3/d19/d36/f40 x:0 0 0 2024-02-15T18:26:59.396 INFO:tasks.workunit.client.0.smithi084.stdout:2/187: chown d3/d19/d24/f2f 1602949 1 2024-02-15T18:26:59.398 INFO:tasks.workunit.client.0.smithi084.stdout:3/139: symlink d8/d1f/d25/l2e 0 2024-02-15T18:26:59.400 INFO:tasks.workunit.client.0.smithi084.stdout:6/154: creat d14/d22/d25/d2f/d31/f34 x:0 0 0 2024-02-15T18:26:59.400 INFO:tasks.workunit.client.0.smithi084.stdout:6/155: chown fb 222 1 2024-02-15T18:26:59.400 INFO:tasks.workunit.client.0.smithi084.stdout:6/156: readlink d14/l21 0 2024-02-15T18:26:59.401 INFO:tasks.workunit.client.0.smithi084.stdout:0/162: dread d0/d4/d1b/d26/f2e [0,4194304] 0 2024-02-15T18:26:59.401 INFO:tasks.workunit.client.0.smithi084.stdout:7/133: creat df/d1d/d1a/f24 x:0 0 0 2024-02-15T18:26:59.403 INFO:tasks.workunit.client.0.smithi084.stdout:1/163: unlink d9/dd/d12/d1b/d2c/f2d 0 2024-02-15T18:26:59.403 INFO:tasks.workunit.client.0.smithi084.stdout:1/164: chown d9/lc 50111379 1 2024-02-15T18:26:59.403 INFO:tasks.workunit.client.0.smithi084.stdout:1/165: truncate d9/f27 462229 0 2024-02-15T18:26:59.403 INFO:tasks.workunit.client.0.smithi084.stdout:1/166: readlink d9/le 0 2024-02-15T18:26:59.403 INFO:tasks.workunit.client.0.smithi084.stdout:3/140: rmdir d8/d1f/d25 39 2024-02-15T18:26:59.405 INFO:tasks.workunit.client.0.smithi084.stdout:7/134: truncate df/d1d/f1f 1972980 0 2024-02-15T18:26:59.405 INFO:tasks.workunit.client.0.smithi084.stdout:1/167: mkdir d9/dd/d12/d33 0 2024-02-15T18:26:59.408 INFO:tasks.workunit.client.0.smithi084.stdout:7/135: creat df/d1d/f25 x:0 0 0 2024-02-15T18:26:59.409 INFO:tasks.workunit.client.0.smithi084.stdout:7/136: write fd [601510,36752] 0 2024-02-15T18:26:59.409 INFO:tasks.workunit.client.0.smithi084.stdout:3/141: dread d8/f1c [0,4194304] 0 2024-02-15T18:26:59.409 INFO:tasks.workunit.client.0.smithi084.stdout:3/142: getdents d8/d1f/d2c 0 2024-02-15T18:26:59.410 INFO:tasks.workunit.client.0.smithi084.stdout:3/143: truncate d8/d1f/d28/f2b 2360696 0 2024-02-15T18:26:59.417 INFO:tasks.workunit.client.0.smithi084.stdout:3/144: stat d8/d1f/d28/c29 0 2024-02-15T18:26:59.417 INFO:tasks.workunit.client.0.smithi084.stdout:3/145: write d8/d22/f24 [4980719,29546] 0 2024-02-15T18:26:59.419 INFO:tasks.workunit.client.0.smithi084.stdout:3/146: link d8/d1f/d28/c29 d8/d1f/d2d/c2f 0 2024-02-15T18:26:59.430 INFO:tasks.workunit.client.0.smithi084.stdout:8/181: dwrite db/d1c/f2c [0,4194304] 0 2024-02-15T18:26:59.432 INFO:tasks.workunit.client.0.smithi084.stdout:6/157: dwrite d14/d22/f2c [0,4194304] 0 2024-02-15T18:26:59.432 INFO:tasks.workunit.client.0.smithi084.stdout:0/163: dwrite d0/f1a [0,4194304] 0 2024-02-15T18:26:59.432 INFO:tasks.workunit.client.0.smithi084.stdout:6/158: fsync d14/d22/d25/f2b 0 2024-02-15T18:26:59.432 INFO:tasks.workunit.client.0.smithi084.stdout:7/137: fsync fd 0 2024-02-15T18:26:59.433 INFO:tasks.workunit.client.0.smithi084.stdout:7/138: write fc [587584,119556] 0 2024-02-15T18:26:59.434 INFO:tasks.workunit.client.0.smithi084.stdout:8/182: mkdir db/dd/d1f/d3e 0 2024-02-15T18:26:59.436 INFO:tasks.workunit.client.0.smithi084.stdout:8/183: mkdir db/d3f 0 2024-02-15T18:26:59.436 INFO:tasks.workunit.client.0.smithi084.stdout:8/184: fdatasync db/d1c/f3b 0 2024-02-15T18:26:59.437 INFO:tasks.workunit.client.0.smithi084.stdout:8/185: write db/fe [6231254,60429] 0 2024-02-15T18:26:59.437 INFO:tasks.workunit.client.0.smithi084.stdout:7/139: dread df/f1b [0,4194304] 0 2024-02-15T18:26:59.440 INFO:tasks.workunit.client.0.smithi084.stdout:7/140: rename df/d1d/f25 to df/d1d/d1a/f26 0 2024-02-15T18:26:59.441 INFO:tasks.workunit.client.0.smithi084.stdout:7/141: symlink df/d1d/l27 0 2024-02-15T18:26:59.442 INFO:tasks.workunit.client.0.smithi084.stdout:7/142: write df/d1d/d1a/f26 [306429,34880] 0 2024-02-15T18:26:59.444 INFO:tasks.workunit.client.0.smithi084.stdout:7/143: rename fd to df/d1d/d1a/f28 0 2024-02-15T18:26:59.446 INFO:tasks.workunit.client.0.smithi084.stdout:7/144: mknod df/c29 0 2024-02-15T18:26:59.455 INFO:tasks.workunit.client.0.smithi084.stdout:3/147: dwrite d8/f15 [0,4194304] 0 2024-02-15T18:26:59.463 INFO:tasks.workunit.client.0.smithi084.stdout:5/209: sync 2024-02-15T18:26:59.464 INFO:tasks.workunit.client.0.smithi084.stdout:9/100: sync 2024-02-15T18:26:59.464 INFO:tasks.workunit.client.0.smithi084.stdout:4/143: sync 2024-02-15T18:26:59.465 INFO:tasks.workunit.client.0.smithi084.stdout:5/210: mknod d9/da/d3d/d44/c46 0 2024-02-15T18:26:59.466 INFO:tasks.workunit.client.0.smithi084.stdout:3/148: dread d8/d1f/f20 [0,4194304] 0 2024-02-15T18:26:59.466 INFO:tasks.workunit.client.0.smithi084.stdout:9/101: mkdir d4/de/d15/d1a/d20 0 2024-02-15T18:26:59.466 INFO:tasks.workunit.client.0.smithi084.stdout:9/102: readlink d4/de/l10 0 2024-02-15T18:26:59.466 INFO:tasks.workunit.client.0.smithi084.stdout:9/103: write d4/fb [937083,67670] 0 2024-02-15T18:26:59.466 INFO:tasks.workunit.client.0.smithi084.stdout:9/104: read - d4/de/f14 zero size 2024-02-15T18:26:59.467 INFO:tasks.workunit.client.0.smithi084.stdout:9/105: chown d4/ca 0 1 2024-02-15T18:26:59.467 INFO:tasks.workunit.client.0.smithi084.stdout:9/106: readlink l3 0 2024-02-15T18:26:59.467 INFO:tasks.workunit.client.0.smithi084.stdout:0/164: dwrite d0/d4/d1b/d26/f2e [4194304,4194304] 0 2024-02-15T18:26:59.467 INFO:tasks.workunit.client.0.smithi084.stdout:4/144: rename d2/d4/c10 to d2/d4/c2c 0 2024-02-15T18:26:59.468 INFO:tasks.workunit.client.0.smithi084.stdout:6/159: dwrite d14/f2d [0,4194304] 0 2024-02-15T18:26:59.468 INFO:tasks.workunit.client.0.smithi084.stdout:8/186: dwrite db/f16 [0,4194304] 0 2024-02-15T18:26:59.469 INFO:tasks.workunit.client.0.smithi084.stdout:5/211: link d9/f2c d9/d23/f47 0 2024-02-15T18:26:59.472 INFO:tasks.workunit.client.0.smithi084.stdout:7/145: getdents df 0 2024-02-15T18:26:59.473 INFO:tasks.workunit.client.0.smithi084.stdout:9/107: unlink d4/l8 0 2024-02-15T18:26:59.475 INFO:tasks.workunit.client.0.smithi084.stdout:4/145: unlink d2/d4/f27 0 2024-02-15T18:26:59.488 INFO:tasks.workunit.client.0.smithi084.stdout:6/160: creat d14/d22/d25/f35 x:0 0 0 2024-02-15T18:26:59.488 INFO:tasks.workunit.client.0.smithi084.stdout:6/161: truncate d14/d22/d25/d28/f2a 301048 0 2024-02-15T18:26:59.489 INFO:tasks.workunit.client.0.smithi084.stdout:5/212: symlink d9/d35/l48 0 2024-02-15T18:26:59.489 INFO:tasks.workunit.client.0.smithi084.stdout:7/146: rmdir df 39 2024-02-15T18:26:59.489 INFO:tasks.workunit.client.0.smithi084.stdout:7/147: fdatasync f7 0 2024-02-15T18:26:59.490 INFO:tasks.workunit.client.0.smithi084.stdout:9/108: mkdir d4/de/d15/d21 0 2024-02-15T18:26:59.490 INFO:tasks.workunit.client.0.smithi084.stdout:9/109: dread - d4/de/f1f zero size 2024-02-15T18:26:59.493 INFO:tasks.workunit.client.0.smithi084.stdout:9/110: rmdir d4/de/d15/d21 0 2024-02-15T18:26:59.495 INFO:tasks.workunit.client.0.smithi084.stdout:9/111: creat d4/de/d15/d1a/f22 x:0 0 0 2024-02-15T18:26:59.495 INFO:tasks.workunit.client.0.smithi084.stdout:9/112: dread - d4/de/f1c zero size 2024-02-15T18:26:59.506 INFO:tasks.workunit.client.0.smithi084.stdout:3/149: dwrite d8/f12 [0,4194304] 0 2024-02-15T18:26:59.506 INFO:tasks.workunit.client.0.smithi084.stdout:3/150: write d8/f1c [1638784,96832] 0 2024-02-15T18:26:59.511 INFO:tasks.workunit.client.0.smithi084.stdout:4/146: dwrite d2/d4/f7 [0,4194304] 0 2024-02-15T18:26:59.512 INFO:tasks.workunit.client.0.smithi084.stdout:0/165: dwrite d0/d4/d1b/d26/f2e [4194304,4194304] 0 2024-02-15T18:26:59.512 INFO:tasks.workunit.client.0.smithi084.stdout:0/166: truncate d0/db/f30 34592 0 2024-02-15T18:26:59.513 INFO:tasks.workunit.client.0.smithi084.stdout:8/187: dwrite db/f16 [4194304,4194304] 0 2024-02-15T18:26:59.513 INFO:tasks.workunit.client.0.smithi084.stdout:8/188: chown db/d1a/f22 399031672 1 2024-02-15T18:26:59.514 INFO:tasks.workunit.client.0.smithi084.stdout:8/189: chown db/d1c/f3b 969105082 1 2024-02-15T18:26:59.514 INFO:tasks.workunit.client.0.smithi084.stdout:8/190: fsync db/d1a/f1d 0 2024-02-15T18:26:59.515 INFO:tasks.workunit.client.0.smithi084.stdout:2/188: sync 2024-02-15T18:26:59.516 INFO:tasks.workunit.client.0.smithi084.stdout:4/147: getdents d2/d2b 0 2024-02-15T18:26:59.518 INFO:tasks.workunit.client.0.smithi084.stdout:8/191: creat db/dd/d13/f40 x:0 0 0 2024-02-15T18:26:59.520 INFO:tasks.workunit.client.0.smithi084.stdout:4/148: creat d2/f2d x:0 0 0 2024-02-15T18:26:59.522 INFO:tasks.workunit.client.0.smithi084.stdout:2/189: rename f2 to d3/f41 0 2024-02-15T18:26:59.523 INFO:tasks.workunit.client.0.smithi084.stdout:4/149: mkdir d2/d4/d28/d2e 0 2024-02-15T18:26:59.523 INFO:tasks.workunit.client.0.smithi084.stdout:4/150: dread - d2/d2b/f1f zero size 2024-02-15T18:26:59.524 INFO:tasks.workunit.client.0.smithi084.stdout:7/148: dread fc [4194304,4194304] 0 2024-02-15T18:26:59.524 INFO:tasks.workunit.client.0.smithi084.stdout:8/192: rename db/f39 to db/d1a/f41 0 2024-02-15T18:26:59.525 INFO:tasks.workunit.client.0.smithi084.stdout:4/151: creat d2/d26/f2f x:0 0 0 2024-02-15T18:26:59.526 INFO:tasks.workunit.client.0.smithi084.stdout:4/152: read - d2/f2d zero size 2024-02-15T18:26:59.526 INFO:tasks.workunit.client.0.smithi084.stdout:7/149: symlink df/d1d/d23/l2a 0 2024-02-15T18:26:59.526 INFO:tasks.workunit.client.0.smithi084.stdout:8/193: mkdir db/dd/d13/d42 0 2024-02-15T18:26:59.527 INFO:tasks.workunit.client.0.smithi084.stdout:4/153: rmdir d2/d29 0 2024-02-15T18:26:59.528 INFO:tasks.workunit.client.0.smithi084.stdout:4/154: write d2/f11 [730179,101106] 0 2024-02-15T18:26:59.528 INFO:tasks.workunit.client.0.smithi084.stdout:4/155: fdatasync d2/d4/f8 0 2024-02-15T18:26:59.528 INFO:tasks.workunit.client.0.smithi084.stdout:4/156: stat d2/d4/d28 0 2024-02-15T18:26:59.530 INFO:tasks.workunit.client.0.smithi084.stdout:4/157: symlink d2/d26/l30 0 2024-02-15T18:26:59.530 INFO:tasks.workunit.client.0.smithi084.stdout:4/158: chown d2/d4/f8 43153822 1 2024-02-15T18:26:59.540 INFO:tasks.workunit.client.0.smithi084.stdout:8/194: dread db/d1c/f2c [0,4194304] 0 2024-02-15T18:26:59.540 INFO:tasks.workunit.client.0.smithi084.stdout:8/195: chown db/d1c/f3b 401065783 1 2024-02-15T18:26:59.541 INFO:tasks.workunit.client.0.smithi084.stdout:8/196: chown db/f3a 5819236 1 2024-02-15T18:26:59.541 INFO:tasks.workunit.client.0.smithi084.stdout:4/159: dread d2/d4/f8 [0,4194304] 0 2024-02-15T18:26:59.542 INFO:tasks.workunit.client.0.smithi084.stdout:4/160: mkdir d2/d26/d31 0 2024-02-15T18:26:59.542 INFO:tasks.workunit.client.0.smithi084.stdout:4/161: chown d2/d4/fb 141168108 1 2024-02-15T18:26:59.543 INFO:tasks.workunit.client.0.smithi084.stdout:4/162: mknod d2/d2b/c32 0 2024-02-15T18:26:59.544 INFO:tasks.workunit.client.0.smithi084.stdout:8/197: read db/dd/f10 [606583,63508] 0 2024-02-15T18:26:59.544 INFO:tasks.workunit.client.0.smithi084.stdout:4/163: symlink d2/d4/d25/l33 0 2024-02-15T18:26:59.545 INFO:tasks.workunit.client.0.smithi084.stdout:8/198: creat db/dd/d1f/d3e/f43 x:0 0 0 2024-02-15T18:26:59.545 INFO:tasks.workunit.client.0.smithi084.stdout:8/199: truncate db/dd/d13/f40 634509 0 2024-02-15T18:26:59.546 INFO:tasks.workunit.client.0.smithi084.stdout:8/200: mknod db/d1a/d2b/c44 0 2024-02-15T18:26:59.548 INFO:tasks.workunit.client.0.smithi084.stdout:6/162: dwrite d14/f2d [0,4194304] 0 2024-02-15T18:26:59.548 INFO:tasks.workunit.client.0.smithi084.stdout:0/167: dwrite d0/db/f30 [0,4194304] 0 2024-02-15T18:26:59.548 INFO:tasks.workunit.client.0.smithi084.stdout:5/213: dwrite d9/f1e [0,4194304] 0 2024-02-15T18:26:59.548 INFO:tasks.workunit.client.0.smithi084.stdout:6/163: dread - d14/d22/d25/d2f/d31/f34 zero size 2024-02-15T18:26:59.548 INFO:tasks.workunit.client.0.smithi084.stdout:5/214: chown d9/da/l24 615533 1 2024-02-15T18:26:59.548 INFO:tasks.workunit.client.0.smithi084.stdout:2/190: dwrite d3/f41 [0,4194304] 0 2024-02-15T18:26:59.548 INFO:tasks.workunit.client.0.smithi084.stdout:9/113: dwrite d4/f19 [0,4194304] 0 2024-02-15T18:26:59.550 INFO:tasks.workunit.client.0.smithi084.stdout:4/164: dread d2/d4/fb [0,4194304] 0 2024-02-15T18:26:59.552 INFO:tasks.workunit.client.0.smithi084.stdout:1/168: sync 2024-02-15T18:26:59.555 INFO:tasks.workunit.client.0.smithi084.stdout:7/150: rmdir df/d1d 39 2024-02-15T18:26:59.557 INFO:tasks.workunit.client.0.smithi084.stdout:6/164: dread d14/d22/d25/d28/f29 [0,4194304] 0 2024-02-15T18:26:59.565 INFO:tasks.workunit.client.0.smithi084.stdout:5/215: write d9/f1e [1009233,32752] 0 2024-02-15T18:26:59.565 INFO:tasks.workunit.client.0.smithi084.stdout:5/216: write d9/f3b [1244407,70347] 0 2024-02-15T18:26:59.565 INFO:tasks.workunit.client.0.smithi084.stdout:5/217: fsync d9/f1d 0 2024-02-15T18:26:59.568 INFO:tasks.workunit.client.0.smithi084.stdout:0/168: dread - d0/d4/d1b/d26/f2d zero size 2024-02-15T18:26:59.568 INFO:tasks.workunit.client.0.smithi084.stdout:7/151: dread f4 [0,4194304] 0 2024-02-15T18:26:59.568 INFO:tasks.workunit.client.0.smithi084.stdout:0/169: write d0/d4/d1b/d26/f2e [8683442,91172] 0 2024-02-15T18:26:59.568 INFO:tasks.workunit.client.0.smithi084.stdout:2/191: creat d3/f42 x:0 0 0 2024-02-15T18:26:59.568 INFO:tasks.workunit.client.0.smithi084.stdout:2/192: dread - d3/d5/d1a/f27 zero size 2024-02-15T18:26:59.569 INFO:tasks.workunit.client.0.smithi084.stdout:9/114: rename d4/de/f11 to d4/de/d15/d1a/f23 0 2024-02-15T18:26:59.569 INFO:tasks.workunit.client.0.smithi084.stdout:4/165: getdents d2/d4/d28 0 2024-02-15T18:26:59.570 INFO:tasks.workunit.client.0.smithi084.stdout:4/166: truncate d2/d4/f1c 265724 0 2024-02-15T18:26:59.570 INFO:tasks.workunit.client.0.smithi084.stdout:4/167: write d2/d4/fb [5129786,128734] 0 2024-02-15T18:26:59.570 INFO:tasks.workunit.client.0.smithi084.stdout:8/201: dwrite db/dd/d1f/f23 [4194304,4194304] 0 2024-02-15T18:26:59.570 INFO:tasks.workunit.client.0.smithi084.stdout:6/165: truncate d14/d22/f2c 289148 0 2024-02-15T18:26:59.573 INFO:tasks.workunit.client.0.smithi084.stdout:0/170: dread d0/d4/d1b/d26/f2e [0,4194304] 0 2024-02-15T18:26:59.575 INFO:tasks.workunit.client.0.smithi084.stdout:7/152: truncate df/d1d/f18 119250 0 2024-02-15T18:26:59.575 INFO:tasks.workunit.client.0.smithi084.stdout:7/153: chown fb 222 1 2024-02-15T18:26:59.577 INFO:tasks.workunit.client.0.smithi084.stdout:2/193: unlink d3/d19/f3d 0 2024-02-15T18:26:59.577 INFO:tasks.workunit.client.0.smithi084.stdout:2/194: write d3/d19/d36/f39 [148109,95124] 0 2024-02-15T18:26:59.578 INFO:tasks.workunit.client.0.smithi084.stdout:5/218: rename d9/d23/c40 to d9/d35/c49 0 2024-02-15T18:26:59.578 INFO:tasks.workunit.client.0.smithi084.stdout:7/154: rename df to df/d2b 22 2024-02-15T18:26:59.579 INFO:tasks.workunit.client.0.smithi084.stdout:0/171: dread d0/f1a [0,4194304] 0 2024-02-15T18:26:59.580 INFO:tasks.workunit.client.0.smithi084.stdout:9/115: getdents d4 0 2024-02-15T18:26:59.581 INFO:tasks.workunit.client.0.smithi084.stdout:9/116: dread d4/de/d15/d1a/f23 [0,4194304] 0 2024-02-15T18:26:59.582 INFO:tasks.workunit.client.0.smithi084.stdout:4/168: link d2/d4/f20 d2/f34 0 2024-02-15T18:26:59.584 INFO:tasks.workunit.client.0.smithi084.stdout:8/202: rmdir db/dd/d1f/d3e 39 2024-02-15T18:26:59.586 INFO:tasks.workunit.client.0.smithi084.stdout:2/195: symlink d3/d5/l43 0 2024-02-15T18:26:59.586 INFO:tasks.workunit.client.0.smithi084.stdout:2/196: fdatasync d3/d19/d36/f40 0 2024-02-15T18:26:59.586 INFO:tasks.workunit.client.0.smithi084.stdout:5/219: dread d9/d23/f37 [0,4194304] 0 2024-02-15T18:26:59.588 INFO:tasks.workunit.client.0.smithi084.stdout:0/172: write d0/d25/f2a [1515867,38036] 0 2024-02-15T18:26:59.588 INFO:tasks.workunit.client.0.smithi084.stdout:7/155: symlink df/d1d/l2c 0 2024-02-15T18:26:59.588 INFO:tasks.workunit.client.0.smithi084.stdout:9/117: mkdir d4/de/d15/d1a/d24 0 2024-02-15T18:26:59.588 INFO:tasks.workunit.client.0.smithi084.stdout:8/203: creat db/d1a/d2b/f45 x:0 0 0 2024-02-15T18:26:59.590 INFO:tasks.workunit.client.0.smithi084.stdout:4/169: dread d2/d4/fe [0,4194304] 0 2024-02-15T18:26:59.590 INFO:tasks.workunit.client.0.smithi084.stdout:2/197: creat d3/d19/d24/f44 x:0 0 0 2024-02-15T18:26:59.590 INFO:tasks.workunit.client.0.smithi084.stdout:7/156: creat df/d1d/d1a/f2d x:0 0 0 2024-02-15T18:26:59.593 INFO:tasks.workunit.client.0.smithi084.stdout:9/118: mknod d4/de/d15/c25 0 2024-02-15T18:26:59.594 INFO:tasks.workunit.client.0.smithi084.stdout:8/204: getdents db/dd/d1f 0 2024-02-15T18:26:59.595 INFO:tasks.workunit.client.0.smithi084.stdout:4/170: creat d2/f35 x:0 0 0 2024-02-15T18:26:59.597 INFO:tasks.workunit.client.0.smithi084.stdout:2/198: creat d3/d28/f45 x:0 0 0 2024-02-15T18:26:59.597 INFO:tasks.workunit.client.0.smithi084.stdout:2/199: chown d3/c12 5337 1 2024-02-15T18:26:59.597 INFO:tasks.workunit.client.0.smithi084.stdout:0/173: write d0/d4/d1b/d26/f2e [3618598,14187] 0 2024-02-15T18:26:59.602 INFO:tasks.workunit.client.0.smithi084.stdout:9/119: mknod d4/c26 0 2024-02-15T18:26:59.602 INFO:tasks.workunit.client.0.smithi084.stdout:7/157: rmdir df/d1d/d1a 39 2024-02-15T18:26:59.602 INFO:tasks.workunit.client.0.smithi084.stdout:7/158: stat df/d1d/f18 0 2024-02-15T18:26:59.603 INFO:tasks.workunit.client.0.smithi084.stdout:8/205: symlink db/d1c/l46 0 2024-02-15T18:26:59.603 INFO:tasks.workunit.client.0.smithi084.stdout:4/171: mknod d2/d4/d28/d2e/c36 0 2024-02-15T18:26:59.604 INFO:tasks.workunit.client.0.smithi084.stdout:2/200: mknod d3/d5/d1a/d1e/c46 0 2024-02-15T18:26:59.605 INFO:tasks.workunit.client.0.smithi084.stdout:4/172: dread d2/d4/f1c [0,4194304] 0 2024-02-15T18:26:59.605 INFO:tasks.workunit.client.0.smithi084.stdout:7/159: dread df/d1d/f1f [0,4194304] 0 2024-02-15T18:26:59.605 INFO:tasks.workunit.client.0.smithi084.stdout:6/166: dwrite fd [0,4194304] 0 2024-02-15T18:26:59.605 INFO:tasks.workunit.client.0.smithi084.stdout:0/174: symlink d0/d25/l31 0 2024-02-15T18:26:59.606 INFO:tasks.workunit.client.0.smithi084.stdout:5/220: dwrite d9/d23/f37 [0,4194304] 0 2024-02-15T18:26:59.607 INFO:tasks.workunit.client.0.smithi084.stdout:5/221: fdatasync d9/d23/d33/f3c 0 2024-02-15T18:26:59.607 INFO:tasks.workunit.client.0.smithi084.stdout:9/120: creat d4/f27 x:0 0 0 2024-02-15T18:26:59.607 INFO:tasks.workunit.client.0.smithi084.stdout:8/206: mknod db/dd/d1f/d3e/c47 0 2024-02-15T18:26:59.612 INFO:tasks.workunit.client.0.smithi084.stdout:4/173: creat d2/d2b/f37 x:0 0 0 2024-02-15T18:26:59.612 INFO:tasks.workunit.client.0.smithi084.stdout:4/174: write d2/d4/f19 [144849,118518] 0 2024-02-15T18:26:59.614 INFO:tasks.workunit.client.0.smithi084.stdout:2/201: rmdir d3/d5 39 2024-02-15T18:26:59.616 INFO:tasks.workunit.client.0.smithi084.stdout:7/160: rename df/d1d/d1a/c22 to df/d1d/d23/c2e 0 2024-02-15T18:26:59.619 INFO:tasks.workunit.client.0.smithi084.stdout:0/175: mknod d0/db/c32 0 2024-02-15T18:26:59.621 INFO:tasks.workunit.client.0.smithi084.stdout:4/175: creat d2/d4/d28/f38 x:0 0 0 2024-02-15T18:26:59.622 INFO:tasks.workunit.client.0.smithi084.stdout:2/202: mkdir d3/d5/d1a/d1e/d47 0 2024-02-15T18:26:59.622 INFO:tasks.workunit.client.0.smithi084.stdout:7/161: mknod df/d1d/d23/c2f 0 2024-02-15T18:26:59.628 INFO:tasks.workunit.client.0.smithi084.stdout:0/176: dread d0/d25/f2a [0,4194304] 0 2024-02-15T18:26:59.630 INFO:tasks.workunit.client.0.smithi084.stdout:4/176: creat d2/f39 x:0 0 0 2024-02-15T18:26:59.631 INFO:tasks.workunit.client.0.smithi084.stdout:4/177: write d2/f11 [61557,36907] 0 2024-02-15T18:26:59.631 INFO:tasks.workunit.client.0.smithi084.stdout:4/178: truncate d2/d4/fd 4968230 0 2024-02-15T18:26:59.631 INFO:tasks.workunit.client.0.smithi084.stdout:4/179: chown d2/d26/c2a 5683723 1 2024-02-15T18:26:59.632 INFO:tasks.workunit.client.0.smithi084.stdout:2/203: mknod d3/c48 0 2024-02-15T18:26:59.634 INFO:tasks.workunit.client.0.smithi084.stdout:4/180: unlink d2/d26/f2f 0 2024-02-15T18:26:59.635 INFO:tasks.workunit.client.0.smithi084.stdout:0/177: write d0/db/f30 [1156726,32969] 0 2024-02-15T18:26:59.636 INFO:tasks.workunit.client.0.smithi084.stdout:2/204: mknod d3/d19/d36/c49 0 2024-02-15T18:26:59.637 INFO:tasks.workunit.client.0.smithi084.stdout:4/181: symlink d2/d26/l3a 0 2024-02-15T18:26:59.642 INFO:tasks.workunit.client.0.smithi084.stdout:2/205: write d3/d19/f33 [2374337,12883] 0 2024-02-15T18:26:59.642 INFO:tasks.workunit.client.0.smithi084.stdout:2/206: chown d3/f41 4826598 1 2024-02-15T18:26:59.642 INFO:tasks.workunit.client.0.smithi084.stdout:2/207: truncate d3/d5/d1a/d2d/f38 784228 0 2024-02-15T18:26:59.642 INFO:tasks.workunit.client.0.smithi084.stdout:2/208: dread - d3/d19/d24/d3e/f3c zero size 2024-02-15T18:26:59.642 INFO:tasks.workunit.client.0.smithi084.stdout:4/182: write d2/d4/f7 [1557181,80560] 0 2024-02-15T18:26:59.642 INFO:tasks.workunit.client.0.smithi084.stdout:4/183: dread - d2/d4/d28/f38 zero size 2024-02-15T18:26:59.643 INFO:tasks.workunit.client.0.smithi084.stdout:4/184: write d2/f11 [1017555,16171] 0 2024-02-15T18:26:59.643 INFO:tasks.workunit.client.0.smithi084.stdout:2/209: getdents d3/d19 0 2024-02-15T18:26:59.644 INFO:tasks.workunit.client.0.smithi084.stdout:4/185: creat d2/d26/f3b x:0 0 0 2024-02-15T18:26:59.644 INFO:tasks.workunit.client.0.smithi084.stdout:2/210: creat d3/d5/d1a/d2d/f4a x:0 0 0 2024-02-15T18:26:59.645 INFO:tasks.workunit.client.0.smithi084.stdout:2/211: chown d3/d5/d1a/d1e/d47 64 1 2024-02-15T18:26:59.646 INFO:tasks.workunit.client.0.smithi084.stdout:2/212: unlink d3/d19/f25 0 2024-02-15T18:26:59.646 INFO:tasks.workunit.client.0.smithi084.stdout:2/213: read d3/d5/d1a/d2d/f38 [282876,49712] 0 2024-02-15T18:26:59.647 INFO:tasks.workunit.client.0.smithi084.stdout:2/214: mkdir d3/d5/d1a/d1e/d4b 0 2024-02-15T18:26:59.648 INFO:tasks.workunit.client.0.smithi084.stdout:2/215: chown d3/d5/d1a/d2d/f4a 117913417 1 2024-02-15T18:26:59.648 INFO:tasks.workunit.client.0.smithi084.stdout:2/216: mknod d3/d19/d36/c4c 0 2024-02-15T18:26:59.648 INFO:tasks.workunit.client.0.smithi084.stdout:2/217: write d3/d5/f21 [1696911,111823] 0 2024-02-15T18:26:59.652 INFO:tasks.workunit.client.0.smithi084.stdout:5/222: dwrite d9/f26 [0,4194304] 0 2024-02-15T18:26:59.654 INFO:tasks.workunit.client.0.smithi084.stdout:5/223: creat d9/d23/f4a x:0 0 0 2024-02-15T18:26:59.665 INFO:tasks.workunit.client.0.smithi084.stdout:9/121: dwrite d4/fb [0,4194304] 0 2024-02-15T18:26:59.665 INFO:tasks.workunit.client.0.smithi084.stdout:9/122: write d4/de/f1f [1027119,97342] 0 2024-02-15T18:26:59.665 INFO:tasks.workunit.client.0.smithi084.stdout:0/178: fsync d0/db/f30 0 2024-02-15T18:26:59.665 INFO:tasks.workunit.client.0.smithi084.stdout:8/207: dwrite db/d1a/f41 [0,4194304] 0 2024-02-15T18:26:59.665 INFO:tasks.workunit.client.0.smithi084.stdout:7/162: dwrite fc [0,4194304] 0 2024-02-15T18:26:59.667 INFO:tasks.workunit.client.0.smithi084.stdout:9/123: unlink d4/de/d15/f18 0 2024-02-15T18:26:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:0/179: symlink d0/d4/d1b/l33 0 2024-02-15T18:26:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:0/180: fdatasync d0/f1a 0 2024-02-15T18:26:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:0/181: chown d0/db/c14 32478722 1 2024-02-15T18:26:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:8/208: creat db/d1c/f48 x:0 0 0 2024-02-15T18:26:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:8/209: dread - db/d1c/f48 zero size 2024-02-15T18:26:59.669 INFO:tasks.workunit.client.0.smithi084.stdout:8/210: write db/f3a [131095,78895] 0 2024-02-15T18:26:59.670 INFO:tasks.workunit.client.0.smithi084.stdout:4/186: dwrite d2/f17 [0,4194304] 0 2024-02-15T18:26:59.670 INFO:tasks.workunit.client.0.smithi084.stdout:4/187: read - d2/f34 zero size 2024-02-15T18:26:59.670 INFO:tasks.workunit.client.0.smithi084.stdout:4/188: chown d2 41571966 1 2024-02-15T18:26:59.671 INFO:tasks.workunit.client.0.smithi084.stdout:4/189: write d2/d4/f20 [568477,49012] 0 2024-02-15T18:26:59.671 INFO:tasks.workunit.client.0.smithi084.stdout:4/190: truncate d2/d4/f1c 669485 0 2024-02-15T18:26:59.671 INFO:tasks.workunit.client.0.smithi084.stdout:4/191: truncate d2/f35 384427 0 2024-02-15T18:26:59.671 INFO:tasks.workunit.client.0.smithi084.stdout:4/192: chown l0 247416760 1 2024-02-15T18:26:59.671 INFO:tasks.workunit.client.0.smithi084.stdout:4/193: fsync d2/fc 0 2024-02-15T18:26:59.678 INFO:tasks.workunit.client.0.smithi084.stdout:9/124: dread d4/fb [0,4194304] 0 2024-02-15T18:26:59.678 INFO:tasks.workunit.client.0.smithi084.stdout:9/125: chown d4/c1e 4416098 1 2024-02-15T18:26:59.678 INFO:tasks.workunit.client.0.smithi084.stdout:9/126: chown d4/de/f13 52207 1 2024-02-15T18:26:59.678 INFO:tasks.workunit.client.0.smithi084.stdout:9/127: stat d4/de/d15/d1a/f23 0 2024-02-15T18:26:59.678 INFO:tasks.workunit.client.0.smithi084.stdout:9/128: write d4/f5 [429028,38580] 0 2024-02-15T18:26:59.684 INFO:tasks.workunit.client.0.smithi084.stdout:7/163: symlink df/l30 0 2024-02-15T18:26:59.684 INFO:tasks.workunit.client.0.smithi084.stdout:7/164: stat f7 0 2024-02-15T18:26:59.684 INFO:tasks.workunit.client.0.smithi084.stdout:7/165: read df/d1d/d1a/f26 [225757,47590] 0 2024-02-15T18:26:59.685 INFO:tasks.workunit.client.0.smithi084.stdout:0/182: creat d0/d25/f34 x:0 0 0 2024-02-15T18:26:59.686 INFO:tasks.workunit.client.0.smithi084.stdout:0/183: write d0/db/f30 [5163651,70868] 0 2024-02-15T18:26:59.686 INFO:tasks.workunit.client.0.smithi084.stdout:0/184: chown d0/d4/c18 1 1 2024-02-15T18:26:59.686 INFO:tasks.workunit.client.0.smithi084.stdout:7/166: dread df/d1d/f18 [0,4194304] 0 2024-02-15T18:26:59.686 INFO:tasks.workunit.client.0.smithi084.stdout:7/167: write df/f1b [2346914,79267] 0 2024-02-15T18:26:59.687 INFO:tasks.workunit.client.0.smithi084.stdout:0/185: write d0/f1a [70664,72880] 0 2024-02-15T18:26:59.687 INFO:tasks.workunit.client.0.smithi084.stdout:0/186: chown d0/d25/f2a 443173 1 2024-02-15T18:26:59.689 INFO:tasks.workunit.client.0.smithi084.stdout:4/194: getdents d2/d4/d25 0 2024-02-15T18:26:59.689 INFO:tasks.workunit.client.0.smithi084.stdout:4/195: truncate d2/f11 1134228 0 2024-02-15T18:26:59.691 INFO:tasks.workunit.client.0.smithi084.stdout:7/168: symlink df/d1d/d23/l31 0 2024-02-15T18:26:59.696 INFO:tasks.workunit.client.0.smithi084.stdout:9/129: dwrite d4/f6 [0,4194304] 0 2024-02-15T18:26:59.697 INFO:tasks.workunit.client.0.smithi084.stdout:9/130: fsync d4/de/f14 0 2024-02-15T18:26:59.697 INFO:tasks.workunit.client.0.smithi084.stdout:3/151: sync 2024-02-15T18:26:59.697 INFO:tasks.workunit.client.0.smithi084.stdout:1/169: sync 2024-02-15T18:26:59.698 INFO:tasks.workunit.client.0.smithi084.stdout:8/211: dwrite fa [0,4194304] 0 2024-02-15T18:26:59.699 INFO:tasks.workunit.client.0.smithi084.stdout:8/212: write db/d1a/d2b/f37 [5630762,124065] 0 2024-02-15T18:26:59.700 INFO:tasks.workunit.client.0.smithi084.stdout:9/131: link d4/de/f1f d4/de/d15/f28 0 2024-02-15T18:26:59.704 INFO:tasks.workunit.client.0.smithi084.stdout:9/132: unlink d4/f5 0 2024-02-15T18:26:59.704 INFO:tasks.workunit.client.0.smithi084.stdout:9/133: write d4/de/d15/d1a/f22 [689854,58421] 0 2024-02-15T18:26:59.705 INFO:tasks.workunit.client.0.smithi084.stdout:9/134: creat d4/f29 x:0 0 0 2024-02-15T18:26:59.707 INFO:tasks.workunit.client.0.smithi084.stdout:0/187: dread d0/f1a [0,4194304] 0 2024-02-15T18:26:59.707 INFO:tasks.workunit.client.0.smithi084.stdout:9/135: creat d4/de/d15/d1a/d24/f2a x:0 0 0 2024-02-15T18:26:59.708 INFO:tasks.workunit.client.0.smithi084.stdout:8/213: dread db/d1c/f2c [0,4194304] 0 2024-02-15T18:26:59.708 INFO:tasks.workunit.client.0.smithi084.stdout:1/170: dread d9/f14 [4194304,4194304] 0 2024-02-15T18:26:59.708 INFO:tasks.workunit.client.0.smithi084.stdout:1/171: write d9/dd/d12/d16/f23 [833128,130585] 0 2024-02-15T18:26:59.710 INFO:tasks.workunit.client.0.smithi084.stdout:0/188: rename d0/db/c1c to d0/d4/d1b/c35 0 2024-02-15T18:26:59.710 INFO:tasks.workunit.client.0.smithi084.stdout:9/136: mkdir d4/d2b 0 2024-02-15T18:26:59.711 INFO:tasks.workunit.client.0.smithi084.stdout:1/172: symlink d9/dd/d12/d1b/d2c/l34 0 2024-02-15T18:26:59.711 INFO:tasks.workunit.client.0.smithi084.stdout:1/173: readlink d9/lf 0 2024-02-15T18:26:59.712 INFO:tasks.workunit.client.0.smithi084.stdout:0/189: mknod d0/db/c36 0 2024-02-15T18:26:59.712 INFO:tasks.workunit.client.0.smithi084.stdout:8/214: write db/fe [6222194,93051] 0 2024-02-15T18:26:59.712 INFO:tasks.workunit.client.0.smithi084.stdout:8/215: dread - db/d1a/d2b/f45 zero size 2024-02-15T18:26:59.712 INFO:tasks.workunit.client.0.smithi084.stdout:8/216: chown db/dd/d13/l30 67 1 2024-02-15T18:26:59.712 INFO:tasks.workunit.client.0.smithi084.stdout:8/217: write db/d1a/d2b/f31 [298095,127490] 0 2024-02-15T18:26:59.713 INFO:tasks.workunit.client.0.smithi084.stdout:9/137: mknod d4/de/c2c 0 2024-02-15T18:26:59.713 INFO:tasks.workunit.client.0.smithi084.stdout:7/169: dwrite df/d1d/d1a/f28 [0,4194304] 0 2024-02-15T18:26:59.714 INFO:tasks.workunit.client.0.smithi084.stdout:7/170: dread - fb zero size 2024-02-15T18:26:59.714 INFO:tasks.workunit.client.0.smithi084.stdout:7/171: fdatasync fb 0 2024-02-15T18:26:59.714 INFO:tasks.workunit.client.0.smithi084.stdout:7/172: truncate df/d1d/d1a/f24 668487 0 2024-02-15T18:26:59.714 INFO:tasks.workunit.client.0.smithi084.stdout:0/190: creat d0/f37 x:0 0 0 2024-02-15T18:26:59.715 INFO:tasks.workunit.client.0.smithi084.stdout:0/191: write d0/d25/f34 [125292,111130] 0 2024-02-15T18:26:59.715 INFO:tasks.workunit.client.0.smithi084.stdout:0/192: truncate d0/f1a 4722513 0 2024-02-15T18:26:59.718 INFO:tasks.workunit.client.0.smithi084.stdout:7/173: dread f4 [0,4194304] 0 2024-02-15T18:26:59.719 INFO:tasks.workunit.client.0.smithi084.stdout:4/196: dwrite d2/d4/f20 [0,4194304] 0 2024-02-15T18:26:59.728 INFO:tasks.workunit.client.0.smithi084.stdout:9/138: symlink d4/de/d15/l2d 0 2024-02-15T18:26:59.730 INFO:tasks.workunit.client.0.smithi084.stdout:0/193: symlink d0/d2f/l38 0 2024-02-15T18:26:59.731 INFO:tasks.workunit.client.0.smithi084.stdout:8/218: truncate db/d1a/d2b/f37 1777005 0 2024-02-15T18:26:59.731 INFO:tasks.workunit.client.0.smithi084.stdout:8/219: chown db/dd/l15 309 1 2024-02-15T18:26:59.732 INFO:tasks.workunit.client.0.smithi084.stdout:7/174: creat df/f32 x:0 0 0 2024-02-15T18:26:59.732 INFO:tasks.workunit.client.0.smithi084.stdout:7/175: truncate fb 726801 0 2024-02-15T18:26:59.733 INFO:tasks.workunit.client.0.smithi084.stdout:9/139: creat d4/de/d15/d1a/f2e x:0 0 0 2024-02-15T18:26:59.734 INFO:tasks.workunit.client.0.smithi084.stdout:0/194: mkdir d0/d39 0 2024-02-15T18:26:59.734 INFO:tasks.workunit.client.0.smithi084.stdout:8/220: creat db/d1a/f49 x:0 0 0 2024-02-15T18:26:59.737 INFO:tasks.workunit.client.0.smithi084.stdout:9/140: rename d4/f27 to d4/d2b/f2f 0 2024-02-15T18:26:59.737 INFO:tasks.workunit.client.0.smithi084.stdout:9/141: dread - d4/de/f1c zero size 2024-02-15T18:26:59.738 INFO:tasks.workunit.client.0.smithi084.stdout:0/195: unlink d0/d4/d1b/c29 0 2024-02-15T18:26:59.738 INFO:tasks.workunit.client.0.smithi084.stdout:8/221: symlink db/d1a/l4a 0 2024-02-15T18:26:59.740 INFO:tasks.workunit.client.0.smithi084.stdout:9/142: symlink d4/de/l30 0 2024-02-15T18:26:59.740 INFO:tasks.workunit.client.0.smithi084.stdout:8/222: creat db/d1a/d2b/f4b x:0 0 0 2024-02-15T18:26:59.740 INFO:tasks.workunit.client.0.smithi084.stdout:8/223: fdatasync db/dd/d1f/f23 0 2024-02-15T18:26:59.742 INFO:tasks.workunit.client.0.smithi084.stdout:8/224: rename db/c35 to db/d1a/d2b/c4c 0 2024-02-15T18:26:59.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/143: write d4/de/f13 [2601343,48483] 0 2024-02-15T18:26:59.742 INFO:tasks.workunit.client.0.smithi084.stdout:8/225: truncate db/d1a/d2b/f4b 1023920 0 2024-02-15T18:26:59.742 INFO:tasks.workunit.client.0.smithi084.stdout:4/197: dwrite d2/d4/f19 [0,4194304] 0 2024-02-15T18:26:59.743 INFO:tasks.workunit.client.0.smithi084.stdout:1/174: dwrite d9/f14 [0,4194304] 0 2024-02-15T18:26:59.743 INFO:tasks.workunit.client.0.smithi084.stdout:0/196: fsync d0/d25/f34 0 2024-02-15T18:26:59.744 INFO:tasks.workunit.client.0.smithi084.stdout:4/198: write d2/d4/fd [2541573,79068] 0 2024-02-15T18:26:59.744 INFO:tasks.workunit.client.0.smithi084.stdout:4/199: stat d2/d4/d28/d2e 0 2024-02-15T18:26:59.746 INFO:tasks.workunit.client.0.smithi084.stdout:8/226: mkdir db/dd/d4d 0 2024-02-15T18:26:59.746 INFO:tasks.workunit.client.0.smithi084.stdout:8/227: truncate db/f3a 1205513 0 2024-02-15T18:26:59.746 INFO:tasks.workunit.client.0.smithi084.stdout:8/228: truncate db/d1a/f1d 4233376 0 2024-02-15T18:26:59.750 INFO:tasks.workunit.client.0.smithi084.stdout:7/176: rmdir df 39 2024-02-15T18:26:59.751 INFO:tasks.workunit.client.0.smithi084.stdout:9/144: getdents d4/de/d15/d1a 0 2024-02-15T18:26:59.752 INFO:tasks.workunit.client.0.smithi084.stdout:1/175: dread d9/dd/f13 [0,4194304] 0 2024-02-15T18:26:59.758 INFO:tasks.workunit.client.0.smithi084.stdout:4/200: rename d2/d4/f23 to d2/d26/f3c 0 2024-02-15T18:26:59.760 INFO:tasks.workunit.client.0.smithi084.stdout:8/229: mknod db/d1c/c4e 0 2024-02-15T18:26:59.760 INFO:tasks.workunit.client.0.smithi084.stdout:8/230: fsync db/dd/d1f/f38 0 2024-02-15T18:26:59.763 INFO:tasks.workunit.client.0.smithi084.stdout:1/176: mkdir d9/dd/d12/d1b/d2c/d35 0 2024-02-15T18:26:59.763 INFO:tasks.workunit.client.0.smithi084.stdout:1/177: truncate d9/dd/d12/d1b/d2c/f31 845911 0 2024-02-15T18:26:59.765 INFO:tasks.workunit.client.0.smithi084.stdout:8/231: dread db/d1c/f2c [0,4194304] 0 2024-02-15T18:26:59.765 INFO:tasks.workunit.client.0.smithi084.stdout:7/177: rename df/l30 to df/d1d/d23/l33 0 2024-02-15T18:26:59.768 INFO:tasks.workunit.client.0.smithi084.stdout:7/178: dread df/d1d/f1f [0,4194304] 0 2024-02-15T18:26:59.769 INFO:tasks.workunit.client.0.smithi084.stdout:1/178: mkdir d9/dd/d36 0 2024-02-15T18:26:59.771 INFO:tasks.workunit.client.0.smithi084.stdout:0/197: dwrite d0/d4/d1b/d26/f2d [0,4194304] 0 2024-02-15T18:26:59.771 INFO:tasks.workunit.client.0.smithi084.stdout:0/198: fsync d0/d25/f2a 0 2024-02-15T18:26:59.771 INFO:tasks.workunit.client.0.smithi084.stdout:6/167: sync 2024-02-15T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:5/224: sync 2024-02-15T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:2/218: sync 2024-02-15T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:3/152: sync 2024-02-15T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:3/153: readlink d8/l18 0 2024-02-15T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:5/225: chown d9/da/l24 126 1 2024-02-15T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:2/219: truncate d3/d19/d36/f39 546595 0 2024-02-15T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:5/226: chown d9/d23/f37 120 1 2024-02-15T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:5/227: fdatasync d9/f2c 0 2024-02-15T18:26:59.772 INFO:tasks.workunit.client.0.smithi084.stdout:7/179: rmdir df/d1d/d23 39 2024-02-15T18:26:59.773 INFO:tasks.workunit.client.0.smithi084.stdout:1/179: mknod d9/c37 0 2024-02-15T18:26:59.777 INFO:tasks.workunit.client.0.smithi084.stdout:9/145: dwrite d4/d2b/f2f [0,4194304] 0 2024-02-15T18:26:59.777 INFO:tasks.workunit.client.0.smithi084.stdout:9/146: chown d4/de/d15/d1a 146 1 2024-02-15T18:26:59.777 INFO:tasks.workunit.client.0.smithi084.stdout:5/228: mknod d9/c4b 0 2024-02-15T18:26:59.777 INFO:tasks.workunit.client.0.smithi084.stdout:5/229: write d9/da/f38 [1015249,123943] 0 2024-02-15T18:26:59.777 INFO:tasks.workunit.client.0.smithi084.stdout:1/180: write d9/dd/f2f [381366,25652] 0 2024-02-15T18:26:59.778 INFO:tasks.workunit.client.0.smithi084.stdout:0/199: mkdir d0/d4/d3a 0 2024-02-15T18:26:59.782 INFO:tasks.workunit.client.0.smithi084.stdout:9/147: mknod d4/de/c31 0 2024-02-15T18:26:59.783 INFO:tasks.workunit.client.0.smithi084.stdout:7/180: dread df/d1d/d1a/f28 [0,4194304] 0 2024-02-15T18:26:59.787 INFO:tasks.workunit.client.0.smithi084.stdout:5/230: creat d9/f4c x:0 0 0 2024-02-15T18:26:59.788 INFO:tasks.workunit.client.0.smithi084.stdout:8/232: dread db/d1a/f41 [0,4194304] 0 2024-02-15T18:26:59.788 INFO:tasks.workunit.client.0.smithi084.stdout:8/233: chown db/d1a/f22 124 1 2024-02-15T18:26:59.788 INFO:tasks.workunit.client.0.smithi084.stdout:8/234: chown db/d1a/d2b/c4c 364508 1 2024-02-15T18:26:59.791 INFO:tasks.workunit.client.0.smithi084.stdout:1/181: mkdir d9/dd/d12/d1b/d38 0 2024-02-15T18:26:59.792 INFO:tasks.workunit.client.0.smithi084.stdout:0/200: mknod d0/d4/c3b 0 2024-02-15T18:26:59.794 INFO:tasks.workunit.client.0.smithi084.stdout:7/181: link f5 df/d1d/d23/f34 0 2024-02-15T18:26:59.794 INFO:tasks.workunit.client.0.smithi084.stdout:7/182: fdatasync f0 0 2024-02-15T18:26:59.795 INFO:tasks.workunit.client.0.smithi084.stdout:8/235: symlink db/d1c/l4f 0 2024-02-15T18:26:59.795 INFO:tasks.workunit.client.0.smithi084.stdout:8/236: fdatasync db/dd/d1f/d3e/f43 0 2024-02-15T18:26:59.798 INFO:tasks.workunit.client.0.smithi084.stdout:1/182: rename d9/dd/d12/d16 to d9/dd/d39 0 2024-02-15T18:26:59.798 INFO:tasks.workunit.client.0.smithi084.stdout:1/183: fdatasync d9/f14 0 2024-02-15T18:26:59.799 INFO:tasks.workunit.client.0.smithi084.stdout:8/237: mknod db/dd/c50 0 2024-02-15T18:26:59.799 INFO:tasks.workunit.client.0.smithi084.stdout:8/238: chown db/dd/d13/c32 12447586 1 2024-02-15T18:26:59.800 INFO:tasks.workunit.client.0.smithi084.stdout:1/184: symlink d9/l3a 0 2024-02-15T18:26:59.800 INFO:tasks.workunit.client.0.smithi084.stdout:3/154: dwrite d8/f1b [0,4194304] 0 2024-02-15T18:26:59.800 INFO:tasks.workunit.client.0.smithi084.stdout:2/220: dwrite d3/fc [0,4194304] 0 2024-02-15T18:26:59.801 INFO:tasks.workunit.client.0.smithi084.stdout:6/168: dread f9 [0,4194304] 0 2024-02-15T18:26:59.803 INFO:tasks.workunit.client.0.smithi084.stdout:8/239: creat db/d1a/d2b/f51 x:0 0 0 2024-02-15T18:26:59.805 INFO:tasks.workunit.client.0.smithi084.stdout:3/155: dread d8/d1f/d28/f2b [0,4194304] 0 2024-02-15T18:26:59.805 INFO:tasks.workunit.client.0.smithi084.stdout:1/185: creat d9/dd/d12/d32/f3b x:0 0 0 2024-02-15T18:26:59.807 INFO:tasks.workunit.client.0.smithi084.stdout:2/221: rmdir d3/d5/d1a/d1e/d30 39 2024-02-15T18:26:59.807 INFO:tasks.workunit.client.0.smithi084.stdout:9/148: dwrite f1 [0,4194304] 0 2024-02-15T18:26:59.807 INFO:tasks.workunit.client.0.smithi084.stdout:1/186: write d9/f14 [6199955,91193] 0 2024-02-15T18:26:59.807 INFO:tasks.workunit.client.0.smithi084.stdout:1/187: truncate d9/dd/d12/d32/f3b 588698 0 2024-02-15T18:26:59.808 INFO:tasks.workunit.client.0.smithi084.stdout:6/169: creat d14/d22/d25/d2f/d31/f36 x:0 0 0 2024-02-15T18:26:59.809 INFO:tasks.workunit.client.0.smithi084.stdout:8/240: mknod db/dd/d4d/c52 0 2024-02-15T18:26:59.810 INFO:tasks.workunit.client.0.smithi084.stdout:3/156: symlink d8/d1f/d25/l30 0 2024-02-15T18:26:59.811 INFO:tasks.workunit.client.0.smithi084.stdout:7/183: dread df/d1d/d1a/f24 [0,4194304] 0 2024-02-15T18:26:59.812 INFO:tasks.workunit.client.0.smithi084.stdout:8/241: dread db/f3a [0,4194304] 0 2024-02-15T18:26:59.816 INFO:tasks.workunit.client.0.smithi084.stdout:2/222: symlink d3/l4d 0 2024-02-15T18:26:59.816 INFO:tasks.workunit.client.0.smithi084.stdout:9/149: dread d4/de/f13 [0,4194304] 0 2024-02-15T18:26:59.816 INFO:tasks.workunit.client.0.smithi084.stdout:9/150: truncate d4/f29 83174 0 2024-02-15T18:26:59.818 INFO:tasks.workunit.client.0.smithi084.stdout:7/184: creat df/f35 x:0 0 0 2024-02-15T18:26:59.818 INFO:tasks.workunit.client.0.smithi084.stdout:8/242: link db/dd/d13/c32 db/d3f/c53 0 2024-02-15T18:26:59.820 INFO:tasks.workunit.client.0.smithi084.stdout:2/223: rename d3/d5/d1a/f3f to d3/d5/d1a/f4e 0 2024-02-15T18:26:59.820 INFO:tasks.workunit.client.0.smithi084.stdout:2/224: dread - d3/d5/f35 zero size 2024-02-15T18:26:59.823 INFO:tasks.workunit.client.0.smithi084.stdout:8/243: link db/d1a/f22 db/d3f/f54 0 2024-02-15T18:26:59.823 INFO:tasks.workunit.client.0.smithi084.stdout:8/244: chown db/d1c/l4f 121 1 2024-02-15T18:26:59.823 INFO:tasks.workunit.client.0.smithi084.stdout:8/245: write db/d1a/f49 [207481,32674] 0 2024-02-15T18:26:59.824 INFO:tasks.workunit.client.0.smithi084.stdout:5/231: dwrite d9/f1e [0,4194304] 0 2024-02-15T18:26:59.824 INFO:tasks.workunit.client.0.smithi084.stdout:5/232: chown d9/cc 16073 1 2024-02-15T18:26:59.824 INFO:tasks.workunit.client.0.smithi084.stdout:7/185: rename df/d1d/d23/c2e to df/d1d/d23/c36 0 2024-02-15T18:26:59.825 INFO:tasks.workunit.client.0.smithi084.stdout:9/151: write d4/fb [2124024,67793] 0 2024-02-15T18:26:59.826 INFO:tasks.workunit.client.0.smithi084.stdout:8/246: creat db/dd/d4d/f55 x:0 0 0 2024-02-15T18:26:59.827 INFO:tasks.workunit.client.0.smithi084.stdout:7/186: unlink df/d1d/f1f 0 2024-02-15T18:26:59.828 INFO:tasks.workunit.client.0.smithi084.stdout:7/187: write f5 [2491698,71044] 0 2024-02-15T18:26:59.833 INFO:tasks.workunit.client.0.smithi084.stdout:6/170: rmdir d14 39 2024-02-15T18:26:59.834 INFO:tasks.workunit.client.0.smithi084.stdout:7/188: write f5 [1547020,119553] 0 2024-02-15T18:26:59.835 INFO:tasks.workunit.client.0.smithi084.stdout:7/189: write df/f1b [633510,17236] 0 2024-02-15T18:26:59.835 INFO:tasks.workunit.client.0.smithi084.stdout:6/171: mknod d14/d22/d25/d28/c37 0 2024-02-15T18:26:59.836 INFO:tasks.workunit.client.0.smithi084.stdout:6/172: fdatasync d14/d22/d25/d2f/d31/f27 0 2024-02-15T18:26:59.836 INFO:tasks.workunit.client.0.smithi084.stdout:6/173: chown f10 1250536 1 2024-02-15T18:26:59.836 INFO:tasks.workunit.client.0.smithi084.stdout:2/225: dread d3/f14 [0,4194304] 0 2024-02-15T18:26:59.836 INFO:tasks.workunit.client.0.smithi084.stdout:2/226: write d3/d5/d1a/d2d/f38 [684865,31193] 0 2024-02-15T18:26:59.837 INFO:tasks.workunit.client.0.smithi084.stdout:7/190: rename fa to df/d1d/d23/f37 0 2024-02-15T18:26:59.839 INFO:tasks.workunit.client.0.smithi084.stdout:7/191: mknod df/d1d/d1a/c38 0 2024-02-15T18:26:59.840 INFO:tasks.workunit.client.0.smithi084.stdout:6/174: rename d14/d22/d25/d28/f29 to d14/f38 0 2024-02-15T18:26:59.840 INFO:tasks.workunit.client.0.smithi084.stdout:6/175: dread - d14/d22/d25/f35 zero size 2024-02-15T18:26:59.841 INFO:tasks.workunit.client.0.smithi084.stdout:7/192: unlink df/c11 0 2024-02-15T18:26:59.842 INFO:tasks.workunit.client.0.smithi084.stdout:6/176: rmdir d14/d22/d25/d2f/d31 39 2024-02-15T18:26:59.843 INFO:tasks.workunit.client.0.smithi084.stdout:0/201: dwrite d0/d25/f34 [0,4194304] 0 2024-02-15T18:26:59.843 INFO:tasks.workunit.client.0.smithi084.stdout:0/202: stat d0/d25/f2a 0 2024-02-15T18:26:59.847 INFO:tasks.workunit.client.0.smithi084.stdout:7/193: write df/d1d/d23/f34 [1429907,51100] 0 2024-02-15T18:26:59.847 INFO:tasks.workunit.client.0.smithi084.stdout:7/194: write df/d1d/d23/f34 [1439980,76818] 0 2024-02-15T18:26:59.849 INFO:tasks.workunit.client.0.smithi084.stdout:0/203: creat d0/d4/d1b/f3c x:0 0 0 2024-02-15T18:26:59.855 INFO:tasks.workunit.client.0.smithi084.stdout:0/204: dread d0/d4/d1b/d26/f2e [0,4194304] 0 2024-02-15T18:26:59.857 INFO:tasks.workunit.client.0.smithi084.stdout:3/157: dwrite d8/d1f/f20 [0,4194304] 0 2024-02-15T18:26:59.857 INFO:tasks.workunit.client.0.smithi084.stdout:0/205: mknod d0/d1e/c3d 0 2024-02-15T18:26:59.860 INFO:tasks.workunit.client.0.smithi084.stdout:0/206: creat d0/d4/d1b/f3e x:0 0 0 2024-02-15T18:26:59.860 INFO:tasks.workunit.client.0.smithi084.stdout:0/207: dread - d0/f37 zero size 2024-02-15T18:26:59.861 INFO:tasks.workunit.client.0.smithi084.stdout:0/208: unlink d0/d4/c2b 0 2024-02-15T18:26:59.863 INFO:tasks.workunit.client.0.smithi084.stdout:3/158: rmdir d8/d1f/d2c 0 2024-02-15T18:26:59.864 INFO:tasks.workunit.client.0.smithi084.stdout:1/188: dwrite d9/dd/f13 [0,4194304] 0 2024-02-15T18:26:59.866 INFO:tasks.workunit.client.0.smithi084.stdout:0/209: rename d0/db to d0/d2f/d3f 0 2024-02-15T18:26:59.867 INFO:tasks.workunit.client.0.smithi084.stdout:3/159: mknod d8/d1f/d2d/c31 0 2024-02-15T18:26:59.867 INFO:tasks.workunit.client.0.smithi084.stdout:3/160: readlink d8/lf 0 2024-02-15T18:26:59.868 INFO:tasks.workunit.client.0.smithi084.stdout:1/189: rmdir d9/dd/d12/d33 0 2024-02-15T18:26:59.872 INFO:tasks.workunit.client.0.smithi084.stdout:0/210: creat d0/d4/d1b/f40 x:0 0 0 2024-02-15T18:26:59.872 INFO:tasks.workunit.client.0.smithi084.stdout:3/161: symlink d8/d1f/d2d/l32 0 2024-02-15T18:26:59.872 INFO:tasks.workunit.client.0.smithi084.stdout:0/211: chown d0/d2f/d3f/c14 233 1 2024-02-15T18:26:59.872 INFO:tasks.workunit.client.0.smithi084.stdout:1/190: symlink d9/dd/d12/d1b/d38/l3c 0 2024-02-15T18:26:59.873 INFO:tasks.workunit.client.0.smithi084.stdout:3/162: mknod d8/d1f/d2d/c33 0 2024-02-15T18:26:59.878 INFO:tasks.workunit.client.0.smithi084.stdout:5/233: dwrite d9/da/f1b [0,4194304] 0 2024-02-15T18:26:59.878 INFO:tasks.workunit.client.0.smithi084.stdout:8/247: dwrite db/dd/f14 [4194304,4194304] 0 2024-02-15T18:26:59.878 INFO:tasks.workunit.client.0.smithi084.stdout:8/248: fsync db/f25 0 2024-02-15T18:26:59.879 INFO:tasks.workunit.client.0.smithi084.stdout:9/152: dwrite d4/f19 [0,4194304] 0 2024-02-15T18:26:59.879 INFO:tasks.workunit.client.0.smithi084.stdout:2/227: dwrite d3/d19/d36/f40 [0,4194304] 0 2024-02-15T18:26:59.881 INFO:tasks.workunit.client.0.smithi084.stdout:3/163: dread d8/f21 [0,4194304] 0 2024-02-15T18:26:59.883 INFO:tasks.workunit.client.0.smithi084.stdout:3/164: dread d8/d22/f24 [4194304,4194304] 0 2024-02-15T18:26:59.886 INFO:tasks.workunit.client.0.smithi084.stdout:5/234: link d9/d23/l39 d9/da/d3d/d44/l4d 0 2024-02-15T18:26:59.886 INFO:tasks.workunit.client.0.smithi084.stdout:8/249: mkdir db/dd/d1f/d56 0 2024-02-15T18:26:59.887 INFO:tasks.workunit.client.0.smithi084.stdout:8/250: read - db/f25 zero size 2024-02-15T18:26:59.891 INFO:tasks.workunit.client.0.smithi084.stdout:2/228: link d3/c9 d3/d5/d1a/d1e/c4f 0 2024-02-15T18:26:59.891 INFO:tasks.workunit.client.0.smithi084.stdout:6/177: dwrite d14/f2d [0,4194304] 0 2024-02-15T18:26:59.894 INFO:tasks.workunit.client.0.smithi084.stdout:5/235: dread d9/da/f18 [0,4194304] 0 2024-02-15T18:26:59.895 INFO:tasks.workunit.client.0.smithi084.stdout:3/165: creat d8/d22/f34 x:0 0 0 2024-02-15T18:26:59.901 INFO:tasks.workunit.client.0.smithi084.stdout:8/251: mknod db/d1a/d2b/c57 0 2024-02-15T18:26:59.901 INFO:tasks.workunit.client.0.smithi084.stdout:2/229: chown d3/d19/d24/f2f 24 1 2024-02-15T18:26:59.901 INFO:tasks.workunit.client.0.smithi084.stdout:6/178: symlink d14/l39 0 2024-02-15T18:26:59.901 INFO:tasks.workunit.client.0.smithi084.stdout:2/230: chown d3/d19/l1c 3 1 2024-02-15T18:26:59.901 INFO:tasks.workunit.client.0.smithi084.stdout:6/179: chown d14/l26 33464 1 2024-02-15T18:26:59.902 INFO:tasks.workunit.client.0.smithi084.stdout:6/180: dread d14/d22/d25/d28/f2a [0,4194304] 0 2024-02-15T18:26:59.904 INFO:tasks.workunit.client.0.smithi084.stdout:3/166: symlink d8/d1f/d28/l35 0 2024-02-15T18:26:59.904 INFO:tasks.workunit.client.0.smithi084.stdout:3/167: truncate d8/d1f/f20 5104894 0 2024-02-15T18:26:59.909 INFO:tasks.workunit.client.0.smithi084.stdout:8/252: rename l0 to db/l58 0 2024-02-15T18:26:59.909 INFO:tasks.workunit.client.0.smithi084.stdout:4/201: sync 2024-02-15T18:26:59.909 INFO:tasks.workunit.client.0.smithi084.stdout:4/202: dread - d2/f2d zero size 2024-02-15T18:26:59.909 INFO:tasks.workunit.client.0.smithi084.stdout:2/231: stat d3/d28/l31 0 2024-02-15T18:26:59.909 INFO:tasks.workunit.client.0.smithi084.stdout:6/181: getdents d14/d22/d25/d2f 0 2024-02-15T18:26:59.912 INFO:tasks.workunit.client.0.smithi084.stdout:8/253: rename db/d1c to db/d3f/d59 0 2024-02-15T18:26:59.913 INFO:tasks.workunit.client.0.smithi084.stdout:4/203: mkdir d2/d4/d28/d3d 0 2024-02-15T18:26:59.913 INFO:tasks.workunit.client.0.smithi084.stdout:4/204: chown d2/c1a 6 1 2024-02-15T18:26:59.913 INFO:tasks.workunit.client.0.smithi084.stdout:4/205: chown d2/f11 205438 1 2024-02-15T18:26:59.915 INFO:tasks.workunit.client.0.smithi084.stdout:8/254: creat db/dd/f5a x:0 0 0 2024-02-15T18:26:59.916 INFO:tasks.workunit.client.0.smithi084.stdout:1/191: dwrite d9/dd/d12/d1b/d2c/f31 [0,4194304] 0 2024-02-15T18:26:59.920 INFO:tasks.workunit.client.0.smithi084.stdout:1/192: unlink d9/dd/d12/d1b/d2c/l34 0 2024-02-15T18:26:59.920 INFO:tasks.workunit.client.0.smithi084.stdout:5/236: dwrite d9/da/f38 [0,4194304] 0 2024-02-15T18:26:59.923 INFO:tasks.workunit.client.0.smithi084.stdout:1/193: symlink d9/dd/d12/d32/l3d 0 2024-02-15T18:26:59.923 INFO:tasks.workunit.client.0.smithi084.stdout:1/194: write d9/dd/d39/f23 [911081,93370] 0 2024-02-15T18:26:59.926 INFO:tasks.workunit.client.0.smithi084.stdout:5/237: mknod d9/da/d3d/d44/c4e 0 2024-02-15T18:26:59.928 INFO:tasks.workunit.client.0.smithi084.stdout:9/153: dwrite d4/f19 [0,4194304] 0 2024-02-15T18:26:59.928 INFO:tasks.workunit.client.0.smithi084.stdout:5/238: creat d9/da/d3d/f4f x:0 0 0 2024-02-15T18:26:59.930 INFO:tasks.workunit.client.0.smithi084.stdout:9/154: mknod d4/de/d15/d1a/c32 0 2024-02-15T18:26:59.932 INFO:tasks.workunit.client.0.smithi084.stdout:5/239: creat d9/da/d3d/f50 x:0 0 0 2024-02-15T18:26:59.932 INFO:tasks.workunit.client.0.smithi084.stdout:3/168: dwrite d8/fc [4194304,4194304] 0 2024-02-15T18:26:59.934 INFO:tasks.workunit.client.0.smithi084.stdout:6/182: dread d14/f2d [0,4194304] 0 2024-02-15T18:26:59.934 INFO:tasks.workunit.client.0.smithi084.stdout:0/212: dwrite d0/d4/d1b/f3c [0,4194304] 0 2024-02-15T18:26:59.935 INFO:tasks.workunit.client.0.smithi084.stdout:9/155: unlink d4/fb 0 2024-02-15T18:26:59.939 INFO:tasks.workunit.client.0.smithi084.stdout:3/169: getdents d8 0 2024-02-15T18:26:59.940 INFO:tasks.workunit.client.0.smithi084.stdout:2/232: dwrite d3/d19/d24/f44 [0,4194304] 0 2024-02-15T18:26:59.940 INFO:tasks.workunit.client.0.smithi084.stdout:8/255: dwrite db/dd/d1f/d3e/f43 [0,4194304] 0 2024-02-15T18:26:59.942 INFO:tasks.workunit.client.0.smithi084.stdout:6/183: dread fc [0,4194304] 0 2024-02-15T18:26:59.950 INFO:tasks.workunit.client.0.smithi084.stdout:9/156: mkdir d4/de/d15/d33 0 2024-02-15T18:26:59.953 INFO:tasks.workunit.client.0.smithi084.stdout:3/170: rename d8/l18 to d8/d1f/d25/l36 0 2024-02-15T18:26:59.956 INFO:tasks.workunit.client.0.smithi084.stdout:7/195: sync 2024-02-15T18:26:59.959 INFO:tasks.workunit.client.0.smithi084.stdout:8/256: creat db/dd/d4d/f5b x:0 0 0 2024-02-15T18:26:59.960 INFO:tasks.workunit.client.0.smithi084.stdout:6/184: symlink d14/d22/d25/d2f/l3a 0 2024-02-15T18:26:59.960 INFO:tasks.workunit.client.0.smithi084.stdout:3/171: write d8/f1d [1553691,127687] 0 2024-02-15T18:26:59.962 INFO:tasks.workunit.client.0.smithi084.stdout:7/196: mknod df/d1d/d1a/c39 0 2024-02-15T18:26:59.962 INFO:tasks.workunit.client.0.smithi084.stdout:7/197: read - df/f32 zero size 2024-02-15T18:26:59.962 INFO:tasks.workunit.client.0.smithi084.stdout:7/198: rename df to df/d1d/d23/d3a 22 2024-02-15T18:26:59.962 INFO:tasks.workunit.client.0.smithi084.stdout:7/199: dread - df/f32 zero size 2024-02-15T18:26:59.964 INFO:tasks.workunit.client.0.smithi084.stdout:2/233: dwrite d3/d28/f45 [0,4194304] 0 2024-02-15T18:26:59.973 INFO:tasks.workunit.client.0.smithi084.stdout:2/234: rename d3/f2a to d3/d19/d24/d3e/f50 0 2024-02-15T18:26:59.973 INFO:tasks.workunit.client.0.smithi084.stdout:2/235: write d3/f42 [60245,63568] 0 2024-02-15T18:26:59.982 INFO:tasks.workunit.client.0.smithi084.stdout:8/257: dread db/d1a/f41 [0,4194304] 0 2024-02-15T18:26:59.985 INFO:tasks.workunit.client.0.smithi084.stdout:8/258: dread db/d1a/d2b/f31 [0,4194304] 0 2024-02-15T18:26:59.989 INFO:tasks.workunit.client.0.smithi084.stdout:8/259: write fa [2134008,33068] 0 2024-02-15T18:26:59.990 INFO:tasks.workunit.client.0.smithi084.stdout:8/260: read db/d3f/d59/f2c [2953886,15417] 0 2024-02-15T18:27:00.018 INFO:tasks.workunit.client.0.smithi084.stdout:2/236: dwrite d3/d5/f16 [0,4194304] 0 2024-02-15T18:27:00.018 INFO:tasks.workunit.client.0.smithi084.stdout:6/185: dwrite fb [0,4194304] 0 2024-02-15T18:27:00.018 INFO:tasks.workunit.client.0.smithi084.stdout:2/237: chown d3/d5/d1a/c29 1059119895 1 2024-02-15T18:27:00.020 INFO:tasks.workunit.client.0.smithi084.stdout:7/200: dwrite df/f35 [0,4194304] 0 2024-02-15T18:27:00.020 INFO:tasks.workunit.client.0.smithi084.stdout:7/201: write df/d1d/d1a/f2d [759307,31030] 0 2024-02-15T18:27:00.021 INFO:tasks.workunit.client.0.smithi084.stdout:8/261: dwrite db/d3f/d59/f28 [0,4194304] 0 2024-02-15T18:27:00.021 INFO:tasks.workunit.client.0.smithi084.stdout:3/172: dwrite d8/f1d [0,4194304] 0 2024-02-15T18:27:00.021 INFO:tasks.workunit.client.0.smithi084.stdout:2/238: mknod d3/d5/d1a/d1e/d4b/c51 0 2024-02-15T18:27:00.022 INFO:tasks.workunit.client.0.smithi084.stdout:6/186: link ca d14/d22/c3b 0 2024-02-15T18:27:00.023 INFO:tasks.workunit.client.0.smithi084.stdout:8/262: write db/d1a/f41 [1293239,122467] 0 2024-02-15T18:27:00.027 INFO:tasks.workunit.client.0.smithi084.stdout:7/202: rmdir df/d1d/d23 39 2024-02-15T18:27:00.033 INFO:tasks.workunit.client.0.smithi084.stdout:3/173: read d8/f15 [88359,81473] 0 2024-02-15T18:27:00.033 INFO:tasks.workunit.client.0.smithi084.stdout:6/187: truncate fc 2217883 0 2024-02-15T18:27:00.033 INFO:tasks.workunit.client.0.smithi084.stdout:6/188: chown d14/d22/d25/f2b 88909344 1 2024-02-15T18:27:00.033 INFO:tasks.workunit.client.0.smithi084.stdout:6/189: write d14/d22/d25/d28/f2a [1301610,14438] 0 2024-02-15T18:27:00.035 INFO:tasks.workunit.client.0.smithi084.stdout:8/263: rename db/d1a/f41 to db/dd/d13/f5c 0 2024-02-15T18:27:00.036 INFO:tasks.workunit.client.0.smithi084.stdout:4/206: sync 2024-02-15T18:27:00.036 INFO:tasks.workunit.client.0.smithi084.stdout:4/207: chown d2/fc 3981 1 2024-02-15T18:27:00.037 INFO:tasks.workunit.client.0.smithi084.stdout:7/203: unlink c6 0 2024-02-15T18:27:00.037 INFO:tasks.workunit.client.0.smithi084.stdout:7/204: read df/d1d/d1a/f26 [225385,18862] 0 2024-02-15T18:27:00.038 INFO:tasks.workunit.client.0.smithi084.stdout:8/264: mknod db/d1a/c5d 0 2024-02-15T18:27:00.040 INFO:tasks.workunit.client.0.smithi084.stdout:4/208: rename d2/f2d to d2/d2b/f3e 0 2024-02-15T18:27:00.040 INFO:tasks.workunit.client.0.smithi084.stdout:6/190: dread f10 [0,4194304] 0 2024-02-15T18:27:00.041 INFO:tasks.workunit.client.0.smithi084.stdout:3/174: creat d8/d1f/d2d/f37 x:0 0 0 2024-02-15T18:27:00.042 INFO:tasks.workunit.client.0.smithi084.stdout:7/205: dread f5 [0,4194304] 0 2024-02-15T18:27:00.044 INFO:tasks.workunit.client.0.smithi084.stdout:6/191: creat d14/d22/d25/d2f/f3c x:0 0 0 2024-02-15T18:27:00.044 INFO:tasks.workunit.client.0.smithi084.stdout:3/175: truncate d8/d22/f34 327875 0 2024-02-15T18:27:00.045 INFO:tasks.workunit.client.0.smithi084.stdout:6/192: mknod d14/c3d 0 2024-02-15T18:27:00.046 INFO:tasks.workunit.client.0.smithi084.stdout:3/176: mknod d8/d1f/c38 0 2024-02-15T18:27:00.050 INFO:tasks.workunit.client.0.smithi084.stdout:3/177: unlink d8/d1f/d28/l35 0 2024-02-15T18:27:00.054 INFO:tasks.workunit.client.0.smithi084.stdout:3/178: symlink d8/d1f/d28/l39 0 2024-02-15T18:27:00.055 INFO:tasks.workunit.client.0.smithi084.stdout:3/179: fdatasync d8/d22/f26 0 2024-02-15T18:27:00.056 INFO:tasks.workunit.client.0.smithi084.stdout:3/180: rename d8/d1f/d28/c29 to d8/d1f/c3a 0 2024-02-15T18:27:00.058 INFO:tasks.workunit.client.0.smithi084.stdout:3/181: rmdir d8/d1f/d2d 39 2024-02-15T18:27:00.059 INFO:tasks.workunit.client.0.smithi084.stdout:3/182: creat d8/d1f/f3b x:0 0 0 2024-02-15T18:27:00.060 INFO:tasks.workunit.client.0.smithi084.stdout:8/265: dwrite db/dd/f5a [0,4194304] 0 2024-02-15T18:27:00.065 INFO:tasks.workunit.client.0.smithi084.stdout:7/206: read df/d1d/d23/f34 [1364391,32956] 0 2024-02-15T18:27:00.066 INFO:tasks.workunit.client.0.smithi084.stdout:4/209: dread d2/d4/f19 [0,4194304] 0 2024-02-15T18:27:00.068 INFO:tasks.workunit.client.0.smithi084.stdout:4/210: unlink d2/d2b/l24 0 2024-02-15T18:27:00.068 INFO:tasks.workunit.client.0.smithi084.stdout:3/183: dread d8/fc [4194304,4194304] 0 2024-02-15T18:27:00.071 INFO:tasks.workunit.client.0.smithi084.stdout:3/184: creat d8/d1f/d28/f3c x:0 0 0 2024-02-15T18:27:00.071 INFO:tasks.workunit.client.0.smithi084.stdout:3/185: fdatasync d8/d22/f24 0 2024-02-15T18:27:00.073 INFO:tasks.workunit.client.0.smithi084.stdout:3/186: creat d8/d1f/d2d/f3d x:0 0 0 2024-02-15T18:27:00.081 INFO:tasks.workunit.client.0.smithi084.stdout:3/187: write d8/d1f/f20 [1562064,82972] 0 2024-02-15T18:27:00.083 INFO:tasks.workunit.client.0.smithi084.stdout:3/188: chown d8/c19 2428232 1 2024-02-15T18:27:00.083 INFO:tasks.workunit.client.0.smithi084.stdout:3/189: readlink d8/d1f/d25/l36 0 2024-02-15T18:27:00.083 INFO:tasks.workunit.client.0.smithi084.stdout:3/190: write d8/d22/f34 [302131,61554] 0 2024-02-15T18:27:00.083 INFO:tasks.workunit.client.0.smithi084.stdout:3/191: stat d8/d1f/d28 0 2024-02-15T18:27:00.083 INFO:tasks.workunit.client.0.smithi084.stdout:6/193: dwrite d14/d22/d25/d28/f2a [0,4194304] 0 2024-02-15T18:27:00.084 INFO:tasks.workunit.client.0.smithi084.stdout:3/192: getdents d8 0 2024-02-15T18:27:00.086 INFO:tasks.workunit.client.0.smithi084.stdout:6/194: unlink d14/d22/d25/d2f/d31/l1b 0 2024-02-15T18:27:00.087 INFO:tasks.workunit.client.0.smithi084.stdout:6/195: chown d14/d22/d25 2 1 2024-02-15T18:27:00.087 INFO:tasks.workunit.client.0.smithi084.stdout:3/193: mknod d8/d1f/d28/c3e 0 2024-02-15T18:27:00.088 INFO:tasks.workunit.client.0.smithi084.stdout:6/196: symlink d14/d22/d25/l3e 0 2024-02-15T18:27:00.088 INFO:tasks.workunit.client.0.smithi084.stdout:6/197: chown d14/l18 275243 1 2024-02-15T18:27:00.088 INFO:tasks.workunit.client.0.smithi084.stdout:3/194: symlink d8/d1f/d28/l3f 0 2024-02-15T18:27:00.089 INFO:tasks.workunit.client.0.smithi084.stdout:3/195: truncate d8/d1f/f3b 919355 0 2024-02-15T18:27:00.089 INFO:tasks.workunit.client.0.smithi084.stdout:6/198: mkdir d14/d22/d25/d2f/d31/d3f 0 2024-02-15T18:27:00.090 INFO:tasks.workunit.client.0.smithi084.stdout:3/196: mkdir d8/d40 0 2024-02-15T18:27:00.090 INFO:tasks.workunit.client.0.smithi084.stdout:6/199: write d14/d22/d25/f2b [1333699,34846] 0 2024-02-15T18:27:00.090 INFO:tasks.workunit.client.0.smithi084.stdout:3/197: mknod d8/d1f/d2d/c41 0 2024-02-15T18:27:00.092 INFO:tasks.workunit.client.0.smithi084.stdout:3/198: mknod d8/d1f/d28/c42 0 2024-02-15T18:27:00.093 INFO:tasks.workunit.client.0.smithi084.stdout:6/200: link l2 d14/d22/d25/d2f/d31/d30/l40 0 2024-02-15T18:27:00.093 INFO:tasks.workunit.client.0.smithi084.stdout:6/201: fdatasync d14/f16 0 2024-02-15T18:27:00.094 INFO:tasks.workunit.client.0.smithi084.stdout:3/199: mkdir d8/d40/d43 0 2024-02-15T18:27:00.094 INFO:tasks.workunit.client.0.smithi084.stdout:6/202: read fb [1758317,55045] 0 2024-02-15T18:27:00.094 INFO:tasks.workunit.client.0.smithi084.stdout:6/203: write fb [4896786,51467] 0 2024-02-15T18:27:00.094 INFO:tasks.workunit.client.0.smithi084.stdout:3/200: creat d8/d1f/f44 x:0 0 0 2024-02-15T18:27:00.095 INFO:tasks.workunit.client.0.smithi084.stdout:6/204: readlink l11 0 2024-02-15T18:27:00.096 INFO:tasks.workunit.client.0.smithi084.stdout:3/201: creat d8/d1f/d2d/f45 x:0 0 0 2024-02-15T18:27:00.096 INFO:tasks.workunit.client.0.smithi084.stdout:3/202: read d8/d1f/d28/f2b [439792,42136] 0 2024-02-15T18:27:00.096 INFO:tasks.workunit.client.0.smithi084.stdout:6/205: mkdir d14/d22/d25/d41 0 2024-02-15T18:27:00.097 INFO:tasks.workunit.client.0.smithi084.stdout:3/203: symlink d8/d1f/d25/l46 0 2024-02-15T18:27:00.098 INFO:tasks.workunit.client.0.smithi084.stdout:6/206: link d14/f2d d14/d22/d25/d2f/d31/d3f/f42 0 2024-02-15T18:27:00.099 INFO:tasks.workunit.client.0.smithi084.stdout:6/207: read fb [1966541,7486] 0 2024-02-15T18:27:00.099 INFO:tasks.workunit.client.0.smithi084.stdout:8/266: dwrite db/d1a/d2b/f51 [0,4194304] 0 2024-02-15T18:27:00.099 INFO:tasks.workunit.client.0.smithi084.stdout:8/267: chown db/d1a/d2b/c57 474 1 2024-02-15T18:27:00.100 INFO:tasks.workunit.client.0.smithi084.stdout:4/211: dwrite d2/f17 [0,4194304] 0 2024-02-15T18:27:00.100 INFO:tasks.workunit.client.0.smithi084.stdout:4/212: chown d2/f11 118322 1 2024-02-15T18:27:00.100 INFO:tasks.workunit.client.0.smithi084.stdout:3/204: write d8/d1f/f20 [50542,34399] 0 2024-02-15T18:27:00.102 INFO:tasks.workunit.client.0.smithi084.stdout:6/208: mkdir d14/d22/d25/d41/d43 0 2024-02-15T18:27:00.102 INFO:tasks.workunit.client.0.smithi084.stdout:6/209: dread - d14/d22/d25/d2f/d31/f27 zero size 2024-02-15T18:27:00.102 INFO:tasks.workunit.client.0.smithi084.stdout:7/207: dwrite f4 [4194304,4194304] 0 2024-02-15T18:27:00.102 INFO:tasks.workunit.client.0.smithi084.stdout:6/210: read d14/d22/d25/d2f/d31/d3f/f42 [1500981,64021] 0 2024-02-15T18:27:00.103 INFO:tasks.workunit.client.0.smithi084.stdout:6/211: write d14/f16 [1615891,82009] 0 2024-02-15T18:27:00.103 INFO:tasks.workunit.client.0.smithi084.stdout:6/212: chown d14/d22/d25/f35 15702715 1 2024-02-15T18:27:00.104 INFO:tasks.workunit.client.0.smithi084.stdout:3/205: rename d8/d1f/d25/l36 to d8/d40/d43/l47 0 2024-02-15T18:27:00.114 INFO:tasks.workunit.client.0.smithi084.stdout:6/213: dread d14/f16 [0,4194304] 0 2024-02-15T18:27:00.120 INFO:tasks.workunit.client.0.smithi084.stdout:3/206: creat d8/f48 x:0 0 0 2024-02-15T18:27:00.122 INFO:tasks.workunit.client.0.smithi084.stdout:6/214: creat d14/d22/d25/f44 x:0 0 0 2024-02-15T18:27:00.122 INFO:tasks.workunit.client.0.smithi084.stdout:6/215: chown d14/l26 3307483 1 2024-02-15T18:27:00.122 INFO:tasks.workunit.client.0.smithi084.stdout:6/216: chown d14/d22/d25/d2f 523851702 1 2024-02-15T18:27:00.123 INFO:tasks.workunit.client.0.smithi084.stdout:3/207: unlink d8/d1f/d28/l3f 0 2024-02-15T18:27:00.123 INFO:tasks.workunit.client.0.smithi084.stdout:3/208: stat d8/d1f/d28/c3e 0 2024-02-15T18:27:00.125 INFO:tasks.workunit.client.0.smithi084.stdout:6/217: rmdir d14/d22/d25/d2f 39 2024-02-15T18:27:00.127 INFO:tasks.workunit.client.0.smithi084.stdout:3/209: link d8/d1f/f44 d8/d22/f49 0 2024-02-15T18:27:00.128 INFO:tasks.workunit.client.0.smithi084.stdout:3/210: write d8/d1f/d28/f3c [999780,64667] 0 2024-02-15T18:27:00.128 INFO:tasks.workunit.client.0.smithi084.stdout:3/211: truncate d8/d1f/d28/f2a 842565 0 2024-02-15T18:27:00.128 INFO:tasks.workunit.client.0.smithi084.stdout:6/218: mkdir d14/d22/d25/d2f/d31/d30/d45 0 2024-02-15T18:27:00.129 INFO:tasks.workunit.client.0.smithi084.stdout:3/212: mknod d8/d40/c4a 0 2024-02-15T18:27:00.131 INFO:tasks.workunit.client.0.smithi084.stdout:1/195: sync 2024-02-15T18:27:00.131 INFO:tasks.workunit.client.0.smithi084.stdout:1/196: chown d9/dd/d12/d1b/l22 26793 1 2024-02-15T18:27:00.131 INFO:tasks.workunit.client.0.smithi084.stdout:6/219: rename ca to d14/d22/d25/d2f/d31/d3f/c46 0 2024-02-15T18:27:00.132 INFO:tasks.workunit.client.0.smithi084.stdout:3/213: mknod d8/d40/d43/c4b 0 2024-02-15T18:27:00.133 INFO:tasks.workunit.client.0.smithi084.stdout:1/197: rename l5 to d9/dd/d12/d32/l3e 0 2024-02-15T18:27:00.134 INFO:tasks.workunit.client.0.smithi084.stdout:1/198: write d9/f27 [222114,57536] 0 2024-02-15T18:27:00.135 INFO:tasks.workunit.client.0.smithi084.stdout:6/220: rename d14/d22/f2c to d14/d22/d25/d2f/d31/f47 0 2024-02-15T18:27:00.135 INFO:tasks.workunit.client.0.smithi084.stdout:6/221: fsync d14/f17 0 2024-02-15T18:27:00.135 INFO:tasks.workunit.client.0.smithi084.stdout:6/222: fsync d14/d22/d25/d2f/d31/f34 0 2024-02-15T18:27:00.136 INFO:tasks.workunit.client.0.smithi084.stdout:1/199: symlink d9/dd/d12/d1b/l3f 0 2024-02-15T18:27:00.136 INFO:tasks.workunit.client.0.smithi084.stdout:6/223: truncate d14/f17 257389 0 2024-02-15T18:27:00.137 INFO:tasks.workunit.client.0.smithi084.stdout:1/200: creat d9/dd/d12/d1b/d2c/d35/f40 x:0 0 0 2024-02-15T18:27:00.140 INFO:tasks.workunit.client.0.smithi084.stdout:6/224: unlink d14/d22/d25/d2f/d31/f36 0 2024-02-15T18:27:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:1/201: symlink d9/dd/d12/d1b/d2c/l41 0 2024-02-15T18:27:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:6/225: creat d14/d22/d25/d28/f48 x:0 0 0 2024-02-15T18:27:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:6/226: mkdir d14/d22/d25/d2f/d31/d3f/d49 0 2024-02-15T18:27:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:8/268: dwrite db/dd/d1f/f23 [4194304,4194304] 0 2024-02-15T18:27:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:4/213: dwrite d2/d4/f19 [0,4194304] 0 2024-02-15T18:27:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:6/227: dread d14/d22/d25/d2f/d31/d3f/f42 [0,4194304] 0 2024-02-15T18:27:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:7/208: dwrite df/f35 [0,4194304] 0 2024-02-15T18:27:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:3/214: dwrite d8/d22/f24 [0,4194304] 0 2024-02-15T18:27:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:3/215: stat d8/d22 0 2024-02-15T18:27:00.163 INFO:tasks.workunit.client.0.smithi084.stdout:8/269: mkdir db/d1a/d5e 0 2024-02-15T18:27:00.163 INFO:tasks.workunit.client.0.smithi084.stdout:1/202: rmdir d9/dd/d12/d1b/d2c 39 2024-02-15T18:27:00.164 INFO:tasks.workunit.client.0.smithi084.stdout:4/214: mknod d2/d26/d31/c3f 0 2024-02-15T18:27:00.165 INFO:tasks.workunit.client.0.smithi084.stdout:4/215: write d2/d4/fb [4170721,19569] 0 2024-02-15T18:27:00.168 INFO:tasks.workunit.client.0.smithi084.stdout:7/209: dwrite fb [0,4194304] 0 2024-02-15T18:27:00.168 INFO:tasks.workunit.client.0.smithi084.stdout:7/210: readlink df/d1d/l2c 0 2024-02-15T18:27:00.168 INFO:tasks.workunit.client.0.smithi084.stdout:6/228: unlink d14/d22/d25/l3e 0 2024-02-15T18:27:00.168 INFO:tasks.workunit.client.0.smithi084.stdout:6/229: dread - d14/d22/d25/f35 zero size 2024-02-15T18:27:00.169 INFO:tasks.workunit.client.0.smithi084.stdout:3/216: truncate d8/d1f/f3b 335053 0 2024-02-15T18:27:00.171 INFO:tasks.workunit.client.0.smithi084.stdout:1/203: creat d9/dd/d12/d1b/f42 x:0 0 0 2024-02-15T18:27:00.171 INFO:tasks.workunit.client.0.smithi084.stdout:1/204: stat d9/dd/d12/d1b/c1c 0 2024-02-15T18:27:00.171 INFO:tasks.workunit.client.0.smithi084.stdout:4/216: symlink d2/l40 0 2024-02-15T18:27:00.171 INFO:tasks.workunit.client.0.smithi084.stdout:4/217: chown d2/d26/d31 38 1 2024-02-15T18:27:00.174 INFO:tasks.workunit.client.0.smithi084.stdout:7/211: rename df/d1d/d23/f37 to df/f3b 0 2024-02-15T18:27:00.175 INFO:tasks.workunit.client.0.smithi084.stdout:6/230: rmdir d14/d22/d25/d41 39 2024-02-15T18:27:00.175 INFO:tasks.workunit.client.0.smithi084.stdout:7/212: write fb [2186053,118936] 0 2024-02-15T18:27:00.175 INFO:tasks.workunit.client.0.smithi084.stdout:7/213: readlink df/d1d/l19 0 2024-02-15T18:27:00.177 INFO:tasks.workunit.client.0.smithi084.stdout:1/205: link d9/dd/d12/d32/f3b d9/dd/d12/d1b/d2c/f43 0 2024-02-15T18:27:00.177 INFO:tasks.workunit.client.0.smithi084.stdout:1/206: write d9/dd/d12/d1b/f42 [84892,65263] 0 2024-02-15T18:27:00.178 INFO:tasks.workunit.client.0.smithi084.stdout:4/218: creat d2/d4/f41 x:0 0 0 2024-02-15T18:27:00.178 INFO:tasks.workunit.client.0.smithi084.stdout:4/219: chown d2/c1a 36045285 1 2024-02-15T18:27:00.179 INFO:tasks.workunit.client.0.smithi084.stdout:6/231: mkdir d14/d22/d25/d2f/d31/d3f/d4a 0 2024-02-15T18:27:00.179 INFO:tasks.workunit.client.0.smithi084.stdout:6/232: readlink d14/d22/d25/d2f/l3a 0 2024-02-15T18:27:00.179 INFO:tasks.workunit.client.0.smithi084.stdout:6/233: readlink d14/l26 0 2024-02-15T18:27:00.180 INFO:tasks.workunit.client.0.smithi084.stdout:7/214: mknod df/c3c 0 2024-02-15T18:27:00.181 INFO:tasks.workunit.client.0.smithi084.stdout:1/207: symlink d9/dd/d12/d1b/l44 0 2024-02-15T18:27:00.182 INFO:tasks.workunit.client.0.smithi084.stdout:1/208: truncate d9/dd/d12/d1b/d2c/d35/f40 143137 0 2024-02-15T18:27:00.182 INFO:tasks.workunit.client.0.smithi084.stdout:4/220: mknod d2/d4/d28/d3d/c42 0 2024-02-15T18:27:00.182 INFO:tasks.workunit.client.0.smithi084.stdout:4/221: readlink d2/d26/l3a 0 2024-02-15T18:27:00.182 INFO:tasks.workunit.client.0.smithi084.stdout:4/222: write d2/d4/f41 [1012724,2902] 0 2024-02-15T18:27:00.183 INFO:tasks.workunit.client.0.smithi084.stdout:4/223: stat d2/d4/d28/d3d/c42 0 2024-02-15T18:27:00.183 INFO:tasks.workunit.client.0.smithi084.stdout:1/209: mknod d9/dd/d12/d1b/d38/c45 0 2024-02-15T18:27:00.185 INFO:tasks.workunit.client.0.smithi084.stdout:1/210: truncate d9/dd/f13 2217881 0 2024-02-15T18:27:00.192 INFO:tasks.workunit.client.0.smithi084.stdout:3/217: dread d8/f12 [0,4194304] 0 2024-02-15T18:27:00.192 INFO:tasks.workunit.client.0.smithi084.stdout:0/213: sync 2024-02-15T18:27:00.192 INFO:tasks.workunit.client.0.smithi084.stdout:5/240: sync 2024-02-15T18:27:00.192 INFO:tasks.workunit.client.0.smithi084.stdout:0/214: dread - d0/d4/d1b/f3e zero size 2024-02-15T18:27:00.192 INFO:tasks.workunit.client.0.smithi084.stdout:7/215: dread df/f1c [0,4194304] 0 2024-02-15T18:27:00.192 INFO:tasks.workunit.client.0.smithi084.stdout:8/270: dwrite db/d3f/d59/f28 [0,4194304] 0 2024-02-15T18:27:00.193 INFO:tasks.workunit.client.0.smithi084.stdout:9/157: sync 2024-02-15T18:27:00.193 INFO:tasks.workunit.client.0.smithi084.stdout:2/239: sync 2024-02-15T18:27:00.207 INFO:tasks.workunit.client.0.smithi084.stdout:7/216: truncate df/d1d/d1a/f28 843049 0 2024-02-15T18:27:00.207 INFO:tasks.workunit.client.0.smithi084.stdout:7/217: stat df/d1d/l27 0 2024-02-15T18:27:00.208 INFO:tasks.workunit.client.0.smithi084.stdout:3/218: write d8/f1d [190971,120120] 0 2024-02-15T18:27:00.208 INFO:tasks.workunit.client.0.smithi084.stdout:3/219: dread - d8/d1f/d2d/f3d zero size 2024-02-15T18:27:00.210 INFO:tasks.workunit.client.0.smithi084.stdout:8/271: creat db/d1a/f5f x:0 0 0 2024-02-15T18:27:00.211 INFO:tasks.workunit.client.0.smithi084.stdout:8/272: write db/d3f/f54 [1167271,84088] 0 2024-02-15T18:27:00.211 INFO:tasks.workunit.client.0.smithi084.stdout:8/273: chown db/d3f/c53 709 1 2024-02-15T18:27:00.211 INFO:tasks.workunit.client.0.smithi084.stdout:7/218: creat df/d1d/d23/f3d x:0 0 0 2024-02-15T18:27:00.212 INFO:tasks.workunit.client.0.smithi084.stdout:7/219: read df/d1d/d1a/f2d [613688,109922] 0 2024-02-15T18:27:00.212 INFO:tasks.workunit.client.0.smithi084.stdout:3/220: mknod d8/d1f/d2d/c4c 0 2024-02-15T18:27:00.212 INFO:tasks.workunit.client.0.smithi084.stdout:3/221: write d8/d1f/d28/f2a [1525659,87929] 0 2024-02-15T18:27:00.215 INFO:tasks.workunit.client.0.smithi084.stdout:8/274: creat db/d3f/d59/f60 x:0 0 0 2024-02-15T18:27:00.216 INFO:tasks.workunit.client.0.smithi084.stdout:7/220: dread df/f3b [0,4194304] 0 2024-02-15T18:27:00.216 INFO:tasks.workunit.client.0.smithi084.stdout:4/224: truncate d2/d4/fb 2994737 0 2024-02-15T18:27:00.216 INFO:tasks.workunit.client.0.smithi084.stdout:7/221: chown df/d1d/l19 121067634 1 2024-02-15T18:27:00.218 INFO:tasks.workunit.client.0.smithi084.stdout:8/275: dread db/d1a/d2b/f31 [0,4194304] 0 2024-02-15T18:27:00.220 INFO:tasks.workunit.client.0.smithi084.stdout:4/225: creat d2/d26/d31/f43 x:0 0 0 2024-02-15T18:27:00.221 INFO:tasks.workunit.client.0.smithi084.stdout:8/276: mknod db/d1a/d2b/c61 0 2024-02-15T18:27:00.223 INFO:tasks.workunit.client.0.smithi084.stdout:8/277: mknod db/dd/d1f/c62 0 2024-02-15T18:27:00.223 INFO:tasks.workunit.client.0.smithi084.stdout:8/278: chown db/dd/d13/c32 68 1 2024-02-15T18:27:00.223 INFO:tasks.workunit.client.0.smithi084.stdout:8/279: chown db/c1b 25845600 1 2024-02-15T18:27:00.223 INFO:tasks.workunit.client.0.smithi084.stdout:6/234: dwrite f9 [0,4194304] 0 2024-02-15T18:27:00.223 INFO:tasks.workunit.client.0.smithi084.stdout:8/280: chown db 1071291 1 2024-02-15T18:27:00.224 INFO:tasks.workunit.client.0.smithi084.stdout:6/235: read d14/d22/d25/f2b [1305740,50479] 0 2024-02-15T18:27:00.224 INFO:tasks.workunit.client.0.smithi084.stdout:0/215: dwrite d0/d25/f34 [0,4194304] 0 2024-02-15T18:27:00.226 INFO:tasks.workunit.client.0.smithi084.stdout:8/281: creat db/dd/d4d/f63 x:0 0 0 2024-02-15T18:27:00.227 INFO:tasks.workunit.client.0.smithi084.stdout:6/236: symlink d14/d22/d25/d2f/d31/d30/d45/l4b 0 2024-02-15T18:27:00.230 INFO:tasks.workunit.client.0.smithi084.stdout:5/241: dwrite d9/da/f1b [4194304,4194304] 0 2024-02-15T18:27:00.231 INFO:tasks.workunit.client.0.smithi084.stdout:4/226: dread d2/d4/f20 [0,4194304] 0 2024-02-15T18:27:00.231 INFO:tasks.workunit.client.0.smithi084.stdout:1/211: dwrite d9/dd/d12/d1b/f42 [0,4194304] 0 2024-02-15T18:27:00.231 INFO:tasks.workunit.client.0.smithi084.stdout:4/227: write d2/d4/d28/f38 [252188,17881] 0 2024-02-15T18:27:00.231 INFO:tasks.workunit.client.0.smithi084.stdout:4/228: chown d2/d4/fe 149438 1 2024-02-15T18:27:00.231 INFO:tasks.workunit.client.0.smithi084.stdout:5/242: write d9/d23/f4a [192490,113071] 0 2024-02-15T18:27:00.232 INFO:tasks.workunit.client.0.smithi084.stdout:7/222: dread df/f35 [0,4194304] 0 2024-02-15T18:27:00.233 INFO:tasks.workunit.client.0.smithi084.stdout:1/212: symlink d9/dd/d12/d1b/l46 0 2024-02-15T18:27:00.234 INFO:tasks.workunit.client.0.smithi084.stdout:6/237: write d14/f38 [22402,125641] 0 2024-02-15T18:27:00.237 INFO:tasks.workunit.client.0.smithi084.stdout:4/229: rename d2/d4/l14 to d2/d4/d25/l44 0 2024-02-15T18:27:00.237 INFO:tasks.workunit.client.0.smithi084.stdout:4/230: read - d2/d2b/f1f zero size 2024-02-15T18:27:00.237 INFO:tasks.workunit.client.0.smithi084.stdout:4/231: fdatasync d2/d26/d31/f43 0 2024-02-15T18:27:00.237 INFO:tasks.workunit.client.0.smithi084.stdout:4/232: fsync d2/d4/f7 0 2024-02-15T18:27:00.238 INFO:tasks.workunit.client.0.smithi084.stdout:7/223: creat df/d1d/f3e x:0 0 0 2024-02-15T18:27:00.238 INFO:tasks.workunit.client.0.smithi084.stdout:2/240: dwrite d3/d19/d24/f2e [4194304,4194304] 0 2024-02-15T18:27:00.239 INFO:tasks.workunit.client.0.smithi084.stdout:1/213: link d9/dd/f2f d9/dd/d39/f47 0 2024-02-15T18:27:00.239 INFO:tasks.workunit.client.0.smithi084.stdout:1/214: write d9/dd/d12/d1b/d2c/d35/f40 [580808,127272] 0 2024-02-15T18:27:00.242 INFO:tasks.workunit.client.0.smithi084.stdout:6/238: rmdir d14/d22/d25/d2f/d31/d3f/d49 0 2024-02-15T18:27:00.244 INFO:tasks.workunit.client.0.smithi084.stdout:7/224: creat df/f3f x:0 0 0 2024-02-15T18:27:00.244 INFO:tasks.workunit.client.0.smithi084.stdout:7/225: truncate df/f35 5184401 0 2024-02-15T18:27:00.244 INFO:tasks.workunit.client.0.smithi084.stdout:6/239: write d14/f16 [3399650,15881] 0 2024-02-15T18:27:00.247 INFO:tasks.workunit.client.0.smithi084.stdout:2/241: rmdir d3/d19 39 2024-02-15T18:27:00.247 INFO:tasks.workunit.client.0.smithi084.stdout:0/216: dwrite d0/f37 [0,4194304] 0 2024-02-15T18:27:00.247 INFO:tasks.workunit.client.0.smithi084.stdout:0/217: fsync d0/d25/f2a 0 2024-02-15T18:27:00.249 INFO:tasks.workunit.client.0.smithi084.stdout:4/233: mknod d2/d4/c45 0 2024-02-15T18:27:00.249 INFO:tasks.workunit.client.0.smithi084.stdout:7/226: mkdir df/d1d/d40 0 2024-02-15T18:27:00.250 INFO:tasks.workunit.client.0.smithi084.stdout:6/240: rename d14/f16 to d14/d22/d25/d2f/d31/d3f/d4a/f4c 0 2024-02-15T18:27:00.251 INFO:tasks.workunit.client.0.smithi084.stdout:2/242: mknod d3/d19/c52 0 2024-02-15T18:27:00.251 INFO:tasks.workunit.client.0.smithi084.stdout:2/243: fsync d3/d19/d24/f2e 0 2024-02-15T18:27:00.251 INFO:tasks.workunit.client.0.smithi084.stdout:2/244: fsync d3/d19/d24/f44 0 2024-02-15T18:27:00.252 INFO:tasks.workunit.client.0.smithi084.stdout:7/227: truncate df/d1d/d23/f34 2450981 0 2024-02-15T18:27:00.253 INFO:tasks.workunit.client.0.smithi084.stdout:6/241: mknod d14/d22/d25/d41/c4d 0 2024-02-15T18:27:00.254 INFO:tasks.workunit.client.0.smithi084.stdout:2/245: write d3/d19/d24/f26 [1256714,80017] 0 2024-02-15T18:27:00.256 INFO:tasks.workunit.client.0.smithi084.stdout:2/246: dread d3/d5/d1a/f4e [0,4194304] 0 2024-02-15T18:27:00.263 INFO:tasks.workunit.client.0.smithi084.stdout:2/247: mkdir d3/d5/d53 0 2024-02-15T18:27:00.263 INFO:tasks.workunit.client.0.smithi084.stdout:2/248: write d3/d5/d1a/f27 [781841,59054] 0 2024-02-15T18:27:00.263 INFO:tasks.workunit.client.0.smithi084.stdout:2/249: write d3/d5/d1a/d2d/f4a [382912,38941] 0 2024-02-15T18:27:00.264 INFO:tasks.workunit.client.0.smithi084.stdout:2/250: mknod d3/d5/d1a/d1e/d4b/c54 0 2024-02-15T18:27:00.268 INFO:tasks.workunit.client.0.smithi084.stdout:8/282: dwrite db/d3f/d59/f48 [0,4194304] 0 2024-02-15T18:27:00.268 INFO:tasks.workunit.client.0.smithi084.stdout:0/218: dread d0/d25/f34 [0,4194304] 0 2024-02-15T18:27:00.269 INFO:tasks.workunit.client.0.smithi084.stdout:2/251: creat d3/d19/d24/d3e/f55 x:0 0 0 2024-02-15T18:27:00.269 INFO:tasks.workunit.client.0.smithi084.stdout:2/252: stat d3/d19/d36/f39 0 2024-02-15T18:27:00.269 INFO:tasks.workunit.client.0.smithi084.stdout:2/253: chown d3/d5/d1a 360486813 1 2024-02-15T18:27:00.275 INFO:tasks.workunit.client.0.smithi084.stdout:4/234: dread d2/d4/fd [0,4194304] 0 2024-02-15T18:27:00.275 INFO:tasks.workunit.client.0.smithi084.stdout:7/228: dwrite fc [4194304,4194304] 0 2024-02-15T18:27:00.279 INFO:tasks.workunit.client.0.smithi084.stdout:8/283: chown c8 680 1 2024-02-15T18:27:00.280 INFO:tasks.workunit.client.0.smithi084.stdout:0/219: creat d0/d2f/d3f/f41 x:0 0 0 2024-02-15T18:27:00.281 INFO:tasks.workunit.client.0.smithi084.stdout:2/254: creat d3/d5/d1a/d1e/d47/f56 x:0 0 0 2024-02-15T18:27:00.282 INFO:tasks.workunit.client.0.smithi084.stdout:4/235: rename d2/d2b/f37 to d2/d4/d28/d3d/f46 0 2024-02-15T18:27:00.283 INFO:tasks.workunit.client.0.smithi084.stdout:7/229: link df/d1d/d1a/c38 df/d1d/d1a/c41 0 2024-02-15T18:27:00.283 INFO:tasks.workunit.client.0.smithi084.stdout:7/230: dread - df/d1d/f3e zero size 2024-02-15T18:27:00.284 INFO:tasks.workunit.client.0.smithi084.stdout:6/242: dwrite d14/d22/d25/f32 [0,4194304] 0 2024-02-15T18:27:00.285 INFO:tasks.workunit.client.0.smithi084.stdout:7/231: dread df/d1d/d1a/f26 [0,4194304] 0 2024-02-15T18:27:00.285 INFO:tasks.workunit.client.0.smithi084.stdout:0/220: creat d0/d4/d1b/f42 x:0 0 0 2024-02-15T18:27:00.285 INFO:tasks.workunit.client.0.smithi084.stdout:0/221: truncate d0/d25/f2a 5296332 0 2024-02-15T18:27:00.285 INFO:tasks.workunit.client.0.smithi084.stdout:0/222: dread - d0/d2f/d3f/f17 zero size 2024-02-15T18:27:00.286 INFO:tasks.workunit.client.0.smithi084.stdout:0/223: stat d0/d25 0 2024-02-15T18:27:00.286 INFO:tasks.workunit.client.0.smithi084.stdout:2/255: mknod d3/d5/d1a/d1e/d47/c57 0 2024-02-15T18:27:00.288 INFO:tasks.workunit.client.0.smithi084.stdout:8/284: dread db/d1a/f1d [0,4194304] 0 2024-02-15T18:27:00.289 INFO:tasks.workunit.client.0.smithi084.stdout:8/285: write db/dd/d1f/f38 [158263,42629] 0 2024-02-15T18:27:00.290 INFO:tasks.workunit.client.0.smithi084.stdout:4/236: rename d2/d26 to d2/d2b/d47 0 2024-02-15T18:27:00.293 INFO:tasks.workunit.client.0.smithi084.stdout:7/232: dread f0 [0,4194304] 0 2024-02-15T18:27:00.296 INFO:tasks.workunit.client.0.smithi084.stdout:6/243: dread f9 [0,4194304] 0 2024-02-15T18:27:00.296 INFO:tasks.workunit.client.0.smithi084.stdout:2/256: creat d3/d5/d1a/d1e/f58 x:0 0 0 2024-02-15T18:27:00.298 INFO:tasks.workunit.client.0.smithi084.stdout:8/286: mknod db/dd/c64 0 2024-02-15T18:27:00.298 INFO:tasks.workunit.client.0.smithi084.stdout:2/257: write d3/f14 [3156206,69911] 0 2024-02-15T18:27:00.298 INFO:tasks.workunit.client.0.smithi084.stdout:2/258: readlink d3/d5/d1a/l2b 0 2024-02-15T18:27:00.298 INFO:tasks.workunit.client.0.smithi084.stdout:2/259: fsync d3/d5/d1a/f27 0 2024-02-15T18:27:00.298 INFO:tasks.workunit.client.0.smithi084.stdout:2/260: fsync d3/d5/f35 0 2024-02-15T18:27:00.299 INFO:tasks.workunit.client.0.smithi084.stdout:2/261: chown d3/d5/d53 6210 1 2024-02-15T18:27:00.299 INFO:tasks.workunit.client.0.smithi084.stdout:2/262: write d3/d5/f16 [1685522,126339] 0 2024-02-15T18:27:00.300 INFO:tasks.workunit.client.0.smithi084.stdout:6/244: rmdir d14/d22/d25/d2f 39 2024-02-15T18:27:00.300 INFO:tasks.workunit.client.0.smithi084.stdout:6/245: readlink l11 0 2024-02-15T18:27:00.302 INFO:tasks.workunit.client.0.smithi084.stdout:8/287: mknod db/dd/d13/d42/c65 0 2024-02-15T18:27:00.303 INFO:tasks.workunit.client.0.smithi084.stdout:6/246: mknod d14/d22/d25/d2f/d31/c4e 0 2024-02-15T18:27:00.304 INFO:tasks.workunit.client.0.smithi084.stdout:8/288: getdents db/dd/d4d 0 2024-02-15T18:27:00.309 INFO:tasks.workunit.client.0.smithi084.stdout:7/233: dread f4 [4194304,4194304] 0 2024-02-15T18:27:00.309 INFO:tasks.workunit.client.0.smithi084.stdout:9/158: sync 2024-02-15T18:27:00.310 INFO:tasks.workunit.client.0.smithi084.stdout:7/234: mknod df/d1d/d23/c42 0 2024-02-15T18:27:00.312 INFO:tasks.workunit.client.0.smithi084.stdout:9/159: link d4/c1e d4/de/d15/c34 0 2024-02-15T18:27:00.313 INFO:tasks.workunit.client.0.smithi084.stdout:9/160: readlink l3 0 2024-02-15T18:27:00.313 INFO:tasks.workunit.client.0.smithi084.stdout:4/237: dwrite d2/d4/f20 [0,4194304] 0 2024-02-15T18:27:00.314 INFO:tasks.workunit.client.0.smithi084.stdout:9/161: write d4/de/d15/d1a/f23 [668110,24527] 0 2024-02-15T18:27:00.314 INFO:tasks.workunit.client.0.smithi084.stdout:9/162: chown d4/de/d15/d1a/f23 109 1 2024-02-15T18:27:00.314 INFO:tasks.workunit.client.0.smithi084.stdout:7/235: creat df/d1d/d23/f43 x:0 0 0 2024-02-15T18:27:00.314 INFO:tasks.workunit.client.0.smithi084.stdout:7/236: write df/d1d/d23/f3d [680696,69837] 0 2024-02-15T18:27:00.314 INFO:tasks.workunit.client.0.smithi084.stdout:7/237: readlink df/d1d/d23/l33 0 2024-02-15T18:27:00.314 INFO:tasks.workunit.client.0.smithi084.stdout:7/238: mkdir df/d1d/d44 0 2024-02-15T18:27:00.319 INFO:tasks.workunit.client.0.smithi084.stdout:7/239: creat df/d1d/d23/f45 x:0 0 0 2024-02-15T18:27:00.321 INFO:tasks.workunit.client.0.smithi084.stdout:7/240: link l8 df/d1d/d44/l46 0 2024-02-15T18:27:00.323 INFO:tasks.workunit.client.0.smithi084.stdout:0/224: dwrite d0/d2f/d3f/f17 [0,4194304] 0 2024-02-15T18:27:00.323 INFO:tasks.workunit.client.0.smithi084.stdout:0/225: stat d0 0 2024-02-15T18:27:00.323 INFO:tasks.workunit.client.0.smithi084.stdout:0/226: truncate d0/d4/d1b/f40 328408 0 2024-02-15T18:27:00.324 INFO:tasks.workunit.client.0.smithi084.stdout:0/227: read - d0/d2f/d3f/f41 zero size 2024-02-15T18:27:00.324 INFO:tasks.workunit.client.0.smithi084.stdout:0/228: fsync d0/d25/f34 0 2024-02-15T18:27:00.324 INFO:tasks.workunit.client.0.smithi084.stdout:0/229: fsync d0/d2f/d3f/f41 0 2024-02-15T18:27:00.324 INFO:tasks.workunit.client.0.smithi084.stdout:0/230: write d0/d2f/d3f/f41 [189147,73699] 0 2024-02-15T18:27:00.324 INFO:tasks.workunit.client.0.smithi084.stdout:0/231: write d0/d4/d1b/f3c [4725475,51276] 0 2024-02-15T18:27:00.328 INFO:tasks.workunit.client.0.smithi084.stdout:6/247: dwrite f9 [0,4194304] 0 2024-02-15T18:27:00.335 INFO:tasks.workunit.client.0.smithi084.stdout:0/232: truncate d0/d2f/d3f/f30 3150892 0 2024-02-15T18:27:00.336 INFO:tasks.workunit.client.0.smithi084.stdout:6/248: dread d14/d22/d25/d2f/d31/d3f/d4a/f4c [0,4194304] 0 2024-02-15T18:27:00.338 INFO:tasks.workunit.client.0.smithi084.stdout:8/289: dwrite db/f16 [0,4194304] 0 2024-02-15T18:27:00.338 INFO:tasks.workunit.client.0.smithi084.stdout:0/233: mkdir d0/d4/d1b/d26/d43 0 2024-02-15T18:27:00.339 INFO:tasks.workunit.client.0.smithi084.stdout:6/249: mkdir d14/d22/d25/d2f/d31/d30/d4f 0 2024-02-15T18:27:00.339 INFO:tasks.workunit.client.0.smithi084.stdout:0/234: creat d0/d1e/f44 x:0 0 0 2024-02-15T18:27:00.340 INFO:tasks.workunit.client.0.smithi084.stdout:0/235: mkdir d0/d39/d45 0 2024-02-15T18:27:00.340 INFO:tasks.workunit.client.0.smithi084.stdout:0/236: readlink d0/d2f/l38 0 2024-02-15T18:27:00.341 INFO:tasks.workunit.client.0.smithi084.stdout:0/237: mkdir d0/d4/d1b/d46 0 2024-02-15T18:27:00.341 INFO:tasks.workunit.client.0.smithi084.stdout:0/238: chown d0/d4/d1b 9642 1 2024-02-15T18:27:00.348 INFO:tasks.workunit.client.0.smithi084.stdout:4/238: dwrite d2/d4/d28/f38 [0,4194304] 0 2024-02-15T18:27:00.349 INFO:tasks.workunit.client.0.smithi084.stdout:4/239: write d2/d4/f8 [574598,15939] 0 2024-02-15T18:27:00.352 INFO:tasks.workunit.client.0.smithi084.stdout:4/240: creat d2/d4/f48 x:0 0 0 2024-02-15T18:27:00.354 INFO:tasks.workunit.client.0.smithi084.stdout:4/241: rename d2/d4/f19 to d2/d4/d28/d2e/f49 0 2024-02-15T18:27:00.357 INFO:tasks.workunit.client.0.smithi084.stdout:6/250: dread f13 [4194304,4194304] 0 2024-02-15T18:27:00.357 INFO:tasks.workunit.client.0.smithi084.stdout:6/251: fsync d14/d22/d25/f2b 0 2024-02-15T18:27:00.358 INFO:tasks.workunit.client.0.smithi084.stdout:6/252: symlink d14/d22/d25/d2f/d31/d30/d4f/l50 0 2024-02-15T18:27:00.358 INFO:tasks.workunit.client.0.smithi084.stdout:6/253: write d14/d22/d25/f44 [887110,22547] 0 2024-02-15T18:27:00.358 INFO:tasks.workunit.client.0.smithi084.stdout:6/254: chown d14/l26 2656635 1 2024-02-15T18:27:00.358 INFO:tasks.workunit.client.0.smithi084.stdout:6/255: mknod d14/d22/d25/d2f/d31/d30/d45/c51 0 2024-02-15T18:27:00.359 INFO:tasks.workunit.client.0.smithi084.stdout:6/256: mkdir d14/d22/d25/d2f/d31/d30/d45/d52 0 2024-02-15T18:27:00.359 INFO:tasks.workunit.client.0.smithi084.stdout:6/257: write fd [4197786,48268] 0 2024-02-15T18:27:00.359 INFO:tasks.workunit.client.0.smithi084.stdout:6/258: dread - d14/d22/d25/d2f/f3c zero size 2024-02-15T18:27:00.361 INFO:tasks.workunit.client.0.smithi084.stdout:6/259: unlink d14/l15 0 2024-02-15T18:27:00.365 INFO:tasks.workunit.client.0.smithi084.stdout:7/241: dwrite f0 [0,4194304] 0 2024-02-15T18:27:00.368 INFO:tasks.workunit.client.0.smithi084.stdout:9/163: dwrite d4/de/d15/f28 [0,4194304] 0 2024-02-15T18:27:00.368 INFO:tasks.workunit.client.0.smithi084.stdout:7/242: dread df/d1d/d23/f34 [0,4194304] 0 2024-02-15T18:27:00.368 INFO:tasks.workunit.client.0.smithi084.stdout:9/164: write d4/de/d15/d1a/f23 [1784513,107622] 0 2024-02-15T18:27:00.369 INFO:tasks.workunit.client.0.smithi084.stdout:2/263: dwrite d3/d19/f33 [0,4194304] 0 2024-02-15T18:27:00.372 INFO:tasks.workunit.client.0.smithi084.stdout:9/165: mknod d4/d2b/c35 0 2024-02-15T18:27:00.372 INFO:tasks.workunit.client.0.smithi084.stdout:9/166: fsync d4/de/d15/d1a/d24/f2a 0 2024-02-15T18:27:00.373 INFO:tasks.workunit.client.0.smithi084.stdout:8/290: dwrite db/f25 [0,4194304] 0 2024-02-15T18:27:00.373 INFO:tasks.workunit.client.0.smithi084.stdout:8/291: write db/d3f/d59/f3b [715964,7967] 0 2024-02-15T18:27:00.374 INFO:tasks.workunit.client.0.smithi084.stdout:9/167: mkdir d4/d36 0 2024-02-15T18:27:00.374 INFO:tasks.workunit.client.0.smithi084.stdout:0/239: dwrite d0/d2f/d3f/f17 [0,4194304] 0 2024-02-15T18:27:00.379 INFO:tasks.workunit.client.0.smithi084.stdout:9/168: write d4/de/f1f [2408120,115730] 0 2024-02-15T18:27:00.381 INFO:tasks.workunit.client.0.smithi084.stdout:4/242: truncate d2/d4/f20 2963901 0 2024-02-15T18:27:00.381 INFO:tasks.workunit.client.0.smithi084.stdout:3/222: sync 2024-02-15T18:27:00.381 INFO:tasks.workunit.client.0.smithi084.stdout:5/243: sync 2024-02-15T18:27:00.388 INFO:tasks.workunit.client.0.smithi084.stdout:6/260: dwrite d14/d22/d25/d2f/d31/d3f/f42 [0,4194304] 0 2024-02-15T18:27:00.388 INFO:tasks.workunit.client.0.smithi084.stdout:0/240: dread d0/f37 [0,4194304] 0 2024-02-15T18:27:00.392 INFO:tasks.workunit.client.0.smithi084.stdout:7/243: dread df/d1d/d23/f3d [0,4194304] 0 2024-02-15T18:27:00.393 INFO:tasks.workunit.client.0.smithi084.stdout:9/169: creat d4/de/d15/f37 x:0 0 0 2024-02-15T18:27:00.393 INFO:tasks.workunit.client.0.smithi084.stdout:4/243: creat d2/d4/d25/f4a x:0 0 0 2024-02-15T18:27:00.394 INFO:tasks.workunit.client.0.smithi084.stdout:3/223: creat d8/d40/d43/f4d x:0 0 0 2024-02-15T18:27:00.396 INFO:tasks.workunit.client.0.smithi084.stdout:5/244: unlink d9/d23/d33/f3c 0 2024-02-15T18:27:00.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/244: dread d2/f3 [0,4194304] 0 2024-02-15T18:27:00.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/245: dread - d2/d2b/d47/d31/f43 zero size 2024-02-15T18:27:00.405 INFO:tasks.workunit.client.0.smithi084.stdout:1/215: sync 2024-02-15T18:27:00.405 INFO:tasks.workunit.client.0.smithi084.stdout:1/216: stat d9/dd/d39 0 2024-02-15T18:27:00.405 INFO:tasks.workunit.client.0.smithi084.stdout:1/217: stat d9/dd/d12/d1b/l44 0 2024-02-15T18:27:00.407 INFO:tasks.workunit.client.0.smithi084.stdout:6/261: link d14/d22/d25/d28/f2a d14/d22/d25/d2f/d31/d30/d45/d52/f53 0 2024-02-15T18:27:00.407 INFO:tasks.workunit.client.0.smithi084.stdout:6/262: readlink d14/d22/d25/d2f/d31/d30/l40 0 2024-02-15T18:27:00.407 INFO:tasks.workunit.client.0.smithi084.stdout:0/241: dwrite d0/d2f/d3f/f30 [0,4194304] 0 2024-02-15T18:27:00.407 INFO:tasks.workunit.client.0.smithi084.stdout:0/242: write d0/d4/d1b/f3e [799350,49761] 0 2024-02-15T18:27:00.411 INFO:tasks.workunit.client.0.smithi084.stdout:7/244: symlink df/d1d/d23/l47 0 2024-02-15T18:27:00.413 INFO:tasks.workunit.client.0.smithi084.stdout:3/224: link d8/c14 d8/d1f/d28/c4e 0 2024-02-15T18:27:00.415 INFO:tasks.workunit.client.0.smithi084.stdout:5/245: rename d9/d23/d33/l3f to d9/da/d3d/d44/l51 0 2024-02-15T18:27:00.415 INFO:tasks.workunit.client.0.smithi084.stdout:4/246: rmdir d2/d2b/d47 39 2024-02-15T18:27:00.416 INFO:tasks.workunit.client.0.smithi084.stdout:1/218: creat d9/dd/d12/d1b/d2c/d35/f48 x:0 0 0 2024-02-15T18:27:00.417 INFO:tasks.workunit.client.0.smithi084.stdout:6/263: mkdir d14/d22/d25/d2f/d31/d30/d45/d54 0 2024-02-15T18:27:00.419 INFO:tasks.workunit.client.0.smithi084.stdout:0/243: creat d0/d25/f47 x:0 0 0 2024-02-15T18:27:00.420 INFO:tasks.workunit.client.0.smithi084.stdout:7/245: truncate df/d1d/f18 114305 0 2024-02-15T18:27:00.420 INFO:tasks.workunit.client.0.smithi084.stdout:7/246: stat df/f14 0 2024-02-15T18:27:00.420 INFO:tasks.workunit.client.0.smithi084.stdout:7/247: fdatasync df/d1d/d23/f34 0 2024-02-15T18:27:00.420 INFO:tasks.workunit.client.0.smithi084.stdout:7/248: stat l2 0 2024-02-15T18:27:00.421 INFO:tasks.workunit.client.0.smithi084.stdout:4/247: dread d2/d4/f41 [0,4194304] 0 2024-02-15T18:27:00.421 INFO:tasks.workunit.client.0.smithi084.stdout:4/248: dread - d2/f21 zero size 2024-02-15T18:27:00.421 INFO:tasks.workunit.client.0.smithi084.stdout:4/249: readlink d2/d2b/d47/l3a 0 2024-02-15T18:27:00.421 INFO:tasks.workunit.client.0.smithi084.stdout:5/246: link d9/l32 d9/d23/l52 0 2024-02-15T18:27:00.422 INFO:tasks.workunit.client.0.smithi084.stdout:0/244: symlink d0/d1e/l48 0 2024-02-15T18:27:00.422 INFO:tasks.workunit.client.0.smithi084.stdout:5/247: write d9/f3b [443791,81530] 0 2024-02-15T18:27:00.424 INFO:tasks.workunit.client.0.smithi084.stdout:4/250: creat d2/d4/d28/f4b x:0 0 0 2024-02-15T18:27:00.424 INFO:tasks.workunit.client.0.smithi084.stdout:4/251: fsync d2/f39 0 2024-02-15T18:27:00.425 INFO:tasks.workunit.client.0.smithi084.stdout:5/248: getdents d9/da 0 2024-02-15T18:27:00.425 INFO:tasks.workunit.client.0.smithi084.stdout:5/249: truncate d9/d23/f30 707355 0 2024-02-15T18:27:00.426 INFO:tasks.workunit.client.0.smithi084.stdout:4/252: mknod d2/c4c 0 2024-02-15T18:27:00.426 INFO:tasks.workunit.client.0.smithi084.stdout:4/253: truncate d2/d4/f1c 1178307 0 2024-02-15T18:27:00.426 INFO:tasks.workunit.client.0.smithi084.stdout:4/254: chown d2/d4/f1c 2069 1 2024-02-15T18:27:00.427 INFO:tasks.workunit.client.0.smithi084.stdout:5/250: symlink d9/da/l53 0 2024-02-15T18:27:00.427 INFO:tasks.workunit.client.0.smithi084.stdout:5/251: dread - d9/f4c zero size 2024-02-15T18:27:00.427 INFO:tasks.workunit.client.0.smithi084.stdout:3/225: dread d8/f1d [0,4194304] 0 2024-02-15T18:27:00.427 INFO:tasks.workunit.client.0.smithi084.stdout:3/226: dread - d8/f48 zero size 2024-02-15T18:27:00.428 INFO:tasks.workunit.client.0.smithi084.stdout:4/255: symlink d2/d2b/d47/d31/l4d 0 2024-02-15T18:27:00.428 INFO:tasks.workunit.client.0.smithi084.stdout:9/170: dwrite d4/de/f1f [0,4194304] 0 2024-02-15T18:27:00.428 INFO:tasks.workunit.client.0.smithi084.stdout:5/252: mknod d9/d23/c54 0 2024-02-15T18:27:00.431 INFO:tasks.workunit.client.0.smithi084.stdout:7/249: rename df/d1d/d23 to df/d1d/d40/d48 0 2024-02-15T18:27:00.431 INFO:tasks.workunit.client.0.smithi084.stdout:0/245: dread d0/f1a [0,4194304] 0 2024-02-15T18:27:00.432 INFO:tasks.workunit.client.0.smithi084.stdout:5/253: write d9/f1d [1461354,74515] 0 2024-02-15T18:27:00.436 INFO:tasks.workunit.client.0.smithi084.stdout:1/219: dwrite d9/dd/d12/d1b/f42 [0,4194304] 0 2024-02-15T18:27:00.437 INFO:tasks.workunit.client.0.smithi084.stdout:3/227: creat d8/d1f/d2d/f4f x:0 0 0 2024-02-15T18:27:00.437 INFO:tasks.workunit.client.0.smithi084.stdout:3/228: write d8/d1f/d2d/f45 [836924,8952] 0 2024-02-15T18:27:00.437 INFO:tasks.workunit.client.0.smithi084.stdout:6/264: dread d14/f2d [0,4194304] 0 2024-02-15T18:27:00.438 INFO:tasks.workunit.client.0.smithi084.stdout:4/256: creat d2/d4/d28/d3d/f4e x:0 0 0 2024-02-15T18:27:00.440 INFO:tasks.workunit.client.0.smithi084.stdout:9/171: rename f1 to d4/d2b/f38 0 2024-02-15T18:27:00.444 INFO:tasks.workunit.client.0.smithi084.stdout:7/250: symlink df/d1d/d44/l49 0 2024-02-15T18:27:00.444 INFO:tasks.workunit.client.0.smithi084.stdout:7/251: chown df/d1d 0 1 2024-02-15T18:27:00.444 INFO:tasks.workunit.client.0.smithi084.stdout:3/229: write d8/d1f/f20 [1018314,52636] 0 2024-02-15T18:27:00.444 INFO:tasks.workunit.client.0.smithi084.stdout:3/230: fdatasync d8/d1f/d28/f2a 0 2024-02-15T18:27:00.446 INFO:tasks.workunit.client.0.smithi084.stdout:0/246: getdents d0/d25 0 2024-02-15T18:27:00.446 INFO:tasks.workunit.client.0.smithi084.stdout:4/257: dread d2/d4/f7 [0,4194304] 0 2024-02-15T18:27:00.446 INFO:tasks.workunit.client.0.smithi084.stdout:9/172: write d4/de/d15/d1a/f22 [525010,104116] 0 2024-02-15T18:27:00.446 INFO:tasks.workunit.client.0.smithi084.stdout:5/254: mkdir d9/da/d3d/d44/d55 0 2024-02-15T18:27:00.446 INFO:tasks.workunit.client.0.smithi084.stdout:5/255: chown d9/d3a/l43 7 1 2024-02-15T18:27:00.451 INFO:tasks.workunit.client.0.smithi084.stdout:4/258: dread d2/d4/fe [0,4194304] 0 2024-02-15T18:27:00.451 INFO:tasks.workunit.client.0.smithi084.stdout:4/259: write d2/d4/f48 [899162,127458] 0 2024-02-15T18:27:00.452 INFO:tasks.workunit.client.0.smithi084.stdout:4/260: chown d2/d2b/d47/d31/c3f 55546904 1 2024-02-15T18:27:00.452 INFO:tasks.workunit.client.0.smithi084.stdout:4/261: dread - d2/d2b/f3e zero size 2024-02-15T18:27:00.452 INFO:tasks.workunit.client.0.smithi084.stdout:4/262: write d2/d2b/f1f [561193,19453] 0 2024-02-15T18:27:00.452 INFO:tasks.workunit.client.0.smithi084.stdout:4/263: fdatasync d2/d4/d28/f38 0 2024-02-15T18:27:00.452 INFO:tasks.workunit.client.0.smithi084.stdout:6/265: symlink d14/d22/d25/d28/l55 0 2024-02-15T18:27:00.452 INFO:tasks.workunit.client.0.smithi084.stdout:6/266: write d14/d22/d25/d2f/d31/f27 [492461,27357] 0 2024-02-15T18:27:00.455 INFO:tasks.workunit.client.0.smithi084.stdout:7/252: unlink df/f3f 0 2024-02-15T18:27:00.455 INFO:tasks.workunit.client.0.smithi084.stdout:3/231: link d8/c19 d8/d22/c50 0 2024-02-15T18:27:00.455 INFO:tasks.workunit.client.0.smithi084.stdout:5/256: dread d9/d23/f2a [0,4194304] 0 2024-02-15T18:27:00.457 INFO:tasks.workunit.client.0.smithi084.stdout:0/247: creat d0/d2f/d3f/f49 x:0 0 0 2024-02-15T18:27:00.457 INFO:tasks.workunit.client.0.smithi084.stdout:0/248: chown d0/d2f/d3f/c1f 15 1 2024-02-15T18:27:00.457 INFO:tasks.workunit.client.0.smithi084.stdout:4/264: creat d2/d4/f4f x:0 0 0 2024-02-15T18:27:00.458 INFO:tasks.workunit.client.0.smithi084.stdout:4/265: chown d2/d4/fb 293 1 2024-02-15T18:27:00.458 INFO:tasks.workunit.client.0.smithi084.stdout:5/257: creat d9/d23/d33/f56 x:0 0 0 2024-02-15T18:27:00.459 INFO:tasks.workunit.client.0.smithi084.stdout:5/258: write d9/d23/d33/f56 [881969,94051] 0 2024-02-15T18:27:00.459 INFO:tasks.workunit.client.0.smithi084.stdout:8/292: sync 2024-02-15T18:27:00.459 INFO:tasks.workunit.client.0.smithi084.stdout:2/264: sync 2024-02-15T18:27:00.459 INFO:tasks.workunit.client.0.smithi084.stdout:2/265: stat d3/f11 0 2024-02-15T18:27:00.459 INFO:tasks.workunit.client.0.smithi084.stdout:2/266: chown d3/d5/d1a/d1e/d47/c57 161325254 1 2024-02-15T18:27:00.459 INFO:tasks.workunit.client.0.smithi084.stdout:0/249: getdents d0/d1e 0 2024-02-15T18:27:00.463 INFO:tasks.workunit.client.0.smithi084.stdout:5/259: creat d9/d23/f57 x:0 0 0 2024-02-15T18:27:00.463 INFO:tasks.workunit.client.0.smithi084.stdout:5/260: truncate d9/d23/d33/f34 100597 0 2024-02-15T18:27:00.463 INFO:tasks.workunit.client.0.smithi084.stdout:8/293: mkdir db/dd/d1f/d66 0 2024-02-15T18:27:00.463 INFO:tasks.workunit.client.0.smithi084.stdout:2/267: creat d3/d5/d1a/d1e/d4b/f59 x:0 0 0 2024-02-15T18:27:00.463 INFO:tasks.workunit.client.0.smithi084.stdout:5/261: creat d9/d35/f58 x:0 0 0 2024-02-15T18:27:00.463 INFO:tasks.workunit.client.0.smithi084.stdout:5/262: fsync d9/da/f18 0 2024-02-15T18:27:00.463 INFO:tasks.workunit.client.0.smithi084.stdout:2/268: creat d3/d19/d24/d3e/f5a x:0 0 0 2024-02-15T18:27:00.465 INFO:tasks.workunit.client.0.smithi084.stdout:5/263: unlink d9/f4c 0 2024-02-15T18:27:00.465 INFO:tasks.workunit.client.0.smithi084.stdout:1/220: dwrite d9/dd/d12/d1b/d2c/f31 [0,4194304] 0 2024-02-15T18:27:00.467 INFO:tasks.workunit.client.0.smithi084.stdout:5/264: rename d9/c21 to d9/c59 0 2024-02-15T18:27:00.468 INFO:tasks.workunit.client.0.smithi084.stdout:4/266: dread d2/d2b/d47/f3c [0,4194304] 0 2024-02-15T18:27:00.468 INFO:tasks.workunit.client.0.smithi084.stdout:0/250: read d0/d25/f2a [4093321,44944] 0 2024-02-15T18:27:00.468 INFO:tasks.workunit.client.0.smithi084.stdout:4/267: write d2/f21 [936666,112098] 0 2024-02-15T18:27:00.468 INFO:tasks.workunit.client.0.smithi084.stdout:6/267: dread fb [0,4194304] 0 2024-02-15T18:27:00.469 INFO:tasks.workunit.client.0.smithi084.stdout:2/269: link d3/d19/d24/f32 d3/d19/f5b 0 2024-02-15T18:27:00.469 INFO:tasks.workunit.client.0.smithi084.stdout:2/270: write d3/d5/f22 [1105515,129640] 0 2024-02-15T18:27:00.472 INFO:tasks.workunit.client.0.smithi084.stdout:1/221: write d9/dd/d39/f47 [2164373,51909] 0 2024-02-15T18:27:00.472 INFO:tasks.workunit.client.0.smithi084.stdout:1/222: write d9/dd/d12/d1b/d2c/d35/f40 [459775,121403] 0 2024-02-15T18:27:00.473 INFO:tasks.workunit.client.0.smithi084.stdout:9/173: dwrite d4/de/f1c [0,4194304] 0 2024-02-15T18:27:00.475 INFO:tasks.workunit.client.0.smithi084.stdout:0/251: mknod d0/d4/d1b/d26/d43/c4a 0 2024-02-15T18:27:00.475 INFO:tasks.workunit.client.0.smithi084.stdout:4/268: truncate d2/fc 3201167 0 2024-02-15T18:27:00.475 INFO:tasks.workunit.client.0.smithi084.stdout:5/265: rename d9/d35/l48 to d9/d23/d33/l5a 0 2024-02-15T18:27:00.477 INFO:tasks.workunit.client.0.smithi084.stdout:1/223: creat d9/dd/d12/d32/f49 x:0 0 0 2024-02-15T18:27:00.477 INFO:tasks.workunit.client.0.smithi084.stdout:1/224: chown d9/le 1422287 1 2024-02-15T18:27:00.478 INFO:tasks.workunit.client.0.smithi084.stdout:9/174: symlink d4/d36/l39 0 2024-02-15T18:27:00.478 INFO:tasks.workunit.client.0.smithi084.stdout:9/175: truncate d4/de/f12 2154672 0 2024-02-15T18:27:00.478 INFO:tasks.workunit.client.0.smithi084.stdout:0/252: readlink d0/d4/d1b/d26/l27 0 2024-02-15T18:27:00.479 INFO:tasks.workunit.client.0.smithi084.stdout:4/269: truncate d2/fc 3523000 0 2024-02-15T18:27:00.480 INFO:tasks.workunit.client.0.smithi084.stdout:5/266: truncate d9/da/f1b 4530259 0 2024-02-15T18:27:00.480 INFO:tasks.workunit.client.0.smithi084.stdout:5/267: write d9/d23/d33/f34 [781806,83541] 0 2024-02-15T18:27:00.481 INFO:tasks.workunit.client.0.smithi084.stdout:1/225: creat d9/dd/d12/d1b/d38/f4a x:0 0 0 2024-02-15T18:27:00.481 INFO:tasks.workunit.client.0.smithi084.stdout:1/226: stat l1 0 2024-02-15T18:27:00.485 INFO:tasks.workunit.client.0.smithi084.stdout:9/176: mknod d4/de/d15/d1a/c3a 0 2024-02-15T18:27:00.485 INFO:tasks.workunit.client.0.smithi084.stdout:9/177: write d4/de/f12 [2563376,95553] 0 2024-02-15T18:27:00.486 INFO:tasks.workunit.client.0.smithi084.stdout:0/253: mkdir d0/d2f/d4b 0 2024-02-15T18:27:00.486 INFO:tasks.workunit.client.0.smithi084.stdout:0/254: chown d0/c7 0 1 2024-02-15T18:27:00.486 INFO:tasks.workunit.client.0.smithi084.stdout:0/255: dread - d0/d25/f47 zero size 2024-02-15T18:27:00.487 INFO:tasks.workunit.client.0.smithi084.stdout:0/256: dread d0/d4/d1b/f40 [0,4194304] 0 2024-02-15T18:27:00.487 INFO:tasks.workunit.client.0.smithi084.stdout:4/270: mkdir d2/d2b/d47/d31/d50 0 2024-02-15T18:27:00.487 INFO:tasks.workunit.client.0.smithi084.stdout:4/271: chown d2/d4/d28/d3d 441188 1 2024-02-15T18:27:00.487 INFO:tasks.workunit.client.0.smithi084.stdout:5/268: getdents d9/da/d3d/d44 0 2024-02-15T18:27:00.489 INFO:tasks.workunit.client.0.smithi084.stdout:1/227: unlink d9/ca 0 2024-02-15T18:27:00.490 INFO:tasks.workunit.client.0.smithi084.stdout:1/228: dread d9/dd/d12/d1b/f25 [0,4194304] 0 2024-02-15T18:27:00.491 INFO:tasks.workunit.client.0.smithi084.stdout:1/229: dread d9/dd/d12/d32/f3b [0,4194304] 0 2024-02-15T18:27:00.496 INFO:tasks.workunit.client.0.smithi084.stdout:9/178: link d4/de/d15/d1a/f2e d4/d2b/f3b 0 2024-02-15T18:27:00.497 INFO:tasks.workunit.client.0.smithi084.stdout:0/257: mkdir d0/d2f/d3f/d4c 0 2024-02-15T18:27:00.498 INFO:tasks.workunit.client.0.smithi084.stdout:7/253: dwrite f0 [0,4194304] 0 2024-02-15T18:27:00.499 INFO:tasks.workunit.client.0.smithi084.stdout:7/254: readlink df/d1d/l2c 0 2024-02-15T18:27:00.499 INFO:tasks.workunit.client.0.smithi084.stdout:3/232: dwrite d8/d1f/f44 [0,4194304] 0 2024-02-15T18:27:00.499 INFO:tasks.workunit.client.0.smithi084.stdout:8/294: dwrite db/d3f/f54 [0,4194304] 0 2024-02-15T18:27:00.500 INFO:tasks.workunit.client.0.smithi084.stdout:3/233: read d8/d1f/f3b [288331,55953] 0 2024-02-15T18:27:00.500 INFO:tasks.workunit.client.0.smithi084.stdout:4/272: getdents d2 0 2024-02-15T18:27:00.500 INFO:tasks.workunit.client.0.smithi084.stdout:5/269: mkdir d9/d5b 0 2024-02-15T18:27:00.502 INFO:tasks.workunit.client.0.smithi084.stdout:2/271: dwrite d3/d5/d1a/d1e/d4b/f59 [0,4194304] 0 2024-02-15T18:27:00.503 INFO:tasks.workunit.client.0.smithi084.stdout:0/258: truncate d0/d4/d1b/d26/f2d 360249 0 2024-02-15T18:27:00.503 INFO:tasks.workunit.client.0.smithi084.stdout:0/259: chown d0/d4/c2c 75406 1 2024-02-15T18:27:00.503 INFO:tasks.workunit.client.0.smithi084.stdout:0/260: chown d0/d1e/f44 79 1 2024-02-15T18:27:00.505 INFO:tasks.workunit.client.0.smithi084.stdout:0/261: dread d0/d4/d1b/f40 [0,4194304] 0 2024-02-15T18:27:00.505 INFO:tasks.workunit.client.0.smithi084.stdout:0/262: write d0/d2f/d3f/f49 [320613,78752] 0 2024-02-15T18:27:00.505 INFO:tasks.workunit.client.0.smithi084.stdout:6/268: dread d14/d22/d25/d2f/d31/f27 [0,4194304] 0 2024-02-15T18:27:00.506 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:26:58.684208+0000 mgr.smithi084.hjmnez (mgr.14596) 15 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 379 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.0 MiB/s rd, 26 MiB/s wr, 773 op/s 2024-02-15T18:27:00.506 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:59.914057+0000 mon.smithi084 (mon.0) 692 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.nxzroj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:27:00.506 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:59.915371+0000 mon.smithi084 (mon.0) 693 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:27:00.506 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:26:59.916312+0000 mon.smithi084 (mon.0) 694 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:00.507 INFO:tasks.workunit.client.0.smithi084.stdout:7/255: unlink df/d1d/l27 0 2024-02-15T18:27:00.507 INFO:tasks.workunit.client.0.smithi084.stdout:1/230: dwrite d9/dd/d39/f23 [0,4194304] 0 2024-02-15T18:27:00.507 INFO:tasks.workunit.client.0.smithi084.stdout:1/231: chown d9/lf 1 1 2024-02-15T18:27:00.510 INFO:tasks.workunit.client.0.smithi084.stdout:8/295: truncate db/d3f/d59/f28 1373933 0 2024-02-15T18:27:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:26:58.684208+0000 mgr.smithi084.hjmnez (mgr.14596) 15 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 379 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.0 MiB/s rd, 26 MiB/s wr, 773 op/s 2024-02-15T18:27:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:59.914057+0000 mon.smithi084 (mon.0) 692 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi133.nxzroj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:27:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:59.915371+0000 mon.smithi084 (mon.0) 693 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:27:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:26:59.916312+0000 mon.smithi084 (mon.0) 694 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:00.512 INFO:tasks.workunit.client.1.smithi133.stdout:2/53: sync 2024-02-15T18:27:00.512 INFO:tasks.workunit.client.1.smithi133.stdout:2/54: dread - d7/f16 zero size 2024-02-15T18:27:00.513 INFO:tasks.workunit.client.0.smithi084.stdout:4/273: getdents d2/d4 0 2024-02-15T18:27:00.513 INFO:tasks.workunit.client.0.smithi084.stdout:7/256: dread f4 [4194304,4194304] 0 2024-02-15T18:27:00.513 INFO:tasks.workunit.client.1.smithi133.stdout:2/55: symlink d7/l17 0 2024-02-15T18:27:00.514 INFO:tasks.workunit.client.1.smithi133.stdout:1/22: sync 2024-02-15T18:27:00.514 INFO:tasks.workunit.client.1.smithi133.stdout:7/10: sync 2024-02-15T18:27:00.514 INFO:tasks.workunit.client.0.smithi084.stdout:9/179: rename d4/de/d15/d1a to d4/d2b/d3c 0 2024-02-15T18:27:00.514 INFO:tasks.workunit.client.0.smithi084.stdout:0/263: rename d0/d39/d45 to d0/d39/d45/d4d 22 2024-02-15T18:27:00.515 INFO:tasks.workunit.client.0.smithi084.stdout:9/180: read d4/f29 [51070,5815] 0 2024-02-15T18:27:00.516 INFO:tasks.workunit.client.1.smithi133.stdout:6/55: sync 2024-02-15T18:27:00.516 INFO:tasks.workunit.client.1.smithi133.stdout:9/43: sync 2024-02-15T18:27:00.516 INFO:tasks.workunit.client.1.smithi133.stdout:8/33: sync 2024-02-15T18:27:00.516 INFO:tasks.workunit.client.1.smithi133.stdout:4/11: sync 2024-02-15T18:27:00.516 INFO:tasks.workunit.client.1.smithi133.stdout:0/13: sync 2024-02-15T18:27:00.516 INFO:tasks.workunit.client.1.smithi133.stdout:0/14: rmdir - no directory 2024-02-15T18:27:00.516 INFO:tasks.workunit.client.1.smithi133.stdout:5/54: sync 2024-02-15T18:27:00.516 INFO:tasks.workunit.client.1.smithi133.stdout:5/55: dread - f10 zero size 2024-02-15T18:27:00.517 INFO:tasks.workunit.client.1.smithi133.stdout:3/58: sync 2024-02-15T18:27:00.517 INFO:tasks.workunit.client.0.smithi084.stdout:5/270: truncate d9/d23/f37 1200923 0 2024-02-15T18:27:00.518 INFO:tasks.workunit.client.1.smithi133.stdout:2/56: mkdir d7/d18 0 2024-02-15T18:27:00.518 INFO:tasks.workunit.client.1.smithi133.stdout:1/23: symlink d6/l9 0 2024-02-15T18:27:00.518 INFO:tasks.workunit.client.1.smithi133.stdout:2/57: truncate d7/f14 284958 0 2024-02-15T18:27:00.523 INFO:tasks.workunit.client.0.smithi084.stdout:2/272: unlink d3/d5/d1a/f27 0 2024-02-15T18:27:00.523 INFO:tasks.workunit.client.0.smithi084.stdout:2/273: chown d3/d5/d1a/d1e/c4f 15 1 2024-02-15T18:27:00.523 INFO:tasks.workunit.client.0.smithi084.stdout:2/274: chown d3/f1b 71 1 2024-02-15T18:27:00.523 INFO:tasks.workunit.client.0.smithi084.stdout:6/269: truncate f3 3835928 0 2024-02-15T18:27:00.525 INFO:tasks.workunit.client.1.smithi133.stdout:8/34: truncate d3/f8 802566 0 2024-02-15T18:27:00.525 INFO:tasks.workunit.client.1.smithi133.stdout:0/15: creat f7 x:0 0 0 2024-02-15T18:27:00.525 INFO:tasks.workunit.client.1.smithi133.stdout:3/59: getdents d0 0 2024-02-15T18:27:00.525 INFO:tasks.workunit.client.1.smithi133.stdout:3/60: getdents d0 0 2024-02-15T18:27:00.525 INFO:tasks.workunit.client.1.smithi133.stdout:3/61: chown d0/lb 374216714 1 2024-02-15T18:27:00.525 INFO:tasks.workunit.client.1.smithi133.stdout:5/56: dread f5 [0,4194304] 0 2024-02-15T18:27:00.525 INFO:tasks.workunit.client.1.smithi133.stdout:8/35: symlink d3/la 0 2024-02-15T18:27:00.528 INFO:tasks.workunit.client.1.smithi133.stdout:4/12: creat d2/f4 x:0 0 0 2024-02-15T18:27:00.528 INFO:tasks.workunit.client.1.smithi133.stdout:0/16: symlink l8 0 2024-02-15T18:27:00.528 INFO:tasks.workunit.client.1.smithi133.stdout:0/17: stat f4 0 2024-02-15T18:27:00.528 INFO:tasks.workunit.client.1.smithi133.stdout:0/18: chown f7 21973676 1 2024-02-15T18:27:00.528 INFO:tasks.workunit.client.1.smithi133.stdout:0/19: dread - f0 zero size 2024-02-15T18:27:00.528 INFO:tasks.workunit.client.1.smithi133.stdout:3/62: creat d0/fc x:0 0 0 2024-02-15T18:27:00.528 INFO:tasks.workunit.client.1.smithi133.stdout:9/44: creat d0/d8/d9/fb x:0 0 0 2024-02-15T18:27:00.529 INFO:tasks.workunit.client.1.smithi133.stdout:8/36: creat d3/fb x:0 0 0 2024-02-15T18:27:00.530 INFO:tasks.workunit.client.1.smithi133.stdout:6/56: read d0/fd [83705,67564] 0 2024-02-15T18:27:00.530 INFO:tasks.workunit.client.1.smithi133.stdout:0/20: mkdir d9 0 2024-02-15T18:27:00.530 INFO:tasks.workunit.client.1.smithi133.stdout:0/21: fsync f6 0 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:3/234: dwrite d8/d1f/d28/f2b [0,4194304] 0 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:8/296: symlink db/dd/l67 0 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:8/297: chown db/dd/d1f/c62 94 1 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:0/264: creat d0/d4/f4e x:0 0 0 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:1/232: mkdir d9/dd/d12/d1b/d2c/d4b 0 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:1/233: chown d9/dd/d12/d1b/f25 46005604 1 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:7/257: rmdir df/d1d/d40 39 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:7/258: readlink df/d1d/d40/d48/l47 0 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:7/259: chown df/d1d/f3e 0 1 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:9/181: mkdir d4/d3d 0 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:2/275: mkdir d3/d19/d24/d3e/d5c 0 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:4/274: rename d2/d4/f41 to d2/d4/d25/f51 0 2024-02-15T18:27:00.532 INFO:tasks.workunit.client.0.smithi084.stdout:4/275: write d2/f15 [4405611,17717] 0 2024-02-15T18:27:00.533 INFO:tasks.workunit.client.0.smithi084.stdout:9/182: write d4/de/f13 [1693198,111531] 0 2024-02-15T18:27:00.533 INFO:tasks.workunit.client.1.smithi133.stdout:9/45: mkdir d0/d8/dc 0 2024-02-15T18:27:00.533 INFO:tasks.workunit.client.1.smithi133.stdout:8/37: symlink d3/d7/lc 0 2024-02-15T18:27:00.534 INFO:tasks.workunit.client.0.smithi084.stdout:6/270: unlink d14/l1c 0 2024-02-15T18:27:00.534 INFO:tasks.workunit.client.0.smithi084.stdout:3/235: mknod d8/d40/c51 0 2024-02-15T18:27:00.535 INFO:tasks.workunit.client.1.smithi133.stdout:0/22: creat d9/fa x:0 0 0 2024-02-15T18:27:00.535 INFO:tasks.workunit.client.1.smithi133.stdout:0/23: fsync f6 0 2024-02-15T18:27:00.536 INFO:tasks.workunit.client.1.smithi133.stdout:6/57: getdents d0 0 2024-02-15T18:27:00.536 INFO:tasks.workunit.client.1.smithi133.stdout:6/58: readlink d0/l1 0 2024-02-15T18:27:00.536 INFO:tasks.workunit.client.1.smithi133.stdout:8/38: mknod d3/cd 0 2024-02-15T18:27:00.537 INFO:tasks.workunit.client.1.smithi133.stdout:0/24: creat d9/fb x:0 0 0 2024-02-15T18:27:00.537 INFO:tasks.workunit.client.1.smithi133.stdout:0/25: fdatasync f7 0 2024-02-15T18:27:00.539 INFO:tasks.workunit.client.1.smithi133.stdout:6/59: creat d0/f12 x:0 0 0 2024-02-15T18:27:00.539 INFO:tasks.workunit.client.1.smithi133.stdout:6/60: chown d0/f10 14 1 2024-02-15T18:27:00.539 INFO:tasks.workunit.client.0.smithi084.stdout:0/265: mkdir d0/d2f/d3f/d4f 0 2024-02-15T18:27:00.539 INFO:tasks.workunit.client.0.smithi084.stdout:7/260: symlink df/d1d/d40/d48/l4a 0 2024-02-15T18:27:00.539 INFO:tasks.workunit.client.0.smithi084.stdout:4/276: creat d2/d4/f52 x:0 0 0 2024-02-15T18:27:00.541 INFO:tasks.workunit.client.1.smithi133.stdout:8/39: mkdir d3/de 0 2024-02-15T18:27:00.541 INFO:tasks.workunit.client.1.smithi133.stdout:8/40: chown c0 2 1 2024-02-15T18:27:00.541 INFO:tasks.workunit.client.1.smithi133.stdout:0/26: creat d9/fc x:0 0 0 2024-02-15T18:27:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:8/298: dread db/dd/d1f/f38 [0,4194304] 0 2024-02-15T18:27:00.542 INFO:tasks.workunit.client.1.smithi133.stdout:6/61: creat d0/d5/f13 x:0 0 0 2024-02-15T18:27:00.542 INFO:tasks.workunit.client.1.smithi133.stdout:6/62: fsync d0/ff 0 2024-02-15T18:27:00.544 INFO:tasks.workunit.client.1.smithi133.stdout:0/27: mknod d9/cd 0 2024-02-15T18:27:00.545 INFO:tasks.workunit.client.1.smithi133.stdout:6/63: creat d0/f14 x:0 0 0 2024-02-15T18:27:00.549 INFO:tasks.workunit.client.0.smithi084.stdout:0/266: dread d0/f1a [4194304,4194304] 0 2024-02-15T18:27:00.549 INFO:tasks.workunit.client.0.smithi084.stdout:9/183: symlink d4/d2b/d3c/l3e 0 2024-02-15T18:27:00.549 INFO:tasks.workunit.client.0.smithi084.stdout:6/271: symlink d14/d22/d25/d2f/l56 0 2024-02-15T18:27:00.550 INFO:tasks.workunit.client.0.smithi084.stdout:0/267: read d0/f1a [1213797,58591] 0 2024-02-15T18:27:00.551 INFO:tasks.workunit.client.0.smithi084.stdout:3/236: rename d8/d1f/d2d/f37 to d8/d22/f52 0 2024-02-15T18:27:00.552 INFO:tasks.workunit.client.0.smithi084.stdout:7/261: mkdir df/d1d/d1a/d4b 0 2024-02-15T18:27:00.556 INFO:tasks.workunit.client.1.smithi133.stdout:9/46: dread d0/f7 [0,4194304] 0 2024-02-15T18:27:00.564 INFO:tasks.workunit.client.1.smithi133.stdout:9/47: rmdir d0/d8/dc 0 2024-02-15T18:27:00.568 INFO:tasks.workunit.client.0.smithi084.stdout:6/272: creat d14/d22/d25/d2f/d31/d30/d45/d54/f57 x:0 0 0 2024-02-15T18:27:00.569 INFO:tasks.workunit.client.0.smithi084.stdout:0/268: rename d0/d4/d1b/c35 to d0/d2f/d4b/c50 0 2024-02-15T18:27:00.570 INFO:tasks.workunit.client.0.smithi084.stdout:7/262: creat df/f4c x:0 0 0 2024-02-15T18:27:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:7/263: dread df/f14 [0,4194304] 0 2024-02-15T18:27:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:7/264: fdatasync df/d1d/d1a/f26 0 2024-02-15T18:27:00.572 INFO:tasks.workunit.client.0.smithi084.stdout:7/265: fsync df/f1b 0 2024-02-15T18:27:00.573 INFO:tasks.workunit.client.1.smithi133.stdout:8/41: fsync d3/fb 0 2024-02-15T18:27:00.573 INFO:tasks.workunit.client.1.smithi133.stdout:1/24: dwrite d6/f7 [0,4194304] 0 2024-02-15T18:27:00.576 INFO:tasks.workunit.client.1.smithi133.stdout:9/48: dread d0/f7 [0,4194304] 0 2024-02-15T18:27:00.576 INFO:tasks.workunit.client.1.smithi133.stdout:9/49: dread - d0/d8/d9/fb zero size 2024-02-15T18:27:00.577 INFO:tasks.workunit.client.1.smithi133.stdout:1/25: creat d6/fa x:0 0 0 2024-02-15T18:27:00.584 INFO:tasks.workunit.client.0.smithi084.stdout:1/234: write d9/dd/d39/f47 [2614439,70490] 0 2024-02-15T18:27:00.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/266: mkdir df/d1d/d1a/d4d 0 2024-02-15T18:27:00.590 INFO:tasks.workunit.client.1.smithi133.stdout:5/57: write f3 [7981212,24245] 0 2024-02-15T18:27:00.593 INFO:tasks.workunit.client.1.smithi133.stdout:5/58: unlink c13 0 2024-02-15T18:27:00.595 INFO:tasks.workunit.client.0.smithi084.stdout:7/267: stat df/d1d/d1a/c41 0 2024-02-15T18:27:00.596 INFO:tasks.workunit.client.1.smithi133.stdout:5/59: unlink l11 0 2024-02-15T18:27:00.597 INFO:tasks.workunit.client.0.smithi084.stdout:7/268: creat df/d1d/d1a/d4d/f4e x:0 0 0 2024-02-15T18:27:00.597 INFO:tasks.workunit.client.0.smithi084.stdout:7/269: read - df/d1d/d40/d48/f45 zero size 2024-02-15T18:27:00.597 INFO:tasks.workunit.client.0.smithi084.stdout:7/270: chown df/d1d/d1a 21507 1 2024-02-15T18:27:00.597 INFO:tasks.workunit.client.1.smithi133.stdout:5/60: dread f5 [0,4194304] 0 2024-02-15T18:27:00.598 INFO:tasks.workunit.client.1.smithi133.stdout:5/61: truncate f10 543068 0 2024-02-15T18:27:00.598 INFO:tasks.workunit.client.1.smithi133.stdout:5/62: fsync fb 0 2024-02-15T18:27:00.598 INFO:tasks.workunit.client.1.smithi133.stdout:5/63: write ff [1041011,84903] 0 2024-02-15T18:27:00.601 INFO:tasks.workunit.client.0.smithi084.stdout:7/271: rename df/d1d/d1a/c39 to df/d1d/d1a/d4d/c4f 0 2024-02-15T18:27:00.608 INFO:tasks.workunit.client.0.smithi084.stdout:2/276: dwrite d3/d19/d24/f32 [0,4194304] 0 2024-02-15T18:27:00.610 INFO:tasks.workunit.client.0.smithi084.stdout:2/277: mknod d3/d19/c5d 0 2024-02-15T18:27:00.617 INFO:tasks.workunit.client.1.smithi133.stdout:3/63: dwrite d0/f8 [4194304,4194304] 0 2024-02-15T18:27:00.618 INFO:tasks.workunit.client.0.smithi084.stdout:4/277: dwrite d2/d2b/d47/d31/f43 [0,4194304] 0 2024-02-15T18:27:00.618 INFO:tasks.workunit.client.1.smithi133.stdout:3/64: write d0/fa [629038,105441] 0 2024-02-15T18:27:00.630 INFO:tasks.workunit.client.1.smithi133.stdout:4/13: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:27:00.630 INFO:tasks.workunit.client.1.smithi133.stdout:6/64: dwrite d0/f10 [0,4194304] 0 2024-02-15T18:27:00.631 INFO:tasks.workunit.client.0.smithi084.stdout:3/237: dwrite d8/d1f/f44 [0,4194304] 0 2024-02-15T18:27:00.632 INFO:tasks.workunit.client.0.smithi084.stdout:3/238: symlink d8/d40/l53 0 2024-02-15T18:27:00.632 INFO:tasks.workunit.client.1.smithi133.stdout:2/58: dwrite d7/f15 [0,4194304] 0 2024-02-15T18:27:00.633 INFO:tasks.workunit.client.1.smithi133.stdout:7/11: dwrite f0 [0,4194304] 0 2024-02-15T18:27:00.635 INFO:tasks.workunit.client.0.smithi084.stdout:8/299: dwrite db/d1a/f1d [0,4194304] 0 2024-02-15T18:27:00.635 INFO:tasks.workunit.client.0.smithi084.stdout:2/278: dwrite d3/d5/d1a/d1e/d47/f56 [0,4194304] 0 2024-02-15T18:27:00.635 INFO:tasks.workunit.client.0.smithi084.stdout:3/239: dread d8/d22/f34 [0,4194304] 0 2024-02-15T18:27:00.635 INFO:tasks.workunit.client.0.smithi084.stdout:3/240: chown d8/d22/f24 2207 1 2024-02-15T18:27:00.635 INFO:tasks.workunit.client.0.smithi084.stdout:1/235: dwrite d9/dd/d12/d1b/d2c/f43 [0,4194304] 0 2024-02-15T18:27:00.636 INFO:tasks.workunit.client.0.smithi084.stdout:9/184: dwrite d4/de/f13 [0,4194304] 0 2024-02-15T18:27:00.636 INFO:tasks.workunit.client.1.smithi133.stdout:4/14: write d2/f4 [5018985,82009] 0 2024-02-15T18:27:00.636 INFO:tasks.workunit.client.1.smithi133.stdout:4/15: truncate f0 213532 0 2024-02-15T18:27:00.638 INFO:tasks.workunit.client.1.smithi133.stdout:6/65: mknod d0/c15 0 2024-02-15T18:27:00.640 INFO:tasks.workunit.client.0.smithi084.stdout:3/241: creat d8/d22/f54 x:0 0 0 2024-02-15T18:27:00.640 INFO:tasks.workunit.client.1.smithi133.stdout:2/59: symlink d7/db/l19 0 2024-02-15T18:27:00.642 INFO:tasks.workunit.client.0.smithi084.stdout:1/236: mkdir d9/dd/d12/d1b/d2c/d4b/d4c 0 2024-02-15T18:27:00.642 INFO:tasks.workunit.client.1.smithi133.stdout:7/12: unlink c2 0 2024-02-15T18:27:00.642 INFO:tasks.workunit.client.1.smithi133.stdout:7/13: write f0 [4690129,39187] 0 2024-02-15T18:27:00.643 INFO:tasks.workunit.client.0.smithi084.stdout:3/242: dread d8/f21 [0,4194304] 0 2024-02-15T18:27:00.645 INFO:tasks.workunit.client.0.smithi084.stdout:9/185: creat d4/de/f3f x:0 0 0 2024-02-15T18:27:00.645 INFO:tasks.workunit.client.0.smithi084.stdout:9/186: chown d4/de/f13 3 1 2024-02-15T18:27:00.645 INFO:tasks.workunit.client.1.smithi133.stdout:4/16: mkdir d2/d5 0 2024-02-15T18:27:00.646 INFO:tasks.workunit.client.1.smithi133.stdout:0/28: dwrite f7 [0,4194304] 0 2024-02-15T18:27:00.647 INFO:tasks.workunit.client.0.smithi084.stdout:2/279: mkdir d3/d5e 0 2024-02-15T18:27:00.648 INFO:tasks.workunit.client.1.smithi133.stdout:7/14: creat f3 x:0 0 0 2024-02-15T18:27:00.648 INFO:tasks.workunit.client.1.smithi133.stdout:2/60: symlink d7/d18/l1a 0 2024-02-15T18:27:00.648 INFO:tasks.workunit.client.1.smithi133.stdout:4/17: creat d2/d5/f6 x:0 0 0 2024-02-15T18:27:00.651 INFO:tasks.workunit.client.1.smithi133.stdout:1/26: dwrite f2 [0,4194304] 0 2024-02-15T18:27:00.651 INFO:tasks.workunit.client.1.smithi133.stdout:1/27: chown d6/fa 620174 1 2024-02-15T18:27:00.651 INFO:tasks.workunit.client.0.smithi084.stdout:1/237: mkdir d9/dd/d12/d1b/d38/d4d 0 2024-02-15T18:27:00.652 INFO:tasks.workunit.client.1.smithi133.stdout:2/61: write f1 [857503,96562] 0 2024-02-15T18:27:00.653 INFO:tasks.workunit.client.1.smithi133.stdout:7/15: symlink l4 0 2024-02-15T18:27:00.654 INFO:tasks.workunit.client.1.smithi133.stdout:4/18: creat d2/f7 x:0 0 0 2024-02-15T18:27:00.654 INFO:tasks.workunit.client.1.smithi133.stdout:4/19: write d2/f4 [5802565,106984] 0 2024-02-15T18:27:00.654 INFO:tasks.workunit.client.1.smithi133.stdout:4/20: dread - d2/d5/f6 zero size 2024-02-15T18:27:00.655 INFO:tasks.workunit.client.1.smithi133.stdout:0/29: link f4 d9/fe 0 2024-02-15T18:27:00.655 INFO:tasks.workunit.client.1.smithi133.stdout:0/30: write f4 [642881,59289] 0 2024-02-15T18:27:00.658 INFO:tasks.workunit.client.0.smithi084.stdout:4/278: dread d2/d4/d28/f38 [0,4194304] 0 2024-02-15T18:27:00.659 INFO:tasks.workunit.client.1.smithi133.stdout:1/28: read d6/f7 [2490126,38646] 0 2024-02-15T18:27:00.659 INFO:tasks.workunit.client.1.smithi133.stdout:6/66: write d0/fd [542603,50862] 0 2024-02-15T18:27:00.660 INFO:tasks.workunit.client.1.smithi133.stdout:2/62: creat d7/db/f1b x:0 0 0 2024-02-15T18:27:00.665 INFO:tasks.workunit.client.1.smithi133.stdout:0/31: link f6 d9/ff 0 2024-02-15T18:27:00.665 INFO:tasks.workunit.client.1.smithi133.stdout:6/67: symlink d0/d5/l16 0 2024-02-15T18:27:00.665 INFO:tasks.workunit.client.1.smithi133.stdout:4/21: rename d2/d5/f6 to d2/d5/f8 0 2024-02-15T18:27:00.665 INFO:tasks.workunit.client.0.smithi084.stdout:0/269: rmdir d0/d4/d1b 39 2024-02-15T18:27:00.666 INFO:tasks.workunit.client.0.smithi084.stdout:0/270: read d0/f1a [1864411,80762] 0 2024-02-15T18:27:00.668 INFO:tasks.workunit.client.1.smithi133.stdout:6/68: write d0/f10 [3637770,49734] 0 2024-02-15T18:27:00.668 INFO:tasks.workunit.client.1.smithi133.stdout:4/22: rename d2/f7 to d2/f9 0 2024-02-15T18:27:00.668 INFO:tasks.workunit.client.1.smithi133.stdout:0/32: mkdir d9/d10 0 2024-02-15T18:27:00.670 INFO:tasks.workunit.client.0.smithi084.stdout:1/238: link d9/dd/d12/d32/l3e d9/dd/d12/l4e 0 2024-02-15T18:27:00.670 INFO:tasks.workunit.client.0.smithi084.stdout:7/272: getdents df 0 2024-02-15T18:27:00.673 INFO:tasks.workunit.client.1.smithi133.stdout:4/23: mknod d2/ca 0 2024-02-15T18:27:00.673 INFO:tasks.workunit.client.1.smithi133.stdout:4/24: chown f0 28175 1 2024-02-15T18:27:00.673 INFO:tasks.workunit.client.1.smithi133.stdout:6/69: unlink d0/d5/f6 0 2024-02-15T18:27:00.673 INFO:tasks.workunit.client.1.smithi133.stdout:6/70: read - d0/ff zero size 2024-02-15T18:27:00.673 INFO:tasks.workunit.client.0.smithi084.stdout:4/279: creat d2/d4/d28/d3d/f53 x:0 0 0 2024-02-15T18:27:00.673 INFO:tasks.workunit.client.0.smithi084.stdout:0/271: truncate d0/d25/f2a 3576673 0 2024-02-15T18:27:00.674 INFO:tasks.workunit.client.0.smithi084.stdout:1/239: write d9/dd/d12/d1b/f42 [228393,8797] 0 2024-02-15T18:27:00.674 INFO:tasks.workunit.client.0.smithi084.stdout:7/273: read df/f1b [65359,50885] 0 2024-02-15T18:27:00.674 INFO:tasks.workunit.client.1.smithi133.stdout:4/25: mkdir d2/db 0 2024-02-15T18:27:00.677 INFO:tasks.workunit.client.0.smithi084.stdout:0/272: read d0/f37 [2115228,81478] 0 2024-02-15T18:27:00.677 INFO:tasks.workunit.client.0.smithi084.stdout:0/273: write d0/d4/f4e [658764,65820] 0 2024-02-15T18:27:00.677 INFO:tasks.workunit.client.0.smithi084.stdout:0/274: fsync d0/d25/f34 0 2024-02-15T18:27:00.678 INFO:tasks.workunit.client.1.smithi133.stdout:0/33: write f7 [993586,3043] 0 2024-02-15T18:27:00.678 INFO:tasks.workunit.client.1.smithi133.stdout:8/42: dwrite d3/f4 [0,4194304] 0 2024-02-15T18:27:00.679 INFO:tasks.workunit.client.0.smithi084.stdout:4/280: truncate d2/d4/d25/f51 313411 0 2024-02-15T18:27:00.679 INFO:tasks.workunit.client.0.smithi084.stdout:4/281: chown d2/d2b/d47/d31/d50 57559 1 2024-02-15T18:27:00.679 INFO:tasks.workunit.client.0.smithi084.stdout:1/240: mkdir d9/dd/d36/d4f 0 2024-02-15T18:27:00.681 INFO:tasks.workunit.client.0.smithi084.stdout:0/275: readlink d0/d4/d1b/d26/l24 0 2024-02-15T18:27:00.681 INFO:tasks.workunit.client.0.smithi084.stdout:6/273: truncate f9 3583816 0 2024-02-15T18:27:00.682 INFO:tasks.workunit.client.0.smithi084.stdout:6/274: write fb [4826660,36825] 0 2024-02-15T18:27:00.682 INFO:tasks.workunit.client.0.smithi084.stdout:6/275: write d14/d22/d25/f35 [696999,86393] 0 2024-02-15T18:27:00.682 INFO:tasks.workunit.client.1.smithi133.stdout:8/43: creat d3/de/ff x:0 0 0 2024-02-15T18:27:00.683 INFO:tasks.workunit.client.0.smithi084.stdout:0/276: mkdir d0/d4/d1b/d51 0 2024-02-15T18:27:00.686 INFO:tasks.workunit.client.0.smithi084.stdout:0/277: rename d0/d2f/d3f/f41 to d0/d4/d1b/d51/f52 0 2024-02-15T18:27:00.690 INFO:tasks.workunit.client.0.smithi084.stdout:0/278: rename d0/d1e/c23 to d0/d4/d1b/d26/d43/c53 0 2024-02-15T18:27:00.692 INFO:tasks.workunit.client.0.smithi084.stdout:1/241: dread d9/dd/d39/f23 [0,4194304] 0 2024-02-15T18:27:00.694 INFO:tasks.workunit.client.0.smithi084.stdout:3/243: dwrite d8/d1f/f20 [0,4194304] 0 2024-02-15T18:27:00.694 INFO:tasks.workunit.client.0.smithi084.stdout:3/244: write d8/d1f/d28/f3c [1405462,528] 0 2024-02-15T18:27:00.694 INFO:tasks.workunit.client.0.smithi084.stdout:1/242: mknod d9/dd/d36/d4f/c50 0 2024-02-15T18:27:00.694 INFO:tasks.workunit.client.0.smithi084.stdout:3/245: truncate d8/f12 232474 0 2024-02-15T18:27:00.694 INFO:tasks.workunit.client.0.smithi084.stdout:3/246: truncate d8/d1f/d2d/f45 1757685 0 2024-02-15T18:27:00.695 INFO:tasks.workunit.client.0.smithi084.stdout:3/247: fdatasync d8/d1f/d2d/f45 0 2024-02-15T18:27:00.695 INFO:tasks.workunit.client.0.smithi084.stdout:3/248: chown d8/fc 1 1 2024-02-15T18:27:00.695 INFO:tasks.workunit.client.0.smithi084.stdout:1/243: mknod d9/dd/d12/d1b/d2c/d4b/c51 0 2024-02-15T18:27:00.696 INFO:tasks.workunit.client.0.smithi084.stdout:1/244: rename d9/dd/d12/d1b/c1c to d9/dd/d12/d1b/d2c/d4b/d4c/c52 0 2024-02-15T18:27:00.698 INFO:tasks.workunit.client.1.smithi133.stdout:6/71: dread d0/fd [0,4194304] 0 2024-02-15T18:27:00.698 INFO:tasks.workunit.client.0.smithi084.stdout:1/245: rename d9/dd/d12/d32/f3b to d9/dd/d12/d1b/f53 0 2024-02-15T18:27:00.699 INFO:tasks.workunit.client.1.smithi133.stdout:6/72: rename d0/f3 to d0/db/f17 0 2024-02-15T18:27:00.699 INFO:tasks.workunit.client.1.smithi133.stdout:6/73: dread - d0/d5/f13 zero size 2024-02-15T18:27:00.700 INFO:tasks.workunit.client.0.smithi084.stdout:1/246: unlink d9/lf 0 2024-02-15T18:27:00.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/74: dread d0/f9 [0,4194304] 0 2024-02-15T18:27:00.707 INFO:tasks.workunit.client.1.smithi133.stdout:9/50: dwrite d0/f7 [0,4194304] 0 2024-02-15T18:27:00.710 INFO:tasks.workunit.client.1.smithi133.stdout:8/44: dwrite d3/f4 [0,4194304] 0 2024-02-15T18:27:00.711 INFO:tasks.workunit.client.1.smithi133.stdout:8/45: chown d3/f8 60126 1 2024-02-15T18:27:00.715 INFO:tasks.workunit.client.1.smithi133.stdout:8/46: symlink d3/d7/l10 0 2024-02-15T18:27:00.718 INFO:tasks.workunit.client.1.smithi133.stdout:6/75: getdents d0/d5 0 2024-02-15T18:27:00.718 INFO:tasks.workunit.client.1.smithi133.stdout:6/76: read d0/fd [446400,25250] 0 2024-02-15T18:27:00.718 INFO:tasks.workunit.client.1.smithi133.stdout:6/77: write d0/ff [525566,25099] 0 2024-02-15T18:27:00.720 INFO:tasks.workunit.client.1.smithi133.stdout:6/78: creat d0/db/f18 x:0 0 0 2024-02-15T18:27:00.720 INFO:tasks.workunit.client.1.smithi133.stdout:6/79: chown d0/l1 78 1 2024-02-15T18:27:00.721 INFO:tasks.workunit.client.1.smithi133.stdout:6/80: link d0/c7 d0/db/c19 0 2024-02-15T18:27:00.722 INFO:tasks.workunit.client.1.smithi133.stdout:6/81: creat d0/f1a x:0 0 0 2024-02-15T18:27:00.722 INFO:tasks.workunit.client.1.smithi133.stdout:6/82: read - d0/d5/f13 zero size 2024-02-15T18:27:00.723 INFO:tasks.workunit.client.1.smithi133.stdout:6/83: link d0/f10 d0/d5/f1b 0 2024-02-15T18:27:00.724 INFO:tasks.workunit.client.1.smithi133.stdout:6/84: mkdir d0/db/d1c 0 2024-02-15T18:27:00.725 INFO:tasks.workunit.client.1.smithi133.stdout:6/85: mknod d0/db/c1d 0 2024-02-15T18:27:00.725 INFO:tasks.workunit.client.1.smithi133.stdout:6/86: mknod d0/db/d1c/c1e 0 2024-02-15T18:27:00.726 INFO:tasks.workunit.client.1.smithi133.stdout:6/87: truncate d0/f10 1485284 0 2024-02-15T18:27:00.732 INFO:tasks.workunit.client.1.smithi133.stdout:6/88: getdents d0 0 2024-02-15T18:27:00.733 INFO:tasks.workunit.client.1.smithi133.stdout:6/89: truncate d0/ff 1569516 0 2024-02-15T18:27:00.733 INFO:tasks.workunit.client.1.smithi133.stdout:6/90: read - d0/f12 zero size 2024-02-15T18:27:00.733 INFO:tasks.workunit.client.1.smithi133.stdout:6/91: mknod d0/db/c1f 0 2024-02-15T18:27:00.733 INFO:tasks.workunit.client.1.smithi133.stdout:6/92: fdatasync d0/d5/f1b 0 2024-02-15T18:27:00.734 INFO:tasks.workunit.client.1.smithi133.stdout:6/93: symlink d0/db/l20 0 2024-02-15T18:27:00.736 INFO:tasks.workunit.client.1.smithi133.stdout:6/94: mkdir d0/db/d21 0 2024-02-15T18:27:00.791 INFO:tasks.workunit.client.1.smithi133.stdout:9/51: dread d0/d8/d9/fa [0,4194304] 0 2024-02-15T18:27:00.791 INFO:tasks.workunit.client.1.smithi133.stdout:9/52: chown d0 29 1 2024-02-15T18:27:00.792 INFO:tasks.workunit.client.1.smithi133.stdout:1/29: dwrite f2 [0,4194304] 0 2024-02-15T18:27:00.792 INFO:tasks.workunit.client.1.smithi133.stdout:1/30: write f2 [5019202,130348] 0 2024-02-15T18:27:00.792 INFO:tasks.workunit.client.1.smithi133.stdout:1/31: rename d6 to d6/db 22 2024-02-15T18:27:00.793 INFO:tasks.workunit.client.1.smithi133.stdout:9/53: creat d0/d8/fd x:0 0 0 2024-02-15T18:27:00.793 INFO:tasks.workunit.client.1.smithi133.stdout:9/54: truncate d0/f5 4598166 0 2024-02-15T18:27:00.793 INFO:tasks.workunit.client.0.smithi084.stdout:9/187: dwrite d4/f6 [4194304,4194304] 0 2024-02-15T18:27:00.794 INFO:tasks.workunit.client.0.smithi084.stdout:2/280: dwrite d3/d28/f45 [4194304,4194304] 0 2024-02-15T18:27:00.794 INFO:tasks.workunit.client.0.smithi084.stdout:0/279: dread d0/d4/d1b/f3c [0,4194304] 0 2024-02-15T18:27:00.794 INFO:tasks.workunit.client.0.smithi084.stdout:0/280: truncate d0/d4/d1b/f42 497691 0 2024-02-15T18:27:00.794 INFO:tasks.workunit.client.0.smithi084.stdout:0/281: readlink d0/d4/d1b/d26/l27 0 2024-02-15T18:27:00.794 INFO:tasks.workunit.client.0.smithi084.stdout:0/282: dread - d0/d25/f47 zero size 2024-02-15T18:27:00.795 INFO:tasks.workunit.client.1.smithi133.stdout:1/32: creat d6/fc x:0 0 0 2024-02-15T18:27:00.796 INFO:tasks.workunit.client.1.smithi133.stdout:9/55: symlink d0/d8/d9/le 0 2024-02-15T18:27:00.796 INFO:tasks.workunit.client.1.smithi133.stdout:9/56: write d0/d8/d9/fa [5020490,120003] 0 2024-02-15T18:27:00.797 INFO:tasks.workunit.client.0.smithi084.stdout:5/271: sync 2024-02-15T18:27:00.797 INFO:tasks.workunit.client.0.smithi084.stdout:5/272: fsync d9/f28 0 2024-02-15T18:27:00.797 INFO:tasks.workunit.client.0.smithi084.stdout:5/273: stat d9/d23/f37 0 2024-02-15T18:27:00.798 INFO:tasks.workunit.client.1.smithi133.stdout:1/33: rename d6/f7 to d6/fd 0 2024-02-15T18:27:00.798 INFO:tasks.workunit.client.1.smithi133.stdout:1/34: read - d6/fc zero size 2024-02-15T18:27:00.798 INFO:tasks.workunit.client.1.smithi133.stdout:1/35: creat d6/fe x:0 0 0 2024-02-15T18:27:00.799 INFO:tasks.workunit.client.1.smithi133.stdout:1/36: creat d6/ff x:0 0 0 2024-02-15T18:27:00.799 INFO:tasks.workunit.client.1.smithi133.stdout:1/37: write d6/fc [738934,17933] 0 2024-02-15T18:27:00.800 INFO:tasks.workunit.client.1.smithi133.stdout:1/38: mknod d6/c10 0 2024-02-15T18:27:00.800 INFO:tasks.workunit.client.1.smithi133.stdout:1/39: chown c4 888989569 1 2024-02-15T18:27:00.803 INFO:tasks.workunit.client.0.smithi084.stdout:4/282: getdents d2/d4/d28/d3d 0 2024-02-15T18:27:00.805 INFO:tasks.workunit.client.0.smithi084.stdout:3/249: write d8/f12 [464242,22570] 0 2024-02-15T18:27:00.805 INFO:tasks.workunit.client.0.smithi084.stdout:3/250: readlink d8/d1f/d2d/l32 0 2024-02-15T18:27:00.806 INFO:tasks.workunit.client.1.smithi133.stdout:7/16: dwrite f3 [0,4194304] 0 2024-02-15T18:27:00.809 INFO:tasks.workunit.client.1.smithi133.stdout:9/57: dread d0/f6 [0,4194304] 0 2024-02-15T18:27:00.809 INFO:tasks.workunit.client.0.smithi084.stdout:1/247: rename d9/dd/d12 to d9/d54 0 2024-02-15T18:27:00.812 INFO:tasks.workunit.client.0.smithi084.stdout:9/188: getdents d4 0 2024-02-15T18:27:00.813 INFO:tasks.workunit.client.1.smithi133.stdout:2/63: dwrite d7/ff [0,4194304] 0 2024-02-15T18:27:00.813 INFO:tasks.workunit.client.1.smithi133.stdout:2/64: chown d7/l12 336 1 2024-02-15T18:27:00.813 INFO:tasks.workunit.client.1.smithi133.stdout:2/65: truncate d7/f14 1008952 0 2024-02-15T18:27:00.813 INFO:tasks.workunit.client.1.smithi133.stdout:2/66: write d7/f14 [2008694,2916] 0 2024-02-15T18:27:00.813 INFO:tasks.workunit.client.1.smithi133.stdout:2/67: dread - d7/db/f1b zero size 2024-02-15T18:27:00.813 INFO:tasks.workunit.client.1.smithi133.stdout:7/17: fsync f0 0 2024-02-15T18:27:00.814 INFO:tasks.workunit.client.0.smithi084.stdout:4/283: link d2/d4/fb d2/d2b/f54 0 2024-02-15T18:27:00.814 INFO:tasks.workunit.client.0.smithi084.stdout:3/251: truncate d8/f1d 2100061 0 2024-02-15T18:27:00.815 INFO:tasks.workunit.client.1.smithi133.stdout:0/34: dwrite d9/fc [0,4194304] 0 2024-02-15T18:27:00.815 INFO:tasks.workunit.client.1.smithi133.stdout:0/35: read - f6 zero size 2024-02-15T18:27:00.815 INFO:tasks.workunit.client.0.smithi084.stdout:5/274: rename d9/cc to d9/d23/c5c 0 2024-02-15T18:27:00.816 INFO:tasks.workunit.client.0.smithi084.stdout:3/252: dread d8/f21 [0,4194304] 0 2024-02-15T18:27:00.816 INFO:tasks.workunit.client.0.smithi084.stdout:3/253: dread - d8/d22/f54 zero size 2024-02-15T18:27:00.816 INFO:tasks.workunit.client.0.smithi084.stdout:1/248: symlink d9/d54/d1b/d2c/d35/l55 0 2024-02-15T18:27:00.817 INFO:tasks.workunit.client.1.smithi133.stdout:2/68: rename d7/db/c10 to d7/d18/c1c 0 2024-02-15T18:27:00.817 INFO:tasks.workunit.client.0.smithi084.stdout:4/284: rmdir d2 39 2024-02-15T18:27:00.817 INFO:tasks.workunit.client.0.smithi084.stdout:4/285: write d2/d4/f4f [635634,17892] 0 2024-02-15T18:27:00.818 INFO:tasks.workunit.client.1.smithi133.stdout:1/40: dread d6/fc [0,4194304] 0 2024-02-15T18:27:00.818 INFO:tasks.workunit.client.0.smithi084.stdout:5/275: symlink d9/da/d3d/d44/d55/l5d 0 2024-02-15T18:27:00.818 INFO:tasks.workunit.client.0.smithi084.stdout:5/276: fsync d9/d23/f30 0 2024-02-15T18:27:00.819 INFO:tasks.workunit.client.1.smithi133.stdout:6/95: dwrite d0/f14 [0,4194304] 0 2024-02-15T18:27:00.819 INFO:tasks.workunit.client.1.smithi133.stdout:6/96: write d0/f12 [924943,10363] 0 2024-02-15T18:27:00.819 INFO:tasks.workunit.client.1.smithi133.stdout:6/97: getdents d0 0 2024-02-15T18:27:00.820 INFO:tasks.workunit.client.1.smithi133.stdout:7/18: unlink f3 0 2024-02-15T18:27:00.820 INFO:tasks.workunit.client.0.smithi084.stdout:9/189: read d4/de/ff [603277,40925] 0 2024-02-15T18:27:00.820 INFO:tasks.workunit.client.0.smithi084.stdout:1/249: creat d9/d54/d1b/f56 x:0 0 0 2024-02-15T18:27:00.821 INFO:tasks.workunit.client.1.smithi133.stdout:0/36: symlink d9/d10/l11 0 2024-02-15T18:27:00.821 INFO:tasks.workunit.client.0.smithi084.stdout:5/277: rename d9/da/d3d/d44/l4d to d9/d3a/l5e 0 2024-02-15T18:27:00.822 INFO:tasks.workunit.client.0.smithi084.stdout:5/278: fsync d9/d23/f57 0 2024-02-15T18:27:00.822 INFO:tasks.workunit.client.0.smithi084.stdout:5/279: chown d9/f2c 1799 1 2024-02-15T18:27:00.822 INFO:tasks.workunit.client.0.smithi084.stdout:9/190: write d4/de/f1c [668785,68087] 0 2024-02-15T18:27:00.822 INFO:tasks.workunit.client.0.smithi084.stdout:9/191: fdatasync d4/de/f3f 0 2024-02-15T18:27:00.824 INFO:tasks.workunit.client.1.smithi133.stdout:6/98: mknod d0/db/d21/c22 0 2024-02-15T18:27:00.825 INFO:tasks.workunit.client.0.smithi084.stdout:1/250: mkdir d9/dd/d36/d4f/d57 0 2024-02-15T18:27:00.825 INFO:tasks.workunit.client.0.smithi084.stdout:0/283: dwrite d0/d2f/d3f/f30 [0,4194304] 0 2024-02-15T18:27:00.827 INFO:tasks.workunit.client.0.smithi084.stdout:5/280: mkdir d9/d5f 0 2024-02-15T18:27:00.827 INFO:tasks.workunit.client.1.smithi133.stdout:0/37: rename l8 to d9/d10/l12 0 2024-02-15T18:27:00.827 INFO:tasks.workunit.client.0.smithi084.stdout:9/192: creat d4/de/d15/f40 x:0 0 0 2024-02-15T18:27:00.828 INFO:tasks.workunit.client.1.smithi133.stdout:9/58: rmdir d0/d8/d9 39 2024-02-15T18:27:00.831 INFO:tasks.workunit.client.0.smithi084.stdout:0/284: dread d0/d4/d1b/f3e [0,4194304] 0 2024-02-15T18:27:00.831 INFO:tasks.workunit.client.0.smithi084.stdout:0/285: readlink d0/d4/d1b/d26/l24 0 2024-02-15T18:27:00.832 INFO:tasks.workunit.client.1.smithi133.stdout:0/38: creat d9/d10/f13 x:0 0 0 2024-02-15T18:27:00.834 INFO:tasks.workunit.client.0.smithi084.stdout:4/286: dread d2/f15 [0,4194304] 0 2024-02-15T18:27:00.834 INFO:tasks.workunit.client.0.smithi084.stdout:0/286: creat d0/d4/f54 x:0 0 0 2024-02-15T18:27:00.835 INFO:tasks.workunit.client.1.smithi133.stdout:0/39: dread f4 [0,4194304] 0 2024-02-15T18:27:00.835 INFO:tasks.workunit.client.1.smithi133.stdout:0/40: chown f6 3581106 1 2024-02-15T18:27:00.837 INFO:tasks.workunit.client.0.smithi084.stdout:5/281: dread d9/d23/f37 [0,4194304] 0 2024-02-15T18:27:00.838 INFO:tasks.workunit.client.1.smithi133.stdout:1/41: rmdir d6 39 2024-02-15T18:27:00.838 INFO:tasks.workunit.client.1.smithi133.stdout:9/59: rename d0/d8/d9/fa to d0/d8/d9/ff 0 2024-02-15T18:27:00.838 INFO:tasks.workunit.client.1.smithi133.stdout:1/42: dread - d6/f8 zero size 2024-02-15T18:27:00.838 INFO:tasks.workunit.client.1.smithi133.stdout:1/43: stat d6/fd 0 2024-02-15T18:27:00.839 INFO:tasks.workunit.client.0.smithi084.stdout:1/251: dread d9/dd/f2f [0,4194304] 0 2024-02-15T18:27:00.839 INFO:tasks.workunit.client.0.smithi084.stdout:1/252: write d9/d54/d32/f49 [265310,51979] 0 2024-02-15T18:27:00.839 INFO:tasks.workunit.client.0.smithi084.stdout:4/287: creat d2/d4/f55 x:0 0 0 2024-02-15T18:27:00.839 INFO:tasks.workunit.client.0.smithi084.stdout:4/288: chown d2/d4/d28 635530598 1 2024-02-15T18:27:00.840 INFO:tasks.workunit.client.1.smithi133.stdout:6/99: dread d0/ff [0,4194304] 0 2024-02-15T18:27:00.840 INFO:tasks.workunit.client.1.smithi133.stdout:6/100: dread - d0/db/f18 zero size 2024-02-15T18:27:00.840 INFO:tasks.workunit.client.1.smithi133.stdout:6/101: write d0/ff [922139,58146] 0 2024-02-15T18:27:00.842 INFO:tasks.workunit.client.1.smithi133.stdout:6/102: dread d0/fd [0,4194304] 0 2024-02-15T18:27:00.842 INFO:tasks.workunit.client.1.smithi133.stdout:6/103: chown d0/db/f17 18 1 2024-02-15T18:27:00.842 INFO:tasks.workunit.client.1.smithi133.stdout:6/104: chown d0/f10 4826245 1 2024-02-15T18:27:00.843 INFO:tasks.workunit.client.0.smithi084.stdout:0/287: write d0/d25/f34 [1879714,126621] 0 2024-02-15T18:27:00.843 INFO:tasks.workunit.client.0.smithi084.stdout:3/254: dwrite d8/f1b [0,4194304] 0 2024-02-15T18:27:00.843 INFO:tasks.workunit.client.1.smithi133.stdout:0/41: truncate d9/fe 433430 0 2024-02-15T18:27:00.844 INFO:tasks.workunit.client.1.smithi133.stdout:6/105: dread d0/f9 [0,4194304] 0 2024-02-15T18:27:00.844 INFO:tasks.workunit.client.1.smithi133.stdout:1/44: rename c5 to d6/c11 0 2024-02-15T18:27:00.845 INFO:tasks.workunit.client.0.smithi084.stdout:0/288: creat d0/d4/d1b/f55 x:0 0 0 2024-02-15T18:27:00.845 INFO:tasks.workunit.client.1.smithi133.stdout:0/42: creat d9/f14 x:0 0 0 2024-02-15T18:27:00.846 INFO:tasks.workunit.client.0.smithi084.stdout:3/255: symlink d8/d22/l55 0 2024-02-15T18:27:00.846 INFO:tasks.workunit.client.0.smithi084.stdout:3/256: stat d8/d1f/d28/c3e 0 2024-02-15T18:27:00.846 INFO:tasks.workunit.client.0.smithi084.stdout:3/257: dread - d8/d1f/d2d/f3d zero size 2024-02-15T18:27:00.846 INFO:tasks.workunit.client.0.smithi084.stdout:5/282: write f8 [3140792,13752] 0 2024-02-15T18:27:00.850 INFO:tasks.workunit.client.0.smithi084.stdout:3/258: symlink d8/d1f/d2d/l56 0 2024-02-15T18:27:00.850 INFO:tasks.workunit.client.0.smithi084.stdout:9/193: dread d4/de/ff [0,4194304] 0 2024-02-15T18:27:00.850 INFO:tasks.workunit.client.0.smithi084.stdout:9/194: truncate d4/d2b/f3b 359084 0 2024-02-15T18:27:00.850 INFO:tasks.workunit.client.0.smithi084.stdout:5/283: creat d9/d3a/f60 x:0 0 0 2024-02-15T18:27:00.850 INFO:tasks.workunit.client.0.smithi084.stdout:5/284: write d9/f1e [4719847,10855] 0 2024-02-15T18:27:00.850 INFO:tasks.workunit.client.0.smithi084.stdout:3/259: symlink d8/d40/l57 0 2024-02-15T18:27:00.850 INFO:tasks.workunit.client.0.smithi084.stdout:3/260: fdatasync d8/f1d 0 2024-02-15T18:27:00.850 INFO:tasks.workunit.client.0.smithi084.stdout:3/261: write d8/d1f/d2d/f3d [254849,127479] 0 2024-02-15T18:27:00.851 INFO:tasks.workunit.client.0.smithi084.stdout:9/195: creat d4/f41 x:0 0 0 2024-02-15T18:27:00.851 INFO:tasks.workunit.client.0.smithi084.stdout:9/196: stat d4/d2b/c35 0 2024-02-15T18:27:00.852 INFO:tasks.workunit.client.1.smithi133.stdout:0/43: creat d9/f15 x:0 0 0 2024-02-15T18:27:00.852 INFO:tasks.workunit.client.1.smithi133.stdout:0/44: write d9/fa [815735,36520] 0 2024-02-15T18:27:00.852 INFO:tasks.workunit.client.1.smithi133.stdout:0/45: write f6 [599909,125054] 0 2024-02-15T18:27:00.852 INFO:tasks.workunit.client.1.smithi133.stdout:0/46: dread - f5 zero size 2024-02-15T18:27:00.853 INFO:tasks.workunit.client.0.smithi084.stdout:5/285: write d9/f10 [1235160,84515] 0 2024-02-15T18:27:00.854 INFO:tasks.workunit.client.1.smithi133.stdout:7/19: dwrite f0 [0,4194304] 0 2024-02-15T18:27:00.854 INFO:tasks.workunit.client.1.smithi133.stdout:7/20: fsync f0 0 2024-02-15T18:27:00.854 INFO:tasks.workunit.client.1.smithi133.stdout:0/47: mknod d9/c16 0 2024-02-15T18:27:00.854 INFO:tasks.workunit.client.1.smithi133.stdout:0/48: chown d9/c16 12332198 1 2024-02-15T18:27:00.855 INFO:tasks.workunit.client.0.smithi084.stdout:3/262: mkdir d8/d40/d58 0 2024-02-15T18:27:00.856 INFO:tasks.workunit.client.0.smithi084.stdout:3/263: write d8/fc [6578801,61156] 0 2024-02-15T18:27:00.857 INFO:tasks.workunit.client.1.smithi133.stdout:9/60: fdatasync d0/f7 0 2024-02-15T18:27:00.857 INFO:tasks.workunit.client.1.smithi133.stdout:7/21: link l4 l5 0 2024-02-15T18:27:00.857 INFO:tasks.workunit.client.0.smithi084.stdout:9/197: rename d4/d2b/d3c/c32 to d4/de/c42 0 2024-02-15T18:27:00.857 INFO:tasks.workunit.client.0.smithi084.stdout:5/286: mknod d9/d5f/c61 0 2024-02-15T18:27:00.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/61: mkdir d0/d8/d10 0 2024-02-15T18:27:00.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/62: dread - d0/d8/fd zero size 2024-02-15T18:27:00.861 INFO:tasks.workunit.client.1.smithi133.stdout:7/22: creat f6 x:0 0 0 2024-02-15T18:27:00.861 INFO:tasks.workunit.client.1.smithi133.stdout:7/23: dread - f6 zero size 2024-02-15T18:27:00.863 INFO:tasks.workunit.client.1.smithi133.stdout:9/63: rename d0/f1 to d0/d8/d10/f11 0 2024-02-15T18:27:00.863 INFO:tasks.workunit.client.0.smithi084.stdout:3/264: creat d8/d40/f59 x:0 0 0 2024-02-15T18:27:00.863 INFO:tasks.workunit.client.0.smithi084.stdout:9/198: rmdir d4/d36 39 2024-02-15T18:27:00.864 INFO:tasks.workunit.client.0.smithi084.stdout:9/199: read d4/de/f13 [3987374,100430] 0 2024-02-15T18:27:00.864 INFO:tasks.workunit.client.0.smithi084.stdout:9/200: fsync d4/d2b/d3c/f22 0 2024-02-15T18:27:00.864 INFO:tasks.workunit.client.0.smithi084.stdout:9/201: read - d4/de/d15/f37 zero size 2024-02-15T18:27:00.865 INFO:tasks.workunit.client.0.smithi084.stdout:5/287: dread d9/d23/f47 [0,4194304] 0 2024-02-15T18:27:00.865 INFO:tasks.workunit.client.1.smithi133.stdout:7/24: creat f7 x:0 0 0 2024-02-15T18:27:00.865 INFO:tasks.workunit.client.1.smithi133.stdout:7/25: chown f6 24 1 2024-02-15T18:27:00.865 INFO:tasks.workunit.client.1.smithi133.stdout:7/26: fdatasync f7 0 2024-02-15T18:27:00.866 INFO:tasks.workunit.client.1.smithi133.stdout:0/49: write d9/fe [565617,91380] 0 2024-02-15T18:27:00.869 INFO:tasks.workunit.client.1.smithi133.stdout:9/64: dread d0/f6 [0,4194304] 0 2024-02-15T18:27:00.869 INFO:tasks.workunit.client.0.smithi084.stdout:3/265: symlink d8/d1f/d28/l5a 0 2024-02-15T18:27:00.871 INFO:tasks.workunit.client.1.smithi133.stdout:1/45: dread f2 [0,4194304] 0 2024-02-15T18:27:00.874 INFO:tasks.workunit.client.0.smithi084.stdout:3/266: dread d8/d1f/d2d/f45 [0,4194304] 0 2024-02-15T18:27:00.874 INFO:tasks.workunit.client.0.smithi084.stdout:3/267: fdatasync d8/d22/f34 0 2024-02-15T18:27:00.874 INFO:tasks.workunit.client.0.smithi084.stdout:3/268: write d8/d1f/d2d/f45 [1588396,85991] 0 2024-02-15T18:27:00.874 INFO:tasks.workunit.client.0.smithi084.stdout:3/269: chown d8/d22/f26 0 1 2024-02-15T18:27:00.874 INFO:tasks.workunit.client.0.smithi084.stdout:3/270: chown d8/d1f/d2d/l56 42322550 1 2024-02-15T18:27:00.883 INFO:tasks.workunit.client.1.smithi133.stdout:2/69: dwrite d7/ff [0,4194304] 0 2024-02-15T18:27:00.884 INFO:tasks.workunit.client.0.smithi084.stdout:4/289: dwrite d2/d4/d25/f51 [0,4194304] 0 2024-02-15T18:27:00.884 INFO:tasks.workunit.client.0.smithi084.stdout:4/290: chown d2/d2b/f54 65404133 1 2024-02-15T18:27:00.884 INFO:tasks.workunit.client.0.smithi084.stdout:1/253: dwrite d9/dd/f13 [0,4194304] 0 2024-02-15T18:27:00.887 INFO:tasks.workunit.client.1.smithi133.stdout:6/106: truncate d0/f12 541452 0 2024-02-15T18:27:00.889 INFO:tasks.workunit.client.1.smithi133.stdout:6/107: dread d0/db/f17 [0,4194304] 0 2024-02-15T18:27:00.889 INFO:tasks.workunit.client.0.smithi084.stdout:9/202: rename d4/de to d4/d2b/d3c/d20/d43 0 2024-02-15T18:27:00.891 INFO:tasks.workunit.client.1.smithi133.stdout:6/108: creat d0/db/d21/f23 x:0 0 0 2024-02-15T18:27:00.893 INFO:tasks.workunit.client.1.smithi133.stdout:6/109: creat d0/f24 x:0 0 0 2024-02-15T18:27:00.897 INFO:tasks.workunit.client.1.smithi133.stdout:9/65: dwrite d0/f6 [0,4194304] 0 2024-02-15T18:27:00.898 INFO:tasks.workunit.client.0.smithi084.stdout:4/291: creat d2/d2b/d47/f56 x:0 0 0 2024-02-15T18:27:00.898 INFO:tasks.workunit.client.1.smithi133.stdout:6/110: creat d0/db/f25 x:0 0 0 2024-02-15T18:27:00.898 INFO:tasks.workunit.client.1.smithi133.stdout:6/111: fdatasync d0/db/f17 0 2024-02-15T18:27:00.899 INFO:tasks.workunit.client.1.smithi133.stdout:9/66: mkdir d0/d8/d9/d12 0 2024-02-15T18:27:00.900 INFO:tasks.workunit.client.1.smithi133.stdout:9/67: stat d0/d8/d10 0 2024-02-15T18:27:00.900 INFO:tasks.workunit.client.0.smithi084.stdout:3/271: rename c7 to d8/c5b 0 2024-02-15T18:27:00.901 INFO:tasks.workunit.client.1.smithi133.stdout:6/112: creat d0/f26 x:0 0 0 2024-02-15T18:27:00.901 INFO:tasks.workunit.client.1.smithi133.stdout:6/113: readlink d0/d5/le 0 2024-02-15T18:27:00.904 INFO:tasks.workunit.client.0.smithi084.stdout:9/203: creat d4/d2b/d3c/d20/d43/d15/f44 x:0 0 0 2024-02-15T18:27:00.905 INFO:tasks.workunit.client.1.smithi133.stdout:6/114: creat d0/f27 x:0 0 0 2024-02-15T18:27:00.907 INFO:tasks.workunit.client.0.smithi084.stdout:9/204: creat d4/d36/f45 x:0 0 0 2024-02-15T18:27:00.908 INFO:tasks.workunit.client.0.smithi084.stdout:9/205: mkdir d4/d2b/d3c/d24/d46 0 2024-02-15T18:27:00.910 INFO:tasks.workunit.client.1.smithi133.stdout:6/115: mknod d0/c28 0 2024-02-15T18:27:00.911 INFO:tasks.workunit.client.0.smithi084.stdout:9/206: rename d4/d2b/d3c/d20/d43/f12 to d4/d2b/d3c/d20/d43/d15/f47 0 2024-02-15T18:27:00.911 INFO:tasks.workunit.client.1.smithi133.stdout:9/68: getdents d0 0 2024-02-15T18:27:00.912 INFO:tasks.workunit.client.1.smithi133.stdout:9/69: write d0/d8/d9/ff [3579467,42155] 0 2024-02-15T18:27:00.915 INFO:tasks.workunit.client.1.smithi133.stdout:6/116: rmdir d0/db/d1c 39 2024-02-15T18:27:00.915 INFO:tasks.workunit.client.1.smithi133.stdout:6/117: truncate d0/d5/f13 1017852 0 2024-02-15T18:27:00.915 INFO:tasks.workunit.client.1.smithi133.stdout:6/118: chown d0/f26 755036608 1 2024-02-15T18:27:00.918 INFO:tasks.workunit.client.0.smithi084.stdout:9/207: rmdir d4/d2b/d3c/d24/d46 0 2024-02-15T18:27:00.918 INFO:tasks.workunit.client.0.smithi084.stdout:9/208: readlink d4/d2b/d3c/d20/d43/d15/l2d 0 2024-02-15T18:27:00.920 INFO:tasks.workunit.client.0.smithi084.stdout:9/209: mkdir d4/d2b/d3c/d20/d43/d15/d48 0 2024-02-15T18:27:00.920 INFO:tasks.workunit.client.0.smithi084.stdout:9/210: write d4/d2b/d3c/f23 [3129942,87342] 0 2024-02-15T18:27:00.920 INFO:tasks.workunit.client.1.smithi133.stdout:2/70: dread d7/f15 [0,4194304] 0 2024-02-15T18:27:00.922 INFO:tasks.workunit.client.1.smithi133.stdout:2/71: rename d7/db/fc to d7/db/f1d 0 2024-02-15T18:27:00.928 INFO:tasks.workunit.client.0.smithi084.stdout:5/288: dwrite f8 [4194304,4194304] 0 2024-02-15T18:27:00.929 INFO:tasks.workunit.client.0.smithi084.stdout:5/289: dread - d9/d23/d33/f3e zero size 2024-02-15T18:27:00.929 INFO:tasks.workunit.client.1.smithi133.stdout:1/46: dwrite d6/fc [0,4194304] 0 2024-02-15T18:27:00.929 INFO:tasks.workunit.client.0.smithi084.stdout:8/300: sync 2024-02-15T18:27:00.931 INFO:tasks.workunit.client.0.smithi084.stdout:8/301: link db/dd/l67 db/dd/d4d/l68 0 2024-02-15T18:27:00.931 INFO:tasks.workunit.client.1.smithi133.stdout:1/47: getdents d6 0 2024-02-15T18:27:00.932 INFO:tasks.workunit.client.0.smithi084.stdout:8/302: mkdir db/d3f/d59/d69 0 2024-02-15T18:27:00.934 INFO:tasks.workunit.client.0.smithi084.stdout:8/303: unlink db/dd/f14 0 2024-02-15T18:27:00.934 INFO:tasks.workunit.client.0.smithi084.stdout:9/211: dread d4/d2b/f2f [0,4194304] 0 2024-02-15T18:27:00.935 INFO:tasks.workunit.client.1.smithi133.stdout:6/119: rmdir d0/db/d21 39 2024-02-15T18:27:00.936 INFO:tasks.workunit.client.1.smithi133.stdout:1/48: symlink d6/l12 0 2024-02-15T18:27:00.936 INFO:tasks.workunit.client.0.smithi084.stdout:9/212: truncate d4/d2b/d3c/d20/d43/d15/f28 818768 0 2024-02-15T18:27:00.936 INFO:tasks.workunit.client.1.smithi133.stdout:6/120: mkdir d0/db/d29 0 2024-02-15T18:27:00.938 INFO:tasks.workunit.client.1.smithi133.stdout:1/49: creat d6/f13 x:0 0 0 2024-02-15T18:27:00.938 INFO:tasks.workunit.client.1.smithi133.stdout:0/50: dwrite d9/fa [0,4194304] 0 2024-02-15T18:27:00.939 INFO:tasks.workunit.client.1.smithi133.stdout:0/51: truncate f0 867337 0 2024-02-15T18:27:00.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/272: dwrite d8/d22/f26 [0,4194304] 0 2024-02-15T18:27:00.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/273: truncate d8/d1f/d2d/f45 2555164 0 2024-02-15T18:27:00.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/274: write d8/f48 [753692,109604] 0 2024-02-15T18:27:00.941 INFO:tasks.workunit.client.1.smithi133.stdout:0/52: creat d9/d10/f17 x:0 0 0 2024-02-15T18:27:00.942 INFO:tasks.workunit.client.0.smithi084.stdout:9/213: dread d4/d2b/d3c/f22 [0,4194304] 0 2024-02-15T18:27:00.943 INFO:tasks.workunit.client.0.smithi084.stdout:3/275: symlink d8/d40/d43/l5c 0 2024-02-15T18:27:00.943 INFO:tasks.workunit.client.1.smithi133.stdout:0/53: unlink d9/d10/f13 0 2024-02-15T18:27:00.943 INFO:tasks.workunit.client.1.smithi133.stdout:0/54: chown d9/fa 92802792 1 2024-02-15T18:27:00.944 INFO:tasks.workunit.client.1.smithi133.stdout:0/55: fsync d9/ff 0 2024-02-15T18:27:00.944 INFO:tasks.workunit.client.1.smithi133.stdout:0/56: read - d9/f14 zero size 2024-02-15T18:27:00.944 INFO:tasks.workunit.client.0.smithi084.stdout:9/214: creat d4/d2b/d3c/f49 x:0 0 0 2024-02-15T18:27:00.944 INFO:tasks.workunit.client.0.smithi084.stdout:9/215: dread - d4/d2b/d3c/d20/d43/f3f zero size 2024-02-15T18:27:00.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/276: rename d8/d1f/d2d/f45 to d8/d1f/d2d/f5d 0 2024-02-15T18:27:00.946 INFO:tasks.workunit.client.0.smithi084.stdout:8/304: dread db/f25 [0,4194304] 0 2024-02-15T18:27:00.946 INFO:tasks.workunit.client.0.smithi084.stdout:8/305: chown db/dd/d1f/d3e 48665 1 2024-02-15T18:27:00.946 INFO:tasks.workunit.client.0.smithi084.stdout:8/306: fsync db/f3a 0 2024-02-15T18:27:00.946 INFO:tasks.workunit.client.0.smithi084.stdout:9/216: symlink d4/d2b/d3c/l4a 0 2024-02-15T18:27:00.946 INFO:tasks.workunit.client.0.smithi084.stdout:9/217: chown d4/d36/f45 190 1 2024-02-15T18:27:00.947 INFO:tasks.workunit.client.0.smithi084.stdout:9/218: dread - d4/d2b/d3c/d20/d43/d15/f37 zero size 2024-02-15T18:27:00.947 INFO:tasks.workunit.client.0.smithi084.stdout:9/219: write d4/d2b/f2f [2069653,23599] 0 2024-02-15T18:27:00.948 INFO:tasks.workunit.client.0.smithi084.stdout:8/307: write db/f16 [1808610,88740] 0 2024-02-15T18:27:00.948 INFO:tasks.workunit.client.0.smithi084.stdout:8/308: readlink db/dd/l24 0 2024-02-15T18:27:00.948 INFO:tasks.workunit.client.0.smithi084.stdout:3/277: rename d8/d1f/f44 to d8/d40/d58/f5e 0 2024-02-15T18:27:00.949 INFO:tasks.workunit.client.0.smithi084.stdout:9/220: mkdir d4/d2b/d3c/d20/d43/d15/d4b 0 2024-02-15T18:27:00.952 INFO:tasks.workunit.client.0.smithi084.stdout:3/278: creat d8/d1f/d28/f5f x:0 0 0 2024-02-15T18:27:00.952 INFO:tasks.workunit.client.0.smithi084.stdout:9/221: truncate d4/f19 2195860 0 2024-02-15T18:27:00.952 INFO:tasks.workunit.client.0.smithi084.stdout:4/292: dwrite d2/d4/f7 [0,4194304] 0 2024-02-15T18:27:00.952 INFO:tasks.workunit.client.0.smithi084.stdout:9/222: write d4/d2b/d3c/d20/d43/d15/f47 [2051962,7759] 0 2024-02-15T18:27:00.952 INFO:tasks.workunit.client.0.smithi084.stdout:3/279: mknod d8/c60 0 2024-02-15T18:27:00.952 INFO:tasks.workunit.client.0.smithi084.stdout:9/223: truncate d4/d36/f45 58867 0 2024-02-15T18:27:00.952 INFO:tasks.workunit.client.0.smithi084.stdout:9/224: chown d4/d2b/d3c/l4a 489 1 2024-02-15T18:27:00.953 INFO:tasks.workunit.client.0.smithi084.stdout:3/280: creat d8/d40/d58/f61 x:0 0 0 2024-02-15T18:27:00.953 INFO:tasks.workunit.client.0.smithi084.stdout:3/281: rename d8/d1f to d8/d1f/d25/d62 22 2024-02-15T18:27:00.953 INFO:tasks.workunit.client.0.smithi084.stdout:9/225: rename d4/d2b/f2f to d4/d2b/f4c 0 2024-02-15T18:27:00.953 INFO:tasks.workunit.client.0.smithi084.stdout:9/226: stat d4/d2b/d3c/d20/d43/f1f 0 2024-02-15T18:27:00.957 INFO:tasks.workunit.client.1.smithi133.stdout:2/72: dwrite d7/f13 [0,4194304] 0 2024-02-15T18:27:00.958 INFO:tasks.workunit.client.1.smithi133.stdout:2/73: stat d7/f16 0 2024-02-15T18:27:00.958 INFO:tasks.workunit.client.1.smithi133.stdout:2/74: write f1 [2720440,111831] 0 2024-02-15T18:27:00.959 INFO:tasks.workunit.client.0.smithi084.stdout:8/309: dread db/d3f/f54 [0,4194304] 0 2024-02-15T18:27:00.959 INFO:tasks.workunit.client.1.smithi133.stdout:9/70: dwrite d0/f7 [0,4194304] 0 2024-02-15T18:27:00.960 INFO:tasks.workunit.client.1.smithi133.stdout:1/50: dwrite d6/fd [0,4194304] 0 2024-02-15T18:27:00.960 INFO:tasks.workunit.client.1.smithi133.stdout:1/51: chown f2 4080764 1 2024-02-15T18:27:00.960 INFO:tasks.workunit.client.0.smithi084.stdout:9/227: rename d4/d2b/d3c/f23 to d4/f4d 0 2024-02-15T18:27:00.960 INFO:tasks.workunit.client.0.smithi084.stdout:9/228: chown d4/d2b/d3c/d20/d43/c42 1583289 1 2024-02-15T18:27:00.960 INFO:tasks.workunit.client.0.smithi084.stdout:9/229: dread - d4/f41 zero size 2024-02-15T18:27:00.961 INFO:tasks.workunit.client.0.smithi084.stdout:8/310: mkdir db/d6a 0 2024-02-15T18:27:00.962 INFO:tasks.workunit.client.0.smithi084.stdout:4/293: dread d2/d4/f7 [0,4194304] 0 2024-02-15T18:27:00.962 INFO:tasks.workunit.client.1.smithi133.stdout:6/121: getdents d0/db 0 2024-02-15T18:27:00.962 INFO:tasks.workunit.client.1.smithi133.stdout:6/122: stat d0 0 2024-02-15T18:27:00.962 INFO:tasks.workunit.client.1.smithi133.stdout:6/123: chown d0/d5/f13 0 1 2024-02-15T18:27:00.963 INFO:tasks.workunit.client.1.smithi133.stdout:9/71: mknod d0/d8/d9/d12/c13 0 2024-02-15T18:27:00.965 INFO:tasks.workunit.client.0.smithi084.stdout:8/311: dread db/d1a/d2b/f4b [0,4194304] 0 2024-02-15T18:27:00.965 INFO:tasks.workunit.client.0.smithi084.stdout:8/312: chown db/dd/d1f/d66 663270001 1 2024-02-15T18:27:00.966 INFO:tasks.workunit.client.1.smithi133.stdout:9/72: creat d0/d8/d10/f14 x:0 0 0 2024-02-15T18:27:00.966 INFO:tasks.workunit.client.1.smithi133.stdout:9/73: fdatasync d0/d8/fd 0 2024-02-15T18:27:00.972 INFO:tasks.workunit.client.1.smithi133.stdout:1/52: mknod d6/c14 0 2024-02-15T18:27:00.973 INFO:tasks.workunit.client.1.smithi133.stdout:9/74: creat d0/d8/d10/f15 x:0 0 0 2024-02-15T18:27:00.973 INFO:tasks.workunit.client.1.smithi133.stdout:9/75: read - d0/d8/d10/f15 zero size 2024-02-15T18:27:00.973 INFO:tasks.workunit.client.1.smithi133.stdout:9/76: truncate d0/d8/d10/f14 935894 0 2024-02-15T18:27:00.974 INFO:tasks.workunit.client.0.smithi084.stdout:9/230: dread d4/d2b/d3c/d20/d43/f13 [0,4194304] 0 2024-02-15T18:27:00.974 INFO:tasks.workunit.client.0.smithi084.stdout:9/231: chown d4/d2b/f4c 381554240 1 2024-02-15T18:27:00.977 INFO:tasks.workunit.client.1.smithi133.stdout:9/77: creat d0/f16 x:0 0 0 2024-02-15T18:27:00.979 INFO:tasks.workunit.client.1.smithi133.stdout:2/75: dread f1 [0,4194304] 0 2024-02-15T18:27:00.983 INFO:tasks.workunit.client.1.smithi133.stdout:2/76: symlink d7/d18/l1e 0 2024-02-15T18:27:00.985 INFO:tasks.workunit.client.1.smithi133.stdout:2/77: dread d7/f14 [0,4194304] 0 2024-02-15T18:27:00.987 INFO:tasks.workunit.client.1.smithi133.stdout:2/78: rename c5 to d7/db/c1f 0 2024-02-15T18:27:00.987 INFO:tasks.workunit.client.1.smithi133.stdout:2/79: chown d7/ff 1024856081 1 2024-02-15T18:27:00.987 INFO:tasks.workunit.client.1.smithi133.stdout:2/80: dread - d7/db/f1b zero size 2024-02-15T18:27:00.987 INFO:tasks.workunit.client.1.smithi133.stdout:2/81: fdatasync d7/ff 0 2024-02-15T18:27:00.993 INFO:tasks.workunit.client.0.smithi084.stdout:3/282: dwrite d8/fc [0,4194304] 0 2024-02-15T18:27:00.993 INFO:tasks.workunit.client.0.smithi084.stdout:3/283: dread - d8/d40/f59 zero size 2024-02-15T18:27:00.993 INFO:tasks.workunit.client.0.smithi084.stdout:3/284: readlink d8/l1a 0 2024-02-15T18:27:00.994 INFO:tasks.workunit.client.1.smithi133.stdout:6/124: dwrite d0/fd [0,4194304] 0 2024-02-15T18:27:00.994 INFO:tasks.workunit.client.1.smithi133.stdout:0/57: dwrite d9/f15 [0,4194304] 0 2024-02-15T18:27:00.994 INFO:tasks.workunit.client.0.smithi084.stdout:4/294: dwrite d2/d4/f1c [0,4194304] 0 2024-02-15T18:27:00.995 INFO:tasks.workunit.client.1.smithi133.stdout:1/53: rmdir d6 39 2024-02-15T18:27:00.996 INFO:tasks.workunit.client.0.smithi084.stdout:3/285: rename d8/l17 to d8/l63 0 2024-02-15T18:27:00.996 INFO:tasks.workunit.client.0.smithi084.stdout:3/286: write d8/d40/d43/f4d [287466,37794] 0 2024-02-15T18:27:00.999 INFO:tasks.workunit.client.0.smithi084.stdout:4/295: rename d2/d4/fb to d2/d4/d28/d2e/f57 0 2024-02-15T18:27:00.999 INFO:tasks.workunit.client.0.smithi084.stdout:4/296: fdatasync d2/d4/f4f 0 2024-02-15T18:27:01.002 INFO:tasks.workunit.client.0.smithi084.stdout:9/232: dread d4/d2b/d3c/d20/d43/d15/f28 [0,4194304] 0 2024-02-15T18:27:01.002 INFO:tasks.workunit.client.0.smithi084.stdout:6/276: sync 2024-02-15T18:27:01.002 INFO:tasks.workunit.client.0.smithi084.stdout:7/274: sync 2024-02-15T18:27:01.003 INFO:tasks.workunit.client.0.smithi084.stdout:6/277: truncate d14/d22/d25/d2f/d31/d3f/d4a/f4c 4337195 0 2024-02-15T18:27:01.003 INFO:tasks.workunit.client.0.smithi084.stdout:6/278: dread - d14/d22/d25/d2f/d31/d30/d45/d54/f57 zero size 2024-02-15T18:27:01.003 INFO:tasks.workunit.client.0.smithi084.stdout:7/275: write df/f4c [708035,72423] 0 2024-02-15T18:27:01.003 INFO:tasks.workunit.client.1.smithi133.stdout:0/58: unlink d9/f15 0 2024-02-15T18:27:01.003 INFO:tasks.workunit.client.1.smithi133.stdout:0/59: write d9/fe [716298,115608] 0 2024-02-15T18:27:01.003 INFO:tasks.workunit.client.1.smithi133.stdout:0/60: chown d9/cd 3049 1 2024-02-15T18:27:01.003 INFO:tasks.workunit.client.1.smithi133.stdout:6/125: rmdir d0/d5 39 2024-02-15T18:27:01.004 INFO:tasks.workunit.client.0.smithi084.stdout:9/233: dread d4/d2b/d3c/f22 [0,4194304] 0 2024-02-15T18:27:01.004 INFO:tasks.workunit.client.0.smithi084.stdout:9/234: write d4/d2b/d3c/d20/d43/d15/f44 [1024965,5850] 0 2024-02-15T18:27:01.004 INFO:tasks.workunit.client.0.smithi084.stdout:9/235: readlink d4/d36/l39 0 2024-02-15T18:27:01.004 INFO:tasks.workunit.client.0.smithi084.stdout:9/236: stat d4/d2b/d3c/d20/d43/f3f 0 2024-02-15T18:27:01.005 INFO:tasks.workunit.client.0.smithi084.stdout:4/297: rename d2/d4/c1d to d2/d4/c58 0 2024-02-15T18:27:01.005 INFO:tasks.workunit.client.0.smithi084.stdout:6/279: mknod d14/d22/d25/d2f/d31/d30/d4f/c58 0 2024-02-15T18:27:01.005 INFO:tasks.workunit.client.0.smithi084.stdout:4/298: chown d2/f39 82182 1 2024-02-15T18:27:01.006 INFO:tasks.workunit.client.0.smithi084.stdout:7/276: getdents df/d1d/d40/d48 0 2024-02-15T18:27:01.006 INFO:tasks.workunit.client.0.smithi084.stdout:7/277: fsync f5 0 2024-02-15T18:27:01.006 INFO:tasks.workunit.client.1.smithi133.stdout:1/54: write d6/fe [802725,90532] 0 2024-02-15T18:27:01.006 INFO:tasks.workunit.client.1.smithi133.stdout:6/126: rmdir d0/db/d21 39 2024-02-15T18:27:01.007 INFO:tasks.workunit.client.0.smithi084.stdout:9/237: symlink d4/d2b/l4e 0 2024-02-15T18:27:01.007 INFO:tasks.workunit.client.0.smithi084.stdout:9/238: chown d4/d2b/f4c 425 1 2024-02-15T18:27:01.009 INFO:tasks.workunit.client.1.smithi133.stdout:6/127: getdents d0/db/d21 0 2024-02-15T18:27:01.010 INFO:tasks.workunit.client.0.smithi084.stdout:6/280: link d14/l21 d14/l59 0 2024-02-15T18:27:01.010 INFO:tasks.workunit.client.0.smithi084.stdout:9/239: rename d4/d2b/d3c/d20/d43/d15/d48 to d4/d2b/d3c/d20/d43/d15/d4f 0 2024-02-15T18:27:01.011 INFO:tasks.workunit.client.1.smithi133.stdout:6/128: symlink d0/db/d1c/l2a 0 2024-02-15T18:27:01.011 INFO:tasks.workunit.client.0.smithi084.stdout:6/281: mknod d14/d22/d25/d2f/d31/d3f/d4a/c5a 0 2024-02-15T18:27:01.011 INFO:tasks.workunit.client.0.smithi084.stdout:6/282: chown d14/d22/d25/d41/c4d 6795428 1 2024-02-15T18:27:01.012 INFO:tasks.workunit.client.1.smithi133.stdout:1/55: rename d6/f8 to d6/f15 0 2024-02-15T18:27:01.012 INFO:tasks.workunit.client.0.smithi084.stdout:9/240: unlink d4/d2b/d3c/c3a 0 2024-02-15T18:27:01.013 INFO:tasks.workunit.client.0.smithi084.stdout:9/241: fdatasync d4/f4d 0 2024-02-15T18:27:01.013 INFO:tasks.workunit.client.0.smithi084.stdout:6/283: mknod d14/d22/c5b 0 2024-02-15T18:27:01.013 INFO:tasks.workunit.client.1.smithi133.stdout:6/129: dread d0/ff [0,4194304] 0 2024-02-15T18:27:01.013 INFO:tasks.workunit.client.1.smithi133.stdout:1/56: creat d6/f16 x:0 0 0 2024-02-15T18:27:01.014 INFO:tasks.workunit.client.0.smithi084.stdout:9/242: creat d4/d2b/f50 x:0 0 0 2024-02-15T18:27:01.015 INFO:tasks.workunit.client.1.smithi133.stdout:6/130: getdents d0 0 2024-02-15T18:27:01.015 INFO:tasks.workunit.client.1.smithi133.stdout:6/131: fsync d0/db/f25 0 2024-02-15T18:27:01.015 INFO:tasks.workunit.client.1.smithi133.stdout:2/82: dwrite d7/db/f1d [0,4194304] 0 2024-02-15T18:27:01.016 INFO:tasks.workunit.client.0.smithi084.stdout:9/243: creat d4/d2b/d3c/d20/d43/d15/d4b/f51 x:0 0 0 2024-02-15T18:27:01.016 INFO:tasks.workunit.client.0.smithi084.stdout:9/244: chown d4/d2b/d3c/d20/d43/d15/f47 43 1 2024-02-15T18:27:01.017 INFO:tasks.workunit.client.1.smithi133.stdout:6/132: mknod d0/db/d1c/c2b 0 2024-02-15T18:27:01.017 INFO:tasks.workunit.client.1.smithi133.stdout:6/133: stat d0/d5/f13 0 2024-02-15T18:27:01.019 INFO:tasks.workunit.client.1.smithi133.stdout:1/57: mkdir d6/d17 0 2024-02-15T18:27:01.019 INFO:tasks.workunit.client.1.smithi133.stdout:1/58: dread - d6/f13 zero size 2024-02-15T18:27:01.019 INFO:tasks.workunit.client.1.smithi133.stdout:6/134: truncate d0/f14 3567458 0 2024-02-15T18:27:01.020 INFO:tasks.workunit.client.1.smithi133.stdout:1/59: link f1 d6/d17/f18 0 2024-02-15T18:27:01.021 INFO:tasks.workunit.client.1.smithi133.stdout:6/135: mknod d0/db/d1c/c2c 0 2024-02-15T18:27:01.024 INFO:tasks.workunit.client.1.smithi133.stdout:6/136: unlink d0/db/d1c/c1e 0 2024-02-15T18:27:01.026 INFO:tasks.workunit.client.1.smithi133.stdout:6/137: dread d0/d5/f13 [0,4194304] 0 2024-02-15T18:27:01.026 INFO:tasks.workunit.client.1.smithi133.stdout:1/60: mknod d6/c19 0 2024-02-15T18:27:01.028 INFO:tasks.workunit.client.1.smithi133.stdout:6/138: creat d0/f2d x:0 0 0 2024-02-15T18:27:01.028 INFO:tasks.workunit.client.1.smithi133.stdout:6/139: write d0/db/f17 [2406098,85504] 0 2024-02-15T18:27:01.028 INFO:tasks.workunit.client.1.smithi133.stdout:1/61: creat d6/d17/f1a x:0 0 0 2024-02-15T18:27:01.028 INFO:tasks.workunit.client.1.smithi133.stdout:1/62: write d6/f16 [555402,58234] 0 2024-02-15T18:27:01.031 INFO:tasks.workunit.client.0.smithi084.stdout:4/299: dwrite d2/d4/f20 [0,4194304] 0 2024-02-15T18:27:01.034 INFO:tasks.workunit.client.0.smithi084.stdout:6/284: dwrite d14/f17 [0,4194304] 0 2024-02-15T18:27:01.034 INFO:tasks.workunit.client.0.smithi084.stdout:6/285: fsync d14/d22/d25/f2b 0 2024-02-15T18:27:01.038 INFO:tasks.workunit.client.1.smithi133.stdout:1/63: getdents d6 0 2024-02-15T18:27:01.038 INFO:tasks.workunit.client.1.smithi133.stdout:1/64: write d6/f13 [121941,38210] 0 2024-02-15T18:27:01.039 INFO:tasks.workunit.client.1.smithi133.stdout:1/65: fdatasync d6/ff 0 2024-02-15T18:27:01.039 INFO:tasks.workunit.client.1.smithi133.stdout:1/66: write d6/d17/f1a [636602,74057] 0 2024-02-15T18:27:01.040 INFO:tasks.workunit.client.0.smithi084.stdout:9/245: getdents d4/d2b/d3c 0 2024-02-15T18:27:01.040 INFO:tasks.workunit.client.0.smithi084.stdout:4/300: symlink d2/d4/d25/l59 0 2024-02-15T18:27:01.040 INFO:tasks.workunit.client.0.smithi084.stdout:9/246: dread d4/f29 [0,4194304] 0 2024-02-15T18:27:01.041 INFO:tasks.workunit.client.0.smithi084.stdout:9/247: chown d4/d2b/d3c/d20/d43/d15/f40 19944 1 2024-02-15T18:27:01.041 INFO:tasks.workunit.client.1.smithi133.stdout:1/67: rmdir d6 39 2024-02-15T18:27:01.041 INFO:tasks.workunit.client.0.smithi084.stdout:6/286: mkdir d14/d22/d25/d2f/d31/d30/d45/d5c 0 2024-02-15T18:27:01.041 INFO:tasks.workunit.client.0.smithi084.stdout:6/287: chown d14/d22/d25/d2f/d31/d30/d4f 40337 1 2024-02-15T18:27:01.041 INFO:tasks.workunit.client.0.smithi084.stdout:6/288: readlink d14/d22/d25/d2f/l56 0 2024-02-15T18:27:01.043 INFO:tasks.workunit.client.0.smithi084.stdout:4/301: creat d2/d4/f5a x:0 0 0 2024-02-15T18:27:01.043 INFO:tasks.workunit.client.0.smithi084.stdout:9/248: creat d4/d2b/d3c/d20/f52 x:0 0 0 2024-02-15T18:27:01.044 INFO:tasks.workunit.client.1.smithi133.stdout:1/68: creat d6/d17/f1b x:0 0 0 2024-02-15T18:27:01.044 INFO:tasks.workunit.client.1.smithi133.stdout:2/83: dwrite d7/f16 [0,4194304] 0 2024-02-15T18:27:01.044 INFO:tasks.workunit.client.1.smithi133.stdout:2/84: chown d7/f15 57409 1 2024-02-15T18:27:01.045 INFO:tasks.workunit.client.1.smithi133.stdout:1/69: creat d6/d17/f1c x:0 0 0 2024-02-15T18:27:01.045 INFO:tasks.workunit.client.1.smithi133.stdout:1/70: chown d6/d17/f1a 4 1 2024-02-15T18:27:01.046 INFO:tasks.workunit.client.1.smithi133.stdout:2/85: write d7/f15 [2179735,68610] 0 2024-02-15T18:27:01.046 INFO:tasks.workunit.client.0.smithi084.stdout:4/302: dread d2/d2b/f1f [0,4194304] 0 2024-02-15T18:27:01.046 INFO:tasks.workunit.client.0.smithi084.stdout:4/303: stat d2/d4/d28 0 2024-02-15T18:27:01.046 INFO:tasks.workunit.client.0.smithi084.stdout:9/249: creat d4/d2b/d3c/d20/d43/d15/d33/f53 x:0 0 0 2024-02-15T18:27:01.048 INFO:tasks.workunit.client.0.smithi084.stdout:9/250: link d4/d2b/d3c/d20/d43/l10 d4/d2b/d3c/d20/d43/d15/d4f/l54 0 2024-02-15T18:27:01.048 INFO:tasks.workunit.client.0.smithi084.stdout:9/251: write d4/d36/f45 [268242,82274] 0 2024-02-15T18:27:01.048 INFO:tasks.workunit.client.1.smithi133.stdout:1/71: creat d6/d17/f1d x:0 0 0 2024-02-15T18:27:01.048 INFO:tasks.workunit.client.1.smithi133.stdout:1/72: dread - d6/f15 zero size 2024-02-15T18:27:01.048 INFO:tasks.workunit.client.1.smithi133.stdout:2/86: creat d7/f20 x:0 0 0 2024-02-15T18:27:01.050 INFO:tasks.workunit.client.1.smithi133.stdout:2/87: creat d7/db/f21 x:0 0 0 2024-02-15T18:27:01.050 INFO:tasks.workunit.client.1.smithi133.stdout:1/73: dread d6/fe [0,4194304] 0 2024-02-15T18:27:01.051 INFO:tasks.workunit.client.0.smithi084.stdout:9/252: unlink d4/ca 0 2024-02-15T18:27:01.051 INFO:tasks.workunit.client.0.smithi084.stdout:6/289: dread f9 [0,4194304] 0 2024-02-15T18:27:01.051 INFO:tasks.workunit.client.0.smithi084.stdout:9/253: write d4/d2b/d3c/d20/d43/f1f [1701625,70474] 0 2024-02-15T18:27:01.051 INFO:tasks.workunit.client.0.smithi084.stdout:6/290: mknod d14/d22/d25/d2f/d31/c5d 0 2024-02-15T18:27:01.051 INFO:tasks.workunit.client.1.smithi133.stdout:2/88: mknod d7/d18/c22 0 2024-02-15T18:27:01.052 INFO:tasks.workunit.client.0.smithi084.stdout:9/254: mknod d4/d2b/d3c/d20/c55 0 2024-02-15T18:27:01.052 INFO:tasks.workunit.client.0.smithi084.stdout:9/255: rename d4/d2b/d3c to d4/d2b/d3c/d56 22 2024-02-15T18:27:01.053 INFO:tasks.workunit.client.1.smithi133.stdout:1/74: mkdir d6/d1e 0 2024-02-15T18:27:01.053 INFO:tasks.workunit.client.0.smithi084.stdout:4/304: dread d2/d4/fe [0,4194304] 0 2024-02-15T18:27:01.053 INFO:tasks.workunit.client.0.smithi084.stdout:9/256: dread d4/f29 [0,4194304] 0 2024-02-15T18:27:01.055 INFO:tasks.workunit.client.0.smithi084.stdout:6/291: dread fb [0,4194304] 0 2024-02-15T18:27:01.055 INFO:tasks.workunit.client.0.smithi084.stdout:6/292: write d14/d22/d25/d2f/d31/f34 [774008,16126] 0 2024-02-15T18:27:01.055 INFO:tasks.workunit.client.0.smithi084.stdout:4/305: link d2/d4/d28/d3d/f46 d2/f5b 0 2024-02-15T18:27:01.057 INFO:tasks.workunit.client.0.smithi084.stdout:9/257: rename d4/cc to d4/d2b/d3c/c57 0 2024-02-15T18:27:01.058 INFO:tasks.workunit.client.0.smithi084.stdout:6/293: unlink d14/d22/d25/d2f/d31/d3f/d4a/c5a 0 2024-02-15T18:27:01.059 INFO:tasks.workunit.client.0.smithi084.stdout:4/306: getdents d2/d2b/d47 0 2024-02-15T18:27:01.059 INFO:tasks.workunit.client.0.smithi084.stdout:4/307: fdatasync d2/d4/d28/d3d/f46 0 2024-02-15T18:27:01.059 INFO:tasks.workunit.client.0.smithi084.stdout:4/308: fsync d2/d2b/d47/f56 0 2024-02-15T18:27:01.061 INFO:tasks.workunit.client.0.smithi084.stdout:9/258: creat d4/d2b/d3c/d24/f58 x:0 0 0 2024-02-15T18:27:01.061 INFO:tasks.workunit.client.0.smithi084.stdout:9/259: dread - d4/d2b/d3c/d24/f2a zero size 2024-02-15T18:27:01.062 INFO:tasks.workunit.client.0.smithi084.stdout:6/294: symlink d14/d22/d25/l5e 0 2024-02-15T18:27:01.063 INFO:tasks.workunit.client.0.smithi084.stdout:6/295: mknod d14/d22/d25/d2f/c5f 0 2024-02-15T18:27:01.067 INFO:tasks.workunit.client.1.smithi133.stdout:2/89: rmdir d7/db 39 2024-02-15T18:27:01.068 INFO:tasks.workunit.client.0.smithi084.stdout:6/296: read d14/d22/d25/d2f/d31/f27 [123978,113323] 0 2024-02-15T18:27:01.069 INFO:tasks.workunit.client.1.smithi133.stdout:2/90: link d7/d18/c22 d7/db/c23 0 2024-02-15T18:27:01.086 INFO:tasks.workunit.client.1.smithi133.stdout:1/75: dwrite d6/fd [4194304,4194304] 0 2024-02-15T18:27:01.088 INFO:tasks.workunit.client.1.smithi133.stdout:1/76: symlink d6/l1f 0 2024-02-15T18:27:01.089 INFO:tasks.workunit.client.1.smithi133.stdout:1/77: creat d6/d17/f20 x:0 0 0 2024-02-15T18:27:01.090 INFO:tasks.workunit.client.1.smithi133.stdout:1/78: link d6/f16 d6/d1e/f21 0 2024-02-15T18:27:01.091 INFO:tasks.workunit.client.1.smithi133.stdout:1/79: creat d6/f22 x:0 0 0 2024-02-15T18:27:01.091 INFO:tasks.workunit.client.1.smithi133.stdout:1/80: truncate d6/f16 778693 0 2024-02-15T18:27:01.092 INFO:tasks.workunit.client.0.smithi084.stdout:9/260: dwrite d4/d2b/d3c/d20/d43/d15/f16 [0,4194304] 0 2024-02-15T18:27:01.092 INFO:tasks.workunit.client.1.smithi133.stdout:1/81: dread d6/f16 [0,4194304] 0 2024-02-15T18:27:01.093 INFO:tasks.workunit.client.0.smithi084.stdout:9/261: mkdir d4/d3d/d59 0 2024-02-15T18:27:01.095 INFO:tasks.workunit.client.0.smithi084.stdout:9/262: rename d4/d2b/d3c/d20/d43/d15/f47 to d4/d2b/d3c/d20/f5a 0 2024-02-15T18:27:01.095 INFO:tasks.workunit.client.0.smithi084.stdout:9/263: read d4/d2b/d3c/f22 [389740,125948] 0 2024-02-15T18:27:01.101 INFO:tasks.workunit.client.0.smithi084.stdout:9/264: dread d4/f4d [0,4194304] 0 2024-02-15T18:27:01.134 INFO:tasks.workunit.client.0.smithi084.stdout:9/265: rename d4/d2b/d3c/d20/c55 to d4/d2b/d3c/d20/d43/d15/c5b 0 2024-02-15T18:27:01.134 INFO:tasks.workunit.client.0.smithi084.stdout:9/266: fdatasync d4/d2b/d3c/d20/d43/d15/f44 0 2024-02-15T18:27:01.134 INFO:tasks.workunit.client.0.smithi084.stdout:9/267: fdatasync d4/d2b/d3c/d20/d43/f3f 0 2024-02-15T18:27:01.134 INFO:tasks.workunit.client.0.smithi084.stdout:6/297: dwrite d14/d22/d25/f2b [0,4194304] 0 2024-02-15T18:27:01.135 INFO:tasks.workunit.client.1.smithi133.stdout:1/82: dread d6/d17/f18 [0,4194304] 0 2024-02-15T18:27:01.135 INFO:tasks.workunit.client.1.smithi133.stdout:1/83: write d6/fa [123797,88841] 0 2024-02-15T18:27:01.136 INFO:tasks.workunit.client.0.smithi084.stdout:9/268: dread d4/f29 [0,4194304] 0 2024-02-15T18:27:01.136 INFO:tasks.workunit.client.0.smithi084.stdout:9/269: truncate d4/d2b/d3c/d20/d43/d15/f17 392769 0 2024-02-15T18:27:01.136 INFO:tasks.workunit.client.0.smithi084.stdout:9/270: dread - d4/d2b/d3c/d20/f52 zero size 2024-02-15T18:27:01.136 INFO:tasks.workunit.client.0.smithi084.stdout:6/298: dread d14/d22/d25/d2f/d31/f34 [0,4194304] 0 2024-02-15T18:27:01.155 INFO:tasks.workunit.client.1.smithi133.stdout:1/84: dwrite d6/d17/f1b [0,4194304] 0 2024-02-15T18:27:01.155 INFO:tasks.workunit.client.1.smithi133.stdout:1/85: chown d6/d17/f18 6890450 1 2024-02-15T18:27:01.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/86: creat d6/d1e/f23 x:0 0 0 2024-02-15T18:27:01.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/87: chown d6/f22 6787455 1 2024-02-15T18:27:01.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/88: creat d6/f24 x:0 0 0 2024-02-15T18:27:01.173 INFO:tasks.workunit.client.1.smithi133.stdout:1/89: dwrite d6/fe [0,4194304] 0 2024-02-15T18:27:01.173 INFO:tasks.workunit.client.1.smithi133.stdout:1/90: fdatasync d6/d17/f1a 0 2024-02-15T18:27:01.176 INFO:tasks.workunit.client.1.smithi133.stdout:1/91: rmdir d6/d17 39 2024-02-15T18:27:01.178 INFO:tasks.workunit.client.0.smithi084.stdout:6/299: dwrite d14/d22/d25/d28/f48 [0,4194304] 0 2024-02-15T18:27:01.178 INFO:tasks.workunit.client.1.smithi133.stdout:1/92: creat d6/d17/f25 x:0 0 0 2024-02-15T18:27:01.179 INFO:tasks.workunit.client.1.smithi133.stdout:1/93: mkdir d6/d1e/d26 0 2024-02-15T18:27:01.179 INFO:tasks.workunit.client.0.smithi084.stdout:9/271: dwrite d4/d2b/f38 [0,4194304] 0 2024-02-15T18:27:01.181 INFO:tasks.workunit.client.0.smithi084.stdout:9/272: dread - d4/d2b/d3c/d20/d43/d15/f40 zero size 2024-02-15T18:27:01.182 INFO:tasks.workunit.client.0.smithi084.stdout:6/300: link d14/d22/d25/d2f/d31/f34 d14/d22/d25/d2f/f60 0 2024-02-15T18:27:01.183 INFO:tasks.workunit.client.1.smithi133.stdout:1/94: rename d6/fa to d6/d1e/f27 0 2024-02-15T18:27:01.185 INFO:tasks.workunit.client.1.smithi133.stdout:1/95: mknod d6/d1e/c28 0 2024-02-15T18:27:01.185 INFO:tasks.workunit.client.1.smithi133.stdout:1/96: creat d6/f29 x:0 0 0 2024-02-15T18:27:01.186 INFO:tasks.workunit.client.0.smithi084.stdout:6/301: creat d14/d22/d25/d2f/d31/d30/d4f/f61 x:0 0 0 2024-02-15T18:27:01.193 INFO:tasks.workunit.client.0.smithi084.stdout:6/302: write d14/d22/d25/d2f/d31/d30/d45/d52/f53 [1421959,85464] 0 2024-02-15T18:27:01.193 INFO:tasks.workunit.client.1.smithi133.stdout:1/97: write d6/fe [2150941,97436] 0 2024-02-15T18:27:01.193 INFO:tasks.workunit.client.1.smithi133.stdout:1/98: dread - d6/d17/f1d zero size 2024-02-15T18:27:01.194 INFO:tasks.workunit.client.1.smithi133.stdout:1/99: mkdir d6/d2a 0 2024-02-15T18:27:01.194 INFO:tasks.workunit.client.1.smithi133.stdout:1/100: dread - d6/d17/f1d zero size 2024-02-15T18:27:01.194 INFO:tasks.workunit.client.1.smithi133.stdout:1/101: truncate d6/d17/f1c 415412 0 2024-02-15T18:27:01.197 INFO:tasks.workunit.client.0.smithi084.stdout:6/303: write d14/d22/d25/f32 [364159,34580] 0 2024-02-15T18:27:01.198 INFO:tasks.workunit.client.0.smithi084.stdout:9/273: dwrite d4/d2b/d3c/d20/f52 [0,4194304] 0 2024-02-15T18:27:01.201 INFO:tasks.workunit.client.0.smithi084.stdout:9/274: creat d4/d2b/d3c/d20/d43/f5c x:0 0 0 2024-02-15T18:27:01.203 INFO:tasks.workunit.client.1.smithi133.stdout:1/102: getdents d6/d1e 0 2024-02-15T18:27:01.205 INFO:tasks.workunit.client.0.smithi084.stdout:6/304: dread d14/f2d [0,4194304] 0 2024-02-15T18:27:01.206 INFO:tasks.workunit.client.0.smithi084.stdout:9/275: dread d4/d2b/f4c [0,4194304] 0 2024-02-15T18:27:01.207 INFO:tasks.workunit.client.0.smithi084.stdout:6/305: unlink d14/d22/d25/d2f/d31/f34 0 2024-02-15T18:27:01.207 INFO:tasks.workunit.client.1.smithi133.stdout:1/103: rmdir d6/d1e/d26 0 2024-02-15T18:27:01.209 INFO:tasks.workunit.client.1.smithi133.stdout:1/104: link d6/d17/f1b d6/d17/f2b 0 2024-02-15T18:27:01.209 INFO:tasks.workunit.client.1.smithi133.stdout:1/105: stat d6/f16 0 2024-02-15T18:27:01.209 INFO:tasks.workunit.client.0.smithi084.stdout:9/276: mkdir d4/d2b/d3c/d20/d43/d15/d5d 0 2024-02-15T18:27:01.211 INFO:tasks.workunit.client.0.smithi084.stdout:6/306: truncate d14/d22/d25/d2f/f60 374569 0 2024-02-15T18:27:01.211 INFO:tasks.workunit.client.0.smithi084.stdout:2/281: sync 2024-02-15T18:27:01.211 INFO:tasks.workunit.client.0.smithi084.stdout:9/277: write d4/d2b/d3c/d20/d43/ff [2221886,90193] 0 2024-02-15T18:27:01.211 INFO:tasks.workunit.client.1.smithi133.stdout:1/106: creat d6/d2a/f2c x:0 0 0 2024-02-15T18:27:01.212 INFO:tasks.workunit.client.0.smithi084.stdout:0/289: sync 2024-02-15T18:27:01.212 INFO:tasks.workunit.client.0.smithi084.stdout:0/290: truncate d0/d25/f47 24352 0 2024-02-15T18:27:01.212 INFO:tasks.workunit.client.0.smithi084.stdout:9/278: read d4/d2b/f4c [2339110,39434] 0 2024-02-15T18:27:01.213 INFO:tasks.workunit.client.0.smithi084.stdout:6/307: rename l11 to d14/d22/d25/d2f/d31/d30/d45/d5c/l62 0 2024-02-15T18:27:01.213 INFO:tasks.workunit.client.1.smithi133.stdout:1/107: creat d6/f2d x:0 0 0 2024-02-15T18:27:01.213 INFO:tasks.workunit.client.1.smithi133.stdout:1/108: fdatasync d6/f13 0 2024-02-15T18:27:01.214 INFO:tasks.workunit.client.0.smithi084.stdout:2/282: creat d3/d19/d24/d3e/d5c/f5f x:0 0 0 2024-02-15T18:27:01.214 INFO:tasks.workunit.client.0.smithi084.stdout:2/283: stat d3/d5 0 2024-02-15T18:27:01.215 INFO:tasks.workunit.client.0.smithi084.stdout:6/308: write d14/d22/d25/d28/f2a [2063211,15118] 0 2024-02-15T18:27:01.215 INFO:tasks.workunit.client.0.smithi084.stdout:0/291: creat d0/d2f/f56 x:0 0 0 2024-02-15T18:27:01.215 INFO:tasks.workunit.client.0.smithi084.stdout:2/284: creat d3/d5/d1a/d2d/f60 x:0 0 0 2024-02-15T18:27:01.217 INFO:tasks.workunit.client.0.smithi084.stdout:5/290: sync 2024-02-15T18:27:01.217 INFO:tasks.workunit.client.0.smithi084.stdout:1/254: sync 2024-02-15T18:27:01.218 INFO:tasks.workunit.client.0.smithi084.stdout:6/309: truncate d14/d22/d25/d28/f48 4159382 0 2024-02-15T18:27:01.218 INFO:tasks.workunit.client.0.smithi084.stdout:6/310: chown c1 188269933 1 2024-02-15T18:27:01.218 INFO:tasks.workunit.client.0.smithi084.stdout:6/311: fsync d14/f2d 0 2024-02-15T18:27:01.220 INFO:tasks.workunit.client.1.smithi133.stdout:1/109: getdents d6 0 2024-02-15T18:27:01.221 INFO:tasks.workunit.client.0.smithi084.stdout:9/279: dread d4/d2b/d3c/d20/d43/f13 [0,4194304] 0 2024-02-15T18:27:01.221 INFO:tasks.workunit.client.0.smithi084.stdout:5/291: read d9/f3b [570826,51407] 0 2024-02-15T18:27:01.221 INFO:tasks.workunit.client.0.smithi084.stdout:5/292: readlink d9/d23/l2b 0 2024-02-15T18:27:01.221 INFO:tasks.workunit.client.0.smithi084.stdout:2/285: rename d3/d19/d24/d3e/f5a to d3/d5/d1a/d1e/f61 0 2024-02-15T18:27:01.221 INFO:tasks.workunit.client.0.smithi084.stdout:2/286: truncate d3/d5/d1a/d2d/f60 910618 0 2024-02-15T18:27:01.221 INFO:tasks.workunit.client.0.smithi084.stdout:1/255: mknod d9/dd/d39/c58 0 2024-02-15T18:27:01.225 INFO:tasks.workunit.client.0.smithi084.stdout:0/292: mknod d0/d4/d1b/d26/c57 0 2024-02-15T18:27:01.227 INFO:tasks.workunit.client.0.smithi084.stdout:9/280: unlink d4/d2b/d3c/d20/d43/f5c 0 2024-02-15T18:27:01.228 INFO:tasks.workunit.client.0.smithi084.stdout:5/293: truncate d9/f1d 2339484 0 2024-02-15T18:27:01.230 INFO:tasks.workunit.client.0.smithi084.stdout:2/287: rename d3/c9 to d3/d5e/c62 0 2024-02-15T18:27:01.230 INFO:tasks.workunit.client.0.smithi084.stdout:2/288: chown d3/d5/d1a/d1e/d47/c57 444 1 2024-02-15T18:27:01.231 INFO:tasks.workunit.client.0.smithi084.stdout:1/256: dread d9/f27 [0,4194304] 0 2024-02-15T18:27:01.233 INFO:tasks.workunit.client.0.smithi084.stdout:5/294: unlink d9/d23/l45 0 2024-02-15T18:27:01.236 INFO:tasks.workunit.client.0.smithi084.stdout:0/293: rename d0/d2f/d3f/c32 to d0/d4/c58 0 2024-02-15T18:27:01.236 INFO:tasks.workunit.client.0.smithi084.stdout:0/294: write d0/d2f/d3f/f49 [990040,78530] 0 2024-02-15T18:27:01.236 INFO:tasks.workunit.client.0.smithi084.stdout:0/295: chown d0/d4/d1b/d26/d43/c4a 15891 1 2024-02-15T18:27:01.236 INFO:tasks.workunit.client.0.smithi084.stdout:0/296: dread - d0/d1e/f44 zero size 2024-02-15T18:27:01.237 INFO:tasks.workunit.client.0.smithi084.stdout:2/289: getdents d3/d19 0 2024-02-15T18:27:01.239 INFO:tasks.workunit.client.0.smithi084.stdout:1/257: creat d9/dd/d36/d4f/f59 x:0 0 0 2024-02-15T18:27:01.239 INFO:tasks.workunit.client.0.smithi084.stdout:1/258: readlink d9/d54/l4e 0 2024-02-15T18:27:01.247 INFO:tasks.workunit.client.0.smithi084.stdout:5/295: unlink d9/c59 0 2024-02-15T18:27:01.247 INFO:tasks.workunit.client.0.smithi084.stdout:2/290: mknod d3/d5/d1a/c63 0 2024-02-15T18:27:01.248 INFO:tasks.workunit.client.0.smithi084.stdout:1/259: creat d9/d54/d1b/d2c/d4b/d4c/f5a x:0 0 0 2024-02-15T18:27:01.250 INFO:tasks.workunit.client.0.smithi084.stdout:5/296: rename d9/l1f to d9/d23/l62 0 2024-02-15T18:27:01.254 INFO:tasks.workunit.client.0.smithi084.stdout:1/260: write d9/d54/d1b/d2c/f43 [2676458,111614] 0 2024-02-15T18:27:01.255 INFO:tasks.workunit.client.0.smithi084.stdout:1/261: getdents d9/dd/d39 0 2024-02-15T18:27:01.263 INFO:tasks.workunit.client.0.smithi084.stdout:6/312: dwrite d14/d22/d25/d2f/d31/d3f/f42 [0,4194304] 0 2024-02-15T18:27:01.265 INFO:tasks.workunit.client.0.smithi084.stdout:5/297: dread d9/f12 [0,4194304] 0 2024-02-15T18:27:01.266 INFO:tasks.workunit.client.0.smithi084.stdout:5/298: dread d9/f15 [0,4194304] 0 2024-02-15T18:27:01.267 INFO:tasks.workunit.client.0.smithi084.stdout:5/299: stat d9/da/c31 0 2024-02-15T18:27:01.268 INFO:tasks.workunit.client.1.smithi133.stdout:1/110: dwrite d6/f15 [0,4194304] 0 2024-02-15T18:27:01.269 INFO:tasks.workunit.client.1.smithi133.stdout:1/111: chown d6/f15 31830 1 2024-02-15T18:27:01.269 INFO:tasks.workunit.client.1.smithi133.stdout:1/112: truncate d6/d1e/f23 995768 0 2024-02-15T18:27:01.269 INFO:tasks.workunit.client.0.smithi084.stdout:5/300: mknod d9/da/d3d/d44/d55/c63 0 2024-02-15T18:27:01.272 INFO:tasks.workunit.client.0.smithi084.stdout:5/301: symlink d9/d5b/l64 0 2024-02-15T18:27:01.272 INFO:tasks.workunit.client.1.smithi133.stdout:1/113: creat d6/f2e x:0 0 0 2024-02-15T18:27:01.272 INFO:tasks.workunit.client.1.smithi133.stdout:1/114: truncate d6/ff 808852 0 2024-02-15T18:27:01.273 INFO:tasks.workunit.client.0.smithi084.stdout:2/291: dread d3/d19/d24/f32 [0,4194304] 0 2024-02-15T18:27:01.274 INFO:tasks.workunit.client.1.smithi133.stdout:1/115: creat d6/d2a/f2f x:0 0 0 2024-02-15T18:27:01.275 INFO:tasks.workunit.client.0.smithi084.stdout:1/262: dread d9/dd/f13 [0,4194304] 0 2024-02-15T18:27:01.275 INFO:tasks.workunit.client.0.smithi084.stdout:1/263: fsync d9/d54/d1b/d2c/d35/f48 0 2024-02-15T18:27:01.276 INFO:tasks.workunit.client.0.smithi084.stdout:0/297: dwrite d0/d4/d1b/d26/f2e [4194304,4194304] 0 2024-02-15T18:27:01.277 INFO:tasks.workunit.client.1.smithi133.stdout:1/116: symlink d6/d2a/l30 0 2024-02-15T18:27:01.279 INFO:tasks.workunit.client.1.smithi133.stdout:1/117: symlink d6/l31 0 2024-02-15T18:27:01.279 INFO:tasks.workunit.client.0.smithi084.stdout:0/298: write d0/d4/d1b/f3c [1946962,18638] 0 2024-02-15T18:27:01.282 INFO:tasks.workunit.client.0.smithi084.stdout:1/264: mkdir d9/d54/d32/d5b 0 2024-02-15T18:27:01.284 INFO:tasks.workunit.client.0.smithi084.stdout:4/309: sync 2024-02-15T18:27:01.284 INFO:tasks.workunit.client.0.smithi084.stdout:7/278: sync 2024-02-15T18:27:01.284 INFO:tasks.workunit.client.0.smithi084.stdout:8/313: sync 2024-02-15T18:27:01.284 INFO:tasks.workunit.client.0.smithi084.stdout:3/287: sync 2024-02-15T18:27:01.284 INFO:tasks.workunit.client.0.smithi084.stdout:2/292: dread f1 [0,4194304] 0 2024-02-15T18:27:01.284 INFO:tasks.workunit.client.0.smithi084.stdout:0/299: mkdir d0/d2f/d3f/d4f/d59 0 2024-02-15T18:27:01.284 INFO:tasks.workunit.client.0.smithi084.stdout:0/300: read - d0/d4/d1b/f55 zero size 2024-02-15T18:27:01.285 INFO:tasks.workunit.client.0.smithi084.stdout:1/265: mkdir d9/d54/d5c 0 2024-02-15T18:27:01.285 INFO:tasks.workunit.client.0.smithi084.stdout:1/266: stat d9/d54/d32/f49 0 2024-02-15T18:27:01.285 INFO:tasks.workunit.client.0.smithi084.stdout:8/314: creat db/d3f/d59/d69/f6b x:0 0 0 2024-02-15T18:27:01.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/315: readlink db/d1a/l4a 0 2024-02-15T18:27:01.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/316: chown db/dd/d1f/c36 2 1 2024-02-15T18:27:01.286 INFO:tasks.workunit.client.0.smithi084.stdout:1/267: read d9/dd/f13 [1340579,2665] 0 2024-02-15T18:27:01.286 INFO:tasks.workunit.client.0.smithi084.stdout:1/268: readlink l1 0 2024-02-15T18:27:01.286 INFO:tasks.workunit.client.0.smithi084.stdout:3/288: mknod d8/d40/d58/c64 0 2024-02-15T18:27:01.287 INFO:tasks.workunit.client.0.smithi084.stdout:3/289: chown d8/d1f/d2d/f5d 8261351 1 2024-02-15T18:27:01.287 INFO:tasks.workunit.client.0.smithi084.stdout:3/290: dread - d8/d1f/d2d/f4f zero size 2024-02-15T18:27:01.287 INFO:tasks.workunit.client.0.smithi084.stdout:2/293: truncate d3/d19/d24/f44 421410 0 2024-02-15T18:27:01.288 INFO:tasks.workunit.client.0.smithi084.stdout:0/301: truncate d0/d4/d1b/f3e 184211 0 2024-02-15T18:27:01.288 INFO:tasks.workunit.client.0.smithi084.stdout:2/294: dread d3/d19/d24/f2f [0,4194304] 0 2024-02-15T18:27:01.289 INFO:tasks.workunit.client.1.smithi133.stdout:1/118: dread d6/d17/f2b [0,4194304] 0 2024-02-15T18:27:01.290 INFO:tasks.workunit.client.0.smithi084.stdout:8/317: rename db/d1a/f22 to db/d1a/d2b/f6c 0 2024-02-15T18:27:01.292 INFO:tasks.workunit.client.0.smithi084.stdout:1/269: creat d9/d54/d1b/d2c/d35/f5d x:0 0 0 2024-02-15T18:27:01.293 INFO:tasks.workunit.client.0.smithi084.stdout:3/291: link d8/d1f/d2d/l32 d8/d1f/d25/l65 0 2024-02-15T18:27:01.294 INFO:tasks.workunit.client.0.smithi084.stdout:2/295: rename d3/d19/c5d to d3/d5/d1a/d1e/c64 0 2024-02-15T18:27:01.294 INFO:tasks.workunit.client.0.smithi084.stdout:3/292: rmdir d8/d1f/d25 39 2024-02-15T18:27:01.297 INFO:tasks.workunit.client.0.smithi084.stdout:1/270: rename d9/d54/d1b/d2c/d35/f40 to d9/d54/d1b/f5e 0 2024-02-15T18:27:01.297 INFO:tasks.workunit.client.0.smithi084.stdout:3/293: symlink d8/d1f/d2d/l66 0 2024-02-15T18:27:01.298 INFO:tasks.workunit.client.0.smithi084.stdout:2/296: symlink d3/d19/d24/l65 0 2024-02-15T18:27:01.299 INFO:tasks.workunit.client.0.smithi084.stdout:2/297: chown d3/d19/d24/f44 66773383 1 2024-02-15T18:27:01.300 INFO:tasks.workunit.client.0.smithi084.stdout:1/271: symlink d9/d54/d32/l5f 0 2024-02-15T18:27:01.300 INFO:tasks.workunit.client.0.smithi084.stdout:1/272: fdatasync d9/dd/f13 0 2024-02-15T18:27:01.300 INFO:tasks.workunit.client.0.smithi084.stdout:2/298: symlink d3/d19/d24/d3e/l66 0 2024-02-15T18:27:01.301 INFO:tasks.workunit.client.0.smithi084.stdout:5/302: dwrite d9/f10 [0,4194304] 0 2024-02-15T18:27:01.303 INFO:tasks.workunit.client.0.smithi084.stdout:6/313: dwrite d14/d22/d25/d2f/d31/d3f/d4a/f4c [4194304,4194304] 0 2024-02-15T18:27:01.311 INFO:tasks.workunit.client.0.smithi084.stdout:2/299: creat d3/d5/d1a/d1e/d30/f67 x:0 0 0 2024-02-15T18:27:01.319 INFO:tasks.workunit.client.0.smithi084.stdout:8/318: dread db/dd/f5a [0,4194304] 0 2024-02-15T18:27:01.325 INFO:tasks.workunit.client.0.smithi084.stdout:4/310: dwrite d2/f5b [0,4194304] 0 2024-02-15T18:27:01.331 INFO:tasks.workunit.client.0.smithi084.stdout:3/294: dwrite d8/d40/d43/f4d [0,4194304] 0 2024-02-15T18:27:01.339 INFO:tasks.workunit.client.0.smithi084.stdout:0/302: dwrite d0/d4/d1b/d26/f2e [4194304,4194304] 0 2024-02-15T18:27:01.339 INFO:tasks.workunit.client.1.smithi133.stdout:1/119: dwrite d6/fe [0,4194304] 0 2024-02-15T18:27:01.340 INFO:tasks.workunit.client.0.smithi084.stdout:7/279: dwrite df/d1d/d1a/f26 [0,4194304] 0 2024-02-15T18:27:01.340 INFO:tasks.workunit.client.0.smithi084.stdout:8/319: dwrite db/d1a/d2b/f31 [0,4194304] 0 2024-02-15T18:27:01.340 INFO:tasks.workunit.client.0.smithi084.stdout:8/320: chown db/d1a/d2b/c44 19 1 2024-02-15T18:27:01.343 INFO:tasks.workunit.client.1.smithi133.stdout:1/120: mkdir d6/d32 0 2024-02-15T18:27:01.343 INFO:tasks.workunit.client.1.smithi133.stdout:1/121: truncate d6/d17/f25 703100 0 2024-02-15T18:27:01.343 INFO:tasks.workunit.client.1.smithi133.stdout:1/122: fsync d6/f22 0 2024-02-15T18:27:01.343 INFO:tasks.workunit.client.1.smithi133.stdout:1/123: rename d6/d17/f2b to d6/d32/f33 0 2024-02-15T18:27:01.344 INFO:tasks.workunit.client.0.smithi084.stdout:5/303: rename d9/d23/d33 to d9/d35/d65 0 2024-02-15T18:27:01.344 INFO:tasks.workunit.client.0.smithi084.stdout:7/280: read df/f15 [1587686,104597] 0 2024-02-15T18:27:01.344 INFO:tasks.workunit.client.0.smithi084.stdout:7/281: write df/d1d/d40/d48/f45 [551021,45143] 0 2024-02-15T18:27:01.344 INFO:tasks.workunit.client.0.smithi084.stdout:6/314: symlink d14/d22/d25/d2f/d31/l63 0 2024-02-15T18:27:01.345 INFO:tasks.workunit.client.0.smithi084.stdout:7/282: write df/d1d/f18 [68025,21891] 0 2024-02-15T18:27:01.347 INFO:tasks.workunit.client.0.smithi084.stdout:1/273: fsync d9/d54/d1b/d2c/d35/f5d 0 2024-02-15T18:27:01.348 INFO:tasks.workunit.client.0.smithi084.stdout:4/311: mkdir d2/d4/d28/d3d/d5c 0 2024-02-15T18:27:01.355 INFO:tasks.workunit.client.0.smithi084.stdout:3/295: link d8/d22/f52 d8/d40/f67 0 2024-02-15T18:27:01.356 INFO:tasks.workunit.client.1.smithi133.stdout:1/124: dwrite f1 [4194304,4194304] 0 2024-02-15T18:27:01.356 INFO:tasks.workunit.client.1.smithi133.stdout:1/125: truncate d6/d17/f25 1354886 0 2024-02-15T18:27:01.357 INFO:tasks.workunit.client.0.smithi084.stdout:0/303: creat d0/d2f/d3f/f5a x:0 0 0 2024-02-15T18:27:01.357 INFO:tasks.workunit.client.1.smithi133.stdout:1/126: mknod d6/d2a/c34 0 2024-02-15T18:27:01.357 INFO:tasks.workunit.client.1.smithi133.stdout:1/127: chown d6 35469 1 2024-02-15T18:27:01.357 INFO:tasks.workunit.client.1.smithi133.stdout:1/128: creat d6/d2a/f35 x:0 0 0 2024-02-15T18:27:01.358 INFO:tasks.workunit.client.0.smithi084.stdout:0/304: write d0/d4/d1b/d26/f2e [5128981,1569] 0 2024-02-15T18:27:01.358 INFO:tasks.workunit.client.0.smithi084.stdout:0/305: chown d0/d4/d1b/d26/l24 157 1 2024-02-15T18:27:01.359 INFO:tasks.workunit.client.1.smithi133.stdout:1/129: rename d6/c19 to d6/d32/c36 0 2024-02-15T18:27:01.359 INFO:tasks.workunit.client.1.smithi133.stdout:1/130: write d6/d17/f1a [1585267,95839] 0 2024-02-15T18:27:01.359 INFO:tasks.workunit.client.1.smithi133.stdout:1/131: fdatasync d6/d2a/f2f 0 2024-02-15T18:27:01.359 INFO:tasks.workunit.client.1.smithi133.stdout:1/132: write d6/f13 [424909,17130] 0 2024-02-15T18:27:01.360 INFO:tasks.workunit.client.1.smithi133.stdout:1/133: dread d6/d17/f25 [0,4194304] 0 2024-02-15T18:27:01.361 INFO:tasks.workunit.client.0.smithi084.stdout:2/300: rename d3/d5/d1a/d2d/f60 to d3/d19/d24/d3e/d5c/f68 0 2024-02-15T18:27:01.362 INFO:tasks.workunit.client.1.smithi133.stdout:1/134: rename d6/d17/f20 to d6/d1e/f37 0 2024-02-15T18:27:01.362 INFO:tasks.workunit.client.1.smithi133.stdout:1/135: dread - d6/f2e zero size 2024-02-15T18:27:01.362 INFO:tasks.workunit.client.1.smithi133.stdout:1/136: fsync d6/d17/f1c 0 2024-02-15T18:27:01.363 INFO:tasks.workunit.client.0.smithi084.stdout:2/301: dread d3/f11 [0,4194304] 0 2024-02-15T18:27:01.363 INFO:tasks.workunit.client.0.smithi084.stdout:5/304: symlink d9/d5b/l66 0 2024-02-15T18:27:01.365 INFO:tasks.workunit.client.0.smithi084.stdout:6/315: creat d14/d22/f64 x:0 0 0 2024-02-15T18:27:01.365 INFO:tasks.workunit.client.0.smithi084.stdout:9/281: sync 2024-02-15T18:27:01.365 INFO:tasks.workunit.client.0.smithi084.stdout:9/282: readlink d4/d2b/d3c/d20/d43/d15/l2d 0 2024-02-15T18:27:01.366 INFO:tasks.workunit.client.0.smithi084.stdout:7/283: creat df/d1d/d1a/d4b/f50 x:0 0 0 2024-02-15T18:27:01.366 INFO:tasks.workunit.client.0.smithi084.stdout:4/312: mkdir d2/d4/d28/d3d/d5c/d5d 0 2024-02-15T18:27:01.367 INFO:tasks.workunit.client.0.smithi084.stdout:3/296: creat d8/d1f/d25/f68 x:0 0 0 2024-02-15T18:27:01.367 INFO:tasks.workunit.client.0.smithi084.stdout:3/297: fdatasync d8/d1f/d28/f2b 0 2024-02-15T18:27:01.368 INFO:tasks.workunit.client.0.smithi084.stdout:0/306: getdents d0/d2f 0 2024-02-15T18:27:01.368 INFO:tasks.workunit.client.0.smithi084.stdout:7/284: dread df/d1d/d1a/f28 [0,4194304] 0 2024-02-15T18:27:01.369 INFO:tasks.workunit.client.0.smithi084.stdout:8/321: rename db/dd/d13/l34 to db/d3f/l6d 0 2024-02-15T18:27:01.370 INFO:tasks.workunit.client.1.smithi133.stdout:1/137: rmdir d6/d2a 39 2024-02-15T18:27:01.370 INFO:tasks.workunit.client.1.smithi133.stdout:1/138: chown d6/d1e/f23 19 1 2024-02-15T18:27:01.371 INFO:tasks.workunit.client.0.smithi084.stdout:8/322: write fa [3663698,95968] 0 2024-02-15T18:27:01.372 INFO:tasks.workunit.client.1.smithi133.stdout:1/139: rename f1 to d6/d2a/f38 0 2024-02-15T18:27:01.374 INFO:tasks.workunit.client.0.smithi084.stdout:5/305: creat d9/d23/f67 x:0 0 0 2024-02-15T18:27:01.374 INFO:tasks.workunit.client.0.smithi084.stdout:2/302: unlink f1 0 2024-02-15T18:27:01.374 INFO:tasks.workunit.client.0.smithi084.stdout:2/303: chown d3/d5/d53 24 1 2024-02-15T18:27:01.374 INFO:tasks.workunit.client.1.smithi133.stdout:1/140: creat d6/d32/f39 x:0 0 0 2024-02-15T18:27:01.375 INFO:tasks.workunit.client.0.smithi084.stdout:6/316: mknod d14/d22/d25/d28/c65 0 2024-02-15T18:27:01.375 INFO:tasks.workunit.client.0.smithi084.stdout:9/283: truncate d4/d2b/d3c/d20/d43/ff 1040144 0 2024-02-15T18:27:01.375 INFO:tasks.workunit.client.0.smithi084.stdout:9/284: chown d4/d2b/d3c/d20/d43/d15/f17 4661 1 2024-02-15T18:27:01.375 INFO:tasks.workunit.client.0.smithi084.stdout:9/285: dread - d4/d2b/d3c/d20/d43/d15/d4b/f51 zero size 2024-02-15T18:27:01.376 INFO:tasks.workunit.client.1.smithi133.stdout:1/141: mkdir d6/d1e/d3a 0 2024-02-15T18:27:01.376 INFO:tasks.workunit.client.1.smithi133.stdout:1/142: truncate d6/d2a/f35 61954 0 2024-02-15T18:27:01.376 INFO:tasks.workunit.client.1.smithi133.stdout:1/143: rmdir d6/d1e 39 2024-02-15T18:27:01.376 INFO:tasks.workunit.client.0.smithi084.stdout:4/313: creat d2/f5e x:0 0 0 2024-02-15T18:27:01.377 INFO:tasks.workunit.client.0.smithi084.stdout:6/317: dread d14/d22/d25/d2f/d31/f27 [0,4194304] 0 2024-02-15T18:27:01.377 INFO:tasks.workunit.client.0.smithi084.stdout:0/307: symlink d0/d39/l5b 0 2024-02-15T18:27:01.378 INFO:tasks.workunit.client.0.smithi084.stdout:7/285: creat df/d1d/d1a/d4b/f51 x:0 0 0 2024-02-15T18:27:01.378 INFO:tasks.workunit.client.0.smithi084.stdout:0/308: read - d0/d2f/d3f/f5a zero size 2024-02-15T18:27:01.378 INFO:tasks.workunit.client.0.smithi084.stdout:0/309: chown d0/d4/c22 1 1 2024-02-15T18:27:01.378 INFO:tasks.workunit.client.0.smithi084.stdout:7/286: chown df/d1d/d40/d48/c36 27 1 2024-02-15T18:27:01.378 INFO:tasks.workunit.client.1.smithi133.stdout:1/144: mknod d6/c3b 0 2024-02-15T18:27:01.383 INFO:tasks.workunit.client.0.smithi084.stdout:8/323: mknod db/dd/d13/c6e 0 2024-02-15T18:27:01.383 INFO:tasks.workunit.client.0.smithi084.stdout:1/274: rename d9/d54/d1b/d2c/d4b/d4c/c52 to d9/dd/c60 0 2024-02-15T18:27:01.385 INFO:tasks.workunit.client.0.smithi084.stdout:5/306: mkdir d9/d5f/d68 0 2024-02-15T18:27:01.385 INFO:tasks.workunit.client.0.smithi084.stdout:6/318: readlink d14/d22/d25/d2f/l3a 0 2024-02-15T18:27:01.387 INFO:tasks.workunit.client.0.smithi084.stdout:1/275: creat d9/d54/d1b/d2c/d4b/d4c/f61 x:0 0 0 2024-02-15T18:27:01.389 INFO:tasks.workunit.client.0.smithi084.stdout:0/310: rename d0/d4/d1b/d51 to d0/d4/d3a/d5c 0 2024-02-15T18:27:01.389 INFO:tasks.workunit.client.0.smithi084.stdout:0/311: write d0/d1e/f44 [18452,106755] 0 2024-02-15T18:27:01.389 INFO:tasks.workunit.client.0.smithi084.stdout:0/312: write d0/d4/d1b/f42 [1110066,118947] 0 2024-02-15T18:27:01.390 INFO:tasks.workunit.client.0.smithi084.stdout:5/307: unlink d9/d23/l2f 0 2024-02-15T18:27:01.390 INFO:tasks.workunit.client.0.smithi084.stdout:2/304: dread d3/d19/f33 [0,4194304] 0 2024-02-15T18:27:01.391 INFO:tasks.workunit.client.0.smithi084.stdout:1/276: dread d9/d54/d32/f49 [0,4194304] 0 2024-02-15T18:27:01.391 INFO:tasks.workunit.client.0.smithi084.stdout:0/313: getdents d0/d2f/d4b 0 2024-02-15T18:27:01.393 INFO:tasks.workunit.client.0.smithi084.stdout:2/305: mknod d3/d19/c69 0 2024-02-15T18:27:01.394 INFO:tasks.workunit.client.0.smithi084.stdout:1/277: mknod d9/d54/d1b/d38/c62 0 2024-02-15T18:27:01.396 INFO:tasks.workunit.client.0.smithi084.stdout:0/314: symlink d0/d4/d1b/l5d 0 2024-02-15T18:27:01.396 INFO:tasks.workunit.client.0.smithi084.stdout:0/315: chown d0/d2f/d4b/c50 4805035 1 2024-02-15T18:27:01.397 INFO:tasks.workunit.client.0.smithi084.stdout:8/324: dread db/d1a/f1d [0,4194304] 0 2024-02-15T18:27:01.397 INFO:tasks.workunit.client.0.smithi084.stdout:2/306: rmdir d3/d5/d1a/d2d 39 2024-02-15T18:27:01.398 INFO:tasks.workunit.client.0.smithi084.stdout:3/298: dwrite d8/d1f/f3b [0,4194304] 0 2024-02-15T18:27:01.398 INFO:tasks.workunit.client.0.smithi084.stdout:0/316: creat d0/d39/d45/f5e x:0 0 0 2024-02-15T18:27:01.400 INFO:tasks.workunit.client.0.smithi084.stdout:8/325: rename db/dd/l67 to db/d1a/d5e/l6f 0 2024-02-15T18:27:01.404 INFO:tasks.workunit.client.0.smithi084.stdout:3/299: rename d8/d1f/d25/l2e to d8/d22/l69 0 2024-02-15T18:27:01.406 INFO:tasks.workunit.client.0.smithi084.stdout:6/319: dread d14/f2d [0,4194304] 0 2024-02-15T18:27:01.409 INFO:tasks.workunit.client.0.smithi084.stdout:6/320: rename d14/d22/d25/d2f/d31/f47 to d14/d22/d25/d2f/f66 0 2024-02-15T18:27:01.412 INFO:tasks.workunit.client.0.smithi084.stdout:2/307: read d3/ff [4162358,79496] 0 2024-02-15T18:27:01.418 INFO:tasks.workunit.client.0.smithi084.stdout:8/326: dread db/d3f/d59/f28 [0,4194304] 0 2024-02-15T18:27:01.418 INFO:tasks.workunit.client.0.smithi084.stdout:3/300: dread d8/d1f/f3b [0,4194304] 0 2024-02-15T18:27:01.421 INFO:tasks.workunit.client.0.smithi084.stdout:8/327: creat db/dd/d4d/f70 x:0 0 0 2024-02-15T18:27:01.421 INFO:tasks.workunit.client.0.smithi084.stdout:8/328: write db/dd/d1f/f38 [1082930,68100] 0 2024-02-15T18:27:01.421 INFO:tasks.workunit.client.0.smithi084.stdout:8/329: write db/d1a/d2b/f4b [1692001,21248] 0 2024-02-15T18:27:01.426 INFO:tasks.workunit.client.0.smithi084.stdout:3/301: rename d8/d1f/d2d/l32 to d8/d22/l6a 0 2024-02-15T18:27:01.426 INFO:tasks.workunit.client.0.smithi084.stdout:3/302: fsync d8/f48 0 2024-02-15T18:27:01.429 INFO:tasks.workunit.client.0.smithi084.stdout:8/330: rename db/l58 to db/dd/l71 0 2024-02-15T18:27:01.430 INFO:tasks.workunit.client.0.smithi084.stdout:3/303: unlink d8/la 0 2024-02-15T18:27:01.431 INFO:tasks.workunit.client.0.smithi084.stdout:8/331: mknod db/dd/c72 0 2024-02-15T18:27:01.431 INFO:tasks.workunit.client.0.smithi084.stdout:3/304: mkdir d8/d1f/d28/d6b 0 2024-02-15T18:27:01.431 INFO:tasks.workunit.client.0.smithi084.stdout:8/332: getdents db/dd/d13/d42 0 2024-02-15T18:27:01.432 INFO:tasks.workunit.client.0.smithi084.stdout:8/333: readlink db/dd/d1f/l29 0 2024-02-15T18:27:01.432 INFO:tasks.workunit.client.0.smithi084.stdout:3/305: creat d8/d1f/d28/d6b/f6c x:0 0 0 2024-02-15T18:27:01.433 INFO:tasks.workunit.client.0.smithi084.stdout:3/306: read d8/f1d [627282,20753] 0 2024-02-15T18:27:01.439 INFO:tasks.workunit.client.0.smithi084.stdout:5/308: dwrite d9/d23/f37 [0,4194304] 0 2024-02-15T18:27:01.439 INFO:tasks.workunit.client.0.smithi084.stdout:5/309: fdatasync d9/f1d 0 2024-02-15T18:27:01.442 INFO:tasks.workunit.client.0.smithi084.stdout:9/286: dwrite d4/d2b/d3c/d20/f52 [0,4194304] 0 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:5/310: write f8 [4493564,85412] 0 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:5/311: dread - d9/d23/f57 zero size 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:1/278: dwrite d9/dd/d36/d4f/f59 [0,4194304] 0 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:5/312: truncate d9/d35/f42 573829 0 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:5/313: stat d9/da 0 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:5/314: readlink d9/da/d3d/d44/d55/l5d 0 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:5/315: dread - d9/d23/f67 zero size 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:4/314: dwrite d2/d2b/f54 [0,4194304] 0 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:7/287: dwrite df/d1d/d40/d48/f3d [0,4194304] 0 2024-02-15T18:27:01.444 INFO:tasks.workunit.client.0.smithi084.stdout:4/315: chown d2/d4/d28/d2e/f49 5296153 1 2024-02-15T18:27:01.445 INFO:tasks.workunit.client.0.smithi084.stdout:9/287: unlink d4/d2b/f4c 0 2024-02-15T18:27:01.445 INFO:tasks.workunit.client.0.smithi084.stdout:6/321: dwrite f13 [4194304,4194304] 0 2024-02-15T18:27:01.446 INFO:tasks.workunit.client.0.smithi084.stdout:6/322: dread d14/d22/d25/d2f/d31/f27 [0,4194304] 0 2024-02-15T18:27:01.447 INFO:tasks.workunit.client.0.smithi084.stdout:1/279: mkdir d9/d54/d1b/d2c/d4b/d63 0 2024-02-15T18:27:01.447 INFO:tasks.workunit.client.0.smithi084.stdout:5/316: getdents d9/d5b 0 2024-02-15T18:27:01.447 INFO:tasks.workunit.client.0.smithi084.stdout:5/317: chown d9/d35/d65/f56 25 1 2024-02-15T18:27:01.447 INFO:tasks.workunit.client.0.smithi084.stdout:5/318: chown d9/d35 20 1 2024-02-15T18:27:01.447 INFO:tasks.workunit.client.0.smithi084.stdout:5/319: dread - d9/da/d3d/f50 zero size 2024-02-15T18:27:01.448 INFO:tasks.workunit.client.0.smithi084.stdout:5/320: getdents d9/d5b 0 2024-02-15T18:27:01.448 INFO:tasks.workunit.client.0.smithi084.stdout:5/321: dread - d9/d35/d65/f3e zero size 2024-02-15T18:27:01.448 INFO:tasks.workunit.client.0.smithi084.stdout:6/323: dread d14/d22/d25/d2f/d31/f27 [0,4194304] 0 2024-02-15T18:27:01.450 INFO:tasks.workunit.client.0.smithi084.stdout:7/288: link df/d1d/d40/d48/l33 df/d1d/d1a/d4d/l52 0 2024-02-15T18:27:01.450 INFO:tasks.workunit.client.0.smithi084.stdout:7/289: fdatasync df/d1d/f3e 0 2024-02-15T18:27:01.450 INFO:tasks.workunit.client.0.smithi084.stdout:7/290: readlink df/d1d/d40/d48/l4a 0 2024-02-15T18:27:01.452 INFO:tasks.workunit.client.0.smithi084.stdout:9/288: creat d4/d36/f5e x:0 0 0 2024-02-15T18:27:01.452 INFO:tasks.workunit.client.0.smithi084.stdout:9/289: truncate d4/d2b/d3c/d20/d43/ff 1102914 0 2024-02-15T18:27:01.452 INFO:tasks.workunit.client.0.smithi084.stdout:9/290: truncate d4/d2b/f38 5223837 0 2024-02-15T18:27:01.453 INFO:tasks.workunit.client.0.smithi084.stdout:1/280: rename d9/dd/l21 to d9/d54/d1b/d2c/d4b/d63/l64 0 2024-02-15T18:27:01.453 INFO:tasks.workunit.client.0.smithi084.stdout:1/281: read - d9/d54/d1b/d2c/d35/f5d zero size 2024-02-15T18:27:01.454 INFO:tasks.workunit.client.0.smithi084.stdout:5/322: creat d9/d35/d65/f69 x:0 0 0 2024-02-15T18:27:01.454 INFO:tasks.workunit.client.0.smithi084.stdout:7/291: creat df/d1d/d1a/f53 x:0 0 0 2024-02-15T18:27:01.455 INFO:tasks.workunit.client.0.smithi084.stdout:8/334: dwrite db/d3f/f54 [0,4194304] 0 2024-02-15T18:27:01.455 INFO:tasks.workunit.client.0.smithi084.stdout:9/291: creat d4/d36/f5f x:0 0 0 2024-02-15T18:27:01.456 INFO:tasks.workunit.client.0.smithi084.stdout:3/307: dwrite d8/f1b [0,4194304] 0 2024-02-15T18:27:01.456 INFO:tasks.workunit.client.0.smithi084.stdout:3/308: readlink d8/d22/l69 0 2024-02-15T18:27:01.456 INFO:tasks.workunit.client.0.smithi084.stdout:3/309: write d8/d1f/d2d/f3d [1050202,119535] 0 2024-02-15T18:27:01.457 INFO:tasks.workunit.client.0.smithi084.stdout:6/324: rename d14/d22/d25/d28/c37 to d14/d22/d25/d2f/d31/d3f/d4a/c67 0 2024-02-15T18:27:01.457 INFO:tasks.workunit.client.0.smithi084.stdout:4/316: dread d2/d2b/d47/d31/f43 [0,4194304] 0 2024-02-15T18:27:01.457 INFO:tasks.workunit.client.0.smithi084.stdout:9/292: write d4/d2b/d3c/d20/d43/f1c [1163979,67527] 0 2024-02-15T18:27:01.458 INFO:tasks.workunit.client.0.smithi084.stdout:5/323: write d9/da/f1b [405027,51177] 0 2024-02-15T18:27:01.459 INFO:tasks.workunit.client.0.smithi084.stdout:5/324: write d9/d23/f67 [768771,99258] 0 2024-02-15T18:27:01.459 INFO:tasks.workunit.client.0.smithi084.stdout:5/325: chown d9/da/d3d/d44/d55/c63 40 1 2024-02-15T18:27:01.459 INFO:tasks.workunit.client.0.smithi084.stdout:5/326: chown d9/d23/f30 55627 1 2024-02-15T18:27:01.464 INFO:tasks.workunit.client.0.smithi084.stdout:1/282: rename d9/d54/d1b/d2c/d4b/c51 to d9/dd/d36/c65 0 2024-02-15T18:27:01.464 INFO:tasks.workunit.client.0.smithi084.stdout:1/283: chown d9/dd/d39 63 1 2024-02-15T18:27:01.464 INFO:tasks.workunit.client.0.smithi084.stdout:8/335: dread db/d1a/d2b/f31 [0,4194304] 0 2024-02-15T18:27:01.465 INFO:tasks.workunit.client.0.smithi084.stdout:8/336: stat db/d1a/d5e 0 2024-02-15T18:27:01.469 INFO:tasks.workunit.client.0.smithi084.stdout:6/325: creat d14/d22/d25/d41/f68 x:0 0 0 2024-02-15T18:27:01.472 INFO:tasks.workunit.client.0.smithi084.stdout:9/293: truncate d4/d2b/f3b 235391 0 2024-02-15T18:27:01.472 INFO:tasks.workunit.client.0.smithi084.stdout:9/294: readlink d4/d2b/d3c/d20/d43/l10 0 2024-02-15T18:27:01.474 INFO:tasks.workunit.client.0.smithi084.stdout:5/327: creat d9/d35/f6a x:0 0 0 2024-02-15T18:27:01.474 INFO:tasks.workunit.client.0.smithi084.stdout:5/328: truncate d9/da/d3d/f4f 27162 0 2024-02-15T18:27:01.474 INFO:tasks.workunit.client.0.smithi084.stdout:5/329: fdatasync d9/d35/d65/f56 0 2024-02-15T18:27:01.474 INFO:tasks.workunit.client.0.smithi084.stdout:5/330: readlink d9/da/d3d/d44/d55/l5d 0 2024-02-15T18:27:01.474 INFO:tasks.workunit.client.0.smithi084.stdout:5/331: truncate d9/f28 192754 0 2024-02-15T18:27:01.474 INFO:tasks.workunit.client.0.smithi084.stdout:6/326: read d14/d22/d25/f32 [674066,86580] 0 2024-02-15T18:27:01.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/327: chown d14/d22/d25/d2f/d31 494493 1 2024-02-15T18:27:01.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/328: stat f9 0 2024-02-15T18:27:01.475 INFO:tasks.workunit.client.0.smithi084.stdout:3/310: rename d8/d40/l53 to d8/d40/d43/l6d 0 2024-02-15T18:27:01.475 INFO:tasks.workunit.client.0.smithi084.stdout:1/284: symlink d9/dd/d36/d4f/l66 0 2024-02-15T18:27:01.475 INFO:tasks.workunit.client.0.smithi084.stdout:1/285: readlink d9/dd/d39/l2e 0 2024-02-15T18:27:01.476 INFO:tasks.workunit.client.0.smithi084.stdout:9/295: symlink d4/d2b/d3c/d20/l60 0 2024-02-15T18:27:01.477 INFO:tasks.workunit.client.0.smithi084.stdout:7/292: dwrite df/d1d/d1a/d4d/f4e [0,4194304] 0 2024-02-15T18:27:01.486 INFO:tasks.workunit.client.0.smithi084.stdout:8/337: rename db/d3f/c53 to db/dd/d1f/d56/c73 0 2024-02-15T18:27:01.486 INFO:tasks.workunit.client.0.smithi084.stdout:8/338: chown db/dd/d1f/d3e/f43 9337693 1 2024-02-15T18:27:01.486 INFO:tasks.workunit.client.0.smithi084.stdout:8/339: chown db/dd/d13/l30 59 1 2024-02-15T18:27:01.487 INFO:tasks.workunit.client.0.smithi084.stdout:6/329: rmdir d14/d22 39 2024-02-15T18:27:01.489 INFO:tasks.workunit.client.0.smithi084.stdout:1/286: unlink l1 0 2024-02-15T18:27:01.492 INFO:tasks.workunit.client.0.smithi084.stdout:5/332: rename d9/da/c16 to d9/d23/c6b 0 2024-02-15T18:27:01.493 INFO:tasks.workunit.client.0.smithi084.stdout:8/340: unlink db/d3f/d59/c2e 0 2024-02-15T18:27:01.494 INFO:tasks.workunit.client.0.smithi084.stdout:6/330: creat d14/d22/d25/d41/f69 x:0 0 0 2024-02-15T18:27:01.494 INFO:tasks.workunit.client.0.smithi084.stdout:1/287: creat d9/d54/d5c/f67 x:0 0 0 2024-02-15T18:27:01.496 INFO:tasks.workunit.client.0.smithi084.stdout:3/311: dwrite d8/d22/f26 [0,4194304] 0 2024-02-15T18:27:01.497 INFO:tasks.workunit.client.0.smithi084.stdout:9/296: dwrite d4/d2b/d3c/f22 [0,4194304] 0 2024-02-15T18:27:01.497 INFO:tasks.workunit.client.0.smithi084.stdout:7/293: rename f7 to df/d1d/d44/f54 0 2024-02-15T18:27:01.498 INFO:tasks.workunit.client.0.smithi084.stdout:5/333: link d9/c4b d9/d5f/c6c 0 2024-02-15T18:27:01.498 INFO:tasks.workunit.client.0.smithi084.stdout:5/334: dread - d9/d35/f6a zero size 2024-02-15T18:27:01.504 INFO:tasks.workunit.client.0.smithi084.stdout:9/297: rmdir d4/d2b/d3c/d20/d43/d15/d33 39 2024-02-15T18:27:01.506 INFO:tasks.workunit.client.0.smithi084.stdout:5/335: creat d9/d23/f6d x:0 0 0 2024-02-15T18:27:01.506 INFO:tasks.workunit.client.0.smithi084.stdout:5/336: stat d9/d23/f37 0 2024-02-15T18:27:01.510 INFO:tasks.workunit.client.0.smithi084.stdout:9/298: rmdir d4/d3d/d59 0 2024-02-15T18:27:01.511 INFO:tasks.workunit.client.0.smithi084.stdout:5/337: creat d9/d35/f6e x:0 0 0 2024-02-15T18:27:01.517 INFO:tasks.workunit.client.0.smithi084.stdout:9/299: unlink d4/d2b/d3c/d20/d43/d15/f16 0 2024-02-15T18:27:01.518 INFO:tasks.workunit.client.0.smithi084.stdout:5/338: creat d9/d3a/f6f x:0 0 0 2024-02-15T18:27:01.518 INFO:tasks.workunit.client.0.smithi084.stdout:9/300: read d4/d2b/d3c/d20/d43/f1c [179352,99528] 0 2024-02-15T18:27:01.518 INFO:tasks.workunit.client.0.smithi084.stdout:9/301: chown d4/d2b/d3c/d24/f58 26469684 1 2024-02-15T18:27:01.520 INFO:tasks.workunit.client.0.smithi084.stdout:9/302: getdents d4/d2b/d3c/d24 0 2024-02-15T18:27:01.520 INFO:tasks.workunit.client.0.smithi084.stdout:9/303: chown d4/d2b/d3c/d20/d43/d15/d5d 1 1 2024-02-15T18:27:01.520 INFO:tasks.workunit.client.0.smithi084.stdout:9/304: dread - d4/d2b/d3c/f49 zero size 2024-02-15T18:27:01.521 INFO:tasks.workunit.client.0.smithi084.stdout:9/305: rename d4/d36/f5f to d4/d3d/f61 0 2024-02-15T18:27:01.521 INFO:tasks.workunit.client.0.smithi084.stdout:5/339: dread d9/d23/f2a [0,4194304] 0 2024-02-15T18:27:01.522 INFO:tasks.workunit.client.0.smithi084.stdout:9/306: rmdir d4/d2b/d3c/d24 39 2024-02-15T18:27:01.522 INFO:tasks.workunit.client.0.smithi084.stdout:9/307: write d4/d2b/d3c/d20/d43/d15/f44 [1834919,8736] 0 2024-02-15T18:27:01.522 INFO:tasks.workunit.client.0.smithi084.stdout:5/340: mkdir d9/da/d3d/d44/d55/d70 0 2024-02-15T18:27:01.523 INFO:tasks.workunit.client.0.smithi084.stdout:5/341: symlink d9/d35/d65/l71 0 2024-02-15T18:27:01.526 INFO:tasks.workunit.client.0.smithi084.stdout:5/342: creat d9/da/d3d/f72 x:0 0 0 2024-02-15T18:27:01.526 INFO:tasks.workunit.client.0.smithi084.stdout:5/343: truncate d9/d35/f58 420007 0 2024-02-15T18:27:01.527 INFO:tasks.workunit.client.0.smithi084.stdout:8/341: dwrite db/dd/f5a [0,4194304] 0 2024-02-15T18:27:01.527 INFO:tasks.workunit.client.0.smithi084.stdout:8/342: chown db/dd/c50 22628752 1 2024-02-15T18:27:01.530 INFO:tasks.workunit.client.0.smithi084.stdout:5/344: rename d9/d35/d65/f3e to d9/da/f73 0 2024-02-15T18:27:01.533 INFO:tasks.workunit.client.0.smithi084.stdout:5/345: dread d9/d23/f4a [0,4194304] 0 2024-02-15T18:27:01.534 INFO:tasks.workunit.client.0.smithi084.stdout:1/288: dwrite d9/d54/d32/f49 [0,4194304] 0 2024-02-15T18:27:01.534 INFO:tasks.workunit.client.0.smithi084.stdout:3/312: dwrite d8/f1d [0,4194304] 0 2024-02-15T18:27:01.535 INFO:tasks.workunit.client.0.smithi084.stdout:5/346: rename d9/c4b to d9/d5f/d68/c74 0 2024-02-15T18:27:01.537 INFO:tasks.workunit.client.0.smithi084.stdout:7/294: dwrite df/d1d/f18 [0,4194304] 0 2024-02-15T18:27:01.537 INFO:tasks.workunit.client.0.smithi084.stdout:7/295: chown df/d1d/d44/f54 935989 1 2024-02-15T18:27:01.537 INFO:tasks.workunit.client.0.smithi084.stdout:1/289: mknod d9/dd/d36/c68 0 2024-02-15T18:27:01.538 INFO:tasks.workunit.client.0.smithi084.stdout:7/296: read df/f1c [90593,51913] 0 2024-02-15T18:27:01.538 INFO:tasks.workunit.client.0.smithi084.stdout:7/297: truncate df/d1d/f3e 362282 0 2024-02-15T18:27:01.538 INFO:tasks.workunit.client.0.smithi084.stdout:3/313: rename d8/d1f/d28/c3e to d8/d1f/c6e 0 2024-02-15T18:27:01.541 INFO:tasks.workunit.client.0.smithi084.stdout:7/298: write df/d1d/d40/d48/f3d [3209138,31357] 0 2024-02-15T18:27:01.541 INFO:tasks.workunit.client.0.smithi084.stdout:5/347: symlink d9/d35/l75 0 2024-02-15T18:27:01.543 INFO:tasks.workunit.client.0.smithi084.stdout:3/314: mknod d8/d22/c6f 0 2024-02-15T18:27:01.545 INFO:tasks.workunit.client.0.smithi084.stdout:9/308: dwrite d4/d2b/d3c/d20/d43/f1c [0,4194304] 0 2024-02-15T18:27:01.547 INFO:tasks.workunit.client.0.smithi084.stdout:7/299: unlink df/d1d/l2c 0 2024-02-15T18:27:01.549 INFO:tasks.workunit.client.0.smithi084.stdout:8/343: truncate db/dd/f5a 3899828 0 2024-02-15T18:27:01.550 INFO:tasks.workunit.client.0.smithi084.stdout:5/348: symlink d9/da/l76 0 2024-02-15T18:27:01.558 INFO:tasks.workunit.client.0.smithi084.stdout:3/315: unlink d8/d1f/c6e 0 2024-02-15T18:27:01.562 INFO:tasks.workunit.client.0.smithi084.stdout:9/309: link d4/d3d/f61 d4/d2b/d3c/d20/f62 0 2024-02-15T18:27:01.563 INFO:tasks.workunit.client.0.smithi084.stdout:5/349: dwrite d9/d35/d65/f56 [0,4194304] 0 2024-02-15T18:27:01.563 INFO:tasks.workunit.client.0.smithi084.stdout:7/300: mkdir df/d1d/d1a/d4d/d55 0 2024-02-15T18:27:01.564 INFO:tasks.workunit.client.0.smithi084.stdout:8/344: creat db/f74 x:0 0 0 2024-02-15T18:27:01.565 INFO:tasks.workunit.client.0.smithi084.stdout:8/345: read db/d1a/f1d [1162209,28618] 0 2024-02-15T18:27:01.565 INFO:tasks.workunit.client.0.smithi084.stdout:8/346: chown db/d3f/l6d 1 1 2024-02-15T18:27:01.566 INFO:tasks.workunit.client.0.smithi084.stdout:0/317: sync 2024-02-15T18:27:01.566 INFO:tasks.workunit.client.0.smithi084.stdout:2/308: sync 2024-02-15T18:27:01.567 INFO:tasks.workunit.client.0.smithi084.stdout:5/350: write d9/fe [2926653,100185] 0 2024-02-15T18:27:01.567 INFO:tasks.workunit.client.0.smithi084.stdout:3/316: getdents d8/d1f 0 2024-02-15T18:27:01.567 INFO:tasks.workunit.client.0.smithi084.stdout:5/351: write d9/d23/f67 [1812830,58005] 0 2024-02-15T18:27:01.569 INFO:tasks.workunit.client.0.smithi084.stdout:7/301: mknod df/d1d/d1a/d4d/c56 0 2024-02-15T18:27:01.572 INFO:tasks.workunit.client.0.smithi084.stdout:8/347: symlink db/dd/d1f/d3e/l75 0 2024-02-15T18:27:01.572 INFO:tasks.workunit.client.0.smithi084.stdout:9/310: dread d4/f6 [0,4194304] 0 2024-02-15T18:27:01.572 INFO:tasks.workunit.client.0.smithi084.stdout:0/318: creat d0/d39/d45/f5f x:0 0 0 2024-02-15T18:27:01.573 INFO:tasks.workunit.client.0.smithi084.stdout:2/309: symlink d3/d19/d36/l6a 0 2024-02-15T18:27:01.573 INFO:tasks.workunit.client.0.smithi084.stdout:2/310: dread - d3/d19/d24/d3e/f55 zero size 2024-02-15T18:27:01.574 INFO:tasks.workunit.client.0.smithi084.stdout:3/317: creat d8/d40/f70 x:0 0 0 2024-02-15T18:27:01.576 INFO:tasks.workunit.client.0.smithi084.stdout:5/352: mknod d9/da/d3d/d44/d55/d70/c77 0 2024-02-15T18:27:01.576 INFO:tasks.workunit.client.0.smithi084.stdout:5/353: dread - d9/d35/f6e zero size 2024-02-15T18:27:01.576 INFO:tasks.workunit.client.0.smithi084.stdout:5/354: chown d9/d35/d65/l71 4395289 1 2024-02-15T18:27:01.576 INFO:tasks.workunit.client.0.smithi084.stdout:8/348: mkdir db/d6a/d76 0 2024-02-15T18:27:01.577 INFO:tasks.workunit.client.0.smithi084.stdout:0/319: dread d0/f1a [0,4194304] 0 2024-02-15T18:27:01.579 INFO:tasks.workunit.client.0.smithi084.stdout:5/355: dread d9/da/f18 [0,4194304] 0 2024-02-15T18:27:01.581 INFO:tasks.workunit.client.0.smithi084.stdout:2/311: symlink d3/d5/l6b 0 2024-02-15T18:27:01.582 INFO:tasks.workunit.client.0.smithi084.stdout:8/349: getdents db/dd/d1f 0 2024-02-15T18:27:01.582 INFO:tasks.workunit.client.0.smithi084.stdout:8/350: write db/f74 [553414,60075] 0 2024-02-15T18:27:01.582 INFO:tasks.workunit.client.0.smithi084.stdout:0/320: creat d0/d2f/d3f/d4f/d59/f60 x:0 0 0 2024-02-15T18:27:01.584 INFO:tasks.workunit.client.0.smithi084.stdout:7/302: dread df/d1d/d40/d48/f3d [0,4194304] 0 2024-02-15T18:27:01.584 INFO:tasks.workunit.client.0.smithi084.stdout:5/356: rename d9/da/l53 to d9/da/d3d/d44/d55/l78 0 2024-02-15T18:27:01.584 INFO:tasks.workunit.client.0.smithi084.stdout:7/303: chown df/d1d/d1a/c41 0 1 2024-02-15T18:27:01.585 INFO:tasks.workunit.client.0.smithi084.stdout:5/357: write d9/f15 [450902,104716] 0 2024-02-15T18:27:01.586 INFO:tasks.workunit.client.0.smithi084.stdout:5/358: fdatasync d9/d35/f58 0 2024-02-15T18:27:01.586 INFO:tasks.workunit.client.0.smithi084.stdout:5/359: chown d9/f2c 388132 1 2024-02-15T18:27:01.587 INFO:tasks.workunit.client.0.smithi084.stdout:3/318: dread d8/f1c [0,4194304] 0 2024-02-15T18:27:01.587 INFO:tasks.workunit.client.0.smithi084.stdout:0/321: dread d0/f1a [0,4194304] 0 2024-02-15T18:27:01.591 INFO:tasks.workunit.client.0.smithi084.stdout:7/304: creat df/d1d/d1a/d4b/f57 x:0 0 0 2024-02-15T18:27:01.591 INFO:tasks.workunit.client.0.smithi084.stdout:8/351: creat db/f77 x:0 0 0 2024-02-15T18:27:01.592 INFO:tasks.workunit.client.0.smithi084.stdout:5/360: mkdir d9/d5b/d79 0 2024-02-15T18:27:01.592 INFO:tasks.workunit.client.0.smithi084.stdout:5/361: readlink d9/d35/l75 0 2024-02-15T18:27:01.592 INFO:tasks.workunit.client.0.smithi084.stdout:5/362: truncate d9/d23/f67 2014275 0 2024-02-15T18:27:01.592 INFO:tasks.workunit.client.0.smithi084.stdout:5/363: chown d9/d35/c49 1355 1 2024-02-15T18:27:01.593 INFO:tasks.workunit.client.0.smithi084.stdout:0/322: mkdir d0/d2f/d3f/d4f/d61 0 2024-02-15T18:27:01.597 INFO:tasks.workunit.client.0.smithi084.stdout:0/323: dread d0/d4/d1b/d26/f2d [0,4194304] 0 2024-02-15T18:27:01.597 INFO:tasks.workunit.client.0.smithi084.stdout:0/324: truncate d0/d39/d45/f5e 527576 0 2024-02-15T18:27:01.597 INFO:tasks.workunit.client.0.smithi084.stdout:7/305: rename fc to df/d1d/f58 0 2024-02-15T18:27:01.597 INFO:tasks.workunit.client.0.smithi084.stdout:0/325: dread - d0/d2f/f56 zero size 2024-02-15T18:27:01.597 INFO:tasks.workunit.client.0.smithi084.stdout:7/306: write f5 [3286715,76757] 0 2024-02-15T18:27:01.597 INFO:tasks.workunit.client.0.smithi084.stdout:7/307: truncate df/f4c 1186800 0 2024-02-15T18:27:01.597 INFO:tasks.workunit.client.0.smithi084.stdout:7/308: write df/d1d/d1a/f28 [1201985,62290] 0 2024-02-15T18:27:01.597 INFO:tasks.workunit.client.0.smithi084.stdout:5/364: truncate d9/f10 1896997 0 2024-02-15T18:27:01.599 INFO:tasks.workunit.client.0.smithi084.stdout:7/309: mkdir df/d1d/d1a/d4d/d59 0 2024-02-15T18:27:01.600 INFO:tasks.workunit.client.0.smithi084.stdout:5/365: mkdir d9/d3a/d7a 0 2024-02-15T18:27:01.601 INFO:tasks.workunit.client.0.smithi084.stdout:7/310: mknod df/d1d/d1a/d4d/c5a 0 2024-02-15T18:27:01.601 INFO:tasks.workunit.client.0.smithi084.stdout:7/311: chown df/d1d/d40/d48/c2f 8896 1 2024-02-15T18:27:01.603 INFO:tasks.workunit.client.0.smithi084.stdout:5/366: rename d9/da/d3d/d44/c46 to d9/d5f/c7b 0 2024-02-15T18:27:01.614 INFO:tasks.workunit.client.0.smithi084.stdout:2/312: dwrite d3/d19/d24/f26 [0,4194304] 0 2024-02-15T18:27:01.615 INFO:tasks.workunit.client.0.smithi084.stdout:2/313: truncate d3/d19/d36/f40 2124936 0 2024-02-15T18:27:01.618 INFO:tasks.workunit.client.0.smithi084.stdout:2/314: write d3/d19/f20 [3968893,82021] 0 2024-02-15T18:27:01.622 INFO:tasks.workunit.client.0.smithi084.stdout:2/315: write d3/d28/f45 [5950205,33460] 0 2024-02-15T18:27:01.624 INFO:tasks.workunit.client.0.smithi084.stdout:8/352: dwrite db/fe [4194304,4194304] 0 2024-02-15T18:27:01.625 INFO:tasks.workunit.client.0.smithi084.stdout:9/311: dwrite d4/d2b/d3c/d24/f58 [0,4194304] 0 2024-02-15T18:27:01.626 INFO:tasks.workunit.client.0.smithi084.stdout:8/353: truncate db/d1a/f1d 1694599 0 2024-02-15T18:27:01.626 INFO:tasks.workunit.client.0.smithi084.stdout:3/319: dwrite d8/d1f/d28/d6b/f6c [0,4194304] 0 2024-02-15T18:27:01.626 INFO:tasks.workunit.client.0.smithi084.stdout:3/320: truncate d8/d22/f26 4814254 0 2024-02-15T18:27:01.626 INFO:tasks.workunit.client.0.smithi084.stdout:3/321: truncate d8/d1f/d2d/f5d 2709944 0 2024-02-15T18:27:01.626 INFO:tasks.workunit.client.0.smithi084.stdout:3/322: read - d8/d1f/d28/f5f zero size 2024-02-15T18:27:01.626 INFO:tasks.workunit.client.0.smithi084.stdout:3/323: readlink d8/d22/l69 0 2024-02-15T18:27:01.626 INFO:tasks.workunit.client.0.smithi084.stdout:8/354: write db/d1a/d2b/f31 [3133028,105584] 0 2024-02-15T18:27:01.628 INFO:tasks.workunit.client.0.smithi084.stdout:2/316: dread d3/d19/d24/f44 [0,4194304] 0 2024-02-15T18:27:01.629 INFO:tasks.workunit.client.0.smithi084.stdout:7/312: dwrite df/f1b [0,4194304] 0 2024-02-15T18:27:01.629 INFO:tasks.workunit.client.0.smithi084.stdout:5/367: dwrite d9/f1d [0,4194304] 0 2024-02-15T18:27:01.629 INFO:tasks.workunit.client.0.smithi084.stdout:9/312: dread d4/d2b/d3c/d20/d43/d15/f44 [0,4194304] 0 2024-02-15T18:27:01.633 INFO:tasks.workunit.client.0.smithi084.stdout:0/326: rmdir d0 39 2024-02-15T18:27:01.633 INFO:tasks.workunit.client.0.smithi084.stdout:0/327: stat d0/d25 0 2024-02-15T18:27:01.633 INFO:tasks.workunit.client.0.smithi084.stdout:0/328: write d0/d2f/f56 [469213,113742] 0 2024-02-15T18:27:01.634 INFO:tasks.workunit.client.0.smithi084.stdout:0/329: readlink d0/d1e/l48 0 2024-02-15T18:27:01.642 INFO:tasks.workunit.client.0.smithi084.stdout:3/324: mkdir d8/d40/d43/d71 0 2024-02-15T18:27:01.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:59.913453+0000 mgr.smithi084.hjmnez (mgr.14596) 16 : cephadm [INF] Upgrade: Updating mgr.smithi133.nxzroj 2024-02-15T18:27:01.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:26:59.916946+0000 mgr.smithi084.hjmnez (mgr.14596) 17 : cephadm [INF] Deploying daemon mgr.smithi133.nxzroj on smithi133 2024-02-15T18:27:01.643 INFO:tasks.workunit.client.0.smithi084.stdout:8/355: unlink db/f20 0 2024-02-15T18:27:01.643 INFO:tasks.workunit.client.0.smithi084.stdout:8/356: write db/d1a/d2b/f45 [593346,96030] 0 2024-02-15T18:27:01.646 INFO:tasks.workunit.client.0.smithi084.stdout:6/331: sync 2024-02-15T18:27:01.646 INFO:tasks.workunit.client.0.smithi084.stdout:4/317: sync 2024-02-15T18:27:01.646 INFO:tasks.workunit.client.0.smithi084.stdout:4/318: write d2/d4/f55 [431165,47409] 0 2024-02-15T18:27:01.648 INFO:tasks.workunit.client.0.smithi084.stdout:7/313: unlink df/d1d/d1a/d4d/c56 0 2024-02-15T18:27:01.649 INFO:tasks.workunit.client.0.smithi084.stdout:2/317: link d3/f1b d3/d19/f6c 0 2024-02-15T18:27:01.651 INFO:tasks.workunit.client.0.smithi084.stdout:1/290: sync 2024-02-15T18:27:01.651 INFO:tasks.workunit.client.0.smithi084.stdout:1/291: truncate d9/d54/d1b/d2c/d35/f5d 239764 0 2024-02-15T18:27:01.653 INFO:tasks.workunit.client.0.smithi084.stdout:5/368: rename d9/d3a to d9/d35/d65/d7c 0 2024-02-15T18:27:01.653 INFO:tasks.workunit.client.0.smithi084.stdout:5/369: truncate d9/f3b 2201097 0 2024-02-15T18:27:01.653 INFO:tasks.workunit.client.0.smithi084.stdout:5/370: readlink d9/da/l24 0 2024-02-15T18:27:01.653 INFO:tasks.workunit.client.0.smithi084.stdout:5/371: chown d9/d35/d65/f34 19931333 1 2024-02-15T18:27:01.653 INFO:tasks.workunit.client.0.smithi084.stdout:5/372: chown d9/da 197 1 2024-02-15T18:27:01.653 INFO:tasks.workunit.client.0.smithi084.stdout:5/373: truncate d9/d23/f4a 456797 0 2024-02-15T18:27:01.654 INFO:tasks.workunit.client.0.smithi084.stdout:9/313: mknod d4/d2b/d3c/d20/d43/d15/d5d/c63 0 2024-02-15T18:27:01.655 INFO:tasks.workunit.client.0.smithi084.stdout:0/330: mknod d0/d2f/d3f/d4f/d59/c62 0 2024-02-15T18:27:01.655 INFO:tasks.workunit.client.0.smithi084.stdout:3/325: creat d8/d40/d58/f72 x:0 0 0 2024-02-15T18:27:01.656 INFO:tasks.workunit.client.0.smithi084.stdout:6/332: link d14/d22/d25/d2f/d31/c5d d14/d22/d25/c6a 0 2024-02-15T18:27:01.657 INFO:tasks.workunit.client.0.smithi084.stdout:6/333: write d14/d22/d25/d41/f68 [888871,111027] 0 2024-02-15T18:27:01.657 INFO:tasks.workunit.client.0.smithi084.stdout:6/334: fsync d14/d22/d25/d2f/d31/d30/d45/d52/f53 0 2024-02-15T18:27:01.657 INFO:tasks.workunit.client.0.smithi084.stdout:6/335: chown d14/d22/d25/l5e 78192581 1 2024-02-15T18:27:01.657 INFO:tasks.workunit.client.0.smithi084.stdout:6/336: truncate d14/f2d 4843915 0 2024-02-15T18:27:01.658 INFO:tasks.workunit.client.0.smithi084.stdout:4/319: link d2/d2b/f54 d2/d2b/f5f 0 2024-02-15T18:27:01.658 INFO:tasks.workunit.client.0.smithi084.stdout:4/320: chown d2/f39 7 1 2024-02-15T18:27:01.658 INFO:tasks.workunit.client.0.smithi084.stdout:7/314: symlink df/d1d/d1a/d4d/d55/l5b 0 2024-02-15T18:27:01.662 INFO:tasks.workunit.client.0.smithi084.stdout:2/318: mknod d3/d19/d24/d3e/c6d 0 2024-02-15T18:27:01.662 INFO:tasks.workunit.client.0.smithi084.stdout:1/292: mkdir d9/d54/d32/d5b/d69 0 2024-02-15T18:27:01.662 INFO:tasks.workunit.client.0.smithi084.stdout:8/357: rename db/dd/d1f/c36 to db/d6a/d76/c78 0 2024-02-15T18:27:01.662 INFO:tasks.workunit.client.0.smithi084.stdout:9/314: creat d4/d2b/d3c/d20/d43/f64 x:0 0 0 2024-02-15T18:27:01.662 INFO:tasks.workunit.client.0.smithi084.stdout:8/358: readlink db/dd/l24 0 2024-02-15T18:27:01.663 INFO:tasks.workunit.client.0.smithi084.stdout:9/315: write d4/d2b/f3b [994172,31865] 0 2024-02-15T18:27:01.663 INFO:tasks.workunit.client.0.smithi084.stdout:0/331: symlink d0/d39/l63 0 2024-02-15T18:27:01.665 INFO:tasks.workunit.client.0.smithi084.stdout:3/326: mkdir d8/d73 0 2024-02-15T18:27:01.665 INFO:tasks.workunit.client.0.smithi084.stdout:8/359: mkdir db/dd/d13/d42/d79 0 2024-02-15T18:27:01.665 INFO:tasks.workunit.client.0.smithi084.stdout:1/293: creat d9/d54/d1b/d2c/d4b/d63/f6a x:0 0 0 2024-02-15T18:27:01.665 INFO:tasks.workunit.client.0.smithi084.stdout:8/360: dread - db/d1a/f5f zero size 2024-02-15T18:27:01.665 INFO:tasks.workunit.client.0.smithi084.stdout:9/316: symlink d4/d2b/d3c/d20/d43/d15/d33/l65 0 2024-02-15T18:27:01.667 INFO:tasks.workunit.client.0.smithi084.stdout:4/321: rename d2/f5b to d2/d2b/f60 0 2024-02-15T18:27:01.667 INFO:tasks.workunit.client.0.smithi084.stdout:4/322: write d2/d2b/d47/f56 [914700,13970] 0 2024-02-15T18:27:01.667 INFO:tasks.workunit.client.0.smithi084.stdout:3/327: symlink d8/d40/d58/l74 0 2024-02-15T18:27:01.667 INFO:tasks.workunit.client.0.smithi084.stdout:3/328: stat d8/d73 0 2024-02-15T18:27:01.669 INFO:tasks.workunit.client.0.smithi084.stdout:1/294: link d9/d54/d1b/d2c/d4b/d63/l64 d9/dd/l6b 0 2024-02-15T18:27:01.672 INFO:tasks.workunit.client.0.smithi084.stdout:3/329: dread d8/d1f/d2d/f5d [0,4194304] 0 2024-02-15T18:27:01.674 INFO:tasks.workunit.client.0.smithi084.stdout:3/330: creat d8/d1f/d25/f75 x:0 0 0 2024-02-15T18:27:01.676 INFO:tasks.workunit.client.0.smithi084.stdout:5/374: dread d9/f29 [0,4194304] 0 2024-02-15T18:27:01.676 INFO:tasks.workunit.client.0.smithi084.stdout:3/331: write d8/d1f/f3b [754106,64319] 0 2024-02-15T18:27:01.676 INFO:tasks.workunit.client.0.smithi084.stdout:5/375: getdents d9/d5b 0 2024-02-15T18:27:01.678 INFO:tasks.workunit.client.0.smithi084.stdout:3/332: mknod d8/d1f/d25/c76 0 2024-02-15T18:27:01.680 INFO:tasks.workunit.client.0.smithi084.stdout:5/376: unlink d9/da/l2d 0 2024-02-15T18:27:01.683 INFO:tasks.workunit.client.0.smithi084.stdout:5/377: link d9/f1d d9/d5b/d79/f7d 0 2024-02-15T18:27:01.684 INFO:tasks.workunit.client.0.smithi084.stdout:5/378: write d9/d35/d65/f56 [5013505,118407] 0 2024-02-15T18:27:01.687 INFO:tasks.workunit.client.0.smithi084.stdout:5/379: rmdir d9/da/d3d 39 2024-02-15T18:27:01.687 INFO:tasks.workunit.client.0.smithi084.stdout:5/380: write d9/d35/d65/d7c/f6f [373576,84196] 0 2024-02-15T18:27:01.690 INFO:tasks.workunit.client.0.smithi084.stdout:8/361: dread db/d1a/d2b/f37 [0,4194304] 0 2024-02-15T18:27:01.690 INFO:tasks.workunit.client.0.smithi084.stdout:5/381: dread d9/d35/f58 [0,4194304] 0 2024-02-15T18:27:01.690 INFO:tasks.workunit.client.0.smithi084.stdout:5/382: stat d9/d35/d65/d7c 0 2024-02-15T18:27:01.690 INFO:tasks.workunit.client.0.smithi084.stdout:5/383: chown d9/d35/d65/d7c/l43 787711 1 2024-02-15T18:27:01.690 INFO:tasks.workunit.client.0.smithi084.stdout:5/384: truncate d9/d23/f47 809411 0 2024-02-15T18:27:01.692 INFO:tasks.workunit.client.0.smithi084.stdout:6/337: dwrite d14/d22/d25/d2f/d31/d3f/d4a/f4c [4194304,4194304] 0 2024-02-15T18:27:01.696 INFO:tasks.workunit.client.0.smithi084.stdout:9/317: dread d4/d2b/d3c/d20/d43/d15/f28 [0,4194304] 0 2024-02-15T18:27:01.698 INFO:tasks.workunit.client.0.smithi084.stdout:8/362: truncate db/dd/f5a 982820 0 2024-02-15T18:27:01.699 INFO:tasks.workunit.client.0.smithi084.stdout:9/318: link d4/d2b/d3c/d20/d43/d15/f37 d4/d2b/d3c/d20/d43/d15/d33/f66 0 2024-02-15T18:27:01.699 INFO:tasks.workunit.client.0.smithi084.stdout:6/338: write f9 [1192100,95140] 0 2024-02-15T18:27:01.703 INFO:tasks.workunit.client.0.smithi084.stdout:9/319: mkdir d4/d2b/d67 0 2024-02-15T18:27:01.703 INFO:tasks.workunit.client.0.smithi084.stdout:9/320: read d4/d36/f45 [283764,8355] 0 2024-02-15T18:27:01.703 INFO:tasks.workunit.client.0.smithi084.stdout:9/321: fsync d4/f29 0 2024-02-15T18:27:01.703 INFO:tasks.workunit.client.0.smithi084.stdout:8/363: mkdir db/dd/d1f/d7a 0 2024-02-15T18:27:01.705 INFO:tasks.workunit.client.0.smithi084.stdout:9/322: creat d4/d2b/d3c/d24/f68 x:0 0 0 2024-02-15T18:27:01.706 INFO:tasks.workunit.client.0.smithi084.stdout:8/364: mkdir db/d1a/d2b/d7b 0 2024-02-15T18:27:01.709 INFO:tasks.workunit.client.0.smithi084.stdout:9/323: link d4/c1e d4/d2b/d3c/d20/c69 0 2024-02-15T18:27:01.709 INFO:tasks.workunit.client.0.smithi084.stdout:8/365: creat db/dd/d4d/f7c x:0 0 0 2024-02-15T18:27:01.710 INFO:tasks.workunit.client.0.smithi084.stdout:9/324: rmdir d4/d2b/d3c/d20/d43/d15/d5d 39 2024-02-15T18:27:01.719 INFO:tasks.workunit.client.0.smithi084.stdout:9/325: dread d4/d2b/d3c/d20/d43/f13 [0,4194304] 0 2024-02-15T18:27:01.719 INFO:tasks.workunit.client.0.smithi084.stdout:9/326: read - d4/d2b/d3c/d20/d43/f3f zero size 2024-02-15T18:27:01.720 INFO:tasks.workunit.client.0.smithi084.stdout:9/327: creat d4/d2b/d3c/d20/d43/f6a x:0 0 0 2024-02-15T18:27:01.721 INFO:tasks.workunit.client.0.smithi084.stdout:9/328: mkdir d4/d6b 0 2024-02-15T18:27:01.724 INFO:tasks.workunit.client.0.smithi084.stdout:4/323: dwrite d2/d2b/d47/f3b [0,4194304] 0 2024-02-15T18:27:01.728 INFO:tasks.workunit.client.0.smithi084.stdout:1/295: dwrite d9/d54/d1b/d2c/d4b/d63/f6a [0,4194304] 0 2024-02-15T18:27:01.729 INFO:tasks.workunit.client.0.smithi084.stdout:0/332: dwrite d0/d2f/d3f/f49 [0,4194304] 0 2024-02-15T18:27:01.729 INFO:tasks.workunit.client.0.smithi084.stdout:8/366: dread db/f16 [4194304,4194304] 0 2024-02-15T18:27:01.729 INFO:tasks.workunit.client.0.smithi084.stdout:8/367: readlink db/d1a/d5e/l6f 0 2024-02-15T18:27:01.729 INFO:tasks.workunit.client.0.smithi084.stdout:3/333: dwrite d8/fc [0,4194304] 0 2024-02-15T18:27:01.729 INFO:tasks.workunit.client.0.smithi084.stdout:7/315: dwrite df/f15 [0,4194304] 0 2024-02-15T18:27:01.729 INFO:tasks.workunit.client.0.smithi084.stdout:7/316: dread - df/d1d/d40/d48/f43 zero size 2024-02-15T18:27:01.730 INFO:tasks.workunit.client.0.smithi084.stdout:5/385: dwrite d9/d23/f4a [0,4194304] 0 2024-02-15T18:27:01.730 INFO:tasks.workunit.client.0.smithi084.stdout:7/317: dread df/f14 [0,4194304] 0 2024-02-15T18:27:01.731 INFO:tasks.workunit.client.0.smithi084.stdout:1/296: creat d9/dd/d36/d4f/d57/f6c x:0 0 0 2024-02-15T18:27:01.731 INFO:tasks.workunit.client.0.smithi084.stdout:2/319: dwrite d3/d5/d1a/d1e/f61 [0,4194304] 0 2024-02-15T18:27:01.733 INFO:tasks.workunit.client.0.smithi084.stdout:3/334: write d8/d22/f24 [2585257,106507] 0 2024-02-15T18:27:01.737 INFO:tasks.workunit.client.0.smithi084.stdout:9/329: dwrite d4/d36/f5e [0,4194304] 0 2024-02-15T18:27:01.737 INFO:tasks.workunit.client.0.smithi084.stdout:9/330: write d4/d2b/d3c/d20/d43/d15/f40 [226739,67751] 0 2024-02-15T18:27:01.740 INFO:tasks.workunit.client.0.smithi084.stdout:9/331: dread d4/d2b/d3c/d20/d43/d15/f44 [0,4194304] 0 2024-02-15T18:27:01.750 INFO:tasks.workunit.client.0.smithi084.stdout:3/335: dread d8/d1f/d28/d6b/f6c [0,4194304] 0 2024-02-15T18:27:01.754 INFO:tasks.workunit.client.0.smithi084.stdout:2/320: dwrite d3/d19/d24/f44 [0,4194304] 0 2024-02-15T18:27:01.755 INFO:tasks.workunit.client.0.smithi084.stdout:0/333: rename d0/d4/d1b/l5d to d0/d2f/d3f/d4f/d61/l64 0 2024-02-15T18:27:01.756 INFO:tasks.workunit.client.0.smithi084.stdout:8/368: mkdir db/d6a/d7d 0 2024-02-15T18:27:01.758 INFO:tasks.workunit.client.0.smithi084.stdout:9/332: dwrite d4/d2b/d3c/f2e [0,4194304] 0 2024-02-15T18:27:01.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:59.913453+0000 mgr.smithi084.hjmnez (mgr.14596) 16 : cephadm [INF] Upgrade: Updating mgr.smithi133.nxzroj 2024-02-15T18:27:01.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:26:59.916946+0000 mgr.smithi084.hjmnez (mgr.14596) 17 : cephadm [INF] Deploying daemon mgr.smithi133.nxzroj on smithi133 2024-02-15T18:27:01.763 INFO:tasks.workunit.client.0.smithi084.stdout:5/386: mkdir d9/d5b/d7e 0 2024-02-15T18:27:01.764 INFO:tasks.workunit.client.0.smithi084.stdout:5/387: chown d9/d35/d65 26220 1 2024-02-15T18:27:01.764 INFO:tasks.workunit.client.0.smithi084.stdout:1/297: rmdir d9/d54/d1b 39 2024-02-15T18:27:01.770 INFO:tasks.workunit.client.0.smithi084.stdout:8/369: dwrite db/d1a/d2b/f51 [4194304,4194304] 0 2024-02-15T18:27:01.770 INFO:tasks.workunit.client.0.smithi084.stdout:8/370: readlink db/dd/d13/l30 0 2024-02-15T18:27:01.770 INFO:tasks.workunit.client.0.smithi084.stdout:8/371: write db/d3f/d59/f28 [69705,3412] 0 2024-02-15T18:27:01.870 INFO:tasks.workunit.client.0.smithi084.stdout:3/336: mknod d8/d1f/d28/c77 0 2024-02-15T18:27:01.887 INFO:tasks.workunit.client.0.smithi084.stdout:3/337: dwrite d8/d1f/d2d/f4f [0,4194304] 0 2024-02-15T18:27:01.925 INFO:tasks.workunit.client.0.smithi084.stdout:2/321: unlink d3/d28/l31 0 2024-02-15T18:27:01.926 INFO:tasks.workunit.client.0.smithi084.stdout:0/334: mknod d0/d4/d3a/c65 0 2024-02-15T18:27:01.927 INFO:tasks.workunit.client.0.smithi084.stdout:0/335: chown d0 439 1 2024-02-15T18:27:01.930 INFO:tasks.workunit.client.0.smithi084.stdout:5/388: getdents d9/d5f 0 2024-02-15T18:27:01.930 INFO:tasks.workunit.client.0.smithi084.stdout:5/389: fdatasync d9/f3b 0 2024-02-15T18:27:01.930 INFO:tasks.workunit.client.0.smithi084.stdout:5/390: write d9/d35/f6a [849218,106558] 0 2024-02-15T18:27:01.930 INFO:tasks.workunit.client.0.smithi084.stdout:5/391: chown d9/d23/f37 0 1 2024-02-15T18:27:01.931 INFO:tasks.workunit.client.0.smithi084.stdout:9/333: creat d4/f6c x:0 0 0 2024-02-15T18:27:01.931 INFO:tasks.workunit.client.0.smithi084.stdout:1/298: mknod d9/d54/d1b/d2c/d4b/d63/c6d 0 2024-02-15T18:27:01.933 INFO:tasks.workunit.client.0.smithi084.stdout:8/372: mkdir db/dd/d4d/d7e 0 2024-02-15T18:27:01.934 INFO:tasks.workunit.client.0.smithi084.stdout:9/334: dread d4/d2b/d3c/d20/d43/ff [0,4194304] 0 2024-02-15T18:27:01.937 INFO:tasks.workunit.client.0.smithi084.stdout:3/338: unlink d8/c60 0 2024-02-15T18:27:01.938 INFO:tasks.workunit.client.0.smithi084.stdout:0/336: getdents d0/d39 0 2024-02-15T18:27:01.941 INFO:tasks.workunit.client.0.smithi084.stdout:5/392: mkdir d9/d35/d65/d7f 0 2024-02-15T18:27:01.942 INFO:tasks.workunit.client.0.smithi084.stdout:1/299: creat d9/d54/f6e x:0 0 0 2024-02-15T18:27:01.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/339: mknod d8/d40/c78 0 2024-02-15T18:27:01.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/340: fsync d8/d22/f52 0 2024-02-15T18:27:01.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/341: fsync d8/f1c 0 2024-02-15T18:27:01.945 INFO:tasks.workunit.client.0.smithi084.stdout:4/324: sync 2024-02-15T18:27:01.945 INFO:tasks.workunit.client.0.smithi084.stdout:6/339: sync 2024-02-15T18:27:01.945 INFO:tasks.workunit.client.0.smithi084.stdout:7/318: sync 2024-02-15T18:27:01.945 INFO:tasks.workunit.client.0.smithi084.stdout:4/325: fdatasync d2/f11 0 2024-02-15T18:27:01.946 INFO:tasks.workunit.client.0.smithi084.stdout:4/326: read d2/d4/fe [1210957,81923] 0 2024-02-15T18:27:01.946 INFO:tasks.workunit.client.0.smithi084.stdout:4/327: fsync d2/d4/d28/d3d/f46 0 2024-02-15T18:27:01.946 INFO:tasks.workunit.client.0.smithi084.stdout:4/328: chown l0 3319 1 2024-02-15T18:27:01.946 INFO:tasks.workunit.client.0.smithi084.stdout:0/337: truncate d0/d2f/d3f/f49 905844 0 2024-02-15T18:27:01.946 INFO:tasks.workunit.client.0.smithi084.stdout:0/338: write d0/d2f/d3f/f30 [4233895,51025] 0 2024-02-15T18:27:01.947 INFO:tasks.workunit.client.0.smithi084.stdout:4/329: write d2/d4/fd [3390202,65459] 0 2024-02-15T18:27:01.947 INFO:tasks.workunit.client.0.smithi084.stdout:5/393: creat d9/d35/d65/d7f/f80 x:0 0 0 2024-02-15T18:27:01.949 INFO:tasks.workunit.client.0.smithi084.stdout:1/300: symlink d9/dd/d36/l6f 0 2024-02-15T18:27:01.949 INFO:tasks.workunit.client.0.smithi084.stdout:1/301: chown d9/dd/d36/l6f 739987 1 2024-02-15T18:27:01.949 INFO:tasks.workunit.client.0.smithi084.stdout:2/322: dwrite d3/d19/f6c [0,4194304] 0 2024-02-15T18:27:01.951 INFO:tasks.workunit.client.0.smithi084.stdout:7/319: creat df/d1d/d40/d48/f5c x:0 0 0 2024-02-15T18:27:01.952 INFO:tasks.workunit.client.0.smithi084.stdout:6/340: creat d14/d22/d25/d2f/d31/d30/f6b x:0 0 0 2024-02-15T18:27:01.952 INFO:tasks.workunit.client.0.smithi084.stdout:9/335: dwrite d4/d2b/f50 [0,4194304] 0 2024-02-15T18:27:01.954 INFO:tasks.workunit.client.0.smithi084.stdout:0/339: mkdir d0/d4/d66 0 2024-02-15T18:27:01.955 INFO:tasks.workunit.client.0.smithi084.stdout:7/320: mknod df/d1d/d1a/d4d/d59/c5d 0 2024-02-15T18:27:01.957 INFO:tasks.workunit.client.0.smithi084.stdout:5/394: dread d9/f29 [0,4194304] 0 2024-02-15T18:27:01.958 INFO:tasks.workunit.client.0.smithi084.stdout:9/336: rename d4/d2b/d3c/d20/d43/f13 to d4/d2b/d67/f6d 0 2024-02-15T18:27:01.958 INFO:tasks.workunit.client.0.smithi084.stdout:9/337: truncate d4/d2b/d3c/d20/d43/d15/f37 313495 0 2024-02-15T18:27:01.958 INFO:tasks.workunit.client.0.smithi084.stdout:9/338: readlink d4/d2b/d3c/d20/d43/l10 0 2024-02-15T18:27:01.962 INFO:tasks.workunit.client.0.smithi084.stdout:0/340: creat d0/d25/f67 x:0 0 0 2024-02-15T18:27:01.963 INFO:tasks.workunit.client.0.smithi084.stdout:0/341: dread d0/d4/d1b/f40 [0,4194304] 0 2024-02-15T18:27:01.964 INFO:tasks.workunit.client.0.smithi084.stdout:5/395: creat d9/d35/d65/d7c/d7a/f81 x:0 0 0 2024-02-15T18:27:01.965 INFO:tasks.workunit.client.0.smithi084.stdout:9/339: symlink d4/d6b/l6e 0 2024-02-15T18:27:01.965 INFO:tasks.workunit.client.0.smithi084.stdout:9/340: truncate d4/d2b/d3c/d20/d43/d15/d4b/f51 1043096 0 2024-02-15T18:27:01.968 INFO:tasks.workunit.client.0.smithi084.stdout:5/396: read d9/d35/d65/f56 [2022025,122791] 0 2024-02-15T18:27:01.968 INFO:tasks.workunit.client.0.smithi084.stdout:5/397: chown d9/d35/f6a 9 1 2024-02-15T18:27:01.970 INFO:tasks.workunit.client.0.smithi084.stdout:0/342: mknod d0/d2f/d3f/d4f/d61/c68 0 2024-02-15T18:27:01.975 INFO:tasks.workunit.client.0.smithi084.stdout:5/398: write d9/fe [618339,129359] 0 2024-02-15T18:27:01.976 INFO:tasks.workunit.client.0.smithi084.stdout:4/330: dwrite d2/d4/f48 [0,4194304] 0 2024-02-15T18:27:01.977 INFO:tasks.workunit.client.0.smithi084.stdout:0/343: creat d0/d2f/d4b/f69 x:0 0 0 2024-02-15T18:27:01.979 INFO:tasks.workunit.client.0.smithi084.stdout:5/399: link d9/d5b/l64 d9/d5f/l82 0 2024-02-15T18:27:01.979 INFO:tasks.workunit.client.0.smithi084.stdout:5/400: truncate d9/d35/d65/f56 5211975 0 2024-02-15T18:27:01.981 INFO:tasks.workunit.client.0.smithi084.stdout:5/401: read d9/d23/f67 [1890319,110870] 0 2024-02-15T18:27:01.981 INFO:tasks.workunit.client.0.smithi084.stdout:5/402: dread - d9/d35/d65/d7f/f80 zero size 2024-02-15T18:27:01.982 INFO:tasks.workunit.client.0.smithi084.stdout:0/344: mkdir d0/d25/d6a 0 2024-02-15T18:27:01.984 INFO:tasks.workunit.client.0.smithi084.stdout:0/345: creat d0/d2f/d3f/d4f/f6b x:0 0 0 2024-02-15T18:27:01.984 INFO:tasks.workunit.client.0.smithi084.stdout:0/346: chown d0/d2f/d3f/d4f/f6b 82622 1 2024-02-15T18:27:01.985 INFO:tasks.workunit.client.0.smithi084.stdout:0/347: link d0/d4/d3a/d5c/f52 d0/d4/d66/f6c 0 2024-02-15T18:27:01.985 INFO:tasks.workunit.client.0.smithi084.stdout:4/331: dread d2/f3 [0,4194304] 0 2024-02-15T18:27:01.985 INFO:tasks.workunit.client.0.smithi084.stdout:4/332: chown d2/d2b/f3e 5343586 1 2024-02-15T18:27:01.986 INFO:tasks.workunit.client.0.smithi084.stdout:4/333: mkdir d2/d2b/d47/d31/d61 0 2024-02-15T18:27:01.986 INFO:tasks.workunit.client.0.smithi084.stdout:4/334: readlink d2/d2b/d47/l3a 0 2024-02-15T18:27:01.988 INFO:tasks.workunit.client.0.smithi084.stdout:9/341: dread d4/f6 [4194304,4194304] 0 2024-02-15T18:27:01.996 INFO:tasks.workunit.client.0.smithi084.stdout:7/321: dwrite df/d1d/d1a/f53 [0,4194304] 0 2024-02-15T18:27:01.998 INFO:tasks.workunit.client.0.smithi084.stdout:2/323: dwrite d3/d19/d24/f32 [0,4194304] 0 2024-02-15T18:27:02.000 INFO:tasks.workunit.client.0.smithi084.stdout:7/322: dread df/f1c [0,4194304] 0 2024-02-15T18:27:02.000 INFO:tasks.workunit.client.0.smithi084.stdout:7/323: write df/d1d/d1a/d4d/f4e [4702811,112085] 0 2024-02-15T18:27:02.000 INFO:tasks.workunit.client.0.smithi084.stdout:6/341: dwrite d14/d22/d25/f2b [4194304,4194304] 0 2024-02-15T18:27:02.001 INFO:tasks.workunit.client.0.smithi084.stdout:7/324: read df/f14 [62728,53539] 0 2024-02-15T18:27:02.002 INFO:tasks.workunit.client.0.smithi084.stdout:1/302: dwrite d9/d54/d1b/d2c/d35/f5d [0,4194304] 0 2024-02-15T18:27:02.009 INFO:tasks.workunit.client.0.smithi084.stdout:6/342: creat d14/d22/d25/f6c x:0 0 0 2024-02-15T18:27:02.013 INFO:tasks.workunit.client.0.smithi084.stdout:1/303: rename d9/dd/f13 to d9/d54/d1b/f70 0 2024-02-15T18:27:02.015 INFO:tasks.workunit.client.0.smithi084.stdout:1/304: unlink d9/lc 0 2024-02-15T18:27:02.016 INFO:tasks.workunit.client.0.smithi084.stdout:1/305: symlink d9/dd/d36/l71 0 2024-02-15T18:27:02.017 INFO:tasks.workunit.client.0.smithi084.stdout:1/306: dread - d9/d54/d5c/f67 zero size 2024-02-15T18:27:02.017 INFO:tasks.workunit.client.0.smithi084.stdout:1/307: dread - d9/d54/f6e zero size 2024-02-15T18:27:02.017 INFO:tasks.workunit.client.0.smithi084.stdout:1/308: write d9/d54/d1b/d38/f4a [535061,120534] 0 2024-02-15T18:27:02.020 INFO:tasks.workunit.client.0.smithi084.stdout:4/335: dwrite d2/fc [0,4194304] 0 2024-02-15T18:27:02.022 INFO:tasks.workunit.client.0.smithi084.stdout:4/336: mkdir d2/d2b/d47/d31/d62 0 2024-02-15T18:27:02.022 INFO:tasks.workunit.client.0.smithi084.stdout:4/337: dread - d2/f39 zero size 2024-02-15T18:27:02.022 INFO:tasks.workunit.client.0.smithi084.stdout:4/338: chown d2/d4/d28/f4b 49 1 2024-02-15T18:27:02.023 INFO:tasks.workunit.client.0.smithi084.stdout:4/339: read d2/f11 [702786,22589] 0 2024-02-15T18:27:02.030 INFO:tasks.workunit.client.0.smithi084.stdout:4/340: rename d2/d4/fe to d2/d4/d28/d3d/d5c/d5d/f63 0 2024-02-15T18:27:02.030 INFO:tasks.workunit.client.0.smithi084.stdout:4/341: readlink d2/d4/d25/l33 0 2024-02-15T18:27:02.030 INFO:tasks.workunit.client.0.smithi084.stdout:4/342: fsync d2/d4/f8 0 2024-02-15T18:27:02.031 INFO:tasks.workunit.client.0.smithi084.stdout:4/343: mkdir d2/d64 0 2024-02-15T18:27:02.031 INFO:tasks.workunit.client.0.smithi084.stdout:4/344: readlink d2/d4/d25/l44 0 2024-02-15T18:27:02.037 INFO:tasks.workunit.client.0.smithi084.stdout:5/403: dwrite d9/d23/f37 [0,4194304] 0 2024-02-15T18:27:02.038 INFO:tasks.workunit.client.0.smithi084.stdout:4/345: dread d2/d2b/d47/d31/f43 [0,4194304] 0 2024-02-15T18:27:02.040 INFO:tasks.workunit.client.0.smithi084.stdout:5/404: creat d9/d5f/d68/f83 x:0 0 0 2024-02-15T18:27:02.040 INFO:tasks.workunit.client.0.smithi084.stdout:5/405: rmdir d9/da/d3d/d44 39 2024-02-15T18:27:02.040 INFO:tasks.workunit.client.0.smithi084.stdout:5/406: truncate d9/da/f73 1048394 0 2024-02-15T18:27:02.042 INFO:tasks.workunit.client.0.smithi084.stdout:5/407: mkdir d9/da/d3d/d44/d55/d70/d84 0 2024-02-15T18:27:02.043 INFO:tasks.workunit.client.0.smithi084.stdout:5/408: symlink d9/da/d3d/d44/d55/d70/l85 0 2024-02-15T18:27:02.046 INFO:tasks.workunit.client.0.smithi084.stdout:7/325: dwrite df/d1d/f58 [4194304,4194304] 0 2024-02-15T18:27:02.046 INFO:tasks.workunit.client.0.smithi084.stdout:7/326: readlink df/d1d/d40/d48/l33 0 2024-02-15T18:27:02.052 INFO:tasks.workunit.client.0.smithi084.stdout:6/343: dwrite d14/d22/d25/d2f/d31/d30/f6b [0,4194304] 0 2024-02-15T18:27:02.053 INFO:tasks.workunit.client.0.smithi084.stdout:2/324: dwrite d3/f11 [0,4194304] 0 2024-02-15T18:27:02.060 INFO:tasks.workunit.client.0.smithi084.stdout:6/344: mknod d14/d22/d25/d2f/d31/d3f/c6d 0 2024-02-15T18:27:02.060 INFO:tasks.workunit.client.0.smithi084.stdout:6/345: readlink d14/d22/d25/d2f/d31/l24 0 2024-02-15T18:27:02.062 INFO:tasks.workunit.client.0.smithi084.stdout:6/346: dread d14/d22/d25/d2f/f60 [0,4194304] 0 2024-02-15T18:27:02.064 INFO:tasks.workunit.client.0.smithi084.stdout:6/347: creat d14/d22/d25/d2f/d31/d30/d45/d54/f6e x:0 0 0 2024-02-15T18:27:02.064 INFO:tasks.workunit.client.0.smithi084.stdout:6/348: fsync d14/f2d 0 2024-02-15T18:27:02.065 INFO:tasks.workunit.client.0.smithi084.stdout:6/349: link d14/d22/f64 d14/f6f 0 2024-02-15T18:27:02.066 INFO:tasks.workunit.client.0.smithi084.stdout:6/350: mknod d14/d22/d25/d2f/d31/d30/d45/d54/c70 0 2024-02-15T18:27:02.066 INFO:tasks.workunit.client.0.smithi084.stdout:6/351: write d14/d22/d25/d2f/f3c [43008,5717] 0 2024-02-15T18:27:02.068 INFO:tasks.workunit.client.0.smithi084.stdout:1/309: dwrite d9/d54/d1b/d2c/f43 [0,4194304] 0 2024-02-15T18:27:02.068 INFO:tasks.workunit.client.0.smithi084.stdout:2/325: dread d3/d19/f5b [0,4194304] 0 2024-02-15T18:27:02.068 INFO:tasks.workunit.client.0.smithi084.stdout:1/310: getdents d9/d54/d32/d5b/d69 0 2024-02-15T18:27:02.068 INFO:tasks.workunit.client.0.smithi084.stdout:1/311: fdatasync d9/d54/d1b/f70 0 2024-02-15T18:27:02.068 INFO:tasks.workunit.client.0.smithi084.stdout:1/312: stat d9/d54/d1b/d38/f4a 0 2024-02-15T18:27:02.068 INFO:tasks.workunit.client.0.smithi084.stdout:6/352: mknod d14/d22/d25/d2f/d31/c71 0 2024-02-15T18:27:02.068 INFO:tasks.workunit.client.0.smithi084.stdout:6/353: rename d14/d22/d25 to d14/d22/d25/d72 22 2024-02-15T18:27:02.069 INFO:tasks.workunit.client.0.smithi084.stdout:2/326: getdents d3/d5 0 2024-02-15T18:27:02.069 INFO:tasks.workunit.client.0.smithi084.stdout:2/327: readlink d3/d5/l6b 0 2024-02-15T18:27:02.069 INFO:tasks.workunit.client.0.smithi084.stdout:1/313: creat d9/d54/d1b/d2c/d35/f72 x:0 0 0 2024-02-15T18:27:02.070 INFO:tasks.workunit.client.0.smithi084.stdout:2/328: creat d3/d5e/f6e x:0 0 0 2024-02-15T18:27:02.070 INFO:tasks.workunit.client.0.smithi084.stdout:2/329: chown d3/d5/d1a/d1e/d4b/f59 50040 1 2024-02-15T18:27:02.070 INFO:tasks.workunit.client.0.smithi084.stdout:2/330: dread - d3/d5/d1a/d1e/f58 zero size 2024-02-15T18:27:02.070 INFO:tasks.workunit.client.0.smithi084.stdout:2/331: chown d3/d5/d1a/d1e/l37 233653362 1 2024-02-15T18:27:02.071 INFO:tasks.workunit.client.0.smithi084.stdout:4/346: dwrite d2/f34 [0,4194304] 0 2024-02-15T18:27:02.072 INFO:tasks.workunit.client.0.smithi084.stdout:5/409: dwrite d9/f1e [4194304,4194304] 0 2024-02-15T18:27:02.073 INFO:tasks.workunit.client.0.smithi084.stdout:7/327: dwrite df/d1d/d1a/f2d [0,4194304] 0 2024-02-15T18:27:02.074 INFO:tasks.workunit.client.0.smithi084.stdout:1/314: getdents d9/dd/d36 0 2024-02-15T18:27:02.079 INFO:tasks.workunit.client.0.smithi084.stdout:4/347: truncate d2/d4/d28/d3d/f46 3140028 0 2024-02-15T18:27:02.082 INFO:tasks.workunit.client.0.smithi084.stdout:6/354: dread fd [0,4194304] 0 2024-02-15T18:27:02.082 INFO:tasks.workunit.client.0.smithi084.stdout:6/355: write d14/d22/d25/d2f/d31/d30/d45/d54/f57 [601194,107843] 0 2024-02-15T18:27:02.083 INFO:tasks.workunit.client.0.smithi084.stdout:5/410: creat d9/da/d3d/d44/f86 x:0 0 0 2024-02-15T18:27:02.083 INFO:tasks.workunit.client.0.smithi084.stdout:5/411: chown d9/d23 24850 1 2024-02-15T18:27:02.085 INFO:tasks.workunit.client.0.smithi084.stdout:2/332: dwrite d3/d5/d1a/d2d/f4a [0,4194304] 0 2024-02-15T18:27:02.085 INFO:tasks.workunit.client.0.smithi084.stdout:2/333: write d3/d19/d24/d3e/d5c/f5f [805355,44700] 0 2024-02-15T18:27:02.086 INFO:tasks.workunit.client.0.smithi084.stdout:2/334: write d3/d5/d1a/d1e/d4b/f59 [3718464,47150] 0 2024-02-15T18:27:02.087 INFO:tasks.workunit.client.1.smithi133.stdout:5/64: sync 2024-02-15T18:27:02.087 INFO:tasks.workunit.client.1.smithi133.stdout:3/65: sync 2024-02-15T18:27:02.087 INFO:tasks.workunit.client.1.smithi133.stdout:4/26: sync 2024-02-15T18:27:02.087 INFO:tasks.workunit.client.1.smithi133.stdout:5/65: fsync f2 0 2024-02-15T18:27:02.087 INFO:tasks.workunit.client.1.smithi133.stdout:4/27: fdatasync d2/f9 0 2024-02-15T18:27:02.088 INFO:tasks.workunit.client.1.smithi133.stdout:4/28: rename d2/f4 to d2/db/fc 0 2024-02-15T18:27:02.089 INFO:tasks.workunit.client.1.smithi133.stdout:5/66: mknod c14 0 2024-02-15T18:27:02.090 INFO:tasks.workunit.client.1.smithi133.stdout:5/67: write fc [2435654,120306] 0 2024-02-15T18:27:02.092 INFO:tasks.workunit.client.0.smithi084.stdout:7/328: symlink df/d1d/d1a/d4d/d55/l5e 0 2024-02-15T18:27:02.093 INFO:tasks.workunit.client.1.smithi133.stdout:5/68: rename f5 to f15 0 2024-02-15T18:27:02.094 INFO:tasks.workunit.client.1.smithi133.stdout:5/69: symlink l16 0 2024-02-15T18:27:02.094 INFO:tasks.workunit.client.1.smithi133.stdout:5/70: chown f10 12 1 2024-02-15T18:27:02.096 INFO:tasks.workunit.client.0.smithi084.stdout:7/329: read df/d1d/d40/d48/f3d [1102863,40954] 0 2024-02-15T18:27:02.096 INFO:tasks.workunit.client.0.smithi084.stdout:7/330: chown df/d1d/d40/d48/l47 29 1 2024-02-15T18:27:02.096 INFO:tasks.workunit.client.1.smithi133.stdout:4/29: dread f0 [0,4194304] 0 2024-02-15T18:27:02.098 INFO:tasks.workunit.client.0.smithi084.stdout:1/315: creat d9/d54/d1b/d2c/d35/f73 x:0 0 0 2024-02-15T18:27:02.098 INFO:tasks.workunit.client.0.smithi084.stdout:6/356: truncate f3 1364474 0 2024-02-15T18:27:02.100 INFO:tasks.workunit.client.0.smithi084.stdout:5/412: creat d9/d5b/d79/f87 x:0 0 0 2024-02-15T18:27:02.100 INFO:tasks.workunit.client.0.smithi084.stdout:5/413: write d9/d23/f57 [464972,129678] 0 2024-02-15T18:27:02.102 INFO:tasks.workunit.client.0.smithi084.stdout:8/373: sync 2024-02-15T18:27:02.102 INFO:tasks.workunit.client.0.smithi084.stdout:2/335: creat d3/d19/f6f x:0 0 0 2024-02-15T18:27:02.104 INFO:tasks.workunit.client.0.smithi084.stdout:1/316: getdents d9/dd/d36/d4f 0 2024-02-15T18:27:02.104 INFO:tasks.workunit.client.0.smithi084.stdout:1/317: write d9/d54/d1b/d38/f4a [1226986,45560] 0 2024-02-15T18:27:02.104 INFO:tasks.workunit.client.0.smithi084.stdout:1/318: readlink d9/d54/d32/l3d 0 2024-02-15T18:27:02.105 INFO:tasks.workunit.client.0.smithi084.stdout:5/414: creat d9/d23/f88 x:0 0 0 2024-02-15T18:27:02.105 INFO:tasks.workunit.client.0.smithi084.stdout:6/357: write d14/d22/d25/f2b [4059818,75325] 0 2024-02-15T18:27:02.106 INFO:tasks.workunit.client.0.smithi084.stdout:2/336: creat d3/d19/d24/d3e/f70 x:0 0 0 2024-02-15T18:27:02.107 INFO:tasks.workunit.client.0.smithi084.stdout:5/415: truncate d9/da/f18 849339 0 2024-02-15T18:27:02.107 INFO:tasks.workunit.client.0.smithi084.stdout:6/358: symlink d14/d22/d25/d41/l73 0 2024-02-15T18:27:02.109 INFO:tasks.workunit.client.0.smithi084.stdout:2/337: truncate d3/d19/d24/f32 2455921 0 2024-02-15T18:27:02.109 INFO:tasks.workunit.client.0.smithi084.stdout:2/338: chown d3/d19/d24/d3e/f50 3 1 2024-02-15T18:27:02.109 INFO:tasks.workunit.client.0.smithi084.stdout:5/416: symlink d9/da/d3d/l89 0 2024-02-15T18:27:02.111 INFO:tasks.workunit.client.0.smithi084.stdout:5/417: creat d9/da/d3d/d44/d55/d70/f8a x:0 0 0 2024-02-15T18:27:02.115 INFO:tasks.workunit.client.0.smithi084.stdout:4/348: dwrite d2/d4/d28/d3d/d5c/d5d/f63 [0,4194304] 0 2024-02-15T18:27:02.115 INFO:tasks.workunit.client.0.smithi084.stdout:4/349: write d2/d2b/d47/f56 [1493693,90734] 0 2024-02-15T18:27:02.117 INFO:tasks.workunit.client.0.smithi084.stdout:4/350: mkdir d2/d4/d28/d3d/d5c/d65 0 2024-02-15T18:27:02.118 INFO:tasks.workunit.client.1.smithi133.stdout:3/66: dwrite d0/fa [0,4194304] 0 2024-02-15T18:27:02.120 INFO:tasks.workunit.client.0.smithi084.stdout:7/331: dwrite df/f3b [0,4194304] 0 2024-02-15T18:27:02.120 INFO:tasks.workunit.client.0.smithi084.stdout:7/332: fdatasync df/d1d/d1a/f2d 0 2024-02-15T18:27:02.125 INFO:tasks.workunit.client.0.smithi084.stdout:4/351: mkdir d2/d4/d25/d66 0 2024-02-15T18:27:02.125 INFO:tasks.workunit.client.0.smithi084.stdout:4/352: chown d2/d4/f4f 26622 1 2024-02-15T18:27:02.126 INFO:tasks.workunit.client.1.smithi133.stdout:3/67: stat d0/c1 0 2024-02-15T18:27:02.126 INFO:tasks.workunit.client.1.smithi133.stdout:4/30: dread d2/db/fc [0,4194304] 0 2024-02-15T18:27:02.128 INFO:tasks.workunit.client.1.smithi133.stdout:4/31: creat d2/fd x:0 0 0 2024-02-15T18:27:02.128 INFO:tasks.workunit.client.1.smithi133.stdout:4/32: write d2/f9 [346969,121459] 0 2024-02-15T18:27:02.131 INFO:tasks.workunit.client.1.smithi133.stdout:4/33: creat d2/db/fe x:0 0 0 2024-02-15T18:27:02.131 INFO:tasks.workunit.client.0.smithi084.stdout:2/339: read d3/d19/d24/f3a [283179,71785] 0 2024-02-15T18:27:02.132 INFO:tasks.workunit.client.1.smithi133.stdout:3/68: symlink d0/ld 0 2024-02-15T18:27:02.132 INFO:tasks.workunit.client.1.smithi133.stdout:3/69: fsync d0/fa 0 2024-02-15T18:27:02.135 INFO:tasks.workunit.client.1.smithi133.stdout:3/70: symlink d0/le 0 2024-02-15T18:27:02.137 INFO:tasks.workunit.client.1.smithi133.stdout:3/71: mkdir d0/df 0 2024-02-15T18:27:02.139 INFO:tasks.workunit.client.0.smithi084.stdout:2/340: write d3/d19/d36/f40 [853590,127652] 0 2024-02-15T18:27:02.147 INFO:tasks.workunit.client.1.smithi133.stdout:5/71: dwrite f3 [4194304,4194304] 0 2024-02-15T18:27:02.151 INFO:tasks.workunit.client.1.smithi133.stdout:5/72: unlink fb 0 2024-02-15T18:27:02.156 INFO:tasks.workunit.client.0.smithi084.stdout:8/374: dwrite db/f25 [0,4194304] 0 2024-02-15T18:27:02.163 INFO:tasks.workunit.client.0.smithi084.stdout:1/319: dwrite d9/dd/d39/f30 [0,4194304] 0 2024-02-15T18:27:02.164 INFO:tasks.workunit.client.0.smithi084.stdout:1/320: symlink d9/d54/l74 0 2024-02-15T18:27:02.168 INFO:tasks.workunit.client.0.smithi084.stdout:1/321: read d9/dd/d39/f30 [3377058,15664] 0 2024-02-15T18:27:02.170 INFO:tasks.workunit.client.0.smithi084.stdout:1/322: creat d9/d54/d32/d5b/f75 x:0 0 0 2024-02-15T18:27:02.170 INFO:tasks.workunit.client.0.smithi084.stdout:1/323: chown d9/d54/d1b/f42 0 1 2024-02-15T18:27:02.170 INFO:tasks.workunit.client.0.smithi084.stdout:1/324: unlink d9/dd/d36/c68 0 2024-02-15T18:27:02.179 INFO:tasks.workunit.client.0.smithi084.stdout:5/418: dwrite d9/f28 [0,4194304] 0 2024-02-15T18:27:02.182 INFO:tasks.workunit.client.0.smithi084.stdout:5/419: symlink d9/d5b/l8b 0 2024-02-15T18:27:02.182 INFO:tasks.workunit.client.0.smithi084.stdout:5/420: chown d9/c41 6572 1 2024-02-15T18:27:02.182 INFO:tasks.workunit.client.0.smithi084.stdout:5/421: dread - d9/d23/f88 zero size 2024-02-15T18:27:02.183 INFO:tasks.workunit.client.0.smithi084.stdout:5/422: truncate d9/da/f38 2253163 0 2024-02-15T18:27:02.184 INFO:tasks.workunit.client.0.smithi084.stdout:5/423: mkdir d9/d35/d65/d8c 0 2024-02-15T18:27:02.185 INFO:tasks.workunit.client.0.smithi084.stdout:5/424: read d9/da/d3d/f4f [9283,76846] 0 2024-02-15T18:27:02.186 INFO:tasks.workunit.client.0.smithi084.stdout:5/425: mkdir d9/d35/d65/d7c/d8d 0 2024-02-15T18:27:02.187 INFO:tasks.workunit.client.0.smithi084.stdout:5/426: symlink d9/d35/d65/d7c/d8d/l8e 0 2024-02-15T18:27:02.188 INFO:tasks.workunit.client.0.smithi084.stdout:5/427: dread d9/da/d3d/f4f [0,4194304] 0 2024-02-15T18:27:02.188 INFO:tasks.workunit.client.0.smithi084.stdout:5/428: fdatasync d9/fe 0 2024-02-15T18:27:02.190 INFO:tasks.workunit.client.0.smithi084.stdout:6/359: dwrite d14/f38 [0,4194304] 0 2024-02-15T18:27:02.190 INFO:tasks.workunit.client.0.smithi084.stdout:5/429: rename d9/da/f18 to d9/d35/d65/d7c/d8d/f8f 0 2024-02-15T18:27:02.192 INFO:tasks.workunit.client.0.smithi084.stdout:1/325: dwrite d9/d54/d1b/d2c/d35/f72 [0,4194304] 0 2024-02-15T18:27:02.193 INFO:tasks.workunit.client.1.smithi133.stdout:3/72: dwrite d0/f8 [0,4194304] 0 2024-02-15T18:27:02.193 INFO:tasks.workunit.client.1.smithi133.stdout:3/73: write d0/fc [372005,94674] 0 2024-02-15T18:27:02.193 INFO:tasks.workunit.client.1.smithi133.stdout:5/73: dwrite f15 [0,4194304] 0 2024-02-15T18:27:02.194 INFO:tasks.workunit.client.0.smithi084.stdout:6/360: creat d14/d22/d25/d2f/d31/d3f/f74 x:0 0 0 2024-02-15T18:27:02.194 INFO:tasks.workunit.client.0.smithi084.stdout:7/333: dwrite df/d1d/d40/d48/f45 [0,4194304] 0 2024-02-15T18:27:02.194 INFO:tasks.workunit.client.0.smithi084.stdout:7/334: fdatasync df/d1d/d1a/f24 0 2024-02-15T18:27:02.196 INFO:tasks.workunit.client.1.smithi133.stdout:4/34: write f0 [1245645,109705] 0 2024-02-15T18:27:02.196 INFO:tasks.workunit.client.0.smithi084.stdout:1/326: mkdir d9/d54/d76 0 2024-02-15T18:27:02.196 INFO:tasks.workunit.client.0.smithi084.stdout:1/327: write d9/d54/d1b/d2c/d35/f73 [433530,61430] 0 2024-02-15T18:27:02.197 INFO:tasks.workunit.client.0.smithi084.stdout:3/342: sync 2024-02-15T18:27:02.198 INFO:tasks.workunit.client.0.smithi084.stdout:3/343: getdents d8/d1f 0 2024-02-15T18:27:02.198 INFO:tasks.workunit.client.0.smithi084.stdout:3/344: dread - d8/d22/f52 zero size 2024-02-15T18:27:02.199 INFO:tasks.workunit.client.0.smithi084.stdout:4/353: dwrite d2/d4/f5a [0,4194304] 0 2024-02-15T18:27:02.201 INFO:tasks.workunit.client.1.smithi133.stdout:4/35: symlink d2/lf 0 2024-02-15T18:27:02.201 INFO:tasks.workunit.client.1.smithi133.stdout:4/36: write d2/fd [629186,1397] 0 2024-02-15T18:27:02.202 INFO:tasks.workunit.client.0.smithi084.stdout:6/361: creat d14/d22/d25/d41/f75 x:0 0 0 2024-02-15T18:27:02.205 INFO:tasks.workunit.client.0.smithi084.stdout:2/341: dread d3/d19/d36/f40 [0,4194304] 0 2024-02-15T18:27:02.205 INFO:tasks.workunit.client.1.smithi133.stdout:7/27: sync 2024-02-15T18:27:02.205 INFO:tasks.workunit.client.1.smithi133.stdout:8/47: sync 2024-02-15T18:27:02.205 INFO:tasks.workunit.client.1.smithi133.stdout:7/28: dread - f7 zero size 2024-02-15T18:27:02.207 INFO:tasks.workunit.client.0.smithi084.stdout:3/345: stat d8/d22/l69 0 2024-02-15T18:27:02.207 INFO:tasks.workunit.client.0.smithi084.stdout:3/346: write d8/d22/f52 [404288,56503] 0 2024-02-15T18:27:02.209 INFO:tasks.workunit.client.1.smithi133.stdout:7/29: getdents . 0 2024-02-15T18:27:02.210 INFO:tasks.workunit.client.1.smithi133.stdout:7/30: mknod c8 0 2024-02-15T18:27:02.211 INFO:tasks.workunit.client.0.smithi084.stdout:4/354: link d2/d4/f52 d2/d4/d28/d2e/f67 0 2024-02-15T18:27:02.211 INFO:tasks.workunit.client.0.smithi084.stdout:4/355: truncate d2/f5e 377728 0 2024-02-15T18:27:02.212 INFO:tasks.workunit.client.0.smithi084.stdout:6/362: rmdir d14/d22/d25/d2f 39 2024-02-15T18:27:02.212 INFO:tasks.workunit.client.0.smithi084.stdout:2/342: symlink d3/d5/l71 0 2024-02-15T18:27:02.214 INFO:tasks.workunit.client.1.smithi133.stdout:4/37: fsync d2/f9 0 2024-02-15T18:27:02.214 INFO:tasks.workunit.client.1.smithi133.stdout:7/31: mkdir d9 0 2024-02-15T18:27:02.215 INFO:tasks.workunit.client.1.smithi133.stdout:4/38: fsync d2/db/fe 0 2024-02-15T18:27:02.215 INFO:tasks.workunit.client.0.smithi084.stdout:4/356: rename d2/d4/l1b to d2/d4/d28/l68 0 2024-02-15T18:27:02.215 INFO:tasks.workunit.client.0.smithi084.stdout:4/357: stat d2/d2b/d47/f56 0 2024-02-15T18:27:02.216 INFO:tasks.workunit.client.0.smithi084.stdout:2/343: dread d3/d19/d36/f39 [0,4194304] 0 2024-02-15T18:27:02.216 INFO:tasks.workunit.client.0.smithi084.stdout:2/344: chown d3/d19/f33 1097 1 2024-02-15T18:27:02.217 INFO:tasks.workunit.client.0.smithi084.stdout:4/358: creat d2/d4/d28/d3d/d5c/d65/f69 x:0 0 0 2024-02-15T18:27:02.219 INFO:tasks.workunit.client.0.smithi084.stdout:6/363: write f13 [804099,128913] 0 2024-02-15T18:27:02.219 INFO:tasks.workunit.client.0.smithi084.stdout:5/430: dwrite d9/fe [0,4194304] 0 2024-02-15T18:27:02.220 INFO:tasks.workunit.client.0.smithi084.stdout:4/359: rename d2/d4/d25/l44 to d2/d2b/d47/d31/d50/l6a 0 2024-02-15T18:27:02.221 INFO:tasks.workunit.client.1.smithi133.stdout:8/48: dread d3/f5 [0,4194304] 0 2024-02-15T18:27:02.221 INFO:tasks.workunit.client.1.smithi133.stdout:8/49: fdatasync d3/f4 0 2024-02-15T18:27:02.221 INFO:tasks.workunit.client.1.smithi133.stdout:8/50: chown f2 3708 1 2024-02-15T18:27:02.223 INFO:tasks.workunit.client.0.smithi084.stdout:1/328: dread d9/d54/d1b/f53 [0,4194304] 0 2024-02-15T18:27:02.223 INFO:tasks.workunit.client.0.smithi084.stdout:7/335: write df/f1c [219446,89206] 0 2024-02-15T18:27:02.224 INFO:tasks.workunit.client.1.smithi133.stdout:7/32: write f0 [1170401,55345] 0 2024-02-15T18:27:02.224 INFO:tasks.workunit.client.0.smithi084.stdout:6/364: symlink d14/d22/d25/d41/l76 0 2024-02-15T18:27:02.224 INFO:tasks.workunit.client.0.smithi084.stdout:4/360: symlink d2/d4/d28/d2e/l6b 0 2024-02-15T18:27:02.224 INFO:tasks.workunit.client.0.smithi084.stdout:6/365: read - d14/d22/d25/d2f/d31/d30/d45/d54/f6e zero size 2024-02-15T18:27:02.224 INFO:tasks.workunit.client.0.smithi084.stdout:4/361: write d2/d4/f52 [931911,33828] 0 2024-02-15T18:27:02.225 INFO:tasks.workunit.client.0.smithi084.stdout:6/366: dread - d14/d22/d25/d41/f69 zero size 2024-02-15T18:27:02.225 INFO:tasks.workunit.client.0.smithi084.stdout:4/362: chown d2/d4/d28/d2e 14 1 2024-02-15T18:27:02.228 INFO:tasks.workunit.client.0.smithi084.stdout:1/329: write d9/d54/d32/f49 [2630926,79098] 0 2024-02-15T18:27:02.228 INFO:tasks.workunit.client.1.smithi133.stdout:7/33: mkdir d9/da 0 2024-02-15T18:27:02.229 INFO:tasks.workunit.client.1.smithi133.stdout:7/34: mkdir d9/db 0 2024-02-15T18:27:02.230 INFO:tasks.workunit.client.0.smithi084.stdout:6/367: unlink d14/d22/d25/d2f/f3c 0 2024-02-15T18:27:02.230 INFO:tasks.workunit.client.0.smithi084.stdout:6/368: truncate d14/d22/d25/f35 1176907 0 2024-02-15T18:27:02.231 INFO:tasks.workunit.client.0.smithi084.stdout:4/363: symlink d2/d2b/l6c 0 2024-02-15T18:27:02.233 INFO:tasks.workunit.client.0.smithi084.stdout:1/330: unlink d9/dd/d36/l6f 0 2024-02-15T18:27:02.235 INFO:tasks.workunit.client.0.smithi084.stdout:5/431: dread d9/f1d [0,4194304] 0 2024-02-15T18:27:02.235 INFO:tasks.workunit.client.1.smithi133.stdout:5/74: dwrite f10 [0,4194304] 0 2024-02-15T18:27:02.236 INFO:tasks.workunit.client.1.smithi133.stdout:5/75: chown f2 0 1 2024-02-15T18:27:02.236 INFO:tasks.workunit.client.1.smithi133.stdout:7/35: unlink l5 0 2024-02-15T18:27:02.236 INFO:tasks.workunit.client.0.smithi084.stdout:1/331: rmdir d9/d54/d32/d5b 39 2024-02-15T18:27:02.237 INFO:tasks.workunit.client.0.smithi084.stdout:5/432: truncate f8 2923430 0 2024-02-15T18:27:02.240 INFO:tasks.workunit.client.0.smithi084.stdout:5/433: write d9/da/d3d/f4f [343325,106618] 0 2024-02-15T18:27:02.240 INFO:tasks.workunit.client.0.smithi084.stdout:1/332: mknod d9/dd/d36/d4f/c77 0 2024-02-15T18:27:02.240 INFO:tasks.workunit.client.0.smithi084.stdout:1/333: creat d9/d54/d76/f78 x:0 0 0 2024-02-15T18:27:02.241 INFO:tasks.workunit.client.1.smithi133.stdout:5/76: mkdir d17 0 2024-02-15T18:27:02.241 INFO:tasks.workunit.client.1.smithi133.stdout:7/36: rmdir d9 39 2024-02-15T18:27:02.244 INFO:tasks.workunit.client.1.smithi133.stdout:3/74: dwrite d0/fa [4194304,4194304] 0 2024-02-15T18:27:02.244 INFO:tasks.workunit.client.1.smithi133.stdout:5/77: rename l16 to d17/l18 0 2024-02-15T18:27:02.245 INFO:tasks.workunit.client.1.smithi133.stdout:5/78: chown le 76997 1 2024-02-15T18:27:02.247 INFO:tasks.workunit.client.1.smithi133.stdout:3/75: getdents d0 0 2024-02-15T18:27:02.247 INFO:tasks.workunit.client.1.smithi133.stdout:3/76: chown d0/f5 922230 1 2024-02-15T18:27:02.247 INFO:tasks.workunit.client.0.smithi084.stdout:3/347: dwrite d8/d22/f34 [0,4194304] 0 2024-02-15T18:27:02.248 INFO:tasks.workunit.client.0.smithi084.stdout:6/369: dread d14/d22/d25/d2f/d31/d30/f6b [0,4194304] 0 2024-02-15T18:27:02.249 INFO:tasks.workunit.client.1.smithi133.stdout:5/79: rename f3 to d17/f19 0 2024-02-15T18:27:02.249 INFO:tasks.workunit.client.1.smithi133.stdout:5/80: readlink la 0 2024-02-15T18:27:02.249 INFO:tasks.workunit.client.1.smithi133.stdout:5/81: truncate f15 4640969 0 2024-02-15T18:27:02.252 INFO:tasks.workunit.client.1.smithi133.stdout:9/78: sync 2024-02-15T18:27:02.252 INFO:tasks.workunit.client.1.smithi133.stdout:0/61: sync 2024-02-15T18:27:02.253 INFO:tasks.workunit.client.1.smithi133.stdout:2/91: sync 2024-02-15T18:27:02.253 INFO:tasks.workunit.client.1.smithi133.stdout:1/145: sync 2024-02-15T18:27:02.253 INFO:tasks.workunit.client.1.smithi133.stdout:6/140: sync 2024-02-15T18:27:02.254 INFO:tasks.workunit.client.0.smithi084.stdout:3/348: symlink d8/d1f/d2d/l79 0 2024-02-15T18:27:02.254 INFO:tasks.workunit.client.0.smithi084.stdout:0/348: sync 2024-02-15T18:27:02.254 INFO:tasks.workunit.client.0.smithi084.stdout:9/342: sync 2024-02-15T18:27:02.254 INFO:tasks.workunit.client.0.smithi084.stdout:0/349: dread - d0/d2f/d3f/d4f/d59/f60 zero size 2024-02-15T18:27:02.259 INFO:tasks.workunit.client.0.smithi084.stdout:6/370: rename d14/d22/d25/f6c to d14/d22/d25/d28/f77 0 2024-02-15T18:27:02.259 INFO:tasks.workunit.client.0.smithi084.stdout:3/349: creat d8/d22/f7a x:0 0 0 2024-02-15T18:27:02.260 INFO:tasks.workunit.client.1.smithi133.stdout:0/62: symlink d9/l18 0 2024-02-15T18:27:02.261 INFO:tasks.workunit.client.0.smithi084.stdout:0/350: mkdir d0/d4/d1b/d26/d43/d6d 0 2024-02-15T18:27:02.261 INFO:tasks.workunit.client.0.smithi084.stdout:2/345: dwrite d3/d5/d1a/d1e/d4b/f59 [0,4194304] 0 2024-02-15T18:27:02.261 INFO:tasks.workunit.client.0.smithi084.stdout:2/346: readlink d3/d5/l71 0 2024-02-15T18:27:02.264 INFO:tasks.workunit.client.0.smithi084.stdout:0/351: read d0/d4/d1b/f3c [296033,2797] 0 2024-02-15T18:27:02.264 INFO:tasks.workunit.client.1.smithi133.stdout:2/92: write d7/f16 [2168347,46824] 0 2024-02-15T18:27:02.265 INFO:tasks.workunit.client.1.smithi133.stdout:2/93: chown d7/l17 3944 1 2024-02-15T18:27:02.265 INFO:tasks.workunit.client.1.smithi133.stdout:2/94: chown d7 5 1 2024-02-15T18:27:02.265 INFO:tasks.workunit.client.1.smithi133.stdout:4/39: dwrite d2/db/fe [0,4194304] 0 2024-02-15T18:27:02.265 INFO:tasks.workunit.client.1.smithi133.stdout:4/40: chown d2/db/fe 14 1 2024-02-15T18:27:02.265 INFO:tasks.workunit.client.1.smithi133.stdout:3/77: dread d0/f8 [0,4194304] 0 2024-02-15T18:27:02.265 INFO:tasks.workunit.client.1.smithi133.stdout:6/141: rename d0/db/d21/c22 to d0/c2e 0 2024-02-15T18:27:02.265 INFO:tasks.workunit.client.1.smithi133.stdout:6/142: chown d0/c2e 240927983 1 2024-02-15T18:27:02.266 INFO:tasks.workunit.client.0.smithi084.stdout:6/371: truncate d14/f38 1782467 0 2024-02-15T18:27:02.266 INFO:tasks.workunit.client.0.smithi084.stdout:6/372: fdatasync d14/d22/d25/f44 0 2024-02-15T18:27:02.266 INFO:tasks.workunit.client.0.smithi084.stdout:3/350: creat d8/d1f/d28/f7b x:0 0 0 2024-02-15T18:27:02.266 INFO:tasks.workunit.client.0.smithi084.stdout:0/352: dread d0/d4/d1b/f3e [0,4194304] 0 2024-02-15T18:27:02.266 INFO:tasks.workunit.client.0.smithi084.stdout:0/353: fdatasync d0/d25/f34 0 2024-02-15T18:27:02.266 INFO:tasks.workunit.client.1.smithi133.stdout:2/95: link c4 d7/d18/c24 0 2024-02-15T18:27:02.269 INFO:tasks.workunit.client.1.smithi133.stdout:4/41: rmdir d2/db 39 2024-02-15T18:27:02.270 INFO:tasks.workunit.client.0.smithi084.stdout:2/347: creat d3/d19/d36/f72 x:0 0 0 2024-02-15T18:27:02.270 INFO:tasks.workunit.client.0.smithi084.stdout:2/348: dread - d3/d19/d36/f72 zero size 2024-02-15T18:27:02.270 INFO:tasks.workunit.client.1.smithi133.stdout:6/143: rmdir d0/db/d21 39 2024-02-15T18:27:02.271 INFO:tasks.workunit.client.0.smithi084.stdout:2/349: symlink d3/d28/l73 0 2024-02-15T18:27:02.272 INFO:tasks.workunit.client.0.smithi084.stdout:2/350: rmdir d3/d5/d1a/d1e/d30 39 2024-02-15T18:27:02.273 INFO:tasks.workunit.client.0.smithi084.stdout:2/351: chown d3/d19/d24/f44 2 1 2024-02-15T18:27:02.273 INFO:tasks.workunit.client.1.smithi133.stdout:2/96: rename d7/db/l19 to d7/l25 0 2024-02-15T18:27:02.275 INFO:tasks.workunit.client.1.smithi133.stdout:6/144: rename d0/d5/f13 to d0/db/d29/f2f 0 2024-02-15T18:27:02.275 INFO:tasks.workunit.client.1.smithi133.stdout:6/145: readlink d0/d5/le 0 2024-02-15T18:27:02.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/146: link d0/c15 d0/db/d1c/c30 0 2024-02-15T18:27:02.280 INFO:tasks.workunit.client.1.smithi133.stdout:6/147: rename d0/cc to d0/c31 0 2024-02-15T18:27:02.280 INFO:tasks.workunit.client.1.smithi133.stdout:6/148: dread - d0/f26 zero size 2024-02-15T18:27:02.291 INFO:tasks.workunit.client.1.smithi133.stdout:7/37: dwrite f7 [0,4194304] 0 2024-02-15T18:27:02.292 INFO:tasks.workunit.client.0.smithi084.stdout:1/334: getdents d9/dd/d36/d4f 0 2024-02-15T18:27:02.294 INFO:tasks.workunit.client.0.smithi084.stdout:3/351: dread d8/d1f/d2d/f4f [0,4194304] 0 2024-02-15T18:27:02.296 INFO:tasks.workunit.client.0.smithi084.stdout:3/352: unlink d8/f48 0 2024-02-15T18:27:02.297 INFO:tasks.workunit.client.0.smithi084.stdout:3/353: creat d8/d1f/d28/f7c x:0 0 0 2024-02-15T18:27:02.297 INFO:tasks.workunit.client.0.smithi084.stdout:3/354: stat d8/fc 0 2024-02-15T18:27:02.299 INFO:tasks.workunit.client.1.smithi133.stdout:2/97: dread d7/db/f1d [0,4194304] 0 2024-02-15T18:27:02.300 INFO:tasks.workunit.client.1.smithi133.stdout:2/98: creat d7/f26 x:0 0 0 2024-02-15T18:27:02.303 INFO:tasks.workunit.client.1.smithi133.stdout:2/99: link d7/d18/l1a d7/db/l27 0 2024-02-15T18:27:02.303 INFO:tasks.workunit.client.1.smithi133.stdout:2/100: write d7/db/f1d [5174885,7981] 0 2024-02-15T18:27:02.303 INFO:tasks.workunit.client.1.smithi133.stdout:2/101: rmdir d7/db 39 2024-02-15T18:27:02.306 INFO:tasks.workunit.client.1.smithi133.stdout:2/102: rename d7/db/c23 to d7/d18/c28 0 2024-02-15T18:27:02.307 INFO:tasks.workunit.client.0.smithi084.stdout:1/335: dread d9/d54/d1b/f70 [0,4194304] 0 2024-02-15T18:27:02.308 INFO:tasks.workunit.client.1.smithi133.stdout:2/103: unlink d7/d18/c24 0 2024-02-15T18:27:02.308 INFO:tasks.workunit.client.1.smithi133.stdout:2/104: truncate d7/f20 984218 0 2024-02-15T18:27:02.309 INFO:tasks.workunit.client.1.smithi133.stdout:9/79: dwrite d0/d8/d9/fb [0,4194304] 0 2024-02-15T18:27:02.309 INFO:tasks.workunit.client.1.smithi133.stdout:9/80: write d0/d8/fd [1010037,93301] 0 2024-02-15T18:27:02.310 INFO:tasks.workunit.client.0.smithi084.stdout:5/434: dwrite d9/da/d3d/f72 [0,4194304] 0 2024-02-15T18:27:02.310 INFO:tasks.workunit.client.0.smithi084.stdout:1/336: rename d9/dd to d9/d54/d1b/d2c/d4b/d4c/d79 0 2024-02-15T18:27:02.310 INFO:tasks.workunit.client.0.smithi084.stdout:4/364: dwrite d2/d4/d28/d3d/f53 [0,4194304] 0 2024-02-15T18:27:02.310 INFO:tasks.workunit.client.0.smithi084.stdout:1/337: fsync d9/d54/d1b/d2c/d35/f73 0 2024-02-15T18:27:02.310 INFO:tasks.workunit.client.0.smithi084.stdout:4/365: write d2/d2b/f1f [751111,79747] 0 2024-02-15T18:27:02.312 INFO:tasks.workunit.client.1.smithi133.stdout:2/105: symlink d7/db/l29 0 2024-02-15T18:27:02.312 INFO:tasks.workunit.client.1.smithi133.stdout:2/106: fdatasync d7/db/f21 0 2024-02-15T18:27:02.312 INFO:tasks.workunit.client.0.smithi084.stdout:5/435: getdents d9/d5b 0 2024-02-15T18:27:02.314 INFO:tasks.workunit.client.1.smithi133.stdout:2/107: write d7/f13 [1193473,100653] 0 2024-02-15T18:27:02.314 INFO:tasks.workunit.client.1.smithi133.stdout:2/108: fsync d7/f14 0 2024-02-15T18:27:02.314 INFO:tasks.workunit.client.1.smithi133.stdout:9/81: rmdir d0/d8/d9/d12 39 2024-02-15T18:27:02.315 INFO:tasks.workunit.client.0.smithi084.stdout:1/338: fsync d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 0 2024-02-15T18:27:02.315 INFO:tasks.workunit.client.0.smithi084.stdout:4/366: dread d2/d4/f55 [0,4194304] 0 2024-02-15T18:27:02.315 INFO:tasks.workunit.client.0.smithi084.stdout:4/367: getdents d2/d64 0 2024-02-15T18:27:02.315 INFO:tasks.workunit.client.0.smithi084.stdout:4/368: dread - d2/d4/d28/f4b zero size 2024-02-15T18:27:02.316 INFO:tasks.workunit.client.1.smithi133.stdout:2/109: read d7/f13 [3682731,8191] 0 2024-02-15T18:27:02.316 INFO:tasks.workunit.client.0.smithi084.stdout:1/339: mkdir d9/d54/d1b/d2c/d4b/d7a 0 2024-02-15T18:27:02.319 INFO:tasks.workunit.client.1.smithi133.stdout:9/82: mknod d0/c17 0 2024-02-15T18:27:02.321 INFO:tasks.workunit.client.1.smithi133.stdout:2/110: link d7/db/l27 d7/l2a 0 2024-02-15T18:27:02.323 INFO:tasks.workunit.client.1.smithi133.stdout:2/111: write f1 [1979504,94737] 0 2024-02-15T18:27:02.323 INFO:tasks.workunit.client.1.smithi133.stdout:2/112: chown d7/d18/l1a 11 1 2024-02-15T18:27:02.323 INFO:tasks.workunit.client.1.smithi133.stdout:2/113: write d7/db/f1b [752772,115318] 0 2024-02-15T18:27:02.323 INFO:tasks.workunit.client.1.smithi133.stdout:9/83: symlink d0/d8/l18 0 2024-02-15T18:27:02.324 INFO:tasks.workunit.client.1.smithi133.stdout:4/42: dwrite d2/fd [0,4194304] 0 2024-02-15T18:27:02.324 INFO:tasks.workunit.client.0.smithi084.stdout:9/343: dwrite d4/f6c [0,4194304] 0 2024-02-15T18:27:02.325 INFO:tasks.workunit.client.0.smithi084.stdout:9/344: write d4/d2b/d3c/d20/d43/f3f [982849,83840] 0 2024-02-15T18:27:02.325 INFO:tasks.workunit.client.0.smithi084.stdout:9/345: chown d4/d2b/d3c/d20/d43/f6a 371 1 2024-02-15T18:27:02.325 INFO:tasks.workunit.client.0.smithi084.stdout:9/346: stat d4/d2b/d3c/d20/d43/d15/d4b 0 2024-02-15T18:27:02.325 INFO:tasks.workunit.client.1.smithi133.stdout:9/84: truncate d0/f6 2166866 0 2024-02-15T18:27:02.326 INFO:tasks.workunit.client.1.smithi133.stdout:3/78: dread d0/fa [4194304,4194304] 0 2024-02-15T18:27:02.326 INFO:tasks.workunit.client.1.smithi133.stdout:3/79: chown d0/ld 184 1 2024-02-15T18:27:02.326 INFO:tasks.workunit.client.1.smithi133.stdout:3/80: readlink d0/lb 0 2024-02-15T18:27:02.327 INFO:tasks.workunit.client.0.smithi084.stdout:0/354: dwrite d0/d4/d1b/f3c [0,4194304] 0 2024-02-15T18:27:02.328 INFO:tasks.workunit.client.0.smithi084.stdout:9/347: read d4/f6c [1512995,14493] 0 2024-02-15T18:27:02.328 INFO:tasks.workunit.client.0.smithi084.stdout:9/348: chown d4/d2b/d3c/d20/d43/d15/f44 0 1 2024-02-15T18:27:02.328 INFO:tasks.workunit.client.1.smithi133.stdout:4/43: creat d2/d5/f10 x:0 0 0 2024-02-15T18:27:02.329 INFO:tasks.workunit.client.0.smithi084.stdout:2/352: dwrite d3/d19/d36/f39 [0,4194304] 0 2024-02-15T18:27:02.329 INFO:tasks.workunit.client.0.smithi084.stdout:0/355: mknod d0/d2f/d3f/c6e 0 2024-02-15T18:27:02.330 INFO:tasks.workunit.client.0.smithi084.stdout:9/349: write d4/d2b/d3c/f22 [295307,2976] 0 2024-02-15T18:27:02.331 INFO:tasks.workunit.client.1.smithi133.stdout:0/63: dwrite d9/d10/f17 [0,4194304] 0 2024-02-15T18:27:02.331 INFO:tasks.workunit.client.1.smithi133.stdout:6/149: dwrite d0/f24 [0,4194304] 0 2024-02-15T18:27:02.331 INFO:tasks.workunit.client.1.smithi133.stdout:6/150: chown d0/db/c11 79903 1 2024-02-15T18:27:02.331 INFO:tasks.workunit.client.1.smithi133.stdout:5/82: dwrite fc [0,4194304] 0 2024-02-15T18:27:02.334 INFO:tasks.workunit.client.1.smithi133.stdout:2/114: write d7/f13 [1521811,68846] 0 2024-02-15T18:27:02.334 INFO:tasks.workunit.client.1.smithi133.stdout:2/115: write d7/db/f21 [781178,65004] 0 2024-02-15T18:27:02.334 INFO:tasks.workunit.client.1.smithi133.stdout:2/116: readlink d7/ld 0 2024-02-15T18:27:02.336 INFO:tasks.workunit.client.1.smithi133.stdout:3/81: rename d0/c1 to d0/c10 0 2024-02-15T18:27:02.336 INFO:tasks.workunit.client.1.smithi133.stdout:4/44: symlink d2/d5/l11 0 2024-02-15T18:27:02.337 INFO:tasks.workunit.client.1.smithi133.stdout:7/38: dwrite f6 [0,4194304] 0 2024-02-15T18:27:02.337 INFO:tasks.workunit.client.1.smithi133.stdout:6/151: creat d0/f32 x:0 0 0 2024-02-15T18:27:02.337 INFO:tasks.workunit.client.1.smithi133.stdout:6/152: write d0/db/d21/f23 [371459,74730] 0 2024-02-15T18:27:02.338 INFO:tasks.workunit.client.1.smithi133.stdout:0/64: dread d9/ff [0,4194304] 0 2024-02-15T18:27:02.338 INFO:tasks.workunit.client.1.smithi133.stdout:5/83: symlink d17/l1a 0 2024-02-15T18:27:02.341 INFO:tasks.workunit.client.0.smithi084.stdout:8/375: sync 2024-02-15T18:27:02.342 INFO:tasks.workunit.client.1.smithi133.stdout:2/117: truncate d7/f15 1202086 0 2024-02-15T18:27:02.344 INFO:tasks.workunit.client.1.smithi133.stdout:3/82: symlink d0/df/l11 0 2024-02-15T18:27:02.344 INFO:tasks.workunit.client.1.smithi133.stdout:3/83: stat d0/f5 0 2024-02-15T18:27:02.346 INFO:tasks.workunit.client.1.smithi133.stdout:7/39: mkdir d9/db/dc 0 2024-02-15T18:27:02.346 INFO:tasks.workunit.client.1.smithi133.stdout:7/40: write f0 [4731300,52853] 0 2024-02-15T18:27:02.346 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:00.684521+0000 mgr.smithi084.hjmnez (mgr.14596) 18 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 379 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 17 MiB/s wr, 89 op/s 2024-02-15T18:27:02.347 INFO:tasks.workunit.client.1.smithi133.stdout:6/153: getdents d0/db/d1c 0 2024-02-15T18:27:02.347 INFO:tasks.workunit.client.1.smithi133.stdout:6/154: fsync d0/f2d 0 2024-02-15T18:27:02.348 INFO:tasks.workunit.client.1.smithi133.stdout:5/84: mknod d17/c1b 0 2024-02-15T18:27:02.348 INFO:tasks.workunit.client.1.smithi133.stdout:5/85: chown c7 5124 1 2024-02-15T18:27:02.350 INFO:tasks.workunit.client.0.smithi084.stdout:2/353: unlink d3/c12 0 2024-02-15T18:27:02.351 INFO:tasks.workunit.client.1.smithi133.stdout:7/41: chown l4 71107 1 2024-02-15T18:27:02.352 INFO:tasks.workunit.client.1.smithi133.stdout:6/155: creat d0/db/f33 x:0 0 0 2024-02-15T18:27:02.353 INFO:tasks.workunit.client.1.smithi133.stdout:5/86: creat d17/f1c x:0 0 0 2024-02-15T18:27:02.353 INFO:tasks.workunit.client.1.smithi133.stdout:0/65: dread f7 [0,4194304] 0 2024-02-15T18:27:02.353 INFO:tasks.workunit.client.1.smithi133.stdout:0/66: write d9/ff [1338183,77361] 0 2024-02-15T18:27:02.353 INFO:tasks.workunit.client.0.smithi084.stdout:9/350: mkdir d4/d36/d6f 0 2024-02-15T18:27:02.354 INFO:tasks.workunit.client.0.smithi084.stdout:8/376: creat db/dd/d1f/d66/f7f x:0 0 0 2024-02-15T18:27:02.354 INFO:tasks.workunit.client.1.smithi133.stdout:7/42: mknod d9/db/dc/cd 0 2024-02-15T18:27:02.354 INFO:tasks.workunit.client.0.smithi084.stdout:3/355: dwrite d8/d40/f67 [0,4194304] 0 2024-02-15T18:27:02.355 INFO:tasks.workunit.client.0.smithi084.stdout:9/351: symlink d4/d2b/d3c/d20/d43/l70 0 2024-02-15T18:27:02.355 INFO:tasks.workunit.client.1.smithi133.stdout:0/67: mkdir d9/d10/d19 0 2024-02-15T18:27:02.356 INFO:tasks.workunit.client.1.smithi133.stdout:0/68: fdatasync f7 0 2024-02-15T18:27:02.356 INFO:tasks.workunit.client.1.smithi133.stdout:7/43: rmdir d9/db 39 2024-02-15T18:27:02.357 INFO:tasks.workunit.client.0.smithi084.stdout:3/356: mknod d8/d40/c7d 0 2024-02-15T18:27:02.357 INFO:tasks.workunit.client.0.smithi084.stdout:3/357: write d8/d40/f70 [698135,60335] 0 2024-02-15T18:27:02.357 INFO:tasks.workunit.client.0.smithi084.stdout:3/358: readlink d8/d40/l57 0 2024-02-15T18:27:02.357 INFO:tasks.workunit.client.1.smithi133.stdout:7/44: mknod d9/db/ce 0 2024-02-15T18:27:02.358 INFO:tasks.workunit.client.0.smithi084.stdout:9/352: creat d4/d2b/d3c/d24/f71 x:0 0 0 2024-02-15T18:27:02.358 INFO:tasks.workunit.client.0.smithi084.stdout:9/353: getdents d4/d6b 0 2024-02-15T18:27:02.359 INFO:tasks.workunit.client.0.smithi084.stdout:9/354: read - d4/d2b/d3c/f49 zero size 2024-02-15T18:27:02.359 INFO:tasks.workunit.client.0.smithi084.stdout:9/355: chown d4/d2b/d3c/d20/d43/d15/f17 54842435 1 2024-02-15T18:27:02.359 INFO:tasks.workunit.client.0.smithi084.stdout:9/356: dread - d4/d2b/d3c/d24/f2a zero size 2024-02-15T18:27:02.359 INFO:tasks.workunit.client.0.smithi084.stdout:9/357: write d4/f41 [21875,5645] 0 2024-02-15T18:27:02.359 INFO:tasks.workunit.client.0.smithi084.stdout:8/377: write db/dd/d1f/d3e/f43 [3248057,25208] 0 2024-02-15T18:27:02.359 INFO:tasks.workunit.client.1.smithi133.stdout:6/156: write d0/f10 [492031,13255] 0 2024-02-15T18:27:02.359 INFO:tasks.workunit.client.1.smithi133.stdout:6/157: mkdir d0/db/d29/d34 0 2024-02-15T18:27:02.360 INFO:tasks.workunit.client.0.smithi084.stdout:9/358: symlink d4/d2b/d3c/d20/d43/d15/d5d/l72 0 2024-02-15T18:27:02.362 INFO:tasks.workunit.client.1.smithi133.stdout:6/158: rename d0/db/d1c/c2b to d0/db/c35 0 2024-02-15T18:27:02.362 INFO:tasks.workunit.client.0.smithi084.stdout:9/359: mknod d4/d2b/d3c/d20/d43/c73 0 2024-02-15T18:27:02.363 INFO:tasks.workunit.client.0.smithi084.stdout:9/360: mknod d4/c74 0 2024-02-15T18:27:02.364 INFO:tasks.workunit.client.0.smithi084.stdout:2/354: write d3/f14 [956674,122533] 0 2024-02-15T18:27:02.369 INFO:tasks.workunit.client.0.smithi084.stdout:2/355: mkdir d3/d5/d1a/d74 0 2024-02-15T18:27:02.369 INFO:tasks.workunit.client.0.smithi084.stdout:9/361: write d4/f6c [1428176,13060] 0 2024-02-15T18:27:02.370 INFO:tasks.workunit.client.0.smithi084.stdout:9/362: mkdir d4/d2b/d3c/d20/d75 0 2024-02-15T18:27:02.374 INFO:tasks.workunit.client.0.smithi084.stdout:9/363: truncate d4/f4d 1611861 0 2024-02-15T18:27:02.374 INFO:tasks.workunit.client.0.smithi084.stdout:9/364: chown d4/d2b/d3c/d20/d43/d15/d5d/l72 88 1 2024-02-15T18:27:02.374 INFO:tasks.workunit.client.0.smithi084.stdout:9/365: dread - d4/d2b/d3c/d24/f71 zero size 2024-02-15T18:27:02.374 INFO:tasks.workunit.client.0.smithi084.stdout:3/359: dread d8/d22/f24 [0,4194304] 0 2024-02-15T18:27:02.375 INFO:tasks.workunit.client.1.smithi133.stdout:6/159: dread d0/f14 [0,4194304] 0 2024-02-15T18:27:02.376 INFO:tasks.workunit.client.0.smithi084.stdout:4/369: dwrite d2/d4/fd [0,4194304] 0 2024-02-15T18:27:02.376 INFO:tasks.workunit.client.0.smithi084.stdout:4/370: write d2/f5e [1314967,41430] 0 2024-02-15T18:27:02.378 INFO:tasks.workunit.client.1.smithi133.stdout:9/85: dwrite d0/d8/d10/f15 [0,4194304] 0 2024-02-15T18:27:02.378 INFO:tasks.workunit.client.1.smithi133.stdout:6/160: write d0/db/f17 [887982,376] 0 2024-02-15T18:27:02.379 INFO:tasks.workunit.client.0.smithi084.stdout:5/436: dwrite d9/d35/d65/f69 [0,4194304] 0 2024-02-15T18:27:02.379 INFO:tasks.workunit.client.0.smithi084.stdout:5/437: chown d9/d35/d65/f56 0 1 2024-02-15T18:27:02.380 INFO:tasks.workunit.client.0.smithi084.stdout:1/340: dwrite d9/d54/d1b/d2c/d35/f73 [0,4194304] 0 2024-02-15T18:27:02.380 INFO:tasks.workunit.client.0.smithi084.stdout:9/366: getdents d4/d2b/d3c/d20/d43/d15/d4b 0 2024-02-15T18:27:02.383 INFO:tasks.workunit.client.0.smithi084.stdout:3/360: link d8/d1f/d28/c77 d8/d40/d43/d71/c7e 0 2024-02-15T18:27:02.383 INFO:tasks.workunit.client.0.smithi084.stdout:3/361: fdatasync d8/d22/f34 0 2024-02-15T18:27:02.384 INFO:tasks.workunit.client.0.smithi084.stdout:0/356: dwrite d0/d4/d1b/d26/f2d [0,4194304] 0 2024-02-15T18:27:02.384 INFO:tasks.workunit.client.0.smithi084.stdout:0/357: readlink d0/d25/l31 0 2024-02-15T18:27:02.384 INFO:tasks.workunit.client.0.smithi084.stdout:0/358: chown d0/d4 7169 1 2024-02-15T18:27:02.384 INFO:tasks.workunit.client.0.smithi084.stdout:0/359: write d0/d4/d1b/f3e [574226,115929] 0 2024-02-15T18:27:02.384 INFO:tasks.workunit.client.0.smithi084.stdout:4/371: mknod d2/d2b/d47/c6d 0 2024-02-15T18:27:02.385 INFO:tasks.workunit.client.1.smithi133.stdout:4/45: getdents d2/d5 0 2024-02-15T18:27:02.387 INFO:tasks.workunit.client.0.smithi084.stdout:1/341: link d9/d54/d32/d5b/f75 d9/d54/d1b/d2c/d4b/d7a/f7b 0 2024-02-15T18:27:02.389 INFO:tasks.workunit.client.1.smithi133.stdout:7/45: write f6 [5008959,13705] 0 2024-02-15T18:27:02.389 INFO:tasks.workunit.client.0.smithi084.stdout:9/367: dread d4/d2b/d67/f6d [0,4194304] 0 2024-02-15T18:27:02.394 INFO:tasks.workunit.client.0.smithi084.stdout:0/360: creat d0/d4/d1b/f6f x:0 0 0 2024-02-15T18:27:02.395 INFO:tasks.workunit.client.1.smithi133.stdout:9/86: rename d0/d8/d9/d12/c13 to d0/c19 0 2024-02-15T18:27:02.395 INFO:tasks.workunit.client.1.smithi133.stdout:7/46: rename d9/da to d9/da/df 22 2024-02-15T18:27:02.395 INFO:tasks.workunit.client.1.smithi133.stdout:7/47: chown f6 5688743 1 2024-02-15T18:27:02.395 INFO:tasks.workunit.client.0.smithi084.stdout:9/368: write d4/f6 [431949,42319] 0 2024-02-15T18:27:02.396 INFO:tasks.workunit.client.0.smithi084.stdout:9/369: stat d4/d2b/d3c/d20/d43 0 2024-02-15T18:27:02.396 INFO:tasks.workunit.client.0.smithi084.stdout:9/370: chown d4/d2b/d3c/f22 5 1 2024-02-15T18:27:02.396 INFO:tasks.workunit.client.1.smithi133.stdout:4/46: creat d2/f12 x:0 0 0 2024-02-15T18:27:02.397 INFO:tasks.workunit.client.0.smithi084.stdout:4/372: link d2/d4/d28/d2e/f49 d2/d64/f6e 0 2024-02-15T18:27:02.397 INFO:tasks.workunit.client.0.smithi084.stdout:1/342: stat d9/d54/d1b/d2c/d4b/d63/l64 0 2024-02-15T18:27:02.398 INFO:tasks.workunit.client.0.smithi084.stdout:4/373: read - d2/d2b/f3e zero size 2024-02-15T18:27:02.398 INFO:tasks.workunit.client.0.smithi084.stdout:1/343: fsync d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 0 2024-02-15T18:27:02.398 INFO:tasks.workunit.client.0.smithi084.stdout:0/361: rmdir d0/d4 39 2024-02-15T18:27:02.398 INFO:tasks.workunit.client.0.smithi084.stdout:1/344: chown d9/le 3 1 2024-02-15T18:27:02.398 INFO:tasks.workunit.client.1.smithi133.stdout:9/87: link d0/f7 d0/d8/d9/d12/f1a 0 2024-02-15T18:27:02.399 INFO:tasks.workunit.client.1.smithi133.stdout:7/48: symlink d9/db/l10 0 2024-02-15T18:27:02.400 INFO:tasks.workunit.client.0.smithi084.stdout:4/374: unlink d2/c16 0 2024-02-15T18:27:02.400 INFO:tasks.workunit.client.1.smithi133.stdout:4/47: symlink d2/d5/l13 0 2024-02-15T18:27:02.401 INFO:tasks.workunit.client.0.smithi084.stdout:1/345: rename d9/d54/c18 to d9/d54/d32/c7c 0 2024-02-15T18:27:02.402 INFO:tasks.workunit.client.1.smithi133.stdout:4/48: unlink d2/lf 0 2024-02-15T18:27:02.403 INFO:tasks.workunit.client.0.smithi084.stdout:0/362: creat d0/d2f/d3f/d4f/d61/f70 x:0 0 0 2024-02-15T18:27:02.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/375: getdents d2/d4/d28/d3d/d5c/d5d 0 2024-02-15T18:27:02.403 INFO:tasks.workunit.client.0.smithi084.stdout:0/363: readlink d0/d1e/l48 0 2024-02-15T18:27:02.405 INFO:tasks.workunit.client.0.smithi084.stdout:4/376: rename d2/d4/f52 to d2/d2b/f6f 0 2024-02-15T18:27:02.410 INFO:tasks.workunit.client.1.smithi133.stdout:3/84: dwrite d0/fc [0,4194304] 0 2024-02-15T18:27:02.411 INFO:tasks.workunit.client.0.smithi084.stdout:7/336: sync 2024-02-15T18:27:02.411 INFO:tasks.workunit.client.0.smithi084.stdout:7/337: stat df/c3c 0 2024-02-15T18:27:02.416 INFO:tasks.workunit.client.0.smithi084.stdout:2/356: truncate d3/d19/f33 2658263 0 2024-02-15T18:27:02.416 INFO:tasks.workunit.client.0.smithi084.stdout:7/338: write f5 [1911129,39897] 0 2024-02-15T18:27:02.416 INFO:tasks.workunit.client.1.smithi133.stdout:3/85: dread d0/f5 [0,4194304] 0 2024-02-15T18:27:02.416 INFO:tasks.workunit.client.1.smithi133.stdout:3/86: truncate d0/f5 8711333 0 2024-02-15T18:27:02.418 INFO:tasks.workunit.client.0.smithi084.stdout:7/339: symlink df/d1d/d44/l5f 0 2024-02-15T18:27:02.419 INFO:tasks.workunit.client.0.smithi084.stdout:7/340: truncate df/f35 2359811 0 2024-02-15T18:27:02.421 INFO:tasks.workunit.client.0.smithi084.stdout:7/341: creat df/d1d/d1a/f60 x:0 0 0 2024-02-15T18:27:02.422 INFO:tasks.workunit.client.1.smithi133.stdout:2/118: dwrite d7/db/f1d [4194304,4194304] 0 2024-02-15T18:27:02.422 INFO:tasks.workunit.client.1.smithi133.stdout:2/119: fsync d7/db/f1d 0 2024-02-15T18:27:02.422 INFO:tasks.workunit.client.1.smithi133.stdout:2/120: chown d7/l25 696 1 2024-02-15T18:27:02.422 INFO:tasks.workunit.client.1.smithi133.stdout:2/121: chown d7/f15 5016594 1 2024-02-15T18:27:02.422 INFO:tasks.workunit.client.1.smithi133.stdout:6/161: dwrite d0/f27 [0,4194304] 0 2024-02-15T18:27:02.423 INFO:tasks.workunit.client.0.smithi084.stdout:8/378: dwrite db/d3f/d59/f28 [0,4194304] 0 2024-02-15T18:27:02.423 INFO:tasks.workunit.client.0.smithi084.stdout:5/438: dwrite d9/da/d3d/d44/f86 [0,4194304] 0 2024-02-15T18:27:02.423 INFO:tasks.workunit.client.0.smithi084.stdout:5/439: chown d9/d5b/l8b 2 1 2024-02-15T18:27:02.423 INFO:tasks.workunit.client.0.smithi084.stdout:5/440: truncate d9/f15 1079545 0 2024-02-15T18:27:02.423 INFO:tasks.workunit.client.1.smithi133.stdout:2/122: read f1 [2604123,22426] 0 2024-02-15T18:27:02.423 INFO:tasks.workunit.client.1.smithi133.stdout:2/123: truncate d7/f20 2012666 0 2024-02-15T18:27:02.425 INFO:tasks.workunit.client.1.smithi133.stdout:9/88: fsync d0/d8/fd 0 2024-02-15T18:27:02.425 INFO:tasks.workunit.client.1.smithi133.stdout:9/89: read d0/d8/d10/f14 [490913,125158] 0 2024-02-15T18:27:02.427 INFO:tasks.workunit.client.1.smithi133.stdout:6/162: write d0/f24 [531911,48456] 0 2024-02-15T18:27:02.427 INFO:tasks.workunit.client.1.smithi133.stdout:2/124: rename d7/ld to d7/db/l2b 0 2024-02-15T18:27:02.428 INFO:tasks.workunit.client.1.smithi133.stdout:0/69: dwrite d9/d10/f17 [0,4194304] 0 2024-02-15T18:27:02.428 INFO:tasks.workunit.client.1.smithi133.stdout:0/70: fsync f6 0 2024-02-15T18:27:02.431 INFO:tasks.workunit.client.0.smithi084.stdout:7/342: write df/d1d/f18 [2871725,19409] 0 2024-02-15T18:27:02.438 INFO:tasks.workunit.client.0.smithi084.stdout:0/364: dwrite d0/d4/d1b/f42 [0,4194304] 0 2024-02-15T18:27:02.438 INFO:tasks.workunit.client.0.smithi084.stdout:8/379: creat db/dd/d13/d42/f80 x:0 0 0 2024-02-15T18:27:02.441 INFO:tasks.workunit.client.1.smithi133.stdout:3/87: truncate d0/f5 96421 0 2024-02-15T18:27:02.441 INFO:tasks.workunit.client.1.smithi133.stdout:3/88: write d0/f7 [4367857,49613] 0 2024-02-15T18:27:02.443 INFO:tasks.workunit.client.0.smithi084.stdout:4/377: dwrite d2/d4/d28/d3d/f53 [0,4194304] 0 2024-02-15T18:27:02.443 INFO:tasks.workunit.client.0.smithi084.stdout:7/343: mknod df/d1d/d1a/d4d/c61 0 2024-02-15T18:27:02.443 INFO:tasks.workunit.client.0.smithi084.stdout:7/344: chown df/d1d/d1a/d4d/l52 119429130 1 2024-02-15T18:27:02.444 INFO:tasks.workunit.client.1.smithi133.stdout:3/89: write d0/fa [3418345,42385] 0 2024-02-15T18:27:02.444 INFO:tasks.workunit.client.0.smithi084.stdout:9/371: dread d4/d2b/d3c/d20/f5a [0,4194304] 0 2024-02-15T18:27:02.445 INFO:tasks.workunit.client.1.smithi133.stdout:9/90: rmdir d0 39 2024-02-15T18:27:02.446 INFO:tasks.workunit.client.0.smithi084.stdout:0/365: mkdir d0/d4/d1b/d26/d43/d6d/d71 0 2024-02-15T18:27:02.448 INFO:tasks.workunit.client.0.smithi084.stdout:9/372: getdents d4/d2b/d3c/d20/d43/d15 0 2024-02-15T18:27:02.448 INFO:tasks.workunit.client.0.smithi084.stdout:9/373: write d4/d2b/d3c/d24/f71 [161828,127786] 0 2024-02-15T18:27:02.449 INFO:tasks.workunit.client.1.smithi133.stdout:2/125: mkdir d7/d2c 0 2024-02-15T18:27:02.449 INFO:tasks.workunit.client.1.smithi133.stdout:2/126: readlink d7/le 0 2024-02-15T18:27:02.450 INFO:tasks.workunit.client.0.smithi084.stdout:0/366: rmdir d0/d25/d6a 0 2024-02-15T18:27:02.450 INFO:tasks.workunit.client.1.smithi133.stdout:0/71: mkdir d9/d10/d19/d1a 0 2024-02-15T18:27:02.451 INFO:tasks.workunit.client.1.smithi133.stdout:0/72: chown f5 10709000 1 2024-02-15T18:27:02.451 INFO:tasks.workunit.client.1.smithi133.stdout:0/73: chown f6 302302784 1 2024-02-15T18:27:02.451 INFO:tasks.workunit.client.1.smithi133.stdout:0/74: read f0 [633542,80894] 0 2024-02-15T18:27:02.452 INFO:tasks.workunit.client.0.smithi084.stdout:0/367: dread d0/d39/d45/f5e [0,4194304] 0 2024-02-15T18:27:02.452 INFO:tasks.workunit.client.0.smithi084.stdout:8/380: dread db/dd/d1f/f23 [0,4194304] 0 2024-02-15T18:27:02.453 INFO:tasks.workunit.client.1.smithi133.stdout:2/127: link f1 d7/db/f2d 0 2024-02-15T18:27:02.454 INFO:tasks.workunit.client.1.smithi133.stdout:0/75: mknod d9/d10/d19/d1a/c1b 0 2024-02-15T18:27:02.454 INFO:tasks.workunit.client.0.smithi084.stdout:6/373: sync 2024-02-15T18:27:02.454 INFO:tasks.workunit.client.0.smithi084.stdout:6/374: stat d14/d22/d25/d2f/d31/d30/d4f/f61 0 2024-02-15T18:27:02.455 INFO:tasks.workunit.client.0.smithi084.stdout:2/357: dwrite d3/d19/d24/f44 [0,4194304] 0 2024-02-15T18:27:02.455 INFO:tasks.workunit.client.0.smithi084.stdout:2/358: fsync d3/d5/d1a/d1e/f58 0 2024-02-15T18:27:02.455 INFO:tasks.workunit.client.0.smithi084.stdout:9/374: getdents d4/d2b/d67 0 2024-02-15T18:27:02.455 INFO:tasks.workunit.client.0.smithi084.stdout:8/381: creat db/dd/d1f/d7a/f81 x:0 0 0 2024-02-15T18:27:02.456 INFO:tasks.workunit.client.0.smithi084.stdout:8/382: chown c6 7175217 1 2024-02-15T18:27:02.456 INFO:tasks.workunit.client.0.smithi084.stdout:4/378: dread d2/f34 [0,4194304] 0 2024-02-15T18:27:02.456 INFO:tasks.workunit.client.1.smithi133.stdout:2/128: rename c3 to d7/c2e 0 2024-02-15T18:27:02.457 INFO:tasks.workunit.client.1.smithi133.stdout:7/49: dwrite f6 [0,4194304] 0 2024-02-15T18:27:02.457 INFO:tasks.workunit.client.1.smithi133.stdout:0/76: mkdir d9/d1c 0 2024-02-15T18:27:02.457 INFO:tasks.workunit.client.1.smithi133.stdout:0/77: chown d9/d10/d19/d1a 24250979 1 2024-02-15T18:27:02.458 INFO:tasks.workunit.client.0.smithi084.stdout:5/441: dwrite d9/d5f/d68/f83 [0,4194304] 0 2024-02-15T18:27:02.458 INFO:tasks.workunit.client.0.smithi084.stdout:0/368: dread d0/d2f/f56 [0,4194304] 0 2024-02-15T18:27:02.459 INFO:tasks.workunit.client.1.smithi133.stdout:9/91: dread d0/d8/d9/d12/f1a [0,4194304] 0 2024-02-15T18:27:02.459 INFO:tasks.workunit.client.0.smithi084.stdout:8/383: link db/d3f/d59/l46 db/dd/d1f/l82 0 2024-02-15T18:27:02.460 INFO:tasks.workunit.client.0.smithi084.stdout:8/384: truncate db/d1a/d2b/f31 4984055 0 2024-02-15T18:27:02.460 INFO:tasks.workunit.client.0.smithi084.stdout:8/385: stat db/d1a/d5e 0 2024-02-15T18:27:02.460 INFO:tasks.workunit.client.0.smithi084.stdout:4/379: symlink d2/d2b/d47/d31/d62/l70 0 2024-02-15T18:27:02.461 INFO:tasks.workunit.client.1.smithi133.stdout:3/90: write d0/f8 [853572,19167] 0 2024-02-15T18:27:02.461 INFO:tasks.workunit.client.1.smithi133.stdout:3/91: readlink d0/l9 0 2024-02-15T18:27:02.465 INFO:tasks.workunit.client.0.smithi084.stdout:6/375: dread d14/d22/d25/d2f/d31/d30/f6b [0,4194304] 0 2024-02-15T18:27:02.467 INFO:tasks.workunit.client.0.smithi084.stdout:7/345: rmdir df/d1d/d1a/d4d 39 2024-02-15T18:27:02.467 INFO:tasks.workunit.client.1.smithi133.stdout:9/92: dread d0/f7 [0,4194304] 0 2024-02-15T18:27:02.467 INFO:tasks.workunit.client.1.smithi133.stdout:0/78: rmdir d9/d10/d19/d1a 39 2024-02-15T18:27:02.469 INFO:tasks.workunit.client.1.smithi133.stdout:7/50: creat d9/db/f11 x:0 0 0 2024-02-15T18:27:02.469 INFO:tasks.workunit.client.1.smithi133.stdout:7/51: chown d9/db/dc/cd 499 1 2024-02-15T18:27:02.469 INFO:tasks.workunit.client.1.smithi133.stdout:6/163: write d0/f9 [815232,13697] 0 2024-02-15T18:27:02.469 INFO:tasks.workunit.client.1.smithi133.stdout:3/92: rename d0/c6 to d0/df/c12 0 2024-02-15T18:27:02.469 INFO:tasks.workunit.client.1.smithi133.stdout:0/79: creat d9/d1c/f1d x:0 0 0 2024-02-15T18:27:02.470 INFO:tasks.workunit.client.1.smithi133.stdout:7/52: symlink d9/da/l12 0 2024-02-15T18:27:02.470 INFO:tasks.workunit.client.0.smithi084.stdout:7/346: write f0 [850540,44758] 0 2024-02-15T18:27:02.471 INFO:tasks.workunit.client.0.smithi084.stdout:6/376: write fc [8360603,6800] 0 2024-02-15T18:27:02.471 INFO:tasks.workunit.client.1.smithi133.stdout:6/164: dread d0/db/d29/f2f [0,4194304] 0 2024-02-15T18:27:02.472 INFO:tasks.workunit.client.0.smithi084.stdout:5/442: symlink d9/d35/d65/d7f/l90 0 2024-02-15T18:27:02.473 INFO:tasks.workunit.client.1.smithi133.stdout:6/165: rmdir d0/d5 39 2024-02-15T18:27:02.474 INFO:tasks.workunit.client.0.smithi084.stdout:0/369: creat d0/d4/d66/f72 x:0 0 0 2024-02-15T18:27:02.474 INFO:tasks.workunit.client.0.smithi084.stdout:0/370: write d0/d4/d66/f72 [671731,11979] 0 2024-02-15T18:27:02.474 INFO:tasks.workunit.client.0.smithi084.stdout:8/386: stat db/dd/d13/l30 0 2024-02-15T18:27:02.474 INFO:tasks.workunit.client.1.smithi133.stdout:0/80: dread d9/ff [0,4194304] 0 2024-02-15T18:27:02.475 INFO:tasks.workunit.client.1.smithi133.stdout:3/93: write d0/f7 [3371737,60793] 0 2024-02-15T18:27:02.475 INFO:tasks.workunit.client.1.smithi133.stdout:6/166: link d0/c15 d0/c36 0 2024-02-15T18:27:02.476 INFO:tasks.workunit.client.1.smithi133.stdout:6/167: dread d0/f12 [0,4194304] 0 2024-02-15T18:27:02.476 INFO:tasks.workunit.client.1.smithi133.stdout:3/94: mknod d0/c13 0 2024-02-15T18:27:02.478 INFO:tasks.workunit.client.0.smithi084.stdout:4/380: getdents d2/d4/d28/d3d 0 2024-02-15T18:27:02.478 INFO:tasks.workunit.client.0.smithi084.stdout:4/381: fsync d2/d4/d28/d3d/f53 0 2024-02-15T18:27:02.479 INFO:tasks.workunit.client.1.smithi133.stdout:6/168: read d0/f27 [2184829,29746] 0 2024-02-15T18:27:02.481 INFO:tasks.workunit.client.0.smithi084.stdout:6/377: truncate d14/d22/d25/f35 1153071 0 2024-02-15T18:27:02.482 INFO:tasks.workunit.client.1.smithi133.stdout:6/169: mkdir d0/d5/d37 0 2024-02-15T18:27:02.482 INFO:tasks.workunit.client.1.smithi133.stdout:6/170: truncate d0/f2d 62574 0 2024-02-15T18:27:02.483 INFO:tasks.workunit.client.0.smithi084.stdout:4/382: write d2/d2b/d47/f3c [3529002,127581] 0 2024-02-15T18:27:02.483 INFO:tasks.workunit.client.0.smithi084.stdout:7/347: dread df/f35 [0,4194304] 0 2024-02-15T18:27:02.483 INFO:tasks.workunit.client.0.smithi084.stdout:9/375: dwrite d4/d2b/d3c/d20/f52 [0,4194304] 0 2024-02-15T18:27:02.483 INFO:tasks.workunit.client.0.smithi084.stdout:9/376: chown d4/d3d 24 1 2024-02-15T18:27:02.483 INFO:tasks.workunit.client.0.smithi084.stdout:9/377: read d4/d2b/d3c/d20/d43/d15/d4b/f51 [311587,52347] 0 2024-02-15T18:27:02.484 INFO:tasks.workunit.client.0.smithi084.stdout:5/443: creat d9/da/d3d/f91 x:0 0 0 2024-02-15T18:27:02.484 INFO:tasks.workunit.client.0.smithi084.stdout:0/371: mkdir d0/d4/d1b/d26/d43/d6d/d71/d73 0 2024-02-15T18:27:02.484 INFO:tasks.workunit.client.1.smithi133.stdout:0/81: dread f0 [0,4194304] 0 2024-02-15T18:27:02.484 INFO:tasks.workunit.client.1.smithi133.stdout:0/82: chown l3 1737 1 2024-02-15T18:27:02.485 INFO:tasks.workunit.client.0.smithi084.stdout:8/387: getdents db/d6a 0 2024-02-15T18:27:02.485 INFO:tasks.workunit.client.0.smithi084.stdout:8/388: write db/dd/d4d/f5b [692690,109753] 0 2024-02-15T18:27:02.486 INFO:tasks.workunit.client.0.smithi084.stdout:6/378: creat d14/f78 x:0 0 0 2024-02-15T18:27:02.486 INFO:tasks.workunit.client.1.smithi133.stdout:6/171: rename d0/db/d29/f2f to d0/db/d21/f38 0 2024-02-15T18:27:02.486 INFO:tasks.workunit.client.1.smithi133.stdout:6/172: readlink d0/l1 0 2024-02-15T18:27:02.486 INFO:tasks.workunit.client.1.smithi133.stdout:6/173: fsync d0/f14 0 2024-02-15T18:27:02.487 INFO:tasks.workunit.client.0.smithi084.stdout:7/348: mkdir df/d1d/d1a/d4d/d59/d62 0 2024-02-15T18:27:02.487 INFO:tasks.workunit.client.1.smithi133.stdout:0/83: creat d9/f1e x:0 0 0 2024-02-15T18:27:02.488 INFO:tasks.workunit.client.0.smithi084.stdout:9/378: symlink d4/d36/l76 0 2024-02-15T18:27:02.490 INFO:tasks.workunit.client.1.smithi133.stdout:0/84: symlink d9/l1f 0 2024-02-15T18:27:02.490 INFO:tasks.workunit.client.1.smithi133.stdout:0/85: chown d9/d10/d19 2699 1 2024-02-15T18:27:02.490 INFO:tasks.workunit.client.1.smithi133.stdout:3/95: fdatasync d0/f7 0 2024-02-15T18:27:02.491 INFO:tasks.workunit.client.1.smithi133.stdout:6/174: dread d0/f14 [0,4194304] 0 2024-02-15T18:27:02.491 INFO:tasks.workunit.client.1.smithi133.stdout:6/175: stat d0/db/d29 0 2024-02-15T18:27:02.492 INFO:tasks.workunit.client.0.smithi084.stdout:2/359: dwrite d3/d19/d24/d3e/d5c/f68 [0,4194304] 0 2024-02-15T18:27:02.492 INFO:tasks.workunit.client.0.smithi084.stdout:2/360: readlink d3/d5/d1a/d1e/l37 0 2024-02-15T18:27:02.492 INFO:tasks.workunit.client.0.smithi084.stdout:8/389: read db/dd/d1f/d3e/f43 [2705659,7588] 0 2024-02-15T18:27:02.492 INFO:tasks.workunit.client.0.smithi084.stdout:5/444: mkdir d9/d5b/d7e/d92 0 2024-02-15T18:27:02.492 INFO:tasks.workunit.client.0.smithi084.stdout:0/372: unlink d0/d39/d45/f5f 0 2024-02-15T18:27:02.492 INFO:tasks.workunit.client.0.smithi084.stdout:0/373: dread - d0/d4/d1b/f55 zero size 2024-02-15T18:27:02.492 INFO:tasks.workunit.client.0.smithi084.stdout:0/374: chown d0/d4/f4e 0 1 2024-02-15T18:27:02.492 INFO:tasks.workunit.client.0.smithi084.stdout:0/375: chown d0/d39/l5b 393 1 2024-02-15T18:27:02.492 INFO:tasks.workunit.client.0.smithi084.stdout:9/379: write d4/d36/f45 [8416,56159] 0 2024-02-15T18:27:02.493 INFO:tasks.workunit.client.1.smithi133.stdout:2/129: dwrite d7/f15 [0,4194304] 0 2024-02-15T18:27:02.496 INFO:tasks.workunit.client.1.smithi133.stdout:2/130: write d7/f13 [1049914,34683] 0 2024-02-15T18:27:02.498 INFO:tasks.workunit.client.0.smithi084.stdout:6/379: rename f13 to d14/d22/d25/d2f/d31/f79 0 2024-02-15T18:27:02.498 INFO:tasks.workunit.client.0.smithi084.stdout:2/361: mkdir d3/d19/d75 0 2024-02-15T18:27:02.499 INFO:tasks.workunit.client.1.smithi133.stdout:3/96: creat d0/f14 x:0 0 0 2024-02-15T18:27:02.499 INFO:tasks.workunit.client.1.smithi133.stdout:6/176: mknod d0/d5/d37/c39 0 2024-02-15T18:27:02.499 INFO:tasks.workunit.client.0.smithi084.stdout:0/376: write d0/d25/f34 [1963469,66571] 0 2024-02-15T18:27:02.500 INFO:tasks.workunit.client.0.smithi084.stdout:8/390: mknod db/dd/d1f/c83 0 2024-02-15T18:27:02.500 INFO:tasks.workunit.client.0.smithi084.stdout:5/445: write d9/f1e [7393556,50316] 0 2024-02-15T18:27:02.501 INFO:tasks.workunit.client.1.smithi133.stdout:2/131: rename d7/c9 to d7/db/c2f 0 2024-02-15T18:27:02.501 INFO:tasks.workunit.client.0.smithi084.stdout:8/391: dread db/f3a [0,4194304] 0 2024-02-15T18:27:02.501 INFO:tasks.workunit.client.0.smithi084.stdout:8/392: stat db/dd/d4d/f55 0 2024-02-15T18:27:02.502 INFO:tasks.workunit.client.0.smithi084.stdout:8/393: readlink db/dd/d1f/l29 0 2024-02-15T18:27:02.502 INFO:tasks.workunit.client.0.smithi084.stdout:8/394: write db/d3f/d59/d69/f6b [1023962,81707] 0 2024-02-15T18:27:02.502 INFO:tasks.workunit.client.0.smithi084.stdout:8/395: chown db/d6a/d7d 21 1 2024-02-15T18:27:02.503 INFO:tasks.workunit.client.1.smithi133.stdout:3/97: mkdir d0/d15 0 2024-02-15T18:27:02.503 INFO:tasks.workunit.client.1.smithi133.stdout:6/177: creat d0/d5/f3a x:0 0 0 2024-02-15T18:27:02.504 INFO:tasks.workunit.client.1.smithi133.stdout:2/132: creat d7/f30 x:0 0 0 2024-02-15T18:27:02.506 INFO:tasks.workunit.client.1.smithi133.stdout:3/98: creat d0/d15/f16 x:0 0 0 2024-02-15T18:27:02.506 INFO:tasks.workunit.client.1.smithi133.stdout:3/99: truncate d0/f8 1746617 0 2024-02-15T18:27:02.506 INFO:tasks.workunit.client.1.smithi133.stdout:3/100: truncate d0/f7 4842697 0 2024-02-15T18:27:02.506 INFO:tasks.workunit.client.1.smithi133.stdout:6/178: mkdir d0/d3b 0 2024-02-15T18:27:02.507 INFO:tasks.workunit.client.1.smithi133.stdout:2/133: getdents d7/d18 0 2024-02-15T18:27:02.514 INFO:tasks.workunit.client.0.smithi084.stdout:7/349: dread df/d1d/d44/f54 [0,4194304] 0 2024-02-15T18:27:02.516 INFO:tasks.workunit.client.1.smithi133.stdout:6/179: rename d0/f1a to d0/db/d21/f3c 0 2024-02-15T18:27:02.516 INFO:tasks.workunit.client.0.smithi084.stdout:7/350: read df/d1d/d1a/f28 [641861,104370] 0 2024-02-15T18:27:02.532 INFO:tasks.workunit.client.0.smithi084.stdout:6/380: rename d14/d22/d25/d28/l55 to d14/d22/d25/l7a 0 2024-02-15T18:27:02.536 INFO:tasks.workunit.client.0.smithi084.stdout:2/362: mkdir d3/d5/d1a/d1e/d47/d76 0 2024-02-15T18:27:02.536 INFO:tasks.workunit.client.0.smithi084.stdout:2/363: chown d3/d19/d24/d3e/d5c/f68 17970 1 2024-02-15T18:27:02.538 INFO:tasks.workunit.client.0.smithi084.stdout:0/377: creat d0/d4/d3a/f74 x:0 0 0 2024-02-15T18:27:02.539 INFO:tasks.workunit.client.0.smithi084.stdout:5/446: mknod d9/d35/d65/d7f/c93 0 2024-02-15T18:27:02.542 INFO:tasks.workunit.client.0.smithi084.stdout:6/381: symlink d14/d22/d25/d2f/d31/d3f/d4a/l7b 0 2024-02-15T18:27:02.542 INFO:tasks.workunit.client.0.smithi084.stdout:6/382: truncate d14/d22/d25/d2f/d31/d30/d4f/f61 368949 0 2024-02-15T18:27:02.542 INFO:tasks.workunit.client.0.smithi084.stdout:2/364: creat d3/d5/d1a/d74/f77 x:0 0 0 2024-02-15T18:27:02.543 INFO:tasks.workunit.client.0.smithi084.stdout:0/378: write d0/d2f/d3f/f30 [675818,11227] 0 2024-02-15T18:27:02.543 INFO:tasks.workunit.client.0.smithi084.stdout:0/379: readlink d0/d4/d1b/l33 0 2024-02-15T18:27:02.544 INFO:tasks.workunit.client.0.smithi084.stdout:2/365: creat d3/d28/f78 x:0 0 0 2024-02-15T18:27:02.545 INFO:tasks.workunit.client.0.smithi084.stdout:2/366: chown d3/d19/d24/l65 3510 1 2024-02-15T18:27:02.545 INFO:tasks.workunit.client.0.smithi084.stdout:0/380: symlink d0/d1e/l75 0 2024-02-15T18:27:02.546 INFO:tasks.workunit.client.0.smithi084.stdout:2/367: mknod d3/d5/d1a/d1e/d4b/c79 0 2024-02-15T18:27:02.546 INFO:tasks.workunit.client.1.smithi133.stdout:7/53: dwrite d9/db/f11 [0,4194304] 0 2024-02-15T18:27:02.547 INFO:tasks.workunit.client.0.smithi084.stdout:0/381: dread d0/d4/d66/f6c [0,4194304] 0 2024-02-15T18:27:02.547 INFO:tasks.workunit.client.0.smithi084.stdout:2/368: write d3/d19/f6c [1784114,20403] 0 2024-02-15T18:27:02.550 INFO:tasks.workunit.client.1.smithi133.stdout:7/54: symlink d9/db/l13 0 2024-02-15T18:27:02.557 INFO:tasks.workunit.client.0.smithi084.stdout:4/383: dwrite d2/d4/d28/d3d/d5c/d5d/f63 [0,4194304] 0 2024-02-15T18:27:02.558 INFO:tasks.workunit.client.1.smithi133.stdout:2/134: dwrite d7/f14 [0,4194304] 0 2024-02-15T18:27:02.558 INFO:tasks.workunit.client.1.smithi133.stdout:2/135: truncate d7/db/f21 1886298 0 2024-02-15T18:27:02.559 INFO:tasks.workunit.client.1.smithi133.stdout:0/86: dwrite f4 [0,4194304] 0 2024-02-15T18:27:02.559 INFO:tasks.workunit.client.1.smithi133.stdout:0/87: chown d9/c16 7950 1 2024-02-15T18:27:02.559 INFO:tasks.workunit.client.1.smithi133.stdout:0/88: truncate d9/d1c/f1d 289490 0 2024-02-15T18:27:02.559 INFO:tasks.workunit.client.0.smithi084.stdout:8/396: dwrite db/dd/d13/f40 [0,4194304] 0 2024-02-15T18:27:02.560 INFO:tasks.workunit.client.0.smithi084.stdout:7/351: dwrite df/f3b [4194304,4194304] 0 2024-02-15T18:27:02.561 INFO:tasks.workunit.client.1.smithi133.stdout:3/101: truncate d0/fa 147560 0 2024-02-15T18:27:02.562 INFO:tasks.workunit.client.0.smithi084.stdout:8/397: symlink db/dd/d1f/l84 0 2024-02-15T18:27:02.563 INFO:tasks.workunit.client.0.smithi084.stdout:9/380: dwrite d4/d2b/d3c/d20/d43/d15/f37 [0,4194304] 0 2024-02-15T18:27:02.568 INFO:tasks.workunit.client.1.smithi133.stdout:2/136: mkdir d7/d2c/d31 0 2024-02-15T18:27:02.574 INFO:tasks.workunit.client.1.smithi133.stdout:0/89: symlink d9/d10/l20 0 2024-02-15T18:27:02.576 INFO:tasks.workunit.client.1.smithi133.stdout:0/90: dread d9/d1c/f1d [0,4194304] 0 2024-02-15T18:27:02.576 INFO:tasks.workunit.client.1.smithi133.stdout:0/91: readlink d9/l18 0 2024-02-15T18:27:02.577 INFO:tasks.workunit.client.1.smithi133.stdout:2/137: rmdir d7/d18 39 2024-02-15T18:27:02.578 INFO:tasks.workunit.client.1.smithi133.stdout:0/92: creat d9/f21 x:0 0 0 2024-02-15T18:27:02.578 INFO:tasks.workunit.client.1.smithi133.stdout:3/102: rename d0/l9 to d0/d15/l17 0 2024-02-15T18:27:02.579 INFO:tasks.workunit.client.1.smithi133.stdout:0/93: mkdir d9/d10/d22 0 2024-02-15T18:27:02.580 INFO:tasks.workunit.client.1.smithi133.stdout:2/138: read d7/ff [3547305,1082] 0 2024-02-15T18:27:02.580 INFO:tasks.workunit.client.0.smithi084.stdout:6/383: dwrite d14/f2d [4194304,4194304] 0 2024-02-15T18:27:02.580 INFO:tasks.workunit.client.1.smithi133.stdout:3/103: mknod d0/c18 0 2024-02-15T18:27:02.581 INFO:tasks.workunit.client.1.smithi133.stdout:0/94: creat d9/d10/d22/f23 x:0 0 0 2024-02-15T18:27:02.581 INFO:tasks.workunit.client.1.smithi133.stdout:2/139: mkdir d7/d18/d32 0 2024-02-15T18:27:02.582 INFO:tasks.workunit.client.1.smithi133.stdout:3/104: mkdir d0/d15/d19 0 2024-02-15T18:27:02.585 INFO:tasks.workunit.client.1.smithi133.stdout:0/95: link f6 d9/d10/d19/f24 0 2024-02-15T18:27:02.585 INFO:tasks.workunit.client.1.smithi133.stdout:0/96: readlink d9/d10/l20 0 2024-02-15T18:27:02.588 INFO:tasks.workunit.client.1.smithi133.stdout:2/140: creat d7/d2c/d31/f33 x:0 0 0 2024-02-15T18:27:02.588 INFO:tasks.workunit.client.1.smithi133.stdout:3/105: rename d0/f7 to d0/df/f1a 0 2024-02-15T18:27:02.588 INFO:tasks.workunit.client.1.smithi133.stdout:0/97: creat d9/d10/d19/d1a/f25 x:0 0 0 2024-02-15T18:27:02.590 INFO:tasks.workunit.client.1.smithi133.stdout:3/106: symlink d0/df/l1b 0 2024-02-15T18:27:02.591 INFO:tasks.workunit.client.1.smithi133.stdout:0/98: symlink d9/d1c/l26 0 2024-02-15T18:27:02.591 INFO:tasks.workunit.client.0.smithi084.stdout:0/382: dwrite d0/d4/d1b/f6f [0,4194304] 0 2024-02-15T18:27:02.591 INFO:tasks.workunit.client.0.smithi084.stdout:0/383: write d0/d4/f4e [1138718,30509] 0 2024-02-15T18:27:02.592 INFO:tasks.workunit.client.1.smithi133.stdout:7/55: dwrite f0 [0,4194304] 0 2024-02-15T18:27:02.592 INFO:tasks.workunit.client.0.smithi084.stdout:0/384: read d0/d4/d66/f72 [307197,41564] 0 2024-02-15T18:27:02.592 INFO:tasks.workunit.client.0.smithi084.stdout:2/369: dwrite d3/f1b [4194304,4194304] 0 2024-02-15T18:27:02.592 INFO:tasks.workunit.client.0.smithi084.stdout:2/370: write d3/d19/d36/f40 [3118187,75765] 0 2024-02-15T18:27:02.592 INFO:tasks.workunit.client.0.smithi084.stdout:2/371: truncate d3/d5/d1a/f4e 2274690 0 2024-02-15T18:27:02.593 INFO:tasks.workunit.client.1.smithi133.stdout:0/99: rename d9/d10/l11 to d9/d1c/l27 0 2024-02-15T18:27:02.593 INFO:tasks.workunit.client.1.smithi133.stdout:0/100: dread - d9/fb zero size 2024-02-15T18:27:02.594 INFO:tasks.workunit.client.1.smithi133.stdout:7/56: mknod d9/db/c14 0 2024-02-15T18:27:02.600 INFO:tasks.workunit.client.1.smithi133.stdout:0/101: mkdir d9/d28 0 2024-02-15T18:27:02.600 INFO:tasks.workunit.client.1.smithi133.stdout:0/102: stat d9/d10/d19/d1a 0 2024-02-15T18:27:02.600 INFO:tasks.workunit.client.1.smithi133.stdout:7/57: mknod d9/db/c15 0 2024-02-15T18:27:02.604 INFO:tasks.workunit.client.1.smithi133.stdout:0/103: mkdir d9/d10/d19/d29 0 2024-02-15T18:27:02.607 INFO:tasks.workunit.client.1.smithi133.stdout:0/104: truncate f6 171276 0 2024-02-15T18:27:02.608 INFO:tasks.workunit.client.0.smithi084.stdout:7/352: rename df/d1d/d1a/d4b/f51 to df/f63 0 2024-02-15T18:27:02.608 INFO:tasks.workunit.client.0.smithi084.stdout:7/353: chown df/d1d/d1a/d4d/d59/d62 52695 1 2024-02-15T18:27:02.608 INFO:tasks.workunit.client.0.smithi084.stdout:2/372: dread d3/d19/f20 [0,4194304] 0 2024-02-15T18:27:02.608 INFO:tasks.workunit.client.0.smithi084.stdout:2/373: chown d3/d19/d24/d3e/f70 117 1 2024-02-15T18:27:02.609 INFO:tasks.workunit.client.0.smithi084.stdout:0/385: dread d0/d2f/d3f/f17 [0,4194304] 0 2024-02-15T18:27:02.609 INFO:tasks.workunit.client.0.smithi084.stdout:0/386: chown d0/d4/d1b 13907 1 2024-02-15T18:27:02.609 INFO:tasks.workunit.client.0.smithi084.stdout:8/398: getdents db/d1a/d5e 0 2024-02-15T18:27:02.610 INFO:tasks.workunit.client.1.smithi133.stdout:0/105: mknod d9/d28/c2a 0 2024-02-15T18:27:02.610 INFO:tasks.workunit.client.1.smithi133.stdout:0/106: readlink d9/d10/l12 0 2024-02-15T18:27:02.610 INFO:tasks.workunit.client.1.smithi133.stdout:0/107: dread - d9/f21 zero size 2024-02-15T18:27:02.610 INFO:tasks.workunit.client.1.smithi133.stdout:3/107: read d0/fa [144056,76191] 0 2024-02-15T18:27:02.612 INFO:tasks.workunit.client.0.smithi084.stdout:2/374: dread d3/d19/d24/f32 [0,4194304] 0 2024-02-15T18:27:02.612 INFO:tasks.workunit.client.1.smithi133.stdout:0/108: mkdir d9/d2b 0 2024-02-15T18:27:02.613 INFO:tasks.workunit.client.1.smithi133.stdout:0/109: stat d9/d10/l20 0 2024-02-15T18:27:02.614 INFO:tasks.workunit.client.0.smithi084.stdout:2/375: write d3/d5/f21 [1768780,109601] 0 2024-02-15T18:27:02.615 INFO:tasks.workunit.client.1.smithi133.stdout:2/141: dwrite d7/db/f2d [0,4194304] 0 2024-02-15T18:27:02.618 INFO:tasks.workunit.client.0.smithi084.stdout:6/384: mknod d14/d22/d25/d2f/d31/d30/c7c 0 2024-02-15T18:27:02.618 INFO:tasks.workunit.client.0.smithi084.stdout:9/381: mknod d4/d2b/d67/c77 0 2024-02-15T18:27:02.618 INFO:tasks.workunit.client.0.smithi084.stdout:9/382: fsync d4/d2b/f3b 0 2024-02-15T18:27:02.619 INFO:tasks.workunit.client.0.smithi084.stdout:9/383: dread - d4/d2b/d3c/d20/f62 zero size 2024-02-15T18:27:02.620 INFO:tasks.workunit.client.0.smithi084.stdout:8/399: creat db/dd/d4d/d7e/f85 x:0 0 0 2024-02-15T18:27:02.622 INFO:tasks.workunit.client.0.smithi084.stdout:7/354: dread df/d1d/d40/d48/f45 [0,4194304] 0 2024-02-15T18:27:02.624 INFO:tasks.workunit.client.0.smithi084.stdout:6/385: creat d14/d22/d25/d41/f7d x:0 0 0 2024-02-15T18:27:02.624 INFO:tasks.workunit.client.0.smithi084.stdout:2/376: symlink d3/d5/l7a 0 2024-02-15T18:27:02.624 INFO:tasks.workunit.client.0.smithi084.stdout:2/377: stat d3/d19/d24/l65 0 2024-02-15T18:27:02.624 INFO:tasks.workunit.client.0.smithi084.stdout:2/378: fdatasync d3/d5/f18 0 2024-02-15T18:27:02.624 INFO:tasks.workunit.client.0.smithi084.stdout:6/386: write d14/d22/d25/d2f/f60 [760858,77469] 0 2024-02-15T18:27:02.624 INFO:tasks.workunit.client.0.smithi084.stdout:8/400: creat db/dd/d1f/d56/f86 x:0 0 0 2024-02-15T18:27:02.624 INFO:tasks.workunit.client.0.smithi084.stdout:9/384: symlink d4/d2b/l78 0 2024-02-15T18:27:02.626 INFO:tasks.workunit.client.0.smithi084.stdout:7/355: creat df/d1d/d1a/f64 x:0 0 0 2024-02-15T18:27:02.630 INFO:tasks.workunit.client.0.smithi084.stdout:6/387: unlink d14/d22/d25/d2f/d31/d3f/c46 0 2024-02-15T18:27:02.630 INFO:tasks.workunit.client.0.smithi084.stdout:8/401: stat l7 0 2024-02-15T18:27:02.630 INFO:tasks.workunit.client.0.smithi084.stdout:9/385: mknod d4/d2b/d3c/d20/c79 0 2024-02-15T18:27:02.630 INFO:tasks.workunit.client.0.smithi084.stdout:9/386: fsync d4/d2b/d3c/d20/d43/f1c 0 2024-02-15T18:27:02.631 INFO:tasks.workunit.client.0.smithi084.stdout:2/379: mkdir d3/d19/d24/d7b 0 2024-02-15T18:27:02.633 INFO:tasks.workunit.client.0.smithi084.stdout:6/388: unlink fd 0 2024-02-15T18:27:02.634 INFO:tasks.workunit.client.0.smithi084.stdout:8/402: rmdir db/d6a/d76 39 2024-02-15T18:27:02.634 INFO:tasks.workunit.client.0.smithi084.stdout:9/387: creat d4/d2b/d3c/d20/d75/f7a x:0 0 0 2024-02-15T18:27:02.636 INFO:tasks.workunit.client.0.smithi084.stdout:6/389: symlink d14/d22/l7e 0 2024-02-15T18:27:02.636 INFO:tasks.workunit.client.0.smithi084.stdout:6/390: fsync d14/d22/d25/f44 0 2024-02-15T18:27:02.636 INFO:tasks.workunit.client.0.smithi084.stdout:6/391: fdatasync d14/f17 0 2024-02-15T18:27:02.637 INFO:tasks.workunit.client.0.smithi084.stdout:9/388: truncate d4/d2b/d3c/d20/d43/f1c 3424163 0 2024-02-15T18:27:02.640 INFO:tasks.workunit.client.0.smithi084.stdout:9/389: mkdir d4/d2b/d3c/d20/d43/d15/d33/d7b 0 2024-02-15T18:27:02.642 INFO:tasks.workunit.client.1.smithi133.stdout:3/108: dwrite d0/f8 [0,4194304] 0 2024-02-15T18:27:02.647 INFO:tasks.workunit.client.0.smithi084.stdout:0/387: dwrite d0/d2f/d3f/f5a [0,4194304] 0 2024-02-15T18:27:02.650 INFO:tasks.workunit.client.0.smithi084.stdout:0/388: creat d0/d4/d1b/d26/d43/f76 x:0 0 0 2024-02-15T18:27:02.653 INFO:tasks.workunit.client.1.smithi133.stdout:0/110: dwrite d9/d10/f17 [4194304,4194304] 0 2024-02-15T18:27:02.655 INFO:tasks.workunit.client.1.smithi133.stdout:0/111: dread d9/d1c/f1d [0,4194304] 0 2024-02-15T18:27:02.659 INFO:tasks.workunit.client.0.smithi084.stdout:8/403: dread db/dd/d13/f5c [0,4194304] 0 2024-02-15T18:27:02.659 INFO:tasks.workunit.client.0.smithi084.stdout:0/389: unlink d0/d2f/d3f/c6e 0 2024-02-15T18:27:02.659 INFO:tasks.workunit.client.0.smithi084.stdout:8/404: mknod db/c87 0 2024-02-15T18:27:02.660 INFO:tasks.workunit.client.0.smithi084.stdout:7/356: dwrite df/d1d/d1a/f60 [0,4194304] 0 2024-02-15T18:27:02.660 INFO:tasks.workunit.client.0.smithi084.stdout:6/392: dread f3 [0,4194304] 0 2024-02-15T18:27:02.660 INFO:tasks.workunit.client.1.smithi133.stdout:2/142: dwrite d7/f15 [0,4194304] 0 2024-02-15T18:27:02.661 INFO:tasks.workunit.client.1.smithi133.stdout:0/112: mkdir d9/d10/d2c 0 2024-02-15T18:27:02.662 INFO:tasks.workunit.client.0.smithi084.stdout:9/390: dwrite d4/d2b/d3c/d20/f5a [0,4194304] 0 2024-02-15T18:27:02.665 INFO:tasks.workunit.client.1.smithi133.stdout:2/143: getdents d7 0 2024-02-15T18:27:02.666 INFO:tasks.workunit.client.1.smithi133.stdout:0/113: creat d9/f2d x:0 0 0 2024-02-15T18:27:02.669 INFO:tasks.workunit.client.1.smithi133.stdout:2/144: dread d7/db/f21 [0,4194304] 0 2024-02-15T18:27:02.669 INFO:tasks.workunit.client.1.smithi133.stdout:0/114: mknod d9/d10/d19/d29/c2e 0 2024-02-15T18:27:02.670 INFO:tasks.workunit.client.0.smithi084.stdout:8/405: rmdir db/dd 39 2024-02-15T18:27:02.671 INFO:tasks.workunit.client.1.smithi133.stdout:2/145: symlink d7/db/l34 0 2024-02-15T18:27:02.671 INFO:tasks.workunit.client.1.smithi133.stdout:3/109: dwrite d0/d15/f16 [0,4194304] 0 2024-02-15T18:27:02.671 INFO:tasks.workunit.client.1.smithi133.stdout:3/110: chown d0 317 1 2024-02-15T18:27:02.671 INFO:tasks.workunit.client.1.smithi133.stdout:0/115: truncate f4 37759 0 2024-02-15T18:27:02.673 INFO:tasks.workunit.client.0.smithi084.stdout:2/380: truncate d3/d5/f21 1016649 0 2024-02-15T18:27:02.675 INFO:tasks.workunit.client.1.smithi133.stdout:2/146: mkdir d7/db/d35 0 2024-02-15T18:27:02.675 INFO:tasks.workunit.client.1.smithi133.stdout:2/147: dread - d7/f30 zero size 2024-02-15T18:27:02.675 INFO:tasks.workunit.client.1.smithi133.stdout:2/148: fsync d7/f15 0 2024-02-15T18:27:02.676 INFO:tasks.workunit.client.1.smithi133.stdout:3/111: symlink d0/d15/l1c 0 2024-02-15T18:27:02.676 INFO:tasks.workunit.client.1.smithi133.stdout:3/112: rename d0 to d0/d15/d19/d1d 22 2024-02-15T18:27:02.677 INFO:tasks.workunit.client.1.smithi133.stdout:0/116: mkdir d9/d10/d22/d2f 0 2024-02-15T18:27:02.677 INFO:tasks.workunit.client.1.smithi133.stdout:0/117: chown d9/d10/d19/d1a 0 1 2024-02-15T18:27:02.677 INFO:tasks.workunit.client.1.smithi133.stdout:0/118: dread - d9/f14 zero size 2024-02-15T18:27:02.679 INFO:tasks.workunit.client.1.smithi133.stdout:3/113: creat d0/d15/d19/f1e x:0 0 0 2024-02-15T18:27:02.679 INFO:tasks.workunit.client.1.smithi133.stdout:3/114: fsync d0/fa 0 2024-02-15T18:27:02.679 INFO:tasks.workunit.client.1.smithi133.stdout:0/119: mkdir d9/d10/d22/d2f/d30 0 2024-02-15T18:27:02.680 INFO:tasks.workunit.client.1.smithi133.stdout:3/115: mknod d0/d15/c1f 0 2024-02-15T18:27:02.682 INFO:tasks.workunit.client.0.smithi084.stdout:6/393: mkdir d14/d22/d25/d2f/d31/d30/d4f/d7f 0 2024-02-15T18:27:02.683 INFO:tasks.workunit.client.1.smithi133.stdout:3/116: creat d0/df/f20 x:0 0 0 2024-02-15T18:27:02.684 INFO:tasks.workunit.client.1.smithi133.stdout:3/117: chown d0/c10 10087 1 2024-02-15T18:27:02.684 INFO:tasks.workunit.client.1.smithi133.stdout:3/118: chown d0/c18 13164724 1 2024-02-15T18:27:02.684 INFO:tasks.workunit.client.1.smithi133.stdout:3/119: fsync d0/d15/f16 0 2024-02-15T18:27:02.684 INFO:tasks.workunit.client.1.smithi133.stdout:3/120: dread - d0/df/f20 zero size 2024-02-15T18:27:02.684 INFO:tasks.workunit.client.0.smithi084.stdout:7/357: creat df/d1d/d40/f65 x:0 0 0 2024-02-15T18:27:02.687 INFO:tasks.workunit.client.0.smithi084.stdout:2/381: rename d3/c10 to d3/d5/d1a/d1e/c7c 0 2024-02-15T18:27:02.688 INFO:tasks.workunit.client.0.smithi084.stdout:6/394: mknod d14/d22/d25/d2f/d31/c80 0 2024-02-15T18:27:02.689 INFO:tasks.workunit.client.0.smithi084.stdout:6/395: write fc [2868888,112917] 0 2024-02-15T18:27:02.690 INFO:tasks.workunit.client.0.smithi084.stdout:7/358: getdents df/d1d/d1a/d4d 0 2024-02-15T18:27:02.691 INFO:tasks.workunit.client.0.smithi084.stdout:2/382: symlink d3/d5/d1a/d1e/d30/l7d 0 2024-02-15T18:27:02.692 INFO:tasks.workunit.client.0.smithi084.stdout:7/359: write df/f3b [3532973,58151] 0 2024-02-15T18:27:02.693 INFO:tasks.workunit.client.0.smithi084.stdout:0/390: dwrite d0/d2f/d3f/f17 [0,4194304] 0 2024-02-15T18:27:02.693 INFO:tasks.workunit.client.0.smithi084.stdout:6/396: mknod d14/d22/d25/d41/c81 0 2024-02-15T18:27:02.693 INFO:tasks.workunit.client.0.smithi084.stdout:6/397: truncate d14/d22/d25/d2f/f66 1189927 0 2024-02-15T18:27:02.693 INFO:tasks.workunit.client.0.smithi084.stdout:0/391: creat d0/d2f/d3f/d4f/d61/f77 x:0 0 0 2024-02-15T18:27:02.694 INFO:tasks.workunit.client.0.smithi084.stdout:6/398: symlink d14/d22/d25/d2f/d31/d30/d4f/d7f/l82 0 2024-02-15T18:27:02.695 INFO:tasks.workunit.client.0.smithi084.stdout:0/392: creat d0/d39/f78 x:0 0 0 2024-02-15T18:27:02.702 INFO:tasks.workunit.client.1.smithi133.stdout:2/149: dwrite d7/f30 [0,4194304] 0 2024-02-15T18:27:02.703 INFO:tasks.workunit.client.0.smithi084.stdout:9/391: dwrite d4/d3d/f61 [0,4194304] 0 2024-02-15T18:27:02.705 INFO:tasks.workunit.client.0.smithi084.stdout:2/383: write d3/d5/d1a/f4e [1664409,92107] 0 2024-02-15T18:27:02.706 INFO:tasks.workunit.client.1.smithi133.stdout:8/51: sync 2024-02-15T18:27:02.706 INFO:tasks.workunit.client.1.smithi133.stdout:1/146: sync 2024-02-15T18:27:02.706 INFO:tasks.workunit.client.0.smithi084.stdout:1/346: sync 2024-02-15T18:27:02.706 INFO:tasks.workunit.client.0.smithi084.stdout:3/362: sync 2024-02-15T18:27:02.707 INFO:tasks.workunit.client.0.smithi084.stdout:9/392: creat d4/d2b/d3c/d20/d43/d15/d33/f7c x:0 0 0 2024-02-15T18:27:02.708 INFO:tasks.workunit.client.0.smithi084.stdout:9/393: fsync d4/d2b/d3c/f49 0 2024-02-15T18:27:02.708 INFO:tasks.workunit.client.0.smithi084.stdout:2/384: creat d3/d5e/f7e x:0 0 0 2024-02-15T18:27:02.709 INFO:tasks.workunit.client.0.smithi084.stdout:3/363: unlink d8/d1f/d2d/f5d 0 2024-02-15T18:27:02.709 INFO:tasks.workunit.client.0.smithi084.stdout:3/364: chown d8/d40/l57 16 1 2024-02-15T18:27:02.710 INFO:tasks.workunit.client.0.smithi084.stdout:1/347: rename d9/d54/d1b/d2c/d4b/d4c/d79/c10 to d9/d54/d1b/d2c/d35/c7d 0 2024-02-15T18:27:02.711 INFO:tasks.workunit.client.0.smithi084.stdout:1/348: chown d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/l66 66759 1 2024-02-15T18:27:02.711 INFO:tasks.workunit.client.0.smithi084.stdout:8/406: dwrite db/d3f/d59/f2c [0,4194304] 0 2024-02-15T18:27:02.712 INFO:tasks.workunit.client.0.smithi084.stdout:9/394: symlink d4/d36/l7d 0 2024-02-15T18:27:02.712 INFO:tasks.workunit.client.1.smithi133.stdout:2/150: write d7/f15 [322011,60322] 0 2024-02-15T18:27:02.713 INFO:tasks.workunit.client.1.smithi133.stdout:0/120: dwrite d9/d10/d19/f24 [0,4194304] 0 2024-02-15T18:27:02.714 INFO:tasks.workunit.client.1.smithi133.stdout:2/151: truncate d7/db/f21 670896 0 2024-02-15T18:27:02.714 INFO:tasks.workunit.client.0.smithi084.stdout:3/365: link d8/d1f/d2d/f3d d8/d1f/d25/f7f 0 2024-02-15T18:27:02.715 INFO:tasks.workunit.client.0.smithi084.stdout:3/366: truncate d8/d40/f59 804507 0 2024-02-15T18:27:02.715 INFO:tasks.workunit.client.0.smithi084.stdout:3/367: write d8/d1f/d25/f7f [2106642,129017] 0 2024-02-15T18:27:02.716 INFO:tasks.workunit.client.0.smithi084.stdout:0/393: dwrite d0/d4/d1b/f3e [0,4194304] 0 2024-02-15T18:27:02.717 INFO:tasks.workunit.client.0.smithi084.stdout:0/394: fdatasync d0/d2f/d3f/f49 0 2024-02-15T18:27:02.717 INFO:tasks.workunit.client.0.smithi084.stdout:6/399: write fc [1511576,26330] 0 2024-02-15T18:27:02.717 INFO:tasks.workunit.client.0.smithi084.stdout:9/395: creat d4/d3d/f7e x:0 0 0 2024-02-15T18:27:02.717 INFO:tasks.workunit.client.1.smithi133.stdout:2/152: rename d7/c2e to d7/d2c/d31/c36 0 2024-02-15T18:27:02.720 INFO:tasks.workunit.client.1.smithi133.stdout:3/121: rmdir d0/df 39 2024-02-15T18:27:02.720 INFO:tasks.workunit.client.0.smithi084.stdout:1/349: write d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 [1997338,102942] 0 2024-02-15T18:27:02.721 INFO:tasks.workunit.client.1.smithi133.stdout:2/153: read d7/f15 [3411100,48289] 0 2024-02-15T18:27:02.722 INFO:tasks.workunit.client.0.smithi084.stdout:9/396: write d4/d2b/d3c/d20/d43/d15/d33/f66 [1935798,3988] 0 2024-02-15T18:27:02.722 INFO:tasks.workunit.client.0.smithi084.stdout:9/397: chown d4/d2b/d3c/d20/d43/d15/f37 120106 1 2024-02-15T18:27:02.723 INFO:tasks.workunit.client.0.smithi084.stdout:3/368: rename d8/d1f/d28 to d8/d40/d58/d80 0 2024-02-15T18:27:02.723 INFO:tasks.workunit.client.0.smithi084.stdout:3/369: readlink d8/d22/l69 0 2024-02-15T18:27:02.723 INFO:tasks.workunit.client.0.smithi084.stdout:3/370: fdatasync d8/f1c 0 2024-02-15T18:27:02.724 INFO:tasks.workunit.client.1.smithi133.stdout:3/122: link d0/df/l11 d0/d15/d19/l21 0 2024-02-15T18:27:02.726 INFO:tasks.workunit.client.1.smithi133.stdout:2/154: rename d7/l2a to d7/d2c/d31/l37 0 2024-02-15T18:27:02.727 INFO:tasks.workunit.client.0.smithi084.stdout:9/398: mknod d4/d2b/d3c/d20/d43/c7f 0 2024-02-15T18:27:02.729 INFO:tasks.workunit.client.1.smithi133.stdout:2/155: unlink d7/d2c/d31/f33 0 2024-02-15T18:27:02.729 INFO:tasks.workunit.client.0.smithi084.stdout:3/371: creat d8/d40/d43/d71/f81 x:0 0 0 2024-02-15T18:27:02.729 INFO:tasks.workunit.client.0.smithi084.stdout:3/372: write d8/f1b [5070768,51057] 0 2024-02-15T18:27:02.730 INFO:tasks.workunit.client.0.smithi084.stdout:3/373: chown d8/d1f/f20 3298 1 2024-02-15T18:27:02.730 INFO:tasks.workunit.client.0.smithi084.stdout:9/399: creat d4/d3d/f80 x:0 0 0 2024-02-15T18:27:02.730 INFO:tasks.workunit.client.0.smithi084.stdout:9/400: fdatasync d4/f41 0 2024-02-15T18:27:02.732 INFO:tasks.workunit.client.1.smithi133.stdout:2/156: rename d7/db/f1b to d7/d2c/d31/f38 0 2024-02-15T18:27:02.735 INFO:tasks.workunit.client.1.smithi133.stdout:2/157: creat d7/db/d35/f39 x:0 0 0 2024-02-15T18:27:02.740 INFO:tasks.workunit.client.1.smithi133.stdout:1/147: dwrite d6/fe [0,4194304] 0 2024-02-15T18:27:02.740 INFO:tasks.workunit.client.1.smithi133.stdout:1/148: fdatasync d6/f2e 0 2024-02-15T18:27:02.742 INFO:tasks.workunit.client.1.smithi133.stdout:3/123: write d0/f8 [4053523,12176] 0 2024-02-15T18:27:02.746 INFO:tasks.workunit.client.1.smithi133.stdout:1/149: creat d6/d17/f3c x:0 0 0 2024-02-15T18:27:02.746 INFO:tasks.workunit.client.1.smithi133.stdout:3/124: truncate d0/df/f1a 1133415 0 2024-02-15T18:27:02.746 INFO:tasks.workunit.client.1.smithi133.stdout:3/125: write d0/fa [733339,11717] 0 2024-02-15T18:27:02.746 INFO:tasks.workunit.client.1.smithi133.stdout:1/150: write d6/f2d [95263,59914] 0 2024-02-15T18:27:02.748 INFO:tasks.workunit.client.1.smithi133.stdout:1/151: getdents d6/d32 0 2024-02-15T18:27:02.751 INFO:tasks.workunit.client.1.smithi133.stdout:1/152: symlink d6/l3d 0 2024-02-15T18:27:02.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:00.684521+0000 mgr.smithi084.hjmnez (mgr.14596) 18 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 379 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 17 MiB/s wr, 89 op/s 2024-02-15T18:27:02.763 INFO:tasks.workunit.client.0.smithi084.stdout:0/395: dwrite d0/d2f/d3f/f17 [4194304,4194304] 0 2024-02-15T18:27:02.765 INFO:tasks.workunit.client.0.smithi084.stdout:0/396: mkdir d0/d2f/d3f/d4f/d61/d79 0 2024-02-15T18:27:02.766 INFO:tasks.workunit.client.0.smithi084.stdout:0/397: mkdir d0/d4/d1b/d7a 0 2024-02-15T18:27:02.766 INFO:tasks.workunit.client.0.smithi084.stdout:0/398: fsync d0/f37 0 2024-02-15T18:27:02.769 INFO:tasks.workunit.client.0.smithi084.stdout:6/400: dread d14/d22/d25/f2b [0,4194304] 0 2024-02-15T18:27:02.770 INFO:tasks.workunit.client.0.smithi084.stdout:6/401: mknod d14/d22/d25/d2f/d31/d30/d45/c83 0 2024-02-15T18:27:02.770 INFO:tasks.workunit.client.0.smithi084.stdout:6/402: dread - d14/d22/d25/d2f/d31/d3f/f74 zero size 2024-02-15T18:27:02.775 INFO:tasks.workunit.client.0.smithi084.stdout:1/350: dwrite d9/f27 [0,4194304] 0 2024-02-15T18:27:02.778 INFO:tasks.workunit.client.0.smithi084.stdout:6/403: write d14/d22/d25/d2f/d31/f79 [4206671,130174] 0 2024-02-15T18:27:02.778 INFO:tasks.workunit.client.0.smithi084.stdout:1/351: creat d9/d54/d1b/d38/d4d/f7e x:0 0 0 2024-02-15T18:27:02.778 INFO:tasks.workunit.client.0.smithi084.stdout:1/352: write d9/f15 [5047890,128869] 0 2024-02-15T18:27:02.778 INFO:tasks.workunit.client.0.smithi084.stdout:6/404: creat d14/d22/d25/f84 x:0 0 0 2024-02-15T18:27:02.780 INFO:tasks.workunit.client.0.smithi084.stdout:1/353: mkdir d9/d54/d7f 0 2024-02-15T18:27:02.781 INFO:tasks.workunit.client.0.smithi084.stdout:1/354: chown d9/d54/d1b/d2c/d4b/d4c/d79/d36/c65 40647730 1 2024-02-15T18:27:02.781 INFO:tasks.workunit.client.0.smithi084.stdout:1/355: chown d9/d54/d76 206500 1 2024-02-15T18:27:02.782 INFO:tasks.workunit.client.0.smithi084.stdout:1/356: creat d9/d54/d76/f80 x:0 0 0 2024-02-15T18:27:02.782 INFO:tasks.workunit.client.1.smithi133.stdout:0/121: dwrite f0 [0,4194304] 0 2024-02-15T18:27:02.784 INFO:tasks.workunit.client.0.smithi084.stdout:1/357: rename d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/d57 to d9/d54/d5c/d81 0 2024-02-15T18:27:02.786 INFO:tasks.workunit.client.1.smithi133.stdout:0/122: dread f7 [0,4194304] 0 2024-02-15T18:27:02.787 INFO:tasks.workunit.client.1.smithi133.stdout:0/123: mknod d9/d10/d22/d2f/c31 0 2024-02-15T18:27:02.787 INFO:tasks.workunit.client.1.smithi133.stdout:2/158: dwrite d7/db/f1d [0,4194304] 0 2024-02-15T18:27:02.792 INFO:tasks.workunit.client.1.smithi133.stdout:3/126: dread d0/f8 [0,4194304] 0 2024-02-15T18:27:02.795 INFO:tasks.workunit.client.0.smithi084.stdout:9/401: dwrite d4/d2b/f38 [0,4194304] 0 2024-02-15T18:27:02.795 INFO:tasks.workunit.client.0.smithi084.stdout:9/402: truncate d4/d3d/f80 697117 0 2024-02-15T18:27:02.796 INFO:tasks.workunit.client.1.smithi133.stdout:8/52: dwrite f2 [0,4194304] 0 2024-02-15T18:27:02.797 INFO:tasks.workunit.client.1.smithi133.stdout:1/153: dwrite d6/d17/f1c [0,4194304] 0 2024-02-15T18:27:02.797 INFO:tasks.workunit.client.1.smithi133.stdout:1/154: truncate d6/f2e 151523 0 2024-02-15T18:27:02.797 INFO:tasks.workunit.client.1.smithi133.stdout:1/155: dread - d6/d17/f3c zero size 2024-02-15T18:27:02.798 INFO:tasks.workunit.client.0.smithi084.stdout:9/403: dread d4/d2b/d3c/d20/d43/d15/f40 [0,4194304] 0 2024-02-15T18:27:02.798 INFO:tasks.workunit.client.0.smithi084.stdout:3/374: dwrite d8/d22/f52 [0,4194304] 0 2024-02-15T18:27:02.798 INFO:tasks.workunit.client.0.smithi084.stdout:3/375: fsync d8/d22/f54 0 2024-02-15T18:27:02.798 INFO:tasks.workunit.client.0.smithi084.stdout:0/399: dwrite d0/d4/d1b/f3e [0,4194304] 0 2024-02-15T18:27:02.803 INFO:tasks.workunit.client.1.smithi133.stdout:2/159: fsync d7/db/d35/f39 0 2024-02-15T18:27:02.807 INFO:tasks.workunit.client.0.smithi084.stdout:0/400: unlink d0/d2f/d3f/d4f/f6b 0 2024-02-15T18:27:02.811 INFO:tasks.workunit.client.1.smithi133.stdout:8/53: getdents d3 0 2024-02-15T18:27:02.812 INFO:tasks.workunit.client.0.smithi084.stdout:0/401: dread d0/d4/f4e [0,4194304] 0 2024-02-15T18:27:02.812 INFO:tasks.workunit.client.0.smithi084.stdout:0/402: truncate d0/d2f/d3f/d4f/d61/f77 181405 0 2024-02-15T18:27:02.813 INFO:tasks.workunit.client.1.smithi133.stdout:1/156: truncate d6/d2a/f38 8186793 0 2024-02-15T18:27:02.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/157: chown l3 12 1 2024-02-15T18:27:02.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/158: chown d6/d2a/f2f 0 1 2024-02-15T18:27:02.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/159: write d6/d2a/f2f [1004404,59405] 0 2024-02-15T18:27:02.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/160: fsync d6/f29 0 2024-02-15T18:27:02.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/161: write d6/d2a/f2f [1878070,106091] 0 2024-02-15T18:27:02.814 INFO:tasks.workunit.client.1.smithi133.stdout:0/124: dread d9/d10/f17 [0,4194304] 0 2024-02-15T18:27:02.814 INFO:tasks.workunit.client.0.smithi084.stdout:0/403: mknod d0/d4/d66/c7b 0 2024-02-15T18:27:02.815 INFO:tasks.workunit.client.1.smithi133.stdout:2/160: rmdir d7 39 2024-02-15T18:27:02.815 INFO:tasks.workunit.client.0.smithi084.stdout:0/404: dread d0/d4/f4e [0,4194304] 0 2024-02-15T18:27:02.816 INFO:tasks.workunit.client.1.smithi133.stdout:5/87: sync 2024-02-15T18:27:02.817 INFO:tasks.workunit.client.1.smithi133.stdout:1/162: mknod d6/d1e/d3a/c3e 0 2024-02-15T18:27:02.821 INFO:tasks.workunit.client.1.smithi133.stdout:2/161: creat d7/d18/f3a x:0 0 0 2024-02-15T18:27:02.821 INFO:tasks.workunit.client.1.smithi133.stdout:1/163: creat d6/d2a/f3f x:0 0 0 2024-02-15T18:27:02.822 INFO:tasks.workunit.client.0.smithi084.stdout:4/384: sync 2024-02-15T18:27:02.822 INFO:tasks.workunit.client.0.smithi084.stdout:5/447: sync 2024-02-15T18:27:02.822 INFO:tasks.workunit.client.0.smithi084.stdout:4/385: readlink d2/d4/d28/d2e/l6b 0 2024-02-15T18:27:02.823 INFO:tasks.workunit.client.1.smithi133.stdout:1/164: rename d6/d17/f25 to d6/d2a/f40 0 2024-02-15T18:27:02.824 INFO:tasks.workunit.client.0.smithi084.stdout:5/448: unlink d9/da/d3d/d44/d55/d70/l85 0 2024-02-15T18:27:02.825 INFO:tasks.workunit.client.1.smithi133.stdout:2/162: mkdir d7/d2c/d3b 0 2024-02-15T18:27:02.826 INFO:tasks.workunit.client.0.smithi084.stdout:4/386: mkdir d2/d4/d28/d71 0 2024-02-15T18:27:02.830 INFO:tasks.workunit.client.1.smithi133.stdout:1/165: mkdir d6/d1e/d41 0 2024-02-15T18:27:02.832 INFO:tasks.workunit.client.0.smithi084.stdout:0/405: dread d0/d2f/d3f/f30 [0,4194304] 0 2024-02-15T18:27:02.832 INFO:tasks.workunit.client.0.smithi084.stdout:9/404: dwrite d4/d2b/d3c/d20/d43/d15/d33/f66 [4194304,4194304] 0 2024-02-15T18:27:02.832 INFO:tasks.workunit.client.0.smithi084.stdout:0/406: stat d0/d4/d1b/f3e 0 2024-02-15T18:27:02.835 INFO:tasks.workunit.client.0.smithi084.stdout:9/405: mkdir d4/d81 0 2024-02-15T18:27:02.835 INFO:tasks.workunit.client.0.smithi084.stdout:9/406: fdatasync d4/d2b/f50 0 2024-02-15T18:27:02.836 INFO:tasks.workunit.client.0.smithi084.stdout:0/407: read d0/d25/f2a [270761,59403] 0 2024-02-15T18:27:02.837 INFO:tasks.workunit.client.0.smithi084.stdout:0/408: chown d0/f37 1167673 1 2024-02-15T18:27:02.837 INFO:tasks.workunit.client.0.smithi084.stdout:0/409: fdatasync d0/d2f/d3f/d4f/d59/f60 0 2024-02-15T18:27:02.837 INFO:tasks.workunit.client.0.smithi084.stdout:0/410: write d0/d2f/f56 [675104,45061] 0 2024-02-15T18:27:02.837 INFO:tasks.workunit.client.0.smithi084.stdout:0/411: fdatasync d0/d4/d1b/f3c 0 2024-02-15T18:27:02.837 INFO:tasks.workunit.client.0.smithi084.stdout:0/412: chown d0/d4/d3a/d5c/f52 463989 1 2024-02-15T18:27:02.837 INFO:tasks.workunit.client.0.smithi084.stdout:0/413: truncate d0/d25/f67 663788 0 2024-02-15T18:27:02.837 INFO:tasks.workunit.client.0.smithi084.stdout:9/407: mknod d4/d6b/c82 0 2024-02-15T18:27:02.837 INFO:tasks.workunit.client.0.smithi084.stdout:9/408: stat d4/d2b/d67 0 2024-02-15T18:27:02.837 INFO:tasks.workunit.client.1.smithi133.stdout:1/166: dread d6/f13 [0,4194304] 0 2024-02-15T18:27:02.838 INFO:tasks.workunit.client.1.smithi133.stdout:1/167: rename d6/d1e/f37 to d6/d1e/d41/f42 0 2024-02-15T18:27:02.839 INFO:tasks.workunit.client.0.smithi084.stdout:9/409: symlink d4/d2b/d3c/l83 0 2024-02-15T18:27:02.840 INFO:tasks.workunit.client.1.smithi133.stdout:3/127: dwrite d0/fc [0,4194304] 0 2024-02-15T18:27:02.840 INFO:tasks.workunit.client.1.smithi133.stdout:0/125: dread d9/fc [0,4194304] 0 2024-02-15T18:27:02.840 INFO:tasks.workunit.client.1.smithi133.stdout:3/128: chown d0/fc 40 1 2024-02-15T18:27:02.840 INFO:tasks.workunit.client.1.smithi133.stdout:3/129: fdatasync d0/df/f20 0 2024-02-15T18:27:02.840 INFO:tasks.workunit.client.1.smithi133.stdout:8/54: dread d3/f8 [0,4194304] 0 2024-02-15T18:27:02.840 INFO:tasks.workunit.client.1.smithi133.stdout:8/55: write d3/de/ff [473629,6178] 0 2024-02-15T18:27:02.840 INFO:tasks.workunit.client.1.smithi133.stdout:1/168: read d6/d2a/f38 [7391611,88750] 0 2024-02-15T18:27:02.840 INFO:tasks.workunit.client.1.smithi133.stdout:1/169: readlink d6/l3d 0 2024-02-15T18:27:02.841 INFO:tasks.workunit.client.1.smithi133.stdout:3/130: write d0/fa [656466,64613] 0 2024-02-15T18:27:02.841 INFO:tasks.workunit.client.1.smithi133.stdout:3/131: truncate d0/d15/d19/f1e 588050 0 2024-02-15T18:27:02.841 INFO:tasks.workunit.client.1.smithi133.stdout:3/132: fdatasync d0/d15/d19/f1e 0 2024-02-15T18:27:02.841 INFO:tasks.workunit.client.0.smithi084.stdout:9/410: mknod d4/d2b/d3c/d20/d75/c84 0 2024-02-15T18:27:02.842 INFO:tasks.workunit.client.0.smithi084.stdout:9/411: write d4/d2b/d3c/d24/f71 [123536,86174] 0 2024-02-15T18:27:02.842 INFO:tasks.workunit.client.0.smithi084.stdout:9/412: fsync d4/d2b/d3c/d24/f2a 0 2024-02-15T18:27:02.843 INFO:tasks.workunit.client.1.smithi133.stdout:0/126: mkdir d9/d10/d22/d32 0 2024-02-15T18:27:02.843 INFO:tasks.workunit.client.1.smithi133.stdout:0/127: fdatasync f6 0 2024-02-15T18:27:02.843 INFO:tasks.workunit.client.1.smithi133.stdout:0/128: chown d9/d10/f17 1643 1 2024-02-15T18:27:02.844 INFO:tasks.workunit.client.1.smithi133.stdout:8/56: symlink d3/d7/l11 0 2024-02-15T18:27:02.844 INFO:tasks.workunit.client.1.smithi133.stdout:1/170: creat d6/f43 x:0 0 0 2024-02-15T18:27:02.844 INFO:tasks.workunit.client.1.smithi133.stdout:1/171: write d6/f22 [249968,13948] 0 2024-02-15T18:27:02.844 INFO:tasks.workunit.client.1.smithi133.stdout:1/172: write d6/d2a/f35 [462155,92306] 0 2024-02-15T18:27:02.844 INFO:tasks.workunit.client.1.smithi133.stdout:3/133: rename d0/f14 to d0/df/f22 0 2024-02-15T18:27:02.844 INFO:tasks.workunit.client.1.smithi133.stdout:3/134: write d0/df/f20 [306172,73249] 0 2024-02-15T18:27:02.844 INFO:tasks.workunit.client.1.smithi133.stdout:8/57: mknod d3/c12 0 2024-02-15T18:27:02.845 INFO:tasks.workunit.client.1.smithi133.stdout:8/58: chown d3/fb 2037589 1 2024-02-15T18:27:02.845 INFO:tasks.workunit.client.1.smithi133.stdout:8/59: symlink d3/l13 0 2024-02-15T18:27:02.847 INFO:tasks.workunit.client.1.smithi133.stdout:1/173: symlink d6/l44 0 2024-02-15T18:27:02.847 INFO:tasks.workunit.client.1.smithi133.stdout:1/174: chown d6/d2a/f3f 0 1 2024-02-15T18:27:02.848 INFO:tasks.workunit.client.1.smithi133.stdout:5/88: dwrite f2 [0,4194304] 0 2024-02-15T18:27:02.848 INFO:tasks.workunit.client.1.smithi133.stdout:3/135: write d0/f5 [1702749,26011] 0 2024-02-15T18:27:02.848 INFO:tasks.workunit.client.1.smithi133.stdout:1/175: creat d6/d32/f45 x:0 0 0 2024-02-15T18:27:02.849 INFO:tasks.workunit.client.1.smithi133.stdout:5/89: mknod d17/c1d 0 2024-02-15T18:27:02.851 INFO:tasks.workunit.client.1.smithi133.stdout:3/136: creat d0/f23 x:0 0 0 2024-02-15T18:27:02.851 INFO:tasks.workunit.client.1.smithi133.stdout:1/176: creat d6/d1e/d41/f46 x:0 0 0 2024-02-15T18:27:02.853 INFO:tasks.workunit.client.1.smithi133.stdout:1/177: mknod d6/c47 0 2024-02-15T18:27:02.853 INFO:tasks.workunit.client.1.smithi133.stdout:5/90: unlink d17/c1d 0 2024-02-15T18:27:02.853 INFO:tasks.workunit.client.1.smithi133.stdout:5/91: read - d17/f1c zero size 2024-02-15T18:27:02.854 INFO:tasks.workunit.client.0.smithi084.stdout:9/413: read d4/d2b/d3c/d20/d43/d15/f40 [3428,5305] 0 2024-02-15T18:27:02.854 INFO:tasks.workunit.client.0.smithi084.stdout:9/414: write d4/d2b/f50 [4766466,59279] 0 2024-02-15T18:27:02.856 INFO:tasks.workunit.client.0.smithi084.stdout:9/415: mknod d4/d2b/d3c/c85 0 2024-02-15T18:27:02.856 INFO:tasks.workunit.client.0.smithi084.stdout:9/416: write d4/d2b/d3c/d20/d43/f1c [3455706,77565] 0 2024-02-15T18:27:02.859 INFO:tasks.workunit.client.0.smithi084.stdout:9/417: rename d4/d6b/c82 to d4/d3d/c86 0 2024-02-15T18:27:02.859 INFO:tasks.workunit.client.0.smithi084.stdout:9/418: write d4/d2b/d3c/d20/d43/d15/d33/f7c [469937,77459] 0 2024-02-15T18:27:02.860 INFO:tasks.workunit.client.0.smithi084.stdout:9/419: fdatasync d4/d2b/f3b 0 2024-02-15T18:27:02.862 INFO:tasks.workunit.client.0.smithi084.stdout:9/420: mkdir d4/d2b/d3c/d20/d75/d87 0 2024-02-15T18:27:02.864 INFO:tasks.workunit.client.1.smithi133.stdout:1/178: write d6/d17/f1b [1761581,85847] 0 2024-02-15T18:27:02.864 INFO:tasks.workunit.client.1.smithi133.stdout:1/179: chown d6/d17/f1d 5 1 2024-02-15T18:27:02.868 INFO:tasks.workunit.client.1.smithi133.stdout:1/180: unlink d6/l9 0 2024-02-15T18:27:02.874 INFO:tasks.workunit.client.1.smithi133.stdout:1/181: creat d6/d2a/f48 x:0 0 0 2024-02-15T18:27:02.875 INFO:tasks.workunit.client.1.smithi133.stdout:1/182: mknod d6/c49 0 2024-02-15T18:27:02.875 INFO:tasks.workunit.client.1.smithi133.stdout:1/183: readlink d6/l31 0 2024-02-15T18:27:02.876 INFO:tasks.workunit.client.1.smithi133.stdout:1/184: readlink d6/l3d 0 2024-02-15T18:27:02.876 INFO:tasks.workunit.client.1.smithi133.stdout:1/185: creat d6/d2a/f4a x:0 0 0 2024-02-15T18:27:02.877 INFO:tasks.workunit.client.1.smithi133.stdout:1/186: creat d6/f4b x:0 0 0 2024-02-15T18:27:02.878 INFO:tasks.workunit.client.1.smithi133.stdout:1/187: rename l3 to d6/d1e/l4c 0 2024-02-15T18:27:02.884 INFO:tasks.workunit.client.0.smithi084.stdout:5/449: dwrite d9/d23/f57 [0,4194304] 0 2024-02-15T18:27:02.887 INFO:tasks.workunit.client.0.smithi084.stdout:4/387: dwrite d2/d4/f48 [0,4194304] 0 2024-02-15T18:27:02.888 INFO:tasks.workunit.client.0.smithi084.stdout:5/450: symlink d9/l94 0 2024-02-15T18:27:02.890 INFO:tasks.workunit.client.0.smithi084.stdout:4/388: link d2/d2b/c32 d2/c72 0 2024-02-15T18:27:02.890 INFO:tasks.workunit.client.0.smithi084.stdout:4/389: dread - d2/d4/d25/f4a zero size 2024-02-15T18:27:02.893 INFO:tasks.workunit.client.0.smithi084.stdout:5/451: symlink d9/d5b/d79/l95 0 2024-02-15T18:27:02.904 INFO:tasks.workunit.client.0.smithi084.stdout:4/390: dread d2/d2b/f5f [0,4194304] 0 2024-02-15T18:27:02.906 INFO:tasks.workunit.client.0.smithi084.stdout:4/391: rmdir d2/d4 39 2024-02-15T18:27:02.906 INFO:tasks.workunit.client.0.smithi084.stdout:4/392: stat d2/f11 0 2024-02-15T18:27:02.906 INFO:tasks.workunit.client.1.smithi133.stdout:0/129: dwrite d9/d10/d19/f24 [0,4194304] 0 2024-02-15T18:27:02.906 INFO:tasks.workunit.client.0.smithi084.stdout:5/452: dread d9/fe [0,4194304] 0 2024-02-15T18:27:02.907 INFO:tasks.workunit.client.0.smithi084.stdout:4/393: symlink d2/d2b/l73 0 2024-02-15T18:27:02.908 INFO:tasks.workunit.client.1.smithi133.stdout:0/130: mknod d9/d10/d19/c33 0 2024-02-15T18:27:02.908 INFO:tasks.workunit.client.1.smithi133.stdout:0/131: truncate d9/d10/d19/d1a/f25 217143 0 2024-02-15T18:27:02.908 INFO:tasks.workunit.client.1.smithi133.stdout:0/132: dread - d9/f1e zero size 2024-02-15T18:27:02.908 INFO:tasks.workunit.client.0.smithi084.stdout:5/453: mkdir d9/da/d3d/d44/d55/d96 0 2024-02-15T18:27:02.908 INFO:tasks.workunit.client.0.smithi084.stdout:5/454: write f8 [3674060,2149] 0 2024-02-15T18:27:02.909 INFO:tasks.workunit.client.0.smithi084.stdout:4/394: mkdir d2/d64/d74 0 2024-02-15T18:27:02.909 INFO:tasks.workunit.client.0.smithi084.stdout:4/395: write d2/d4/fd [5855441,82780] 0 2024-02-15T18:27:02.909 INFO:tasks.workunit.client.0.smithi084.stdout:4/396: chown d2/d2b/f1f 65 1 2024-02-15T18:27:02.909 INFO:tasks.workunit.client.0.smithi084.stdout:4/397: fdatasync d2/d4/d28/d3d/d5c/d65/f69 0 2024-02-15T18:27:02.910 INFO:tasks.workunit.client.0.smithi084.stdout:5/455: creat d9/da/d3d/d44/f97 x:0 0 0 2024-02-15T18:27:02.912 INFO:tasks.workunit.client.0.smithi084.stdout:5/456: write d9/d35/d65/f69 [181185,111102] 0 2024-02-15T18:27:02.914 INFO:tasks.workunit.client.0.smithi084.stdout:5/457: rename d9/f3b to d9/da/d3d/d44/d55/d70/d84/f98 0 2024-02-15T18:27:02.915 INFO:tasks.workunit.client.0.smithi084.stdout:5/458: creat d9/da/f99 x:0 0 0 2024-02-15T18:27:02.915 INFO:tasks.workunit.client.0.smithi084.stdout:5/459: chown d9/d35 42084779 1 2024-02-15T18:27:02.918 INFO:tasks.workunit.client.0.smithi084.stdout:9/421: dwrite d4/d2b/d67/f6d [0,4194304] 0 2024-02-15T18:27:02.918 INFO:tasks.workunit.client.0.smithi084.stdout:0/414: dwrite d0/d39/d45/f5e [0,4194304] 0 2024-02-15T18:27:02.918 INFO:tasks.workunit.client.0.smithi084.stdout:0/415: write d0/d2f/d3f/f49 [1615064,68276] 0 2024-02-15T18:27:02.918 INFO:tasks.workunit.client.0.smithi084.stdout:0/416: write d0/d2f/d3f/d4f/d61/f77 [943284,47451] 0 2024-02-15T18:27:02.918 INFO:tasks.workunit.client.1.smithi133.stdout:3/137: dwrite d0/f5 [0,4194304] 0 2024-02-15T18:27:02.919 INFO:tasks.workunit.client.0.smithi084.stdout:0/417: write d0/d2f/d3f/f17 [1631680,47682] 0 2024-02-15T18:27:02.920 INFO:tasks.workunit.client.1.smithi133.stdout:1/188: dwrite d6/d17/f18 [4194304,4194304] 0 2024-02-15T18:27:02.920 INFO:tasks.workunit.client.1.smithi133.stdout:8/60: dwrite d3/f5 [0,4194304] 0 2024-02-15T18:27:02.922 INFO:tasks.workunit.client.1.smithi133.stdout:1/189: dread d6/d1e/f21 [0,4194304] 0 2024-02-15T18:27:02.922 INFO:tasks.workunit.client.1.smithi133.stdout:3/138: getdents d0/d15/d19 0 2024-02-15T18:27:02.928 INFO:tasks.workunit.client.0.smithi084.stdout:0/418: creat d0/d4/d1b/d26/f7c x:0 0 0 2024-02-15T18:27:02.930 INFO:tasks.workunit.client.0.smithi084.stdout:0/419: getdents d0/d2f/d3f/d4f/d59 0 2024-02-15T18:27:02.934 INFO:tasks.workunit.client.0.smithi084.stdout:4/398: rmdir d2 39 2024-02-15T18:27:02.938 INFO:tasks.workunit.client.0.smithi084.stdout:0/420: mknod d0/d39/d45/c7d 0 2024-02-15T18:27:02.939 INFO:tasks.workunit.client.0.smithi084.stdout:4/399: symlink d2/d2b/l75 0 2024-02-15T18:27:02.941 INFO:tasks.workunit.client.1.smithi133.stdout:1/190: mknod d6/d2a/c4d 0 2024-02-15T18:27:02.942 INFO:tasks.workunit.client.0.smithi084.stdout:0/421: mkdir d0/d4/d1b/d26/d43/d7e 0 2024-02-15T18:27:02.942 INFO:tasks.workunit.client.0.smithi084.stdout:9/422: dwrite d4/d2b/d3c/d20/d43/d15/f37 [0,4194304] 0 2024-02-15T18:27:02.942 INFO:tasks.workunit.client.0.smithi084.stdout:9/423: fsync d4/d2b/d3c/d20/d43/d15/f37 0 2024-02-15T18:27:02.943 INFO:tasks.workunit.client.1.smithi133.stdout:1/191: creat d6/d1e/d41/f4e x:0 0 0 2024-02-15T18:27:02.944 INFO:tasks.workunit.client.0.smithi084.stdout:0/422: read d0/d4/d1b/f3c [3766917,59602] 0 2024-02-15T18:27:02.944 INFO:tasks.workunit.client.0.smithi084.stdout:0/423: read d0/f1a [1650892,11650] 0 2024-02-15T18:27:02.944 INFO:tasks.workunit.client.0.smithi084.stdout:4/400: write d2/d4/d28/d3d/f46 [2288550,57842] 0 2024-02-15T18:27:02.944 INFO:tasks.workunit.client.0.smithi084.stdout:9/424: mknod d4/d2b/d3c/d20/d43/c88 0 2024-02-15T18:27:02.944 INFO:tasks.workunit.client.0.smithi084.stdout:9/425: write d4/d36/f45 [20087,38968] 0 2024-02-15T18:27:02.945 INFO:tasks.workunit.client.1.smithi133.stdout:1/192: symlink d6/d17/l4f 0 2024-02-15T18:27:02.945 INFO:tasks.workunit.client.1.smithi133.stdout:1/193: write d6/f16 [1526305,77823] 0 2024-02-15T18:27:02.946 INFO:tasks.workunit.client.0.smithi084.stdout:0/424: link d0/d4/c2c d0/d4/d1b/d46/c7f 0 2024-02-15T18:27:02.946 INFO:tasks.workunit.client.1.smithi133.stdout:1/194: creat d6/d32/f50 x:0 0 0 2024-02-15T18:27:02.947 INFO:tasks.workunit.client.0.smithi084.stdout:7/360: sync 2024-02-15T18:27:02.947 INFO:tasks.workunit.client.0.smithi084.stdout:4/401: rename d2/d4/d28/d3d/f4e to d2/d4/d28/d3d/d5c/d65/f76 0 2024-02-15T18:27:02.948 INFO:tasks.workunit.client.0.smithi084.stdout:9/426: link d4/d2b/d3c/d20/d43/d15/f17 d4/d81/f89 0 2024-02-15T18:27:02.949 INFO:tasks.workunit.client.1.smithi133.stdout:1/195: mknod d6/d1e/c51 0 2024-02-15T18:27:02.949 INFO:tasks.workunit.client.0.smithi084.stdout:0/425: getdents d0/d2f/d3f/d4f 0 2024-02-15T18:27:02.949 INFO:tasks.workunit.client.0.smithi084.stdout:0/426: write d0/d4/d1b/f3c [4755310,43429] 0 2024-02-15T18:27:02.950 INFO:tasks.workunit.client.1.smithi133.stdout:1/196: mknod d6/d1e/d3a/c52 0 2024-02-15T18:27:02.950 INFO:tasks.workunit.client.1.smithi133.stdout:1/197: fsync d6/fe 0 2024-02-15T18:27:02.950 INFO:tasks.workunit.client.0.smithi084.stdout:7/361: creat df/d1d/d1a/d4d/d55/f66 x:0 0 0 2024-02-15T18:27:02.950 INFO:tasks.workunit.client.1.smithi133.stdout:1/198: creat d6/f53 x:0 0 0 2024-02-15T18:27:02.952 INFO:tasks.workunit.client.0.smithi084.stdout:4/402: creat d2/d4/d28/d2e/f77 x:0 0 0 2024-02-15T18:27:02.952 INFO:tasks.workunit.client.0.smithi084.stdout:4/403: write d2/d4/f20 [2035889,23569] 0 2024-02-15T18:27:02.952 INFO:tasks.workunit.client.0.smithi084.stdout:4/404: truncate d2/d2b/d47/f3c 4320963 0 2024-02-15T18:27:02.953 INFO:tasks.workunit.client.0.smithi084.stdout:9/427: creat d4/d2b/d3c/d24/f8a x:0 0 0 2024-02-15T18:27:02.953 INFO:tasks.workunit.client.0.smithi084.stdout:4/405: read d2/d4/f4f [609468,102382] 0 2024-02-15T18:27:02.953 INFO:tasks.workunit.client.1.smithi133.stdout:1/199: read d6/fd [7150909,72844] 0 2024-02-15T18:27:02.953 INFO:tasks.workunit.client.1.smithi133.stdout:1/200: stat d6/d32/f50 0 2024-02-15T18:27:02.953 INFO:tasks.workunit.client.1.smithi133.stdout:1/201: creat d6/d1e/d41/f54 x:0 0 0 2024-02-15T18:27:02.954 INFO:tasks.workunit.client.1.smithi133.stdout:1/202: truncate d6/d17/f1c 484903 0 2024-02-15T18:27:02.954 INFO:tasks.workunit.client.0.smithi084.stdout:7/362: link df/d1d/d1a/f26 df/d1d/d1a/d4d/f67 0 2024-02-15T18:27:02.955 INFO:tasks.workunit.client.1.smithi133.stdout:1/203: symlink d6/d1e/d41/l55 0 2024-02-15T18:27:02.956 INFO:tasks.workunit.client.0.smithi084.stdout:9/428: creat d4/d2b/d3c/f8b x:0 0 0 2024-02-15T18:27:02.956 INFO:tasks.workunit.client.0.smithi084.stdout:9/429: read - d4/d2b/d3c/d24/f8a zero size 2024-02-15T18:27:02.957 INFO:tasks.workunit.client.0.smithi084.stdout:9/430: write d4/d2b/d3c/d20/d43/d15/f44 [1184023,34059] 0 2024-02-15T18:27:02.957 INFO:tasks.workunit.client.0.smithi084.stdout:9/431: chown d4/d36/l76 5 1 2024-02-15T18:27:02.957 INFO:tasks.workunit.client.0.smithi084.stdout:9/432: fsync d4/f29 0 2024-02-15T18:27:02.958 INFO:tasks.workunit.client.0.smithi084.stdout:7/363: rename df/d1d/d44/l46 to df/d1d/d1a/d4d/d55/l68 0 2024-02-15T18:27:02.958 INFO:tasks.workunit.client.0.smithi084.stdout:7/364: read - df/d1d/d40/f65 zero size 2024-02-15T18:27:02.960 INFO:tasks.workunit.client.1.smithi133.stdout:1/204: symlink d6/l56 0 2024-02-15T18:27:02.962 INFO:tasks.workunit.client.1.smithi133.stdout:1/205: creat d6/d1e/f57 x:0 0 0 2024-02-15T18:27:02.966 INFO:tasks.workunit.client.1.smithi133.stdout:8/61: dwrite f2 [0,4194304] 0 2024-02-15T18:27:02.966 INFO:tasks.workunit.client.1.smithi133.stdout:8/62: fsync d3/fb 0 2024-02-15T18:27:02.969 INFO:tasks.workunit.client.1.smithi133.stdout:1/206: dread d6/d2a/f2f [0,4194304] 0 2024-02-15T18:27:02.971 INFO:tasks.workunit.client.1.smithi133.stdout:8/63: creat d3/f14 x:0 0 0 2024-02-15T18:27:02.972 INFO:tasks.workunit.client.1.smithi133.stdout:1/207: creat d6/d1e/d41/f58 x:0 0 0 2024-02-15T18:27:02.977 INFO:tasks.workunit.client.1.smithi133.stdout:1/208: write d6/d17/f1b [87974,4974] 0 2024-02-15T18:27:02.979 INFO:tasks.workunit.client.1.smithi133.stdout:1/209: mkdir d6/d2a/d59 0 2024-02-15T18:27:02.979 INFO:tasks.workunit.client.1.smithi133.stdout:1/210: chown c4 87 1 2024-02-15T18:27:02.979 INFO:tasks.workunit.client.1.smithi133.stdout:1/211: chown d6/c49 52310185 1 2024-02-15T18:27:02.979 INFO:tasks.workunit.client.0.smithi084.stdout:5/460: dwrite d9/d35/d65/d7c/f6f [0,4194304] 0 2024-02-15T18:27:02.980 INFO:tasks.workunit.client.0.smithi084.stdout:5/461: stat d9/da/c31 0 2024-02-15T18:27:02.980 INFO:tasks.workunit.client.0.smithi084.stdout:5/462: write d9/da/d3d/d44/d55/d70/d84/f98 [469903,129200] 0 2024-02-15T18:27:02.981 INFO:tasks.workunit.client.1.smithi133.stdout:1/212: read d6/d17/f18 [488737,40356] 0 2024-02-15T18:27:02.982 INFO:tasks.workunit.client.1.smithi133.stdout:3/139: dwrite d0/f23 [0,4194304] 0 2024-02-15T18:27:02.986 INFO:tasks.workunit.client.1.smithi133.stdout:1/213: mkdir d6/d2a/d59/d5a 0 2024-02-15T18:27:02.986 INFO:tasks.workunit.client.1.smithi133.stdout:1/214: chown d6/d1e/d3a/c52 162 1 2024-02-15T18:27:02.987 INFO:tasks.workunit.client.1.smithi133.stdout:1/215: fdatasync d6/d17/f1a 0 2024-02-15T18:27:02.987 INFO:tasks.workunit.client.1.smithi133.stdout:3/140: dread d0/fa [0,4194304] 0 2024-02-15T18:27:02.987 INFO:tasks.workunit.client.1.smithi133.stdout:9/93: sync 2024-02-15T18:27:02.988 INFO:tasks.workunit.client.1.smithi133.stdout:4/49: sync 2024-02-15T18:27:02.989 INFO:tasks.workunit.client.1.smithi133.stdout:9/94: truncate d0/d8/d10/f14 794671 0 2024-02-15T18:27:02.989 INFO:tasks.workunit.client.1.smithi133.stdout:3/141: creat d0/d15/f24 x:0 0 0 2024-02-15T18:27:02.990 INFO:tasks.workunit.client.1.smithi133.stdout:4/50: getdents d2/d5 0 2024-02-15T18:27:02.990 INFO:tasks.workunit.client.1.smithi133.stdout:4/51: stat d2/db/fe 0 2024-02-15T18:27:02.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/64: dread f2 [0,4194304] 0 2024-02-15T18:27:02.991 INFO:tasks.workunit.client.1.smithi133.stdout:9/95: creat d0/d8/d9/d12/f1b x:0 0 0 2024-02-15T18:27:02.992 INFO:tasks.workunit.client.1.smithi133.stdout:8/65: mknod d3/d7/c15 0 2024-02-15T18:27:02.993 INFO:tasks.workunit.client.0.smithi084.stdout:9/433: dwrite d4/d2b/d3c/d20/d43/f3f [0,4194304] 0 2024-02-15T18:27:02.993 INFO:tasks.workunit.client.0.smithi084.stdout:0/427: dwrite d0/d4/d1b/d26/d43/f76 [0,4194304] 0 2024-02-15T18:27:02.993 INFO:tasks.workunit.client.0.smithi084.stdout:0/428: fsync d0/d4/d1b/f42 0 2024-02-15T18:27:02.995 INFO:tasks.workunit.client.1.smithi133.stdout:8/66: link c0 d3/d7/c16 0 2024-02-15T18:27:02.995 INFO:tasks.workunit.client.1.smithi133.stdout:8/67: dread - d3/f14 zero size 2024-02-15T18:27:02.995 INFO:tasks.workunit.client.1.smithi133.stdout:8/68: fsync d3/fb 0 2024-02-15T18:27:02.995 INFO:tasks.workunit.client.0.smithi084.stdout:0/429: read d0/f37 [1452621,121387] 0 2024-02-15T18:27:02.996 INFO:tasks.workunit.client.0.smithi084.stdout:7/365: dwrite df/d1d/d1a/d4d/f4e [0,4194304] 0 2024-02-15T18:27:02.996 INFO:tasks.workunit.client.0.smithi084.stdout:9/434: creat d4/d2b/d67/f8c x:0 0 0 2024-02-15T18:27:02.997 INFO:tasks.workunit.client.0.smithi084.stdout:4/406: dwrite d2/d2b/f1f [0,4194304] 0 2024-02-15T18:27:02.998 INFO:tasks.workunit.client.1.smithi133.stdout:1/216: dread f2 [4194304,4194304] 0 2024-02-15T18:27:02.998 INFO:tasks.workunit.client.0.smithi084.stdout:7/366: mkdir df/d1d/d1a/d4b/d69 0 2024-02-15T18:27:02.999 INFO:tasks.workunit.client.0.smithi084.stdout:9/435: write d4/d2b/d67/f6d [1189415,59101] 0 2024-02-15T18:27:02.999 INFO:tasks.workunit.client.0.smithi084.stdout:9/436: getdents d4/d2b/d3c/d20/d43/d15/d4b 0 2024-02-15T18:27:02.999 INFO:tasks.workunit.client.0.smithi084.stdout:9/437: write d4/f19 [2826727,76323] 0 2024-02-15T18:27:02.999 INFO:tasks.workunit.client.0.smithi084.stdout:9/438: write d4/d3d/f7e [771674,102668] 0 2024-02-15T18:27:03.000 INFO:tasks.workunit.client.1.smithi133.stdout:1/217: mknod d6/d1e/c5b 0 2024-02-15T18:27:03.000 INFO:tasks.workunit.client.1.smithi133.stdout:1/218: readlink d6/d17/l4f 0 2024-02-15T18:27:03.000 INFO:tasks.workunit.client.1.smithi133.stdout:1/219: fdatasync d6/d32/f50 0 2024-02-15T18:27:03.000 INFO:tasks.workunit.client.1.smithi133.stdout:1/220: chown d6/d1e/d41/f54 20980242 1 2024-02-15T18:27:03.004 INFO:tasks.workunit.client.0.smithi084.stdout:5/463: dwrite d9/d23/f2a [0,4194304] 0 2024-02-15T18:27:03.004 INFO:tasks.workunit.client.1.smithi133.stdout:3/142: write d0/f23 [4567144,32080] 0 2024-02-15T18:27:03.005 INFO:tasks.workunit.client.0.smithi084.stdout:4/407: creat d2/d64/d74/f78 x:0 0 0 2024-02-15T18:27:03.006 INFO:tasks.workunit.client.1.smithi133.stdout:1/221: link d6/l44 d6/d32/l5c 0 2024-02-15T18:27:03.006 INFO:tasks.workunit.client.1.smithi133.stdout:8/69: dread d3/f4 [0,4194304] 0 2024-02-15T18:27:03.011 INFO:tasks.workunit.client.0.smithi084.stdout:9/439: dread d4/d2b/d3c/f22 [0,4194304] 0 2024-02-15T18:27:03.012 INFO:tasks.workunit.client.0.smithi084.stdout:9/440: stat d4/d2b/d67/c77 0 2024-02-15T18:27:03.012 INFO:tasks.workunit.client.0.smithi084.stdout:9/441: fdatasync d4/d2b/d3c/f22 0 2024-02-15T18:27:03.015 INFO:tasks.workunit.client.1.smithi133.stdout:3/143: rename d0/le to d0/d15/l25 0 2024-02-15T18:27:03.015 INFO:tasks.workunit.client.1.smithi133.stdout:1/222: symlink d6/d32/l5d 0 2024-02-15T18:27:03.015 INFO:tasks.workunit.client.1.smithi133.stdout:1/223: fsync d6/d32/f39 0 2024-02-15T18:27:03.016 INFO:tasks.workunit.client.1.smithi133.stdout:8/70: rename c1 to d3/d7/c17 0 2024-02-15T18:27:03.017 INFO:tasks.workunit.client.1.smithi133.stdout:1/224: symlink d6/d2a/d59/l5e 0 2024-02-15T18:27:03.017 INFO:tasks.workunit.client.1.smithi133.stdout:1/225: fsync d6/d17/f18 0 2024-02-15T18:27:03.018 INFO:tasks.workunit.client.1.smithi133.stdout:8/71: rename d3/fb to d3/de/f18 0 2024-02-15T18:27:03.018 INFO:tasks.workunit.client.1.smithi133.stdout:8/72: fsync d3/de/ff 0 2024-02-15T18:27:03.020 INFO:tasks.workunit.client.1.smithi133.stdout:8/73: unlink c0 0 2024-02-15T18:27:03.020 INFO:tasks.workunit.client.0.smithi084.stdout:9/442: getdents d4/d36 0 2024-02-15T18:27:03.020 INFO:tasks.workunit.client.0.smithi084.stdout:9/443: write d4/d2b/d3c/f49 [814917,85099] 0 2024-02-15T18:27:03.022 INFO:tasks.workunit.client.0.smithi084.stdout:9/444: symlink d4/d2b/d67/l8d 0 2024-02-15T18:27:03.022 INFO:tasks.workunit.client.0.smithi084.stdout:9/445: write d4/d2b/d3c/d20/d43/f1c [3940985,75753] 0 2024-02-15T18:27:03.023 INFO:tasks.workunit.client.1.smithi133.stdout:8/74: symlink d3/d7/l19 0 2024-02-15T18:27:03.024 INFO:tasks.workunit.client.1.smithi133.stdout:8/75: unlink d3/f8 0 2024-02-15T18:27:03.025 INFO:tasks.workunit.client.0.smithi084.stdout:9/446: creat d4/d2b/d3c/d20/d43/d15/d5d/f8e x:0 0 0 2024-02-15T18:27:03.025 INFO:tasks.workunit.client.0.smithi084.stdout:9/447: read - d4/d2b/d3c/f8b zero size 2024-02-15T18:27:03.025 INFO:tasks.workunit.client.0.smithi084.stdout:9/448: write d4/d2b/d3c/d20/d43/f6a [1013368,67363] 0 2024-02-15T18:27:03.027 INFO:tasks.workunit.client.0.smithi084.stdout:4/408: getdents d2/d64/d74 0 2024-02-15T18:27:03.027 INFO:tasks.workunit.client.1.smithi133.stdout:8/76: truncate d3/f5 3037081 0 2024-02-15T18:27:03.029 INFO:tasks.workunit.client.0.smithi084.stdout:4/409: link d2/d4/d28/f4b d2/d4/d25/d66/f79 0 2024-02-15T18:27:03.029 INFO:tasks.workunit.client.1.smithi133.stdout:6/180: sync 2024-02-15T18:27:03.029 INFO:tasks.workunit.client.1.smithi133.stdout:7/58: sync 2024-02-15T18:27:03.029 INFO:tasks.workunit.client.1.smithi133.stdout:6/181: truncate d0/db/f18 656293 0 2024-02-15T18:27:03.030 INFO:tasks.workunit.client.0.smithi084.stdout:4/410: creat d2/d2b/d47/f7a x:0 0 0 2024-02-15T18:27:03.031 INFO:tasks.workunit.client.1.smithi133.stdout:7/59: mkdir d9/db/d16 0 2024-02-15T18:27:03.032 INFO:tasks.workunit.client.1.smithi133.stdout:6/182: truncate d0/f24 1500341 0 2024-02-15T18:27:03.032 INFO:tasks.workunit.client.1.smithi133.stdout:6/183: dread - d0/db/d21/f3c zero size 2024-02-15T18:27:03.033 INFO:tasks.workunit.client.0.smithi084.stdout:0/430: dwrite d0/d39/d45/f5e [0,4194304] 0 2024-02-15T18:27:03.033 INFO:tasks.workunit.client.0.smithi084.stdout:7/367: dwrite df/d1d/d1a/f26 [0,4194304] 0 2024-02-15T18:27:03.034 INFO:tasks.workunit.client.0.smithi084.stdout:5/464: dwrite d9/f1d [0,4194304] 0 2024-02-15T18:27:03.034 INFO:tasks.workunit.client.0.smithi084.stdout:5/465: chown d9/da/d3d/d44 16060 1 2024-02-15T18:27:03.035 INFO:tasks.workunit.client.0.smithi084.stdout:0/431: symlink d0/d4/d1b/d26/d43/l80 0 2024-02-15T18:27:03.037 INFO:tasks.workunit.client.1.smithi133.stdout:6/184: dread d0/ff [0,4194304] 0 2024-02-15T18:27:03.039 INFO:tasks.workunit.client.0.smithi084.stdout:5/466: write d9/da/d3d/f72 [744408,124585] 0 2024-02-15T18:27:03.039 INFO:tasks.workunit.client.0.smithi084.stdout:5/467: truncate d9/da/f38 2861274 0 2024-02-15T18:27:03.039 INFO:tasks.workunit.client.0.smithi084.stdout:0/432: write d0/d4/d1b/d26/f2e [1323921,127425] 0 2024-02-15T18:27:03.039 INFO:tasks.workunit.client.0.smithi084.stdout:0/433: dread - d0/d4/d1b/d26/f7c zero size 2024-02-15T18:27:03.040 INFO:tasks.workunit.client.0.smithi084.stdout:8/407: sync 2024-02-15T18:27:03.040 INFO:tasks.workunit.client.0.smithi084.stdout:2/385: sync 2024-02-15T18:27:03.040 INFO:tasks.workunit.client.0.smithi084.stdout:6/405: sync 2024-02-15T18:27:03.040 INFO:tasks.workunit.client.0.smithi084.stdout:2/386: readlink d3/d5/l7a 0 2024-02-15T18:27:03.040 INFO:tasks.workunit.client.0.smithi084.stdout:2/387: write d3/d19/d24/d3e/f3c [861272,11728] 0 2024-02-15T18:27:03.041 INFO:tasks.workunit.client.1.smithi133.stdout:1/226: dwrite d6/d17/f1d [0,4194304] 0 2024-02-15T18:27:03.041 INFO:tasks.workunit.client.1.smithi133.stdout:6/185: symlink d0/db/d29/l3d 0 2024-02-15T18:27:03.045 INFO:tasks.workunit.client.0.smithi084.stdout:5/468: rename d9/d35/d65/d7c to d9/d5f/d68/d9a 0 2024-02-15T18:27:03.045 INFO:tasks.workunit.client.0.smithi084.stdout:7/368: read df/f35 [79127,67186] 0 2024-02-15T18:27:03.048 INFO:tasks.workunit.client.0.smithi084.stdout:6/406: symlink d14/d22/d25/d2f/d31/d3f/l85 0 2024-02-15T18:27:03.048 INFO:tasks.workunit.client.0.smithi084.stdout:9/449: fsync d4/d2b/d3c/d20/d43/d15/f44 0 2024-02-15T18:27:03.050 INFO:tasks.workunit.client.0.smithi084.stdout:8/408: mknod db/dd/d1f/d56/c88 0 2024-02-15T18:27:03.050 INFO:tasks.workunit.client.0.smithi084.stdout:8/409: write db/dd/d1f/d56/f86 [602298,56582] 0 2024-02-15T18:27:03.051 INFO:tasks.workunit.client.0.smithi084.stdout:8/410: unlink db/dd/d13/f40 0 2024-02-15T18:27:03.052 INFO:tasks.workunit.client.0.smithi084.stdout:8/411: write db/dd/d4d/f55 [861732,53491] 0 2024-02-15T18:27:03.054 INFO:tasks.workunit.client.0.smithi084.stdout:8/412: mknod db/d6a/d7d/c89 0 2024-02-15T18:27:03.054 INFO:tasks.workunit.client.0.smithi084.stdout:8/413: truncate db/dd/d13/d42/f80 956125 0 2024-02-15T18:27:03.058 INFO:tasks.workunit.client.0.smithi084.stdout:0/434: dread d0/d25/f34 [0,4194304] 0 2024-02-15T18:27:03.059 INFO:tasks.workunit.client.0.smithi084.stdout:8/414: dread db/dd/d4d/f5b [0,4194304] 0 2024-02-15T18:27:03.064 INFO:tasks.workunit.client.0.smithi084.stdout:0/435: link d0/d2f/d3f/f17 d0/d4/d3a/d5c/f81 0 2024-02-15T18:27:03.064 INFO:tasks.workunit.client.0.smithi084.stdout:8/415: creat db/dd/d4d/f8a x:0 0 0 2024-02-15T18:27:03.072 INFO:tasks.workunit.client.1.smithi133.stdout:1/227: mknod d6/d2a/d59/c5f 0 2024-02-15T18:27:03.073 INFO:tasks.workunit.client.1.smithi133.stdout:6/186: link d0/d5/d37/c39 d0/db/d21/c3e 0 2024-02-15T18:27:03.076 INFO:tasks.workunit.client.1.smithi133.stdout:1/228: rmdir d6/d17 39 2024-02-15T18:27:03.076 INFO:tasks.workunit.client.1.smithi133.stdout:1/229: chown d6/ff 160108 1 2024-02-15T18:27:03.077 INFO:tasks.workunit.client.1.smithi133.stdout:6/187: creat d0/db/f3f x:0 0 0 2024-02-15T18:27:03.078 INFO:tasks.workunit.client.1.smithi133.stdout:1/230: creat d6/d17/f60 x:0 0 0 2024-02-15T18:27:03.079 INFO:tasks.workunit.client.1.smithi133.stdout:6/188: mkdir d0/db/d1c/d40 0 2024-02-15T18:27:03.079 INFO:tasks.workunit.client.1.smithi133.stdout:6/189: fsync d0/f26 0 2024-02-15T18:27:03.079 INFO:tasks.workunit.client.1.smithi133.stdout:1/231: creat d6/d1e/d3a/f61 x:0 0 0 2024-02-15T18:27:03.079 INFO:tasks.workunit.client.1.smithi133.stdout:1/232: readlink d6/d32/l5d 0 2024-02-15T18:27:03.082 INFO:tasks.workunit.client.1.smithi133.stdout:1/233: dread d6/d17/f18 [4194304,4194304] 0 2024-02-15T18:27:03.083 INFO:tasks.workunit.client.1.smithi133.stdout:1/234: mknod d6/d32/c62 0 2024-02-15T18:27:03.084 INFO:tasks.workunit.client.1.smithi133.stdout:1/235: write d6/d2a/f2f [1345962,57592] 0 2024-02-15T18:27:03.084 INFO:tasks.workunit.client.1.smithi133.stdout:1/236: fsync f2 0 2024-02-15T18:27:03.086 INFO:tasks.workunit.client.1.smithi133.stdout:1/237: unlink d6/d1e/d3a/c3e 0 2024-02-15T18:27:03.086 INFO:tasks.workunit.client.1.smithi133.stdout:1/238: symlink d6/d1e/d3a/l63 0 2024-02-15T18:27:03.087 INFO:tasks.workunit.client.1.smithi133.stdout:3/144: dwrite d0/d15/d19/f1e [0,4194304] 0 2024-02-15T18:27:03.087 INFO:tasks.workunit.client.1.smithi133.stdout:3/145: fdatasync d0/d15/f24 0 2024-02-15T18:27:03.088 INFO:tasks.workunit.client.1.smithi133.stdout:1/239: getdents d6/d1e/d41 0 2024-02-15T18:27:03.088 INFO:tasks.workunit.client.1.smithi133.stdout:1/240: chown d6/l44 55 1 2024-02-15T18:27:03.096 INFO:tasks.workunit.client.1.smithi133.stdout:7/60: dwrite f6 [4194304,4194304] 0 2024-02-15T18:27:03.097 INFO:tasks.workunit.client.1.smithi133.stdout:8/77: dwrite d3/de/ff [0,4194304] 0 2024-02-15T18:27:03.097 INFO:tasks.workunit.client.1.smithi133.stdout:8/78: chown d3/de 2520 1 2024-02-15T18:27:03.097 INFO:tasks.workunit.client.1.smithi133.stdout:8/79: stat d3/f5 0 2024-02-15T18:27:03.097 INFO:tasks.workunit.client.0.smithi084.stdout:9/450: dwrite d4/d2b/d3c/d20/f52 [0,4194304] 0 2024-02-15T18:27:03.098 INFO:tasks.workunit.client.0.smithi084.stdout:9/451: chown d4/d2b/d3c/d24 0 1 2024-02-15T18:27:03.098 INFO:tasks.workunit.client.0.smithi084.stdout:6/407: dwrite d14/f17 [0,4194304] 0 2024-02-15T18:27:03.098 INFO:tasks.workunit.client.0.smithi084.stdout:8/416: dwrite db/d1a/d2b/f4b [0,4194304] 0 2024-02-15T18:27:03.098 INFO:tasks.workunit.client.0.smithi084.stdout:4/411: dwrite d2/d4/d25/d66/f79 [0,4194304] 0 2024-02-15T18:27:03.099 INFO:tasks.workunit.client.0.smithi084.stdout:7/369: dwrite f5 [0,4194304] 0 2024-02-15T18:27:03.101 INFO:tasks.workunit.client.0.smithi084.stdout:9/452: write d4/d2b/d3c/d20/d43/d15/f37 [5341433,17770] 0 2024-02-15T18:27:03.101 INFO:tasks.workunit.client.0.smithi084.stdout:9/453: dread - d4/d2b/d3c/d24/f8a zero size 2024-02-15T18:27:03.101 INFO:tasks.workunit.client.1.smithi133.stdout:8/80: creat d3/f1a x:0 0 0 2024-02-15T18:27:03.101 INFO:tasks.workunit.client.1.smithi133.stdout:8/81: dread - d3/de/f18 zero size 2024-02-15T18:27:03.102 INFO:tasks.workunit.client.1.smithi133.stdout:8/82: stat d3/d7/c15 0 2024-02-15T18:27:03.102 INFO:tasks.workunit.client.0.smithi084.stdout:6/408: write d14/d22/d25/d2f/d31/f79 [48698,31452] 0 2024-02-15T18:27:03.103 INFO:tasks.workunit.client.0.smithi084.stdout:6/409: dread - d14/f6f zero size 2024-02-15T18:27:03.103 INFO:tasks.workunit.client.1.smithi133.stdout:8/83: mkdir d3/de/d1b 0 2024-02-15T18:27:03.103 INFO:tasks.workunit.client.1.smithi133.stdout:8/84: truncate d3/f1a 299248 0 2024-02-15T18:27:03.107 INFO:tasks.workunit.client.0.smithi084.stdout:4/412: write d2/d2b/d47/d31/f43 [1560570,9383] 0 2024-02-15T18:27:03.110 INFO:tasks.workunit.client.0.smithi084.stdout:7/370: mkdir df/d1d/d1a/d6a 0 2024-02-15T18:27:03.110 INFO:tasks.workunit.client.0.smithi084.stdout:7/371: readlink df/d1d/d1a/d4d/l52 0 2024-02-15T18:27:03.111 INFO:tasks.workunit.client.0.smithi084.stdout:5/469: dwrite d9/da/f99 [0,4194304] 0 2024-02-15T18:27:03.111 INFO:tasks.workunit.client.0.smithi084.stdout:5/470: chown d9/da/c27 48 1 2024-02-15T18:27:03.111 INFO:tasks.workunit.client.0.smithi084.stdout:9/454: getdents d4/d6b 0 2024-02-15T18:27:03.111 INFO:tasks.workunit.client.0.smithi084.stdout:9/455: truncate d4/d2b/d3c/d20/d43/d15/f40 687717 0 2024-02-15T18:27:03.111 INFO:tasks.workunit.client.0.smithi084.stdout:5/471: read d9/d23/f37 [3155729,112775] 0 2024-02-15T18:27:03.112 INFO:tasks.workunit.client.0.smithi084.stdout:7/372: read df/d1d/d40/d48/f45 [3742437,94621] 0 2024-02-15T18:27:03.112 INFO:tasks.workunit.client.0.smithi084.stdout:7/373: truncate df/f63 259193 0 2024-02-15T18:27:03.112 INFO:tasks.workunit.client.0.smithi084.stdout:5/472: dread - d9/da/d3d/f91 zero size 2024-02-15T18:27:03.112 INFO:tasks.workunit.client.0.smithi084.stdout:5/473: dread - d9/d5f/d68/d9a/d7a/f81 zero size 2024-02-15T18:27:03.112 INFO:tasks.workunit.client.0.smithi084.stdout:9/456: write d4/d36/f5e [1431887,72404] 0 2024-02-15T18:27:03.113 INFO:tasks.workunit.client.1.smithi133.stdout:3/146: dread d0/fc [0,4194304] 0 2024-02-15T18:27:03.113 INFO:tasks.workunit.client.1.smithi133.stdout:6/190: getdents d0/db/d29 0 2024-02-15T18:27:03.113 INFO:tasks.workunit.client.1.smithi133.stdout:1/241: dwrite d6/f16 [0,4194304] 0 2024-02-15T18:27:03.113 INFO:tasks.workunit.client.1.smithi133.stdout:1/242: fsync d6/fe 0 2024-02-15T18:27:03.113 INFO:tasks.workunit.client.1.smithi133.stdout:1/243: truncate d6/d1e/d41/f42 553276 0 2024-02-15T18:27:03.113 INFO:tasks.workunit.client.0.smithi084.stdout:6/410: creat d14/d22/d25/d2f/d31/d30/d45/f86 x:0 0 0 2024-02-15T18:27:03.114 INFO:tasks.workunit.client.1.smithi133.stdout:7/61: dread f6 [4194304,4194304] 0 2024-02-15T18:27:03.115 INFO:tasks.workunit.client.0.smithi084.stdout:4/413: write d2/d4/d28/d2e/f49 [1809762,56503] 0 2024-02-15T18:27:03.115 INFO:tasks.workunit.client.0.smithi084.stdout:4/414: fdatasync d2/d4/f4f 0 2024-02-15T18:27:03.119 INFO:tasks.workunit.client.1.smithi133.stdout:3/147: creat d0/d15/f26 x:0 0 0 2024-02-15T18:27:03.121 INFO:tasks.workunit.client.1.smithi133.stdout:8/85: truncate d3/de/ff 2363393 0 2024-02-15T18:27:03.122 INFO:tasks.workunit.client.1.smithi133.stdout:6/191: rmdir d0/db/d21 39 2024-02-15T18:27:03.127 INFO:tasks.workunit.client.1.smithi133.stdout:8/86: rename d3/de/d1b to d3/d1c 0 2024-02-15T18:27:03.127 INFO:tasks.workunit.client.1.smithi133.stdout:8/87: fdatasync d3/de/ff 0 2024-02-15T18:27:03.128 INFO:tasks.workunit.client.0.smithi084.stdout:9/457: creat d4/d2b/d3c/d20/d43/d15/d33/d7b/f8f x:0 0 0 2024-02-15T18:27:03.129 INFO:tasks.workunit.client.1.smithi133.stdout:8/88: truncate d3/f5 2218501 0 2024-02-15T18:27:03.129 INFO:tasks.workunit.client.0.smithi084.stdout:6/411: link d14/d22/d25/d2f/d31/c4e d14/d22/d25/d2f/d31/d3f/d4a/c87 0 2024-02-15T18:27:03.129 INFO:tasks.workunit.client.0.smithi084.stdout:8/417: dwrite db/d3f/d59/f48 [0,4194304] 0 2024-02-15T18:27:03.129 INFO:tasks.workunit.client.0.smithi084.stdout:8/418: fsync db/d3f/d59/f3b 0 2024-02-15T18:27:03.130 INFO:tasks.workunit.client.0.smithi084.stdout:4/415: rename d2/d4/f7 to d2/d2b/d47/f7b 0 2024-02-15T18:27:03.130 INFO:tasks.workunit.client.0.smithi084.stdout:4/416: readlink d2/d2b/l73 0 2024-02-15T18:27:03.135 INFO:tasks.workunit.client.0.smithi084.stdout:9/458: creat d4/d2b/f90 x:0 0 0 2024-02-15T18:27:03.135 INFO:tasks.workunit.client.0.smithi084.stdout:5/474: truncate d9/da/f38 2560305 0 2024-02-15T18:27:03.135 INFO:tasks.workunit.client.0.smithi084.stdout:5/475: dread - d9/da/d3d/f91 zero size 2024-02-15T18:27:03.135 INFO:tasks.workunit.client.0.smithi084.stdout:8/419: mknod db/dd/d13/d42/c8b 0 2024-02-15T18:27:03.135 INFO:tasks.workunit.client.0.smithi084.stdout:6/412: rename d14/f2d to d14/d22/d25/d2f/d31/d30/d45/d54/f88 0 2024-02-15T18:27:03.136 INFO:tasks.workunit.client.0.smithi084.stdout:6/413: fsync d14/d22/d25/d28/f2a 0 2024-02-15T18:27:03.136 INFO:tasks.workunit.client.0.smithi084.stdout:4/417: mknod d2/d4/d28/c7c 0 2024-02-15T18:27:03.137 INFO:tasks.workunit.client.0.smithi084.stdout:9/459: symlink d4/d6b/l91 0 2024-02-15T18:27:03.137 INFO:tasks.workunit.client.0.smithi084.stdout:1/358: sync 2024-02-15T18:27:03.137 INFO:tasks.workunit.client.0.smithi084.stdout:3/376: sync 2024-02-15T18:27:03.137 INFO:tasks.workunit.client.0.smithi084.stdout:1/359: readlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/l66 0 2024-02-15T18:27:03.138 INFO:tasks.workunit.client.0.smithi084.stdout:5/476: truncate d9/d23/f4a 1863475 0 2024-02-15T18:27:03.138 INFO:tasks.workunit.client.0.smithi084.stdout:5/477: fsync d9/da/d3d/f72 0 2024-02-15T18:27:03.140 INFO:tasks.workunit.client.0.smithi084.stdout:6/414: mkdir d14/d22/d25/d89 0 2024-02-15T18:27:03.140 INFO:tasks.workunit.client.0.smithi084.stdout:8/420: rename db/dd/f10 to db/dd/d13/f8c 0 2024-02-15T18:27:03.140 INFO:tasks.workunit.client.0.smithi084.stdout:8/421: chown db/d1a/d2b/f45 30 1 2024-02-15T18:27:03.140 INFO:tasks.workunit.client.0.smithi084.stdout:4/418: getdents d2/d2b/d47/d31/d50 0 2024-02-15T18:27:03.141 INFO:tasks.workunit.client.0.smithi084.stdout:4/419: read d2/f21 [596873,88295] 0 2024-02-15T18:27:03.142 INFO:tasks.workunit.client.0.smithi084.stdout:5/478: unlink d9/d5b/l8b 0 2024-02-15T18:27:03.142 INFO:tasks.workunit.client.0.smithi084.stdout:9/460: dread d4/d2b/d3c/f49 [0,4194304] 0 2024-02-15T18:27:03.143 INFO:tasks.workunit.client.0.smithi084.stdout:8/422: rmdir db/d6a/d7d 39 2024-02-15T18:27:03.143 INFO:tasks.workunit.client.0.smithi084.stdout:4/420: rmdir d2/d4/d28/d3d/d5c 39 2024-02-15T18:27:03.143 INFO:tasks.workunit.client.0.smithi084.stdout:4/421: getdents d2/d2b/d47/d31/d50 0 2024-02-15T18:27:03.144 INFO:tasks.workunit.client.0.smithi084.stdout:7/374: dwrite df/d1d/d1a/f26 [0,4194304] 0 2024-02-15T18:27:03.144 INFO:tasks.workunit.client.0.smithi084.stdout:5/479: truncate d9/f15 1053790 0 2024-02-15T18:27:03.145 INFO:tasks.workunit.client.1.smithi133.stdout:3/148: dwrite d0/f23 [4194304,4194304] 0 2024-02-15T18:27:03.145 INFO:tasks.workunit.client.1.smithi133.stdout:3/149: rename d0/d15 to d0/d15/d27 22 2024-02-15T18:27:03.145 INFO:tasks.workunit.client.1.smithi133.stdout:3/150: truncate d0/df/f22 610701 0 2024-02-15T18:27:03.145 INFO:tasks.workunit.client.1.smithi133.stdout:3/151: chown d0/lb 231036 1 2024-02-15T18:27:03.146 INFO:tasks.workunit.client.0.smithi084.stdout:9/461: symlink d4/d3d/l92 0 2024-02-15T18:27:03.147 INFO:tasks.workunit.client.0.smithi084.stdout:8/423: mknod db/d3f/d59/d69/c8d 0 2024-02-15T18:27:03.147 INFO:tasks.workunit.client.0.smithi084.stdout:8/424: fsync db/d3f/d59/f3b 0 2024-02-15T18:27:03.147 INFO:tasks.workunit.client.0.smithi084.stdout:8/425: chown db/d3f/d59/f48 171904301 1 2024-02-15T18:27:03.148 INFO:tasks.workunit.client.0.smithi084.stdout:4/422: rmdir d2/d64 39 2024-02-15T18:27:03.148 INFO:tasks.workunit.client.0.smithi084.stdout:4/423: write d2/d4/d28/d3d/d5c/d65/f69 [821029,8212] 0 2024-02-15T18:27:03.149 INFO:tasks.workunit.client.1.smithi133.stdout:6/192: dwrite d0/d5/f1b [0,4194304] 0 2024-02-15T18:27:03.149 INFO:tasks.workunit.client.1.smithi133.stdout:6/193: getdents d0/db/d1c/d40 0 2024-02-15T18:27:03.149 INFO:tasks.workunit.client.1.smithi133.stdout:6/194: write d0/db/d21/f3c [495109,87847] 0 2024-02-15T18:27:03.150 INFO:tasks.workunit.client.1.smithi133.stdout:6/195: mkdir d0/d3b/d41 0 2024-02-15T18:27:03.151 INFO:tasks.workunit.client.0.smithi084.stdout:8/426: dread db/d1a/d2b/f45 [0,4194304] 0 2024-02-15T18:27:03.151 INFO:tasks.workunit.client.0.smithi084.stdout:5/480: rename d9/d23/l52 to d9/da/d3d/d44/d55/d96/l9b 0 2024-02-15T18:27:03.152 INFO:tasks.workunit.client.0.smithi084.stdout:5/481: write d9/d23/f37 [2411530,107168] 0 2024-02-15T18:27:03.152 INFO:tasks.workunit.client.0.smithi084.stdout:5/482: chown d9/d23/l62 19 1 2024-02-15T18:27:03.152 INFO:tasks.workunit.client.1.smithi133.stdout:3/152: dread d0/fc [0,4194304] 0 2024-02-15T18:27:03.154 INFO:tasks.workunit.client.0.smithi084.stdout:9/462: mknod d4/d2b/d3c/d20/d43/d15/d4f/c93 0 2024-02-15T18:27:03.155 INFO:tasks.workunit.client.0.smithi084.stdout:9/463: fsync d4/f41 0 2024-02-15T18:27:03.155 INFO:tasks.workunit.client.1.smithi133.stdout:3/153: dread d0/fa [0,4194304] 0 2024-02-15T18:27:03.155 INFO:tasks.workunit.client.1.smithi133.stdout:6/196: truncate d0/f24 813257 0 2024-02-15T18:27:03.156 INFO:tasks.workunit.client.0.smithi084.stdout:4/424: creat d2/d2b/d47/d31/d50/f7d x:0 0 0 2024-02-15T18:27:03.164 INFO:tasks.workunit.client.0.smithi084.stdout:9/464: dread d4/d3d/f61 [0,4194304] 0 2024-02-15T18:27:03.164 INFO:tasks.workunit.client.0.smithi084.stdout:9/465: fsync d4/d2b/d3c/d20/d43/d15/f28 0 2024-02-15T18:27:03.164 INFO:tasks.workunit.client.0.smithi084.stdout:9/466: write d4/d3d/f7e [1804876,69367] 0 2024-02-15T18:27:03.164 INFO:tasks.workunit.client.0.smithi084.stdout:9/467: fdatasync d4/d2b/d3c/f8b 0 2024-02-15T18:27:03.165 INFO:tasks.workunit.client.0.smithi084.stdout:8/427: creat db/d6a/d76/f8e x:0 0 0 2024-02-15T18:27:03.167 INFO:tasks.workunit.client.0.smithi084.stdout:5/483: creat d9/d35/d65/d8c/f9c x:0 0 0 2024-02-15T18:27:03.168 INFO:tasks.workunit.client.0.smithi084.stdout:4/425: creat d2/d4/d28/d3d/d5c/d5d/f7e x:0 0 0 2024-02-15T18:27:03.169 INFO:tasks.workunit.client.1.smithi133.stdout:2/163: sync 2024-02-15T18:27:03.169 INFO:tasks.workunit.client.1.smithi133.stdout:5/92: sync 2024-02-15T18:27:03.169 INFO:tasks.workunit.client.0.smithi084.stdout:1/360: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 [0,4194304] 0 2024-02-15T18:27:03.169 INFO:tasks.workunit.client.0.smithi084.stdout:9/468: creat d4/d3d/f94 x:0 0 0 2024-02-15T18:27:03.169 INFO:tasks.workunit.client.0.smithi084.stdout:9/469: read - d4/d2b/d3c/d20/d43/d15/d5d/f8e zero size 2024-02-15T18:27:03.169 INFO:tasks.workunit.client.1.smithi133.stdout:0/133: sync 2024-02-15T18:27:03.170 INFO:tasks.workunit.client.0.smithi084.stdout:5/484: creat d9/d5f/d68/d9a/f9d x:0 0 0 2024-02-15T18:27:03.171 INFO:tasks.workunit.client.0.smithi084.stdout:6/415: dwrite d14/d22/d25/d2f/d31/d30/d45/d54/f57 [0,4194304] 0 2024-02-15T18:27:03.172 INFO:tasks.workunit.client.1.smithi133.stdout:3/154: truncate d0/f23 7462273 0 2024-02-15T18:27:03.172 INFO:tasks.workunit.client.1.smithi133.stdout:3/155: chown d0/f23 8090 1 2024-02-15T18:27:03.172 INFO:tasks.workunit.client.1.smithi133.stdout:6/197: getdents d0/d3b 0 2024-02-15T18:27:03.174 INFO:tasks.workunit.client.0.smithi084.stdout:1/361: creat d9/d54/f82 x:0 0 0 2024-02-15T18:27:03.175 INFO:tasks.workunit.client.1.smithi133.stdout:6/198: unlink d0/c15 0 2024-02-15T18:27:03.176 INFO:tasks.workunit.client.0.smithi084.stdout:4/426: dread d2/d4/f8 [0,4194304] 0 2024-02-15T18:27:03.177 INFO:tasks.workunit.client.0.smithi084.stdout:4/427: getdents d2/d2b/d47/d31/d61 0 2024-02-15T18:27:03.181 INFO:tasks.workunit.client.0.smithi084.stdout:9/470: rename d4/d2b/d3c/f2e to d4/d2b/d3c/d20/d43/f95 0 2024-02-15T18:27:03.181 INFO:tasks.workunit.client.0.smithi084.stdout:9/471: fsync d4/d2b/d3c/d20/d43/f6a 0 2024-02-15T18:27:03.181 INFO:tasks.workunit.client.0.smithi084.stdout:5/485: getdents d9/d5f/d68/d9a/d7a 0 2024-02-15T18:27:03.181 INFO:tasks.workunit.client.0.smithi084.stdout:6/416: truncate d14/d22/d25/d28/f2a 2424852 0 2024-02-15T18:27:03.185 INFO:tasks.workunit.client.0.smithi084.stdout:1/362: readlink d9/d54/d1b/d2c/d4b/d4c/d79/d39/l28 0 2024-02-15T18:27:03.185 INFO:tasks.workunit.client.0.smithi084.stdout:1/363: truncate d9/d54/f82 570733 0 2024-02-15T18:27:03.192 INFO:tasks.workunit.client.0.smithi084.stdout:4/428: creat d2/d64/d74/f7f x:0 0 0 2024-02-15T18:27:03.195 INFO:tasks.workunit.client.0.smithi084.stdout:9/472: rmdir d4/d2b/d3c/d20/d43/d15/d5d 39 2024-02-15T18:27:03.195 INFO:tasks.workunit.client.0.smithi084.stdout:9/473: chown d4/f41 14 1 2024-02-15T18:27:03.195 INFO:tasks.workunit.client.0.smithi084.stdout:1/364: write d9/d54/d1b/d2c/f43 [2380720,84470] 0 2024-02-15T18:27:03.195 INFO:tasks.workunit.client.0.smithi084.stdout:4/429: mknod d2/d2b/c80 0 2024-02-15T18:27:03.201 INFO:tasks.workunit.client.0.smithi084.stdout:9/474: symlink d4/d2b/d3c/d20/l96 0 2024-02-15T18:27:03.202 INFO:tasks.workunit.client.0.smithi084.stdout:1/365: creat d9/d54/d1b/d38/f83 x:0 0 0 2024-02-15T18:27:03.204 INFO:tasks.workunit.client.0.smithi084.stdout:4/430: unlink d2/d64/f6e 0 2024-02-15T18:27:03.204 INFO:tasks.workunit.client.0.smithi084.stdout:4/431: fdatasync d2/d4/f5a 0 2024-02-15T18:27:03.204 INFO:tasks.workunit.client.0.smithi084.stdout:4/432: chown d2/d2b/d47/d31/c3f 6645658 1 2024-02-15T18:27:03.206 INFO:tasks.workunit.client.0.smithi084.stdout:9/475: rename d4/d36/f45 to d4/d6b/f97 0 2024-02-15T18:27:03.207 INFO:tasks.workunit.client.0.smithi084.stdout:4/433: mknod d2/d4/d28/c81 0 2024-02-15T18:27:03.221 INFO:tasks.workunit.client.1.smithi133.stdout:2/164: dwrite d7/db/d35/f39 [0,4194304] 0 2024-02-15T18:27:03.221 INFO:tasks.workunit.client.1.smithi133.stdout:2/165: write d7/db/f2d [4702393,109447] 0 2024-02-15T18:27:03.224 INFO:tasks.workunit.client.1.smithi133.stdout:2/166: link f1 d7/f3c 0 2024-02-15T18:27:03.225 INFO:tasks.workunit.client.1.smithi133.stdout:2/167: creat d7/db/d35/f3d x:0 0 0 2024-02-15T18:27:03.225 INFO:tasks.workunit.client.1.smithi133.stdout:2/168: symlink d7/d2c/d3b/l3e 0 2024-02-15T18:27:03.227 INFO:tasks.workunit.client.1.smithi133.stdout:2/169: mknod d7/c3f 0 2024-02-15T18:27:03.228 INFO:tasks.workunit.client.1.smithi133.stdout:2/170: creat d7/d18/f40 x:0 0 0 2024-02-15T18:27:03.229 INFO:tasks.workunit.client.1.smithi133.stdout:2/171: link d7/d18/c22 d7/db/c41 0 2024-02-15T18:27:03.239 INFO:tasks.workunit.client.0.smithi084.stdout:6/417: dwrite f10 [0,4194304] 0 2024-02-15T18:27:03.240 INFO:tasks.workunit.client.0.smithi084.stdout:6/418: stat d14/d22/d25/f44 0 2024-02-15T18:27:03.240 INFO:tasks.workunit.client.1.smithi133.stdout:0/134: dwrite f0 [4194304,4194304] 0 2024-02-15T18:27:03.240 INFO:tasks.workunit.client.1.smithi133.stdout:3/156: dwrite d0/fa [0,4194304] 0 2024-02-15T18:27:03.240 INFO:tasks.workunit.client.1.smithi133.stdout:5/93: dwrite f10 [0,4194304] 0 2024-02-15T18:27:03.241 INFO:tasks.workunit.client.0.smithi084.stdout:6/419: mkdir d14/d22/d25/d2f/d31/d30/d45/d52/d8a 0 2024-02-15T18:27:03.243 INFO:tasks.workunit.client.1.smithi133.stdout:6/199: dwrite d0/f12 [0,4194304] 0 2024-02-15T18:27:03.243 INFO:tasks.workunit.client.0.smithi084.stdout:1/366: dwrite d9/d54/d32/f49 [4194304,4194304] 0 2024-02-15T18:27:03.244 INFO:tasks.workunit.client.0.smithi084.stdout:6/420: unlink d14/d22/c3b 0 2024-02-15T18:27:03.245 INFO:tasks.workunit.client.1.smithi133.stdout:3/157: write d0/f8 [798082,21983] 0 2024-02-15T18:27:03.247 INFO:tasks.workunit.client.0.smithi084.stdout:9/476: dwrite d4/d2b/d3c/d20/d43/d15/d33/f53 [0,4194304] 0 2024-02-15T18:27:03.247 INFO:tasks.workunit.client.0.smithi084.stdout:9/477: readlink l3 0 2024-02-15T18:27:03.247 INFO:tasks.workunit.client.1.smithi133.stdout:5/94: write fc [2637158,100362] 0 2024-02-15T18:27:03.248 INFO:tasks.workunit.client.0.smithi084.stdout:6/421: creat d14/d22/d25/d2f/d31/d30/d4f/d7f/f8b x:0 0 0 2024-02-15T18:27:03.250 INFO:tasks.workunit.client.1.smithi133.stdout:2/172: dwrite d7/d18/f3a [0,4194304] 0 2024-02-15T18:27:03.251 INFO:tasks.workunit.client.1.smithi133.stdout:6/200: symlink d0/db/d29/l42 0 2024-02-15T18:27:03.254 INFO:tasks.workunit.client.0.smithi084.stdout:6/422: rename d14/d22/d25/d41/c81 to d14/d22/d25/d2f/c8c 0 2024-02-15T18:27:03.256 INFO:tasks.workunit.client.1.smithi133.stdout:2/173: getdents d7/d2c 0 2024-02-15T18:27:03.256 INFO:tasks.workunit.client.1.smithi133.stdout:6/201: dread - d0/db/f25 zero size 2024-02-15T18:27:03.256 INFO:tasks.workunit.client.1.smithi133.stdout:6/202: chown d0 1870728432 1 2024-02-15T18:27:03.258 INFO:tasks.workunit.client.0.smithi084.stdout:4/434: dwrite d2/d4/f4f [0,4194304] 0 2024-02-15T18:27:03.259 INFO:tasks.workunit.client.1.smithi133.stdout:2/174: read d7/f14 [3703249,114373] 0 2024-02-15T18:27:03.264 INFO:tasks.workunit.client.0.smithi084.stdout:4/435: rmdir d2/d4 39 2024-02-15T18:27:03.271 INFO:tasks.workunit.client.1.smithi133.stdout:6/203: dread d0/f12 [0,4194304] 0 2024-02-15T18:27:03.271 INFO:tasks.workunit.client.1.smithi133.stdout:2/175: dread d7/f16 [0,4194304] 0 2024-02-15T18:27:03.272 INFO:tasks.workunit.client.1.smithi133.stdout:3/158: dread d0/f8 [0,4194304] 0 2024-02-15T18:27:03.276 INFO:tasks.workunit.client.1.smithi133.stdout:6/204: mknod d0/d5/d37/c43 0 2024-02-15T18:27:03.278 INFO:tasks.workunit.client.0.smithi084.stdout:1/367: dwrite d9/d54/d1b/d2c/d4b/d4c/f5a [0,4194304] 0 2024-02-15T18:27:03.279 INFO:tasks.workunit.client.1.smithi133.stdout:0/135: dwrite d9/f14 [0,4194304] 0 2024-02-15T18:27:03.279 INFO:tasks.workunit.client.1.smithi133.stdout:0/136: chown d9/d28/c2a 14679799 1 2024-02-15T18:27:03.279 INFO:tasks.workunit.client.1.smithi133.stdout:5/95: fdatasync fc 0 2024-02-15T18:27:03.280 INFO:tasks.workunit.client.0.smithi084.stdout:9/478: dwrite d4/d2b/d3c/d20/d43/d15/d5d/f8e [0,4194304] 0 2024-02-15T18:27:03.281 INFO:tasks.workunit.client.1.smithi133.stdout:6/205: dread d0/db/f17 [0,4194304] 0 2024-02-15T18:27:03.283 INFO:tasks.workunit.client.1.smithi133.stdout:6/206: unlink d0/db/d21/f38 0 2024-02-15T18:27:03.284 INFO:tasks.workunit.client.0.smithi084.stdout:9/479: truncate d4/d2b/d3c/d20/d43/f3f 3955093 0 2024-02-15T18:27:03.287 INFO:tasks.workunit.client.1.smithi133.stdout:2/176: dread d7/f30 [0,4194304] 0 2024-02-15T18:27:03.288 INFO:tasks.workunit.client.0.smithi084.stdout:9/480: link l3 d4/d2b/d3c/l98 0 2024-02-15T18:27:03.291 INFO:tasks.workunit.client.0.smithi084.stdout:2/388: sync 2024-02-15T18:27:03.291 INFO:tasks.workunit.client.0.smithi084.stdout:0/436: sync 2024-02-15T18:27:03.291 INFO:tasks.workunit.client.0.smithi084.stdout:0/437: truncate d0/d2f/d3f/d4f/d61/f70 898908 0 2024-02-15T18:27:03.292 INFO:tasks.workunit.client.1.smithi133.stdout:0/137: dread f0 [4194304,4194304] 0 2024-02-15T18:27:03.293 INFO:tasks.workunit.client.0.smithi084.stdout:9/481: unlink d4/d2b/d3c/d20/d43/c7f 0 2024-02-15T18:27:03.293 INFO:tasks.workunit.client.1.smithi133.stdout:2/177: dread d7/d2c/d31/f38 [0,4194304] 0 2024-02-15T18:27:03.294 INFO:tasks.workunit.client.1.smithi133.stdout:2/178: chown d7/d18/l1a 0 1 2024-02-15T18:27:03.294 INFO:tasks.workunit.client.1.smithi133.stdout:0/138: mknod d9/d10/d2c/c34 0 2024-02-15T18:27:03.295 INFO:tasks.workunit.client.0.smithi084.stdout:1/368: dread d9/d54/d1b/d2c/f31 [0,4194304] 0 2024-02-15T18:27:03.295 INFO:tasks.workunit.client.0.smithi084.stdout:2/389: creat d3/d5/d1a/d2d/f7f x:0 0 0 2024-02-15T18:27:03.295 INFO:tasks.workunit.client.0.smithi084.stdout:2/390: chown d3/d5/d1a/c63 93009879 1 2024-02-15T18:27:03.295 INFO:tasks.workunit.client.0.smithi084.stdout:2/391: truncate d3/d5e/f6e 475029 0 2024-02-15T18:27:03.295 INFO:tasks.workunit.client.0.smithi084.stdout:2/392: dread - d3/d19/d24/d3e/f55 zero size 2024-02-15T18:27:03.295 INFO:tasks.workunit.client.0.smithi084.stdout:2/393: fdatasync d3/d19/d24/f32 0 2024-02-15T18:27:03.295 INFO:tasks.workunit.client.0.smithi084.stdout:2/394: chown d3/d5/d1a/d1e/d30 4061 1 2024-02-15T18:27:03.296 INFO:tasks.workunit.client.1.smithi133.stdout:2/179: unlink d7/d18/c28 0 2024-02-15T18:27:03.296 INFO:tasks.workunit.client.1.smithi133.stdout:2/180: dread d7/db/f21 [0,4194304] 0 2024-02-15T18:27:03.298 INFO:tasks.workunit.client.1.smithi133.stdout:0/139: dread d9/fe [0,4194304] 0 2024-02-15T18:27:03.300 INFO:tasks.workunit.client.1.smithi133.stdout:6/207: dread d0/fd [0,4194304] 0 2024-02-15T18:27:03.300 INFO:tasks.workunit.client.1.smithi133.stdout:5/96: dwrite d17/f1c [0,4194304] 0 2024-02-15T18:27:03.301 INFO:tasks.workunit.client.1.smithi133.stdout:0/140: write d9/f14 [3705844,35370] 0 2024-02-15T18:27:03.301 INFO:tasks.workunit.client.1.smithi133.stdout:0/141: stat d9/ff 0 2024-02-15T18:27:03.305 INFO:tasks.workunit.client.1.smithi133.stdout:5/97: mkdir d17/d1e 0 2024-02-15T18:27:03.305 INFO:tasks.workunit.client.1.smithi133.stdout:5/98: stat f2 0 2024-02-15T18:27:03.307 INFO:tasks.workunit.client.1.smithi133.stdout:6/208: link d0/c28 d0/db/d1c/d40/c44 0 2024-02-15T18:27:03.310 INFO:tasks.workunit.client.1.smithi133.stdout:4/52: sync 2024-02-15T18:27:03.312 INFO:tasks.workunit.client.1.smithi133.stdout:9/96: sync 2024-02-15T18:27:03.312 INFO:tasks.workunit.client.1.smithi133.stdout:9/97: write d0/f16 [126548,108215] 0 2024-02-15T18:27:03.312 INFO:tasks.workunit.client.1.smithi133.stdout:4/53: rmdir d2/d5 39 2024-02-15T18:27:03.312 INFO:tasks.workunit.client.1.smithi133.stdout:9/98: chown d0/d8/d10 1 1 2024-02-15T18:27:03.312 INFO:tasks.workunit.client.1.smithi133.stdout:4/54: chown c1 0 1 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:4/55: write d2/db/fe [4679640,26421] 0 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:9/99: write d0/d8/fd [1492572,117556] 0 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:1/244: sync 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:7/62: sync 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:1/245: readlink d6/l12 0 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:7/63: chown f0 1 1 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:1/246: write d6/d1e/d41/f46 [169901,42217] 0 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:6/209: dread d0/fd [0,4194304] 0 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:8/89: sync 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:5/99: write fc [1865559,116104] 0 2024-02-15T18:27:03.313 INFO:tasks.workunit.client.1.smithi133.stdout:5/100: chown d17 5855 1 2024-02-15T18:27:03.315 INFO:tasks.workunit.client.1.smithi133.stdout:9/100: rmdir d0/d8 39 2024-02-15T18:27:03.315 INFO:tasks.workunit.client.1.smithi133.stdout:4/56: mkdir d2/d14 0 2024-02-15T18:27:03.315 INFO:tasks.workunit.client.1.smithi133.stdout:4/57: chown f0 1101 1 2024-02-15T18:27:03.315 INFO:tasks.workunit.client.1.smithi133.stdout:1/247: dread d6/f13 [0,4194304] 0 2024-02-15T18:27:03.316 INFO:tasks.workunit.client.1.smithi133.stdout:7/64: mknod d9/db/d16/c17 0 2024-02-15T18:27:03.317 INFO:tasks.workunit.client.1.smithi133.stdout:8/90: creat d3/de/f1d x:0 0 0 2024-02-15T18:27:03.321 INFO:tasks.workunit.client.1.smithi133.stdout:4/58: dread f0 [0,4194304] 0 2024-02-15T18:27:03.322 INFO:tasks.workunit.client.1.smithi133.stdout:5/101: symlink d17/d1e/l1f 0 2024-02-15T18:27:03.325 INFO:tasks.workunit.client.1.smithi133.stdout:9/101: rename d0/d8/d9/d12/f1a to d0/d8/d9/d12/f1c 0 2024-02-15T18:27:03.325 INFO:tasks.workunit.client.1.smithi133.stdout:1/248: mknod d6/d2a/c64 0 2024-02-15T18:27:03.327 INFO:tasks.workunit.client.1.smithi133.stdout:5/102: write d17/f1c [3655,57504] 0 2024-02-15T18:27:03.327 INFO:tasks.workunit.client.1.smithi133.stdout:5/103: chown cd 26793 1 2024-02-15T18:27:03.329 INFO:tasks.workunit.client.1.smithi133.stdout:1/249: rename d6/c47 to d6/d17/c65 0 2024-02-15T18:27:03.329 INFO:tasks.workunit.client.1.smithi133.stdout:1/250: read - d6/d2a/f48 zero size 2024-02-15T18:27:03.332 INFO:tasks.workunit.client.1.smithi133.stdout:2/181: dwrite d7/d18/f40 [0,4194304] 0 2024-02-15T18:27:03.332 INFO:tasks.workunit.client.1.smithi133.stdout:5/104: unlink c12 0 2024-02-15T18:27:03.332 INFO:tasks.workunit.client.1.smithi133.stdout:2/182: read d7/f30 [3539198,69985] 0 2024-02-15T18:27:03.333 INFO:tasks.workunit.client.1.smithi133.stdout:1/251: rename d6/d1e/d41/f4e to d6/d1e/d41/f66 0 2024-02-15T18:27:03.333 INFO:tasks.workunit.client.1.smithi133.stdout:1/252: chown d6/d1e/d3a/f61 70 1 2024-02-15T18:27:03.335 INFO:tasks.workunit.client.1.smithi133.stdout:5/105: mkdir d17/d20 0 2024-02-15T18:27:03.336 INFO:tasks.workunit.client.1.smithi133.stdout:2/183: getdents d7/d2c/d31 0 2024-02-15T18:27:03.338 INFO:tasks.workunit.client.1.smithi133.stdout:5/106: link ff d17/d1e/f21 0 2024-02-15T18:27:03.344 INFO:tasks.workunit.client.0.smithi084.stdout:2/395: dwrite d3/f1b [4194304,4194304] 0 2024-02-15T18:27:03.344 INFO:tasks.workunit.client.0.smithi084.stdout:2/396: stat d3/d19/d36/c4c 0 2024-02-15T18:27:03.346 INFO:tasks.workunit.client.0.smithi084.stdout:2/397: symlink d3/d5/d1a/d1e/d4b/l80 0 2024-02-15T18:27:03.348 INFO:tasks.workunit.client.0.smithi084.stdout:1/369: dwrite d9/d54/d1b/d2c/d35/f73 [0,4194304] 0 2024-02-15T18:27:03.349 INFO:tasks.workunit.client.1.smithi133.stdout:0/142: dwrite d9/d1c/f1d [0,4194304] 0 2024-02-15T18:27:03.349 INFO:tasks.workunit.client.1.smithi133.stdout:0/143: fdatasync f6 0 2024-02-15T18:27:03.352 INFO:tasks.workunit.client.1.smithi133.stdout:0/144: write f6 [2006712,77678] 0 2024-02-15T18:27:03.352 INFO:tasks.workunit.client.1.smithi133.stdout:0/145: write f5 [868725,90391] 0 2024-02-15T18:27:03.356 INFO:tasks.workunit.client.1.smithi133.stdout:0/146: creat d9/d10/f35 x:0 0 0 2024-02-15T18:27:03.360 INFO:tasks.workunit.client.1.smithi133.stdout:0/147: creat d9/d28/f36 x:0 0 0 2024-02-15T18:27:03.361 INFO:tasks.workunit.client.1.smithi133.stdout:5/107: dread d17/f19 [0,4194304] 0 2024-02-15T18:27:03.375 INFO:tasks.workunit.client.1.smithi133.stdout:8/91: dwrite d3/de/f18 [0,4194304] 0 2024-02-15T18:27:03.375 INFO:tasks.workunit.client.1.smithi133.stdout:8/92: chown d3 33368 1 2024-02-15T18:27:03.377 INFO:tasks.workunit.client.1.smithi133.stdout:6/210: dwrite d0/f14 [0,4194304] 0 2024-02-15T18:27:03.377 INFO:tasks.workunit.client.1.smithi133.stdout:8/93: rename f2 to d3/d1c/f1e 0 2024-02-15T18:27:03.378 INFO:tasks.workunit.client.1.smithi133.stdout:1/253: dwrite d6/d17/f60 [0,4194304] 0 2024-02-15T18:27:03.378 INFO:tasks.workunit.client.1.smithi133.stdout:1/254: write d6/d17/f18 [8496507,42899] 0 2024-02-15T18:27:03.378 INFO:tasks.workunit.client.1.smithi133.stdout:6/211: stat d0/f27 0 2024-02-15T18:27:03.379 INFO:tasks.workunit.client.1.smithi133.stdout:4/59: dwrite d2/fd [0,4194304] 0 2024-02-15T18:27:03.379 INFO:tasks.workunit.client.1.smithi133.stdout:2/184: dwrite d7/f14 [0,4194304] 0 2024-02-15T18:27:03.379 INFO:tasks.workunit.client.0.smithi084.stdout:2/398: dwrite d3/d5/f21 [0,4194304] 0 2024-02-15T18:27:03.379 INFO:tasks.workunit.client.0.smithi084.stdout:1/370: dwrite d9/d54/d5c/f67 [0,4194304] 0 2024-02-15T18:27:03.379 INFO:tasks.workunit.client.0.smithi084.stdout:2/399: chown d3/d28/f45 1631 1 2024-02-15T18:27:03.379 INFO:tasks.workunit.client.0.smithi084.stdout:2/400: chown d3/d19/d36 821658055 1 2024-02-15T18:27:03.379 INFO:tasks.workunit.client.0.smithi084.stdout:2/401: chown d3/d5/f35 0 1 2024-02-15T18:27:03.382 INFO:tasks.workunit.client.1.smithi133.stdout:5/108: truncate fc 3130792 0 2024-02-15T18:27:03.382 INFO:tasks.workunit.client.0.smithi084.stdout:1/371: creat d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f84 x:0 0 0 2024-02-15T18:27:03.382 INFO:tasks.workunit.client.0.smithi084.stdout:1/372: readlink d9/d54/d1b/l46 0 2024-02-15T18:27:03.383 INFO:tasks.workunit.client.0.smithi084.stdout:8/428: sync 2024-02-15T18:27:03.383 INFO:tasks.workunit.client.0.smithi084.stdout:3/377: sync 2024-02-15T18:27:03.383 INFO:tasks.workunit.client.0.smithi084.stdout:6/423: sync 2024-02-15T18:27:03.383 INFO:tasks.workunit.client.0.smithi084.stdout:7/375: sync 2024-02-15T18:27:03.383 INFO:tasks.workunit.client.0.smithi084.stdout:7/376: chown df/f63 14828787 1 2024-02-15T18:27:03.383 INFO:tasks.workunit.client.0.smithi084.stdout:7/377: chown f4 0 1 2024-02-15T18:27:03.383 INFO:tasks.workunit.client.0.smithi084.stdout:5/486: sync 2024-02-15T18:27:03.385 INFO:tasks.workunit.client.0.smithi084.stdout:1/373: rename d9/d54/d1b/c2b to d9/d54/d1b/d2c/d4b/d63/c85 0 2024-02-15T18:27:03.387 INFO:tasks.workunit.client.0.smithi084.stdout:8/429: write db/d1a/d2b/f37 [1062321,64486] 0 2024-02-15T18:27:03.387 INFO:tasks.workunit.client.0.smithi084.stdout:8/430: write db/d1a/f5f [892072,120927] 0 2024-02-15T18:27:03.387 INFO:tasks.workunit.client.0.smithi084.stdout:6/424: unlink d14/d22/d25/d2f/d31/d30/d45/f86 0 2024-02-15T18:27:03.387 INFO:tasks.workunit.client.0.smithi084.stdout:3/378: symlink d8/d40/d58/l82 0 2024-02-15T18:27:03.388 INFO:tasks.workunit.client.0.smithi084.stdout:7/378: rmdir df/d1d/d44 39 2024-02-15T18:27:03.389 INFO:tasks.workunit.client.0.smithi084.stdout:5/487: creat d9/d5b/d7e/d92/f9e x:0 0 0 2024-02-15T18:27:03.389 INFO:tasks.workunit.client.0.smithi084.stdout:5/488: chown d9/da/d3d/d44/d55/d70/d84 22 1 2024-02-15T18:27:03.389 INFO:tasks.workunit.client.0.smithi084.stdout:5/489: chown d9/d23/c54 4 1 2024-02-15T18:27:03.390 INFO:tasks.workunit.client.0.smithi084.stdout:1/374: mknod d9/d54/d1b/d2c/c86 0 2024-02-15T18:27:03.390 INFO:tasks.workunit.client.1.smithi133.stdout:8/94: mkdir d3/d1f 0 2024-02-15T18:27:03.390 INFO:tasks.workunit.client.1.smithi133.stdout:4/60: mknod d2/d14/c15 0 2024-02-15T18:27:03.390 INFO:tasks.workunit.client.1.smithi133.stdout:1/255: mkdir d6/d32/d67 0 2024-02-15T18:27:03.390 INFO:tasks.workunit.client.1.smithi133.stdout:4/61: fdatasync d2/db/fe 0 2024-02-15T18:27:03.391 INFO:tasks.workunit.client.0.smithi084.stdout:1/375: write d9/d54/d1b/d2c/d4b/d4c/d79/f2f [2124796,88525] 0 2024-02-15T18:27:03.391 INFO:tasks.workunit.client.0.smithi084.stdout:1/376: stat d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f84 0 2024-02-15T18:27:03.391 INFO:tasks.workunit.client.0.smithi084.stdout:8/431: mknod db/dd/d13/d42/c8f 0 2024-02-15T18:27:03.391 INFO:tasks.workunit.client.0.smithi084.stdout:6/425: creat d14/d22/d25/d2f/d31/d3f/d4a/f8d x:0 0 0 2024-02-15T18:27:03.392 INFO:tasks.workunit.client.1.smithi133.stdout:8/95: creat d3/d1f/f20 x:0 0 0 2024-02-15T18:27:03.392 INFO:tasks.workunit.client.1.smithi133.stdout:8/96: fsync d3/f14 0 2024-02-15T18:27:03.393 INFO:tasks.workunit.client.0.smithi084.stdout:3/379: creat d8/d40/d58/f83 x:0 0 0 2024-02-15T18:27:03.393 INFO:tasks.workunit.client.0.smithi084.stdout:3/380: readlink d8/l9 0 2024-02-15T18:27:03.394 INFO:tasks.workunit.client.0.smithi084.stdout:7/379: mknod df/d1d/d1a/d4d/d59/c6b 0 2024-02-15T18:27:03.394 INFO:tasks.workunit.client.0.smithi084.stdout:7/380: chown df/d1d/c1e 14 1 2024-02-15T18:27:03.394 INFO:tasks.workunit.client.1.smithi133.stdout:6/212: creat d0/d3b/f45 x:0 0 0 2024-02-15T18:27:03.395 INFO:tasks.workunit.client.1.smithi133.stdout:4/62: rmdir d2/db 39 2024-02-15T18:27:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:7/381: rmdir df/d1d/d44 39 2024-02-15T18:27:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:1/377: mknod d9/d54/d32/d5b/d69/c87 0 2024-02-15T18:27:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:8/432: mkdir db/dd/d13/d42/d90 0 2024-02-15T18:27:03.396 INFO:tasks.workunit.client.0.smithi084.stdout:8/433: truncate db/d1a/f49 1043941 0 2024-02-15T18:27:03.396 INFO:tasks.workunit.client.1.smithi133.stdout:2/185: truncate d7/d18/f40 1673473 0 2024-02-15T18:27:03.400 INFO:tasks.workunit.client.0.smithi084.stdout:1/378: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/c88 0 2024-02-15T18:27:03.400 INFO:tasks.workunit.client.0.smithi084.stdout:8/434: creat db/d3f/d59/d69/f91 x:0 0 0 2024-02-15T18:27:03.401 INFO:tasks.workunit.client.0.smithi084.stdout:5/490: dread d9/d23/f2a [0,4194304] 0 2024-02-15T18:27:03.402 INFO:tasks.workunit.client.1.smithi133.stdout:6/213: getdents d0/db/d1c 0 2024-02-15T18:27:03.404 INFO:tasks.workunit.client.1.smithi133.stdout:4/63: read d2/db/fe [1706978,127821] 0 2024-02-15T18:27:03.404 INFO:tasks.workunit.client.1.smithi133.stdout:8/97: rename d3/d7/l19 to d3/d1f/l21 0 2024-02-15T18:27:03.405 INFO:tasks.workunit.client.0.smithi084.stdout:8/435: mknod db/d1a/d2b/c92 0 2024-02-15T18:27:03.405 INFO:tasks.workunit.client.0.smithi084.stdout:8/436: read - db/d3f/d59/f60 zero size 2024-02-15T18:27:03.405 INFO:tasks.workunit.client.0.smithi084.stdout:2/402: dwrite d3/d5/f35 [0,4194304] 0 2024-02-15T18:27:03.405 INFO:tasks.workunit.client.0.smithi084.stdout:2/403: chown d3/d19/d36/c4c 124759 1 2024-02-15T18:27:03.407 INFO:tasks.workunit.client.0.smithi084.stdout:6/426: dread fc [0,4194304] 0 2024-02-15T18:27:03.407 INFO:tasks.workunit.client.0.smithi084.stdout:6/427: dread - d14/f6f zero size 2024-02-15T18:27:03.407 INFO:tasks.workunit.client.0.smithi084.stdout:6/428: dread - d14/d22/d25/d41/f69 zero size 2024-02-15T18:27:03.407 INFO:tasks.workunit.client.0.smithi084.stdout:6/429: chown d14/d22/d25/d2f/d31/c4e 28 1 2024-02-15T18:27:03.410 INFO:tasks.workunit.client.1.smithi133.stdout:4/64: symlink d2/d5/l16 0 2024-02-15T18:27:03.410 INFO:tasks.workunit.client.0.smithi084.stdout:8/437: mknod db/dd/d1f/d3e/c93 0 2024-02-15T18:27:03.410 INFO:tasks.workunit.client.0.smithi084.stdout:8/438: dread - db/d3f/d59/f60 zero size 2024-02-15T18:27:03.410 INFO:tasks.workunit.client.0.smithi084.stdout:8/439: truncate db/f77 686180 0 2024-02-15T18:27:03.411 INFO:tasks.workunit.client.0.smithi084.stdout:7/382: dread f4 [4194304,4194304] 0 2024-02-15T18:27:03.411 INFO:tasks.workunit.client.0.smithi084.stdout:5/491: link d9/d35/d65/f56 d9/d5f/d68/d9a/d7a/f9f 0 2024-02-15T18:27:03.411 INFO:tasks.workunit.client.0.smithi084.stdout:5/492: fdatasync d9/da/d3d/f91 0 2024-02-15T18:27:03.411 INFO:tasks.workunit.client.0.smithi084.stdout:6/430: link d14/d22/d25/d2f/d31/d3f/d4a/l7b d14/d22/d25/d2f/d31/d30/d4f/d7f/l8e 0 2024-02-15T18:27:03.413 INFO:tasks.workunit.client.1.smithi133.stdout:4/65: rename d2/d5/l13 to d2/d5/l17 0 2024-02-15T18:27:03.414 INFO:tasks.workunit.client.0.smithi084.stdout:8/440: rename db/dd/d13/c32 to db/dd/d13/d42/d79/c94 0 2024-02-15T18:27:03.414 INFO:tasks.workunit.client.0.smithi084.stdout:7/383: rmdir df 39 2024-02-15T18:27:03.415 INFO:tasks.workunit.client.0.smithi084.stdout:5/493: truncate d9/d35/d65/f56 5128649 0 2024-02-15T18:27:03.415 INFO:tasks.workunit.client.0.smithi084.stdout:5/494: fsync d9/d5f/d68/d9a/f60 0 2024-02-15T18:27:03.415 INFO:tasks.workunit.client.0.smithi084.stdout:5/495: chown d9/d5f/d68/f83 60838 1 2024-02-15T18:27:03.416 INFO:tasks.workunit.client.1.smithi133.stdout:4/66: rename d2/db/fc to d2/db/f18 0 2024-02-15T18:27:03.417 INFO:tasks.workunit.client.1.smithi133.stdout:9/102: dwrite d0/f5 [0,4194304] 0 2024-02-15T18:27:03.418 INFO:tasks.workunit.client.0.smithi084.stdout:7/384: truncate df/d1d/d1a/f2d 178481 0 2024-02-15T18:27:03.419 INFO:tasks.workunit.client.0.smithi084.stdout:5/496: mknod d9/d23/ca0 0 2024-02-15T18:27:03.419 INFO:tasks.workunit.client.0.smithi084.stdout:5/497: stat d9/d23/c54 0 2024-02-15T18:27:03.420 INFO:tasks.workunit.client.0.smithi084.stdout:7/385: unlink df/f1b 0 2024-02-15T18:27:03.421 INFO:tasks.workunit.client.0.smithi084.stdout:7/386: read - df/d1d/d1a/d4b/f57 zero size 2024-02-15T18:27:03.423 INFO:tasks.workunit.client.0.smithi084.stdout:2/404: dread d3/f11 [0,4194304] 0 2024-02-15T18:27:03.423 INFO:tasks.workunit.client.0.smithi084.stdout:7/387: rmdir df/d1d/d1a/d4d/d55 39 2024-02-15T18:27:03.423 INFO:tasks.workunit.client.1.smithi133.stdout:9/103: symlink d0/d8/d9/l1d 0 2024-02-15T18:27:03.423 INFO:tasks.workunit.client.1.smithi133.stdout:9/104: write d0/d8/d9/d12/f1b [964501,28346] 0 2024-02-15T18:27:03.424 INFO:tasks.workunit.client.1.smithi133.stdout:9/105: rename d0/d8 to d0/d8/d9/d12/d1e 22 2024-02-15T18:27:03.424 INFO:tasks.workunit.client.0.smithi084.stdout:2/405: creat d3/d5/d1a/f81 x:0 0 0 2024-02-15T18:27:03.424 INFO:tasks.workunit.client.1.smithi133.stdout:2/186: dread d7/f15 [0,4194304] 0 2024-02-15T18:27:03.424 INFO:tasks.workunit.client.1.smithi133.stdout:2/187: readlink d7/l25 0 2024-02-15T18:27:03.425 INFO:tasks.workunit.client.0.smithi084.stdout:7/388: symlink df/d1d/l6c 0 2024-02-15T18:27:03.425 INFO:tasks.workunit.client.1.smithi133.stdout:9/106: symlink d0/l1f 0 2024-02-15T18:27:03.425 INFO:tasks.workunit.client.1.smithi133.stdout:9/107: chown d0/f7 120454557 1 2024-02-15T18:27:03.425 INFO:tasks.workunit.client.1.smithi133.stdout:5/109: write fc [2145427,5232] 0 2024-02-15T18:27:03.426 INFO:tasks.workunit.client.0.smithi084.stdout:2/406: mkdir d3/d5/d1a/d1e/d30/d82 0 2024-02-15T18:27:03.426 INFO:tasks.workunit.client.0.smithi084.stdout:2/407: stat d3/d5e 0 2024-02-15T18:27:03.426 INFO:tasks.workunit.client.0.smithi084.stdout:2/408: truncate d3/d5/d1a/f4e 4960654 0 2024-02-15T18:27:03.427 INFO:tasks.workunit.client.1.smithi133.stdout:2/188: write d7/db/f21 [511471,113403] 0 2024-02-15T18:27:03.427 INFO:tasks.workunit.client.1.smithi133.stdout:2/189: chown d7/d18/f40 56507 1 2024-02-15T18:27:03.428 INFO:tasks.workunit.client.1.smithi133.stdout:5/110: read d17/d1e/f21 [638286,125263] 0 2024-02-15T18:27:03.428 INFO:tasks.workunit.client.1.smithi133.stdout:2/190: mknod d7/db/c42 0 2024-02-15T18:27:03.428 INFO:tasks.workunit.client.1.smithi133.stdout:2/191: read d7/f20 [1580265,10143] 0 2024-02-15T18:27:03.429 INFO:tasks.workunit.client.0.smithi084.stdout:2/409: mknod d3/d19/d24/d3e/c83 0 2024-02-15T18:27:03.430 INFO:tasks.workunit.client.0.smithi084.stdout:2/410: unlink d3/d19/d24/f2f 0 2024-02-15T18:27:03.432 INFO:tasks.workunit.client.0.smithi084.stdout:2/411: rmdir d3/d5e 39 2024-02-15T18:27:03.437 INFO:tasks.workunit.client.1.smithi133.stdout:2/192: write d7/f16 [1352041,35787] 0 2024-02-15T18:27:03.438 INFO:tasks.workunit.client.0.smithi084.stdout:7/389: dread df/d1d/d40/d48/f45 [0,4194304] 0 2024-02-15T18:27:03.438 INFO:tasks.workunit.client.0.smithi084.stdout:3/381: dwrite d8/d22/f34 [4194304,4194304] 0 2024-02-15T18:27:03.440 INFO:tasks.workunit.client.0.smithi084.stdout:1/379: dwrite d9/d54/d1b/d38/f4a [0,4194304] 0 2024-02-15T18:27:03.440 INFO:tasks.workunit.client.0.smithi084.stdout:2/412: write d3/f1b [5869255,6003] 0 2024-02-15T18:27:03.441 INFO:tasks.workunit.client.1.smithi133.stdout:1/256: dwrite d6/d1e/f27 [0,4194304] 0 2024-02-15T18:27:03.441 INFO:tasks.workunit.client.1.smithi133.stdout:1/257: readlink d6/d17/l4f 0 2024-02-15T18:27:03.441 INFO:tasks.workunit.client.1.smithi133.stdout:5/111: dread f15 [0,4194304] 0 2024-02-15T18:27:03.445 INFO:tasks.workunit.client.1.smithi133.stdout:5/112: creat d17/d20/f22 x:0 0 0 2024-02-15T18:27:03.445 INFO:tasks.workunit.client.1.smithi133.stdout:5/113: fsync ff 0 2024-02-15T18:27:03.449 INFO:tasks.workunit.client.0.smithi084.stdout:1/380: dread d9/d54/d1b/f5e [0,4194304] 0 2024-02-15T18:27:03.451 INFO:tasks.workunit.client.1.smithi133.stdout:2/193: fsync d7/f16 0 2024-02-15T18:27:03.453 INFO:tasks.workunit.client.1.smithi133.stdout:6/214: dwrite d0/f2d [0,4194304] 0 2024-02-15T18:27:03.453 INFO:tasks.workunit.client.1.smithi133.stdout:6/215: fsync d0/d5/f1b 0 2024-02-15T18:27:03.453 INFO:tasks.workunit.client.1.smithi133.stdout:6/216: truncate d0/db/f3f 916929 0 2024-02-15T18:27:03.454 INFO:tasks.workunit.client.0.smithi084.stdout:5/498: rename d9/d5f/d68/d9a/d7a to d9/da/d3d/d44/d55/d70/d84/da1 0 2024-02-15T18:27:03.456 INFO:tasks.workunit.client.1.smithi133.stdout:9/108: dwrite d0/f7 [0,4194304] 0 2024-02-15T18:27:03.456 INFO:tasks.workunit.client.0.smithi084.stdout:8/441: getdents db/d3f/d59/d69 0 2024-02-15T18:27:03.457 INFO:tasks.workunit.client.1.smithi133.stdout:2/194: write d7/ff [1224813,97694] 0 2024-02-15T18:27:03.457 INFO:tasks.workunit.client.1.smithi133.stdout:2/195: write d7/f26 [508061,98396] 0 2024-02-15T18:27:03.458 INFO:tasks.workunit.client.1.smithi133.stdout:6/217: symlink d0/db/d1c/d40/l46 0 2024-02-15T18:27:03.458 INFO:tasks.workunit.client.0.smithi084.stdout:6/431: rmdir d14/d22/d25/d2f/d31/d3f 39 2024-02-15T18:27:03.461 INFO:tasks.workunit.client.1.smithi133.stdout:9/109: creat d0/f20 x:0 0 0 2024-02-15T18:27:03.466 INFO:tasks.workunit.client.1.smithi133.stdout:6/218: read d0/f10 [3545364,3027] 0 2024-02-15T18:27:03.468 INFO:tasks.workunit.client.1.smithi133.stdout:6/219: creat d0/db/d29/f47 x:0 0 0 2024-02-15T18:27:03.469 INFO:tasks.workunit.client.1.smithi133.stdout:6/220: mkdir d0/db/d29/d34/d48 0 2024-02-15T18:27:03.470 INFO:tasks.workunit.client.0.smithi084.stdout:1/381: mkdir d9/d54/d1b/d2c/d4b/d7a/d89 0 2024-02-15T18:27:03.471 INFO:tasks.workunit.client.1.smithi133.stdout:6/221: creat d0/db/d29/d34/d48/f49 x:0 0 0 2024-02-15T18:27:03.471 INFO:tasks.workunit.client.1.smithi133.stdout:6/222: creat d0/d5/f4a x:0 0 0 2024-02-15T18:27:03.472 INFO:tasks.workunit.client.0.smithi084.stdout:2/413: rename d3/d5/d1a/d1e/d4b/c51 to d3/d5/d1a/c84 0 2024-02-15T18:27:03.473 INFO:tasks.workunit.client.0.smithi084.stdout:5/499: link d9/d35/c49 d9/da/d3d/d44/d55/d70/d84/da1/ca2 0 2024-02-15T18:27:03.473 INFO:tasks.workunit.client.0.smithi084.stdout:5/500: chown d9/d5f/d68/d9a/d8d 2030517 1 2024-02-15T18:27:03.474 INFO:tasks.workunit.client.0.smithi084.stdout:8/442: mknod db/dd/d13/d42/d90/c95 0 2024-02-15T18:27:03.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/432: fsync d14/d22/f64 0 2024-02-15T18:27:03.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/433: fsync d14/d22/d25/d2f/d31/d3f/f74 0 2024-02-15T18:27:03.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/434: fdatasync d14/d22/d25/d2f/d31/f27 0 2024-02-15T18:27:03.475 INFO:tasks.workunit.client.0.smithi084.stdout:6/435: write d14/d22/d25/d41/f7d [59573,27329] 0 2024-02-15T18:27:03.475 INFO:tasks.workunit.client.0.smithi084.stdout:1/382: creat d9/d54/d1b/d2c/d35/f8a x:0 0 0 2024-02-15T18:27:03.476 INFO:tasks.workunit.client.0.smithi084.stdout:5/501: creat d9/da/d3d/d44/d55/d70/fa3 x:0 0 0 2024-02-15T18:27:03.477 INFO:tasks.workunit.client.0.smithi084.stdout:2/414: read d3/d5/d1a/d1e/f61 [3126031,96104] 0 2024-02-15T18:27:03.478 INFO:tasks.workunit.client.0.smithi084.stdout:8/443: unlink db/dd/l15 0 2024-02-15T18:27:03.482 INFO:tasks.workunit.client.0.smithi084.stdout:3/382: dwrite d8/d40/d58/d80/f3c [0,4194304] 0 2024-02-15T18:27:03.482 INFO:tasks.workunit.client.0.smithi084.stdout:5/502: getdents d9/d5f 0 2024-02-15T18:27:03.482 INFO:tasks.workunit.client.0.smithi084.stdout:1/383: link d9/d54/l74 d9/d54/d7f/l8b 0 2024-02-15T18:27:03.483 INFO:tasks.workunit.client.0.smithi084.stdout:6/436: write d14/d22/d25/d2f/d31/d3f/f42 [7752084,95565] 0 2024-02-15T18:27:03.483 INFO:tasks.workunit.client.1.smithi133.stdout:5/114: dwrite f2 [4194304,4194304] 0 2024-02-15T18:27:03.483 INFO:tasks.workunit.client.1.smithi133.stdout:5/115: chown l1 8003034 1 2024-02-15T18:27:03.483 INFO:tasks.workunit.client.1.smithi133.stdout:5/116: chown d17/d20/f22 160 1 2024-02-15T18:27:03.483 INFO:tasks.workunit.client.1.smithi133.stdout:5/117: fdatasync d17/f19 0 2024-02-15T18:27:03.484 INFO:tasks.workunit.client.1.smithi133.stdout:5/118: creat d17/d20/f23 x:0 0 0 2024-02-15T18:27:03.485 INFO:tasks.workunit.client.0.smithi084.stdout:5/503: rmdir d9/d35/d65/d8c 39 2024-02-15T18:27:03.487 INFO:tasks.workunit.client.1.smithi133.stdout:5/119: symlink d17/d1e/l24 0 2024-02-15T18:27:03.488 INFO:tasks.workunit.client.0.smithi084.stdout:1/384: rmdir d9/d54/d1b/d2c/d4b/d7a 39 2024-02-15T18:27:03.488 INFO:tasks.workunit.client.0.smithi084.stdout:1/385: readlink d9/d54/d32/l5f 0 2024-02-15T18:27:03.489 INFO:tasks.workunit.client.0.smithi084.stdout:7/390: dwrite df/d1d/d40/d48/f5c [0,4194304] 0 2024-02-15T18:27:03.489 INFO:tasks.workunit.client.1.smithi133.stdout:1/258: dwrite d6/d1e/f23 [0,4194304] 0 2024-02-15T18:27:03.489 INFO:tasks.workunit.client.0.smithi084.stdout:6/437: truncate d14/d22/d25/d2f/d31/d30/f6b 2862974 0 2024-02-15T18:27:03.490 INFO:tasks.workunit.client.0.smithi084.stdout:3/383: dread d8/f12 [0,4194304] 0 2024-02-15T18:27:03.490 INFO:tasks.workunit.client.0.smithi084.stdout:3/384: write d8/d40/d58/d80/f2b [4837978,26390] 0 2024-02-15T18:27:03.492 INFO:tasks.workunit.client.0.smithi084.stdout:1/386: unlink d9/d54/d32/f49 0 2024-02-15T18:27:03.493 INFO:tasks.workunit.client.1.smithi133.stdout:9/110: dwrite d0/d8/d10/f11 [0,4194304] 0 2024-02-15T18:27:03.494 INFO:tasks.workunit.client.0.smithi084.stdout:4/436: sync 2024-02-15T18:27:03.494 INFO:tasks.workunit.client.0.smithi084.stdout:0/438: sync 2024-02-15T18:27:03.494 INFO:tasks.workunit.client.0.smithi084.stdout:9/482: sync 2024-02-15T18:27:03.494 INFO:tasks.workunit.client.0.smithi084.stdout:4/437: write d2/f35 [930021,16299] 0 2024-02-15T18:27:03.494 INFO:tasks.workunit.client.0.smithi084.stdout:5/504: dread d9/da/f99 [0,4194304] 0 2024-02-15T18:27:03.494 INFO:tasks.workunit.client.0.smithi084.stdout:5/505: rename d9 to d9/da/d3d/d44/da4 22 2024-02-15T18:27:03.495 INFO:tasks.workunit.client.0.smithi084.stdout:5/506: dread - d9/da/d3d/f50 zero size 2024-02-15T18:27:03.495 INFO:tasks.workunit.client.0.smithi084.stdout:5/507: stat d9/da/d3d/d44/d55/d70/d84 0 2024-02-15T18:27:03.495 INFO:tasks.workunit.client.1.smithi133.stdout:6/223: dread d0/d5/f1b [0,4194304] 0 2024-02-15T18:27:03.496 INFO:tasks.workunit.client.1.smithi133.stdout:9/111: unlink d0/d8/d9/d12/f1c 0 2024-02-15T18:27:03.497 INFO:tasks.workunit.client.0.smithi084.stdout:5/508: write d9/da/d3d/d44/d55/d70/d84/f98 [386183,74741] 0 2024-02-15T18:27:03.497 INFO:tasks.workunit.client.0.smithi084.stdout:6/438: symlink d14/d22/d25/d2f/d31/d30/d45/l8f 0 2024-02-15T18:27:03.498 INFO:tasks.workunit.client.1.smithi133.stdout:6/224: creat d0/f4b x:0 0 0 2024-02-15T18:27:03.498 INFO:tasks.workunit.client.1.smithi133.stdout:6/225: readlink d0/d5/l16 0 2024-02-15T18:27:03.501 INFO:tasks.workunit.client.1.smithi133.stdout:6/226: mknod d0/db/d1c/d40/c4c 0 2024-02-15T18:27:03.502 INFO:tasks.workunit.client.1.smithi133.stdout:6/227: mknod d0/db/c4d 0 2024-02-15T18:27:03.502 INFO:tasks.workunit.client.1.smithi133.stdout:6/228: stat d0/db/d21 0 2024-02-15T18:27:03.504 INFO:tasks.workunit.client.0.smithi084.stdout:1/387: truncate d9/d54/d1b/f5e 345517 0 2024-02-15T18:27:03.504 INFO:tasks.workunit.client.0.smithi084.stdout:5/509: creat d9/d5b/d79/fa5 x:0 0 0 2024-02-15T18:27:03.504 INFO:tasks.workunit.client.0.smithi084.stdout:0/439: mkdir d0/d4/d3a/d82 0 2024-02-15T18:27:03.505 INFO:tasks.workunit.client.0.smithi084.stdout:9/483: creat d4/d2b/d3c/d20/d43/f99 x:0 0 0 2024-02-15T18:27:03.508 INFO:tasks.workunit.client.1.smithi133.stdout:6/229: dread d0/fd [0,4194304] 0 2024-02-15T18:27:03.509 INFO:tasks.workunit.client.1.smithi133.stdout:6/230: readlink d0/db/d29/l42 0 2024-02-15T18:27:03.510 INFO:tasks.workunit.client.1.smithi133.stdout:2/196: truncate d7/f26 430432 0 2024-02-15T18:27:03.510 INFO:tasks.workunit.client.0.smithi084.stdout:7/391: dread f5 [0,4194304] 0 2024-02-15T18:27:03.510 INFO:tasks.workunit.client.0.smithi084.stdout:2/415: dwrite d3/d28/f45 [8388608,4194304] 0 2024-02-15T18:27:03.513 INFO:tasks.workunit.client.1.smithi133.stdout:5/120: getdents d17/d20 0 2024-02-15T18:27:03.514 INFO:tasks.workunit.client.1.smithi133.stdout:6/231: mknod d0/d5/d37/c4e 0 2024-02-15T18:27:03.514 INFO:tasks.workunit.client.1.smithi133.stdout:6/232: chown d0/db/c4d 23 1 2024-02-15T18:27:03.514 INFO:tasks.workunit.client.1.smithi133.stdout:2/197: getdents d7/db 0 2024-02-15T18:27:03.516 INFO:tasks.workunit.client.1.smithi133.stdout:5/121: symlink d17/l25 0 2024-02-15T18:27:03.517 INFO:tasks.workunit.client.1.smithi133.stdout:2/198: creat d7/db/f43 x:0 0 0 2024-02-15T18:27:03.518 INFO:tasks.workunit.client.1.smithi133.stdout:6/233: creat d0/db/f4f x:0 0 0 2024-02-15T18:27:03.518 INFO:tasks.workunit.client.0.smithi084.stdout:7/392: dread df/d1d/d40/d48/f34 [0,4194304] 0 2024-02-15T18:27:03.519 INFO:tasks.workunit.client.1.smithi133.stdout:2/199: fsync d7/db/f2d 0 2024-02-15T18:27:03.521 INFO:tasks.workunit.client.0.smithi084.stdout:1/388: getdents d9/d54/d1b/d38 0 2024-02-15T18:27:03.521 INFO:tasks.workunit.client.0.smithi084.stdout:5/510: creat d9/d5f/d68/d9a/fa6 x:0 0 0 2024-02-15T18:27:03.521 INFO:tasks.workunit.client.0.smithi084.stdout:2/416: unlink d3/d5/l7a 0 2024-02-15T18:27:03.522 INFO:tasks.workunit.client.0.smithi084.stdout:0/440: dread d0/d4/d1b/d26/f2d [0,4194304] 0 2024-02-15T18:27:03.523 INFO:tasks.workunit.client.1.smithi133.stdout:2/200: dread d7/f30 [0,4194304] 0 2024-02-15T18:27:03.523 INFO:tasks.workunit.client.1.smithi133.stdout:6/234: write d0/f2d [2083395,81061] 0 2024-02-15T18:27:03.523 INFO:tasks.workunit.client.1.smithi133.stdout:6/235: chown d0/db/f25 251692760 1 2024-02-15T18:27:03.523 INFO:tasks.workunit.client.1.smithi133.stdout:6/236: chown d0/db/d21/c3e 3187 1 2024-02-15T18:27:03.523 INFO:tasks.workunit.client.0.smithi084.stdout:7/393: creat df/d1d/d1a/d4b/d69/f6d x:0 0 0 2024-02-15T18:27:03.524 INFO:tasks.workunit.client.1.smithi133.stdout:2/201: unlink d7/db/f2d 0 2024-02-15T18:27:03.524 INFO:tasks.workunit.client.1.smithi133.stdout:2/202: fsync d7/f30 0 2024-02-15T18:27:03.524 INFO:tasks.workunit.client.1.smithi133.stdout:2/203: truncate d7/d2c/d31/f38 1784419 0 2024-02-15T18:27:03.525 INFO:tasks.workunit.client.0.smithi084.stdout:5/511: truncate d9/fe 2374865 0 2024-02-15T18:27:03.525 INFO:tasks.workunit.client.0.smithi084.stdout:2/417: getdents d3/d19/d36 0 2024-02-15T18:27:03.525 INFO:tasks.workunit.client.1.smithi133.stdout:6/237: dread - d0/f26 zero size 2024-02-15T18:27:03.525 INFO:tasks.workunit.client.1.smithi133.stdout:6/238: stat d0/db/d1c/c2c 0 2024-02-15T18:27:03.526 INFO:tasks.workunit.client.0.smithi084.stdout:0/441: mkdir d0/d2f/d3f/d4f/d61/d79/d83 0 2024-02-15T18:27:03.526 INFO:tasks.workunit.client.1.smithi133.stdout:6/239: creat d0/f50 x:0 0 0 2024-02-15T18:27:03.526 INFO:tasks.workunit.client.0.smithi084.stdout:2/418: creat d3/d28/f85 x:0 0 0 2024-02-15T18:27:03.528 INFO:tasks.workunit.client.1.smithi133.stdout:2/204: unlink d7/db/c11 0 2024-02-15T18:27:03.528 INFO:tasks.workunit.client.0.smithi084.stdout:0/442: rmdir d0/d4/d1b/d26/d43 39 2024-02-15T18:27:03.528 INFO:tasks.workunit.client.0.smithi084.stdout:0/443: fdatasync d0/d4/d1b/f3c 0 2024-02-15T18:27:03.529 INFO:tasks.workunit.client.0.smithi084.stdout:2/419: creat d3/d28/f86 x:0 0 0 2024-02-15T18:27:03.529 INFO:tasks.workunit.client.0.smithi084.stdout:7/394: write df/d1d/f18 [2933701,33006] 0 2024-02-15T18:27:03.529 INFO:tasks.workunit.client.0.smithi084.stdout:0/444: creat d0/d4/d1b/d26/f84 x:0 0 0 2024-02-15T18:27:03.529 INFO:tasks.workunit.client.0.smithi084.stdout:1/389: write d9/d54/d1b/d2c/d4b/d4c/f5a [3336553,30076] 0 2024-02-15T18:27:03.529 INFO:tasks.workunit.client.1.smithi133.stdout:6/240: rename d0/db/d1c/d40/c44 to d0/d5/c51 0 2024-02-15T18:27:03.531 INFO:tasks.workunit.client.1.smithi133.stdout:6/241: mkdir d0/d3b/d52 0 2024-02-15T18:27:03.531 INFO:tasks.workunit.client.0.smithi084.stdout:3/385: dwrite d8/d40/d43/f4d [0,4194304] 0 2024-02-15T18:27:03.531 INFO:tasks.workunit.client.0.smithi084.stdout:3/386: chown d8/d22/c6f 508374 1 2024-02-15T18:27:03.531 INFO:tasks.workunit.client.0.smithi084.stdout:2/420: rename d3/d19/d36/c4c to d3/d5/d1a/c87 0 2024-02-15T18:27:03.531 INFO:tasks.workunit.client.0.smithi084.stdout:0/445: write d0/d4/d1b/f3e [783529,85362] 0 2024-02-15T18:27:03.531 INFO:tasks.workunit.client.0.smithi084.stdout:0/446: dread - d0/d39/f78 zero size 2024-02-15T18:27:03.531 INFO:tasks.workunit.client.0.smithi084.stdout:9/484: dwrite d4/d2b/d3c/d20/d75/f7a [0,4194304] 0 2024-02-15T18:27:03.532 INFO:tasks.workunit.client.1.smithi133.stdout:6/242: readlink d0/la 0 2024-02-15T18:27:03.532 INFO:tasks.workunit.client.0.smithi084.stdout:1/390: mknod d9/d54/d1b/d38/d4d/c8c 0 2024-02-15T18:27:03.532 INFO:tasks.workunit.client.0.smithi084.stdout:1/391: write d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f84 [1011629,28221] 0 2024-02-15T18:27:03.534 INFO:tasks.workunit.client.0.smithi084.stdout:2/421: creat d3/d5/d1a/d1e/d30/f88 x:0 0 0 2024-02-15T18:27:03.534 INFO:tasks.workunit.client.0.smithi084.stdout:2/422: read - d3/d19/d24/d3e/f55 zero size 2024-02-15T18:27:03.534 INFO:tasks.workunit.client.0.smithi084.stdout:7/395: dread df/f1c [0,4194304] 0 2024-02-15T18:27:03.535 INFO:tasks.workunit.client.1.smithi133.stdout:9/112: dwrite d0/d8/d9/ff [4194304,4194304] 0 2024-02-15T18:27:03.536 INFO:tasks.workunit.client.0.smithi084.stdout:6/439: dwrite d14/d22/d25/d2f/d31/f79 [4194304,4194304] 0 2024-02-15T18:27:03.536 INFO:tasks.workunit.client.1.smithi133.stdout:6/243: dread d0/fd [0,4194304] 0 2024-02-15T18:27:03.536 INFO:tasks.workunit.client.1.smithi133.stdout:6/244: fsync d0/db/d29/d34/d48/f49 0 2024-02-15T18:27:03.539 INFO:tasks.workunit.client.1.smithi133.stdout:2/205: dread d7/f13 [0,4194304] 0 2024-02-15T18:27:03.539 INFO:tasks.workunit.client.0.smithi084.stdout:3/387: dread d8/f1b [0,4194304] 0 2024-02-15T18:27:03.541 INFO:tasks.workunit.client.0.smithi084.stdout:5/512: read d9/fe [1260205,60426] 0 2024-02-15T18:27:03.543 INFO:tasks.workunit.client.0.smithi084.stdout:9/485: symlink d4/l9a 0 2024-02-15T18:27:03.544 INFO:tasks.workunit.client.1.smithi133.stdout:9/113: rmdir d0/d8/d9 39 2024-02-15T18:27:03.546 INFO:tasks.workunit.client.0.smithi084.stdout:0/447: symlink d0/d4/d1b/d26/d43/d7e/l85 0 2024-02-15T18:27:03.546 INFO:tasks.workunit.client.1.smithi133.stdout:6/245: mkdir d0/d3b/d53 0 2024-02-15T18:27:03.546 INFO:tasks.workunit.client.1.smithi133.stdout:6/246: fdatasync d0/db/d29/d34/d48/f49 0 2024-02-15T18:27:03.547 INFO:tasks.workunit.client.0.smithi084.stdout:9/486: read d4/d2b/d3c/d20/f52 [529099,127484] 0 2024-02-15T18:27:03.549 INFO:tasks.workunit.client.0.smithi084.stdout:1/392: rename d9/d54/d76/f78 to d9/d54/d32/d5b/f8d 0 2024-02-15T18:27:03.549 INFO:tasks.workunit.client.0.smithi084.stdout:7/396: creat df/f6e x:0 0 0 2024-02-15T18:27:03.550 INFO:tasks.workunit.client.1.smithi133.stdout:9/114: link d0/f6 d0/d8/d9/d12/f21 0 2024-02-15T18:27:03.553 INFO:tasks.workunit.client.0.smithi084.stdout:6/440: link d14/c3d d14/d22/d25/d2f/d31/d30/d45/d54/c90 0 2024-02-15T18:27:03.555 INFO:tasks.workunit.client.0.smithi084.stdout:6/441: read f9 [57033,104140] 0 2024-02-15T18:27:03.558 INFO:tasks.workunit.client.1.smithi133.stdout:1/259: dwrite d6/d1e/f23 [4194304,4194304] 0 2024-02-15T18:27:03.559 INFO:tasks.workunit.client.0.smithi084.stdout:3/388: link d8/d40/d58/d80/f2b d8/d40/d58/d80/f84 0 2024-02-15T18:27:03.560 INFO:tasks.workunit.client.0.smithi084.stdout:5/513: mkdir d9/d5f/da7 0 2024-02-15T18:27:03.560 INFO:tasks.workunit.client.0.smithi084.stdout:5/514: fsync d9/da/d3d/d44/d55/d70/d84/da1/f81 0 2024-02-15T18:27:03.560 INFO:tasks.workunit.client.0.smithi084.stdout:5/515: chown d9/da/d3d/f4f 11115644 1 2024-02-15T18:27:03.560 INFO:tasks.workunit.client.0.smithi084.stdout:6/442: read d14/f38 [392007,72268] 0 2024-02-15T18:27:03.560 INFO:tasks.workunit.client.0.smithi084.stdout:9/487: symlink d4/d2b/d3c/d20/d43/d15/d4f/l9b 0 2024-02-15T18:27:03.560 INFO:tasks.workunit.client.0.smithi084.stdout:9/488: read d4/d2b/d3c/d20/d43/d15/f40 [268967,27961] 0 2024-02-15T18:27:03.561 INFO:tasks.workunit.client.1.smithi133.stdout:1/260: truncate d6/d1e/f27 2266531 0 2024-02-15T18:27:03.561 INFO:tasks.workunit.client.0.smithi084.stdout:1/393: link d9/d54/d1b/d2c/d4b/d4c/d79/l19 d9/d54/d1b/d2c/d35/l8e 0 2024-02-15T18:27:03.561 INFO:tasks.workunit.client.0.smithi084.stdout:1/394: chown d9/d54/d1b/f5e 337369 1 2024-02-15T18:27:03.561 INFO:tasks.workunit.client.0.smithi084.stdout:6/443: write d14/d22/d25/d2f/f66 [283074,48137] 0 2024-02-15T18:27:03.561 INFO:tasks.workunit.client.0.smithi084.stdout:7/397: creat df/d1d/d1a/d4d/f6f x:0 0 0 2024-02-15T18:27:03.563 INFO:tasks.workunit.client.0.smithi084.stdout:2/423: rename d3/d19/d36 to d3/d19/d24/d89 0 2024-02-15T18:27:03.564 INFO:tasks.workunit.client.1.smithi133.stdout:1/261: dread d6/d2a/f38 [8388608,4194304] 0 2024-02-15T18:27:03.564 INFO:tasks.workunit.client.0.smithi084.stdout:6/444: symlink d14/d22/d25/d2f/d31/d3f/d4a/l91 0 2024-02-15T18:27:03.566 INFO:tasks.workunit.client.1.smithi133.stdout:2/206: dread d7/db/f1d [0,4194304] 0 2024-02-15T18:27:03.569 INFO:tasks.workunit.client.0.smithi084.stdout:0/448: dwrite d0/d4/d1b/d26/f7c [0,4194304] 0 2024-02-15T18:27:03.570 INFO:tasks.workunit.client.0.smithi084.stdout:0/449: stat d0/d4/d1b/d7a 0 2024-02-15T18:27:03.570 INFO:tasks.workunit.client.0.smithi084.stdout:0/450: fdatasync d0/d4/d1b/f3c 0 2024-02-15T18:27:03.571 INFO:tasks.workunit.client.0.smithi084.stdout:7/398: rename df/d1d/d1a/d4b/d69 to df/d70 0 2024-02-15T18:27:03.571 INFO:tasks.workunit.client.0.smithi084.stdout:7/399: chown df/f6e 8 1 2024-02-15T18:27:03.572 INFO:tasks.workunit.client.0.smithi084.stdout:7/400: truncate df/d1d/d1a/f24 846452 0 2024-02-15T18:27:03.572 INFO:tasks.workunit.client.0.smithi084.stdout:6/445: truncate fb 2493472 0 2024-02-15T18:27:03.572 INFO:tasks.workunit.client.1.smithi133.stdout:2/207: creat d7/d2c/f44 x:0 0 0 2024-02-15T18:27:03.575 INFO:tasks.workunit.client.1.smithi133.stdout:2/208: rename d7/db to d7/db/d35/d45 22 2024-02-15T18:27:03.575 INFO:tasks.workunit.client.0.smithi084.stdout:3/389: dread d8/f1d [0,4194304] 0 2024-02-15T18:27:03.577 INFO:tasks.workunit.client.0.smithi084.stdout:0/451: rmdir d0/d2f/d3f/d4f/d61/d79/d83 0 2024-02-15T18:27:03.577 INFO:tasks.workunit.client.0.smithi084.stdout:0/452: write d0/d2f/d3f/f49 [2254643,58304] 0 2024-02-15T18:27:03.577 INFO:tasks.workunit.client.1.smithi133.stdout:9/115: dread d0/d8/d10/f11 [0,4194304] 0 2024-02-15T18:27:03.577 INFO:tasks.workunit.client.0.smithi084.stdout:7/401: creat df/d1d/d1a/d4d/d59/f71 x:0 0 0 2024-02-15T18:27:03.580 INFO:tasks.workunit.client.0.smithi084.stdout:5/516: dread d9/da/d3d/d44/f86 [0,4194304] 0 2024-02-15T18:27:03.581 INFO:tasks.workunit.client.1.smithi133.stdout:2/209: truncate d7/f26 286942 0 2024-02-15T18:27:03.582 INFO:tasks.workunit.client.1.smithi133.stdout:2/210: fdatasync f1 0 2024-02-15T18:27:03.582 INFO:tasks.workunit.client.1.smithi133.stdout:9/116: creat d0/d8/f22 x:0 0 0 2024-02-15T18:27:03.582 INFO:tasks.workunit.client.0.smithi084.stdout:1/395: dread d9/d54/d5c/f67 [0,4194304] 0 2024-02-15T18:27:03.582 INFO:tasks.workunit.client.0.smithi084.stdout:0/453: dread d0/d4/d1b/f40 [0,4194304] 0 2024-02-15T18:27:03.583 INFO:tasks.workunit.client.0.smithi084.stdout:5/517: truncate d9/f2c 592991 0 2024-02-15T18:27:03.584 INFO:tasks.workunit.client.0.smithi084.stdout:1/396: rename d9/le to d9/d54/d1b/d38/d4d/l8f 0 2024-02-15T18:27:03.586 INFO:tasks.workunit.client.1.smithi133.stdout:2/211: mkdir d7/d2c/d46 0 2024-02-15T18:27:03.587 INFO:tasks.workunit.client.0.smithi084.stdout:5/518: mknod d9/da/d3d/d44/d55/d96/ca8 0 2024-02-15T18:27:03.588 INFO:tasks.workunit.client.0.smithi084.stdout:5/519: write d9/da/d3d/f50 [724573,114599] 0 2024-02-15T18:27:03.588 INFO:tasks.workunit.client.1.smithi133.stdout:9/117: truncate d0/f6 1868356 0 2024-02-15T18:27:03.588 INFO:tasks.workunit.client.1.smithi133.stdout:9/118: chown d0/l1f 397462 1 2024-02-15T18:27:03.590 INFO:tasks.workunit.client.0.smithi084.stdout:1/397: rename d9/d54/d1b/d2c/d4b/d7a/f7b to d9/d54/d32/d5b/f90 0 2024-02-15T18:27:03.592 INFO:tasks.workunit.client.0.smithi084.stdout:5/520: creat d9/d5f/da7/fa9 x:0 0 0 2024-02-15T18:27:03.592 INFO:tasks.workunit.client.0.smithi084.stdout:5/521: dread - d9/d35/d65/d8c/f9c zero size 2024-02-15T18:27:03.593 INFO:tasks.workunit.client.0.smithi084.stdout:5/522: chown d9/d5b 378335709 1 2024-02-15T18:27:03.593 INFO:tasks.workunit.client.0.smithi084.stdout:5/523: fdatasync d9/d23/f88 0 2024-02-15T18:27:03.594 INFO:tasks.workunit.client.1.smithi133.stdout:9/119: mknod d0/d8/d10/c23 0 2024-02-15T18:27:03.598 INFO:tasks.workunit.client.1.smithi133.stdout:9/120: symlink d0/l24 0 2024-02-15T18:27:03.598 INFO:tasks.workunit.client.0.smithi084.stdout:1/398: rename d9/d54/d1b/d2c/d4b/d4c/f5a to d9/d54/d1b/f91 0 2024-02-15T18:27:03.600 INFO:tasks.workunit.client.1.smithi133.stdout:7/65: sync 2024-02-15T18:27:03.601 INFO:tasks.workunit.client.1.smithi133.stdout:3/159: sync 2024-02-15T18:27:03.601 INFO:tasks.workunit.client.1.smithi133.stdout:3/160: fsync d0/d15/f16 0 2024-02-15T18:27:03.602 INFO:tasks.workunit.client.1.smithi133.stdout:9/121: dread d0/f16 [0,4194304] 0 2024-02-15T18:27:03.602 INFO:tasks.workunit.client.1.smithi133.stdout:3/161: truncate d0/fc 2531650 0 2024-02-15T18:27:03.603 INFO:tasks.workunit.client.1.smithi133.stdout:3/162: rename d0/c13 to d0/df/c28 0 2024-02-15T18:27:03.604 INFO:tasks.workunit.client.1.smithi133.stdout:9/122: write d0/d8/d10/f15 [2591038,14525] 0 2024-02-15T18:27:03.612 INFO:tasks.workunit.client.1.smithi133.stdout:0/148: sync 2024-02-15T18:27:03.614 INFO:tasks.workunit.client.0.smithi084.stdout:1/399: dread d9/d54/d1b/d2c/d4b/d4c/d79/d39/f23 [0,4194304] 0 2024-02-15T18:27:03.614 INFO:tasks.workunit.client.0.smithi084.stdout:1/400: fsync d9/d54/d1b/f25 0 2024-02-15T18:27:03.614 INFO:tasks.workunit.client.0.smithi084.stdout:1/401: fdatasync d9/d54/d1b/f70 0 2024-02-15T18:27:03.614 INFO:tasks.workunit.client.0.smithi084.stdout:1/402: write d9/d54/d32/d5b/f8d [961594,70105] 0 2024-02-15T18:27:03.616 INFO:tasks.workunit.client.0.smithi084.stdout:1/403: unlink d9/d54/d1b/d38/c45 0 2024-02-15T18:27:03.616 INFO:tasks.workunit.client.0.smithi084.stdout:1/404: stat d9 0 2024-02-15T18:27:03.617 INFO:tasks.workunit.client.0.smithi084.stdout:1/405: getdents d9/d54/d1b/d2c 0 2024-02-15T18:27:03.619 INFO:tasks.workunit.client.1.smithi133.stdout:7/66: dread f0 [0,4194304] 0 2024-02-15T18:27:03.619 INFO:tasks.workunit.client.1.smithi133.stdout:0/149: read f4 [24529,16213] 0 2024-02-15T18:27:03.619 INFO:tasks.workunit.client.1.smithi133.stdout:9/123: dread d0/d8/d9/ff [0,4194304] 0 2024-02-15T18:27:03.619 INFO:tasks.workunit.client.1.smithi133.stdout:7/67: symlink d9/db/d16/l18 0 2024-02-15T18:27:03.619 INFO:tasks.workunit.client.1.smithi133.stdout:7/68: fsync f6 0 2024-02-15T18:27:03.621 INFO:tasks.workunit.client.1.smithi133.stdout:1/262: dwrite d6/d17/f18 [4194304,4194304] 0 2024-02-15T18:27:03.621 INFO:tasks.workunit.client.1.smithi133.stdout:0/150: link d9/d10/d19/d29/c2e d9/c37 0 2024-02-15T18:27:03.622 INFO:tasks.workunit.client.1.smithi133.stdout:9/124: creat d0/f25 x:0 0 0 2024-02-15T18:27:03.622 INFO:tasks.workunit.client.1.smithi133.stdout:7/69: mkdir d9/d19 0 2024-02-15T18:27:03.623 INFO:tasks.workunit.client.1.smithi133.stdout:1/263: rename d6/d17/f1b to d6/d17/f68 0 2024-02-15T18:27:03.625 INFO:tasks.workunit.client.0.smithi084.stdout:9/489: dwrite d4/d2b/d3c/d20/d43/f14 [0,4194304] 0 2024-02-15T18:27:03.626 INFO:tasks.workunit.client.1.smithi133.stdout:7/70: link d9/db/d16/l18 d9/d19/l1a 0 2024-02-15T18:27:03.626 INFO:tasks.workunit.client.0.smithi084.stdout:0/454: dwrite d0/d39/d45/f5e [0,4194304] 0 2024-02-15T18:27:03.626 INFO:tasks.workunit.client.0.smithi084.stdout:2/424: dwrite d3/d28/f85 [0,4194304] 0 2024-02-15T18:27:03.627 INFO:tasks.workunit.client.1.smithi133.stdout:2/212: dwrite d7/f14 [0,4194304] 0 2024-02-15T18:27:03.628 INFO:tasks.workunit.client.1.smithi133.stdout:2/213: truncate d7/db/d35/f3d 610776 0 2024-02-15T18:27:03.629 INFO:tasks.workunit.client.0.smithi084.stdout:9/490: creat d4/f9c x:0 0 0 2024-02-15T18:27:03.629 INFO:tasks.workunit.client.0.smithi084.stdout:9/491: fdatasync d4/d2b/d67/f6d 0 2024-02-15T18:27:03.629 INFO:tasks.workunit.client.0.smithi084.stdout:3/390: dwrite d8/d22/f34 [0,4194304] 0 2024-02-15T18:27:03.631 INFO:tasks.workunit.client.1.smithi133.stdout:2/214: read d7/d18/f40 [1381716,105037] 0 2024-02-15T18:27:03.635 INFO:tasks.workunit.client.1.smithi133.stdout:2/215: truncate f1 5750953 0 2024-02-15T18:27:03.635 INFO:tasks.workunit.client.1.smithi133.stdout:7/71: dread f0 [0,4194304] 0 2024-02-15T18:27:03.635 INFO:tasks.workunit.client.1.smithi133.stdout:3/163: dwrite d0/d15/d19/f1e [0,4194304] 0 2024-02-15T18:27:03.636 INFO:tasks.workunit.client.0.smithi084.stdout:0/455: unlink d0/d2f/d3f/d4f/d61/f77 0 2024-02-15T18:27:03.636 INFO:tasks.workunit.client.0.smithi084.stdout:9/492: creat d4/f9d x:0 0 0 2024-02-15T18:27:03.636 INFO:tasks.workunit.client.0.smithi084.stdout:9/493: stat d4/d2b/d3c/d20/d75 0 2024-02-15T18:27:03.636 INFO:tasks.workunit.client.1.smithi133.stdout:3/164: write d0/f8 [4425004,504] 0 2024-02-15T18:27:03.636 INFO:tasks.workunit.client.1.smithi133.stdout:7/72: write f0 [4918754,128845] 0 2024-02-15T18:27:03.637 INFO:tasks.workunit.client.0.smithi084.stdout:3/391: creat d8/d40/d58/d80/d6b/f85 x:0 0 0 2024-02-15T18:27:03.637 INFO:tasks.workunit.client.0.smithi084.stdout:3/392: fdatasync d8/d40/d58/d80/d6b/f6c 0 2024-02-15T18:27:03.641 INFO:tasks.workunit.client.0.smithi084.stdout:0/456: mknod d0/d1e/c86 0 2024-02-15T18:27:03.644 INFO:tasks.workunit.client.0.smithi084.stdout:3/393: rename d8/f1b to d8/d73/f86 0 2024-02-15T18:27:03.649 INFO:tasks.workunit.client.0.smithi084.stdout:0/457: creat d0/d2f/d3f/d4f/d61/d79/f87 x:0 0 0 2024-02-15T18:27:03.652 INFO:tasks.workunit.client.1.smithi133.stdout:8/98: sync 2024-02-15T18:27:03.652 INFO:tasks.workunit.client.1.smithi133.stdout:4/67: sync 2024-02-15T18:27:03.653 INFO:tasks.workunit.client.1.smithi133.stdout:3/165: dread d0/f8 [0,4194304] 0 2024-02-15T18:27:03.653 INFO:tasks.workunit.client.1.smithi133.stdout:3/166: readlink d0/d15/l17 0 2024-02-15T18:27:03.654 INFO:tasks.workunit.client.1.smithi133.stdout:1/264: dwrite d6/f22 [0,4194304] 0 2024-02-15T18:27:03.654 INFO:tasks.workunit.client.1.smithi133.stdout:1/265: dread - d6/d1e/d41/f54 zero size 2024-02-15T18:27:03.654 INFO:tasks.workunit.client.1.smithi133.stdout:1/266: chown d6/d17/f60 6944 1 2024-02-15T18:27:03.654 INFO:tasks.workunit.client.1.smithi133.stdout:8/99: creat d3/f22 x:0 0 0 2024-02-15T18:27:03.655 INFO:tasks.workunit.client.1.smithi133.stdout:4/68: symlink d2/d14/l19 0 2024-02-15T18:27:03.655 INFO:tasks.workunit.client.1.smithi133.stdout:4/69: fdatasync d2/f9 0 2024-02-15T18:27:03.655 INFO:tasks.workunit.client.1.smithi133.stdout:4/70: dread - d2/d5/f8 zero size 2024-02-15T18:27:03.656 INFO:tasks.workunit.client.0.smithi084.stdout:0/458: mknod d0/d4/d1b/c88 0 2024-02-15T18:27:03.657 INFO:tasks.workunit.client.1.smithi133.stdout:3/167: mknod d0/df/c29 0 2024-02-15T18:27:03.657 INFO:tasks.workunit.client.1.smithi133.stdout:4/71: read d2/fd [3970944,39808] 0 2024-02-15T18:27:03.661 INFO:tasks.workunit.client.0.smithi084.stdout:0/459: symlink d0/d2f/d3f/l89 0 2024-02-15T18:27:03.661 INFO:tasks.workunit.client.0.smithi084.stdout:4/438: sync 2024-02-15T18:27:03.661 INFO:tasks.workunit.client.0.smithi084.stdout:8/444: sync 2024-02-15T18:27:03.663 INFO:tasks.workunit.client.0.smithi084.stdout:4/439: truncate d2/d2b/f54 1459499 0 2024-02-15T18:27:03.663 INFO:tasks.workunit.client.1.smithi133.stdout:1/267: symlink d6/d1e/d3a/l69 0 2024-02-15T18:27:03.664 INFO:tasks.workunit.client.0.smithi084.stdout:8/445: mknod db/dd/d1f/d7a/c96 0 2024-02-15T18:27:03.664 INFO:tasks.workunit.client.0.smithi084.stdout:8/446: stat db/d1a 0 2024-02-15T18:27:03.665 INFO:tasks.workunit.client.0.smithi084.stdout:8/447: stat db/f25 0 2024-02-15T18:27:03.665 INFO:tasks.workunit.client.0.smithi084.stdout:8/448: dread - db/dd/d4d/f70 zero size 2024-02-15T18:27:03.665 INFO:tasks.workunit.client.1.smithi133.stdout:8/100: getdents d3/d7 0 2024-02-15T18:27:03.665 INFO:tasks.workunit.client.1.smithi133.stdout:3/168: mknod d0/d15/c2a 0 2024-02-15T18:27:03.665 INFO:tasks.workunit.client.1.smithi133.stdout:4/72: creat d2/db/f1a x:0 0 0 2024-02-15T18:27:03.665 INFO:tasks.workunit.client.0.smithi084.stdout:4/440: rmdir d2/d4/d28/d3d 39 2024-02-15T18:27:03.667 INFO:tasks.workunit.client.1.smithi133.stdout:4/73: rename d2/d5/f8 to d2/d14/f1b 0 2024-02-15T18:27:03.668 INFO:tasks.workunit.client.0.smithi084.stdout:8/449: mkdir db/dd/d4d/d97 0 2024-02-15T18:27:03.669 INFO:tasks.workunit.client.1.smithi133.stdout:3/169: write d0/d15/f16 [2971600,99370] 0 2024-02-15T18:27:03.670 INFO:tasks.workunit.client.0.smithi084.stdout:4/441: rename d2/d2b/d47/f7b to d2/d4/f82 0 2024-02-15T18:27:03.670 INFO:tasks.workunit.client.0.smithi084.stdout:4/442: fdatasync d2/d4/d28/d3d/d5c/d65/f76 0 2024-02-15T18:27:03.670 INFO:tasks.workunit.client.0.smithi084.stdout:0/460: dread d0/d4/d66/f72 [0,4194304] 0 2024-02-15T18:27:03.670 INFO:tasks.workunit.client.0.smithi084.stdout:0/461: fdatasync d0/d4/d1b/f3c 0 2024-02-15T18:27:03.671 INFO:tasks.workunit.client.0.smithi084.stdout:0/462: fsync d0/d4/d1b/d26/f2d 0 2024-02-15T18:27:03.671 INFO:tasks.workunit.client.0.smithi084.stdout:0/463: write d0/d2f/f56 [735475,2229] 0 2024-02-15T18:27:03.671 INFO:tasks.workunit.client.1.smithi133.stdout:4/74: link d2/db/f18 d2/d14/f1c 0 2024-02-15T18:27:03.671 INFO:tasks.workunit.client.1.smithi133.stdout:4/75: write d2/db/f18 [6709818,130693] 0 2024-02-15T18:27:03.671 INFO:tasks.workunit.client.0.smithi084.stdout:0/464: dread d0/d2f/d3f/d4f/d61/f70 [0,4194304] 0 2024-02-15T18:27:03.672 INFO:tasks.workunit.client.1.smithi133.stdout:3/170: mkdir d0/d15/d2b 0 2024-02-15T18:27:03.673 INFO:tasks.workunit.client.0.smithi084.stdout:8/450: rename db/dd/d1f/c33 to db/dd/d1f/d7a/c98 0 2024-02-15T18:27:03.674 INFO:tasks.workunit.client.1.smithi133.stdout:4/76: creat d2/db/f1d x:0 0 0 2024-02-15T18:27:03.674 INFO:tasks.workunit.client.1.smithi133.stdout:4/77: read - d2/db/f1a zero size 2024-02-15T18:27:03.674 INFO:tasks.workunit.client.1.smithi133.stdout:4/78: truncate d2/f9 664539 0 2024-02-15T18:27:03.674 INFO:tasks.workunit.client.1.smithi133.stdout:4/79: fdatasync d2/f9 0 2024-02-15T18:27:03.674 INFO:tasks.workunit.client.1.smithi133.stdout:3/171: link d0/df/c28 d0/d15/d2b/c2c 0 2024-02-15T18:27:03.676 INFO:tasks.workunit.client.1.smithi133.stdout:3/172: truncate d0/df/f22 100264 0 2024-02-15T18:27:03.676 INFO:tasks.workunit.client.1.smithi133.stdout:3/173: chown d0/d15/c1f 1362759481 1 2024-02-15T18:27:03.679 INFO:tasks.workunit.client.1.smithi133.stdout:3/174: rename d0/d15/d19/f1e to d0/f2d 0 2024-02-15T18:27:03.680 INFO:tasks.workunit.client.1.smithi133.stdout:9/125: dwrite d0/d8/d9/d12/f21 [0,4194304] 0 2024-02-15T18:27:03.680 INFO:tasks.workunit.client.0.smithi084.stdout:5/524: dwrite d9/da/d3d/f50 [0,4194304] 0 2024-02-15T18:27:03.682 INFO:tasks.workunit.client.1.smithi133.stdout:3/175: unlink d0/f5 0 2024-02-15T18:27:03.682 INFO:tasks.workunit.client.1.smithi133.stdout:3/176: read d0/df/f20 [323970,84676] 0 2024-02-15T18:27:03.683 INFO:tasks.workunit.client.0.smithi084.stdout:5/525: rmdir d9/da/d3d/d44/d55/d70/d84 39 2024-02-15T18:27:03.683 INFO:tasks.workunit.client.0.smithi084.stdout:9/494: dwrite d4/f29 [0,4194304] 0 2024-02-15T18:27:03.683 INFO:tasks.workunit.client.0.smithi084.stdout:9/495: chown d4/d2b/d3c/d20/d43/c42 294010 1 2024-02-15T18:27:03.684 INFO:tasks.workunit.client.1.smithi133.stdout:9/126: creat d0/d8/d9/f26 x:0 0 0 2024-02-15T18:27:03.684 INFO:tasks.workunit.client.1.smithi133.stdout:9/127: write d0/f20 [686485,42711] 0 2024-02-15T18:27:03.685 INFO:tasks.workunit.client.1.smithi133.stdout:3/177: symlink d0/d15/d19/l2e 0 2024-02-15T18:27:03.685 INFO:tasks.workunit.client.1.smithi133.stdout:9/128: creat d0/f27 x:0 0 0 2024-02-15T18:27:03.686 INFO:tasks.workunit.client.0.smithi084.stdout:4/443: dread d2/d4/d25/d66/f79 [0,4194304] 0 2024-02-15T18:27:03.689 INFO:tasks.workunit.client.1.smithi133.stdout:9/129: mknod d0/d8/c28 0 2024-02-15T18:27:03.700 INFO:tasks.workunit.client.0.smithi084.stdout:9/496: dread d4/d2b/d3c/d20/f5a [0,4194304] 0 2024-02-15T18:27:03.700 INFO:tasks.workunit.client.0.smithi084.stdout:9/497: fdatasync d4/d2b/d3c/d20/d43/f1f 0 2024-02-15T18:27:03.702 INFO:tasks.workunit.client.1.smithi133.stdout:2/216: dwrite d7/f13 [4194304,4194304] 0 2024-02-15T18:27:03.706 INFO:tasks.workunit.client.1.smithi133.stdout:2/217: mknod d7/d2c/c47 0 2024-02-15T18:27:03.707 INFO:tasks.workunit.client.1.smithi133.stdout:2/218: stat d7/l25 0 2024-02-15T18:27:03.707 INFO:tasks.workunit.client.0.smithi084.stdout:3/394: dwrite d8/d1f/d25/f7f [0,4194304] 0 2024-02-15T18:27:03.709 INFO:tasks.workunit.client.1.smithi133.stdout:9/130: dread d0/d8/d9/ff [4194304,4194304] 0 2024-02-15T18:27:03.709 INFO:tasks.workunit.client.1.smithi133.stdout:9/131: write d0/d8/d9/f26 [482972,71437] 0 2024-02-15T18:27:03.711 INFO:tasks.workunit.client.1.smithi133.stdout:9/132: creat d0/d8/d10/f29 x:0 0 0 2024-02-15T18:27:03.711 INFO:tasks.workunit.client.1.smithi133.stdout:9/133: readlink d0/l24 0 2024-02-15T18:27:03.712 INFO:tasks.workunit.client.1.smithi133.stdout:7/73: dwrite d9/db/f11 [4194304,4194304] 0 2024-02-15T18:27:03.714 INFO:tasks.workunit.client.1.smithi133.stdout:7/74: creat d9/da/f1b x:0 0 0 2024-02-15T18:27:03.714 INFO:tasks.workunit.client.1.smithi133.stdout:7/75: fdatasync d9/da/f1b 0 2024-02-15T18:27:03.715 INFO:tasks.workunit.client.1.smithi133.stdout:7/76: creat d9/f1c x:0 0 0 2024-02-15T18:27:03.715 INFO:tasks.workunit.client.1.smithi133.stdout:7/77: truncate f7 4291274 0 2024-02-15T18:27:03.715 INFO:tasks.workunit.client.1.smithi133.stdout:7/78: write d9/f1c [786280,35404] 0 2024-02-15T18:27:03.715 INFO:tasks.workunit.client.1.smithi133.stdout:7/79: dread - d9/da/f1b zero size 2024-02-15T18:27:03.716 INFO:tasks.workunit.client.1.smithi133.stdout:7/80: mkdir d9/d1d 0 2024-02-15T18:27:03.717 INFO:tasks.workunit.client.1.smithi133.stdout:7/81: mknod d9/db/d16/c1e 0 2024-02-15T18:27:03.720 INFO:tasks.workunit.client.1.smithi133.stdout:2/219: dread d7/ff [0,4194304] 0 2024-02-15T18:27:03.721 INFO:tasks.workunit.client.1.smithi133.stdout:8/101: dwrite d3/f1a [0,4194304] 0 2024-02-15T18:27:03.723 INFO:tasks.workunit.client.1.smithi133.stdout:2/220: mkdir d7/d2c/d3b/d48 0 2024-02-15T18:27:03.723 INFO:tasks.workunit.client.1.smithi133.stdout:8/102: truncate d3/f5 551206 0 2024-02-15T18:27:03.724 INFO:tasks.workunit.client.1.smithi133.stdout:8/103: dread - d3/f14 zero size 2024-02-15T18:27:03.724 INFO:tasks.workunit.client.1.smithi133.stdout:8/104: chown d3/d7/c15 407 1 2024-02-15T18:27:03.724 INFO:tasks.workunit.client.1.smithi133.stdout:8/105: write d3/d1f/f20 [92396,41297] 0 2024-02-15T18:27:03.726 INFO:tasks.workunit.client.1.smithi133.stdout:1/268: dwrite d6/f15 [0,4194304] 0 2024-02-15T18:27:03.726 INFO:tasks.workunit.client.1.smithi133.stdout:1/269: stat d6/d1e/c5b 0 2024-02-15T18:27:03.726 INFO:tasks.workunit.client.1.smithi133.stdout:1/270: write d6/d17/f1a [2474009,74084] 0 2024-02-15T18:27:03.728 INFO:tasks.workunit.client.1.smithi133.stdout:1/271: read d6/d17/f60 [977005,8584] 0 2024-02-15T18:27:03.728 INFO:tasks.workunit.client.1.smithi133.stdout:1/272: dread - d6/d2a/f3f zero size 2024-02-15T18:27:03.728 INFO:tasks.workunit.client.1.smithi133.stdout:1/273: read - d6/f43 zero size 2024-02-15T18:27:03.728 INFO:tasks.workunit.client.1.smithi133.stdout:1/274: dread - d6/f29 zero size 2024-02-15T18:27:03.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/498: dread d4/d2b/d3c/d24/f58 [0,4194304] 0 2024-02-15T18:27:03.742 INFO:tasks.workunit.client.0.smithi084.stdout:0/465: dwrite d0/f1a [0,4194304] 0 2024-02-15T18:27:03.743 INFO:tasks.workunit.client.0.smithi084.stdout:9/499: symlink d4/d2b/d3c/d20/l9e 0 2024-02-15T18:27:03.743 INFO:tasks.workunit.client.0.smithi084.stdout:0/466: mkdir d0/d2f/d3f/d8a 0 2024-02-15T18:27:03.745 INFO:tasks.workunit.client.0.smithi084.stdout:9/500: creat d4/d2b/d3c/d20/d43/d15/d4b/f9f x:0 0 0 2024-02-15T18:27:03.745 INFO:tasks.workunit.client.0.smithi084.stdout:9/501: write d4/d2b/d3c/d20/d43/d15/f40 [1595265,68645] 0 2024-02-15T18:27:03.745 INFO:tasks.workunit.client.0.smithi084.stdout:0/467: creat d0/d2f/d3f/d8a/f8b x:0 0 0 2024-02-15T18:27:03.746 INFO:tasks.workunit.client.0.smithi084.stdout:9/502: mknod d4/d2b/d3c/d20/ca0 0 2024-02-15T18:27:03.746 INFO:tasks.workunit.client.0.smithi084.stdout:9/503: chown d4/d2b/d3c/d20/d43/d15/d33/l65 4278 1 2024-02-15T18:27:03.746 INFO:tasks.workunit.client.0.smithi084.stdout:0/468: write d0/d4/d1b/f42 [2340706,33659] 0 2024-02-15T18:27:03.747 INFO:tasks.workunit.client.0.smithi084.stdout:0/469: creat d0/d4/d1b/f8c x:0 0 0 2024-02-15T18:27:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:4/444: dwrite d2/d4/d28/d3d/d5c/d65/f69 [0,4194304] 0 2024-02-15T18:27:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:4/445: readlink d2/d2b/l73 0 2024-02-15T18:27:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:4/446: fsync d2/d4/d28/d2e/f77 0 2024-02-15T18:27:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:4/447: readlink d2/d2b/d47/l30 0 2024-02-15T18:27:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:5/526: dwrite d9/da/f73 [0,4194304] 0 2024-02-15T18:27:03.748 INFO:tasks.workunit.client.0.smithi084.stdout:8/451: dwrite db/d3f/d59/d69/f91 [0,4194304] 0 2024-02-15T18:27:03.749 INFO:tasks.workunit.client.0.smithi084.stdout:8/452: fdatasync db/d1a/d2b/f4b 0 2024-02-15T18:27:03.749 INFO:tasks.workunit.client.0.smithi084.stdout:0/470: mknod d0/d4/d3a/c8d 0 2024-02-15T18:27:03.750 INFO:tasks.workunit.client.0.smithi084.stdout:3/395: dwrite d8/d40/d58/d80/f84 [0,4194304] 0 2024-02-15T18:27:03.750 INFO:tasks.workunit.client.0.smithi084.stdout:3/396: write d8/d40/d43/d71/f81 [846829,47462] 0 2024-02-15T18:27:03.750 INFO:tasks.workunit.client.1.smithi133.stdout:7/82: dwrite d9/da/f1b [0,4194304] 0 2024-02-15T18:27:03.750 INFO:tasks.workunit.client.1.smithi133.stdout:1/275: dwrite d6/d1e/d41/f54 [0,4194304] 0 2024-02-15T18:27:03.752 INFO:tasks.workunit.client.1.smithi133.stdout:8/106: dread d3/d1f/f20 [0,4194304] 0 2024-02-15T18:27:03.752 INFO:tasks.workunit.client.1.smithi133.stdout:3/178: rename d0/d15/d19 to d0/d15/d2f 0 2024-02-15T18:27:03.753 INFO:tasks.workunit.client.1.smithi133.stdout:8/107: dread d3/d1f/f20 [0,4194304] 0 2024-02-15T18:27:03.753 INFO:tasks.workunit.client.1.smithi133.stdout:8/108: stat d3/d7/l10 0 2024-02-15T18:27:03.753 INFO:tasks.workunit.client.1.smithi133.stdout:4/80: dwrite d2/d5/f10 [0,4194304] 0 2024-02-15T18:27:03.753 INFO:tasks.workunit.client.1.smithi133.stdout:4/81: dread - d2/d14/f1b zero size 2024-02-15T18:27:03.754 INFO:tasks.workunit.client.0.smithi084.stdout:4/448: rmdir d2/d4/d28/d3d/d5c/d5d 39 2024-02-15T18:27:03.754 INFO:tasks.workunit.client.0.smithi084.stdout:4/449: read d2/d4/f8 [415611,82793] 0 2024-02-15T18:27:03.756 INFO:tasks.workunit.client.0.smithi084.stdout:5/527: mkdir d9/da/d3d/d44/d55/daa 0 2024-02-15T18:27:03.757 INFO:tasks.workunit.client.0.smithi084.stdout:8/453: symlink db/d1a/d5e/l99 0 2024-02-15T18:27:03.759 INFO:tasks.workunit.client.0.smithi084.stdout:0/471: rename d0/d4/d1b/f8c to d0/d39/f8e 0 2024-02-15T18:27:03.759 INFO:tasks.workunit.client.0.smithi084.stdout:8/454: dread db/f77 [0,4194304] 0 2024-02-15T18:27:03.763 INFO:tasks.workunit.client.0.smithi084.stdout:3/397: rmdir d8 39 2024-02-15T18:27:03.763 INFO:tasks.workunit.client.1.smithi133.stdout:7/83: creat d9/db/f1f x:0 0 0 2024-02-15T18:27:03.764 INFO:tasks.workunit.client.1.smithi133.stdout:7/84: fdatasync f7 0 2024-02-15T18:27:03.764 INFO:tasks.workunit.client.1.smithi133.stdout:7/85: write f0 [4218715,93494] 0 2024-02-15T18:27:03.764 INFO:tasks.workunit.client.1.smithi133.stdout:7/86: chown d9/db/l10 573487933 1 2024-02-15T18:27:03.765 INFO:tasks.workunit.client.0.smithi084.stdout:9/504: dwrite d4/d2b/d3c/d24/f2a [0,4194304] 0 2024-02-15T18:27:03.766 INFO:tasks.workunit.client.1.smithi133.stdout:1/276: link d6/d1e/f23 d6/d2a/d59/f6a 0 2024-02-15T18:27:03.768 INFO:tasks.workunit.client.1.smithi133.stdout:3/179: creat d0/d15/d2f/f30 x:0 0 0 2024-02-15T18:27:03.769 INFO:tasks.workunit.client.1.smithi133.stdout:8/109: link d3/de/f18 d3/d1f/f23 0 2024-02-15T18:27:03.771 INFO:tasks.workunit.client.1.smithi133.stdout:9/134: dwrite d0/f20 [0,4194304] 0 2024-02-15T18:27:03.775 INFO:tasks.workunit.client.1.smithi133.stdout:4/82: getdents d2/d14 0 2024-02-15T18:27:03.776 INFO:tasks.workunit.client.1.smithi133.stdout:4/83: write d2/d14/f1c [4516947,67167] 0 2024-02-15T18:27:03.776 INFO:tasks.workunit.client.1.smithi133.stdout:4/84: write d2/db/f1a [512663,114999] 0 2024-02-15T18:27:03.777 INFO:tasks.workunit.client.1.smithi133.stdout:1/277: symlink d6/d32/l6b 0 2024-02-15T18:27:03.777 INFO:tasks.workunit.client.1.smithi133.stdout:8/110: symlink d3/d1f/l24 0 2024-02-15T18:27:03.777 INFO:tasks.workunit.client.1.smithi133.stdout:8/111: truncate d3/de/f1d 957854 0 2024-02-15T18:27:03.777 INFO:tasks.workunit.client.0.smithi084.stdout:5/528: mknod d9/d5b/d7e/cab 0 2024-02-15T18:27:03.778 INFO:tasks.workunit.client.1.smithi133.stdout:4/85: read d2/fd [1006507,128165] 0 2024-02-15T18:27:03.778 INFO:tasks.workunit.client.1.smithi133.stdout:4/86: getdents d2/d14 0 2024-02-15T18:27:03.778 INFO:tasks.workunit.client.1.smithi133.stdout:4/87: readlink d2/d5/l16 0 2024-02-15T18:27:03.778 INFO:tasks.workunit.client.1.smithi133.stdout:9/135: mkdir d0/d8/d9/d12/d2a 0 2024-02-15T18:27:03.778 INFO:tasks.workunit.client.1.smithi133.stdout:3/180: read d0/f8 [2760131,34331] 0 2024-02-15T18:27:03.778 INFO:tasks.workunit.client.1.smithi133.stdout:3/181: chown d0/df/c29 191 1 2024-02-15T18:27:03.779 INFO:tasks.workunit.client.1.smithi133.stdout:7/87: truncate d9/da/f1b 438177 0 2024-02-15T18:27:03.779 INFO:tasks.workunit.client.0.smithi084.stdout:4/450: rename d2/d2b/c32 to d2/d64/c83 0 2024-02-15T18:27:03.779 INFO:tasks.workunit.client.0.smithi084.stdout:4/451: chown d2/d4/f55 6 1 2024-02-15T18:27:03.780 INFO:tasks.workunit.client.0.smithi084.stdout:0/472: mknod d0/d4/d1b/d26/d43/d6d/d71/c8f 0 2024-02-15T18:27:03.780 INFO:tasks.workunit.client.1.smithi133.stdout:8/112: rename d3/de/f18 to d3/de/f25 0 2024-02-15T18:27:03.780 INFO:tasks.workunit.client.1.smithi133.stdout:8/113: write d3/f22 [867211,25306] 0 2024-02-15T18:27:03.781 INFO:tasks.workunit.client.0.smithi084.stdout:8/455: unlink db/d3f/d59/c3c 0 2024-02-15T18:27:03.781 INFO:tasks.workunit.client.0.smithi084.stdout:1/406: sync 2024-02-15T18:27:03.781 INFO:tasks.workunit.client.0.smithi084.stdout:2/425: sync 2024-02-15T18:27:03.781 INFO:tasks.workunit.client.0.smithi084.stdout:6/446: sync 2024-02-15T18:27:03.781 INFO:tasks.workunit.client.0.smithi084.stdout:7/402: sync 2024-02-15T18:27:03.782 INFO:tasks.workunit.client.0.smithi084.stdout:1/407: write d9/d54/d32/d5b/f8d [174313,1199] 0 2024-02-15T18:27:03.783 INFO:tasks.workunit.client.1.smithi133.stdout:4/88: rename d2/db/f18 to d2/db/f1e 0 2024-02-15T18:27:03.783 INFO:tasks.workunit.client.0.smithi084.stdout:2/426: dread d3/d5/f21 [4194304,4194304] 0 2024-02-15T18:27:03.783 INFO:tasks.workunit.client.0.smithi084.stdout:2/427: readlink d3/d5/d1a/d1e/l37 0 2024-02-15T18:27:03.783 INFO:tasks.workunit.client.0.smithi084.stdout:2/428: chown d3/d5/f18 6711 1 2024-02-15T18:27:03.784 INFO:tasks.workunit.client.0.smithi084.stdout:2/429: chown d3/d19/d24/f26 54703073 1 2024-02-15T18:27:03.784 INFO:tasks.workunit.client.0.smithi084.stdout:2/430: read - d3/d5/d1a/d1e/d30/f88 zero size 2024-02-15T18:27:03.784 INFO:tasks.workunit.client.0.smithi084.stdout:9/505: unlink d4/d2b/d3c/d20/d43/d15/d4f/l54 0 2024-02-15T18:27:03.784 INFO:tasks.workunit.client.1.smithi133.stdout:3/182: symlink d0/d15/l31 0 2024-02-15T18:27:03.785 INFO:tasks.workunit.client.0.smithi084.stdout:5/529: mkdir d9/d23/dac 0 2024-02-15T18:27:03.785 INFO:tasks.workunit.client.1.smithi133.stdout:1/278: dread d6/d1e/f21 [0,4194304] 0 2024-02-15T18:27:03.786 INFO:tasks.workunit.client.1.smithi133.stdout:7/88: truncate d9/da/f1b 1060429 0 2024-02-15T18:27:03.787 INFO:tasks.workunit.client.0.smithi084.stdout:4/452: creat d2/f84 x:0 0 0 2024-02-15T18:27:03.787 INFO:tasks.workunit.client.0.smithi084.stdout:6/447: mkdir d14/d22/d25/d2f/d31/d30/d45/d52/d92 0 2024-02-15T18:27:03.790 INFO:tasks.workunit.client.0.smithi084.stdout:0/473: rmdir d0/d4/d3a/d5c 39 2024-02-15T18:27:03.790 INFO:tasks.workunit.client.0.smithi084.stdout:3/398: dwrite d8/d1f/f3b [0,4194304] 0 2024-02-15T18:27:03.790 INFO:tasks.workunit.client.0.smithi084.stdout:3/399: dread - d8/d40/d58/d80/f5f zero size 2024-02-15T18:27:03.790 INFO:tasks.workunit.client.0.smithi084.stdout:3/400: stat d8/d40/d58/f83 0 2024-02-15T18:27:03.790 INFO:tasks.workunit.client.0.smithi084.stdout:7/403: creat df/d1d/d40/d48/f72 x:0 0 0 2024-02-15T18:27:03.790 INFO:tasks.workunit.client.0.smithi084.stdout:1/408: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/d92 0 2024-02-15T18:27:03.790 INFO:tasks.workunit.client.0.smithi084.stdout:1/409: chown d9/d54/d1b/d38/d4d/c8c 46468349 1 2024-02-15T18:27:03.792 INFO:tasks.workunit.client.0.smithi084.stdout:2/431: link d3/d5/d1a/d1e/c7c d3/d5/d1a/d1e/d47/d76/c8a 0 2024-02-15T18:27:03.793 INFO:tasks.workunit.client.1.smithi133.stdout:8/114: rename d3/d1f/f20 to d3/d7/f26 0 2024-02-15T18:27:03.794 INFO:tasks.workunit.client.0.smithi084.stdout:9/506: creat d4/d2b/d3c/d20/d43/fa1 x:0 0 0 2024-02-15T18:27:03.794 INFO:tasks.workunit.client.0.smithi084.stdout:9/507: stat d4/f29 0 2024-02-15T18:27:03.795 INFO:tasks.workunit.client.0.smithi084.stdout:4/453: getdents d2/d4 0 2024-02-15T18:27:03.796 INFO:tasks.workunit.client.1.smithi133.stdout:3/183: symlink d0/d15/d2f/l32 0 2024-02-15T18:27:03.796 INFO:tasks.workunit.client.1.smithi133.stdout:3/184: write d0/df/f20 [1219665,57521] 0 2024-02-15T18:27:03.798 INFO:tasks.workunit.client.1.smithi133.stdout:1/279: mknod d6/d1e/c6c 0 2024-02-15T18:27:03.799 INFO:tasks.workunit.client.0.smithi084.stdout:6/448: unlink d14/d22/d25/d2f/d31/f27 0 2024-02-15T18:27:03.799 INFO:tasks.workunit.client.0.smithi084.stdout:6/449: readlink d14/d22/d25/d41/l73 0 2024-02-15T18:27:03.801 INFO:tasks.workunit.client.0.smithi084.stdout:3/401: symlink d8/d40/d43/l87 0 2024-02-15T18:27:03.801 INFO:tasks.workunit.client.0.smithi084.stdout:7/404: creat df/d1d/d40/f73 x:0 0 0 2024-02-15T18:27:03.801 INFO:tasks.workunit.client.0.smithi084.stdout:7/405: fsync df/d1d/d40/d48/f43 0 2024-02-15T18:27:03.801 INFO:tasks.workunit.client.0.smithi084.stdout:7/406: read - df/d1d/d40/d48/f43 zero size 2024-02-15T18:27:03.801 INFO:tasks.workunit.client.0.smithi084.stdout:3/402: write d8/f12 [842262,70648] 0 2024-02-15T18:27:03.801 INFO:tasks.workunit.client.0.smithi084.stdout:7/407: truncate df/f14 636344 0 2024-02-15T18:27:03.802 INFO:tasks.workunit.client.1.smithi133.stdout:4/89: rmdir d2/db 39 2024-02-15T18:27:03.802 INFO:tasks.workunit.client.0.smithi084.stdout:4/454: creat d2/d64/f85 x:0 0 0 2024-02-15T18:27:03.803 INFO:tasks.workunit.client.0.smithi084.stdout:4/455: chown d2/d4/d28 7 1 2024-02-15T18:27:03.803 INFO:tasks.workunit.client.0.smithi084.stdout:3/403: rmdir d8/d1f/d2d 39 2024-02-15T18:27:03.804 INFO:tasks.workunit.client.0.smithi084.stdout:7/408: mknod df/c74 0 2024-02-15T18:27:03.804 INFO:tasks.workunit.client.0.smithi084.stdout:7/409: dread - df/d1d/d40/d48/f72 zero size 2024-02-15T18:27:03.804 INFO:tasks.workunit.client.1.smithi133.stdout:8/115: truncate d3/f4 2404114 0 2024-02-15T18:27:03.805 INFO:tasks.workunit.client.0.smithi084.stdout:3/404: symlink d8/d40/d58/l88 0 2024-02-15T18:27:03.805 INFO:tasks.workunit.client.1.smithi133.stdout:3/185: symlink d0/d15/d2b/l33 0 2024-02-15T18:27:03.805 INFO:tasks.workunit.client.0.smithi084.stdout:7/410: creat df/d1d/d1a/f75 x:0 0 0 2024-02-15T18:27:03.806 INFO:tasks.workunit.client.1.smithi133.stdout:1/280: symlink d6/d32/l6d 0 2024-02-15T18:27:03.807 INFO:tasks.workunit.client.1.smithi133.stdout:7/89: unlink c1 0 2024-02-15T18:27:03.807 INFO:tasks.workunit.client.1.smithi133.stdout:4/90: creat d2/f1f x:0 0 0 2024-02-15T18:27:03.808 INFO:tasks.workunit.client.0.smithi084.stdout:3/405: unlink d8/c5b 0 2024-02-15T18:27:03.808 INFO:tasks.workunit.client.1.smithi133.stdout:3/186: mkdir d0/d15/d34 0 2024-02-15T18:27:03.808 INFO:tasks.workunit.client.1.smithi133.stdout:8/116: dread d3/f5 [0,4194304] 0 2024-02-15T18:27:03.809 INFO:tasks.workunit.client.0.smithi084.stdout:7/411: symlink df/d1d/d40/l76 0 2024-02-15T18:27:03.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/90: mknod d9/d19/c20 0 2024-02-15T18:27:03.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/91: fdatasync f7 0 2024-02-15T18:27:03.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/92: chown d9/db/d16 1068 1 2024-02-15T18:27:03.811 INFO:tasks.workunit.client.0.smithi084.stdout:3/406: creat d8/d40/f89 x:0 0 0 2024-02-15T18:27:03.811 INFO:tasks.workunit.client.0.smithi084.stdout:7/412: symlink df/d1d/d1a/d4b/l77 0 2024-02-15T18:27:03.812 INFO:tasks.workunit.client.1.smithi133.stdout:4/91: mknod d2/db/c20 0 2024-02-15T18:27:03.812 INFO:tasks.workunit.client.1.smithi133.stdout:4/92: dread - d2/f12 zero size 2024-02-15T18:27:03.812 INFO:tasks.workunit.client.1.smithi133.stdout:8/117: creat d3/d1c/f27 x:0 0 0 2024-02-15T18:27:03.812 INFO:tasks.workunit.client.1.smithi133.stdout:3/187: symlink d0/d15/l35 0 2024-02-15T18:27:03.812 INFO:tasks.workunit.client.0.smithi084.stdout:3/407: creat d8/d1f/d2d/f8a x:0 0 0 2024-02-15T18:27:03.812 INFO:tasks.workunit.client.1.smithi133.stdout:8/118: symlink d3/d7/l28 0 2024-02-15T18:27:03.814 INFO:tasks.workunit.client.1.smithi133.stdout:3/188: mknod d0/c36 0 2024-02-15T18:27:03.814 INFO:tasks.workunit.client.0.smithi084.stdout:7/413: rename df/d1d/d1a/d4d/f4e to df/d1d/d1a/d4d/f78 0 2024-02-15T18:27:03.814 INFO:tasks.workunit.client.1.smithi133.stdout:7/93: rename d9/db/l10 to d9/db/d16/l21 0 2024-02-15T18:27:03.815 INFO:tasks.workunit.client.1.smithi133.stdout:8/119: symlink d3/d7/l29 0 2024-02-15T18:27:03.815 INFO:tasks.workunit.client.1.smithi133.stdout:8/120: fdatasync d3/f4 0 2024-02-15T18:27:03.816 INFO:tasks.workunit.client.0.smithi084.stdout:7/414: mkdir df/d1d/d1a/d4d/d59/d79 0 2024-02-15T18:27:03.817 INFO:tasks.workunit.client.1.smithi133.stdout:3/189: rename d0/d15/d34 to d0/d15/d37 0 2024-02-15T18:27:03.817 INFO:tasks.workunit.client.1.smithi133.stdout:3/190: truncate d0/df/f22 667182 0 2024-02-15T18:27:03.818 INFO:tasks.workunit.client.1.smithi133.stdout:8/121: unlink d3/d1f/l24 0 2024-02-15T18:27:03.819 INFO:tasks.workunit.client.0.smithi084.stdout:6/450: dread d14/d22/d25/d2f/d31/d30/d45/d54/f57 [0,4194304] 0 2024-02-15T18:27:03.821 INFO:tasks.workunit.client.1.smithi133.stdout:4/93: rename d2/d14 to d2/db/d21 0 2024-02-15T18:27:03.821 INFO:tasks.workunit.client.1.smithi133.stdout:3/191: truncate d0/f2d 2613627 0 2024-02-15T18:27:03.821 INFO:tasks.workunit.client.0.smithi084.stdout:6/451: rmdir d14/d22/d25/d41 39 2024-02-15T18:27:03.823 INFO:tasks.workunit.client.0.smithi084.stdout:8/456: dwrite db/d1a/f5f [0,4194304] 0 2024-02-15T18:27:03.823 INFO:tasks.workunit.client.1.smithi133.stdout:3/192: read d0/fa [3427214,69313] 0 2024-02-15T18:27:03.823 INFO:tasks.workunit.client.1.smithi133.stdout:3/193: chown d0/df/c28 4275 1 2024-02-15T18:27:03.824 INFO:tasks.workunit.client.0.smithi084.stdout:6/452: mkdir d14/d22/d25/d2f/d31/d30/d93 0 2024-02-15T18:27:03.828 INFO:tasks.workunit.client.1.smithi133.stdout:8/122: creat d3/d1f/f2a x:0 0 0 2024-02-15T18:27:03.828 INFO:tasks.workunit.client.1.smithi133.stdout:4/94: creat d2/db/d21/f22 x:0 0 0 2024-02-15T18:27:03.828 INFO:tasks.workunit.client.1.smithi133.stdout:8/123: stat d3/cd 0 2024-02-15T18:27:03.828 INFO:tasks.workunit.client.1.smithi133.stdout:4/95: truncate d2/f9 1504061 0 2024-02-15T18:27:03.828 INFO:tasks.workunit.client.0.smithi084.stdout:8/457: creat db/dd/d4d/d97/f9a x:0 0 0 2024-02-15T18:27:03.828 INFO:tasks.workunit.client.0.smithi084.stdout:6/453: stat d14/d22/d25/d2f/l56 0 2024-02-15T18:27:03.828 INFO:tasks.workunit.client.0.smithi084.stdout:6/454: fdatasync d14/d22/d25/d41/f68 0 2024-02-15T18:27:03.828 INFO:tasks.workunit.client.0.smithi084.stdout:6/455: chown d14/d22/d25/d2f/d31/d30/d45/c51 111066654 1 2024-02-15T18:27:03.829 INFO:tasks.workunit.client.0.smithi084.stdout:4/456: dread d2/d4/fd [0,4194304] 0 2024-02-15T18:27:03.829 INFO:tasks.workunit.client.0.smithi084.stdout:8/458: mkdir db/dd/d1f/d9b 0 2024-02-15T18:27:03.831 INFO:tasks.workunit.client.0.smithi084.stdout:8/459: dread fa [4194304,4194304] 0 2024-02-15T18:27:03.831 INFO:tasks.workunit.client.1.smithi133.stdout:8/124: symlink d3/d7/l2b 0 2024-02-15T18:27:03.832 INFO:tasks.workunit.client.1.smithi133.stdout:3/194: symlink d0/d15/d2f/l38 0 2024-02-15T18:27:03.832 INFO:tasks.workunit.client.1.smithi133.stdout:4/96: creat d2/f23 x:0 0 0 2024-02-15T18:27:03.832 INFO:tasks.workunit.client.0.smithi084.stdout:6/456: unlink d14/d22/d25/d2f/d31/d30/d45/d54/c70 0 2024-02-15T18:27:03.833 INFO:tasks.workunit.client.1.smithi133.stdout:8/125: creat d3/d1f/f2c x:0 0 0 2024-02-15T18:27:03.834 INFO:tasks.workunit.client.1.smithi133.stdout:3/195: mkdir d0/d15/d2b/d39 0 2024-02-15T18:27:03.834 INFO:tasks.workunit.client.1.smithi133.stdout:3/196: fdatasync d0/d15/f16 0 2024-02-15T18:27:03.835 INFO:tasks.workunit.client.1.smithi133.stdout:4/97: creat d2/db/f24 x:0 0 0 2024-02-15T18:27:03.836 INFO:tasks.workunit.client.1.smithi133.stdout:8/126: mknod d3/d1f/c2d 0 2024-02-15T18:27:03.837 INFO:tasks.workunit.client.1.smithi133.stdout:3/197: creat d0/f3a x:0 0 0 2024-02-15T18:27:03.837 INFO:tasks.workunit.client.1.smithi133.stdout:3/198: read - d0/d15/f26 zero size 2024-02-15T18:27:03.838 INFO:tasks.workunit.client.1.smithi133.stdout:4/98: write d2/d5/f10 [952340,13076] 0 2024-02-15T18:27:03.838 INFO:tasks.workunit.client.1.smithi133.stdout:4/99: chown d2/db/d21/l19 10 1 2024-02-15T18:27:03.840 INFO:tasks.workunit.client.1.smithi133.stdout:3/199: creat d0/d15/f3b x:0 0 0 2024-02-15T18:27:03.840 INFO:tasks.workunit.client.1.smithi133.stdout:3/200: read - d0/d15/d2f/f30 zero size 2024-02-15T18:27:03.843 INFO:tasks.workunit.client.1.smithi133.stdout:3/201: mknod d0/df/c3c 0 2024-02-15T18:27:03.843 INFO:tasks.workunit.client.1.smithi133.stdout:3/202: dread - d0/f3a zero size 2024-02-15T18:27:03.846 INFO:tasks.workunit.client.0.smithi084.stdout:5/530: dwrite d9/d5f/d68/d9a/d8d/f8f [0,4194304] 0 2024-02-15T18:27:03.850 INFO:tasks.workunit.client.0.smithi084.stdout:5/531: unlink d9/f10 0 2024-02-15T18:27:03.852 INFO:tasks.workunit.client.0.smithi084.stdout:6/457: dwrite d14/d22/d25/d41/f75 [0,4194304] 0 2024-02-15T18:27:03.859 INFO:tasks.workunit.client.0.smithi084.stdout:8/460: dread db/d1a/d2b/f4b [0,4194304] 0 2024-02-15T18:27:03.860 INFO:tasks.workunit.client.0.smithi084.stdout:8/461: truncate db/dd/d4d/d97/f9a 230127 0 2024-02-15T18:27:03.860 INFO:tasks.workunit.client.0.smithi084.stdout:8/462: fdatasync db/dd/d4d/f7c 0 2024-02-15T18:27:03.861 INFO:tasks.workunit.client.0.smithi084.stdout:8/463: creat db/d6a/f9c x:0 0 0 2024-02-15T18:27:03.861 INFO:tasks.workunit.client.0.smithi084.stdout:8/464: chown db/dd/d4d/f7c 1 1 2024-02-15T18:27:03.862 INFO:tasks.workunit.client.0.smithi084.stdout:2/432: dread d3/d19/f20 [0,4194304] 0 2024-02-15T18:27:03.864 INFO:tasks.workunit.client.0.smithi084.stdout:2/433: symlink d3/d28/l8b 0 2024-02-15T18:27:03.867 INFO:tasks.workunit.client.0.smithi084.stdout:2/434: rename d3/f1b to d3/d19/d24/d3e/f8c 0 2024-02-15T18:27:03.867 INFO:tasks.workunit.client.0.smithi084.stdout:2/435: write d3/d19/d24/d3e/f70 [823756,113198] 0 2024-02-15T18:27:03.867 INFO:tasks.workunit.client.0.smithi084.stdout:2/436: fsync d3/f41 0 2024-02-15T18:27:03.870 INFO:tasks.workunit.client.0.smithi084.stdout:5/532: dread d9/da/f1b [0,4194304] 0 2024-02-15T18:27:03.872 INFO:tasks.workunit.client.1.smithi133.stdout:9/136: dwrite d0/f5 [0,4194304] 0 2024-02-15T18:27:03.873 INFO:tasks.workunit.client.0.smithi084.stdout:5/533: rename d9/da/d3d/d44/d55/d70/fa3 to d9/d5f/fad 0 2024-02-15T18:27:03.876 INFO:tasks.workunit.client.0.smithi084.stdout:5/534: creat d9/d5b/fae x:0 0 0 2024-02-15T18:27:03.879 INFO:tasks.workunit.client.0.smithi084.stdout:5/535: symlink d9/da/d3d/d44/d55/d70/d84/laf 0 2024-02-15T18:27:03.880 INFO:tasks.workunit.client.0.smithi084.stdout:5/536: truncate d9/d5b/d7e/d92/f9e 460568 0 2024-02-15T18:27:03.885 INFO:tasks.workunit.client.0.smithi084.stdout:8/465: dread db/d1a/d2b/f31 [0,4194304] 0 2024-02-15T18:27:03.885 INFO:tasks.workunit.client.0.smithi084.stdout:8/466: dread - db/dd/d4d/d7e/f85 zero size 2024-02-15T18:27:03.885 INFO:tasks.workunit.client.0.smithi084.stdout:8/467: write db/dd/d4d/f8a [702953,58103] 0 2024-02-15T18:27:03.886 INFO:tasks.workunit.client.1.smithi133.stdout:9/137: truncate d0/f7 5056628 0 2024-02-15T18:27:03.886 INFO:tasks.workunit.client.0.smithi084.stdout:5/537: write d9/d23/f37 [1000265,84972] 0 2024-02-15T18:27:03.889 INFO:tasks.workunit.client.0.smithi084.stdout:9/508: dwrite d4/d2b/d3c/d20/f62 [0,4194304] 0 2024-02-15T18:27:03.889 INFO:tasks.workunit.client.0.smithi084.stdout:0/474: dwrite d0/d39/f78 [0,4194304] 0 2024-02-15T18:27:03.889 INFO:tasks.workunit.client.0.smithi084.stdout:0/475: truncate d0/d2f/d3f/f5a 4864961 0 2024-02-15T18:27:03.890 INFO:tasks.workunit.client.1.smithi133.stdout:1/281: dwrite d6/d1e/d41/f46 [0,4194304] 0 2024-02-15T18:27:03.895 INFO:tasks.workunit.client.0.smithi084.stdout:4/457: dwrite d2/d64/d74/f78 [0,4194304] 0 2024-02-15T18:27:03.898 INFO:tasks.workunit.client.0.smithi084.stdout:1/410: dwrite d9/d54/d1b/d2c/d35/f5d [0,4194304] 0 2024-02-15T18:27:03.900 INFO:tasks.workunit.client.1.smithi133.stdout:1/282: rmdir d6 39 2024-02-15T18:27:03.900 INFO:tasks.workunit.client.1.smithi133.stdout:8/127: dwrite d3/f5 [0,4194304] 0 2024-02-15T18:27:03.901 INFO:tasks.workunit.client.0.smithi084.stdout:2/437: dwrite d3/f11 [4194304,4194304] 0 2024-02-15T18:27:03.906 INFO:tasks.workunit.client.0.smithi084.stdout:6/458: dwrite d14/d22/d25/d2f/d31/f79 [0,4194304] 0 2024-02-15T18:27:03.906 INFO:tasks.workunit.client.1.smithi133.stdout:3/203: dwrite d0/d15/f3b [0,4194304] 0 2024-02-15T18:27:03.906 INFO:tasks.workunit.client.1.smithi133.stdout:7/94: dread f0 [0,4194304] 0 2024-02-15T18:27:03.907 INFO:tasks.workunit.client.0.smithi084.stdout:7/415: rmdir df/d1d/d1a 39 2024-02-15T18:27:03.908 INFO:tasks.workunit.client.0.smithi084.stdout:9/509: symlink d4/la2 0 2024-02-15T18:27:03.909 INFO:tasks.workunit.client.1.smithi133.stdout:1/283: rename d6/d1e/f57 to d6/d17/f6e 0 2024-02-15T18:27:03.909 INFO:tasks.workunit.client.1.smithi133.stdout:1/284: write d6/f29 [243347,20016] 0 2024-02-15T18:27:03.911 INFO:tasks.workunit.client.0.smithi084.stdout:0/476: mkdir d0/d39/d90 0 2024-02-15T18:27:03.911 INFO:tasks.workunit.client.0.smithi084.stdout:0/477: fdatasync d0/d2f/d3f/f30 0 2024-02-15T18:27:03.914 INFO:tasks.workunit.client.0.smithi084.stdout:4/458: getdents d2/d4/d28/d3d/d5c/d5d 0 2024-02-15T18:27:03.918 INFO:tasks.workunit.client.0.smithi084.stdout:2/438: mkdir d3/d5/d1a/d1e/d30/d8d 0 2024-02-15T18:27:03.920 INFO:tasks.workunit.client.0.smithi084.stdout:6/459: rmdir d14/d22/d25/d2f/d31/d30/d45/d52/d92 0 2024-02-15T18:27:03.920 INFO:tasks.workunit.client.0.smithi084.stdout:8/468: dread db/fe [0,4194304] 0 2024-02-15T18:27:03.922 INFO:tasks.workunit.client.0.smithi084.stdout:7/416: rename df/d1d/d40/d48/f45 to df/d1d/d1a/d4d/d55/f7a 0 2024-02-15T18:27:03.924 INFO:tasks.workunit.client.1.smithi133.stdout:3/204: mknod d0/d15/d2b/d39/c3d 0 2024-02-15T18:27:03.925 INFO:tasks.workunit.client.0.smithi084.stdout:0/478: creat d0/d4/d1b/f91 x:0 0 0 2024-02-15T18:27:03.925 INFO:tasks.workunit.client.0.smithi084.stdout:0/479: chown d0/d4/d3a/c65 36092325 1 2024-02-15T18:27:03.926 INFO:tasks.workunit.client.0.smithi084.stdout:8/469: symlink db/d3f/d59/d69/l9d 0 2024-02-15T18:27:03.926 INFO:tasks.workunit.client.0.smithi084.stdout:8/470: rename db/dd/d13/d42/d79 to db/dd/d13/d42/d79/d9e 22 2024-02-15T18:27:03.927 INFO:tasks.workunit.client.1.smithi133.stdout:1/285: creat d6/d2a/d59/d5a/f6f x:0 0 0 2024-02-15T18:27:03.928 INFO:tasks.workunit.client.0.smithi084.stdout:8/471: symlink db/dd/d4d/l9f 0 2024-02-15T18:27:03.928 INFO:tasks.workunit.client.0.smithi084.stdout:7/417: creat df/d1d/d1a/d4d/d55/f7b x:0 0 0 2024-02-15T18:27:03.928 INFO:tasks.workunit.client.0.smithi084.stdout:7/418: write df/d1d/d1a/d4b/f57 [781927,123899] 0 2024-02-15T18:27:03.928 INFO:tasks.workunit.client.0.smithi084.stdout:7/419: write df/f32 [126212,39494] 0 2024-02-15T18:27:03.928 INFO:tasks.workunit.client.0.smithi084.stdout:7/420: write df/d1d/d40/f73 [1021641,93812] 0 2024-02-15T18:27:03.930 INFO:tasks.workunit.client.0.smithi084.stdout:3/408: dwrite d8/f12 [0,4194304] 0 2024-02-15T18:27:03.930 INFO:tasks.workunit.client.0.smithi084.stdout:3/409: chown d8/d40/c7d 93 1 2024-02-15T18:27:03.931 INFO:tasks.workunit.client.1.smithi133.stdout:4/100: dwrite d2/db/d21/f1c [0,4194304] 0 2024-02-15T18:27:03.931 INFO:tasks.workunit.client.1.smithi133.stdout:4/101: stat d2/d5/l16 0 2024-02-15T18:27:03.931 INFO:tasks.workunit.client.1.smithi133.stdout:4/102: read - d2/f23 zero size 2024-02-15T18:27:03.931 INFO:tasks.workunit.client.1.smithi133.stdout:4/103: stat d2/db/f1a 0 2024-02-15T18:27:03.931 INFO:tasks.workunit.client.0.smithi084.stdout:7/421: mknod df/c7c 0 2024-02-15T18:27:03.934 INFO:tasks.workunit.client.1.smithi133.stdout:3/205: mkdir d0/df/d3e 0 2024-02-15T18:27:03.934 INFO:tasks.workunit.client.1.smithi133.stdout:3/206: chown d0/d15/d2f 0 1 2024-02-15T18:27:03.934 INFO:tasks.workunit.client.0.smithi084.stdout:8/472: rename db/d6a/d7d to db/dd/d1f/d9b/da0 0 2024-02-15T18:27:03.935 INFO:tasks.workunit.client.1.smithi133.stdout:1/286: symlink d6/d1e/l70 0 2024-02-15T18:27:03.935 INFO:tasks.workunit.client.1.smithi133.stdout:1/287: fdatasync d6/d17/f68 0 2024-02-15T18:27:03.938 INFO:tasks.workunit.client.1.smithi133.stdout:1/288: unlink d6/c3b 0 2024-02-15T18:27:03.939 INFO:tasks.workunit.client.0.smithi084.stdout:3/410: rename d8/d22/f52 to d8/d40/d43/f8b 0 2024-02-15T18:27:03.939 INFO:tasks.workunit.client.0.smithi084.stdout:3/411: fsync d8/d40/d58/f72 0 2024-02-15T18:27:03.939 INFO:tasks.workunit.client.0.smithi084.stdout:8/473: link db/d3f/d59/l4f db/dd/d1f/la1 0 2024-02-15T18:27:03.940 INFO:tasks.workunit.client.0.smithi084.stdout:8/474: fsync db/dd/d1f/f38 0 2024-02-15T18:27:03.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/412: write d8/d40/d58/d80/f84 [5264808,97821] 0 2024-02-15T18:27:03.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/413: chown d8/d40/f89 381 1 2024-02-15T18:27:03.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/414: chown d8/d1f/f20 84792 1 2024-02-15T18:27:03.940 INFO:tasks.workunit.client.1.smithi133.stdout:1/289: creat d6/d2a/d59/d5a/f71 x:0 0 0 2024-02-15T18:27:03.941 INFO:tasks.workunit.client.0.smithi084.stdout:8/475: mkdir db/dd/d1f/d66/da2 0 2024-02-15T18:27:03.941 INFO:tasks.workunit.client.0.smithi084.stdout:8/476: fsync db/d1a/f49 0 2024-02-15T18:27:03.941 INFO:tasks.workunit.client.0.smithi084.stdout:3/415: truncate d8/d40/d58/f5e 3208709 0 2024-02-15T18:27:03.942 INFO:tasks.workunit.client.0.smithi084.stdout:8/477: mknod db/dd/d4d/d97/ca3 0 2024-02-15T18:27:03.942 INFO:tasks.workunit.client.0.smithi084.stdout:3/416: mkdir d8/d40/d43/d71/d8c 0 2024-02-15T18:27:03.944 INFO:tasks.workunit.client.0.smithi084.stdout:8/478: symlink db/dd/d1f/d56/la4 0 2024-02-15T18:27:03.944 INFO:tasks.workunit.client.0.smithi084.stdout:8/479: chown db/d1a/d2b/f51 368 1 2024-02-15T18:27:03.944 INFO:tasks.workunit.client.0.smithi084.stdout:3/417: write d8/d40/d58/d80/f7c [719616,87695] 0 2024-02-15T18:27:03.944 INFO:tasks.workunit.client.0.smithi084.stdout:8/480: getdents db/dd/d1f/d7a 0 2024-02-15T18:27:03.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/418: truncate d8/d1f/f20 4117655 0 2024-02-15T18:27:03.951 INFO:tasks.workunit.client.0.smithi084.stdout:3/419: rename d8/d22/f7a to d8/d40/d58/d80/d6b/f8d 0 2024-02-15T18:27:03.951 INFO:tasks.workunit.client.0.smithi084.stdout:3/420: readlink d8/d22/l55 0 2024-02-15T18:27:03.952 INFO:tasks.workunit.client.0.smithi084.stdout:3/421: truncate d8/d40/d58/d80/f5f 326060 0 2024-02-15T18:27:03.960 INFO:tasks.workunit.client.0.smithi084.stdout:3/422: write d8/d40/f67 [2683719,94808] 0 2024-02-15T18:27:03.960 INFO:tasks.workunit.client.0.smithi084.stdout:3/423: write d8/d1f/d2d/f8a [797930,15216] 0 2024-02-15T18:27:03.961 INFO:tasks.workunit.client.0.smithi084.stdout:3/424: truncate d8/d40/f59 783651 0 2024-02-15T18:27:03.962 INFO:tasks.workunit.client.0.smithi084.stdout:3/425: creat d8/d1f/d25/f8e x:0 0 0 2024-02-15T18:27:03.963 INFO:tasks.workunit.client.0.smithi084.stdout:3/426: mknod d8/c8f 0 2024-02-15T18:27:03.983 INFO:tasks.workunit.client.0.smithi084.stdout:1/411: dwrite d9/d54/d1b/d2c/d4b/d63/f6a [4194304,4194304] 0 2024-02-15T18:27:03.987 INFO:tasks.workunit.client.1.smithi133.stdout:8/128: dwrite d3/d7/f26 [0,4194304] 0 2024-02-15T18:27:03.987 INFO:tasks.workunit.client.1.smithi133.stdout:8/129: readlink d3/d1f/l21 0 2024-02-15T18:27:03.989 INFO:tasks.workunit.client.0.smithi084.stdout:1/412: write d9/d54/d1b/f42 [3223111,104308] 0 2024-02-15T18:27:03.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/130: getdents d3/d7 0 2024-02-15T18:27:03.990 INFO:tasks.workunit.client.0.smithi084.stdout:1/413: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/c93 0 2024-02-15T18:27:03.991 INFO:tasks.workunit.client.1.smithi133.stdout:8/131: read d3/d7/f26 [1838646,82301] 0 2024-02-15T18:27:03.991 INFO:tasks.workunit.client.0.smithi084.stdout:0/480: dwrite d0/d4/d3a/f74 [0,4194304] 0 2024-02-15T18:27:03.992 INFO:tasks.workunit.client.0.smithi084.stdout:2/439: dwrite d3/d19/d24/f26 [0,4194304] 0 2024-02-15T18:27:03.992 INFO:tasks.workunit.client.0.smithi084.stdout:1/414: mkdir d9/d54/d5c/d81/d94 0 2024-02-15T18:27:03.992 INFO:tasks.workunit.client.1.smithi133.stdout:4/104: dwrite d2/f1f [0,4194304] 0 2024-02-15T18:27:03.993 INFO:tasks.workunit.client.0.smithi084.stdout:4/459: dwrite d2/d4/d25/d66/f79 [0,4194304] 0 2024-02-15T18:27:03.993 INFO:tasks.workunit.client.0.smithi084.stdout:4/460: fsync d2/d4/d25/f51 0 2024-02-15T18:27:03.994 INFO:tasks.workunit.client.1.smithi133.stdout:5/122: sync 2024-02-15T18:27:03.994 INFO:tasks.workunit.client.1.smithi133.stdout:5/123: chown l1 211366690 1 2024-02-15T18:27:03.994 INFO:tasks.workunit.client.0.smithi084.stdout:0/481: write d0/d4/d1b/f3e [640170,117493] 0 2024-02-15T18:27:03.997 INFO:tasks.workunit.client.0.smithi084.stdout:1/415: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/c95 0 2024-02-15T18:27:03.998 INFO:tasks.workunit.client.0.smithi084.stdout:1/416: chown d9/d54/d5c 195996 1 2024-02-15T18:27:03.998 INFO:tasks.workunit.client.0.smithi084.stdout:0/482: dread d0/d4/d3a/d5c/f52 [0,4194304] 0 2024-02-15T18:27:03.999 INFO:tasks.workunit.client.0.smithi084.stdout:9/510: dwrite d4/d2b/d3c/d20/d75/f7a [0,4194304] 0 2024-02-15T18:27:04.000 INFO:tasks.workunit.client.0.smithi084.stdout:9/511: dread - d4/f9c zero size 2024-02-15T18:27:04.000 INFO:tasks.workunit.client.0.smithi084.stdout:9/512: readlink d4/d36/l7d 0 2024-02-15T18:27:04.000 INFO:tasks.workunit.client.0.smithi084.stdout:9/513: getdents d4/d2b/d3c/d20/d43/d15 0 2024-02-15T18:27:04.001 INFO:tasks.workunit.client.0.smithi084.stdout:4/461: rename d2/d4/d28/d2e/f67 to d2/d2b/d47/d31/f86 0 2024-02-15T18:27:04.001 INFO:tasks.workunit.client.0.smithi084.stdout:8/481: dwrite db/d1a/d2b/f51 [4194304,4194304] 0 2024-02-15T18:27:04.001 INFO:tasks.workunit.client.0.smithi084.stdout:3/427: dwrite d8/d40/d58/d80/d6b/f85 [0,4194304] 0 2024-02-15T18:27:04.001 INFO:tasks.workunit.client.1.smithi133.stdout:5/124: rename d17/d1e to d17/d26 0 2024-02-15T18:27:04.002 INFO:tasks.workunit.client.1.smithi133.stdout:8/132: dread d3/d7/f26 [0,4194304] 0 2024-02-15T18:27:04.002 INFO:tasks.workunit.client.1.smithi133.stdout:1/290: dwrite d6/d2a/d59/f6a [4194304,4194304] 0 2024-02-15T18:27:04.002 INFO:tasks.workunit.client.1.smithi133.stdout:9/138: dwrite d0/d8/d9/ff [0,4194304] 0 2024-02-15T18:27:04.002 INFO:tasks.workunit.client.1.smithi133.stdout:8/133: creat d3/f2e x:0 0 0 2024-02-15T18:27:04.002 INFO:tasks.workunit.client.1.smithi133.stdout:5/125: creat d17/f27 x:0 0 0 2024-02-15T18:27:04.002 INFO:tasks.workunit.client.1.smithi133.stdout:8/134: chown d3/d7/l29 10067322 1 2024-02-15T18:27:04.002 INFO:tasks.workunit.client.1.smithi133.stdout:5/126: truncate ff 1193931 0 2024-02-15T18:27:04.003 INFO:tasks.workunit.client.0.smithi084.stdout:0/483: mknod d0/c92 0 2024-02-15T18:27:04.003 INFO:tasks.workunit.client.1.smithi133.stdout:3/207: rename d0/df to d0/d15/d2b/d39/d3f 0 2024-02-15T18:27:04.003 INFO:tasks.workunit.client.1.smithi133.stdout:3/208: truncate d0/f3a 199808 0 2024-02-15T18:27:04.004 INFO:tasks.workunit.client.1.smithi133.stdout:3/209: read - d0/d15/d2f/f30 zero size 2024-02-15T18:27:04.004 INFO:tasks.workunit.client.1.smithi133.stdout:5/127: write d17/f1c [63038,59949] 0 2024-02-15T18:27:04.007 INFO:tasks.workunit.client.1.smithi133.stdout:8/135: unlink d3/d1c/f27 0 2024-02-15T18:27:04.011 INFO:tasks.workunit.client.1.smithi133.stdout:8/136: mkdir d3/d1c/d2f 0 2024-02-15T18:27:04.014 INFO:tasks.workunit.client.1.smithi133.stdout:8/137: truncate d3/de/ff 1894465 0 2024-02-15T18:27:04.014 INFO:tasks.workunit.client.1.smithi133.stdout:8/138: write d3/d1f/f2c [203690,45053] 0 2024-02-15T18:27:04.014 INFO:tasks.workunit.client.1.smithi133.stdout:8/139: stat d3/c12 0 2024-02-15T18:27:04.014 INFO:tasks.workunit.client.0.smithi084.stdout:8/482: dread db/d1a/f5f [0,4194304] 0 2024-02-15T18:27:04.014 INFO:tasks.workunit.client.0.smithi084.stdout:8/483: chown db/d6a/d76/f8e 43068693 1 2024-02-15T18:27:04.015 INFO:tasks.workunit.client.0.smithi084.stdout:9/514: mkdir d4/da3 0 2024-02-15T18:27:04.018 INFO:tasks.workunit.client.1.smithi133.stdout:4/105: dread d2/db/d21/f1c [0,4194304] 0 2024-02-15T18:27:04.018 INFO:tasks.workunit.client.1.smithi133.stdout:4/106: write d2/f12 [461788,51003] 0 2024-02-15T18:27:04.019 INFO:tasks.workunit.client.0.smithi084.stdout:1/417: dread d9/d54/d1b/d2c/d4b/d63/f6a [0,4194304] 0 2024-02-15T18:27:04.024 INFO:tasks.workunit.client.0.smithi084.stdout:1/418: write d9/d54/d1b/d38/f4a [3555364,73528] 0 2024-02-15T18:27:04.027 INFO:tasks.workunit.client.0.smithi084.stdout:3/428: rmdir d8 39 2024-02-15T18:27:04.027 INFO:tasks.workunit.client.1.smithi133.stdout:4/107: dread d2/fd [0,4194304] 0 2024-02-15T18:27:04.030 INFO:tasks.workunit.client.1.smithi133.stdout:4/108: mkdir d2/d5/d25 0 2024-02-15T18:27:04.030 INFO:tasks.workunit.client.1.smithi133.stdout:4/109: dread - d2/db/d21/f1b zero size 2024-02-15T18:27:04.031 INFO:tasks.workunit.client.0.smithi084.stdout:4/462: dread d2/d2b/f1f [0,4194304] 0 2024-02-15T18:27:04.037 INFO:tasks.workunit.client.0.smithi084.stdout:0/484: getdents d0/d4/d1b 0 2024-02-15T18:27:04.038 INFO:tasks.workunit.client.1.smithi133.stdout:0/151: sync 2024-02-15T18:27:04.038 INFO:tasks.workunit.client.1.smithi133.stdout:2/221: sync 2024-02-15T18:27:04.038 INFO:tasks.workunit.client.1.smithi133.stdout:2/222: write d7/d2c/d31/f38 [803262,24805] 0 2024-02-15T18:27:04.038 INFO:tasks.workunit.client.1.smithi133.stdout:6/247: sync 2024-02-15T18:27:04.039 INFO:tasks.workunit.client.1.smithi133.stdout:4/110: write d2/f1f [394768,96675] 0 2024-02-15T18:27:04.039 INFO:tasks.workunit.client.1.smithi133.stdout:1/291: dwrite d6/d1e/f27 [0,4194304] 0 2024-02-15T18:27:04.039 INFO:tasks.workunit.client.1.smithi133.stdout:1/292: truncate d6/d1e/d41/f58 898506 0 2024-02-15T18:27:04.040 INFO:tasks.workunit.client.0.smithi084.stdout:8/484: mkdir db/d1a/da5 0 2024-02-15T18:27:04.040 INFO:tasks.workunit.client.0.smithi084.stdout:8/485: stat db/dd/d1f/c62 0 2024-02-15T18:27:04.040 INFO:tasks.workunit.client.0.smithi084.stdout:3/429: dread d8/d40/d58/d80/d6b/f6c [0,4194304] 0 2024-02-15T18:27:04.040 INFO:tasks.workunit.client.0.smithi084.stdout:0/485: dread d0/d25/f47 [0,4194304] 0 2024-02-15T18:27:04.040 INFO:tasks.workunit.client.0.smithi084.stdout:0/486: truncate d0/d4/f4e 1177067 0 2024-02-15T18:27:04.041 INFO:tasks.workunit.client.0.smithi084.stdout:1/419: getdents d9/d54/d32 0 2024-02-15T18:27:04.041 INFO:tasks.workunit.client.1.smithi133.stdout:0/152: symlink d9/d10/d19/d1a/l38 0 2024-02-15T18:27:04.043 INFO:tasks.workunit.client.1.smithi133.stdout:2/223: rename d7/db/d35/f39 to d7/d2c/f49 0 2024-02-15T18:27:04.044 INFO:tasks.workunit.client.1.smithi133.stdout:6/248: truncate d0/f14 1669630 0 2024-02-15T18:27:04.045 INFO:tasks.workunit.client.1.smithi133.stdout:5/128: dwrite ff [0,4194304] 0 2024-02-15T18:27:04.045 INFO:tasks.workunit.client.1.smithi133.stdout:5/129: write fc [4177517,68639] 0 2024-02-15T18:27:04.045 INFO:tasks.workunit.client.1.smithi133.stdout:5/130: fdatasync f2 0 2024-02-15T18:27:04.046 INFO:tasks.workunit.client.0.smithi084.stdout:4/463: dread d2/d4/f48 [0,4194304] 0 2024-02-15T18:27:04.046 INFO:tasks.workunit.client.1.smithi133.stdout:4/111: link d2/d5/l17 d2/db/d21/l26 0 2024-02-15T18:27:04.047 INFO:tasks.workunit.client.1.smithi133.stdout:4/112: chown c1 90276935 1 2024-02-15T18:27:04.047 INFO:tasks.workunit.client.0.smithi084.stdout:8/486: unlink db/d1a/f49 0 2024-02-15T18:27:04.047 INFO:tasks.workunit.client.0.smithi084.stdout:8/487: readlink db/d3f/d59/l4f 0 2024-02-15T18:27:04.047 INFO:tasks.workunit.client.0.smithi084.stdout:8/488: chown db/d1a/d2b/f31 16 1 2024-02-15T18:27:04.049 INFO:tasks.workunit.client.0.smithi084.stdout:3/430: rename d8/d22/f24 to d8/d73/f90 0 2024-02-15T18:27:04.049 INFO:tasks.workunit.client.0.smithi084.stdout:3/431: write d8/d40/d58/d80/f7c [1700349,18603] 0 2024-02-15T18:27:04.049 INFO:tasks.workunit.client.1.smithi133.stdout:1/293: mknod d6/d2a/d59/d5a/c72 0 2024-02-15T18:27:04.049 INFO:tasks.workunit.client.0.smithi084.stdout:9/515: dwrite d4/d2b/d3c/d20/d43/d15/f44 [0,4194304] 0 2024-02-15T18:27:04.052 INFO:tasks.workunit.client.1.smithi133.stdout:4/113: dread d2/fd [0,4194304] 0 2024-02-15T18:27:04.052 INFO:tasks.workunit.client.1.smithi133.stdout:4/114: write d2/f23 [731920,104310] 0 2024-02-15T18:27:04.054 INFO:tasks.workunit.client.1.smithi133.stdout:0/153: creat d9/d10/d22/d32/f39 x:0 0 0 2024-02-15T18:27:04.054 INFO:tasks.workunit.client.1.smithi133.stdout:2/224: mkdir d7/db/d35/d4a 0 2024-02-15T18:27:04.054 INFO:tasks.workunit.client.1.smithi133.stdout:2/225: dread - d7/d2c/f44 zero size 2024-02-15T18:27:04.055 INFO:tasks.workunit.client.1.smithi133.stdout:0/154: write f5 [1051511,19468] 0 2024-02-15T18:27:04.057 INFO:tasks.workunit.client.1.smithi133.stdout:9/139: dwrite d0/d8/fd [0,4194304] 0 2024-02-15T18:27:04.058 INFO:tasks.workunit.client.0.smithi084.stdout:0/487: creat d0/d2f/f93 x:0 0 0 2024-02-15T18:27:04.059 INFO:tasks.workunit.client.0.smithi084.stdout:4/464: mknod d2/d4/c87 0 2024-02-15T18:27:04.062 INFO:tasks.workunit.client.1.smithi133.stdout:5/131: creat d17/d20/f28 x:0 0 0 2024-02-15T18:27:04.063 INFO:tasks.workunit.client.1.smithi133.stdout:1/294: creat d6/d17/f73 x:0 0 0 2024-02-15T18:27:04.064 INFO:tasks.workunit.client.0.smithi084.stdout:9/516: link d4/d2b/d3c/d20/d43/d15/d33/l65 d4/da3/la4 0 2024-02-15T18:27:04.064 INFO:tasks.workunit.client.0.smithi084.stdout:0/488: getdents d0/d2f/d3f/d8a 0 2024-02-15T18:27:04.064 INFO:tasks.workunit.client.0.smithi084.stdout:9/517: write d4/d2b/d3c/d20/d43/d15/d33/d7b/f8f [435651,28299] 0 2024-02-15T18:27:04.065 INFO:tasks.workunit.client.1.smithi133.stdout:0/155: creat d9/d28/f3a x:0 0 0 2024-02-15T18:27:04.065 INFO:tasks.workunit.client.1.smithi133.stdout:4/115: truncate d2/fd 388600 0 2024-02-15T18:27:04.067 INFO:tasks.workunit.client.0.smithi084.stdout:3/432: dread d8/d1f/d25/f7f [0,4194304] 0 2024-02-15T18:27:04.068 INFO:tasks.workunit.client.1.smithi133.stdout:1/295: rename d6/d2a/f38 to d6/f74 0 2024-02-15T18:27:04.068 INFO:tasks.workunit.client.1.smithi133.stdout:1/296: truncate d6/d2a/f48 329464 0 2024-02-15T18:27:04.069 INFO:tasks.workunit.client.0.smithi084.stdout:0/489: mknod d0/d4/d1b/d26/d43/d6d/d71/d73/c94 0 2024-02-15T18:27:04.069 INFO:tasks.workunit.client.0.smithi084.stdout:9/518: mkdir d4/d3d/da5 0 2024-02-15T18:27:04.070 INFO:tasks.workunit.client.0.smithi084.stdout:9/519: write d4/d81/f89 [777654,19937] 0 2024-02-15T18:27:04.070 INFO:tasks.workunit.client.0.smithi084.stdout:9/520: chown d4/d2b/d3c/l3e 7 1 2024-02-15T18:27:04.070 INFO:tasks.workunit.client.0.smithi084.stdout:9/521: stat d4/d2b/d3c/d20/d43/c73 0 2024-02-15T18:27:04.070 INFO:tasks.workunit.client.0.smithi084.stdout:0/490: rmdir d0/d2f/d3f/d8a 39 2024-02-15T18:27:04.070 INFO:tasks.workunit.client.0.smithi084.stdout:4/465: dread d2/d4/d28/d3d/d5c/d5d/f63 [0,4194304] 0 2024-02-15T18:27:04.071 INFO:tasks.workunit.client.0.smithi084.stdout:0/491: rmdir d0 39 2024-02-15T18:27:04.071 INFO:tasks.workunit.client.0.smithi084.stdout:9/522: write d4/d2b/d3c/d24/f2a [2901294,1913] 0 2024-02-15T18:27:04.071 INFO:tasks.workunit.client.0.smithi084.stdout:0/492: chown d0/d2f/d3f/f5a 27 1 2024-02-15T18:27:04.071 INFO:tasks.workunit.client.1.smithi133.stdout:4/116: creat d2/d5/d25/f27 x:0 0 0 2024-02-15T18:27:04.071 INFO:tasks.workunit.client.1.smithi133.stdout:4/117: chown d2/db 7 1 2024-02-15T18:27:04.072 INFO:tasks.workunit.client.0.smithi084.stdout:4/466: mkdir d2/d2b/d47/d31/d62/d88 0 2024-02-15T18:27:04.075 INFO:tasks.workunit.client.0.smithi084.stdout:4/467: symlink d2/d2b/d47/d31/d50/l89 0 2024-02-15T18:27:04.076 INFO:tasks.workunit.client.1.smithi133.stdout:4/118: symlink d2/d5/l28 0 2024-02-15T18:27:04.080 INFO:tasks.workunit.client.0.smithi084.stdout:4/468: rename d2/c1a to d2/d4/d28/d3d/d5c/d65/c8a 0 2024-02-15T18:27:04.081 INFO:tasks.workunit.client.0.smithi084.stdout:8/489: dwrite db/f74 [0,4194304] 0 2024-02-15T18:27:04.083 INFO:tasks.workunit.client.0.smithi084.stdout:1/420: dwrite d9/d54/d1b/d2c/d4b/d63/f6a [4194304,4194304] 0 2024-02-15T18:27:04.083 INFO:tasks.workunit.client.0.smithi084.stdout:1/421: write d9/d54/d1b/d2c/d4b/d4c/d79/f2f [4429085,61585] 0 2024-02-15T18:27:04.083 INFO:tasks.workunit.client.0.smithi084.stdout:4/469: write d2/d2b/f1f [3824461,100685] 0 2024-02-15T18:27:04.086 INFO:tasks.workunit.client.1.smithi133.stdout:4/119: dread f0 [0,4194304] 0 2024-02-15T18:27:04.089 INFO:tasks.workunit.client.1.smithi133.stdout:4/120: rename f0 to d2/f29 0 2024-02-15T18:27:04.090 INFO:tasks.workunit.client.1.smithi133.stdout:4/121: write d2/db/f1d [1028255,88524] 0 2024-02-15T18:27:04.090 INFO:tasks.workunit.client.0.smithi084.stdout:8/490: mkdir db/dd/d13/d42/d79/da6 0 2024-02-15T18:27:04.092 INFO:tasks.workunit.client.1.smithi133.stdout:4/122: link d2/db/f1a d2/f2a 0 2024-02-15T18:27:04.092 INFO:tasks.workunit.client.0.smithi084.stdout:1/422: creat d9/d54/d1b/d2c/d4b/d7a/d89/f96 x:0 0 0 2024-02-15T18:27:04.092 INFO:tasks.workunit.client.0.smithi084.stdout:1/423: truncate d9/d54/d1b/d38/f83 654733 0 2024-02-15T18:27:04.093 INFO:tasks.workunit.client.0.smithi084.stdout:4/470: rename d2/l40 to d2/d4/d28/d3d/l8b 0 2024-02-15T18:27:04.094 INFO:tasks.workunit.client.0.smithi084.stdout:8/491: truncate db/f77 285904 0 2024-02-15T18:27:04.094 INFO:tasks.workunit.client.0.smithi084.stdout:4/471: write d2/d4/f48 [341457,62565] 0 2024-02-15T18:27:04.095 INFO:tasks.workunit.client.0.smithi084.stdout:1/424: symlink d9/d54/d5c/d81/d94/l97 0 2024-02-15T18:27:04.095 INFO:tasks.workunit.client.0.smithi084.stdout:1/425: stat d9/d54/d1b/d2c/d35/f8a 0 2024-02-15T18:27:04.096 INFO:tasks.workunit.client.0.smithi084.stdout:1/426: write d9/d54/d32/d5b/f75 [519825,35361] 0 2024-02-15T18:27:04.097 INFO:tasks.workunit.client.0.smithi084.stdout:1/427: creat d9/d54/d1b/d2c/d4b/d7a/d89/f98 x:0 0 0 2024-02-15T18:27:04.097 INFO:tasks.workunit.client.0.smithi084.stdout:1/428: creat d9/d54/f99 x:0 0 0 2024-02-15T18:27:04.099 INFO:tasks.workunit.client.0.smithi084.stdout:8/492: write db/d1a/d2b/f4b [503117,100291] 0 2024-02-15T18:27:04.099 INFO:tasks.workunit.client.0.smithi084.stdout:8/493: stat db/dd/c50 0 2024-02-15T18:27:04.099 INFO:tasks.workunit.client.0.smithi084.stdout:1/429: rmdir d9/d54/d76 39 2024-02-15T18:27:04.103 INFO:tasks.workunit.client.0.smithi084.stdout:1/430: read d9/d54/d1b/d2c/d4b/d4c/d79/f2f [1375618,49366] 0 2024-02-15T18:27:04.103 INFO:tasks.workunit.client.0.smithi084.stdout:1/431: chown d9/f14 2 1 2024-02-15T18:27:04.104 INFO:tasks.workunit.client.0.smithi084.stdout:1/432: creat d9/d54/d1b/d2c/d4b/d7a/d89/f9a x:0 0 0 2024-02-15T18:27:04.104 INFO:tasks.workunit.client.0.smithi084.stdout:1/433: chown d9/d54/d32/c7c 1506794 1 2024-02-15T18:27:04.118 INFO:tasks.workunit.client.0.smithi084.stdout:8/494: dread db/d1a/d2b/f51 [0,4194304] 0 2024-02-15T18:27:04.131 INFO:tasks.workunit.client.1.smithi133.stdout:9/140: dwrite d0/f27 [0,4194304] 0 2024-02-15T18:27:04.131 INFO:tasks.workunit.client.1.smithi133.stdout:9/141: fsync d0/d8/d9/f26 0 2024-02-15T18:27:04.132 INFO:tasks.workunit.client.0.smithi084.stdout:9/523: dwrite d4/d2b/d3c/d20/d43/d15/d5d/f8e [0,4194304] 0 2024-02-15T18:27:04.132 INFO:tasks.workunit.client.1.smithi133.stdout:5/132: dwrite d17/d20/f22 [0,4194304] 0 2024-02-15T18:27:04.132 INFO:tasks.workunit.client.1.smithi133.stdout:1/297: dwrite d6/d32/f45 [0,4194304] 0 2024-02-15T18:27:04.133 INFO:tasks.workunit.client.1.smithi133.stdout:4/123: fdatasync d2/db/f1d 0 2024-02-15T18:27:04.133 INFO:tasks.workunit.client.1.smithi133.stdout:8/140: dwrite d3/d1f/f2c [0,4194304] 0 2024-02-15T18:27:04.133 INFO:tasks.workunit.client.0.smithi084.stdout:4/472: dwrite d2/d2b/d47/f3c [0,4194304] 0 2024-02-15T18:27:04.133 INFO:tasks.workunit.client.0.smithi084.stdout:3/433: dwrite d8/f15 [4194304,4194304] 0 2024-02-15T18:27:04.135 INFO:tasks.workunit.client.0.smithi084.stdout:0/493: dwrite d0/d2f/d3f/d4f/d59/f60 [0,4194304] 0 2024-02-15T18:27:04.135 INFO:tasks.workunit.client.0.smithi084.stdout:0/494: chown d0/d4/d1b/d26/d43/l80 216321030 1 2024-02-15T18:27:04.135 INFO:tasks.workunit.client.0.smithi084.stdout:1/434: dwrite d9/d54/d1b/f5e [0,4194304] 0 2024-02-15T18:27:04.135 INFO:tasks.workunit.client.1.smithi133.stdout:1/298: write d6/f74 [1443087,60863] 0 2024-02-15T18:27:04.136 INFO:tasks.workunit.client.0.smithi084.stdout:9/524: link d4/d2b/d3c/l83 d4/d36/la6 0 2024-02-15T18:27:04.136 INFO:tasks.workunit.client.0.smithi084.stdout:0/495: dread d0/d2f/d3f/d4f/d61/f70 [0,4194304] 0 2024-02-15T18:27:04.137 INFO:tasks.workunit.client.1.smithi133.stdout:9/142: symlink d0/l2b 0 2024-02-15T18:27:04.138 INFO:tasks.workunit.client.1.smithi133.stdout:9/143: dread d0/d8/d10/f14 [0,4194304] 0 2024-02-15T18:27:04.138 INFO:tasks.workunit.client.0.smithi084.stdout:4/473: rename d2/d4/d28/d2e/f57 to d2/d2b/d47/d31/d61/f8c 0 2024-02-15T18:27:04.141 INFO:tasks.workunit.client.0.smithi084.stdout:3/434: creat d8/d40/f91 x:0 0 0 2024-02-15T18:27:04.148 INFO:tasks.workunit.client.1.smithi133.stdout:4/124: rename d2/db to d2/d5/d2b 0 2024-02-15T18:27:04.148 INFO:tasks.workunit.client.1.smithi133.stdout:1/299: mkdir d6/d1e/d3a/d75 0 2024-02-15T18:27:04.149 INFO:tasks.workunit.client.1.smithi133.stdout:9/144: mknod d0/d8/c2c 0 2024-02-15T18:27:04.150 INFO:tasks.workunit.client.1.smithi133.stdout:4/125: symlink d2/d5/d2b/l2c 0 2024-02-15T18:27:04.152 INFO:tasks.workunit.client.1.smithi133.stdout:9/145: symlink d0/d8/d10/l2d 0 2024-02-15T18:27:04.153 INFO:tasks.workunit.client.1.smithi133.stdout:4/126: mkdir d2/d5/d2b/d21/d2d 0 2024-02-15T18:27:04.153 INFO:tasks.workunit.client.1.smithi133.stdout:4/127: write d2/fd [1368588,82488] 0 2024-02-15T18:27:04.153 INFO:tasks.workunit.client.1.smithi133.stdout:4/128: write d2/d5/d2b/f24 [32840,65302] 0 2024-02-15T18:27:04.158 INFO:tasks.workunit.client.1.smithi133.stdout:4/129: creat d2/d5/d2b/d21/d2d/f2e x:0 0 0 2024-02-15T18:27:04.158 INFO:tasks.workunit.client.1.smithi133.stdout:4/130: write d2/d5/d25/f27 [823230,1111] 0 2024-02-15T18:27:04.160 INFO:tasks.workunit.client.1.smithi133.stdout:4/131: creat d2/f2f x:0 0 0 2024-02-15T18:27:04.163 INFO:tasks.workunit.client.0.smithi084.stdout:1/435: truncate d9/f14 8354389 0 2024-02-15T18:27:04.164 INFO:tasks.workunit.client.0.smithi084.stdout:9/525: creat d4/d2b/d3c/d20/fa7 x:0 0 0 2024-02-15T18:27:04.165 INFO:tasks.workunit.client.1.smithi133.stdout:9/146: dread d0/d8/d9/d12/f1b [0,4194304] 0 2024-02-15T18:27:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:1/436: write d9/d54/d1b/d2c/f43 [3030530,86499] 0 2024-02-15T18:27:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:1/437: write d9/d54/d32/d5b/f75 [1187207,30529] 0 2024-02-15T18:27:04.165 INFO:tasks.workunit.client.0.smithi084.stdout:0/496: creat d0/f95 x:0 0 0 2024-02-15T18:27:04.166 INFO:tasks.workunit.client.1.smithi133.stdout:4/132: dread d2/f23 [0,4194304] 0 2024-02-15T18:27:04.166 INFO:tasks.workunit.client.1.smithi133.stdout:9/147: rename d0/d8/d9/f26 to d0/d8/d9/d12/d2a/f2e 0 2024-02-15T18:27:04.167 INFO:tasks.workunit.client.0.smithi084.stdout:3/435: creat d8/d1f/d2d/f92 x:0 0 0 2024-02-15T18:27:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:9/526: rename d4/d2b/d3c/d24/f58 to d4/d2b/d3c/d20/d75/d87/fa8 0 2024-02-15T18:27:04.168 INFO:tasks.workunit.client.0.smithi084.stdout:9/527: write d4/d2b/d3c/d20/d43/f64 [585294,86529] 0 2024-02-15T18:27:04.171 INFO:tasks.workunit.client.0.smithi084.stdout:1/438: mknod d9/d54/d1b/c9b 0 2024-02-15T18:27:04.171 INFO:tasks.workunit.client.0.smithi084.stdout:0/497: mknod d0/d4/d1b/d7a/c96 0 2024-02-15T18:27:04.171 INFO:tasks.workunit.client.0.smithi084.stdout:0/498: write d0/d4/f4e [104423,59250] 0 2024-02-15T18:27:04.174 INFO:tasks.workunit.client.0.smithi084.stdout:3/436: write d8/d40/d58/d80/f2b [4822597,92614] 0 2024-02-15T18:27:04.175 INFO:tasks.workunit.client.0.smithi084.stdout:3/437: mkdir d8/d73/d93 0 2024-02-15T18:27:04.177 INFO:tasks.workunit.client.0.smithi084.stdout:3/438: mkdir d8/d40/d43/d71/d8c/d94 0 2024-02-15T18:27:04.181 INFO:tasks.workunit.client.1.smithi133.stdout:8/141: dwrite d3/f22 [0,4194304] 0 2024-02-15T18:27:04.182 INFO:tasks.workunit.client.0.smithi084.stdout:9/528: dread d4/d2b/d3c/d20/d43/d15/d5d/f8e [0,4194304] 0 2024-02-15T18:27:04.185 INFO:tasks.workunit.client.1.smithi133.stdout:8/142: getdents d3/d1c 0 2024-02-15T18:27:04.186 INFO:tasks.workunit.client.1.smithi133.stdout:4/133: dread d2/d5/f10 [0,4194304] 0 2024-02-15T18:27:04.186 INFO:tasks.workunit.client.1.smithi133.stdout:4/134: chown d2/d5/l28 4 1 2024-02-15T18:27:04.186 INFO:tasks.workunit.client.0.smithi084.stdout:4/474: dwrite d2/f5e [0,4194304] 0 2024-02-15T18:27:04.187 INFO:tasks.workunit.client.1.smithi133.stdout:5/133: dwrite d17/d20/f22 [0,4194304] 0 2024-02-15T18:27:04.187 INFO:tasks.workunit.client.1.smithi133.stdout:8/143: write d3/d1f/f23 [3573091,28430] 0 2024-02-15T18:27:04.188 INFO:tasks.workunit.client.0.smithi084.stdout:5/538: sync 2024-02-15T18:27:04.188 INFO:tasks.workunit.client.0.smithi084.stdout:6/460: sync 2024-02-15T18:27:04.188 INFO:tasks.workunit.client.0.smithi084.stdout:7/422: sync 2024-02-15T18:27:04.188 INFO:tasks.workunit.client.0.smithi084.stdout:5/539: fsync d9/da/d3d/d44/f86 0 2024-02-15T18:27:04.189 INFO:tasks.workunit.client.0.smithi084.stdout:2/440: sync 2024-02-15T18:27:04.189 INFO:tasks.workunit.client.1.smithi133.stdout:9/148: dwrite d0/d8/d10/f14 [0,4194304] 0 2024-02-15T18:27:04.190 INFO:tasks.workunit.client.1.smithi133.stdout:9/149: truncate d0/d8/d9/d12/f21 5228221 0 2024-02-15T18:27:04.192 INFO:tasks.workunit.client.1.smithi133.stdout:1/300: dwrite d6/d1e/d41/f66 [0,4194304] 0 2024-02-15T18:27:04.192 INFO:tasks.workunit.client.0.smithi084.stdout:9/529: dread d4/d2b/d3c/d20/d43/d15/f40 [0,4194304] 0 2024-02-15T18:27:04.193 INFO:tasks.workunit.client.0.smithi084.stdout:5/540: link d9/d5b/d79/f7d d9/d5b/d7e/d92/fb0 0 2024-02-15T18:27:04.193 INFO:tasks.workunit.client.0.smithi084.stdout:5/541: chown d9/d23/ca0 12170 1 2024-02-15T18:27:04.194 INFO:tasks.workunit.client.1.smithi133.stdout:9/150: write d0/f27 [2183121,53581] 0 2024-02-15T18:27:04.196 INFO:tasks.workunit.client.0.smithi084.stdout:0/499: dread d0/d4/d1b/f6f [0,4194304] 0 2024-02-15T18:27:04.196 INFO:tasks.workunit.client.1.smithi133.stdout:4/135: truncate d2/d5/d2b/fe 1774938 0 2024-02-15T18:27:04.196 INFO:tasks.workunit.client.1.smithi133.stdout:4/136: readlink d2/d5/l16 0 2024-02-15T18:27:04.197 INFO:tasks.workunit.client.0.smithi084.stdout:7/423: mknod df/d70/c7d 0 2024-02-15T18:27:04.197 INFO:tasks.workunit.client.0.smithi084.stdout:2/441: mkdir d3/d5/d1a/d74/d8e 0 2024-02-15T18:27:04.197 INFO:tasks.workunit.client.0.smithi084.stdout:9/530: truncate d4/d3d/f61 1000153 0 2024-02-15T18:27:04.197 INFO:tasks.workunit.client.0.smithi084.stdout:9/531: stat d4/d2b/d3c/d20/d75/f7a 0 2024-02-15T18:27:04.197 INFO:tasks.workunit.client.0.smithi084.stdout:9/532: chown d4/d2b/d3c/d24/f68 813410 1 2024-02-15T18:27:04.197 INFO:tasks.workunit.client.0.smithi084.stdout:9/533: dread - d4/d3d/f94 zero size 2024-02-15T18:27:04.197 INFO:tasks.workunit.client.1.smithi133.stdout:8/144: symlink d3/d1c/l30 0 2024-02-15T18:27:04.198 INFO:tasks.workunit.client.0.smithi084.stdout:4/475: dread d2/d2b/d47/f3b [0,4194304] 0 2024-02-15T18:27:04.199 INFO:tasks.workunit.client.0.smithi084.stdout:5/542: unlink d9/da/f73 0 2024-02-15T18:27:04.199 INFO:tasks.workunit.client.0.smithi084.stdout:5/543: chown d9/l94 87779 1 2024-02-15T18:27:04.199 INFO:tasks.workunit.client.1.smithi133.stdout:1/301: mkdir d6/d1e/d76 0 2024-02-15T18:27:04.199 INFO:tasks.workunit.client.1.smithi133.stdout:1/302: fsync d6/d2a/f3f 0 2024-02-15T18:27:04.200 INFO:tasks.workunit.client.0.smithi084.stdout:3/439: dread d8/d73/f90 [0,4194304] 0 2024-02-15T18:27:04.201 INFO:tasks.workunit.client.0.smithi084.stdout:0/500: mknod d0/d25/c97 0 2024-02-15T18:27:04.203 INFO:tasks.workunit.client.0.smithi084.stdout:7/424: unlink df/d1d/d40/d48/l47 0 2024-02-15T18:27:04.203 INFO:tasks.workunit.client.0.smithi084.stdout:2/442: getdents d3/d5 0 2024-02-15T18:27:04.203 INFO:tasks.workunit.client.0.smithi084.stdout:2/443: fdatasync d3/d5/d1a/d1e/f61 0 2024-02-15T18:27:04.203 INFO:tasks.workunit.client.0.smithi084.stdout:2/444: read - d3/d5/d1a/d1e/d30/f67 zero size 2024-02-15T18:27:04.203 INFO:tasks.workunit.client.0.smithi084.stdout:2/445: dread - d3/d19/d24/d89/f72 zero size 2024-02-15T18:27:04.205 INFO:tasks.workunit.client.0.smithi084.stdout:3/440: mknod d8/d40/d58/d80/d6b/c95 0 2024-02-15T18:27:04.210 INFO:tasks.workunit.client.0.smithi084.stdout:8/495: dwrite db/f77 [0,4194304] 0 2024-02-15T18:27:04.210 INFO:tasks.workunit.client.0.smithi084.stdout:1/439: dwrite d9/d54/f82 [0,4194304] 0 2024-02-15T18:27:04.210 INFO:tasks.workunit.client.0.smithi084.stdout:8/496: fdatasync db/d3f/d59/f48 0 2024-02-15T18:27:04.210 INFO:tasks.workunit.client.0.smithi084.stdout:8/497: fdatasync db/dd/d4d/f5b 0 2024-02-15T18:27:04.210 INFO:tasks.workunit.client.0.smithi084.stdout:1/440: write d9/d54/d1b/d2c/d4b/d4c/d79/d39/f30 [4697038,210] 0 2024-02-15T18:27:04.212 INFO:tasks.workunit.client.0.smithi084.stdout:0/501: truncate d0/d4/d1b/f3e 1761861 0 2024-02-15T18:27:04.215 INFO:tasks.workunit.client.0.smithi084.stdout:2/446: rename d3/d5/d1a/d2d/f7f to d3/d19/d24/d3e/d5c/f8f 0 2024-02-15T18:27:04.216 INFO:tasks.workunit.client.0.smithi084.stdout:3/441: creat d8/d1f/d2d/f96 x:0 0 0 2024-02-15T18:27:04.216 INFO:tasks.workunit.client.0.smithi084.stdout:3/442: getdents d8/d40/d43/d71/d8c/d94 0 2024-02-15T18:27:04.221 INFO:tasks.workunit.client.0.smithi084.stdout:4/476: dread d2/d4/d28/d3d/d5c/d65/f69 [0,4194304] 0 2024-02-15T18:27:04.222 INFO:tasks.workunit.client.0.smithi084.stdout:2/447: symlink d3/d5/d53/l90 0 2024-02-15T18:27:04.225 INFO:tasks.workunit.client.1.smithi133.stdout:9/151: dwrite d0/f25 [0,4194304] 0 2024-02-15T18:27:04.226 INFO:tasks.workunit.client.0.smithi084.stdout:4/477: symlink d2/d4/d25/l8d 0 2024-02-15T18:27:04.226 INFO:tasks.workunit.client.0.smithi084.stdout:4/478: fdatasync d2/d64/d74/f78 0 2024-02-15T18:27:04.227 INFO:tasks.workunit.client.0.smithi084.stdout:2/448: mkdir d3/d19/d24/d91 0 2024-02-15T18:27:04.228 INFO:tasks.workunit.client.0.smithi084.stdout:2/449: chown d3/d19/d24/d3e/f8c 2183 1 2024-02-15T18:27:04.228 INFO:tasks.workunit.client.0.smithi084.stdout:4/479: mknod d2/d4/d28/d71/c8e 0 2024-02-15T18:27:04.229 INFO:tasks.workunit.client.0.smithi084.stdout:4/480: mkdir d2/d64/d74/d8f 0 2024-02-15T18:27:04.231 INFO:tasks.workunit.client.0.smithi084.stdout:8/498: dread db/d1a/d2b/f31 [0,4194304] 0 2024-02-15T18:27:04.233 INFO:tasks.workunit.client.1.smithi133.stdout:9/152: write d0/f6 [2348379,96952] 0 2024-02-15T18:27:04.236 INFO:tasks.workunit.client.1.smithi133.stdout:9/153: creat d0/d8/d10/f2f x:0 0 0 2024-02-15T18:27:04.238 INFO:tasks.workunit.client.1.smithi133.stdout:9/154: creat d0/d8/d10/f30 x:0 0 0 2024-02-15T18:27:04.241 INFO:tasks.workunit.client.1.smithi133.stdout:9/155: rename d0/d8/d9/fb to d0/d8/d9/f31 0 2024-02-15T18:27:04.241 INFO:tasks.workunit.client.1.smithi133.stdout:9/156: chown d0/f25 3050 1 2024-02-15T18:27:04.241 INFO:tasks.workunit.client.1.smithi133.stdout:1/303: dwrite d6/d17/f68 [0,4194304] 0 2024-02-15T18:27:04.242 INFO:tasks.workunit.client.0.smithi084.stdout:4/481: dread d2/d2b/d47/f3c [0,4194304] 0 2024-02-15T18:27:04.242 INFO:tasks.workunit.client.0.smithi084.stdout:4/482: chown d2/d64/d74 128433283 1 2024-02-15T18:27:04.242 INFO:tasks.workunit.client.0.smithi084.stdout:4/483: write d2/f84 [1038462,113713] 0 2024-02-15T18:27:04.242 INFO:tasks.workunit.client.0.smithi084.stdout:4/484: chown d2/d4/d28/f4b 813274 1 2024-02-15T18:27:04.242 INFO:tasks.workunit.client.0.smithi084.stdout:4/485: dread - d2/d4/d28/d3d/d5c/d5d/f7e zero size 2024-02-15T18:27:04.242 INFO:tasks.workunit.client.0.smithi084.stdout:4/486: fsync d2/d2b/f1f 0 2024-02-15T18:27:04.242 INFO:tasks.workunit.client.1.smithi133.stdout:9/157: mknod d0/d8/d9/d12/c32 0 2024-02-15T18:27:04.246 INFO:tasks.workunit.client.1.smithi133.stdout:1/304: creat d6/d2a/d59/f77 x:0 0 0 2024-02-15T18:27:04.246 INFO:tasks.workunit.client.1.smithi133.stdout:9/158: symlink d0/d8/d9/d12/d2a/l33 0 2024-02-15T18:27:04.247 INFO:tasks.workunit.client.0.smithi084.stdout:4/487: link d2/d4/f82 d2/d4/d28/d3d/f90 0 2024-02-15T18:27:04.249 INFO:tasks.workunit.client.0.smithi084.stdout:4/488: mknod d2/d4/d28/d3d/d5c/d5d/c91 0 2024-02-15T18:27:04.249 INFO:tasks.workunit.client.1.smithi133.stdout:1/305: mknod d6/d1e/d3a/d75/c78 0 2024-02-15T18:27:04.250 INFO:tasks.workunit.client.1.smithi133.stdout:8/145: dwrite d3/f14 [0,4194304] 0 2024-02-15T18:27:04.251 INFO:tasks.workunit.client.1.smithi133.stdout:8/146: fsync d3/f1a 0 2024-02-15T18:27:04.252 INFO:tasks.workunit.client.0.smithi084.stdout:4/489: rename d2/f15 to d2/d4/d28/d3d/f92 0 2024-02-15T18:27:04.252 INFO:tasks.workunit.client.0.smithi084.stdout:4/490: chown d2/d2b/l73 90 1 2024-02-15T18:27:04.252 INFO:tasks.workunit.client.0.smithi084.stdout:7/425: rmdir df/d1d/d40 39 2024-02-15T18:27:04.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/147: creat d3/d1f/f31 x:0 0 0 2024-02-15T18:27:04.254 INFO:tasks.workunit.client.0.smithi084.stdout:7/426: creat df/d1d/d1a/d4b/f7e x:0 0 0 2024-02-15T18:27:04.254 INFO:tasks.workunit.client.1.smithi133.stdout:8/148: link d3/cd d3/d1c/c32 0 2024-02-15T18:27:04.257 INFO:tasks.workunit.client.0.smithi084.stdout:7/427: mkdir df/d1d/d40/d7f 0 2024-02-15T18:27:04.259 INFO:tasks.workunit.client.0.smithi084.stdout:7/428: link df/d1d/d1a/d4d/l52 df/d1d/d1a/d4d/d59/l80 0 2024-02-15T18:27:04.264 INFO:tasks.workunit.client.0.smithi084.stdout:7/429: write f4 [444964,32747] 0 2024-02-15T18:27:04.265 INFO:tasks.workunit.client.1.smithi133.stdout:8/149: dread d3/de/ff [0,4194304] 0 2024-02-15T18:27:04.266 INFO:tasks.workunit.client.0.smithi084.stdout:7/430: creat df/d1d/d1a/f81 x:0 0 0 2024-02-15T18:27:04.266 INFO:tasks.workunit.client.0.smithi084.stdout:9/534: dwrite d4/d36/f5e [0,4194304] 0 2024-02-15T18:27:04.267 INFO:tasks.workunit.client.1.smithi133.stdout:8/150: symlink d3/d1c/d2f/l33 0 2024-02-15T18:27:04.268 INFO:tasks.workunit.client.1.smithi133.stdout:8/151: symlink d3/d1c/d2f/l34 0 2024-02-15T18:27:04.272 INFO:tasks.workunit.client.0.smithi084.stdout:0/502: dwrite d0/d2f/d3f/f17 [0,4194304] 0 2024-02-15T18:27:04.272 INFO:tasks.workunit.client.0.smithi084.stdout:0/503: chown d0/d25 12 1 2024-02-15T18:27:04.273 INFO:tasks.workunit.client.0.smithi084.stdout:3/443: dwrite d8/d40/d58/d80/f2b [0,4194304] 0 2024-02-15T18:27:04.274 INFO:tasks.workunit.client.0.smithi084.stdout:0/504: mkdir d0/d98 0 2024-02-15T18:27:04.275 INFO:tasks.workunit.client.0.smithi084.stdout:3/444: rename d8/d40/d58/c64 to d8/d73/d93/c97 0 2024-02-15T18:27:04.276 INFO:tasks.workunit.client.0.smithi084.stdout:0/505: creat d0/f99 x:0 0 0 2024-02-15T18:27:04.277 INFO:tasks.workunit.client.0.smithi084.stdout:0/506: getdents d0/d4/d1b/d7a 0 2024-02-15T18:27:04.278 INFO:tasks.workunit.client.0.smithi084.stdout:7/431: dread df/d1d/d1a/f53 [0,4194304] 0 2024-02-15T18:27:04.301 INFO:tasks.workunit.client.0.smithi084.stdout:0/507: dwrite d0/d2f/f56 [0,4194304] 0 2024-02-15T18:27:04.303 INFO:tasks.workunit.client.0.smithi084.stdout:0/508: mkdir d0/d2f/d3f/d4c/d9a 0 2024-02-15T18:27:04.303 INFO:tasks.workunit.client.0.smithi084.stdout:0/509: chown d0/d39 74 1 2024-02-15T18:27:04.308 INFO:tasks.workunit.client.0.smithi084.stdout:5/544: dwrite d9/da/f99 [4194304,4194304] 0 2024-02-15T18:27:04.308 INFO:tasks.workunit.client.0.smithi084.stdout:8/499: dwrite db/d6a/f9c [0,4194304] 0 2024-02-15T18:27:04.308 INFO:tasks.workunit.client.0.smithi084.stdout:2/450: dwrite d3/d5/d1a/f81 [0,4194304] 0 2024-02-15T18:27:04.308 INFO:tasks.workunit.client.0.smithi084.stdout:8/500: truncate db/dd/d4d/f5b 1759743 0 2024-02-15T18:27:04.309 INFO:tasks.workunit.client.0.smithi084.stdout:0/510: link d0/d4/d1b/f55 d0/d4/d1b/d26/d43/d6d/d71/d73/f9b 0 2024-02-15T18:27:04.310 INFO:tasks.workunit.client.1.smithi133.stdout:1/306: dwrite d6/d1e/f27 [0,4194304] 0 2024-02-15T18:27:04.310 INFO:tasks.workunit.client.0.smithi084.stdout:4/491: dwrite d2/f5e [0,4194304] 0 2024-02-15T18:27:04.311 INFO:tasks.workunit.client.0.smithi084.stdout:9/535: dwrite d4/d2b/d3c/d20/d43/f95 [0,4194304] 0 2024-02-15T18:27:04.311 INFO:tasks.workunit.client.0.smithi084.stdout:9/536: truncate d4/d6b/f97 1341576 0 2024-02-15T18:27:04.313 INFO:tasks.workunit.client.0.smithi084.stdout:2/451: symlink d3/d5/d1a/d1e/d30/d8d/l92 0 2024-02-15T18:27:04.314 INFO:tasks.workunit.client.0.smithi084.stdout:8/501: mknod db/dd/d1f/d7a/ca7 0 2024-02-15T18:27:04.314 INFO:tasks.workunit.client.1.smithi133.stdout:9/159: rmdir d0/d8/d10 39 2024-02-15T18:27:04.315 INFO:tasks.workunit.client.0.smithi084.stdout:9/537: symlink d4/d36/la9 0 2024-02-15T18:27:04.315 INFO:tasks.workunit.client.0.smithi084.stdout:4/492: dread d2/d4/d28/d3d/d5c/d65/f69 [0,4194304] 0 2024-02-15T18:27:04.316 INFO:tasks.workunit.client.1.smithi133.stdout:1/307: mkdir d6/d1e/d3a/d79 0 2024-02-15T18:27:04.316 INFO:tasks.workunit.client.1.smithi133.stdout:1/308: chown d6/d17/f6e 19 1 2024-02-15T18:27:04.317 INFO:tasks.workunit.client.0.smithi084.stdout:8/502: mkdir db/dd/d1f/d7a/da8 0 2024-02-15T18:27:04.318 INFO:tasks.workunit.client.0.smithi084.stdout:8/503: write db/f3a [839627,117334] 0 2024-02-15T18:27:04.318 INFO:tasks.workunit.client.0.smithi084.stdout:9/538: rename d4/d2b/d3c/d20/d43/fa1 to d4/d2b/d3c/d24/faa 0 2024-02-15T18:27:04.319 INFO:tasks.workunit.client.1.smithi133.stdout:8/152: rmdir d3/d1f 39 2024-02-15T18:27:04.319 INFO:tasks.workunit.client.0.smithi084.stdout:9/539: write d4/d2b/d3c/d20/d43/d15/d4b/f51 [301889,33502] 0 2024-02-15T18:27:04.320 INFO:tasks.workunit.client.1.smithi133.stdout:9/160: symlink d0/d8/l34 0 2024-02-15T18:27:04.320 INFO:tasks.workunit.client.0.smithi084.stdout:4/493: truncate d2/f11 123154 0 2024-02-15T18:27:04.320 INFO:tasks.workunit.client.0.smithi084.stdout:5/545: write d9/d5f/d68/f83 [3625924,126491] 0 2024-02-15T18:27:04.320 INFO:tasks.workunit.client.0.smithi084.stdout:7/432: dwrite fb [0,4194304] 0 2024-02-15T18:27:04.322 INFO:tasks.workunit.client.1.smithi133.stdout:1/309: unlink d6/d32/c36 0 2024-02-15T18:27:04.322 INFO:tasks.workunit.client.0.smithi084.stdout:2/452: mknod d3/d19/d24/c93 0 2024-02-15T18:27:04.324 INFO:tasks.workunit.client.0.smithi084.stdout:8/504: creat db/d1a/d5e/fa9 x:0 0 0 2024-02-15T18:27:04.324 INFO:tasks.workunit.client.0.smithi084.stdout:9/540: creat d4/d36/d6f/fab x:0 0 0 2024-02-15T18:27:04.324 INFO:tasks.workunit.client.0.smithi084.stdout:9/541: truncate d4/f6 8623450 0 2024-02-15T18:27:04.325 INFO:tasks.workunit.client.1.smithi133.stdout:8/153: rename d3/la to d3/d1c/d2f/l35 0 2024-02-15T18:27:04.325 INFO:tasks.workunit.client.1.smithi133.stdout:1/310: stat d6/d32/l5c 0 2024-02-15T18:27:04.326 INFO:tasks.workunit.client.1.smithi133.stdout:8/154: creat d3/d1c/d2f/f36 x:0 0 0 2024-02-15T18:27:04.327 INFO:tasks.workunit.client.1.smithi133.stdout:8/155: mkdir d3/d1c/d37 0 2024-02-15T18:27:04.338 INFO:tasks.workunit.client.1.smithi133.stdout:1/311: dread d6/d17/f60 [0,4194304] 0 2024-02-15T18:27:04.338 INFO:tasks.workunit.client.0.smithi084.stdout:5/546: dwrite d9/da/d3d/f4f [0,4194304] 0 2024-02-15T18:27:04.358 INFO:tasks.workunit.client.1.smithi133.stdout:8/156: dwrite d3/d1f/f23 [0,4194304] 0 2024-02-15T18:27:04.359 INFO:tasks.workunit.client.1.smithi133.stdout:1/312: dwrite d6/d17/f18 [0,4194304] 0 2024-02-15T18:27:04.361 INFO:tasks.workunit.client.1.smithi133.stdout:1/313: creat d6/d1e/d3a/d75/f7a x:0 0 0 2024-02-15T18:27:04.371 INFO:tasks.workunit.client.1.smithi133.stdout:1/314: dread d6/fd [0,4194304] 0 2024-02-15T18:27:04.371 INFO:tasks.workunit.client.1.smithi133.stdout:1/315: truncate d6/f29 1137775 0 2024-02-15T18:27:04.372 INFO:tasks.workunit.client.1.smithi133.stdout:1/316: creat d6/d1e/f7b x:0 0 0 2024-02-15T18:27:04.372 INFO:tasks.workunit.client.1.smithi133.stdout:8/157: dwrite d3/f2e [0,4194304] 0 2024-02-15T18:27:04.372 INFO:tasks.workunit.client.1.smithi133.stdout:8/158: chown d3/de/ff 1723233 1 2024-02-15T18:27:04.373 INFO:tasks.workunit.client.1.smithi133.stdout:1/317: mkdir d6/d1e/d41/d7c 0 2024-02-15T18:27:04.378 INFO:tasks.workunit.client.1.smithi133.stdout:1/318: rmdir d6/d1e 39 2024-02-15T18:27:04.383 INFO:tasks.workunit.client.1.smithi133.stdout:8/159: dread d3/f14 [0,4194304] 0 2024-02-15T18:27:04.384 INFO:tasks.workunit.client.1.smithi133.stdout:8/160: mknod d3/d1f/c38 0 2024-02-15T18:27:04.384 INFO:tasks.workunit.client.1.smithi133.stdout:8/161: chown d3/d7/l28 3 1 2024-02-15T18:27:04.385 INFO:tasks.workunit.client.1.smithi133.stdout:8/162: write d3/f2e [232143,36164] 0 2024-02-15T18:27:04.386 INFO:tasks.workunit.client.1.smithi133.stdout:8/163: symlink d3/d1f/l39 0 2024-02-15T18:27:04.386 INFO:tasks.workunit.client.1.smithi133.stdout:8/164: fsync d3/d1c/d2f/f36 0 2024-02-15T18:27:04.387 INFO:tasks.workunit.client.1.smithi133.stdout:8/165: read d3/f22 [998647,46290] 0 2024-02-15T18:27:04.388 INFO:tasks.workunit.client.1.smithi133.stdout:8/166: creat d3/f3a x:0 0 0 2024-02-15T18:27:04.388 INFO:tasks.workunit.client.1.smithi133.stdout:8/167: creat d3/d1c/d2f/f3b x:0 0 0 2024-02-15T18:27:04.391 INFO:tasks.workunit.client.0.smithi084.stdout:4/494: mknod d2/d4/d25/c93 0 2024-02-15T18:27:04.393 INFO:tasks.workunit.client.0.smithi084.stdout:8/505: mknod db/d1a/caa 0 2024-02-15T18:27:04.393 INFO:tasks.workunit.client.0.smithi084.stdout:8/506: readlink db/dd/d1f/l84 0 2024-02-15T18:27:04.393 INFO:tasks.workunit.client.1.smithi133.stdout:1/319: dwrite f2 [0,4194304] 0 2024-02-15T18:27:04.394 INFO:tasks.workunit.client.0.smithi084.stdout:9/542: symlink d4/d2b/d3c/d20/d75/d87/lac 0 2024-02-15T18:27:04.397 INFO:tasks.workunit.client.0.smithi084.stdout:5/547: symlink d9/d23/dac/lb1 0 2024-02-15T18:27:04.397 INFO:tasks.workunit.client.0.smithi084.stdout:5/548: dread - d9/d5b/d79/fa5 zero size 2024-02-15T18:27:04.397 INFO:tasks.workunit.client.0.smithi084.stdout:5/549: chown d9/d5b/d79/f87 155007596 1 2024-02-15T18:27:04.398 INFO:tasks.workunit.client.0.smithi084.stdout:8/507: read db/d6a/f9c [450983,89568] 0 2024-02-15T18:27:04.401 INFO:tasks.workunit.client.0.smithi084.stdout:2/453: rename d3/f41 to d3/f94 0 2024-02-15T18:27:04.401 INFO:tasks.workunit.client.0.smithi084.stdout:2/454: chown d3/d19/d24/d3e/f55 1 1 2024-02-15T18:27:04.402 INFO:tasks.workunit.client.0.smithi084.stdout:8/508: creat db/dd/d1f/d7a/da8/fab x:0 0 0 2024-02-15T18:27:04.403 INFO:tasks.workunit.client.0.smithi084.stdout:2/455: truncate d3/d19/d24/d3e/d5c/f68 1971757 0 2024-02-15T18:27:04.404 INFO:tasks.workunit.client.0.smithi084.stdout:8/509: creat db/dd/d1f/d66/da2/fac x:0 0 0 2024-02-15T18:27:04.404 INFO:tasks.workunit.client.1.smithi133.stdout:1/320: write d6/f15 [1636427,64917] 0 2024-02-15T18:27:04.405 INFO:tasks.workunit.client.0.smithi084.stdout:4/495: dread d2/d2b/f54 [0,4194304] 0 2024-02-15T18:27:04.405 INFO:tasks.workunit.client.1.smithi133.stdout:1/321: creat d6/d1e/d3a/d75/f7d x:0 0 0 2024-02-15T18:27:04.406 INFO:tasks.workunit.client.0.smithi084.stdout:8/510: link db/dd/d4d/f5b db/dd/d1f/d9b/da0/fad 0 2024-02-15T18:27:04.406 INFO:tasks.workunit.client.1.smithi133.stdout:1/322: mkdir d6/d1e/d41/d7c/d7e 0 2024-02-15T18:27:04.407 INFO:tasks.workunit.client.0.smithi084.stdout:4/496: mkdir d2/d2b/d47/d31/d50/d94 0 2024-02-15T18:27:04.407 INFO:tasks.workunit.client.0.smithi084.stdout:4/497: write d2/d4/d28/f4b [5088038,85550] 0 2024-02-15T18:27:04.407 INFO:tasks.workunit.client.1.smithi133.stdout:1/323: mkdir d6/d1e/d41/d7c/d7e/d7f 0 2024-02-15T18:27:04.408 INFO:tasks.workunit.client.1.smithi133.stdout:1/324: creat d6/d2a/d59/f80 x:0 0 0 2024-02-15T18:27:04.409 INFO:tasks.workunit.client.0.smithi084.stdout:4/498: symlink d2/d64/d74/d8f/l95 0 2024-02-15T18:27:04.411 INFO:tasks.workunit.client.1.smithi133.stdout:1/325: rename d6/d1e/d41/f42 to d6/d1e/d76/f81 0 2024-02-15T18:27:04.422 INFO:tasks.workunit.client.1.smithi133.stdout:1/326: dread d6/d17/f18 [0,4194304] 0 2024-02-15T18:27:04.422 INFO:tasks.workunit.client.1.smithi133.stdout:1/327: stat d6/f13 0 2024-02-15T18:27:04.422 INFO:tasks.workunit.client.1.smithi133.stdout:1/328: dread - d6/d2a/d59/d5a/f6f zero size 2024-02-15T18:27:04.423 INFO:tasks.workunit.client.1.smithi133.stdout:1/329: unlink d6/d32/l5c 0 2024-02-15T18:27:04.424 INFO:tasks.workunit.client.1.smithi133.stdout:1/330: mkdir d6/d1e/d3a/d82 0 2024-02-15T18:27:04.427 INFO:tasks.workunit.client.0.smithi084.stdout:9/543: dwrite d4/d2b/d3c/d24/f2a [0,4194304] 0 2024-02-15T18:27:04.428 INFO:tasks.workunit.client.0.smithi084.stdout:8/511: dwrite db/f74 [4194304,4194304] 0 2024-02-15T18:27:04.428 INFO:tasks.workunit.client.0.smithi084.stdout:8/512: chown c6 29693 1 2024-02-15T18:27:04.429 INFO:tasks.workunit.client.1.smithi133.stdout:8/168: dwrite d3/f5 [0,4194304] 0 2024-02-15T18:27:04.430 INFO:tasks.workunit.client.0.smithi084.stdout:5/550: truncate d9/da/d3d/f4f 1389149 0 2024-02-15T18:27:04.430 INFO:tasks.workunit.client.0.smithi084.stdout:5/551: chown d9/d5f/l82 1185475090 1 2024-02-15T18:27:04.433 INFO:tasks.workunit.client.1.smithi133.stdout:8/169: mknod d3/d1c/c3c 0 2024-02-15T18:27:04.433 INFO:tasks.workunit.client.1.smithi133.stdout:8/170: chown d3/d1f/f2a 9 1 2024-02-15T18:27:04.433 INFO:tasks.workunit.client.1.smithi133.stdout:8/171: chown d3 38015 1 2024-02-15T18:27:04.434 INFO:tasks.workunit.client.0.smithi084.stdout:2/456: rmdir d3/d19/d24/d3e/d5c 39 2024-02-15T18:27:04.434 INFO:tasks.workunit.client.0.smithi084.stdout:2/457: write d3/d19/d24/d3e/d5c/f68 [2306436,79316] 0 2024-02-15T18:27:04.434 INFO:tasks.workunit.client.1.smithi133.stdout:8/172: write d3/f22 [1260164,27003] 0 2024-02-15T18:27:04.435 INFO:tasks.workunit.client.1.smithi133.stdout:8/173: chown d3/d7/l28 1290521 1 2024-02-15T18:27:04.436 INFO:tasks.workunit.client.0.smithi084.stdout:9/544: symlink d4/d2b/d3c/d20/d43/lad 0 2024-02-15T18:27:04.437 INFO:tasks.workunit.client.0.smithi084.stdout:9/545: dread - d4/d2b/d3c/d24/f8a zero size 2024-02-15T18:27:04.438 INFO:tasks.workunit.client.0.smithi084.stdout:8/513: rmdir db/dd/d1f/d7a/da8 39 2024-02-15T18:27:04.439 INFO:tasks.workunit.client.1.smithi133.stdout:8/174: write d3/f1a [1824893,82527] 0 2024-02-15T18:27:04.439 INFO:tasks.workunit.client.1.smithi133.stdout:1/331: dwrite d6/f74 [0,4194304] 0 2024-02-15T18:27:04.439 INFO:tasks.workunit.client.1.smithi133.stdout:1/332: dread - d6/f24 zero size 2024-02-15T18:27:04.440 INFO:tasks.workunit.client.0.smithi084.stdout:5/552: link d9/d35/d65/l36 d9/d5b/d7e/d92/lb2 0 2024-02-15T18:27:04.442 INFO:tasks.workunit.client.1.smithi133.stdout:1/333: creat d6/d32/f83 x:0 0 0 2024-02-15T18:27:04.442 INFO:tasks.workunit.client.1.smithi133.stdout:1/334: chown d6/d17 598039 1 2024-02-15T18:27:04.442 INFO:tasks.workunit.client.0.smithi084.stdout:9/546: dread d4/d3d/f61 [0,4194304] 0 2024-02-15T18:27:04.444 INFO:tasks.workunit.client.0.smithi084.stdout:2/458: mknod d3/d5/d1a/d74/c95 0 2024-02-15T18:27:04.444 INFO:tasks.workunit.client.0.smithi084.stdout:2/459: chown d3/f42 0 1 2024-02-15T18:27:04.444 INFO:tasks.workunit.client.0.smithi084.stdout:8/514: mknod db/dd/d1f/d7a/da8/cae 0 2024-02-15T18:27:04.448 INFO:tasks.workunit.client.0.smithi084.stdout:5/553: rename d9/da/d3d/d44/d55/l5d to d9/d35/lb3 0 2024-02-15T18:27:04.449 INFO:tasks.workunit.client.0.smithi084.stdout:9/547: symlink d4/d2b/d3c/d20/d75/lae 0 2024-02-15T18:27:04.449 INFO:tasks.workunit.client.0.smithi084.stdout:2/460: rmdir d3/d5/d1a/d1e/d47/d76 39 2024-02-15T18:27:04.449 INFO:tasks.workunit.client.1.smithi133.stdout:1/335: creat d6/d1e/d3a/d75/f84 x:0 0 0 2024-02-15T18:27:04.451 INFO:tasks.workunit.client.0.smithi084.stdout:5/554: rmdir d9/da/d3d/d44/d55/d70 39 2024-02-15T18:27:04.452 INFO:tasks.workunit.client.1.smithi133.stdout:1/336: truncate d6/d1e/d41/f58 538926 0 2024-02-15T18:27:04.452 INFO:tasks.workunit.client.0.smithi084.stdout:9/548: getdents d4/d6b 0 2024-02-15T18:27:04.453 INFO:tasks.workunit.client.0.smithi084.stdout:9/549: write d4/d2b/d3c/d20/d43/d15/d33/f7c [1372704,72278] 0 2024-02-15T18:27:04.454 INFO:tasks.workunit.client.0.smithi084.stdout:2/461: mkdir d3/d5/d1a/d74/d8e/d96 0 2024-02-15T18:27:04.454 INFO:tasks.workunit.client.0.smithi084.stdout:2/462: dread - d3/d28/f78 zero size 2024-02-15T18:27:04.454 INFO:tasks.workunit.client.1.smithi133.stdout:7/95: sync 2024-02-15T18:27:04.454 INFO:tasks.workunit.client.1.smithi133.stdout:0/156: sync 2024-02-15T18:27:04.454 INFO:tasks.workunit.client.1.smithi133.stdout:6/249: sync 2024-02-15T18:27:04.455 INFO:tasks.workunit.client.1.smithi133.stdout:3/210: sync 2024-02-15T18:27:04.455 INFO:tasks.workunit.client.1.smithi133.stdout:2/226: sync 2024-02-15T18:27:04.455 INFO:tasks.workunit.client.1.smithi133.stdout:2/227: chown d7/f15 855555741 1 2024-02-15T18:27:04.455 INFO:tasks.workunit.client.1.smithi133.stdout:6/250: write d0/f24 [815880,79384] 0 2024-02-15T18:27:04.456 INFO:tasks.workunit.client.0.smithi084.stdout:2/463: truncate d3/d19/d24/d3e/f70 884296 0 2024-02-15T18:27:04.456 INFO:tasks.workunit.client.1.smithi133.stdout:2/228: fdatasync d7/db/f21 0 2024-02-15T18:27:04.456 INFO:tasks.workunit.client.0.smithi084.stdout:9/550: write d4/d2b/d3c/d20/d43/f14 [256119,105863] 0 2024-02-15T18:27:04.457 INFO:tasks.workunit.client.1.smithi133.stdout:3/211: getdents d0/d15/d2b 0 2024-02-15T18:27:04.457 INFO:tasks.workunit.client.1.smithi133.stdout:3/212: fdatasync d0/d15/d2b/d39/d3f/f22 0 2024-02-15T18:27:04.458 INFO:tasks.workunit.client.1.smithi133.stdout:6/251: symlink d0/db/l54 0 2024-02-15T18:27:04.458 INFO:tasks.workunit.client.1.smithi133.stdout:6/252: write d0/d5/f1b [4688510,49072] 0 2024-02-15T18:27:04.458 INFO:tasks.workunit.client.0.smithi084.stdout:2/464: rename d3/d5/l43 to d3/d5/d1a/d1e/d30/l97 0 2024-02-15T18:27:04.460 INFO:tasks.workunit.client.0.smithi084.stdout:5/555: dread d9/d23/f67 [0,4194304] 0 2024-02-15T18:27:04.460 INFO:tasks.workunit.client.0.smithi084.stdout:9/551: mkdir d4/d2b/daf 0 2024-02-15T18:27:04.461 INFO:tasks.workunit.client.0.smithi084.stdout:2/465: getdents d3/d5/d1a/d1e/d47 0 2024-02-15T18:27:04.461 INFO:tasks.workunit.client.1.smithi133.stdout:1/337: rename d6/d32 to d6/d1e/d3a/d82/d85 0 2024-02-15T18:27:04.462 INFO:tasks.workunit.client.1.smithi133.stdout:3/213: write d0/d15/f3b [1233811,3277] 0 2024-02-15T18:27:04.462 INFO:tasks.workunit.client.1.smithi133.stdout:3/214: chown d0/f8 9438 1 2024-02-15T18:27:04.462 INFO:tasks.workunit.client.1.smithi133.stdout:3/215: fsync d0/d15/d2b/d39/d3f/f22 0 2024-02-15T18:27:04.462 INFO:tasks.workunit.client.1.smithi133.stdout:3/216: readlink d0/d15/d2b/d39/d3f/l11 0 2024-02-15T18:27:04.462 INFO:tasks.workunit.client.1.smithi133.stdout:6/253: symlink d0/d5/l55 0 2024-02-15T18:27:04.463 INFO:tasks.workunit.client.0.smithi084.stdout:5/556: mknod d9/d35/cb4 0 2024-02-15T18:27:04.465 INFO:tasks.workunit.client.1.smithi133.stdout:8/175: dwrite d3/de/f1d [0,4194304] 0 2024-02-15T18:27:04.466 INFO:tasks.workunit.client.0.smithi084.stdout:2/466: write d3/d28/f45 [8372359,53529] 0 2024-02-15T18:27:04.466 INFO:tasks.workunit.client.0.smithi084.stdout:2/467: fdatasync d3/d19/f20 0 2024-02-15T18:27:04.466 INFO:tasks.workunit.client.0.smithi084.stdout:9/552: unlink d4/d2b/d3c/d20/d43/d15/d5d/f8e 0 2024-02-15T18:27:04.466 INFO:tasks.workunit.client.1.smithi133.stdout:1/338: creat d6/d1e/f86 x:0 0 0 2024-02-15T18:27:04.466 INFO:tasks.workunit.client.0.smithi084.stdout:5/557: mkdir d9/d5b/d7e/db5 0 2024-02-15T18:27:04.469 INFO:tasks.workunit.client.1.smithi133.stdout:2/229: rename d7/d18/f3a to d7/d2c/d31/f4b 0 2024-02-15T18:27:04.471 INFO:tasks.workunit.client.1.smithi133.stdout:7/96: dread f0 [0,4194304] 0 2024-02-15T18:27:04.473 INFO:tasks.workunit.client.1.smithi133.stdout:3/217: creat d0/d15/d37/f40 x:0 0 0 2024-02-15T18:27:04.474 INFO:tasks.workunit.client.0.smithi084.stdout:2/468: write d3/d19/d24/d3e/f8c [7516523,48665] 0 2024-02-15T18:27:04.475 INFO:tasks.workunit.client.1.smithi133.stdout:3/218: write d0/d15/d2b/d39/d3f/f20 [300601,51440] 0 2024-02-15T18:27:04.475 INFO:tasks.workunit.client.0.smithi084.stdout:8/515: dwrite db/dd/d13/f8c [4194304,4194304] 0 2024-02-15T18:27:04.476 INFO:tasks.workunit.client.0.smithi084.stdout:5/558: mkdir d9/da/d3d/d44/d55/d70/d84/db6 0 2024-02-15T18:27:04.477 INFO:tasks.workunit.client.1.smithi133.stdout:3/219: rmdir d0/d15/d2b/d39/d3f 39 2024-02-15T18:27:04.477 INFO:tasks.workunit.client.1.smithi133.stdout:7/97: truncate d9/f1c 645324 0 2024-02-15T18:27:04.477 INFO:tasks.workunit.client.1.smithi133.stdout:0/157: dwrite d9/d10/d22/d32/f39 [0,4194304] 0 2024-02-15T18:27:04.478 INFO:tasks.workunit.client.0.smithi084.stdout:5/559: write d9/d5b/d7e/d92/f9e [11523,20830] 0 2024-02-15T18:27:04.478 INFO:tasks.workunit.client.0.smithi084.stdout:2/469: symlink d3/d19/d24/d89/l98 0 2024-02-15T18:27:04.479 INFO:tasks.workunit.client.1.smithi133.stdout:7/98: mknod d9/d19/c22 0 2024-02-15T18:27:04.483 INFO:tasks.workunit.client.1.smithi133.stdout:0/158: symlink d9/d10/d19/d1a/l3b 0 2024-02-15T18:27:04.484 INFO:tasks.workunit.client.0.smithi084.stdout:5/560: truncate d9/da/d3d/f50 3526519 0 2024-02-15T18:27:04.484 INFO:tasks.workunit.client.0.smithi084.stdout:5/561: write d9/d5f/d68/d9a/f60 [528471,63900] 0 2024-02-15T18:27:04.484 INFO:tasks.workunit.client.0.smithi084.stdout:5/562: fsync d9/da/d3d/f72 0 2024-02-15T18:27:04.485 INFO:tasks.workunit.client.1.smithi133.stdout:0/159: mknod d9/d10/d2c/c3c 0 2024-02-15T18:27:04.485 INFO:tasks.workunit.client.1.smithi133.stdout:0/160: write d9/d10/d22/f23 [893358,61425] 0 2024-02-15T18:27:04.488 INFO:tasks.workunit.client.1.smithi133.stdout:0/161: creat d9/d10/d19/f3d x:0 0 0 2024-02-15T18:27:04.488 INFO:tasks.workunit.client.1.smithi133.stdout:0/162: chown d9/d10/d19 19837 1 2024-02-15T18:27:04.489 INFO:tasks.workunit.client.1.smithi133.stdout:0/163: read d9/fc [3825460,43963] 0 2024-02-15T18:27:04.494 INFO:tasks.workunit.client.0.smithi084.stdout:9/553: dwrite d4/d2b/f50 [4194304,4194304] 0 2024-02-15T18:27:04.495 INFO:tasks.workunit.client.0.smithi084.stdout:9/554: read d4/d6b/f97 [932147,15178] 0 2024-02-15T18:27:04.495 INFO:tasks.workunit.client.0.smithi084.stdout:9/555: stat d4/d2b/d3c/d20/d43/f99 0 2024-02-15T18:27:04.496 INFO:tasks.workunit.client.1.smithi133.stdout:0/164: creat d9/f3e x:0 0 0 2024-02-15T18:27:04.496 INFO:tasks.workunit.client.1.smithi133.stdout:1/339: getdents d6/d1e 0 2024-02-15T18:27:04.497 INFO:tasks.workunit.client.0.smithi084.stdout:9/556: mkdir d4/da3/db0 0 2024-02-15T18:27:04.497 INFO:tasks.workunit.client.1.smithi133.stdout:7/99: dread f6 [0,4194304] 0 2024-02-15T18:27:04.498 INFO:tasks.workunit.client.1.smithi133.stdout:6/254: dwrite d0/f26 [0,4194304] 0 2024-02-15T18:27:04.499 INFO:tasks.workunit.client.1.smithi133.stdout:1/340: creat d6/d1e/d3a/d82/d85/d67/f87 x:0 0 0 2024-02-15T18:27:04.501 INFO:tasks.workunit.client.1.smithi133.stdout:7/100: rename f0 to d9/d1d/f23 0 2024-02-15T18:27:04.503 INFO:tasks.workunit.client.1.smithi133.stdout:5/134: sync 2024-02-15T18:27:04.503 INFO:tasks.workunit.client.1.smithi133.stdout:5/135: chown d17/d26/l1f 6603192 1 2024-02-15T18:27:04.503 INFO:tasks.workunit.client.1.smithi133.stdout:4/137: sync 2024-02-15T18:27:04.506 INFO:tasks.workunit.client.1.smithi133.stdout:7/101: write d9/db/f11 [5551372,7095] 0 2024-02-15T18:27:04.509 INFO:tasks.workunit.client.0.smithi084.stdout:6/461: sync 2024-02-15T18:27:04.509 INFO:tasks.workunit.client.0.smithi084.stdout:1/441: sync 2024-02-15T18:27:04.509 INFO:tasks.workunit.client.0.smithi084.stdout:1/442: truncate d9/d54/d5c/d81/f6c 725422 0 2024-02-15T18:27:04.509 INFO:tasks.workunit.client.0.smithi084.stdout:1/443: read - d9/d54/d1b/d38/d4d/f7e zero size 2024-02-15T18:27:04.510 INFO:tasks.workunit.client.1.smithi133.stdout:8/176: dread d3/f1a [0,4194304] 0 2024-02-15T18:27:04.510 INFO:tasks.workunit.client.1.smithi133.stdout:8/177: chown d3/d7/l2b 501829895 1 2024-02-15T18:27:04.510 INFO:tasks.workunit.client.1.smithi133.stdout:8/178: truncate d3/d1c/d2f/f36 247637 0 2024-02-15T18:27:04.511 INFO:tasks.workunit.client.1.smithi133.stdout:4/138: dread d2/d5/d2b/f1d [0,4194304] 0 2024-02-15T18:27:04.513 INFO:tasks.workunit.client.1.smithi133.stdout:4/139: dread d2/f29 [0,4194304] 0 2024-02-15T18:27:04.516 INFO:tasks.workunit.client.1.smithi133.stdout:3/220: dwrite d0/f23 [4194304,4194304] 0 2024-02-15T18:27:04.517 INFO:tasks.workunit.client.1.smithi133.stdout:2/230: dwrite d7/f15 [0,4194304] 0 2024-02-15T18:27:04.518 INFO:tasks.workunit.client.1.smithi133.stdout:4/140: dread d2/d5/d2b/f24 [0,4194304] 0 2024-02-15T18:27:04.519 INFO:tasks.workunit.client.1.smithi133.stdout:2/231: write d7/ff [3775571,43856] 0 2024-02-15T18:27:04.521 INFO:tasks.workunit.client.1.smithi133.stdout:4/141: symlink d2/d5/d2b/d21/d2d/l30 0 2024-02-15T18:27:04.523 INFO:tasks.workunit.client.1.smithi133.stdout:2/232: truncate d7/d2c/f49 2678590 0 2024-02-15T18:27:04.523 INFO:tasks.workunit.client.1.smithi133.stdout:1/341: dread d6/fc [0,4194304] 0 2024-02-15T18:27:04.523 INFO:tasks.workunit.client.1.smithi133.stdout:1/342: readlink d6/d1e/l70 0 2024-02-15T18:27:04.523 INFO:tasks.workunit.client.1.smithi133.stdout:1/343: dread - d6/d2a/f2c zero size 2024-02-15T18:27:04.524 INFO:tasks.workunit.client.0.smithi084.stdout:8/516: dwrite db/dd/d1f/f23 [0,4194304] 0 2024-02-15T18:27:04.524 INFO:tasks.workunit.client.0.smithi084.stdout:8/517: chown db/d1a/f1d 7 1 2024-02-15T18:27:04.524 INFO:tasks.workunit.client.1.smithi133.stdout:2/233: truncate d7/f16 3562225 0 2024-02-15T18:27:04.524 INFO:tasks.workunit.client.1.smithi133.stdout:7/102: dread d9/f1c [0,4194304] 0 2024-02-15T18:27:04.526 INFO:tasks.workunit.client.1.smithi133.stdout:1/344: dread d6/d1e/d76/f81 [0,4194304] 0 2024-02-15T18:27:04.526 INFO:tasks.workunit.client.1.smithi133.stdout:5/136: dread f15 [0,4194304] 0 2024-02-15T18:27:04.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/221: write d0/f23 [3199937,61325] 0 2024-02-15T18:27:04.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/222: dread - d0/d15/f24 zero size 2024-02-15T18:27:04.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/223: read - d0/d15/f26 zero size 2024-02-15T18:27:04.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/224: stat d0/d15/d2b/d39/c3d 0 2024-02-15T18:27:04.526 INFO:tasks.workunit.client.1.smithi133.stdout:3/225: dread - d0/d15/d37/f40 zero size 2024-02-15T18:27:04.526 INFO:tasks.workunit.client.1.smithi133.stdout:2/234: creat d7/d18/d32/f4c x:0 0 0 2024-02-15T18:27:04.527 INFO:tasks.workunit.client.1.smithi133.stdout:0/165: dwrite d9/fe [0,4194304] 0 2024-02-15T18:27:04.527 INFO:tasks.workunit.client.1.smithi133.stdout:0/166: dread - d9/d28/f36 zero size 2024-02-15T18:27:04.529 INFO:tasks.workunit.client.1.smithi133.stdout:7/103: rename d9/da/f1b to d9/db/d16/f24 0 2024-02-15T18:27:04.529 INFO:tasks.workunit.client.1.smithi133.stdout:7/104: readlink d9/d19/l1a 0 2024-02-15T18:27:04.530 INFO:tasks.workunit.client.1.smithi133.stdout:1/345: unlink d6/d1e/d3a/l63 0 2024-02-15T18:27:04.534 INFO:tasks.workunit.client.1.smithi133.stdout:3/226: getdents d0/d15/d2f 0 2024-02-15T18:27:04.536 INFO:tasks.workunit.client.1.smithi133.stdout:2/235: creat d7/d2c/d3b/f4d x:0 0 0 2024-02-15T18:27:04.537 INFO:tasks.workunit.client.1.smithi133.stdout:0/167: unlink d9/d10/d2c/c34 0 2024-02-15T18:27:04.538 INFO:tasks.workunit.client.1.smithi133.stdout:5/137: rename d17/l18 to d17/d20/l29 0 2024-02-15T18:27:04.539 INFO:tasks.workunit.client.1.smithi133.stdout:1/346: unlink d6/d2a/f35 0 2024-02-15T18:27:04.539 INFO:tasks.workunit.client.1.smithi133.stdout:1/347: chown d6/d1e/c5b 12280481 1 2024-02-15T18:27:04.539 INFO:tasks.workunit.client.1.smithi133.stdout:1/348: fdatasync d6/d1e/d3a/d82/d85/f33 0 2024-02-15T18:27:04.540 INFO:tasks.workunit.client.1.smithi133.stdout:2/236: symlink d7/db/d35/d4a/l4e 0 2024-02-15T18:27:04.540 INFO:tasks.workunit.client.1.smithi133.stdout:0/168: creat d9/d1c/f3f x:0 0 0 2024-02-15T18:27:04.541 INFO:tasks.workunit.client.1.smithi133.stdout:3/227: rename d0/d15/f26 to d0/d15/d2b/f41 0 2024-02-15T18:27:04.544 INFO:tasks.workunit.client.1.smithi133.stdout:5/138: truncate fc 3690100 0 2024-02-15T18:27:04.544 INFO:tasks.workunit.client.1.smithi133.stdout:5/139: fdatasync d17/f1c 0 2024-02-15T18:27:04.544 INFO:tasks.workunit.client.1.smithi133.stdout:5/140: chown c14 14306 1 2024-02-15T18:27:04.544 INFO:tasks.workunit.client.1.smithi133.stdout:2/237: symlink d7/d2c/d46/l4f 0 2024-02-15T18:27:04.544 INFO:tasks.workunit.client.1.smithi133.stdout:2/238: fsync f1 0 2024-02-15T18:27:04.556 INFO:tasks.workunit.client.0.smithi084.stdout:6/462: dwrite d14/d22/d25/d28/f48 [0,4194304] 0 2024-02-15T18:27:04.556 INFO:tasks.workunit.client.0.smithi084.stdout:6/463: write d14/f6f [429226,53065] 0 2024-02-15T18:27:04.557 INFO:tasks.workunit.client.0.smithi084.stdout:6/464: mkdir d14/d22/d25/d41/d94 0 2024-02-15T18:27:04.559 INFO:tasks.workunit.client.1.smithi133.stdout:0/169: dread f4 [0,4194304] 0 2024-02-15T18:27:04.559 INFO:tasks.workunit.client.1.smithi133.stdout:0/170: readlink d9/l18 0 2024-02-15T18:27:04.572 INFO:tasks.workunit.client.1.smithi133.stdout:0/171: dread f0 [4194304,4194304] 0 2024-02-15T18:27:04.577 INFO:tasks.workunit.client.1.smithi133.stdout:9/161: sync 2024-02-15T18:27:04.580 INFO:tasks.workunit.client.1.smithi133.stdout:7/105: dwrite d9/db/d16/f24 [0,4194304] 0 2024-02-15T18:27:04.582 INFO:tasks.workunit.client.0.smithi084.stdout:9/557: dwrite d4/d6b/f97 [0,4194304] 0 2024-02-15T18:27:04.583 INFO:tasks.workunit.client.1.smithi133.stdout:8/179: dwrite d3/d1f/f2a [0,4194304] 0 2024-02-15T18:27:04.583 INFO:tasks.workunit.client.1.smithi133.stdout:9/162: dread d0/d8/d10/f11 [0,4194304] 0 2024-02-15T18:27:04.584 INFO:tasks.workunit.client.1.smithi133.stdout:7/106: link d9/d1d/f23 d9/db/d16/f25 0 2024-02-15T18:27:04.587 INFO:tasks.workunit.client.1.smithi133.stdout:8/180: rename d3/d1c/d2f/l34 to d3/d7/l3d 0 2024-02-15T18:27:04.588 INFO:tasks.workunit.client.1.smithi133.stdout:9/163: symlink d0/l35 0 2024-02-15T18:27:04.588 INFO:tasks.workunit.client.1.smithi133.stdout:9/164: readlink d0/l35 0 2024-02-15T18:27:04.588 INFO:tasks.workunit.client.1.smithi133.stdout:7/107: rmdir d9/db/dc 39 2024-02-15T18:27:04.590 INFO:tasks.workunit.client.1.smithi133.stdout:7/108: symlink d9/l26 0 2024-02-15T18:27:04.590 INFO:tasks.workunit.client.1.smithi133.stdout:7/109: fdatasync f6 0 2024-02-15T18:27:04.590 INFO:tasks.workunit.client.1.smithi133.stdout:7/110: readlink d9/da/l12 0 2024-02-15T18:27:04.590 INFO:tasks.workunit.client.1.smithi133.stdout:7/111: truncate f7 4651664 0 2024-02-15T18:27:04.593 INFO:tasks.workunit.client.1.smithi133.stdout:5/141: dwrite f10 [0,4194304] 0 2024-02-15T18:27:04.594 INFO:tasks.workunit.client.0.smithi084.stdout:8/518: dwrite db/dd/d4d/f7c [0,4194304] 0 2024-02-15T18:27:04.597 INFO:tasks.workunit.client.1.smithi133.stdout:1/349: dwrite d6/d1e/d41/f66 [4194304,4194304] 0 2024-02-15T18:27:04.597 INFO:tasks.workunit.client.1.smithi133.stdout:5/142: mkdir d17/d2a 0 2024-02-15T18:27:04.599 INFO:tasks.workunit.client.1.smithi133.stdout:0/172: dwrite d9/fe [0,4194304] 0 2024-02-15T18:27:04.599 INFO:tasks.workunit.client.1.smithi133.stdout:0/173: dread - d9/d1c/f3f zero size 2024-02-15T18:27:04.599 INFO:tasks.workunit.client.1.smithi133.stdout:0/174: truncate d9/d28/f36 453396 0 2024-02-15T18:27:04.599 INFO:tasks.workunit.client.1.smithi133.stdout:7/112: read d9/f1c [87803,43312] 0 2024-02-15T18:27:04.601 INFO:tasks.workunit.client.0.smithi084.stdout:6/465: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/f53 [0,4194304] 0 2024-02-15T18:27:04.602 INFO:tasks.workunit.client.0.smithi084.stdout:6/466: write d14/f6f [330036,49] 0 2024-02-15T18:27:04.603 INFO:tasks.workunit.client.0.smithi084.stdout:6/467: write d14/d22/d25/d28/f77 [792872,123713] 0 2024-02-15T18:27:04.603 INFO:tasks.workunit.client.0.smithi084.stdout:8/519: mkdir db/daf 0 2024-02-15T18:27:04.605 INFO:tasks.workunit.client.1.smithi133.stdout:7/113: rename d9/f1c to d9/db/f27 0 2024-02-15T18:27:04.606 INFO:tasks.workunit.client.1.smithi133.stdout:7/114: chown d9/db/d16/c1e 1681645661 1 2024-02-15T18:27:04.607 INFO:tasks.workunit.client.1.smithi133.stdout:0/175: link d9/fc d9/d10/d22/d32/f40 0 2024-02-15T18:27:04.607 INFO:tasks.workunit.client.1.smithi133.stdout:0/176: truncate d9/d1c/f3f 736894 0 2024-02-15T18:27:04.613 INFO:tasks.workunit.client.1.smithi133.stdout:2/239: truncate d7/ff 2594481 0 2024-02-15T18:27:04.613 INFO:tasks.workunit.client.1.smithi133.stdout:2/240: chown d7/db/f21 4932607 1 2024-02-15T18:27:04.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:02.685122+0000 mgr.smithi084.hjmnez (mgr.14596) 19 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 379 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 17 MiB/s wr, 89 op/s 2024-02-15T18:27:04.652 INFO:tasks.workunit.client.0.smithi084.stdout:9/558: dwrite d4/d3d/f61 [0,4194304] 0 2024-02-15T18:27:04.654 INFO:tasks.workunit.client.1.smithi133.stdout:8/181: dwrite d3/d1c/f1e [0,4194304] 0 2024-02-15T18:27:04.655 INFO:tasks.workunit.client.0.smithi084.stdout:9/559: link d4/d2b/d3c/d20/d43/d15/f37 d4/d36/d6f/fb1 0 2024-02-15T18:27:04.656 INFO:tasks.workunit.client.1.smithi133.stdout:8/182: mkdir d3/de/d3e 0 2024-02-15T18:27:04.659 INFO:tasks.workunit.client.1.smithi133.stdout:1/350: dwrite d6/d1e/f27 [4194304,4194304] 0 2024-02-15T18:27:04.660 INFO:tasks.workunit.client.1.smithi133.stdout:9/165: dwrite d0/d8/f22 [0,4194304] 0 2024-02-15T18:27:04.660 INFO:tasks.workunit.client.1.smithi133.stdout:9/166: chown d0/d8/d9/l1d 5 1 2024-02-15T18:27:04.661 INFO:tasks.workunit.client.0.smithi084.stdout:8/520: dwrite db/dd/d4d/d7e/f85 [0,4194304] 0 2024-02-15T18:27:04.661 INFO:tasks.workunit.client.0.smithi084.stdout:8/521: stat db/dd/d13/d42/d90 0 2024-02-15T18:27:04.662 INFO:tasks.workunit.client.1.smithi133.stdout:5/143: dwrite d17/f1c [0,4194304] 0 2024-02-15T18:27:04.662 INFO:tasks.workunit.client.1.smithi133.stdout:5/144: dread - d17/d20/f23 zero size 2024-02-15T18:27:04.662 INFO:tasks.workunit.client.1.smithi133.stdout:0/177: dwrite d9/d1c/f1d [4194304,4194304] 0 2024-02-15T18:27:04.662 INFO:tasks.workunit.client.0.smithi084.stdout:8/522: truncate db/d1a/f5f 2438025 0 2024-02-15T18:27:04.665 INFO:tasks.workunit.client.1.smithi133.stdout:9/167: truncate d0/d8/d10/f14 2939797 0 2024-02-15T18:27:04.665 INFO:tasks.workunit.client.1.smithi133.stdout:9/168: stat d0/l35 0 2024-02-15T18:27:04.665 INFO:tasks.workunit.client.1.smithi133.stdout:9/169: fsync d0/d8/f22 0 2024-02-15T18:27:04.665 INFO:tasks.workunit.client.1.smithi133.stdout:2/241: dwrite d7/f14 [0,4194304] 0 2024-02-15T18:27:04.665 INFO:tasks.workunit.client.1.smithi133.stdout:9/170: rename d0/f25 to d0/d8/d10/f36 0 2024-02-15T18:27:04.666 INFO:tasks.workunit.client.1.smithi133.stdout:7/115: dwrite d9/db/f1f [0,4194304] 0 2024-02-15T18:27:04.666 INFO:tasks.workunit.client.1.smithi133.stdout:2/242: rmdir d7/db/d35/d4a 39 2024-02-15T18:27:04.667 INFO:tasks.workunit.client.0.smithi084.stdout:8/523: mknod db/dd/d1f/d9b/da0/cb0 0 2024-02-15T18:27:04.667 INFO:tasks.workunit.client.0.smithi084.stdout:3/445: sync 2024-02-15T18:27:04.667 INFO:tasks.workunit.client.0.smithi084.stdout:7/433: sync 2024-02-15T18:27:04.667 INFO:tasks.workunit.client.0.smithi084.stdout:0/511: sync 2024-02-15T18:27:04.667 INFO:tasks.workunit.client.0.smithi084.stdout:3/446: chown d8/d40/d58/l88 896272831 1 2024-02-15T18:27:04.667 INFO:tasks.workunit.client.0.smithi084.stdout:7/434: write df/d1d/d1a/d4d/d59/f71 [659456,16038] 0 2024-02-15T18:27:04.667 INFO:tasks.workunit.client.0.smithi084.stdout:7/435: fdatasync df/f1c 0 2024-02-15T18:27:04.667 INFO:tasks.workunit.client.0.smithi084.stdout:7/436: write df/d70/f6d [433558,80936] 0 2024-02-15T18:27:04.668 INFO:tasks.workunit.client.0.smithi084.stdout:7/437: stat df/d1d/d1a/d4d/d55/f7b 0 2024-02-15T18:27:04.668 INFO:tasks.workunit.client.0.smithi084.stdout:7/438: write df/d1d/d1a/d4d/f6f [227646,50130] 0 2024-02-15T18:27:04.669 INFO:tasks.workunit.client.0.smithi084.stdout:1/444: sync 2024-02-15T18:27:04.669 INFO:tasks.workunit.client.0.smithi084.stdout:5/563: sync 2024-02-15T18:27:04.669 INFO:tasks.workunit.client.0.smithi084.stdout:4/499: sync 2024-02-15T18:27:04.669 INFO:tasks.workunit.client.0.smithi084.stdout:2/470: sync 2024-02-15T18:27:04.669 INFO:tasks.workunit.client.0.smithi084.stdout:2/471: write d3/d5e/f6e [478147,10267] 0 2024-02-15T18:27:04.669 INFO:tasks.workunit.client.0.smithi084.stdout:6/468: dwrite d14/d22/d25/d41/f7d [0,4194304] 0 2024-02-15T18:27:04.669 INFO:tasks.workunit.client.0.smithi084.stdout:6/469: getdents d14/d22/d25/d41/d94 0 2024-02-15T18:27:04.669 INFO:tasks.workunit.client.0.smithi084.stdout:6/470: dread - d14/d22/d25/d2f/d31/d3f/d4a/f8d zero size 2024-02-15T18:27:04.671 INFO:tasks.workunit.client.1.smithi133.stdout:1/351: write d6/d1e/d3a/d82/d85/f45 [3576415,38566] 0 2024-02-15T18:27:04.672 INFO:tasks.workunit.client.1.smithi133.stdout:5/145: dread d17/f1c [0,4194304] 0 2024-02-15T18:27:04.673 INFO:tasks.workunit.client.0.smithi084.stdout:5/564: dread d9/da/f99 [0,4194304] 0 2024-02-15T18:27:04.673 INFO:tasks.workunit.client.0.smithi084.stdout:8/524: rename db/dd/d1f/d56/c73 to db/dd/d1f/d7a/cb1 0 2024-02-15T18:27:04.673 INFO:tasks.workunit.client.0.smithi084.stdout:7/439: symlink df/d1d/d1a/d4d/d55/l82 0 2024-02-15T18:27:04.674 INFO:tasks.workunit.client.0.smithi084.stdout:4/500: write d2/d2b/f6f [879282,51306] 0 2024-02-15T18:27:04.674 INFO:tasks.workunit.client.0.smithi084.stdout:1/445: link d9/d54/d1b/d2c/d35/f73 d9/d54/d1b/d2c/d4b/d4c/d79/f9c 0 2024-02-15T18:27:04.675 INFO:tasks.workunit.client.1.smithi133.stdout:1/352: rename d6/ff to d6/d1e/f88 0 2024-02-15T18:27:04.675 INFO:tasks.workunit.client.0.smithi084.stdout:9/560: rmdir d4/d2b/d3c/d20 39 2024-02-15T18:27:04.675 INFO:tasks.workunit.client.0.smithi084.stdout:9/561: write d4/d2b/d3c/d24/f68 [268808,6954] 0 2024-02-15T18:27:04.676 INFO:tasks.workunit.client.0.smithi084.stdout:9/562: write d4/d2b/d3c/d24/f71 [712889,24160] 0 2024-02-15T18:27:04.679 INFO:tasks.workunit.client.0.smithi084.stdout:6/471: mkdir d14/d22/d25/d41/d95 0 2024-02-15T18:27:04.680 INFO:tasks.workunit.client.1.smithi133.stdout:5/146: rmdir d17/d20 39 2024-02-15T18:27:04.681 INFO:tasks.workunit.client.0.smithi084.stdout:8/525: link db/d3f/d59/f2c db/fb2 0 2024-02-15T18:27:04.682 INFO:tasks.workunit.client.1.smithi133.stdout:8/183: dwrite d3/d7/f26 [0,4194304] 0 2024-02-15T18:27:04.682 INFO:tasks.workunit.client.1.smithi133.stdout:1/353: rename d6/d1e/d76 to d6/d89 0 2024-02-15T18:27:04.683 INFO:tasks.workunit.client.1.smithi133.stdout:7/116: dread d9/db/f11 [4194304,4194304] 0 2024-02-15T18:27:04.683 INFO:tasks.workunit.client.0.smithi084.stdout:7/440: creat df/d1d/d1a/d4d/d59/f83 x:0 0 0 2024-02-15T18:27:04.683 INFO:tasks.workunit.client.0.smithi084.stdout:7/441: getdents df/d1d/d1a/d6a 0 2024-02-15T18:27:04.684 INFO:tasks.workunit.client.1.smithi133.stdout:9/171: dread d0/d8/f22 [0,4194304] 0 2024-02-15T18:27:04.686 INFO:tasks.workunit.client.0.smithi084.stdout:2/472: rename d3/d5/f16 to d3/d5/d1a/d1e/d30/d8d/f99 0 2024-02-15T18:27:04.686 INFO:tasks.workunit.client.0.smithi084.stdout:2/473: write d3/d19/d24/f3a [1184147,95305] 0 2024-02-15T18:27:04.687 INFO:tasks.workunit.client.1.smithi133.stdout:5/147: mknod d17/d20/c2b 0 2024-02-15T18:27:04.687 INFO:tasks.workunit.client.1.smithi133.stdout:8/184: mkdir d3/d1f/d3f 0 2024-02-15T18:27:04.687 INFO:tasks.workunit.client.1.smithi133.stdout:7/117: creat d9/db/dc/f28 x:0 0 0 2024-02-15T18:27:04.687 INFO:tasks.workunit.client.1.smithi133.stdout:7/118: fsync f6 0 2024-02-15T18:27:04.688 INFO:tasks.workunit.client.0.smithi084.stdout:4/501: link d2/d2b/d47/f7a d2/d4/d28/f96 0 2024-02-15T18:27:04.688 INFO:tasks.workunit.client.0.smithi084.stdout:4/502: chown d2/d4/d28/d3d/d5c/d65 181638517 1 2024-02-15T18:27:04.688 INFO:tasks.workunit.client.0.smithi084.stdout:1/446: creat d9/f9d x:0 0 0 2024-02-15T18:27:04.688 INFO:tasks.workunit.client.0.smithi084.stdout:9/563: mknod d4/d3d/cb2 0 2024-02-15T18:27:04.689 INFO:tasks.workunit.client.0.smithi084.stdout:6/472: creat d14/d22/d25/d2f/d31/d3f/f96 x:0 0 0 2024-02-15T18:27:04.689 INFO:tasks.workunit.client.0.smithi084.stdout:6/473: fdatasync d14/f17 0 2024-02-15T18:27:04.690 INFO:tasks.workunit.client.0.smithi084.stdout:6/474: fsync d14/f78 0 2024-02-15T18:27:04.693 INFO:tasks.workunit.client.0.smithi084.stdout:8/526: creat db/d3f/d59/fb3 x:0 0 0 2024-02-15T18:27:04.693 INFO:tasks.workunit.client.0.smithi084.stdout:8/527: fdatasync db/dd/d4d/d97/f9a 0 2024-02-15T18:27:04.693 INFO:tasks.workunit.client.1.smithi133.stdout:8/185: mkdir d3/d7/d40 0 2024-02-15T18:27:04.693 INFO:tasks.workunit.client.1.smithi133.stdout:5/148: mkdir d17/d20/d2c 0 2024-02-15T18:27:04.693 INFO:tasks.workunit.client.1.smithi133.stdout:7/119: creat d9/db/d16/f29 x:0 0 0 2024-02-15T18:27:04.693 INFO:tasks.workunit.client.1.smithi133.stdout:7/120: chown d9/db/dc 0 1 2024-02-15T18:27:04.694 INFO:tasks.workunit.client.1.smithi133.stdout:8/186: creat d3/d1f/d3f/f41 x:0 0 0 2024-02-15T18:27:04.694 INFO:tasks.workunit.client.1.smithi133.stdout:8/187: chown d3/d1c 0 1 2024-02-15T18:27:04.694 INFO:tasks.workunit.client.0.smithi084.stdout:7/442: symlink df/l84 0 2024-02-15T18:27:04.696 INFO:tasks.workunit.client.0.smithi084.stdout:5/565: rename d9/d35/d65/d8c to d9/d5b/d79/db7 0 2024-02-15T18:27:04.696 INFO:tasks.workunit.client.0.smithi084.stdout:5/566: write d9/d5f/d68/d9a/fa6 [766600,97339] 0 2024-02-15T18:27:04.698 INFO:tasks.workunit.client.1.smithi133.stdout:5/149: write fc [2785252,17676] 0 2024-02-15T18:27:04.698 INFO:tasks.workunit.client.1.smithi133.stdout:5/150: readlink d17/l25 0 2024-02-15T18:27:04.698 INFO:tasks.workunit.client.0.smithi084.stdout:8/528: write db/d1a/f1d [1237143,45568] 0 2024-02-15T18:27:04.698 INFO:tasks.workunit.client.0.smithi084.stdout:8/529: stat db/dd/d13/f8c 0 2024-02-15T18:27:04.698 INFO:tasks.workunit.client.0.smithi084.stdout:2/474: unlink d3/d19/f20 0 2024-02-15T18:27:04.700 INFO:tasks.workunit.client.0.smithi084.stdout:5/567: read d9/d5f/d68/d9a/f6f [2504317,110429] 0 2024-02-15T18:27:04.700 INFO:tasks.workunit.client.0.smithi084.stdout:4/503: link d2/d4/d25/d66/f79 d2/d2b/d47/d31/d50/d94/f97 0 2024-02-15T18:27:04.700 INFO:tasks.workunit.client.1.smithi133.stdout:7/121: creat d9/f2a x:0 0 0 2024-02-15T18:27:04.702 INFO:tasks.workunit.client.1.smithi133.stdout:7/122: getdents d9/d1d 0 2024-02-15T18:27:04.703 INFO:tasks.workunit.client.0.smithi084.stdout:6/475: mkdir d14/d22/d25/d41/d43/d97 0 2024-02-15T18:27:04.703 INFO:tasks.workunit.client.0.smithi084.stdout:7/443: mknod df/d70/c85 0 2024-02-15T18:27:04.703 INFO:tasks.workunit.client.0.smithi084.stdout:7/444: dread - df/d1d/d1a/d4d/d55/f66 zero size 2024-02-15T18:27:04.703 INFO:tasks.workunit.client.0.smithi084.stdout:7/445: fdatasync df/d1d/f3e 0 2024-02-15T18:27:04.703 INFO:tasks.workunit.client.0.smithi084.stdout:7/446: read - df/d1d/d1a/d4b/f50 zero size 2024-02-15T18:27:04.704 INFO:tasks.workunit.client.0.smithi084.stdout:2/475: creat d3/d19/d24/d7b/f9a x:0 0 0 2024-02-15T18:27:04.705 INFO:tasks.workunit.client.0.smithi084.stdout:5/568: unlink d9/c41 0 2024-02-15T18:27:04.705 INFO:tasks.workunit.client.0.smithi084.stdout:5/569: stat d9/d23/dac/lb1 0 2024-02-15T18:27:04.705 INFO:tasks.workunit.client.0.smithi084.stdout:5/570: stat d9/da/f1b 0 2024-02-15T18:27:04.706 INFO:tasks.workunit.client.1.smithi133.stdout:7/123: rename d9/db/d16/f24 to d9/d1d/f2b 0 2024-02-15T18:27:04.706 INFO:tasks.workunit.client.0.smithi084.stdout:4/504: getdents d2/d4/d28/d3d/d5c/d65 0 2024-02-15T18:27:04.708 INFO:tasks.workunit.client.1.smithi133.stdout:7/124: rename d9/db/d16/c1e to d9/c2c 0 2024-02-15T18:27:04.711 INFO:tasks.workunit.client.0.smithi084.stdout:2/476: symlink d3/d5/d1a/d1e/d47/l9b 0 2024-02-15T18:27:04.712 INFO:tasks.workunit.client.0.smithi084.stdout:4/505: truncate d2/d2b/f1f 1127465 0 2024-02-15T18:27:04.712 INFO:tasks.workunit.client.0.smithi084.stdout:4/506: dread - d2/d4/d28/d3d/d5c/d5d/f7e zero size 2024-02-15T18:27:04.712 INFO:tasks.workunit.client.0.smithi084.stdout:8/530: dread db/f25 [0,4194304] 0 2024-02-15T18:27:04.713 INFO:tasks.workunit.client.1.smithi133.stdout:5/151: dread d17/d20/f22 [0,4194304] 0 2024-02-15T18:27:04.714 INFO:tasks.workunit.client.0.smithi084.stdout:2/477: link d3/f94 d3/d5/d1a/f9c 0 2024-02-15T18:27:04.715 INFO:tasks.workunit.client.0.smithi084.stdout:4/507: rmdir d2/d2b 39 2024-02-15T18:27:04.715 INFO:tasks.workunit.client.0.smithi084.stdout:4/508: truncate d2/d4/d25/f4a 655156 0 2024-02-15T18:27:04.716 INFO:tasks.workunit.client.0.smithi084.stdout:8/531: truncate db/dd/d1f/d9b/da0/fad 188452 0 2024-02-15T18:27:04.716 INFO:tasks.workunit.client.0.smithi084.stdout:8/532: chown db/dd/d4d/l9f 1035 1 2024-02-15T18:27:04.717 INFO:tasks.workunit.client.1.smithi133.stdout:5/152: rename f2 to d17/d2a/f2d 0 2024-02-15T18:27:04.719 INFO:tasks.workunit.client.1.smithi133.stdout:5/153: getdents d17 0 2024-02-15T18:27:04.720 INFO:tasks.workunit.client.1.smithi133.stdout:5/154: truncate ff 4169063 0 2024-02-15T18:27:04.722 INFO:tasks.workunit.client.1.smithi133.stdout:5/155: rmdir d17/d20/d2c 0 2024-02-15T18:27:04.722 INFO:tasks.workunit.client.0.smithi084.stdout:6/476: dread d14/d22/d25/d28/f48 [0,4194304] 0 2024-02-15T18:27:04.729 INFO:tasks.workunit.client.0.smithi084.stdout:7/447: dread df/d1d/d1a/d4d/f67 [0,4194304] 0 2024-02-15T18:27:04.729 INFO:tasks.workunit.client.0.smithi084.stdout:7/448: fdatasync df/f4c 0 2024-02-15T18:27:04.729 INFO:tasks.workunit.client.0.smithi084.stdout:7/449: stat df/d1d/d44/f54 0 2024-02-15T18:27:04.729 INFO:tasks.workunit.client.0.smithi084.stdout:8/533: read db/d6a/f9c [937519,69073] 0 2024-02-15T18:27:04.731 INFO:tasks.workunit.client.0.smithi084.stdout:7/450: symlink df/d70/l86 0 2024-02-15T18:27:04.731 INFO:tasks.workunit.client.0.smithi084.stdout:7/451: chown df/d1d/d40/d48/f3d 9204649 1 2024-02-15T18:27:04.731 INFO:tasks.workunit.client.0.smithi084.stdout:7/452: truncate df/d1d/d1a/f75 704206 0 2024-02-15T18:27:04.731 INFO:tasks.workunit.client.0.smithi084.stdout:7/453: write df/d1d/d1a/f81 [661987,68522] 0 2024-02-15T18:27:04.731 INFO:tasks.workunit.client.0.smithi084.stdout:7/454: readlink df/l13 0 2024-02-15T18:27:04.731 INFO:tasks.workunit.client.0.smithi084.stdout:7/455: write df/f32 [401392,111022] 0 2024-02-15T18:27:04.731 INFO:tasks.workunit.client.0.smithi084.stdout:8/534: rmdir db/dd/d13/d42 39 2024-02-15T18:27:04.736 INFO:tasks.workunit.client.0.smithi084.stdout:7/456: rename df/c7c to df/d1d/d1a/c87 0 2024-02-15T18:27:04.738 INFO:tasks.workunit.client.0.smithi084.stdout:7/457: rmdir df/d1d/d1a/d4d/d59/d62 0 2024-02-15T18:27:04.739 INFO:tasks.workunit.client.0.smithi084.stdout:7/458: mkdir df/d1d/d1a/d4d/d55/d88 0 2024-02-15T18:27:04.742 INFO:tasks.workunit.client.0.smithi084.stdout:4/509: dread d2/d2b/f60 [0,4194304] 0 2024-02-15T18:27:04.742 INFO:tasks.workunit.client.0.smithi084.stdout:8/535: dread db/d1a/d2b/f51 [0,4194304] 0 2024-02-15T18:27:04.744 INFO:tasks.workunit.client.0.smithi084.stdout:8/536: creat db/d6a/fb4 x:0 0 0 2024-02-15T18:27:04.744 INFO:tasks.workunit.client.0.smithi084.stdout:8/537: fdatasync db/d6a/d76/f8e 0 2024-02-15T18:27:04.744 INFO:tasks.workunit.client.0.smithi084.stdout:3/447: dwrite d8/d73/f90 [0,4194304] 0 2024-02-15T18:27:04.745 INFO:tasks.workunit.client.1.smithi133.stdout:2/243: truncate d7/f14 3849547 0 2024-02-15T18:27:04.746 INFO:tasks.workunit.client.1.smithi133.stdout:2/244: rmdir d7/db/d35/d4a 39 2024-02-15T18:27:04.747 INFO:tasks.workunit.client.0.smithi084.stdout:8/538: creat db/dd/d1f/d3e/fb5 x:0 0 0 2024-02-15T18:27:04.747 INFO:tasks.workunit.client.0.smithi084.stdout:8/539: chown db/d3f/d59/f28 0 1 2024-02-15T18:27:04.747 INFO:tasks.workunit.client.0.smithi084.stdout:8/540: dread - db/d6a/fb4 zero size 2024-02-15T18:27:04.747 INFO:tasks.workunit.client.0.smithi084.stdout:9/564: dread d4/d2b/d3c/d24/f71 [0,4194304] 0 2024-02-15T18:27:04.750 INFO:tasks.workunit.client.1.smithi133.stdout:2/245: write f1 [106899,90302] 0 2024-02-15T18:27:04.751 INFO:tasks.workunit.client.0.smithi084.stdout:9/565: write d4/d2b/d3c/d20/d43/d15/f28 [1196966,62572] 0 2024-02-15T18:27:04.752 INFO:tasks.workunit.client.1.smithi133.stdout:2/246: creat d7/d2c/d3b/f50 x:0 0 0 2024-02-15T18:27:04.753 INFO:tasks.workunit.client.1.smithi133.stdout:1/354: dwrite d6/d1e/f27 [4194304,4194304] 0 2024-02-15T18:27:04.755 INFO:tasks.workunit.client.0.smithi084.stdout:9/566: truncate d4/d2b/d3c/d20/d43/d15/f17 737237 0 2024-02-15T18:27:04.755 INFO:tasks.workunit.client.1.smithi133.stdout:2/247: rename d7/d18/c22 to d7/d2c/d31/c51 0 2024-02-15T18:27:04.756 INFO:tasks.workunit.client.1.smithi133.stdout:5/156: dwrite d17/f1c [4194304,4194304] 0 2024-02-15T18:27:04.756 INFO:tasks.workunit.client.0.smithi084.stdout:0/512: dwrite d0/d2f/d3f/f17 [0,4194304] 0 2024-02-15T18:27:04.756 INFO:tasks.workunit.client.0.smithi084.stdout:1/447: dwrite d9/d54/d1b/d2c/d4b/d7a/d89/f9a [0,4194304] 0 2024-02-15T18:27:04.757 INFO:tasks.workunit.client.0.smithi084.stdout:5/571: dwrite d9/d35/f42 [0,4194304] 0 2024-02-15T18:27:04.757 INFO:tasks.workunit.client.1.smithi133.stdout:9/172: dwrite d0/d8/d10/f15 [0,4194304] 0 2024-02-15T18:27:04.758 INFO:tasks.workunit.client.1.smithi133.stdout:1/355: symlink d6/d2a/l8a 0 2024-02-15T18:27:04.759 INFO:tasks.workunit.client.0.smithi084.stdout:6/477: dwrite f9 [0,4194304] 0 2024-02-15T18:27:04.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:02.685122+0000 mgr.smithi084.hjmnez (mgr.14596) 19 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 379 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 17 MiB/s wr, 89 op/s 2024-02-15T18:27:04.761 INFO:tasks.workunit.client.0.smithi084.stdout:2/478: dread d3/d5e/f6e [0,4194304] 0 2024-02-15T18:27:04.761 INFO:tasks.workunit.client.1.smithi133.stdout:8/188: truncate d3/d7/f26 1442132 0 2024-02-15T18:27:04.767 INFO:tasks.workunit.client.1.smithi133.stdout:2/248: dread d7/d2c/d31/f38 [0,4194304] 0 2024-02-15T18:27:04.767 INFO:tasks.workunit.client.1.smithi133.stdout:2/249: write d7/db/f43 [641282,62404] 0 2024-02-15T18:27:04.767 INFO:tasks.workunit.client.0.smithi084.stdout:9/567: dread d4/d3d/f7e [0,4194304] 0 2024-02-15T18:27:04.768 INFO:tasks.workunit.client.1.smithi133.stdout:5/157: dread fc [0,4194304] 0 2024-02-15T18:27:04.768 INFO:tasks.workunit.client.1.smithi133.stdout:5/158: write d17/f27 [72072,78396] 0 2024-02-15T18:27:04.770 INFO:tasks.workunit.client.0.smithi084.stdout:3/448: dread d8/f15 [0,4194304] 0 2024-02-15T18:27:04.773 INFO:tasks.workunit.client.0.smithi084.stdout:5/572: link d9/d5b/d79/l95 d9/d35/lb8 0 2024-02-15T18:27:04.774 INFO:tasks.workunit.client.1.smithi133.stdout:9/173: mkdir d0/d37 0 2024-02-15T18:27:04.776 INFO:tasks.workunit.client.0.smithi084.stdout:2/479: creat d3/d28/f9d x:0 0 0 2024-02-15T18:27:04.777 INFO:tasks.workunit.client.1.smithi133.stdout:8/189: link d3/f3a d3/f42 0 2024-02-15T18:27:04.777 INFO:tasks.workunit.client.1.smithi133.stdout:8/190: stat d3/l6 0 2024-02-15T18:27:04.777 INFO:tasks.workunit.client.1.smithi133.stdout:8/191: write d3/f3a [302934,23972] 0 2024-02-15T18:27:04.777 INFO:tasks.workunit.client.1.smithi133.stdout:8/192: chown d3/d1c/d2f 177 1 2024-02-15T18:27:04.777 INFO:tasks.workunit.client.1.smithi133.stdout:1/356: creat d6/d1e/d3a/d82/d85/d67/f8b x:0 0 0 2024-02-15T18:27:04.778 INFO:tasks.workunit.client.0.smithi084.stdout:4/510: dwrite d2/d2b/d47/d31/f43 [0,4194304] 0 2024-02-15T18:27:04.778 INFO:tasks.workunit.client.0.smithi084.stdout:7/459: dwrite df/f1c [0,4194304] 0 2024-02-15T18:27:04.778 INFO:tasks.workunit.client.0.smithi084.stdout:3/449: rename d8/d40/l57 to d8/l98 0 2024-02-15T18:27:04.778 INFO:tasks.workunit.client.0.smithi084.stdout:5/573: creat d9/da/d3d/fb9 x:0 0 0 2024-02-15T18:27:04.778 INFO:tasks.workunit.client.0.smithi084.stdout:6/478: write f3 [2071688,84790] 0 2024-02-15T18:27:04.780 INFO:tasks.workunit.client.1.smithi133.stdout:9/174: symlink d0/d37/l38 0 2024-02-15T18:27:04.780 INFO:tasks.workunit.client.1.smithi133.stdout:8/193: creat d3/f43 x:0 0 0 2024-02-15T18:27:04.781 INFO:tasks.workunit.client.1.smithi133.stdout:2/250: creat d7/db/d35/d4a/f52 x:0 0 0 2024-02-15T18:27:04.781 INFO:tasks.workunit.client.1.smithi133.stdout:2/251: stat d7/d2c/d3b 0 2024-02-15T18:27:04.781 INFO:tasks.workunit.client.1.smithi133.stdout:2/252: write d7/d2c/d3b/f50 [707012,119021] 0 2024-02-15T18:27:04.781 INFO:tasks.workunit.client.1.smithi133.stdout:9/175: mknod d0/d8/d9/d12/d2a/c39 0 2024-02-15T18:27:04.783 INFO:tasks.workunit.client.1.smithi133.stdout:5/159: read fc [2784754,54895] 0 2024-02-15T18:27:04.784 INFO:tasks.workunit.client.0.smithi084.stdout:4/511: link d2/d4/d28/d3d/f53 d2/d2b/d47/d31/d50/f98 0 2024-02-15T18:27:04.784 INFO:tasks.workunit.client.0.smithi084.stdout:2/480: unlink d3/d5/d1a/d1e/f61 0 2024-02-15T18:27:04.784 INFO:tasks.workunit.client.0.smithi084.stdout:1/448: dread d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 [0,4194304] 0 2024-02-15T18:27:04.785 INFO:tasks.workunit.client.1.smithi133.stdout:8/194: creat d3/f44 x:0 0 0 2024-02-15T18:27:04.785 INFO:tasks.workunit.client.1.smithi133.stdout:8/195: dread - d3/d1c/d2f/f3b zero size 2024-02-15T18:27:04.785 INFO:tasks.workunit.client.1.smithi133.stdout:8/196: readlink d3/d7/l11 0 2024-02-15T18:27:04.785 INFO:tasks.workunit.client.1.smithi133.stdout:2/253: creat d7/f53 x:0 0 0 2024-02-15T18:27:04.785 INFO:tasks.workunit.client.1.smithi133.stdout:2/254: chown d7/d2c/d3b/f50 68445 1 2024-02-15T18:27:04.789 INFO:tasks.workunit.client.0.smithi084.stdout:7/460: symlink df/d1d/d1a/d4d/d59/l89 0 2024-02-15T18:27:04.789 INFO:tasks.workunit.client.0.smithi084.stdout:7/461: readlink df/l84 0 2024-02-15T18:27:04.789 INFO:tasks.workunit.client.1.smithi133.stdout:5/160: rename d17/l1a to d17/d2a/l2e 0 2024-02-15T18:27:04.789 INFO:tasks.workunit.client.1.smithi133.stdout:8/197: getdents d3/d1f 0 2024-02-15T18:27:04.789 INFO:tasks.workunit.client.1.smithi133.stdout:8/198: fdatasync d3/d1f/f23 0 2024-02-15T18:27:04.790 INFO:tasks.workunit.client.0.smithi084.stdout:3/450: mknod d8/d40/d43/d71/d8c/c99 0 2024-02-15T18:27:04.791 INFO:tasks.workunit.client.1.smithi133.stdout:2/255: mkdir d7/db/d35/d4a/d54 0 2024-02-15T18:27:04.791 INFO:tasks.workunit.client.1.smithi133.stdout:2/256: stat d7/db/d35/d4a 0 2024-02-15T18:27:04.792 INFO:tasks.workunit.client.0.smithi084.stdout:4/512: getdents d2/d64/d74 0 2024-02-15T18:27:04.792 INFO:tasks.workunit.client.0.smithi084.stdout:4/513: write d2/d4/d28/d3d/d5c/d5d/f63 [4901676,103847] 0 2024-02-15T18:27:04.792 INFO:tasks.workunit.client.0.smithi084.stdout:4/514: dread - d2/d64/f85 zero size 2024-02-15T18:27:04.794 INFO:tasks.workunit.client.0.smithi084.stdout:2/481: truncate d3/f11 6827256 0 2024-02-15T18:27:04.794 INFO:tasks.workunit.client.0.smithi084.stdout:2/482: fdatasync d3/d28/f45 0 2024-02-15T18:27:04.794 INFO:tasks.workunit.client.0.smithi084.stdout:3/451: creat d8/d1f/d25/f9a x:0 0 0 2024-02-15T18:27:04.794 INFO:tasks.workunit.client.0.smithi084.stdout:3/452: write d8/d40/d58/f72 [560740,112536] 0 2024-02-15T18:27:04.794 INFO:tasks.workunit.client.0.smithi084.stdout:3/453: dread - d8/d40/d58/f83 zero size 2024-02-15T18:27:04.795 INFO:tasks.workunit.client.1.smithi133.stdout:2/257: write d7/f26 [241779,53277] 0 2024-02-15T18:27:04.795 INFO:tasks.workunit.client.0.smithi084.stdout:4/515: write d2/d4/d28/d2e/f49 [5065748,106690] 0 2024-02-15T18:27:04.799 INFO:tasks.workunit.client.1.smithi133.stdout:1/357: dread d6/d17/f60 [0,4194304] 0 2024-02-15T18:27:04.799 INFO:tasks.workunit.client.1.smithi133.stdout:1/358: stat d6/f16 0 2024-02-15T18:27:04.799 INFO:tasks.workunit.client.1.smithi133.stdout:8/199: rename d3/d7/l28 to d3/d7/d40/l45 0 2024-02-15T18:27:04.801 INFO:tasks.workunit.client.0.smithi084.stdout:1/449: write d9/d54/d1b/d2c/f43 [608499,112045] 0 2024-02-15T18:27:04.802 INFO:tasks.workunit.client.1.smithi133.stdout:1/359: rename d6/d1e/d3a/d82/d85/f50 to d6/d1e/d41/d7c/f8c 0 2024-02-15T18:27:04.803 INFO:tasks.workunit.client.1.smithi133.stdout:1/360: readlink d6/l1f 0 2024-02-15T18:27:04.803 INFO:tasks.workunit.client.1.smithi133.stdout:8/200: creat d3/f46 x:0 0 0 2024-02-15T18:27:04.803 INFO:tasks.workunit.client.1.smithi133.stdout:8/201: chown d3/d1f 0 1 2024-02-15T18:27:04.803 INFO:tasks.workunit.client.1.smithi133.stdout:8/202: fdatasync d3/f43 0 2024-02-15T18:27:04.804 INFO:tasks.workunit.client.1.smithi133.stdout:1/361: mknod d6/d1e/d3a/c8d 0 2024-02-15T18:27:04.807 INFO:tasks.workunit.client.0.smithi084.stdout:2/483: mkdir d3/d9e 0 2024-02-15T18:27:04.808 INFO:tasks.workunit.client.1.smithi133.stdout:8/203: link d3/d7/l11 d3/l47 0 2024-02-15T18:27:04.810 INFO:tasks.workunit.client.0.smithi084.stdout:3/454: write d8/d40/d58/d80/f3c [830761,54425] 0 2024-02-15T18:27:04.810 INFO:tasks.workunit.client.1.smithi133.stdout:8/204: symlink d3/l48 0 2024-02-15T18:27:04.810 INFO:tasks.workunit.client.0.smithi084.stdout:4/516: dread d2/d4/d28/d3d/f90 [0,4194304] 0 2024-02-15T18:27:04.811 INFO:tasks.workunit.client.1.smithi133.stdout:8/205: truncate d3/d1f/f2c 3105826 0 2024-02-15T18:27:04.811 INFO:tasks.workunit.client.1.smithi133.stdout:8/206: dread - d3/f43 zero size 2024-02-15T18:27:04.812 INFO:tasks.workunit.client.0.smithi084.stdout:2/484: mknod d3/d5/d1a/d1e/d47/d76/c9f 0 2024-02-15T18:27:04.812 INFO:tasks.workunit.client.0.smithi084.stdout:2/485: chown d3/d5/d1a/d1e/d47 3115 1 2024-02-15T18:27:04.812 INFO:tasks.workunit.client.0.smithi084.stdout:2/486: chown d3/d5e 8013 1 2024-02-15T18:27:04.812 INFO:tasks.workunit.client.0.smithi084.stdout:2/487: dread - d3/d19/d24/d7b/f9a zero size 2024-02-15T18:27:04.812 INFO:tasks.workunit.client.0.smithi084.stdout:4/517: rmdir d2/d4/d28/d3d/d5c 39 2024-02-15T18:27:04.813 INFO:tasks.workunit.client.0.smithi084.stdout:4/518: symlink d2/d4/l99 0 2024-02-15T18:27:04.815 INFO:tasks.workunit.client.0.smithi084.stdout:4/519: mknod d2/d4/d28/d3d/d5c/c9a 0 2024-02-15T18:27:04.816 INFO:tasks.workunit.client.0.smithi084.stdout:4/520: mknod d2/d2b/d47/d31/c9b 0 2024-02-15T18:27:04.817 INFO:tasks.workunit.client.0.smithi084.stdout:4/521: truncate d2/d2b/d47/f56 286681 0 2024-02-15T18:27:04.819 INFO:tasks.workunit.client.0.smithi084.stdout:0/513: dwrite d0/d4/d66/f6c [0,4194304] 0 2024-02-15T18:27:04.819 INFO:tasks.workunit.client.0.smithi084.stdout:4/522: link d2/d4/d28/d3d/c42 d2/d4/d28/d71/c9c 0 2024-02-15T18:27:04.822 INFO:tasks.workunit.client.0.smithi084.stdout:9/568: dwrite d4/d2b/d3c/f8b [0,4194304] 0 2024-02-15T18:27:04.822 INFO:tasks.workunit.client.0.smithi084.stdout:8/541: dwrite db/d1a/f1d [0,4194304] 0 2024-02-15T18:27:04.823 INFO:tasks.workunit.client.0.smithi084.stdout:8/542: read db/dd/d4d/d97/f9a [50408,108752] 0 2024-02-15T18:27:04.823 INFO:tasks.workunit.client.0.smithi084.stdout:9/569: write d4/d2b/d3c/d24/f71 [345368,10113] 0 2024-02-15T18:27:04.823 INFO:tasks.workunit.client.0.smithi084.stdout:9/570: write d4/d2b/d3c/d20/d43/d15/d33/f7c [1742179,6028] 0 2024-02-15T18:27:04.825 INFO:tasks.workunit.client.0.smithi084.stdout:9/571: write d4/d2b/d3c/d20/d43/f3f [266269,130692] 0 2024-02-15T18:27:04.825 INFO:tasks.workunit.client.0.smithi084.stdout:9/572: stat d4/f6c 0 2024-02-15T18:27:04.825 INFO:tasks.workunit.client.0.smithi084.stdout:9/573: chown d4/d36/la9 1 1 2024-02-15T18:27:04.825 INFO:tasks.workunit.client.0.smithi084.stdout:8/543: mkdir db/daf/db6 0 2024-02-15T18:27:04.826 INFO:tasks.workunit.client.1.smithi133.stdout:8/207: fsync d3/d7/f26 0 2024-02-15T18:27:04.828 INFO:tasks.workunit.client.0.smithi084.stdout:0/514: write d0/d4/d1b/f6f [2798275,121288] 0 2024-02-15T18:27:04.828 INFO:tasks.workunit.client.1.smithi133.stdout:8/208: rename d3/d7/l11 to d3/d1c/d37/l49 0 2024-02-15T18:27:04.830 INFO:tasks.workunit.client.1.smithi133.stdout:8/209: creat d3/f4a x:0 0 0 2024-02-15T18:27:04.830 INFO:tasks.workunit.client.1.smithi133.stdout:8/210: readlink d3/d7/l3d 0 2024-02-15T18:27:04.830 INFO:tasks.workunit.client.0.smithi084.stdout:0/515: mknod d0/d4/d1b/d7a/c9c 0 2024-02-15T18:27:04.833 INFO:tasks.workunit.client.0.smithi084.stdout:0/516: rename d0/d39/l63 to d0/d4/d1b/d26/d43/d6d/d71/l9d 0 2024-02-15T18:27:04.833 INFO:tasks.workunit.client.0.smithi084.stdout:0/517: write d0/d4/d1b/f3c [4851102,128188] 0 2024-02-15T18:27:04.835 INFO:tasks.workunit.client.0.smithi084.stdout:0/518: creat d0/d4/d1b/d26/d43/f9e x:0 0 0 2024-02-15T18:27:04.840 INFO:tasks.workunit.client.0.smithi084.stdout:0/519: creat d0/d1e/f9f x:0 0 0 2024-02-15T18:27:04.843 INFO:tasks.workunit.client.0.smithi084.stdout:5/574: dwrite d9/da/d3d/d44/d55/d70/d84/f98 [0,4194304] 0 2024-02-15T18:27:04.844 INFO:tasks.workunit.client.0.smithi084.stdout:5/575: write d9/da/f99 [306165,102681] 0 2024-02-15T18:27:04.845 INFO:tasks.workunit.client.0.smithi084.stdout:5/576: truncate d9/da/d3d/f72 673891 0 2024-02-15T18:27:04.847 INFO:tasks.workunit.client.0.smithi084.stdout:5/577: rename d9/da/d3d/d44/d55/d70/c77 to d9/d5b/cba 0 2024-02-15T18:27:04.847 INFO:tasks.workunit.client.0.smithi084.stdout:0/520: write d0/d4/d1b/f42 [2854447,7341] 0 2024-02-15T18:27:04.848 INFO:tasks.workunit.client.1.smithi133.stdout:2/258: dread d7/d2c/d3b/f50 [0,4194304] 0 2024-02-15T18:27:04.849 INFO:tasks.workunit.client.0.smithi084.stdout:5/578: creat d9/d5b/d79/fbb x:0 0 0 2024-02-15T18:27:04.850 INFO:tasks.workunit.client.0.smithi084.stdout:0/521: mkdir d0/d4/d1b/d26/d43/da0 0 2024-02-15T18:27:04.853 INFO:tasks.workunit.client.1.smithi133.stdout:9/176: dwrite d0/d8/d9/d12/d2a/f2e [0,4194304] 0 2024-02-15T18:27:04.854 INFO:tasks.workunit.client.0.smithi084.stdout:6/479: dwrite d14/d22/d25/d2f/d31/d30/d45/d54/f6e [0,4194304] 0 2024-02-15T18:27:04.856 INFO:tasks.workunit.client.0.smithi084.stdout:1/450: dwrite d9/d54/f99 [0,4194304] 0 2024-02-15T18:27:04.859 INFO:tasks.workunit.client.0.smithi084.stdout:3/455: dwrite d8/d40/f70 [0,4194304] 0 2024-02-15T18:27:04.859 INFO:tasks.workunit.client.0.smithi084.stdout:1/451: dread d9/d54/d32/d5b/f90 [0,4194304] 0 2024-02-15T18:27:04.860 INFO:tasks.workunit.client.0.smithi084.stdout:2/488: dwrite d3/d19/d24/d7b/f9a [0,4194304] 0 2024-02-15T18:27:04.864 INFO:tasks.workunit.client.0.smithi084.stdout:9/574: dwrite d4/d36/f5e [0,4194304] 0 2024-02-15T18:27:04.864 INFO:tasks.workunit.client.0.smithi084.stdout:9/575: write d4/d2b/d3c/d24/f68 [220132,73718] 0 2024-02-15T18:27:04.867 INFO:tasks.workunit.client.0.smithi084.stdout:8/544: dwrite db/f25 [0,4194304] 0 2024-02-15T18:27:04.867 INFO:tasks.workunit.client.0.smithi084.stdout:8/545: stat db/dd/d4d/f63 0 2024-02-15T18:27:04.869 INFO:tasks.workunit.client.0.smithi084.stdout:4/523: dwrite d2/d4/f55 [0,4194304] 0 2024-02-15T18:27:04.869 INFO:tasks.workunit.client.0.smithi084.stdout:0/522: dwrite d0/d4/d1b/d26/d43/f9e [0,4194304] 0 2024-02-15T18:27:04.873 INFO:tasks.workunit.client.0.smithi084.stdout:6/480: creat d14/d22/d25/d2f/d31/d3f/d4a/f98 x:0 0 0 2024-02-15T18:27:04.877 INFO:tasks.workunit.client.0.smithi084.stdout:5/579: getdents d9/da/d3d/d44/d55/d70 0 2024-02-15T18:27:04.877 INFO:tasks.workunit.client.0.smithi084.stdout:5/580: dread - d9/da/d3d/fb9 zero size 2024-02-15T18:27:04.881 INFO:tasks.workunit.client.0.smithi084.stdout:4/524: dread d2/fc [0,4194304] 0 2024-02-15T18:27:04.888 INFO:tasks.workunit.client.0.smithi084.stdout:3/456: rename d8/d1f/d2d/f8a to d8/d40/d43/d71/f9b 0 2024-02-15T18:27:04.889 INFO:tasks.workunit.client.0.smithi084.stdout:3/457: fsync d8/d1f/d2d/f3d 0 2024-02-15T18:27:04.889 INFO:tasks.workunit.client.0.smithi084.stdout:3/458: write d8/d40/d58/d80/f7c [463050,17782] 0 2024-02-15T18:27:04.889 INFO:tasks.workunit.client.0.smithi084.stdout:1/452: truncate d9/d54/d1b/d38/f4a 2892238 0 2024-02-15T18:27:04.889 INFO:tasks.workunit.client.0.smithi084.stdout:1/453: chown d9/d54/d32/l3e 9051 1 2024-02-15T18:27:04.892 INFO:tasks.workunit.client.0.smithi084.stdout:9/576: creat d4/d81/fb3 x:0 0 0 2024-02-15T18:27:04.894 INFO:tasks.workunit.client.0.smithi084.stdout:8/546: mkdir db/d1a/db7 0 2024-02-15T18:27:04.895 INFO:tasks.workunit.client.0.smithi084.stdout:5/581: dwrite d9/da/f99 [0,4194304] 0 2024-02-15T18:27:04.901 INFO:tasks.workunit.client.0.smithi084.stdout:0/523: creat d0/d4/d3a/d5c/fa1 x:0 0 0 2024-02-15T18:27:04.910 INFO:tasks.workunit.client.0.smithi084.stdout:4/525: rmdir d2/d4/d25 39 2024-02-15T18:27:04.911 INFO:tasks.workunit.client.0.smithi084.stdout:0/524: dread d0/d25/f34 [0,4194304] 0 2024-02-15T18:27:04.911 INFO:tasks.workunit.client.0.smithi084.stdout:0/525: write d0/d2f/d3f/f49 [3061090,130623] 0 2024-02-15T18:27:04.911 INFO:tasks.workunit.client.0.smithi084.stdout:2/489: rename d3/d5/d1a/d1e/c4f to d3/d5/d53/ca0 0 2024-02-15T18:27:04.914 INFO:tasks.workunit.client.0.smithi084.stdout:1/454: creat d9/d54/d1b/d2c/d4b/f9e x:0 0 0 2024-02-15T18:27:04.915 INFO:tasks.workunit.client.0.smithi084.stdout:8/547: getdents db/d1a 0 2024-02-15T18:27:04.915 INFO:tasks.workunit.client.0.smithi084.stdout:4/526: dread d2/f34 [0,4194304] 0 2024-02-15T18:27:04.915 INFO:tasks.workunit.client.0.smithi084.stdout:4/527: truncate d2/d2b/d47/f56 325593 0 2024-02-15T18:27:04.918 INFO:tasks.workunit.client.0.smithi084.stdout:6/481: truncate f3 1368518 0 2024-02-15T18:27:04.918 INFO:tasks.workunit.client.0.smithi084.stdout:6/482: fdatasync d14/d22/d25/f32 0 2024-02-15T18:27:04.919 INFO:tasks.workunit.client.0.smithi084.stdout:0/526: mkdir d0/d1e/da2 0 2024-02-15T18:27:04.919 INFO:tasks.workunit.client.0.smithi084.stdout:1/455: dread d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 [0,4194304] 0 2024-02-15T18:27:04.920 INFO:tasks.workunit.client.0.smithi084.stdout:8/548: dread db/d3f/d59/f3b [0,4194304] 0 2024-02-15T18:27:04.921 INFO:tasks.workunit.client.0.smithi084.stdout:3/459: rename d8/d40/d58/l74 to d8/d1f/l9c 0 2024-02-15T18:27:04.922 INFO:tasks.workunit.client.0.smithi084.stdout:2/490: getdents d3/d5/d1a/d74/d8e 0 2024-02-15T18:27:04.931 INFO:tasks.workunit.client.0.smithi084.stdout:4/528: dread d2/d2b/d47/d31/d50/d94/f97 [0,4194304] 0 2024-02-15T18:27:04.941 INFO:tasks.workunit.client.0.smithi084.stdout:8/549: dwrite db/d1a/f5f [0,4194304] 0 2024-02-15T18:27:04.958 INFO:tasks.workunit.client.1.smithi133.stdout:6/255: sync 2024-02-15T18:27:04.958 INFO:tasks.workunit.client.1.smithi133.stdout:4/142: sync 2024-02-15T18:27:04.958 INFO:tasks.workunit.client.1.smithi133.stdout:4/143: dread - d2/d5/d2b/d21/f1b zero size 2024-02-15T18:27:04.959 INFO:tasks.workunit.client.1.smithi133.stdout:6/256: unlink d0/c28 0 2024-02-15T18:27:04.960 INFO:tasks.workunit.client.1.smithi133.stdout:6/257: write d0/f27 [4361082,16599] 0 2024-02-15T18:27:04.960 INFO:tasks.workunit.client.1.smithi133.stdout:6/258: chown d0/db/c1d 6285957 1 2024-02-15T18:27:04.960 INFO:tasks.workunit.client.1.smithi133.stdout:6/259: write d0/db/d29/d34/d48/f49 [70915,37169] 0 2024-02-15T18:27:04.960 INFO:tasks.workunit.client.1.smithi133.stdout:6/260: read d0/db/f3f [515572,66370] 0 2024-02-15T18:27:04.960 INFO:tasks.workunit.client.1.smithi133.stdout:6/261: fdatasync d0/db/f18 0 2024-02-15T18:27:04.961 INFO:tasks.workunit.client.1.smithi133.stdout:4/144: link d2/fd d2/d5/d2b/d21/f31 0 2024-02-15T18:27:04.961 INFO:tasks.workunit.client.1.smithi133.stdout:6/262: write d0/f14 [899788,100513] 0 2024-02-15T18:27:04.961 INFO:tasks.workunit.client.1.smithi133.stdout:4/145: creat d2/d5/d2b/f32 x:0 0 0 2024-02-15T18:27:04.961 INFO:tasks.workunit.client.1.smithi133.stdout:4/146: dread - d2/d5/d2b/d21/f1b zero size 2024-02-15T18:27:04.962 INFO:tasks.workunit.client.1.smithi133.stdout:4/147: chown d2/d5/d2b/d21/d2d/f2e 37327 1 2024-02-15T18:27:04.962 INFO:tasks.workunit.client.1.smithi133.stdout:6/263: creat d0/d3b/d41/f56 x:0 0 0 2024-02-15T18:27:04.964 INFO:tasks.workunit.client.1.smithi133.stdout:6/264: mknod d0/db/d29/d34/d48/c57 0 2024-02-15T18:27:04.965 INFO:tasks.workunit.client.1.smithi133.stdout:6/265: creat d0/d3b/d52/f58 x:0 0 0 2024-02-15T18:27:04.967 INFO:tasks.workunit.client.1.smithi133.stdout:4/148: rmdir d2 39 2024-02-15T18:27:04.968 INFO:tasks.workunit.client.1.smithi133.stdout:4/149: read d2/f23 [358937,33288] 0 2024-02-15T18:27:04.968 INFO:tasks.workunit.client.1.smithi133.stdout:4/150: fdatasync d2/d5/d2b/fe 0 2024-02-15T18:27:04.968 INFO:tasks.workunit.client.1.smithi133.stdout:6/266: creat d0/d3b/d52/f59 x:0 0 0 2024-02-15T18:27:04.969 INFO:tasks.workunit.client.1.smithi133.stdout:4/151: symlink d2/d5/d25/l33 0 2024-02-15T18:27:04.971 INFO:tasks.workunit.client.1.smithi133.stdout:6/267: rmdir d0/d5/d37 39 2024-02-15T18:27:04.971 INFO:tasks.workunit.client.1.smithi133.stdout:6/268: dread - d0/f50 zero size 2024-02-15T18:27:04.972 INFO:tasks.workunit.client.1.smithi133.stdout:4/152: symlink d2/l34 0 2024-02-15T18:27:04.974 INFO:tasks.workunit.client.1.smithi133.stdout:4/153: mknod d2/d5/d2b/c35 0 2024-02-15T18:27:04.974 INFO:tasks.workunit.client.1.smithi133.stdout:4/154: write d2/f2a [673276,4471] 0 2024-02-15T18:27:04.975 INFO:tasks.workunit.client.1.smithi133.stdout:6/269: dread d0/ff [0,4194304] 0 2024-02-15T18:27:04.975 INFO:tasks.workunit.client.1.smithi133.stdout:4/155: unlink d2/f2f 0 2024-02-15T18:27:04.976 INFO:tasks.workunit.client.0.smithi084.stdout:6/483: stat d14/d22/d25/d2f/d31/d30/d45/d5c/l62 0 2024-02-15T18:27:04.977 INFO:tasks.workunit.client.0.smithi084.stdout:1/456: truncate d9/d54/d1b/d2c/f31 1944324 0 2024-02-15T18:27:04.977 INFO:tasks.workunit.client.0.smithi084.stdout:1/457: read - d9/d54/d1b/d2c/d4b/d7a/d89/f96 zero size 2024-02-15T18:27:04.979 INFO:tasks.workunit.client.0.smithi084.stdout:9/577: rename d4/d2b/d3c/d20/d43/c42 to d4/d2b/d3c/d20/d43/d15/d4b/cb4 0 2024-02-15T18:27:04.979 INFO:tasks.workunit.client.1.smithi133.stdout:6/270: rmdir d0 39 2024-02-15T18:27:04.980 INFO:tasks.workunit.client.1.smithi133.stdout:4/156: mkdir d2/d5/d2b/d21/d36 0 2024-02-15T18:27:04.981 INFO:tasks.workunit.client.0.smithi084.stdout:3/460: rmdir d8 39 2024-02-15T18:27:04.981 INFO:tasks.workunit.client.0.smithi084.stdout:2/491: symlink d3/d9e/la1 0 2024-02-15T18:27:04.981 INFO:tasks.workunit.client.0.smithi084.stdout:2/492: fsync d3/d19/f6c 0 2024-02-15T18:27:04.984 INFO:tasks.workunit.client.1.smithi133.stdout:6/271: chown d0/d5/f1b 175570896 1 2024-02-15T18:27:04.984 INFO:tasks.workunit.client.0.smithi084.stdout:4/529: mknod d2/d4/d25/d66/c9d 0 2024-02-15T18:27:04.984 INFO:tasks.workunit.client.0.smithi084.stdout:4/530: write d2/d64/d74/f7f [910648,106922] 0 2024-02-15T18:27:04.985 INFO:tasks.workunit.client.0.smithi084.stdout:4/531: write d2/f21 [1759970,20069] 0 2024-02-15T18:27:04.985 INFO:tasks.workunit.client.1.smithi133.stdout:4/157: mknod d2/d5/d2b/c37 0 2024-02-15T18:27:04.986 INFO:tasks.workunit.client.0.smithi084.stdout:8/550: mknod db/cb8 0 2024-02-15T18:27:04.986 INFO:tasks.workunit.client.0.smithi084.stdout:8/551: fsync fa 0 2024-02-15T18:27:04.986 INFO:tasks.workunit.client.0.smithi084.stdout:8/552: chown db/d1a/da5 3499356 1 2024-02-15T18:27:04.986 INFO:tasks.workunit.client.1.smithi133.stdout:6/272: symlink d0/d3b/d52/l5a 0 2024-02-15T18:27:04.987 INFO:tasks.workunit.client.1.smithi133.stdout:4/158: symlink d2/d5/d25/l38 0 2024-02-15T18:27:04.988 INFO:tasks.workunit.client.0.smithi084.stdout:6/484: mkdir d14/d22/d25/d2f/d31/d30/d93/d99 0 2024-02-15T18:27:04.988 INFO:tasks.workunit.client.1.smithi133.stdout:6/273: symlink d0/db/d1c/d40/l5b 0 2024-02-15T18:27:04.989 INFO:tasks.workunit.client.0.smithi084.stdout:1/458: unlink d9/d54/d1b/d2c/c86 0 2024-02-15T18:27:04.990 INFO:tasks.workunit.client.0.smithi084.stdout:3/461: creat d8/f9d x:0 0 0 2024-02-15T18:27:04.991 INFO:tasks.workunit.client.0.smithi084.stdout:1/459: write d9/d54/d1b/f70 [608116,2432] 0 2024-02-15T18:27:04.992 INFO:tasks.workunit.client.0.smithi084.stdout:4/532: link d2/f35 d2/d2b/d47/d31/f9e 0 2024-02-15T18:27:04.993 INFO:tasks.workunit.client.0.smithi084.stdout:3/462: mknod d8/d40/d43/d71/c9e 0 2024-02-15T18:27:04.994 INFO:tasks.workunit.client.0.smithi084.stdout:3/463: fsync d8/d73/f90 0 2024-02-15T18:27:04.995 INFO:tasks.workunit.client.0.smithi084.stdout:1/460: truncate d9/d54/d1b/d2c/d35/f5d 2288005 0 2024-02-15T18:27:04.997 INFO:tasks.workunit.client.1.smithi133.stdout:6/274: unlink d0/l4 0 2024-02-15T18:27:04.997 INFO:tasks.workunit.client.1.smithi133.stdout:6/275: dread - d0/f50 zero size 2024-02-15T18:27:04.997 INFO:tasks.workunit.client.1.smithi133.stdout:6/276: fsync d0/f26 0 2024-02-15T18:27:04.997 INFO:tasks.workunit.client.1.smithi133.stdout:6/277: read - d0/f4b zero size 2024-02-15T18:27:04.998 INFO:tasks.workunit.client.0.smithi084.stdout:1/461: mkdir d9/d54/d76/d9f 0 2024-02-15T18:27:04.998 INFO:tasks.workunit.client.1.smithi133.stdout:4/159: getdents d2/d5/d2b/d21 0 2024-02-15T18:27:05.000 INFO:tasks.workunit.client.0.smithi084.stdout:1/462: unlink d9/d54/d1b/f42 0 2024-02-15T18:27:05.000 INFO:tasks.workunit.client.0.smithi084.stdout:1/463: readlink d9/d54/d5c/d81/d94/l97 0 2024-02-15T18:27:05.000 INFO:tasks.workunit.client.0.smithi084.stdout:1/464: chown d9/d54/d1b/d2c/d35/f72 22 1 2024-02-15T18:27:05.000 INFO:tasks.workunit.client.1.smithi133.stdout:4/160: symlink d2/d5/d2b/d21/d36/l39 0 2024-02-15T18:27:05.001 INFO:tasks.workunit.client.0.smithi084.stdout:1/465: creat d9/d54/d1b/d38/d4d/fa0 x:0 0 0 2024-02-15T18:27:05.001 INFO:tasks.workunit.client.0.smithi084.stdout:1/466: chown d9/d54/d1b/d2c/d4b/d7a/d89/f98 19 1 2024-02-15T18:27:05.004 INFO:tasks.workunit.client.0.smithi084.stdout:1/467: mknod d9/d54/d76/ca1 0 2024-02-15T18:27:05.004 INFO:tasks.workunit.client.1.smithi133.stdout:4/161: rename d2/d5/d25/l38 to d2/d5/d2b/d21/l3a 0 2024-02-15T18:27:05.005 INFO:tasks.workunit.client.0.smithi084.stdout:1/468: chown d9/d54/d1b/d2c/d4b/d4c/d79/d39/l2a 25 1 2024-02-15T18:27:05.005 INFO:tasks.workunit.client.1.smithi133.stdout:4/162: mkdir d2/d5/d2b/d21/d3b 0 2024-02-15T18:27:05.005 INFO:tasks.workunit.client.1.smithi133.stdout:4/163: fsync d2/fd 0 2024-02-15T18:27:05.007 INFO:tasks.workunit.client.0.smithi084.stdout:1/469: unlink d9/d54/d1b/d2c/d35/f48 0 2024-02-15T18:27:05.010 INFO:tasks.workunit.client.0.smithi084.stdout:9/578: dwrite d4/d2b/d3c/d20/f52 [0,4194304] 0 2024-02-15T18:27:05.013 INFO:tasks.workunit.client.0.smithi084.stdout:8/553: dread db/dd/d13/f8c [0,4194304] 0 2024-02-15T18:27:05.016 INFO:tasks.workunit.client.0.smithi084.stdout:9/579: rename d4/d2b/d3c/d20/d43/f3f to d4/d2b/d3c/d20/d75/fb5 0 2024-02-15T18:27:05.016 INFO:tasks.workunit.client.0.smithi084.stdout:9/580: readlink d4/d2b/d3c/d20/d43/d15/l2d 0 2024-02-15T18:27:05.016 INFO:tasks.workunit.client.0.smithi084.stdout:9/581: write d4/d2b/d3c/d20/f5a [4676473,42042] 0 2024-02-15T18:27:05.019 INFO:tasks.workunit.client.0.smithi084.stdout:2/493: dwrite d3/d28/f78 [0,4194304] 0 2024-02-15T18:27:05.020 INFO:tasks.workunit.client.0.smithi084.stdout:9/582: write d4/d6b/f97 [2076647,70338] 0 2024-02-15T18:27:05.026 INFO:tasks.workunit.client.0.smithi084.stdout:8/554: dread db/fe [4194304,4194304] 0 2024-02-15T18:27:05.028 INFO:tasks.workunit.client.0.smithi084.stdout:8/555: mkdir db/dd/d13/db9 0 2024-02-15T18:27:05.030 INFO:tasks.workunit.client.0.smithi084.stdout:8/556: write db/dd/d4d/f7c [3373803,57084] 0 2024-02-15T18:27:05.036 INFO:tasks.workunit.client.0.smithi084.stdout:6/485: dwrite d14/d22/d25/d2f/d31/d3f/d4a/f98 [0,4194304] 0 2024-02-15T18:27:05.041 INFO:tasks.workunit.client.0.smithi084.stdout:6/486: mknod d14/d22/d25/d2f/d31/c9a 0 2024-02-15T18:27:05.041 INFO:tasks.workunit.client.0.smithi084.stdout:6/487: truncate d14/d22/d25/f35 1554379 0 2024-02-15T18:27:05.041 INFO:tasks.workunit.client.0.smithi084.stdout:6/488: read d14/d22/f64 [442762,49270] 0 2024-02-15T18:27:05.049 INFO:tasks.workunit.client.0.smithi084.stdout:4/533: dread d2/d64/d74/f7f [0,4194304] 0 2024-02-15T18:27:05.049 INFO:tasks.workunit.client.0.smithi084.stdout:4/534: chown d2/d4/d28/d3d/d5c/d65 1 1 2024-02-15T18:27:05.053 INFO:tasks.workunit.client.0.smithi084.stdout:6/489: dread d14/d22/d25/d2f/d31/d30/d45/d52/f53 [0,4194304] 0 2024-02-15T18:27:05.056 INFO:tasks.workunit.client.0.smithi084.stdout:6/490: rename d14/d22/d25/d89 to d14/d22/d25/d2f/d31/d30/d45/d5c/d9b 0 2024-02-15T18:27:05.056 INFO:tasks.workunit.client.0.smithi084.stdout:6/491: readlink d14/d22/d25/d2f/l3a 0 2024-02-15T18:27:05.057 INFO:tasks.workunit.client.0.smithi084.stdout:6/492: write d14/f17 [917052,85342] 0 2024-02-15T18:27:05.058 INFO:tasks.workunit.client.0.smithi084.stdout:6/493: write d14/d22/d25/d28/f48 [4176376,76837] 0 2024-02-15T18:27:05.058 INFO:tasks.workunit.client.0.smithi084.stdout:6/494: truncate d14/d22/d25/d2f/d31/d30/d4f/f61 1115185 0 2024-02-15T18:27:05.059 INFO:tasks.workunit.client.0.smithi084.stdout:1/470: dwrite d9/d54/d32/d5b/f8d [0,4194304] 0 2024-02-15T18:27:05.059 INFO:tasks.workunit.client.0.smithi084.stdout:3/464: dwrite d8/d40/f70 [0,4194304] 0 2024-02-15T18:27:05.059 INFO:tasks.workunit.client.0.smithi084.stdout:3/465: readlink d8/d40/d43/l6d 0 2024-02-15T18:27:05.060 INFO:tasks.workunit.client.0.smithi084.stdout:2/494: dwrite d3/d5/f21 [0,4194304] 0 2024-02-15T18:27:05.061 INFO:tasks.workunit.client.0.smithi084.stdout:1/471: creat d9/d54/d5c/d81/fa2 x:0 0 0 2024-02-15T18:27:05.062 INFO:tasks.workunit.client.1.smithi133.stdout:4/164: dwrite d2/f9 [0,4194304] 0 2024-02-15T18:27:05.067 INFO:tasks.workunit.client.0.smithi084.stdout:1/472: unlink d9/d54/d1b/d2c/d35/f5d 0 2024-02-15T18:27:05.069 INFO:tasks.workunit.client.0.smithi084.stdout:6/495: dread d14/d22/d25/d41/f75 [0,4194304] 0 2024-02-15T18:27:05.069 INFO:tasks.workunit.client.0.smithi084.stdout:6/496: readlink d14/d22/d25/d2f/d31/d3f/d4a/l7b 0 2024-02-15T18:27:05.069 INFO:tasks.workunit.client.0.smithi084.stdout:4/535: dwrite d2/d4/d28/d3d/d5c/d65/f76 [0,4194304] 0 2024-02-15T18:27:05.070 INFO:tasks.workunit.client.0.smithi084.stdout:9/583: dwrite d4/d2b/d3c/d20/d43/d15/f40 [0,4194304] 0 2024-02-15T18:27:05.070 INFO:tasks.workunit.client.0.smithi084.stdout:1/473: creat d9/d54/d32/d5b/d69/fa3 x:0 0 0 2024-02-15T18:27:05.079 INFO:tasks.workunit.client.0.smithi084.stdout:8/557: dwrite db/dd/d13/d42/f80 [0,4194304] 0 2024-02-15T18:27:05.080 INFO:tasks.workunit.client.0.smithi084.stdout:7/462: sync 2024-02-15T18:27:05.080 INFO:tasks.workunit.client.0.smithi084.stdout:8/558: write db/f3a [5314,9098] 0 2024-02-15T18:27:05.080 INFO:tasks.workunit.client.0.smithi084.stdout:8/559: fsync db/f74 0 2024-02-15T18:27:05.082 INFO:tasks.workunit.client.0.smithi084.stdout:4/536: mkdir d2/d4/d28/d3d/d5c/d65/d9f 0 2024-02-15T18:27:05.084 INFO:tasks.workunit.client.0.smithi084.stdout:9/584: rename d4/d2b/d3c/l83 to d4/d2b/d3c/d20/d43/lb6 0 2024-02-15T18:27:05.085 INFO:tasks.workunit.client.0.smithi084.stdout:1/474: symlink d9/d54/d1b/d38/d4d/la4 0 2024-02-15T18:27:05.087 INFO:tasks.workunit.client.0.smithi084.stdout:7/463: creat df/d1d/d1a/d4d/d59/f8a x:0 0 0 2024-02-15T18:27:05.088 INFO:tasks.workunit.client.0.smithi084.stdout:8/560: creat db/d1a/da5/fba x:0 0 0 2024-02-15T18:27:05.090 INFO:tasks.workunit.client.0.smithi084.stdout:1/475: dread d9/f15 [4194304,4194304] 0 2024-02-15T18:27:05.090 INFO:tasks.workunit.client.0.smithi084.stdout:1/476: chown d9/d54/d1b/d2c/d4b/d4c/d79 3477 1 2024-02-15T18:27:05.090 INFO:tasks.workunit.client.0.smithi084.stdout:4/537: creat d2/d2b/d47/d31/d61/fa0 x:0 0 0 2024-02-15T18:27:05.090 INFO:tasks.workunit.client.0.smithi084.stdout:4/538: fdatasync d2/f11 0 2024-02-15T18:27:05.091 INFO:tasks.workunit.client.0.smithi084.stdout:4/539: write d2/d4/f8 [440954,100675] 0 2024-02-15T18:27:05.091 INFO:tasks.workunit.client.0.smithi084.stdout:7/464: rename df/d1d/d40 to df/d1d/d1a/d6a/d8b 0 2024-02-15T18:27:05.091 INFO:tasks.workunit.client.0.smithi084.stdout:7/465: chown df/f14 6991393 1 2024-02-15T18:27:05.092 INFO:tasks.workunit.client.0.smithi084.stdout:7/466: write df/d1d/d1a/d4b/f57 [34309,50989] 0 2024-02-15T18:27:05.092 INFO:tasks.workunit.client.0.smithi084.stdout:7/467: chown df/d70/l86 743966 1 2024-02-15T18:27:05.093 INFO:tasks.workunit.client.0.smithi084.stdout:8/561: symlink db/d1a/da5/lbb 0 2024-02-15T18:27:05.094 INFO:tasks.workunit.client.0.smithi084.stdout:3/466: dwrite d8/d1f/d2d/f92 [0,4194304] 0 2024-02-15T18:27:05.095 INFO:tasks.workunit.client.0.smithi084.stdout:0/527: sync 2024-02-15T18:27:05.095 INFO:tasks.workunit.client.0.smithi084.stdout:5/582: sync 2024-02-15T18:27:05.095 INFO:tasks.workunit.client.0.smithi084.stdout:5/583: chown d9/f12 90 1 2024-02-15T18:27:05.095 INFO:tasks.workunit.client.0.smithi084.stdout:5/584: truncate d9/d23/f6d 979883 0 2024-02-15T18:27:05.095 INFO:tasks.workunit.client.0.smithi084.stdout:0/528: write d0/f95 [21385,108830] 0 2024-02-15T18:27:05.095 INFO:tasks.workunit.client.0.smithi084.stdout:1/477: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ca5 0 2024-02-15T18:27:05.100 INFO:tasks.workunit.client.0.smithi084.stdout:4/540: rename d2/d2b/d47/c6d to d2/d2b/d47/d31/d61/ca1 0 2024-02-15T18:27:05.100 INFO:tasks.workunit.client.0.smithi084.stdout:7/468: creat df/d1d/d1a/d4d/d59/d79/f8c x:0 0 0 2024-02-15T18:27:05.101 INFO:tasks.workunit.client.0.smithi084.stdout:4/541: truncate d2/d64/d74/f7f 2033482 0 2024-02-15T18:27:05.101 INFO:tasks.workunit.client.0.smithi084.stdout:8/562: symlink db/dd/d13/db9/lbc 0 2024-02-15T18:27:05.102 INFO:tasks.workunit.client.0.smithi084.stdout:5/585: link d9/f26 d9/da/d3d/d44/d55/d70/fbc 0 2024-02-15T18:27:05.103 INFO:tasks.workunit.client.0.smithi084.stdout:0/529: creat d0/d2f/d3f/d4c/d9a/fa3 x:0 0 0 2024-02-15T18:27:05.104 INFO:tasks.workunit.client.0.smithi084.stdout:0/530: dread - d0/d4/d3a/d5c/fa1 zero size 2024-02-15T18:27:05.104 INFO:tasks.workunit.client.1.smithi133.stdout:4/165: dwrite d2/d5/d2b/d21/f31 [0,4194304] 0 2024-02-15T18:27:05.105 INFO:tasks.workunit.client.0.smithi084.stdout:1/478: link d9/d54/d1b/d2c/d35/c7d d9/d54/ca6 0 2024-02-15T18:27:05.105 INFO:tasks.workunit.client.0.smithi084.stdout:1/479: write d9/d54/d1b/d2c/d4b/d4c/d79/f9c [4791244,103184] 0 2024-02-15T18:27:05.107 INFO:tasks.workunit.client.0.smithi084.stdout:8/563: write db/dd/d1f/f23 [5734171,113714] 0 2024-02-15T18:27:05.107 INFO:tasks.workunit.client.0.smithi084.stdout:8/564: fsync db/dd/f5a 0 2024-02-15T18:27:05.109 INFO:tasks.workunit.client.0.smithi084.stdout:4/542: unlink d2/d2b/f6f 0 2024-02-15T18:27:05.109 INFO:tasks.workunit.client.0.smithi084.stdout:7/469: mkdir df/d1d/d44/d8d 0 2024-02-15T18:27:05.110 INFO:tasks.workunit.client.0.smithi084.stdout:8/565: unlink db/d3f/d59/f60 0 2024-02-15T18:27:05.111 INFO:tasks.workunit.client.1.smithi133.stdout:4/166: dread d2/d5/d25/f27 [0,4194304] 0 2024-02-15T18:27:05.113 INFO:tasks.workunit.client.1.smithi133.stdout:4/167: creat d2/d5/d2b/d21/d2d/f3c x:0 0 0 2024-02-15T18:27:05.113 INFO:tasks.workunit.client.1.smithi133.stdout:4/168: getdents d2/d5/d25 0 2024-02-15T18:27:05.113 INFO:tasks.workunit.client.1.smithi133.stdout:4/169: write d2/d5/d2b/f24 [39913,94263] 0 2024-02-15T18:27:05.114 INFO:tasks.workunit.client.1.smithi133.stdout:4/170: mkdir d2/d5/d2b/d21/d3b/d3d 0 2024-02-15T18:27:05.114 INFO:tasks.workunit.client.0.smithi084.stdout:4/543: symlink d2/d2b/d47/d31/d61/la2 0 2024-02-15T18:27:05.115 INFO:tasks.workunit.client.0.smithi084.stdout:4/544: write d2/d4/f48 [4361832,93225] 0 2024-02-15T18:27:05.116 INFO:tasks.workunit.client.0.smithi084.stdout:8/566: creat db/dd/fbd x:0 0 0 2024-02-15T18:27:05.116 INFO:tasks.workunit.client.0.smithi084.stdout:8/567: write db/dd/d4d/d97/f9a [1101293,87512] 0 2024-02-15T18:27:05.117 INFO:tasks.workunit.client.0.smithi084.stdout:4/545: creat d2/d4/d25/d66/fa3 x:0 0 0 2024-02-15T18:27:05.117 INFO:tasks.workunit.client.0.smithi084.stdout:4/546: write d2/d64/f85 [711552,126898] 0 2024-02-15T18:27:05.118 INFO:tasks.workunit.client.0.smithi084.stdout:4/547: readlink l0 0 2024-02-15T18:27:05.118 INFO:tasks.workunit.client.0.smithi084.stdout:8/568: mkdir db/dd/d13/d42/d79/dbe 0 2024-02-15T18:27:05.119 INFO:tasks.workunit.client.0.smithi084.stdout:4/548: mkdir d2/d4/d28/d3d/da4 0 2024-02-15T18:27:05.119 INFO:tasks.workunit.client.0.smithi084.stdout:4/549: rmdir d2/d4/d28/d3d 39 2024-02-15T18:27:05.122 INFO:tasks.workunit.client.1.smithi133.stdout:4/171: dread d2/d5/d2b/f1e [4194304,4194304] 0 2024-02-15T18:27:05.123 INFO:tasks.workunit.client.0.smithi084.stdout:6/497: dwrite d14/d22/d25/d2f/d31/d3f/f74 [0,4194304] 0 2024-02-15T18:27:05.123 INFO:tasks.workunit.client.0.smithi084.stdout:6/498: write f10 [8360690,36846] 0 2024-02-15T18:27:05.123 INFO:tasks.workunit.client.0.smithi084.stdout:9/585: dwrite d4/d2b/d3c/f49 [0,4194304] 0 2024-02-15T18:27:05.124 INFO:tasks.workunit.client.0.smithi084.stdout:2/495: dwrite d3/d19/d24/d3e/f55 [0,4194304] 0 2024-02-15T18:27:05.124 INFO:tasks.workunit.client.0.smithi084.stdout:2/496: stat d3/d19/d24/d89 0 2024-02-15T18:27:05.124 INFO:tasks.workunit.client.0.smithi084.stdout:2/497: readlink d3/d5/d1a/d1e/d30/l97 0 2024-02-15T18:27:05.125 INFO:tasks.workunit.client.0.smithi084.stdout:5/586: dwrite d9/d5f/d68/d9a/f60 [0,4194304] 0 2024-02-15T18:27:05.125 INFO:tasks.workunit.client.0.smithi084.stdout:5/587: chown d9/d23/f88 62405399 1 2024-02-15T18:27:05.126 INFO:tasks.workunit.client.0.smithi084.stdout:3/467: dwrite d8/d1f/d25/f75 [0,4194304] 0 2024-02-15T18:27:05.129 INFO:tasks.workunit.client.1.smithi133.stdout:4/172: rmdir d2/d5/d2b/d21/d2d 39 2024-02-15T18:27:05.131 INFO:tasks.workunit.client.1.smithi133.stdout:4/173: dread d2/d5/d25/f27 [0,4194304] 0 2024-02-15T18:27:05.133 INFO:tasks.workunit.client.1.smithi133.stdout:4/174: link d2/d5/d2b/d21/d2d/l30 d2/d5/d2b/d21/d2d/l3e 0 2024-02-15T18:27:05.133 INFO:tasks.workunit.client.1.smithi133.stdout:4/175: fdatasync d2/d5/d2b/f24 0 2024-02-15T18:27:05.134 INFO:tasks.workunit.client.0.smithi084.stdout:6/499: mknod d14/d22/d25/d2f/d31/d30/c9c 0 2024-02-15T18:27:05.134 INFO:tasks.workunit.client.0.smithi084.stdout:6/500: truncate d14/d22/d25/d41/f7d 4683016 0 2024-02-15T18:27:05.134 INFO:tasks.workunit.client.0.smithi084.stdout:6/501: stat fc 0 2024-02-15T18:27:05.136 INFO:tasks.workunit.client.0.smithi084.stdout:8/569: dread db/dd/d4d/f7c [0,4194304] 0 2024-02-15T18:27:05.138 INFO:tasks.workunit.client.0.smithi084.stdout:7/470: rename df/d1d/d1a/d4d/d59 to df/d1d/d1a/d6a/d8e 0 2024-02-15T18:27:05.138 INFO:tasks.workunit.client.0.smithi084.stdout:7/471: write df/d1d/d1a/d6a/d8b/d48/f43 [855261,94073] 0 2024-02-15T18:27:05.142 INFO:tasks.workunit.client.0.smithi084.stdout:4/550: getdents d2/d2b/d47/d31/d61 0 2024-02-15T18:27:05.145 INFO:tasks.workunit.client.1.smithi133.stdout:0/178: sync 2024-02-15T18:27:05.145 INFO:tasks.workunit.client.1.smithi133.stdout:7/125: sync 2024-02-15T18:27:05.145 INFO:tasks.workunit.client.1.smithi133.stdout:3/228: sync 2024-02-15T18:27:05.145 INFO:tasks.workunit.client.1.smithi133.stdout:5/161: sync 2024-02-15T18:27:05.145 INFO:tasks.workunit.client.1.smithi133.stdout:7/126: truncate d9/db/f27 840581 0 2024-02-15T18:27:05.145 INFO:tasks.workunit.client.1.smithi133.stdout:7/127: fsync d9/d1d/f2b 0 2024-02-15T18:27:05.147 INFO:tasks.workunit.client.1.smithi133.stdout:3/229: symlink d0/d15/d2b/d39/d3f/d3e/l42 0 2024-02-15T18:27:05.147 INFO:tasks.workunit.client.1.smithi133.stdout:7/128: creat d9/db/f2d x:0 0 0 2024-02-15T18:27:05.147 INFO:tasks.workunit.client.1.smithi133.stdout:7/129: fdatasync d9/db/f11 0 2024-02-15T18:27:05.149 INFO:tasks.workunit.client.1.smithi133.stdout:3/230: creat d0/d15/d2b/f43 x:0 0 0 2024-02-15T18:27:05.149 INFO:tasks.workunit.client.0.smithi084.stdout:2/498: creat d3/d5/d1a/d1e/d47/d76/fa2 x:0 0 0 2024-02-15T18:27:05.149 INFO:tasks.workunit.client.0.smithi084.stdout:2/499: chown d3/d19/d24/d89 13221 1 2024-02-15T18:27:05.150 INFO:tasks.workunit.client.0.smithi084.stdout:0/531: dwrite d0/f95 [0,4194304] 0 2024-02-15T18:27:05.150 INFO:tasks.workunit.client.1.smithi133.stdout:7/130: creat d9/d1d/f2e x:0 0 0 2024-02-15T18:27:05.150 INFO:tasks.workunit.client.0.smithi084.stdout:8/570: dread db/d1a/f5f [0,4194304] 0 2024-02-15T18:27:05.152 INFO:tasks.workunit.client.1.smithi133.stdout:3/231: unlink d0/f23 0 2024-02-15T18:27:05.152 INFO:tasks.workunit.client.1.smithi133.stdout:3/232: fdatasync d0/d15/f24 0 2024-02-15T18:27:05.153 INFO:tasks.workunit.client.0.smithi084.stdout:2/500: write d3/d5/f22 [42841,96598] 0 2024-02-15T18:27:05.153 INFO:tasks.workunit.client.0.smithi084.stdout:8/571: read db/dd/f5a [931797,42832] 0 2024-02-15T18:27:05.158 INFO:tasks.workunit.client.0.smithi084.stdout:5/588: rmdir d9/d23 39 2024-02-15T18:27:05.158 INFO:tasks.workunit.client.0.smithi084.stdout:5/589: truncate d9/d5f/da7/fa9 1033558 0 2024-02-15T18:27:05.158 INFO:tasks.workunit.client.0.smithi084.stdout:5/590: write d9/d35/d65/f34 [1451593,99292] 0 2024-02-15T18:27:05.166 INFO:tasks.workunit.client.0.smithi084.stdout:6/502: symlink d14/d22/d25/d2f/d31/d30/d93/l9d 0 2024-02-15T18:27:05.166 INFO:tasks.workunit.client.0.smithi084.stdout:6/503: chown d14/d22/f64 463245122 1 2024-02-15T18:27:05.168 INFO:tasks.workunit.client.0.smithi084.stdout:9/586: rename d4/d2b/d3c/d24/faa to d4/d6b/fb7 0 2024-02-15T18:27:05.168 INFO:tasks.workunit.client.0.smithi084.stdout:9/587: chown d4/d2b/d3c/d20/d43/d15/c5b 385918 1 2024-02-15T18:27:05.171 INFO:tasks.workunit.client.1.smithi133.stdout:0/179: dread d9/fa [0,4194304] 0 2024-02-15T18:27:05.171 INFO:tasks.workunit.client.1.smithi133.stdout:4/176: dwrite d2/f9 [4194304,4194304] 0 2024-02-15T18:27:05.172 INFO:tasks.workunit.client.0.smithi084.stdout:0/532: truncate d0/d2f/d3f/f17 39492 0 2024-02-15T18:27:05.172 INFO:tasks.workunit.client.0.smithi084.stdout:0/533: readlink d0/d1e/l75 0 2024-02-15T18:27:05.173 INFO:tasks.workunit.client.0.smithi084.stdout:2/501: creat d3/d19/d24/d3e/fa3 x:0 0 0 2024-02-15T18:27:05.174 INFO:tasks.workunit.client.0.smithi084.stdout:5/591: stat d9/d23/c5c 0 2024-02-15T18:27:05.177 INFO:tasks.workunit.client.0.smithi084.stdout:3/468: rename d8/d40/f67 to d8/d73/f9f 0 2024-02-15T18:27:05.177 INFO:tasks.workunit.client.0.smithi084.stdout:9/588: symlink d4/d2b/d3c/d20/lb8 0 2024-02-15T18:27:05.178 INFO:tasks.workunit.client.0.smithi084.stdout:0/534: mkdir d0/d2f/d3f/da4 0 2024-02-15T18:27:05.180 INFO:tasks.workunit.client.0.smithi084.stdout:5/592: creat d9/d5b/d7e/db5/fbd x:0 0 0 2024-02-15T18:27:05.180 INFO:tasks.workunit.client.0.smithi084.stdout:4/551: dwrite d2/d2b/d47/d31/d50/f7d [0,4194304] 0 2024-02-15T18:27:05.182 INFO:tasks.workunit.client.0.smithi084.stdout:8/572: dwrite db/d1a/f1d [0,4194304] 0 2024-02-15T18:27:05.182 INFO:tasks.workunit.client.0.smithi084.stdout:8/573: chown db/d3f/d59/d69 823 1 2024-02-15T18:27:05.182 INFO:tasks.workunit.client.0.smithi084.stdout:8/574: chown db/fb2 0 1 2024-02-15T18:27:05.182 INFO:tasks.workunit.client.1.smithi133.stdout:0/180: write d9/d1c/f1d [3342951,129810] 0 2024-02-15T18:27:05.182 INFO:tasks.workunit.client.1.smithi133.stdout:0/181: chown d9/f1e 134358380 1 2024-02-15T18:27:05.183 INFO:tasks.workunit.client.0.smithi084.stdout:7/472: rename df/d1d/d1a/d6a/d8b/d48/f34 to df/d1d/d44/d8d/f8f 0 2024-02-15T18:27:05.183 INFO:tasks.workunit.client.0.smithi084.stdout:7/473: chown df/d1d/d1a/d4d/d55/l5b 928483 1 2024-02-15T18:27:05.184 INFO:tasks.workunit.client.1.smithi133.stdout:0/182: symlink d9/l41 0 2024-02-15T18:27:05.185 INFO:tasks.workunit.client.0.smithi084.stdout:9/589: unlink d4/d3d/cb2 0 2024-02-15T18:27:05.190 INFO:tasks.workunit.client.0.smithi084.stdout:5/593: creat d9/d23/fbe x:0 0 0 2024-02-15T18:27:05.191 INFO:tasks.workunit.client.1.smithi133.stdout:0/183: dread d9/d10/d19/d1a/f25 [0,4194304] 0 2024-02-15T18:27:05.192 INFO:tasks.workunit.client.0.smithi084.stdout:4/552: rmdir d2/d4/d28/d3d/d5c/d65 39 2024-02-15T18:27:05.193 INFO:tasks.workunit.client.1.smithi133.stdout:0/184: link l1 d9/d10/d22/d2f/l42 0 2024-02-15T18:27:05.193 INFO:tasks.workunit.client.1.smithi133.stdout:0/185: chown d9/d1c/f3f 2359951 1 2024-02-15T18:27:05.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/186: write d9/fb [1008919,72008] 0 2024-02-15T18:27:05.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/187: stat d9/d1c/l26 0 2024-02-15T18:27:05.198 INFO:tasks.workunit.client.0.smithi084.stdout:6/504: rename d14/d22/d25/d41/f75 to d14/d22/d25/d2f/d31/d30/d45/d5c/f9e 0 2024-02-15T18:27:05.198 INFO:tasks.workunit.client.0.smithi084.stdout:9/590: dread d4/d2b/d3c/f49 [0,4194304] 0 2024-02-15T18:27:05.198 INFO:tasks.workunit.client.0.smithi084.stdout:9/591: chown d4/d2b/d3c 385 1 2024-02-15T18:27:05.198 INFO:tasks.workunit.client.0.smithi084.stdout:7/474: symlink df/d1d/d1a/d4d/d55/d88/l90 0 2024-02-15T18:27:05.198 INFO:tasks.workunit.client.0.smithi084.stdout:4/553: mkdir d2/d64/da5 0 2024-02-15T18:27:05.203 INFO:tasks.workunit.client.0.smithi084.stdout:5/594: dread d9/d5f/d68/f83 [0,4194304] 0 2024-02-15T18:27:05.204 INFO:tasks.workunit.client.0.smithi084.stdout:0/535: rename d0/d2f/d4b/f69 to d0/d4/d3a/fa5 0 2024-02-15T18:27:05.204 INFO:tasks.workunit.client.0.smithi084.stdout:9/592: symlink d4/d2b/d3c/lb9 0 2024-02-15T18:27:05.204 INFO:tasks.workunit.client.0.smithi084.stdout:4/554: creat d2/d2b/d47/d31/fa6 x:0 0 0 2024-02-15T18:27:05.204 INFO:tasks.workunit.client.0.smithi084.stdout:7/475: symlink df/d1d/d1a/d6a/d8b/d7f/l91 0 2024-02-15T18:27:05.205 INFO:tasks.workunit.client.0.smithi084.stdout:5/595: symlink d9/da/d3d/d44/d55/d70/d84/lbf 0 2024-02-15T18:27:05.214 INFO:tasks.workunit.client.0.smithi084.stdout:6/505: symlink d14/d22/l9f 0 2024-02-15T18:27:05.214 INFO:tasks.workunit.client.0.smithi084.stdout:6/506: truncate d14/d22/d25/d2f/f66 1726138 0 2024-02-15T18:27:05.215 INFO:tasks.workunit.client.0.smithi084.stdout:0/536: creat d0/d4/d66/fa6 x:0 0 0 2024-02-15T18:27:05.215 INFO:tasks.workunit.client.0.smithi084.stdout:4/555: creat d2/d64/d74/d8f/fa7 x:0 0 0 2024-02-15T18:27:05.216 INFO:tasks.workunit.client.0.smithi084.stdout:7/476: creat df/d1d/d1a/d4b/f92 x:0 0 0 2024-02-15T18:27:05.217 INFO:tasks.workunit.client.0.smithi084.stdout:0/537: mkdir d0/d2f/d3f/d4f/d59/da7 0 2024-02-15T18:27:05.217 INFO:tasks.workunit.client.0.smithi084.stdout:0/538: write d0/d4/d1b/d26/d43/d6d/d71/d73/f9b [187543,29717] 0 2024-02-15T18:27:05.217 INFO:tasks.workunit.client.0.smithi084.stdout:0/539: chown d0/d25/l31 43076022 1 2024-02-15T18:27:05.218 INFO:tasks.workunit.client.0.smithi084.stdout:4/556: symlink d2/d4/la8 0 2024-02-15T18:27:05.219 INFO:tasks.workunit.client.0.smithi084.stdout:4/557: truncate d2/f34 1952276 0 2024-02-15T18:27:05.219 INFO:tasks.workunit.client.0.smithi084.stdout:4/558: fdatasync d2/d4/f1c 0 2024-02-15T18:27:05.220 INFO:tasks.workunit.client.0.smithi084.stdout:6/507: dread d14/d22/d25/d2f/f66 [0,4194304] 0 2024-02-15T18:27:05.220 INFO:tasks.workunit.client.0.smithi084.stdout:7/477: dread df/d1d/d1a/d4d/f6f [0,4194304] 0 2024-02-15T18:27:05.221 INFO:tasks.workunit.client.0.smithi084.stdout:6/508: creat d14/d22/d25/d2f/d31/d3f/d4a/fa0 x:0 0 0 2024-02-15T18:27:05.221 INFO:tasks.workunit.client.0.smithi084.stdout:4/559: symlink d2/d2b/d47/d31/d50/d94/la9 0 2024-02-15T18:27:05.221 INFO:tasks.workunit.client.0.smithi084.stdout:4/560: write d2/d2b/d47/f7a [293084,69762] 0 2024-02-15T18:27:05.222 INFO:tasks.workunit.client.0.smithi084.stdout:7/478: link df/d1d/l19 df/d1d/d1a/l93 0 2024-02-15T18:27:05.224 INFO:tasks.workunit.client.0.smithi084.stdout:4/561: unlink d2/d4/d25/l8d 0 2024-02-15T18:27:05.225 INFO:tasks.workunit.client.0.smithi084.stdout:4/562: read d2/d2b/f60 [2754386,106001] 0 2024-02-15T18:27:05.226 INFO:tasks.workunit.client.0.smithi084.stdout:7/479: creat df/d1d/d1a/d6a/d8b/d7f/f94 x:0 0 0 2024-02-15T18:27:05.226 INFO:tasks.workunit.client.0.smithi084.stdout:7/480: chown df/d1d/d1a/d4b/l77 7795 1 2024-02-15T18:27:05.227 INFO:tasks.workunit.client.1.smithi133.stdout:5/162: dwrite ff [0,4194304] 0 2024-02-15T18:27:05.227 INFO:tasks.workunit.client.1.smithi133.stdout:4/177: dwrite d2/d5/d2b/f1d [0,4194304] 0 2024-02-15T18:27:05.228 INFO:tasks.workunit.client.0.smithi084.stdout:6/509: write d14/d22/d25/d2f/d31/d30/d45/d54/f88 [862346,112171] 0 2024-02-15T18:27:05.228 INFO:tasks.workunit.client.0.smithi084.stdout:6/510: dread - d14/d22/d25/f84 zero size 2024-02-15T18:27:05.228 INFO:tasks.workunit.client.0.smithi084.stdout:7/481: symlink df/d1d/d1a/d6a/l95 0 2024-02-15T18:27:05.230 INFO:tasks.workunit.client.0.smithi084.stdout:7/482: rmdir df/d1d/d1a/d4d/d55/d88 39 2024-02-15T18:27:05.231 INFO:tasks.workunit.client.1.smithi133.stdout:4/178: mknod d2/d5/d25/c3f 0 2024-02-15T18:27:05.233 INFO:tasks.workunit.client.0.smithi084.stdout:7/483: mkdir df/d1d/d44/d96 0 2024-02-15T18:27:05.233 INFO:tasks.workunit.client.1.smithi133.stdout:4/179: mknod d2/d5/d2b/d21/d36/c40 0 2024-02-15T18:27:05.233 INFO:tasks.workunit.client.1.smithi133.stdout:4/180: fdatasync d2/d5/d2b/f1a 0 2024-02-15T18:27:05.241 INFO:tasks.workunit.client.1.smithi133.stdout:7/131: dwrite d9/db/f27 [0,4194304] 0 2024-02-15T18:27:05.243 INFO:tasks.workunit.client.1.smithi133.stdout:3/233: dwrite d0/d15/d2b/d39/d3f/f22 [0,4194304] 0 2024-02-15T18:27:05.244 INFO:tasks.workunit.client.1.smithi133.stdout:7/132: truncate d9/db/f11 6932017 0 2024-02-15T18:27:05.244 INFO:tasks.workunit.client.1.smithi133.stdout:7/133: write d9/f2a [865031,39160] 0 2024-02-15T18:27:05.246 INFO:tasks.workunit.client.1.smithi133.stdout:7/134: write d9/db/f27 [3191494,117053] 0 2024-02-15T18:27:05.248 INFO:tasks.workunit.client.1.smithi133.stdout:5/163: dread d17/d26/f21 [0,4194304] 0 2024-02-15T18:27:05.248 INFO:tasks.workunit.client.1.smithi133.stdout:7/135: write f6 [1483097,50937] 0 2024-02-15T18:27:05.249 INFO:tasks.workunit.client.1.smithi133.stdout:3/234: rename d0/f8 to d0/d15/d2b/f44 0 2024-02-15T18:27:05.250 INFO:tasks.workunit.client.1.smithi133.stdout:7/136: mknod d9/d1d/c2f 0 2024-02-15T18:27:05.250 INFO:tasks.workunit.client.1.smithi133.stdout:7/137: write d9/d1d/f2e [909547,88628] 0 2024-02-15T18:27:05.250 INFO:tasks.workunit.client.1.smithi133.stdout:7/138: write d9/db/d16/f29 [211928,94896] 0 2024-02-15T18:27:05.251 INFO:tasks.workunit.client.1.smithi133.stdout:7/139: link d9/db/f2d d9/db/dc/f30 0 2024-02-15T18:27:05.263 INFO:tasks.workunit.client.0.smithi084.stdout:3/469: dwrite d8/d40/d58/d80/f5f [0,4194304] 0 2024-02-15T18:27:05.266 INFO:tasks.workunit.client.0.smithi084.stdout:3/470: unlink d8/d1f/d25/l30 0 2024-02-15T18:27:05.271 INFO:tasks.workunit.client.0.smithi084.stdout:2/502: dwrite d3/d19/d24/d3e/d5c/f8f [0,4194304] 0 2024-02-15T18:27:05.271 INFO:tasks.workunit.client.0.smithi084.stdout:8/575: dwrite db/d1a/da5/fba [0,4194304] 0 2024-02-15T18:27:05.271 INFO:tasks.workunit.client.0.smithi084.stdout:8/576: fsync db/d3f/d59/fb3 0 2024-02-15T18:27:05.271 INFO:tasks.workunit.client.0.smithi084.stdout:5/596: dwrite d9/f15 [0,4194304] 0 2024-02-15T18:27:05.272 INFO:tasks.workunit.client.0.smithi084.stdout:9/593: dwrite d4/d3d/f7e [0,4194304] 0 2024-02-15T18:27:05.272 INFO:tasks.workunit.client.0.smithi084.stdout:9/594: truncate d4/d2b/d3c/d20/fa7 1005157 0 2024-02-15T18:27:05.272 INFO:tasks.workunit.client.1.smithi133.stdout:0/188: dwrite f5 [0,4194304] 0 2024-02-15T18:27:05.273 INFO:tasks.workunit.client.0.smithi084.stdout:5/597: read d9/d35/d65/f56 [4872118,128376] 0 2024-02-15T18:27:05.273 INFO:tasks.workunit.client.0.smithi084.stdout:5/598: dread - d9/d35/f6e zero size 2024-02-15T18:27:05.273 INFO:tasks.workunit.client.0.smithi084.stdout:5/599: chown d9/d5b/d79/l95 303740374 1 2024-02-15T18:27:05.273 INFO:tasks.workunit.client.0.smithi084.stdout:5/600: fsync d9/d5f/d68/d9a/f60 0 2024-02-15T18:27:05.281 INFO:tasks.workunit.client.0.smithi084.stdout:9/595: dread d4/d2b/d3c/d20/d43/d15/f44 [0,4194304] 0 2024-02-15T18:27:05.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/577: creat db/d1a/d2b/d7b/fbf x:0 0 0 2024-02-15T18:27:05.287 INFO:tasks.workunit.client.0.smithi084.stdout:0/540: dwrite d0/d4/f54 [0,4194304] 0 2024-02-15T18:27:05.287 INFO:tasks.workunit.client.0.smithi084.stdout:4/563: dwrite d2/f21 [0,4194304] 0 2024-02-15T18:27:05.287 INFO:tasks.workunit.client.0.smithi084.stdout:4/564: dread - d2/f39 zero size 2024-02-15T18:27:05.287 INFO:tasks.workunit.client.0.smithi084.stdout:7/484: dwrite f5 [0,4194304] 0 2024-02-15T18:27:05.290 INFO:tasks.workunit.client.1.smithi133.stdout:3/235: dwrite d0/d15/f24 [0,4194304] 0 2024-02-15T18:27:05.290 INFO:tasks.workunit.client.1.smithi133.stdout:5/164: dwrite f15 [0,4194304] 0 2024-02-15T18:27:05.290 INFO:tasks.workunit.client.1.smithi133.stdout:5/165: readlink le 0 2024-02-15T18:27:05.290 INFO:tasks.workunit.client.0.smithi084.stdout:3/471: dwrite d8/d22/f54 [0,4194304] 0 2024-02-15T18:27:05.290 INFO:tasks.workunit.client.0.smithi084.stdout:3/472: write d8/f15 [9042526,116300] 0 2024-02-15T18:27:05.292 INFO:tasks.workunit.client.0.smithi084.stdout:5/601: link d9/d35/d65/f34 d9/da/d3d/d44/d55/fc0 0 2024-02-15T18:27:05.292 INFO:tasks.workunit.client.1.smithi133.stdout:3/236: dread d0/f3a [0,4194304] 0 2024-02-15T18:27:05.295 INFO:tasks.workunit.client.0.smithi084.stdout:2/503: link d3/d19/d24/c93 d3/d19/d24/ca4 0 2024-02-15T18:27:05.297 INFO:tasks.workunit.client.1.smithi133.stdout:3/237: write d0/d15/d2b/d39/d3f/f1a [871164,105591] 0 2024-02-15T18:27:05.297 INFO:tasks.workunit.client.1.smithi133.stdout:3/238: write d0/d15/d37/f40 [988337,3041] 0 2024-02-15T18:27:05.297 INFO:tasks.workunit.client.1.smithi133.stdout:3/239: write d0/d15/f16 [5096759,127957] 0 2024-02-15T18:27:05.297 INFO:tasks.workunit.client.1.smithi133.stdout:3/240: dread - d0/d15/d2b/f43 zero size 2024-02-15T18:27:05.298 INFO:tasks.workunit.client.1.smithi133.stdout:3/241: write d0/d15/d37/f40 [655454,26357] 0 2024-02-15T18:27:05.298 INFO:tasks.workunit.client.1.smithi133.stdout:3/242: write d0/d15/d2f/f30 [176078,115191] 0 2024-02-15T18:27:05.300 INFO:tasks.workunit.client.1.smithi133.stdout:5/166: truncate d17/d2a/f2d 6718890 0 2024-02-15T18:27:05.304 INFO:tasks.workunit.client.1.smithi133.stdout:3/243: creat d0/d15/d2b/f45 x:0 0 0 2024-02-15T18:27:05.305 INFO:tasks.workunit.client.1.smithi133.stdout:3/244: dread d0/d15/d2b/f44 [4194304,4194304] 0 2024-02-15T18:27:05.313 INFO:tasks.workunit.client.0.smithi084.stdout:1/480: sync 2024-02-15T18:27:05.317 INFO:tasks.workunit.client.0.smithi084.stdout:9/596: creat d4/d36/fba x:0 0 0 2024-02-15T18:27:05.320 INFO:tasks.workunit.client.0.smithi084.stdout:1/481: dread d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f84 [0,4194304] 0 2024-02-15T18:27:05.320 INFO:tasks.workunit.client.1.smithi133.stdout:3/245: dread d0/d15/f24 [0,4194304] 0 2024-02-15T18:27:05.321 INFO:tasks.workunit.client.0.smithi084.stdout:7/485: getdents df 0 2024-02-15T18:27:05.321 INFO:tasks.workunit.client.0.smithi084.stdout:7/486: write df/d1d/d1a/d4b/f7e [1045174,72559] 0 2024-02-15T18:27:05.322 INFO:tasks.workunit.client.1.smithi133.stdout:7/140: dwrite d9/db/d16/f29 [0,4194304] 0 2024-02-15T18:27:05.322 INFO:tasks.workunit.client.1.smithi133.stdout:7/141: stat d9/d1d/c2f 0 2024-02-15T18:27:05.322 INFO:tasks.workunit.client.1.smithi133.stdout:7/142: chown d9/db/dc/cd 95057 1 2024-02-15T18:27:05.322 INFO:tasks.workunit.client.1.smithi133.stdout:3/246: symlink d0/d15/l46 0 2024-02-15T18:27:05.324 INFO:tasks.workunit.client.1.smithi133.stdout:7/143: rmdir d9/d1d 39 2024-02-15T18:27:05.324 INFO:tasks.workunit.client.1.smithi133.stdout:7/144: truncate f7 5687341 0 2024-02-15T18:27:05.324 INFO:tasks.workunit.client.0.smithi084.stdout:3/473: symlink d8/d40/d58/la0 0 2024-02-15T18:27:05.325 INFO:tasks.workunit.client.1.smithi133.stdout:3/247: truncate d0/d15/f3b 1751313 0 2024-02-15T18:27:05.327 INFO:tasks.workunit.client.0.smithi084.stdout:9/597: creat d4/d2b/daf/fbb x:0 0 0 2024-02-15T18:27:05.328 INFO:tasks.workunit.client.1.smithi133.stdout:7/145: mkdir d9/d1d/d31 0 2024-02-15T18:27:05.328 INFO:tasks.workunit.client.1.smithi133.stdout:3/248: mknod d0/d15/d2b/d39/d3f/c47 0 2024-02-15T18:27:05.328 INFO:tasks.workunit.client.1.smithi133.stdout:3/249: stat d0/d15/c2a 0 2024-02-15T18:27:05.329 INFO:tasks.workunit.client.1.smithi133.stdout:2/259: sync 2024-02-15T18:27:05.329 INFO:tasks.workunit.client.1.smithi133.stdout:2/260: chown d7/db/d35/f3d 0 1 2024-02-15T18:27:05.329 INFO:tasks.workunit.client.1.smithi133.stdout:8/211: sync 2024-02-15T18:27:05.331 INFO:tasks.workunit.client.0.smithi084.stdout:3/474: symlink d8/d40/d43/d71/la1 0 2024-02-15T18:27:05.331 INFO:tasks.workunit.client.0.smithi084.stdout:3/475: truncate d8/f1c 2048312 0 2024-02-15T18:27:05.332 INFO:tasks.workunit.client.1.smithi133.stdout:7/146: link d9/d1d/f2b d9/d1d/f32 0 2024-02-15T18:27:05.332 INFO:tasks.workunit.client.1.smithi133.stdout:7/147: readlink l4 0 2024-02-15T18:27:05.332 INFO:tasks.workunit.client.1.smithi133.stdout:7/148: fdatasync d9/db/f2d 0 2024-02-15T18:27:05.332 INFO:tasks.workunit.client.0.smithi084.stdout:9/598: symlink d4/d2b/d3c/d20/d43/lbc 0 2024-02-15T18:27:05.333 INFO:tasks.workunit.client.1.smithi133.stdout:3/250: unlink d0/d15/l1c 0 2024-02-15T18:27:05.333 INFO:tasks.workunit.client.1.smithi133.stdout:8/212: mknod d3/d1c/d2f/c4b 0 2024-02-15T18:27:05.334 INFO:tasks.workunit.client.1.smithi133.stdout:3/251: creat d0/d15/d37/f48 x:0 0 0 2024-02-15T18:27:05.335 INFO:tasks.workunit.client.1.smithi133.stdout:9/177: sync 2024-02-15T18:27:05.335 INFO:tasks.workunit.client.1.smithi133.stdout:1/362: sync 2024-02-15T18:27:05.335 INFO:tasks.workunit.client.1.smithi133.stdout:6/278: sync 2024-02-15T18:27:05.335 INFO:tasks.workunit.client.1.smithi133.stdout:6/279: stat d0/db/f3f 0 2024-02-15T18:27:05.336 INFO:tasks.workunit.client.1.smithi133.stdout:8/213: unlink d3/f1a 0 2024-02-15T18:27:05.337 INFO:tasks.workunit.client.1.smithi133.stdout:3/252: rmdir d0/d15/d2f 39 2024-02-15T18:27:05.337 INFO:tasks.workunit.client.1.smithi133.stdout:3/253: readlink d0/d15/d2f/l32 0 2024-02-15T18:27:05.340 INFO:tasks.workunit.client.1.smithi133.stdout:6/280: symlink d0/db/d29/l5c 0 2024-02-15T18:27:05.340 INFO:tasks.workunit.client.1.smithi133.stdout:8/214: symlink d3/d1f/l4c 0 2024-02-15T18:27:05.341 INFO:tasks.workunit.client.1.smithi133.stdout:1/363: mkdir d6/d1e/d3a/d79/d8e 0 2024-02-15T18:27:05.341 INFO:tasks.workunit.client.1.smithi133.stdout:3/254: rename d0/d15/d2b/d39/d3f/c47 to d0/d15/d37/c49 0 2024-02-15T18:27:05.342 INFO:tasks.workunit.client.1.smithi133.stdout:6/281: truncate d0/ff 1567078 0 2024-02-15T18:27:05.343 INFO:tasks.workunit.client.1.smithi133.stdout:8/215: creat d3/d7/f4d x:0 0 0 2024-02-15T18:27:05.343 INFO:tasks.workunit.client.1.smithi133.stdout:8/216: readlink d3/d1c/d2f/l33 0 2024-02-15T18:27:05.344 INFO:tasks.workunit.client.0.smithi084.stdout:0/541: dwrite d0/d39/d45/f5e [0,4194304] 0 2024-02-15T18:27:05.344 INFO:tasks.workunit.client.1.smithi133.stdout:6/282: rename d0/db/d1c to d0/db/d29/d34/d5d 0 2024-02-15T18:27:05.344 INFO:tasks.workunit.client.1.smithi133.stdout:2/261: dread d7/d18/f40 [0,4194304] 0 2024-02-15T18:27:05.345 INFO:tasks.workunit.client.1.smithi133.stdout:6/283: mknod d0/d3b/d53/c5e 0 2024-02-15T18:27:05.345 INFO:tasks.workunit.client.0.smithi084.stdout:0/542: read d0/d4/d1b/f55 [89566,46713] 0 2024-02-15T18:27:05.346 INFO:tasks.workunit.client.0.smithi084.stdout:9/599: write d4/f19 [1158634,73358] 0 2024-02-15T18:27:05.346 INFO:tasks.workunit.client.0.smithi084.stdout:9/600: write d4/d2b/f90 [46564,84352] 0 2024-02-15T18:27:05.347 INFO:tasks.workunit.client.1.smithi133.stdout:2/262: creat d7/db/d35/d4a/f55 x:0 0 0 2024-02-15T18:27:05.348 INFO:tasks.workunit.client.1.smithi133.stdout:7/149: dread f7 [0,4194304] 0 2024-02-15T18:27:05.349 INFO:tasks.workunit.client.1.smithi133.stdout:6/284: unlink d0/fd 0 2024-02-15T18:27:05.351 INFO:tasks.workunit.client.0.smithi084.stdout:0/543: mkdir d0/d4/da8 0 2024-02-15T18:27:05.351 INFO:tasks.workunit.client.0.smithi084.stdout:0/544: truncate d0/d4/d1b/f91 313467 0 2024-02-15T18:27:05.351 INFO:tasks.workunit.client.0.smithi084.stdout:9/601: creat d4/d2b/fbd x:0 0 0 2024-02-15T18:27:05.353 INFO:tasks.workunit.client.0.smithi084.stdout:0/545: symlink d0/la9 0 2024-02-15T18:27:05.354 INFO:tasks.workunit.client.1.smithi133.stdout:6/285: symlink d0/db/d29/d34/d48/l5f 0 2024-02-15T18:27:05.354 INFO:tasks.workunit.client.0.smithi084.stdout:9/602: creat d4/d2b/d3c/d20/d43/d15/d4b/fbe x:0 0 0 2024-02-15T18:27:05.354 INFO:tasks.workunit.client.0.smithi084.stdout:9/603: chown d4/d81 273582012 1 2024-02-15T18:27:05.355 INFO:tasks.workunit.client.0.smithi084.stdout:0/546: creat d0/d2f/faa x:0 0 0 2024-02-15T18:27:05.355 INFO:tasks.workunit.client.0.smithi084.stdout:0/547: readlink d0/d2f/d3f/l89 0 2024-02-15T18:27:05.356 INFO:tasks.workunit.client.0.smithi084.stdout:0/548: truncate d0/d25/f2a 1904156 0 2024-02-15T18:27:05.364 INFO:tasks.workunit.client.1.smithi133.stdout:2/263: dread d7/d2c/f49 [0,4194304] 0 2024-02-15T18:27:05.366 INFO:tasks.workunit.client.1.smithi133.stdout:2/264: stat d7/d18/l1a 0 2024-02-15T18:27:05.368 INFO:tasks.workunit.client.1.smithi133.stdout:2/265: creat d7/db/d35/d4a/f56 x:0 0 0 2024-02-15T18:27:05.375 INFO:tasks.workunit.client.0.smithi084.stdout:5/602: dwrite d9/d23/f57 [0,4194304] 0 2024-02-15T18:27:05.376 INFO:tasks.workunit.client.1.smithi133.stdout:2/266: dread d7/db/f21 [0,4194304] 0 2024-02-15T18:27:05.377 INFO:tasks.workunit.client.0.smithi084.stdout:8/578: dwrite db/dd/d4d/f5b [0,4194304] 0 2024-02-15T18:27:05.377 INFO:tasks.workunit.client.0.smithi084.stdout:4/565: dwrite d2/d4/d28/d3d/f92 [0,4194304] 0 2024-02-15T18:27:05.377 INFO:tasks.workunit.client.1.smithi133.stdout:2/267: write d7/d2c/f49 [2334899,67449] 0 2024-02-15T18:27:05.378 INFO:tasks.workunit.client.1.smithi133.stdout:2/268: chown d7/l12 103 1 2024-02-15T18:27:05.383 INFO:tasks.workunit.client.0.smithi084.stdout:4/566: dread d2/d2b/d47/d31/d50/d94/f97 [4194304,4194304] 0 2024-02-15T18:27:05.386 INFO:tasks.workunit.client.0.smithi084.stdout:4/567: creat d2/d2b/d47/d31/d50/d94/faa x:0 0 0 2024-02-15T18:27:05.386 INFO:tasks.workunit.client.0.smithi084.stdout:4/568: truncate d2/f39 745122 0 2024-02-15T18:27:05.387 INFO:tasks.workunit.client.0.smithi084.stdout:4/569: chown d2/d2b/d47/d31/d61/fa0 45 1 2024-02-15T18:27:05.388 INFO:tasks.workunit.client.0.smithi084.stdout:4/570: mknod d2/d4/d28/d3d/da4/cab 0 2024-02-15T18:27:05.404 INFO:tasks.workunit.client.0.smithi084.stdout:7/487: dwrite df/d1d/d1a/d6a/d8e/f71 [0,4194304] 0 2024-02-15T18:27:05.406 INFO:tasks.workunit.client.0.smithi084.stdout:7/488: symlink df/d1d/d44/d8d/l97 0 2024-02-15T18:27:05.407 INFO:tasks.workunit.client.0.smithi084.stdout:2/504: dwrite d3/d19/f33 [0,4194304] 0 2024-02-15T18:27:05.409 INFO:tasks.workunit.client.0.smithi084.stdout:7/489: mkdir df/d1d/d1a/d4d/d55/d88/d98 0 2024-02-15T18:27:05.409 INFO:tasks.workunit.client.0.smithi084.stdout:4/571: dread d2/d4/fd [0,4194304] 0 2024-02-15T18:27:05.410 INFO:tasks.workunit.client.0.smithi084.stdout:3/476: dwrite d8/d1f/d25/f8e [0,4194304] 0 2024-02-15T18:27:05.410 INFO:tasks.workunit.client.0.smithi084.stdout:3/477: fsync d8/d40/d58/d80/f7c 0 2024-02-15T18:27:05.410 INFO:tasks.workunit.client.0.smithi084.stdout:2/505: truncate d3/d5/d1a/d1e/d47/f56 3005132 0 2024-02-15T18:27:05.411 INFO:tasks.workunit.client.0.smithi084.stdout:7/490: creat df/d1d/d1a/d4d/d55/f99 x:0 0 0 2024-02-15T18:27:05.411 INFO:tasks.workunit.client.1.smithi133.stdout:3/255: dread d0/d15/d2f/f30 [0,4194304] 0 2024-02-15T18:27:05.411 INFO:tasks.workunit.client.1.smithi133.stdout:8/217: dwrite d3/d1f/d3f/f41 [0,4194304] 0 2024-02-15T18:27:05.412 INFO:tasks.workunit.client.1.smithi133.stdout:9/178: dwrite d0/d8/d9/d12/f1b [0,4194304] 0 2024-02-15T18:27:05.419 INFO:tasks.workunit.client.0.smithi084.stdout:3/478: rename d8/d40/d58/d80/f5f to d8/d40/fa2 0 2024-02-15T18:27:05.419 INFO:tasks.workunit.client.0.smithi084.stdout:2/506: creat d3/d19/d24/d3e/fa5 x:0 0 0 2024-02-15T18:27:05.420 INFO:tasks.workunit.client.1.smithi133.stdout:2/269: dread d7/d2c/d31/f4b [0,4194304] 0 2024-02-15T18:27:05.420 INFO:tasks.workunit.client.0.smithi084.stdout:4/572: write d2/d4/d25/f51 [1756050,11176] 0 2024-02-15T18:27:05.420 INFO:tasks.workunit.client.0.smithi084.stdout:4/573: fsync d2/f5e 0 2024-02-15T18:27:05.420 INFO:tasks.workunit.client.0.smithi084.stdout:4/574: fsync d2/d2b/d47/f3b 0 2024-02-15T18:27:05.422 INFO:tasks.workunit.client.1.smithi133.stdout:6/286: dwrite d0/f14 [0,4194304] 0 2024-02-15T18:27:05.423 INFO:tasks.workunit.client.1.smithi133.stdout:3/256: write d0/fc [1489668,38487] 0 2024-02-15T18:27:05.423 INFO:tasks.workunit.client.1.smithi133.stdout:3/257: chown d0/d15/d2b/d39/d3f/c12 4 1 2024-02-15T18:27:05.424 INFO:tasks.workunit.client.1.smithi133.stdout:2/270: write d7/d2c/d31/f4b [2506811,93152] 0 2024-02-15T18:27:05.424 INFO:tasks.workunit.client.1.smithi133.stdout:1/364: dwrite d6/d1e/d3a/d75/f7d [0,4194304] 0 2024-02-15T18:27:05.425 INFO:tasks.workunit.client.0.smithi084.stdout:4/575: unlink d2/f35 0 2024-02-15T18:27:05.426 INFO:tasks.workunit.client.1.smithi133.stdout:8/218: link d3/f5 d3/d1f/d3f/f4e 0 2024-02-15T18:27:05.429 INFO:tasks.workunit.client.1.smithi133.stdout:1/365: read d6/d1e/d41/f46 [703008,76075] 0 2024-02-15T18:27:05.429 INFO:tasks.workunit.client.1.smithi133.stdout:1/366: fsync d6/d1e/d3a/d82/d85/d67/f8b 0 2024-02-15T18:27:05.430 INFO:tasks.workunit.client.1.smithi133.stdout:3/258: mkdir d0/d15/d37/d4a 0 2024-02-15T18:27:05.430 INFO:tasks.workunit.client.0.smithi084.stdout:9/604: dwrite d4/d2b/d3c/d20/f5a [4194304,4194304] 0 2024-02-15T18:27:05.430 INFO:tasks.workunit.client.0.smithi084.stdout:9/605: rename d4/d2b to d4/d2b/d3c/d20/d75/dbf 22 2024-02-15T18:27:05.430 INFO:tasks.workunit.client.0.smithi084.stdout:8/579: dwrite db/d1a/d2b/f31 [4194304,4194304] 0 2024-02-15T18:27:05.431 INFO:tasks.workunit.client.0.smithi084.stdout:5/603: dwrite d9/f15 [0,4194304] 0 2024-02-15T18:27:05.431 INFO:tasks.workunit.client.1.smithi133.stdout:1/367: read d6/f2e [117741,118990] 0 2024-02-15T18:27:05.431 INFO:tasks.workunit.client.1.smithi133.stdout:5/167: dwrite d17/d2a/f2d [0,4194304] 0 2024-02-15T18:27:05.432 INFO:tasks.workunit.client.1.smithi133.stdout:8/219: mkdir d3/d1f/d4f 0 2024-02-15T18:27:05.432 INFO:tasks.workunit.client.1.smithi133.stdout:3/259: creat d0/d15/d37/f4b x:0 0 0 2024-02-15T18:27:05.434 INFO:tasks.workunit.client.1.smithi133.stdout:1/368: symlink d6/d2a/l8f 0 2024-02-15T18:27:05.436 INFO:tasks.workunit.client.1.smithi133.stdout:3/260: creat d0/d15/d37/d4a/f4c x:0 0 0 2024-02-15T18:27:05.437 INFO:tasks.workunit.client.0.smithi084.stdout:9/606: link d4/d2b/d3c/d20/d75/d87/lac d4/d3d/lc0 0 2024-02-15T18:27:05.437 INFO:tasks.workunit.client.1.smithi133.stdout:6/287: dread d0/f9 [0,4194304] 0 2024-02-15T18:27:05.438 INFO:tasks.workunit.client.1.smithi133.stdout:1/369: creat d6/f90 x:0 0 0 2024-02-15T18:27:05.438 INFO:tasks.workunit.client.1.smithi133.stdout:1/370: chown d6/d1e/c6c 133 1 2024-02-15T18:27:05.438 INFO:tasks.workunit.client.1.smithi133.stdout:3/261: creat d0/d15/d2b/f4d x:0 0 0 2024-02-15T18:27:05.439 INFO:tasks.workunit.client.1.smithi133.stdout:6/288: dread d0/f9 [0,4194304] 0 2024-02-15T18:27:05.439 INFO:tasks.workunit.client.1.smithi133.stdout:6/289: readlink d0/db/l20 0 2024-02-15T18:27:05.439 INFO:tasks.workunit.client.1.smithi133.stdout:6/290: readlink d0/db/d29/d34/d5d/d40/l46 0 2024-02-15T18:27:05.439 INFO:tasks.workunit.client.1.smithi133.stdout:1/371: mknod d6/d1e/d3a/d82/d85/c91 0 2024-02-15T18:27:05.439 INFO:tasks.workunit.client.1.smithi133.stdout:1/372: dread - d6/f24 zero size 2024-02-15T18:27:05.441 INFO:tasks.workunit.client.1.smithi133.stdout:6/291: creat d0/d3b/d41/f60 x:0 0 0 2024-02-15T18:27:05.441 INFO:tasks.workunit.client.0.smithi084.stdout:8/580: rmdir db/d6a/d76 39 2024-02-15T18:27:05.442 INFO:tasks.workunit.client.0.smithi084.stdout:7/491: dwrite df/f63 [0,4194304] 0 2024-02-15T18:27:05.444 INFO:tasks.workunit.client.1.smithi133.stdout:1/373: rmdir d6/d2a/d59 39 2024-02-15T18:27:05.444 INFO:tasks.workunit.client.1.smithi133.stdout:1/374: write d6/d1e/f21 [4305529,109961] 0 2024-02-15T18:27:05.444 INFO:tasks.workunit.client.0.smithi084.stdout:4/576: dread d2/d64/d74/f78 [0,4194304] 0 2024-02-15T18:27:05.444 INFO:tasks.workunit.client.0.smithi084.stdout:4/577: dread - d2/d2b/f3e zero size 2024-02-15T18:27:05.444 INFO:tasks.workunit.client.0.smithi084.stdout:4/578: write d2/d2b/f3e [1016547,29710] 0 2024-02-15T18:27:05.445 INFO:tasks.workunit.client.1.smithi133.stdout:3/262: dread d0/d15/f24 [0,4194304] 0 2024-02-15T18:27:05.446 INFO:tasks.workunit.client.1.smithi133.stdout:1/375: link d6/d2a/l30 d6/d1e/d41/l92 0 2024-02-15T18:27:05.447 INFO:tasks.workunit.client.0.smithi084.stdout:8/581: write db/d3f/d59/f48 [3907798,38581] 0 2024-02-15T18:27:05.447 INFO:tasks.workunit.client.1.smithi133.stdout:3/263: creat d0/d15/d37/d4a/f4e x:0 0 0 2024-02-15T18:27:05.448 INFO:tasks.workunit.client.1.smithi133.stdout:1/376: write d6/d1e/d3a/d82/d85/f33 [752189,13399] 0 2024-02-15T18:27:05.449 INFO:tasks.workunit.client.0.smithi084.stdout:7/492: write df/d1d/d44/d8d/f8f [1855686,11321] 0 2024-02-15T18:27:05.449 INFO:tasks.workunit.client.0.smithi084.stdout:7/493: stat df/d1d/d1a/d6a/d8b/d48/l4a 0 2024-02-15T18:27:05.449 INFO:tasks.workunit.client.0.smithi084.stdout:7/494: chown df/d1d/d1a/d6a/d8b/d7f 34 1 2024-02-15T18:27:05.450 INFO:tasks.workunit.client.0.smithi084.stdout:5/604: creat d9/d5b/d79/fc1 x:0 0 0 2024-02-15T18:27:05.450 INFO:tasks.workunit.client.1.smithi133.stdout:3/264: rename d0/d15/l17 to d0/d15/d37/l4f 0 2024-02-15T18:27:05.451 INFO:tasks.workunit.client.1.smithi133.stdout:3/265: readlink d0/d15/d2b/l33 0 2024-02-15T18:27:05.451 INFO:tasks.workunit.client.0.smithi084.stdout:9/607: mkdir d4/d3d/da5/dc1 0 2024-02-15T18:27:05.451 INFO:tasks.workunit.client.0.smithi084.stdout:9/608: truncate d4/d2b/d3c/d20/d43/f1c 4052692 0 2024-02-15T18:27:05.452 INFO:tasks.workunit.client.0.smithi084.stdout:6/511: sync 2024-02-15T18:27:05.452 INFO:tasks.workunit.client.1.smithi133.stdout:3/266: creat d0/f50 x:0 0 0 2024-02-15T18:27:05.452 INFO:tasks.workunit.client.1.smithi133.stdout:3/267: dread - d0/d15/d2b/f4d zero size 2024-02-15T18:27:05.452 INFO:tasks.workunit.client.1.smithi133.stdout:3/268: dread - d0/d15/d2b/f41 zero size 2024-02-15T18:27:05.454 INFO:tasks.workunit.client.1.smithi133.stdout:3/269: creat d0/d15/d2b/d39/f51 x:0 0 0 2024-02-15T18:27:05.454 INFO:tasks.workunit.client.1.smithi133.stdout:3/270: chown d0/d15/d2f 3372458 1 2024-02-15T18:27:05.454 INFO:tasks.workunit.client.1.smithi133.stdout:3/271: truncate d0/d15/d2b/f45 330133 0 2024-02-15T18:27:05.454 INFO:tasks.workunit.client.0.smithi084.stdout:4/579: rename d2/d4/d28/d3d/d5c/d5d/f63 to d2/d2b/fac 0 2024-02-15T18:27:05.455 INFO:tasks.workunit.client.1.smithi133.stdout:3/272: mknod d0/d15/d2f/c52 0 2024-02-15T18:27:05.457 INFO:tasks.workunit.client.0.smithi084.stdout:9/609: mkdir d4/dc2 0 2024-02-15T18:27:05.457 INFO:tasks.workunit.client.0.smithi084.stdout:7/495: creat df/d1d/d1a/d6a/d8b/d7f/f9a x:0 0 0 2024-02-15T18:27:05.457 INFO:tasks.workunit.client.0.smithi084.stdout:7/496: chown df/f32 17540 1 2024-02-15T18:27:05.459 INFO:tasks.workunit.client.0.smithi084.stdout:6/512: unlink d14/d22/d25/d2f/d31/d30/d4f/f61 0 2024-02-15T18:27:05.459 INFO:tasks.workunit.client.0.smithi084.stdout:8/582: dread db/dd/d4d/d7e/f85 [0,4194304] 0 2024-02-15T18:27:05.462 INFO:tasks.workunit.client.0.smithi084.stdout:4/580: readlink d2/d2b/d47/d31/d62/l70 0 2024-02-15T18:27:05.462 INFO:tasks.workunit.client.0.smithi084.stdout:9/610: unlink d4/d36/d6f/fb1 0 2024-02-15T18:27:05.462 INFO:tasks.workunit.client.0.smithi084.stdout:9/611: chown d4/d2b/d3c/d20/f62 7517760 1 2024-02-15T18:27:05.462 INFO:tasks.workunit.client.0.smithi084.stdout:0/549: dwrite d0/d4/d1b/d26/d43/f76 [0,4194304] 0 2024-02-15T18:27:05.463 INFO:tasks.workunit.client.0.smithi084.stdout:0/550: chown d0/d2f/d3f/d4c/d9a/fa3 293611 1 2024-02-15T18:27:05.465 INFO:tasks.workunit.client.0.smithi084.stdout:4/581: mknod d2/d64/da5/cad 0 2024-02-15T18:27:05.467 INFO:tasks.workunit.client.0.smithi084.stdout:8/583: truncate db/dd/d1f/f23 5135763 0 2024-02-15T18:27:05.467 INFO:tasks.workunit.client.0.smithi084.stdout:9/612: mkdir d4/da3/dc3 0 2024-02-15T18:27:05.470 INFO:tasks.workunit.client.1.smithi133.stdout:8/220: dwrite d3/d1c/d2f/f3b [0,4194304] 0 2024-02-15T18:27:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:0/551: creat d0/d2f/d3f/da4/fab x:0 0 0 2024-02-15T18:27:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:4/582: readlink d2/d2b/d47/d31/l4d 0 2024-02-15T18:27:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:0/552: write d0/d4/d66/f72 [1708340,29671] 0 2024-02-15T18:27:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:0/553: readlink d0/d4/d1b/l33 0 2024-02-15T18:27:05.470 INFO:tasks.workunit.client.0.smithi084.stdout:9/613: mknod d4/d2b/d3c/d20/d43/d15/d4f/cc4 0 2024-02-15T18:27:05.476 INFO:tasks.workunit.client.0.smithi084.stdout:9/614: write d4/d2b/d3c/d24/f2a [2904212,48921] 0 2024-02-15T18:27:05.476 INFO:tasks.workunit.client.0.smithi084.stdout:4/583: mkdir d2/d64/da5/dae 0 2024-02-15T18:27:05.479 INFO:tasks.workunit.client.0.smithi084.stdout:9/615: rmdir d4/d2b/d3c/d20/d43/d15/d5d 39 2024-02-15T18:27:05.480 INFO:tasks.workunit.client.1.smithi133.stdout:9/179: dwrite d0/d8/f22 [0,4194304] 0 2024-02-15T18:27:05.480 INFO:tasks.workunit.client.0.smithi084.stdout:4/584: symlink d2/d64/d74/laf 0 2024-02-15T18:27:05.480 INFO:tasks.workunit.client.0.smithi084.stdout:4/585: fsync d2/d4/f82 0 2024-02-15T18:27:05.480 INFO:tasks.workunit.client.0.smithi084.stdout:4/586: write d2/d4/d25/f4a [1624407,59953] 0 2024-02-15T18:27:05.481 INFO:tasks.workunit.client.0.smithi084.stdout:9/616: truncate d4/d2b/d3c/d24/f68 8213 0 2024-02-15T18:27:05.481 INFO:tasks.workunit.client.0.smithi084.stdout:9/617: readlink d4/d36/la9 0 2024-02-15T18:27:05.483 INFO:tasks.workunit.client.0.smithi084.stdout:4/587: mkdir d2/d2b/d47/d31/d62/d88/db0 0 2024-02-15T18:27:05.483 INFO:tasks.workunit.client.0.smithi084.stdout:4/588: stat d2/d4/d28/d3d/f92 0 2024-02-15T18:27:05.483 INFO:tasks.workunit.client.0.smithi084.stdout:4/589: fdatasync d2/d4/f55 0 2024-02-15T18:27:05.484 INFO:tasks.workunit.client.0.smithi084.stdout:9/618: mkdir d4/da3/db0/dc5 0 2024-02-15T18:27:05.486 INFO:tasks.workunit.client.1.smithi133.stdout:9/180: truncate d0/f7 4595894 0 2024-02-15T18:27:05.487 INFO:tasks.workunit.client.0.smithi084.stdout:4/590: creat d2/d2b/d47/d31/d50/fb1 x:0 0 0 2024-02-15T18:27:05.488 INFO:tasks.workunit.client.0.smithi084.stdout:4/591: fsync d2/d2b/d47/d31/f9e 0 2024-02-15T18:27:05.491 INFO:tasks.workunit.client.1.smithi133.stdout:8/221: dread d3/f22 [0,4194304] 0 2024-02-15T18:27:05.492 INFO:tasks.workunit.client.0.smithi084.stdout:4/592: creat d2/d4/fb2 x:0 0 0 2024-02-15T18:27:05.493 INFO:tasks.workunit.client.1.smithi133.stdout:6/292: dwrite d0/f27 [0,4194304] 0 2024-02-15T18:27:05.496 INFO:tasks.workunit.client.1.smithi133.stdout:5/168: truncate d17/f19 3664454 0 2024-02-15T18:27:05.503 INFO:tasks.workunit.client.1.smithi133.stdout:8/222: rename d3/l13 to d3/d1c/d37/l50 0 2024-02-15T18:27:05.507 INFO:tasks.workunit.client.0.smithi084.stdout:3/479: dwrite d8/d22/f34 [4194304,4194304] 0 2024-02-15T18:27:05.507 INFO:tasks.workunit.client.0.smithi084.stdout:3/480: readlink d8/d40/d43/l6d 0 2024-02-15T18:27:05.507 INFO:tasks.workunit.client.0.smithi084.stdout:3/481: fsync d8/d73/f86 0 2024-02-15T18:27:05.507 INFO:tasks.workunit.client.0.smithi084.stdout:2/507: dwrite d3/d28/f45 [4194304,4194304] 0 2024-02-15T18:27:05.508 INFO:tasks.workunit.client.1.smithi133.stdout:9/181: dread d0/d8/d10/f36 [0,4194304] 0 2024-02-15T18:27:05.509 INFO:tasks.workunit.client.1.smithi133.stdout:9/182: mknod d0/d37/c3a 0 2024-02-15T18:27:05.510 INFO:tasks.workunit.client.0.smithi084.stdout:3/482: mkdir d8/d40/d43/d71/d8c/d94/da3 0 2024-02-15T18:27:05.511 INFO:tasks.workunit.client.1.smithi133.stdout:8/223: write d3/d7/f26 [1278903,81765] 0 2024-02-15T18:27:05.511 INFO:tasks.workunit.client.1.smithi133.stdout:8/224: chown d3/f22 1711653974 1 2024-02-15T18:27:05.512 INFO:tasks.workunit.client.0.smithi084.stdout:2/508: rename d3/d19/d24/d3e to d3/d5/d1a/d1e/d4b/da6 0 2024-02-15T18:27:05.513 INFO:tasks.workunit.client.1.smithi133.stdout:9/183: creat d0/d8/d9/f3b x:0 0 0 2024-02-15T18:27:05.513 INFO:tasks.workunit.client.1.smithi133.stdout:9/184: chown d0/d8/f22 333186814 1 2024-02-15T18:27:05.528 INFO:tasks.workunit.client.0.smithi084.stdout:8/584: write db/dd/d1f/f23 [3980006,94861] 0 2024-02-15T18:27:05.529 INFO:tasks.workunit.client.0.smithi084.stdout:3/483: dread d8/d40/d58/d80/f3c [0,4194304] 0 2024-02-15T18:27:05.529 INFO:tasks.workunit.client.0.smithi084.stdout:8/585: creat db/d1a/d2b/d7b/fc0 x:0 0 0 2024-02-15T18:27:05.533 INFO:tasks.workunit.client.0.smithi084.stdout:8/586: symlink db/dd/lc1 0 2024-02-15T18:27:05.534 INFO:tasks.workunit.client.0.smithi084.stdout:8/587: chown db/dd/d13/db9/lbc 941322851 1 2024-02-15T18:27:05.534 INFO:tasks.workunit.client.0.smithi084.stdout:7/497: dwrite df/d1d/f3e [0,4194304] 0 2024-02-15T18:27:05.534 INFO:tasks.workunit.client.1.smithi133.stdout:1/377: dwrite f2 [0,4194304] 0 2024-02-15T18:27:05.534 INFO:tasks.workunit.client.1.smithi133.stdout:1/378: truncate d6/d1e/d3a/d82/d85/f83 973539 0 2024-02-15T18:27:05.535 INFO:tasks.workunit.client.0.smithi084.stdout:3/484: creat d8/d40/d43/d71/fa4 x:0 0 0 2024-02-15T18:27:05.536 INFO:tasks.workunit.client.0.smithi084.stdout:8/588: mknod db/d6a/d76/cc2 0 2024-02-15T18:27:05.536 INFO:tasks.workunit.client.0.smithi084.stdout:8/589: readlink db/dd/l71 0 2024-02-15T18:27:05.537 INFO:tasks.workunit.client.1.smithi133.stdout:1/379: getdents d6/d2a 0 2024-02-15T18:27:05.538 INFO:tasks.workunit.client.0.smithi084.stdout:3/485: rename d8/c10 to d8/d22/ca5 0 2024-02-15T18:27:05.538 INFO:tasks.workunit.client.0.smithi084.stdout:3/486: stat d8/d40/d43/l87 0 2024-02-15T18:27:05.538 INFO:tasks.workunit.client.0.smithi084.stdout:0/554: dwrite d0/d4/d1b/d26/f7c [4194304,4194304] 0 2024-02-15T18:27:05.538 INFO:tasks.workunit.client.0.smithi084.stdout:0/555: chown d0/d4/c3b 2 1 2024-02-15T18:27:05.539 INFO:tasks.workunit.client.0.smithi084.stdout:8/590: symlink db/dd/d1f/d3e/lc3 0 2024-02-15T18:27:05.541 INFO:tasks.workunit.client.0.smithi084.stdout:3/487: creat d8/d40/d43/d71/d8c/d94/fa6 x:0 0 0 2024-02-15T18:27:05.541 INFO:tasks.workunit.client.0.smithi084.stdout:6/513: dwrite d14/f38 [0,4194304] 0 2024-02-15T18:27:05.542 INFO:tasks.workunit.client.0.smithi084.stdout:9/619: dwrite d4/f29 [0,4194304] 0 2024-02-15T18:27:05.542 INFO:tasks.workunit.client.1.smithi133.stdout:6/293: dwrite d0/f50 [0,4194304] 0 2024-02-15T18:27:05.544 INFO:tasks.workunit.client.1.smithi133.stdout:1/380: creat d6/d1e/d3a/d79/f93 x:0 0 0 2024-02-15T18:27:05.544 INFO:tasks.workunit.client.0.smithi084.stdout:0/556: symlink d0/d2f/d3f/lac 0 2024-02-15T18:27:05.545 INFO:tasks.workunit.client.0.smithi084.stdout:8/591: creat db/dd/d1f/fc4 x:0 0 0 2024-02-15T18:27:05.546 INFO:tasks.workunit.client.0.smithi084.stdout:8/592: chown db/d3f/d59/d69 4832551 1 2024-02-15T18:27:05.550 INFO:tasks.workunit.client.0.smithi084.stdout:7/498: dread df/f3b [0,4194304] 0 2024-02-15T18:27:05.551 INFO:tasks.workunit.client.0.smithi084.stdout:3/488: stat d8/d40/d58/d80/l5a 0 2024-02-15T18:27:05.555 INFO:tasks.workunit.client.1.smithi133.stdout:5/169: dwrite f15 [4194304,4194304] 0 2024-02-15T18:27:05.555 INFO:tasks.workunit.client.1.smithi133.stdout:8/225: dwrite d3/d1f/f2a [0,4194304] 0 2024-02-15T18:27:05.556 INFO:tasks.workunit.client.1.smithi133.stdout:9/185: dwrite d0/d8/d9/d12/f21 [0,4194304] 0 2024-02-15T18:27:05.556 INFO:tasks.workunit.client.0.smithi084.stdout:2/509: dwrite d3/d5/d1a/d1e/f58 [0,4194304] 0 2024-02-15T18:27:05.556 INFO:tasks.workunit.client.0.smithi084.stdout:6/514: mknod d14/d22/d25/d41/d95/ca1 0 2024-02-15T18:27:05.556 INFO:tasks.workunit.client.0.smithi084.stdout:2/510: dread d3/d5/f18 [0,4194304] 0 2024-02-15T18:27:05.563 INFO:tasks.workunit.client.0.smithi084.stdout:7/499: unlink df/d1d/d1a/f24 0 2024-02-15T18:27:05.564 INFO:tasks.workunit.client.1.smithi133.stdout:1/381: creat d6/d1e/d41/d7c/d7e/f94 x:0 0 0 2024-02-15T18:27:05.565 INFO:tasks.workunit.client.1.smithi133.stdout:8/226: write d3/f4 [688686,120537] 0 2024-02-15T18:27:05.565 INFO:tasks.workunit.client.1.smithi133.stdout:5/170: creat d17/d20/f2f x:0 0 0 2024-02-15T18:27:05.566 INFO:tasks.workunit.client.0.smithi084.stdout:3/489: link d8/d1f/d2d/c31 d8/d40/d43/ca7 0 2024-02-15T18:27:05.567 INFO:tasks.workunit.client.0.smithi084.stdout:6/515: creat d14/d22/d25/d2f/d31/d30/d45/fa2 x:0 0 0 2024-02-15T18:27:05.567 INFO:tasks.workunit.client.0.smithi084.stdout:6/516: chown d14 27237 1 2024-02-15T18:27:05.567 INFO:tasks.workunit.client.0.smithi084.stdout:7/500: dread df/d1d/d1a/f28 [0,4194304] 0 2024-02-15T18:27:05.568 INFO:tasks.workunit.client.0.smithi084.stdout:7/501: read df/d1d/d1a/f28 [168746,114458] 0 2024-02-15T18:27:05.568 INFO:tasks.workunit.client.0.smithi084.stdout:7/502: readlink df/d1d/d1a/d6a/d8b/d48/l4a 0 2024-02-15T18:27:05.568 INFO:tasks.workunit.client.1.smithi133.stdout:8/227: dread d3/de/ff [0,4194304] 0 2024-02-15T18:27:05.572 INFO:tasks.workunit.client.1.smithi133.stdout:1/382: getdents d6 0 2024-02-15T18:27:05.572 INFO:tasks.workunit.client.0.smithi084.stdout:2/511: creat d3/d5/d1a/d1e/d47/d76/fa7 x:0 0 0 2024-02-15T18:27:05.573 INFO:tasks.workunit.client.1.smithi133.stdout:5/171: mknod d17/d20/c30 0 2024-02-15T18:27:05.573 INFO:tasks.workunit.client.1.smithi133.stdout:5/172: chown d17/d20/f2f 485914 1 2024-02-15T18:27:05.573 INFO:tasks.workunit.client.0.smithi084.stdout:3/490: creat d8/d40/fa8 x:0 0 0 2024-02-15T18:27:05.574 INFO:tasks.workunit.client.1.smithi133.stdout:8/228: creat d3/d1c/f51 x:0 0 0 2024-02-15T18:27:05.575 INFO:tasks.workunit.client.1.smithi133.stdout:5/173: creat d17/d2a/f31 x:0 0 0 2024-02-15T18:27:05.575 INFO:tasks.workunit.client.1.smithi133.stdout:8/229: mkdir d3/d7/d52 0 2024-02-15T18:27:05.575 INFO:tasks.workunit.client.1.smithi133.stdout:8/230: stat d3/d1c/d2f/f36 0 2024-02-15T18:27:05.576 INFO:tasks.workunit.client.1.smithi133.stdout:8/231: stat d3/d7/l2b 0 2024-02-15T18:27:05.576 INFO:tasks.workunit.client.1.smithi133.stdout:5/174: mkdir d17/d20/d32 0 2024-02-15T18:27:05.578 INFO:tasks.workunit.client.1.smithi133.stdout:5/175: creat d17/f33 x:0 0 0 2024-02-15T18:27:05.578 INFO:tasks.workunit.client.1.smithi133.stdout:5/176: fdatasync ff 0 2024-02-15T18:27:05.580 INFO:tasks.workunit.client.1.smithi133.stdout:5/177: mknod d17/d26/c34 0 2024-02-15T18:27:05.581 INFO:tasks.workunit.client.0.smithi084.stdout:7/503: symlink df/d1d/d1a/d6a/d8b/d48/l9b 0 2024-02-15T18:27:05.581 INFO:tasks.workunit.client.0.smithi084.stdout:2/512: symlink d3/d5/d53/la8 0 2024-02-15T18:27:05.581 INFO:tasks.workunit.client.0.smithi084.stdout:6/517: creat d14/d22/d25/d2f/d31/d30/d4f/fa3 x:0 0 0 2024-02-15T18:27:05.581 INFO:tasks.workunit.client.0.smithi084.stdout:6/518: write d14/f78 [611903,55802] 0 2024-02-15T18:27:05.581 INFO:tasks.workunit.client.0.smithi084.stdout:3/491: link d8/d40/d58/d80/d6b/f8d d8/d22/fa9 0 2024-02-15T18:27:05.581 INFO:tasks.workunit.client.0.smithi084.stdout:9/620: dwrite d4/d2b/d3c/d20/d43/f95 [4194304,4194304] 0 2024-02-15T18:27:05.582 INFO:tasks.workunit.client.0.smithi084.stdout:6/519: dread d14/d22/d25/d2f/f66 [0,4194304] 0 2024-02-15T18:27:05.582 INFO:tasks.workunit.client.0.smithi084.stdout:6/520: chown d14/d22/d25/d41/c4d 12981 1 2024-02-15T18:27:05.582 INFO:tasks.workunit.client.0.smithi084.stdout:7/504: mkdir df/d70/d9c 0 2024-02-15T18:27:05.584 INFO:tasks.workunit.client.0.smithi084.stdout:2/513: creat d3/d5/d1a/d74/d8e/d96/fa9 x:0 0 0 2024-02-15T18:27:05.585 INFO:tasks.workunit.client.1.smithi133.stdout:6/294: dwrite d0/f24 [0,4194304] 0 2024-02-15T18:27:05.585 INFO:tasks.workunit.client.1.smithi133.stdout:6/295: dread - d0/d3b/d52/f58 zero size 2024-02-15T18:27:05.586 INFO:tasks.workunit.client.0.smithi084.stdout:6/521: creat d14/d22/d25/d2f/d31/d30/d45/d52/fa4 x:0 0 0 2024-02-15T18:27:05.587 INFO:tasks.workunit.client.0.smithi084.stdout:3/492: write d8/d1f/d25/f7f [2029486,65052] 0 2024-02-15T18:27:05.587 INFO:tasks.workunit.client.0.smithi084.stdout:3/493: write d8/d40/fa8 [611958,66160] 0 2024-02-15T18:27:05.587 INFO:tasks.workunit.client.0.smithi084.stdout:3/494: fdatasync d8/d73/f90 0 2024-02-15T18:27:05.588 INFO:tasks.workunit.client.1.smithi133.stdout:5/178: creat d17/d20/f35 x:0 0 0 2024-02-15T18:27:05.588 INFO:tasks.workunit.client.1.smithi133.stdout:5/179: truncate fc 4404927 0 2024-02-15T18:27:05.589 INFO:tasks.workunit.client.0.smithi084.stdout:0/557: dwrite d0/d2f/d3f/f5a [0,4194304] 0 2024-02-15T18:27:05.589 INFO:tasks.workunit.client.0.smithi084.stdout:0/558: stat d0/d2f/d3f/d4f/d61/c68 0 2024-02-15T18:27:05.589 INFO:tasks.workunit.client.0.smithi084.stdout:0/559: write d0/d4/d3a/d5c/f52 [4375692,44488] 0 2024-02-15T18:27:05.589 INFO:tasks.workunit.client.0.smithi084.stdout:2/514: rename d3/d19/f6c to d3/d5/d1a/d1e/faa 0 2024-02-15T18:27:05.590 INFO:tasks.workunit.client.0.smithi084.stdout:8/593: dwrite db/d3f/d59/d69/f6b [0,4194304] 0 2024-02-15T18:27:05.590 INFO:tasks.workunit.client.1.smithi133.stdout:5/180: write ff [1796255,88211] 0 2024-02-15T18:27:05.591 INFO:tasks.workunit.client.0.smithi084.stdout:8/594: write db/d3f/f54 [4171483,86170] 0 2024-02-15T18:27:05.593 INFO:tasks.workunit.client.1.smithi133.stdout:5/181: creat d17/f36 x:0 0 0 2024-02-15T18:27:05.593 INFO:tasks.workunit.client.1.smithi133.stdout:5/182: readlink la 0 2024-02-15T18:27:05.595 INFO:tasks.workunit.client.0.smithi084.stdout:1/482: sync 2024-02-15T18:27:05.597 INFO:tasks.workunit.client.1.smithi133.stdout:5/183: creat d17/d20/d32/f37 x:0 0 0 2024-02-15T18:27:05.597 INFO:tasks.workunit.client.0.smithi084.stdout:3/495: creat d8/d40/faa x:0 0 0 2024-02-15T18:27:05.598 INFO:tasks.workunit.client.0.smithi084.stdout:0/560: write d0/d39/f78 [556039,48165] 0 2024-02-15T18:27:05.599 INFO:tasks.workunit.client.0.smithi084.stdout:0/561: stat d0/d25/f67 0 2024-02-15T18:27:05.599 INFO:tasks.workunit.client.0.smithi084.stdout:2/515: truncate d3/d19/d24/d7b/f9a 1407902 0 2024-02-15T18:27:05.599 INFO:tasks.workunit.client.0.smithi084.stdout:2/516: fdatasync d3/d5/d1a/d1e/faa 0 2024-02-15T18:27:05.600 INFO:tasks.workunit.client.1.smithi133.stdout:5/184: mkdir d17/d20/d32/d38 0 2024-02-15T18:27:05.602 INFO:tasks.workunit.client.1.smithi133.stdout:5/185: symlink d17/l39 0 2024-02-15T18:27:05.605 INFO:tasks.workunit.client.0.smithi084.stdout:8/595: creat db/d1a/d2b/fc5 x:0 0 0 2024-02-15T18:27:05.606 INFO:tasks.workunit.client.0.smithi084.stdout:1/483: mkdir d9/d54/d1b/da7 0 2024-02-15T18:27:05.606 INFO:tasks.workunit.client.0.smithi084.stdout:1/484: truncate d9/d54/d1b/f25 1091998 0 2024-02-15T18:27:05.606 INFO:tasks.workunit.client.0.smithi084.stdout:1/485: write d9/f9d [97231,65969] 0 2024-02-15T18:27:05.606 INFO:tasks.workunit.client.0.smithi084.stdout:3/496: getdents d8/d73/d93 0 2024-02-15T18:27:05.608 INFO:tasks.workunit.client.0.smithi084.stdout:0/562: truncate d0/f1a 3475226 0 2024-02-15T18:27:05.610 INFO:tasks.workunit.client.0.smithi084.stdout:2/517: rename d3/d5/d1a/d1e/c7c to d3/d5/d1a/d74/cab 0 2024-02-15T18:27:05.611 INFO:tasks.workunit.client.1.smithi133.stdout:1/383: dwrite d6/d1e/d3a/d82/d85/f83 [0,4194304] 0 2024-02-15T18:27:05.611 INFO:tasks.workunit.client.1.smithi133.stdout:1/384: readlink d6/d1e/d3a/d82/d85/l6b 0 2024-02-15T18:27:05.612 INFO:tasks.workunit.client.0.smithi084.stdout:8/596: rmdir db/d1a 39 2024-02-15T18:27:05.612 INFO:tasks.workunit.client.0.smithi084.stdout:8/597: readlink db/dd/d1f/l21 0 2024-02-15T18:27:05.612 INFO:tasks.workunit.client.0.smithi084.stdout:8/598: chown db/dd/d4d 84455 1 2024-02-15T18:27:05.612 INFO:tasks.workunit.client.0.smithi084.stdout:8/599: chown db/dd/d4d/l9f 1219 1 2024-02-15T18:27:05.612 INFO:tasks.workunit.client.0.smithi084.stdout:0/563: truncate d0/d25/f34 78258 0 2024-02-15T18:27:05.614 INFO:tasks.workunit.client.0.smithi084.stdout:2/518: link d3/d5/d1a/d1e/d4b/f59 d3/d5/d1a/d74/fac 0 2024-02-15T18:27:05.615 INFO:tasks.workunit.client.1.smithi133.stdout:1/385: symlink d6/d2a/d59/l95 0 2024-02-15T18:27:05.616 INFO:tasks.workunit.client.0.smithi084.stdout:8/600: rmdir db/d1a/d5e 39 2024-02-15T18:27:05.618 INFO:tasks.workunit.client.0.smithi084.stdout:2/519: rmdir d3/d5e 39 2024-02-15T18:27:05.620 INFO:tasks.workunit.client.0.smithi084.stdout:1/486: dread d9/d54/d1b/f53 [0,4194304] 0 2024-02-15T18:27:05.620 INFO:tasks.workunit.client.0.smithi084.stdout:1/487: write d9/d54/d5c/d81/fa2 [298986,46050] 0 2024-02-15T18:27:05.627 INFO:tasks.workunit.client.0.smithi084.stdout:1/488: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8 0 2024-02-15T18:27:05.627 INFO:tasks.workunit.client.0.smithi084.stdout:6/522: dwrite d14/d22/f64 [0,4194304] 0 2024-02-15T18:27:05.628 INFO:tasks.workunit.client.0.smithi084.stdout:2/520: rename d3/d19/d24/f3a to d3/fad 0 2024-02-15T18:27:05.631 INFO:tasks.workunit.client.1.smithi133.stdout:6/296: dwrite d0/d5/f1b [0,4194304] 0 2024-02-15T18:27:05.631 INFO:tasks.workunit.client.1.smithi133.stdout:6/297: write d0/d3b/d52/f59 [200941,118823] 0 2024-02-15T18:27:05.632 INFO:tasks.workunit.client.0.smithi084.stdout:2/521: rename d3/d5/d53/l90 to d3/d5/d53/lae 0 2024-02-15T18:27:05.632 INFO:tasks.workunit.client.1.smithi133.stdout:6/298: truncate d0/f14 101129 0 2024-02-15T18:27:05.633 INFO:tasks.workunit.client.1.smithi133.stdout:6/299: readlink d0/d5/l55 0 2024-02-15T18:27:05.633 INFO:tasks.workunit.client.1.smithi133.stdout:6/300: write d0/db/d21/f3c [596187,108828] 0 2024-02-15T18:27:05.636 INFO:tasks.workunit.client.0.smithi084.stdout:2/522: creat d3/faf x:0 0 0 2024-02-15T18:27:05.637 INFO:tasks.workunit.client.0.smithi084.stdout:2/523: mkdir d3/d19/d24/d7b/db0 0 2024-02-15T18:27:05.638 INFO:tasks.workunit.client.1.smithi133.stdout:6/301: write d0/f32 [862044,4896] 0 2024-02-15T18:27:05.639 INFO:tasks.workunit.client.1.smithi133.stdout:6/302: mknod d0/d3b/d41/c61 0 2024-02-15T18:27:05.639 INFO:tasks.workunit.client.1.smithi133.stdout:6/303: dread - d0/db/f4f zero size 2024-02-15T18:27:05.639 INFO:tasks.workunit.client.1.smithi133.stdout:6/304: readlink d0/d5/l55 0 2024-02-15T18:27:05.639 INFO:tasks.workunit.client.1.smithi133.stdout:6/305: write d0/f24 [5172872,117418] 0 2024-02-15T18:27:05.639 INFO:tasks.workunit.client.1.smithi133.stdout:6/306: read d0/d5/f1b [1290714,28911] 0 2024-02-15T18:27:05.640 INFO:tasks.workunit.client.1.smithi133.stdout:6/307: rmdir d0/d3b/d52 39 2024-02-15T18:27:05.640 INFO:tasks.workunit.client.0.smithi084.stdout:2/524: rename d3/d5/f35 to d3/d5/d53/fb1 0 2024-02-15T18:27:05.641 INFO:tasks.workunit.client.0.smithi084.stdout:2/525: readlink d3/d5/d1a/d1e/d47/l9b 0 2024-02-15T18:27:05.653 INFO:tasks.workunit.client.1.smithi133.stdout:6/308: dread d0/f27 [0,4194304] 0 2024-02-15T18:27:05.654 INFO:tasks.workunit.client.1.smithi133.stdout:6/309: write d0/f50 [2660793,82421] 0 2024-02-15T18:27:05.656 INFO:tasks.workunit.client.1.smithi133.stdout:5/186: dwrite fc [0,4194304] 0 2024-02-15T18:27:05.658 INFO:tasks.workunit.client.1.smithi133.stdout:5/187: creat d17/f3a x:0 0 0 2024-02-15T18:27:05.658 INFO:tasks.workunit.client.1.smithi133.stdout:5/188: write d17/d20/f28 [368685,30988] 0 2024-02-15T18:27:05.659 INFO:tasks.workunit.client.1.smithi133.stdout:6/310: mkdir d0/d62 0 2024-02-15T18:27:05.660 INFO:tasks.workunit.client.1.smithi133.stdout:6/311: mknod d0/db/c63 0 2024-02-15T18:27:05.661 INFO:tasks.workunit.client.1.smithi133.stdout:6/312: write d0/db/f17 [1994760,96657] 0 2024-02-15T18:27:05.665 INFO:tasks.workunit.client.1.smithi133.stdout:5/189: dread d17/d26/f21 [0,4194304] 0 2024-02-15T18:27:05.665 INFO:tasks.workunit.client.1.smithi133.stdout:5/190: dread - d17/d20/d32/f37 zero size 2024-02-15T18:27:05.666 INFO:tasks.workunit.client.1.smithi133.stdout:5/191: getdents d17/d20/d32 0 2024-02-15T18:27:05.667 INFO:tasks.workunit.client.0.smithi084.stdout:3/497: dwrite d8/d40/d43/d71/d8c/d94/fa6 [0,4194304] 0 2024-02-15T18:27:05.668 INFO:tasks.workunit.client.1.smithi133.stdout:5/192: creat d17/d2a/f3b x:0 0 0 2024-02-15T18:27:05.668 INFO:tasks.workunit.client.1.smithi133.stdout:5/193: dread - d17/f33 zero size 2024-02-15T18:27:05.668 INFO:tasks.workunit.client.1.smithi133.stdout:5/194: write d17/f19 [4103377,14166] 0 2024-02-15T18:27:05.668 INFO:tasks.workunit.client.1.smithi133.stdout:1/386: dwrite d6/d17/f68 [0,4194304] 0 2024-02-15T18:27:05.668 INFO:tasks.workunit.client.1.smithi133.stdout:1/387: stat d6/f22 0 2024-02-15T18:27:05.668 INFO:tasks.workunit.client.1.smithi133.stdout:1/388: chown d6/d1e/d3a/d82/d85/d67/f8b 262562660 1 2024-02-15T18:27:05.669 INFO:tasks.workunit.client.0.smithi084.stdout:6/523: dwrite d14/d22/d25/d28/f48 [0,4194304] 0 2024-02-15T18:27:05.669 INFO:tasks.workunit.client.0.smithi084.stdout:6/524: truncate d14/d22/d25/d41/f68 1227265 0 2024-02-15T18:27:05.670 INFO:tasks.workunit.client.0.smithi084.stdout:0/564: dwrite d0/d2f/d3f/da4/fab [0,4194304] 0 2024-02-15T18:27:05.670 INFO:tasks.workunit.client.0.smithi084.stdout:0/565: readlink d0/d2f/d3f/lac 0 2024-02-15T18:27:05.670 INFO:tasks.workunit.client.0.smithi084.stdout:3/498: rmdir d8/d40/d43 39 2024-02-15T18:27:05.670 INFO:tasks.workunit.client.0.smithi084.stdout:2/526: dwrite d3/d28/f45 [0,4194304] 0 2024-02-15T18:27:05.670 INFO:tasks.workunit.client.1.smithi133.stdout:5/195: mkdir d17/d3c 0 2024-02-15T18:27:05.670 INFO:tasks.workunit.client.1.smithi133.stdout:1/389: mkdir d6/d1e/d3a/d82/d85/d96 0 2024-02-15T18:27:05.672 INFO:tasks.workunit.client.1.smithi133.stdout:5/196: creat d17/d20/d32/d38/f3d x:0 0 0 2024-02-15T18:27:05.673 INFO:tasks.workunit.client.1.smithi133.stdout:5/197: truncate d17/d20/f23 614629 0 2024-02-15T18:27:05.673 INFO:tasks.workunit.client.0.smithi084.stdout:6/525: mknod d14/d22/d25/d2f/d31/d30/d93/ca5 0 2024-02-15T18:27:05.673 INFO:tasks.workunit.client.1.smithi133.stdout:6/313: dread d0/f32 [0,4194304] 0 2024-02-15T18:27:05.674 INFO:tasks.workunit.client.1.smithi133.stdout:1/390: mkdir d6/d1e/d3a/d97 0 2024-02-15T18:27:05.674 INFO:tasks.workunit.client.1.smithi133.stdout:1/391: read - d6/d17/f73 zero size 2024-02-15T18:27:05.674 INFO:tasks.workunit.client.1.smithi133.stdout:1/392: chown d6/c14 1842 1 2024-02-15T18:27:05.675 INFO:tasks.workunit.client.0.smithi084.stdout:0/566: creat d0/d2f/d3f/d4f/fad x:0 0 0 2024-02-15T18:27:05.675 INFO:tasks.workunit.client.0.smithi084.stdout:6/526: creat d14/d22/d25/d41/d43/fa6 x:0 0 0 2024-02-15T18:27:05.676 INFO:tasks.workunit.client.1.smithi133.stdout:1/393: write d6/d17/f1c [245797,106709] 0 2024-02-15T18:27:05.678 INFO:tasks.workunit.client.0.smithi084.stdout:2/527: dread d3/d5/d1a/d1e/faa [0,4194304] 0 2024-02-15T18:27:05.678 INFO:tasks.workunit.client.1.smithi133.stdout:5/198: link d17/d2a/l2e d17/d20/d32/d38/l3e 0 2024-02-15T18:27:05.680 INFO:tasks.workunit.client.1.smithi133.stdout:6/314: symlink d0/d3b/d41/l64 0 2024-02-15T18:27:05.681 INFO:tasks.workunit.client.1.smithi133.stdout:1/394: creat d6/d1e/d41/d7c/f98 x:0 0 0 2024-02-15T18:27:05.681 INFO:tasks.workunit.client.1.smithi133.stdout:1/395: dread - d6/d2a/d59/d5a/f6f zero size 2024-02-15T18:27:05.683 INFO:tasks.workunit.client.1.smithi133.stdout:5/199: unlink d17/d2a/l2e 0 2024-02-15T18:27:05.684 INFO:tasks.workunit.client.1.smithi133.stdout:6/315: rename d0/f4b to d0/d3b/d53/f65 0 2024-02-15T18:27:05.687 INFO:tasks.workunit.client.0.smithi084.stdout:6/527: write d14/d22/f64 [180956,54126] 0 2024-02-15T18:27:05.691 INFO:tasks.workunit.client.0.smithi084.stdout:6/528: rename d14/d22/d25/d2f/d31/d3f/d4a/l91 to d14/d22/d25/d2f/d31/d30/d4f/d7f/la7 0 2024-02-15T18:27:05.693 INFO:tasks.workunit.client.1.smithi133.stdout:1/396: rmdir d6/d1e/d3a/d82/d85/d96 0 2024-02-15T18:27:05.693 INFO:tasks.workunit.client.1.smithi133.stdout:5/200: mknod d17/d2a/c3f 0 2024-02-15T18:27:05.694 INFO:tasks.workunit.client.0.smithi084.stdout:6/529: read d14/d22/d25/d2f/d31/d3f/d4a/f4c [1041134,86308] 0 2024-02-15T18:27:05.695 INFO:tasks.workunit.client.1.smithi133.stdout:5/201: write fc [3187281,55891] 0 2024-02-15T18:27:05.695 INFO:tasks.workunit.client.1.smithi133.stdout:5/202: write d17/f27 [932365,93961] 0 2024-02-15T18:27:05.696 INFO:tasks.workunit.client.0.smithi084.stdout:6/530: creat d14/d22/d25/d2f/d31/d30/d45/d5c/fa8 x:0 0 0 2024-02-15T18:27:05.704 INFO:tasks.workunit.client.1.smithi133.stdout:1/397: dread d6/d1e/d41/f66 [4194304,4194304] 0 2024-02-15T18:27:05.704 INFO:tasks.workunit.client.1.smithi133.stdout:1/398: fsync d6/d1e/d3a/d82/d85/d67/f87 0 2024-02-15T18:27:05.704 INFO:tasks.workunit.client.1.smithi133.stdout:1/399: stat d6/d2a/d59/c5f 0 2024-02-15T18:27:05.705 INFO:tasks.workunit.client.1.smithi133.stdout:1/400: rename d6/f2e to d6/d1e/d41/d7c/d7e/f99 0 2024-02-15T18:27:05.707 INFO:tasks.workunit.client.1.smithi133.stdout:1/401: unlink d6/d2a/d59/f6a 0 2024-02-15T18:27:05.707 INFO:tasks.workunit.client.1.smithi133.stdout:1/402: fdatasync d6/f90 0 2024-02-15T18:27:05.707 INFO:tasks.workunit.client.1.smithi133.stdout:1/403: readlink d6/d1e/d3a/d82/d85/l5d 0 2024-02-15T18:27:05.707 INFO:tasks.workunit.client.1.smithi133.stdout:1/404: creat d6/d1e/d41/d7c/d7e/f9a x:0 0 0 2024-02-15T18:27:05.708 INFO:tasks.workunit.client.1.smithi133.stdout:1/405: stat d6/d1e/d3a/d82/d85/c91 0 2024-02-15T18:27:05.708 INFO:tasks.workunit.client.1.smithi133.stdout:1/406: fsync d6/d89/f81 0 2024-02-15T18:27:05.708 INFO:tasks.workunit.client.0.smithi084.stdout:0/567: dwrite d0/d2f/f93 [0,4194304] 0 2024-02-15T18:27:05.709 INFO:tasks.workunit.client.1.smithi133.stdout:1/407: creat d6/d2a/d59/d5a/f9b x:0 0 0 2024-02-15T18:27:05.709 INFO:tasks.workunit.client.1.smithi133.stdout:1/408: chown d6/d2a/f4a 63719928 1 2024-02-15T18:27:05.709 INFO:tasks.workunit.client.0.smithi084.stdout:2/528: dwrite d3/d5/d1a/f9c [0,4194304] 0 2024-02-15T18:27:05.710 INFO:tasks.workunit.client.1.smithi133.stdout:1/409: creat d6/d1e/d41/d7c/f9c x:0 0 0 2024-02-15T18:27:05.713 INFO:tasks.workunit.client.0.smithi084.stdout:2/529: creat d3/d19/d24/d89/fb2 x:0 0 0 2024-02-15T18:27:05.713 INFO:tasks.workunit.client.0.smithi084.stdout:2/530: write d3/d5/d1a/d74/f77 [546032,58376] 0 2024-02-15T18:27:05.713 INFO:tasks.workunit.client.0.smithi084.stdout:2/531: dread - d3/d5/d1a/d1e/d4b/da6/fa5 zero size 2024-02-15T18:27:05.714 INFO:tasks.workunit.client.1.smithi133.stdout:1/410: rename d6/d17/f73 to d6/d1e/d3a/f9d 0 2024-02-15T18:27:05.719 INFO:tasks.workunit.client.1.smithi133.stdout:6/316: dwrite d0/f12 [0,4194304] 0 2024-02-15T18:27:05.724 INFO:tasks.workunit.client.0.smithi084.stdout:6/531: dwrite d14/d22/d25/d2f/d31/d30/d45/d54/f6e [4194304,4194304] 0 2024-02-15T18:27:05.728 INFO:tasks.workunit.client.1.smithi133.stdout:6/317: rename d0/d5/d37 to d0/d62/d66 0 2024-02-15T18:27:05.728 INFO:tasks.workunit.client.1.smithi133.stdout:6/318: write d0/d3b/d52/f59 [400172,59981] 0 2024-02-15T18:27:05.729 INFO:tasks.workunit.client.1.smithi133.stdout:6/319: fsync d0/f14 0 2024-02-15T18:27:05.729 INFO:tasks.workunit.client.1.smithi133.stdout:6/320: chown d0/d62 50564 1 2024-02-15T18:27:05.731 INFO:tasks.workunit.client.0.smithi084.stdout:6/532: rename d14/d22/d25/d2f/d31/d30/d45/d5c to d14/d22/d25/d2f/da9 0 2024-02-15T18:27:05.731 INFO:tasks.workunit.client.1.smithi133.stdout:6/321: mkdir d0/d3b/d67 0 2024-02-15T18:27:05.731 INFO:tasks.workunit.client.1.smithi133.stdout:6/322: chown d0/c36 15018945 1 2024-02-15T18:27:05.731 INFO:tasks.workunit.client.1.smithi133.stdout:6/323: fsync d0/db/f3f 0 2024-02-15T18:27:05.732 INFO:tasks.workunit.client.1.smithi133.stdout:6/324: dread d0/db/f3f [0,4194304] 0 2024-02-15T18:27:05.732 INFO:tasks.workunit.client.0.smithi084.stdout:6/533: mknod d14/d22/d25/d2f/caa 0 2024-02-15T18:27:05.738 INFO:tasks.workunit.client.1.smithi133.stdout:6/325: dread d0/db/d21/f3c [0,4194304] 0 2024-02-15T18:27:05.739 INFO:tasks.workunit.client.1.smithi133.stdout:6/326: symlink d0/db/d29/d34/l68 0 2024-02-15T18:27:05.745 INFO:tasks.workunit.client.0.smithi084.stdout:0/568: dwrite d0/d4/d1b/d26/f2e [0,4194304] 0 2024-02-15T18:27:05.745 INFO:tasks.workunit.client.0.smithi084.stdout:2/532: dwrite d3/d5/d1a/d1e/d30/f67 [0,4194304] 0 2024-02-15T18:27:05.746 INFO:tasks.workunit.client.1.smithi133.stdout:1/411: dwrite d6/fe [0,4194304] 0 2024-02-15T18:27:05.746 INFO:tasks.workunit.client.1.smithi133.stdout:1/412: dread - d6/f4b zero size 2024-02-15T18:27:05.749 INFO:tasks.workunit.client.1.smithi133.stdout:1/413: mkdir d6/d1e/d3a/d9e 0 2024-02-15T18:27:05.749 INFO:tasks.workunit.client.1.smithi133.stdout:1/414: read - d6/d2a/d59/d5a/f6f zero size 2024-02-15T18:27:05.756 INFO:tasks.workunit.client.1.smithi133.stdout:1/415: truncate d6/f29 858233 0 2024-02-15T18:27:05.756 INFO:tasks.workunit.client.1.smithi133.stdout:1/416: dread - d6/d1e/f7b zero size 2024-02-15T18:27:05.756 INFO:tasks.workunit.client.1.smithi133.stdout:1/417: chown d6/d1e/d41/d7c/d7e/d7f 18 1 2024-02-15T18:27:05.758 INFO:tasks.workunit.client.0.smithi084.stdout:6/534: dwrite f3 [0,4194304] 0 2024-02-15T18:27:05.758 INFO:tasks.workunit.client.0.smithi084.stdout:6/535: truncate d14/d22/d25/d2f/d31/d30/d45/d52/f53 5149715 0 2024-02-15T18:27:05.759 INFO:tasks.workunit.client.0.smithi084.stdout:6/536: mkdir d14/d22/d25/d28/dab 0 2024-02-15T18:27:05.763 INFO:tasks.workunit.client.1.smithi133.stdout:1/418: mknod d6/d1e/d3a/d75/c9f 0 2024-02-15T18:27:05.763 INFO:tasks.workunit.client.1.smithi133.stdout:1/419: write d6/d1e/d3a/d82/d85/d67/f8b [513480,49123] 0 2024-02-15T18:27:05.763 INFO:tasks.workunit.client.1.smithi133.stdout:6/327: dwrite d0/ff [0,4194304] 0 2024-02-15T18:27:05.763 INFO:tasks.workunit.client.0.smithi084.stdout:6/537: dread d14/d22/d25/f44 [0,4194304] 0 2024-02-15T18:27:05.764 INFO:tasks.workunit.client.0.smithi084.stdout:6/538: readlink d14/l26 0 2024-02-15T18:27:05.764 INFO:tasks.workunit.client.0.smithi084.stdout:6/539: dread - d14/d22/d25/d2f/d31/d30/d4f/fa3 zero size 2024-02-15T18:27:05.765 INFO:tasks.workunit.client.0.smithi084.stdout:0/569: dwrite d0/d4/d3a/f74 [4194304,4194304] 0 2024-02-15T18:27:05.765 INFO:tasks.workunit.client.1.smithi133.stdout:6/328: rename d0/db/d29/d34/d5d/d40/l5b to d0/d3b/d41/l69 0 2024-02-15T18:27:05.767 INFO:tasks.workunit.client.1.smithi133.stdout:6/329: write d0/f24 [4743992,6729] 0 2024-02-15T18:27:05.767 INFO:tasks.workunit.client.1.smithi133.stdout:6/330: fdatasync d0/db/f4f 0 2024-02-15T18:27:05.769 INFO:tasks.workunit.client.1.smithi133.stdout:6/331: mknod d0/db/d29/d34/c6a 0 2024-02-15T18:27:05.770 INFO:tasks.workunit.client.0.smithi084.stdout:0/570: mkdir d0/d2f/d4b/dae 0 2024-02-15T18:27:05.774 INFO:tasks.workunit.client.1.smithi133.stdout:6/332: write d0/d5/f4a [471580,59263] 0 2024-02-15T18:27:05.775 INFO:tasks.workunit.client.1.smithi133.stdout:6/333: creat d0/db/d29/d34/d5d/f6b x:0 0 0 2024-02-15T18:27:05.775 INFO:tasks.workunit.client.1.smithi133.stdout:6/334: fsync d0/db/f33 0 2024-02-15T18:27:05.775 INFO:tasks.workunit.client.1.smithi133.stdout:6/335: symlink d0/db/d29/l6c 0 2024-02-15T18:27:05.776 INFO:tasks.workunit.client.1.smithi133.stdout:6/336: creat d0/d3b/f6d x:0 0 0 2024-02-15T18:27:05.777 INFO:tasks.workunit.client.1.smithi133.stdout:6/337: creat d0/d3b/d53/f6e x:0 0 0 2024-02-15T18:27:05.777 INFO:tasks.workunit.client.1.smithi133.stdout:7/150: sync 2024-02-15T18:27:05.777 INFO:tasks.workunit.client.1.smithi133.stdout:4/181: sync 2024-02-15T18:27:05.778 INFO:tasks.workunit.client.1.smithi133.stdout:6/338: creat d0/db/d21/f6f x:0 0 0 2024-02-15T18:27:05.779 INFO:tasks.workunit.client.1.smithi133.stdout:7/151: link d9/d19/l1a d9/da/l33 0 2024-02-15T18:27:05.779 INFO:tasks.workunit.client.1.smithi133.stdout:6/339: write d0/d5/f1b [955298,118438] 0 2024-02-15T18:27:05.780 INFO:tasks.workunit.client.1.smithi133.stdout:7/152: write d9/f2a [167703,31949] 0 2024-02-15T18:27:05.780 INFO:tasks.workunit.client.1.smithi133.stdout:4/182: symlink d2/d5/d2b/l41 0 2024-02-15T18:27:05.780 INFO:tasks.workunit.client.1.smithi133.stdout:6/340: creat d0/db/f70 x:0 0 0 2024-02-15T18:27:05.780 INFO:tasks.workunit.client.1.smithi133.stdout:6/341: stat d0/db/d29/d34/d5d/d40/l46 0 2024-02-15T18:27:05.781 INFO:tasks.workunit.client.1.smithi133.stdout:6/342: write d0/f14 [1145475,11570] 0 2024-02-15T18:27:05.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/153: mknod d9/d1d/c34 0 2024-02-15T18:27:05.782 INFO:tasks.workunit.client.1.smithi133.stdout:0/189: sync 2024-02-15T18:27:05.782 INFO:tasks.workunit.client.1.smithi133.stdout:4/183: rmdir d2/d5/d2b/d21/d3b/d3d 0 2024-02-15T18:27:05.783 INFO:tasks.workunit.client.1.smithi133.stdout:6/343: mknod d0/db/d21/c71 0 2024-02-15T18:27:05.783 INFO:tasks.workunit.client.1.smithi133.stdout:6/344: write d0/db/f33 [159339,74122] 0 2024-02-15T18:27:05.783 INFO:tasks.workunit.client.1.smithi133.stdout:6/345: fdatasync d0/db/d21/f6f 0 2024-02-15T18:27:05.784 INFO:tasks.workunit.client.1.smithi133.stdout:7/154: creat d9/db/dc/f35 x:0 0 0 2024-02-15T18:27:05.784 INFO:tasks.workunit.client.1.smithi133.stdout:1/420: dwrite d6/d1e/f21 [0,4194304] 0 2024-02-15T18:27:05.784 INFO:tasks.workunit.client.1.smithi133.stdout:7/155: chown d9/db/f27 28859208 1 2024-02-15T18:27:05.785 INFO:tasks.workunit.client.0.smithi084.stdout:5/605: sync 2024-02-15T18:27:05.785 INFO:tasks.workunit.client.0.smithi084.stdout:4/593: sync 2024-02-15T18:27:05.785 INFO:tasks.workunit.client.0.smithi084.stdout:5/606: truncate d9/f2c 1616008 0 2024-02-15T18:27:05.785 INFO:tasks.workunit.client.1.smithi133.stdout:0/190: getdents d9/d10/d19/d1a 0 2024-02-15T18:27:05.786 INFO:tasks.workunit.client.1.smithi133.stdout:6/346: creat d0/db/d21/f72 x:0 0 0 2024-02-15T18:27:05.787 INFO:tasks.workunit.client.0.smithi084.stdout:0/571: dread d0/d4/d1b/f3c [0,4194304] 0 2024-02-15T18:27:05.788 INFO:tasks.workunit.client.1.smithi133.stdout:1/421: mknod d6/d1e/d41/d7c/d7e/ca0 0 2024-02-15T18:27:05.788 INFO:tasks.workunit.client.0.smithi084.stdout:4/594: rename d2/d4/d25/c93 to d2/d2b/d47/d31/d62/d88/db0/cb3 0 2024-02-15T18:27:05.789 INFO:tasks.workunit.client.0.smithi084.stdout:4/595: write d2/d4/d28/d3d/f53 [3369239,129328] 0 2024-02-15T18:27:05.790 INFO:tasks.workunit.client.0.smithi084.stdout:5/607: unlink d9/d35/f6a 0 2024-02-15T18:27:05.791 INFO:tasks.workunit.client.1.smithi133.stdout:6/347: creat d0/db/d29/d34/f73 x:0 0 0 2024-02-15T18:27:05.794 INFO:tasks.workunit.client.0.smithi084.stdout:4/596: mkdir d2/d2b/d47/d31/d50/db4 0 2024-02-15T18:27:05.794 INFO:tasks.workunit.client.0.smithi084.stdout:5/608: link d9/da/d3d/d44/d55/c63 d9/d23/dac/cc2 0 2024-02-15T18:27:05.796 INFO:tasks.workunit.client.1.smithi133.stdout:4/184: dread d2/f1f [0,4194304] 0 2024-02-15T18:27:05.797 INFO:tasks.workunit.client.0.smithi084.stdout:5/609: creat d9/d5b/d7e/d92/fc3 x:0 0 0 2024-02-15T18:27:05.802 INFO:tasks.workunit.client.0.smithi084.stdout:5/610: symlink d9/lc4 0 2024-02-15T18:27:05.807 INFO:tasks.workunit.client.1.smithi133.stdout:7/156: rename d9/d1d to d9/d36 0 2024-02-15T18:27:05.811 INFO:tasks.workunit.client.1.smithi133.stdout:7/157: creat d9/d36/f37 x:0 0 0 2024-02-15T18:27:05.811 INFO:tasks.workunit.client.1.smithi133.stdout:0/191: dwrite d9/d1c/f1d [4194304,4194304] 0 2024-02-15T18:27:05.812 INFO:tasks.workunit.client.1.smithi133.stdout:0/192: readlink d9/d10/d22/d2f/l42 0 2024-02-15T18:27:05.812 INFO:tasks.workunit.client.0.smithi084.stdout:4/597: dread d2/d2b/d47/d31/f43 [0,4194304] 0 2024-02-15T18:27:05.813 INFO:tasks.workunit.client.0.smithi084.stdout:5/611: dread d9/d23/f47 [0,4194304] 0 2024-02-15T18:27:05.813 INFO:tasks.workunit.client.1.smithi133.stdout:7/158: unlink d9/da/l12 0 2024-02-15T18:27:05.814 INFO:tasks.workunit.client.1.smithi133.stdout:7/159: chown d9/d36/f37 3 1 2024-02-15T18:27:05.816 INFO:tasks.workunit.client.0.smithi084.stdout:5/612: rename d9/d35/l75 to d9/d5b/d7e/lc5 0 2024-02-15T18:27:05.816 INFO:tasks.workunit.client.0.smithi084.stdout:5/613: write d9/d5b/d7e/db5/fbd [950719,108300] 0 2024-02-15T18:27:05.816 INFO:tasks.workunit.client.0.smithi084.stdout:5/614: fdatasync d9/d5f/d68/f83 0 2024-02-15T18:27:05.816 INFO:tasks.workunit.client.0.smithi084.stdout:5/615: chown d9/da/cd 0 1 2024-02-15T18:27:05.818 INFO:tasks.workunit.client.0.smithi084.stdout:5/616: mkdir d9/dc6 0 2024-02-15T18:27:05.818 INFO:tasks.workunit.client.1.smithi133.stdout:6/348: dwrite d0/db/d29/d34/f73 [0,4194304] 0 2024-02-15T18:27:05.818 INFO:tasks.workunit.client.1.smithi133.stdout:7/160: mknod d9/c38 0 2024-02-15T18:27:05.819 INFO:tasks.workunit.client.1.smithi133.stdout:1/422: dwrite d6/d17/f18 [4194304,4194304] 0 2024-02-15T18:27:05.819 INFO:tasks.workunit.client.1.smithi133.stdout:1/423: read - d6/d2a/d59/d5a/f9b zero size 2024-02-15T18:27:05.819 INFO:tasks.workunit.client.1.smithi133.stdout:1/424: fdatasync d6/d1e/d3a/d75/f84 0 2024-02-15T18:27:05.819 INFO:tasks.workunit.client.0.smithi084.stdout:5/617: symlink d9/d5b/d7e/lc7 0 2024-02-15T18:27:05.819 INFO:tasks.workunit.client.0.smithi084.stdout:5/618: chown d9/da/d3d/d44/d55/d70/f8a 44 1 2024-02-15T18:27:05.821 INFO:tasks.workunit.client.0.smithi084.stdout:5/619: link d9/d23/f37 d9/fc8 0 2024-02-15T18:27:05.821 INFO:tasks.workunit.client.0.smithi084.stdout:4/598: dread d2/d4/f82 [0,4194304] 0 2024-02-15T18:27:05.822 INFO:tasks.workunit.client.0.smithi084.stdout:4/599: getdents d2/d4/d28/d3d/d5c/d65/d9f 0 2024-02-15T18:27:05.823 INFO:tasks.workunit.client.0.smithi084.stdout:5/620: getdents d9/da/d3d/d44 0 2024-02-15T18:27:05.826 INFO:tasks.workunit.client.1.smithi133.stdout:0/193: dwrite d9/ff [0,4194304] 0 2024-02-15T18:27:05.827 INFO:tasks.workunit.client.0.smithi084.stdout:4/600: mknod d2/d2b/d47/d31/d62/cb5 0 2024-02-15T18:27:05.827 INFO:tasks.workunit.client.0.smithi084.stdout:4/601: write d2/f17 [5009406,79487] 0 2024-02-15T18:27:05.827 INFO:tasks.workunit.client.0.smithi084.stdout:4/602: truncate d2/d4/d25/f51 4296193 0 2024-02-15T18:27:05.827 INFO:tasks.workunit.client.0.smithi084.stdout:4/603: stat d2/f34 0 2024-02-15T18:27:05.827 INFO:tasks.workunit.client.0.smithi084.stdout:4/604: chown d2/f84 495775 1 2024-02-15T18:27:05.827 INFO:tasks.workunit.client.0.smithi084.stdout:5/621: rmdir d9/da/d3d/d44 39 2024-02-15T18:27:05.827 INFO:tasks.workunit.client.1.smithi133.stdout:0/194: symlink d9/d10/d19/l43 0 2024-02-15T18:27:05.828 INFO:tasks.workunit.client.0.smithi084.stdout:5/622: mkdir d9/d23/dac/dc9 0 2024-02-15T18:27:05.830 INFO:tasks.workunit.client.0.smithi084.stdout:5/623: creat d9/d5f/da7/fca x:0 0 0 2024-02-15T18:27:05.835 INFO:tasks.workunit.client.1.smithi133.stdout:0/195: mkdir d9/d10/d22/d2f/d30/d44 0 2024-02-15T18:27:05.845 INFO:tasks.workunit.client.1.smithi133.stdout:1/425: dwrite d6/fe [4194304,4194304] 0 2024-02-15T18:27:05.845 INFO:tasks.workunit.client.1.smithi133.stdout:1/426: chown d6/d1e/c5b 372156 1 2024-02-15T18:27:05.845 INFO:tasks.workunit.client.1.smithi133.stdout:1/427: write d6/d17/f6e [116643,15158] 0 2024-02-15T18:27:05.847 INFO:tasks.workunit.client.1.smithi133.stdout:1/428: creat d6/d1e/d3a/d97/fa1 x:0 0 0 2024-02-15T18:27:05.848 INFO:tasks.workunit.client.1.smithi133.stdout:1/429: creat d6/d1e/d41/d7c/fa2 x:0 0 0 2024-02-15T18:27:05.851 INFO:tasks.workunit.client.1.smithi133.stdout:1/430: creat d6/d1e/d3a/d82/fa3 x:0 0 0 2024-02-15T18:27:05.852 INFO:tasks.workunit.client.1.smithi133.stdout:1/431: mkdir d6/d2a/d59/d5a/da4 0 2024-02-15T18:27:05.855 INFO:tasks.workunit.client.1.smithi133.stdout:1/432: write d6/d1e/d41/f46 [3739371,51899] 0 2024-02-15T18:27:05.855 INFO:tasks.workunit.client.1.smithi133.stdout:1/433: chown d6/f74 46 1 2024-02-15T18:27:05.857 INFO:tasks.workunit.client.1.smithi133.stdout:1/434: getdents d6/d1e/d3a/d82/d85 0 2024-02-15T18:27:05.860 INFO:tasks.workunit.client.1.smithi133.stdout:1/435: write d6/d17/f68 [7651,21480] 0 2024-02-15T18:27:05.861 INFO:tasks.workunit.client.1.smithi133.stdout:1/436: fsync d6/d17/f60 0 2024-02-15T18:27:05.861 INFO:tasks.workunit.client.1.smithi133.stdout:1/437: chown d6/d1e/d3a/d9e 50010543 1 2024-02-15T18:27:05.861 INFO:tasks.workunit.client.1.smithi133.stdout:1/438: write d6/d1e/d41/d7c/f9c [424752,42173] 0 2024-02-15T18:27:05.864 INFO:tasks.workunit.client.1.smithi133.stdout:1/439: write d6/d1e/f23 [1840213,64361] 0 2024-02-15T18:27:05.865 INFO:tasks.workunit.client.1.smithi133.stdout:1/440: creat d6/fa5 x:0 0 0 2024-02-15T18:27:05.865 INFO:tasks.workunit.client.1.smithi133.stdout:1/441: truncate d6/d1e/d3a/d82/d85/f45 2443836 0 2024-02-15T18:27:05.868 INFO:tasks.workunit.client.0.smithi084.stdout:4/605: dwrite d2/d2b/d47/d31/f86 [0,4194304] 0 2024-02-15T18:27:05.868 INFO:tasks.workunit.client.0.smithi084.stdout:4/606: chown d2/d2b/d47/d31/d50/d94 426661207 1 2024-02-15T18:27:05.869 INFO:tasks.workunit.client.1.smithi133.stdout:0/196: dwrite f4 [0,4194304] 0 2024-02-15T18:27:05.871 INFO:tasks.workunit.client.0.smithi084.stdout:4/607: creat d2/d4/d28/d2e/fb6 x:0 0 0 2024-02-15T18:27:05.872 INFO:tasks.workunit.client.0.smithi084.stdout:5/624: dwrite d9/da/d3d/fb9 [0,4194304] 0 2024-02-15T18:27:05.872 INFO:tasks.workunit.client.1.smithi133.stdout:7/161: dwrite d9/d36/f23 [4194304,4194304] 0 2024-02-15T18:27:05.873 INFO:tasks.workunit.client.1.smithi133.stdout:0/197: rename d9/d10/d19/f24 to d9/d2b/f45 0 2024-02-15T18:27:05.877 INFO:tasks.workunit.client.0.smithi084.stdout:5/625: link d9/da/d3d/d44/d55/d96/ca8 d9/da/d3d/d44/d55/d70/d84/da1/ccb 0 2024-02-15T18:27:05.877 INFO:tasks.workunit.client.0.smithi084.stdout:5/626: write d9/d5f/da7/fa9 [1529571,109908] 0 2024-02-15T18:27:05.877 INFO:tasks.workunit.client.0.smithi084.stdout:5/627: chown d9/d23/f37 0 1 2024-02-15T18:27:05.877 INFO:tasks.workunit.client.0.smithi084.stdout:5/628: dread - d9/d5b/d79/f87 zero size 2024-02-15T18:27:05.878 INFO:tasks.workunit.client.0.smithi084.stdout:5/629: dread d9/d5b/d7e/d92/f9e [0,4194304] 0 2024-02-15T18:27:05.878 INFO:tasks.workunit.client.0.smithi084.stdout:5/630: chown d9/da/l76 43590346 1 2024-02-15T18:27:05.883 INFO:tasks.workunit.client.0.smithi084.stdout:5/631: mkdir d9/d5f/dcc 0 2024-02-15T18:27:05.883 INFO:tasks.workunit.client.0.smithi084.stdout:5/632: chown d9/d35/lb8 14 1 2024-02-15T18:27:05.883 INFO:tasks.workunit.client.0.smithi084.stdout:5/633: truncate f8 4177484 0 2024-02-15T18:27:05.887 INFO:tasks.workunit.client.0.smithi084.stdout:5/634: link d9/d5b/d7e/d92/fb0 d9/d23/fcd 0 2024-02-15T18:27:05.889 INFO:tasks.workunit.client.0.smithi084.stdout:5/635: symlink d9/d35/lce 0 2024-02-15T18:27:05.891 INFO:tasks.workunit.client.0.smithi084.stdout:5/636: truncate d9/d5b/d7e/d92/fb0 3589945 0 2024-02-15T18:27:05.892 INFO:tasks.workunit.client.0.smithi084.stdout:5/637: symlink d9/da/d3d/d44/lcf 0 2024-02-15T18:27:05.892 INFO:tasks.workunit.client.0.smithi084.stdout:5/638: fsync d9/d5f/d68/d9a/d8d/f8f 0 2024-02-15T18:27:05.930 INFO:tasks.workunit.client.0.smithi084.stdout:4/608: dwrite d2/d64/d74/f7f [0,4194304] 0 2024-02-15T18:27:05.930 INFO:tasks.workunit.client.1.smithi133.stdout:1/442: dwrite d6/d17/f6e [0,4194304] 0 2024-02-15T18:27:05.930 INFO:tasks.workunit.client.1.smithi133.stdout:1/443: stat d6/d89/f81 0 2024-02-15T18:27:05.930 INFO:tasks.workunit.client.1.smithi133.stdout:7/162: dwrite d9/db/f2d [0,4194304] 0 2024-02-15T18:27:05.931 INFO:tasks.workunit.client.0.smithi084.stdout:5/639: dwrite d9/d23/fbe [0,4194304] 0 2024-02-15T18:27:05.931 INFO:tasks.workunit.client.1.smithi133.stdout:0/198: dwrite f7 [0,4194304] 0 2024-02-15T18:27:05.931 INFO:tasks.workunit.client.1.smithi133.stdout:1/444: mkdir d6/d1e/d3a/d82/d85/d67/da6 0 2024-02-15T18:27:05.932 INFO:tasks.workunit.client.1.smithi133.stdout:1/445: truncate d6/d2a/f40 1589723 0 2024-02-15T18:27:05.932 INFO:tasks.workunit.client.0.smithi084.stdout:4/609: link d2/d4/d28/f38 d2/d64/d74/fb7 0 2024-02-15T18:27:05.935 INFO:tasks.workunit.client.1.smithi133.stdout:9/186: sync 2024-02-15T18:27:05.935 INFO:tasks.workunit.client.1.smithi133.stdout:2/271: sync 2024-02-15T18:27:05.935 INFO:tasks.workunit.client.1.smithi133.stdout:3/273: sync 2024-02-15T18:27:05.935 INFO:tasks.workunit.client.1.smithi133.stdout:3/274: write d0/fc [3355289,117386] 0 2024-02-15T18:27:05.937 INFO:tasks.workunit.client.1.smithi133.stdout:0/199: link d9/l18 d9/d10/d2c/l46 0 2024-02-15T18:27:05.937 INFO:tasks.workunit.client.1.smithi133.stdout:0/200: chown d9/d10/f17 6774688 1 2024-02-15T18:27:05.938 INFO:tasks.workunit.client.0.smithi084.stdout:4/610: dread d2/d4/f82 [0,4194304] 0 2024-02-15T18:27:05.938 INFO:tasks.workunit.client.0.smithi084.stdout:4/611: rename d2/d2b/d47 to d2/d2b/d47/db8 22 2024-02-15T18:27:05.939 INFO:tasks.workunit.client.1.smithi133.stdout:1/446: getdents d6/d1e/d3a/d75 0 2024-02-15T18:27:05.939 INFO:tasks.workunit.client.1.smithi133.stdout:9/187: mkdir d0/d8/d9/d3c 0 2024-02-15T18:27:05.940 INFO:tasks.workunit.client.1.smithi133.stdout:9/188: truncate d0/d8/d10/f29 431545 0 2024-02-15T18:27:05.940 INFO:tasks.workunit.client.1.smithi133.stdout:9/189: truncate d0/d8/d9/f3b 79333 0 2024-02-15T18:27:05.940 INFO:tasks.workunit.client.1.smithi133.stdout:9/190: chown d0/d8/d10/c23 1 1 2024-02-15T18:27:05.940 INFO:tasks.workunit.client.0.smithi084.stdout:5/640: symlink d9/d5f/da7/ld0 0 2024-02-15T18:27:05.941 INFO:tasks.workunit.client.1.smithi133.stdout:9/191: read d0/d8/d10/f36 [1965695,52611] 0 2024-02-15T18:27:05.942 INFO:tasks.workunit.client.0.smithi084.stdout:4/612: rename d2/d64/d74/d8f/fa7 to d2/d2b/d47/d31/d50/db4/fb9 0 2024-02-15T18:27:05.942 INFO:tasks.workunit.client.0.smithi084.stdout:8/601: sync 2024-02-15T18:27:05.942 INFO:tasks.workunit.client.0.smithi084.stdout:3/499: sync 2024-02-15T18:27:05.942 INFO:tasks.workunit.client.0.smithi084.stdout:1/489: sync 2024-02-15T18:27:05.943 INFO:tasks.workunit.client.0.smithi084.stdout:1/490: chown d9/d54/d32/d5b/d69/fa3 66544 1 2024-02-15T18:27:05.943 INFO:tasks.workunit.client.0.smithi084.stdout:7/505: sync 2024-02-15T18:27:05.943 INFO:tasks.workunit.client.0.smithi084.stdout:9/621: sync 2024-02-15T18:27:05.943 INFO:tasks.workunit.client.0.smithi084.stdout:7/506: dread - df/d1d/d1a/d4b/f92 zero size 2024-02-15T18:27:05.943 INFO:tasks.workunit.client.0.smithi084.stdout:7/507: stat df/d1d/d1a/d6a/d8b/d48/l2a 0 2024-02-15T18:27:05.943 INFO:tasks.workunit.client.0.smithi084.stdout:7/508: chown df/d1d/d1a/f2d 462669 1 2024-02-15T18:27:05.944 INFO:tasks.workunit.client.1.smithi133.stdout:0/201: mkdir d9/d10/d47 0 2024-02-15T18:27:05.944 INFO:tasks.workunit.client.1.smithi133.stdout:3/275: rename d0/d15/d2b/d39/f51 to d0/d15/d37/f53 0 2024-02-15T18:27:05.944 INFO:tasks.workunit.client.1.smithi133.stdout:3/276: chown d0/c36 423691 1 2024-02-15T18:27:05.944 INFO:tasks.workunit.client.1.smithi133.stdout:3/277: truncate d0/d15/d2b/f41 185854 0 2024-02-15T18:27:05.944 INFO:tasks.workunit.client.1.smithi133.stdout:7/163: write d9/db/dc/f30 [4806969,59278] 0 2024-02-15T18:27:05.944 INFO:tasks.workunit.client.1.smithi133.stdout:1/447: rmdir d6/d17 39 2024-02-15T18:27:05.944 INFO:tasks.workunit.client.0.smithi084.stdout:1/491: read d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 [1724310,13894] 0 2024-02-15T18:27:05.945 INFO:tasks.workunit.client.0.smithi084.stdout:5/641: mkdir d9/d35/d65/d7f/dd1 0 2024-02-15T18:27:05.945 INFO:tasks.workunit.client.0.smithi084.stdout:5/642: read - d9/d5f/da7/fca zero size 2024-02-15T18:27:05.945 INFO:tasks.workunit.client.0.smithi084.stdout:8/602: link db/d1a/d2b/c44 db/d6a/cc6 0 2024-02-15T18:27:05.946 INFO:tasks.workunit.client.0.smithi084.stdout:9/622: mkdir d4/d2b/d3c/d20/d43/dc6 0 2024-02-15T18:27:05.946 INFO:tasks.workunit.client.1.smithi133.stdout:3/278: mkdir d0/d15/d54 0 2024-02-15T18:27:05.947 INFO:tasks.workunit.client.0.smithi084.stdout:7/509: creat df/d1d/d1a/f9d x:0 0 0 2024-02-15T18:27:05.947 INFO:tasks.workunit.client.0.smithi084.stdout:7/510: read df/d1d/d1a/d4d/f6f [86823,64672] 0 2024-02-15T18:27:05.947 INFO:tasks.workunit.client.1.smithi133.stdout:7/164: getdents d9/da 0 2024-02-15T18:27:05.948 INFO:tasks.workunit.client.0.smithi084.stdout:1/492: mkdir d9/d54/d1b/d2c/d4b/d4c/da9 0 2024-02-15T18:27:05.948 INFO:tasks.workunit.client.0.smithi084.stdout:1/493: stat d9/d54/d32 0 2024-02-15T18:27:05.949 INFO:tasks.workunit.client.0.smithi084.stdout:7/511: dread df/f4c [0,4194304] 0 2024-02-15T18:27:05.949 INFO:tasks.workunit.client.0.smithi084.stdout:7/512: write df/d1d/d1a/f64 [602261,52445] 0 2024-02-15T18:27:05.950 INFO:tasks.workunit.client.1.smithi133.stdout:3/279: creat d0/d15/d2b/d39/f55 x:0 0 0 2024-02-15T18:27:05.950 INFO:tasks.workunit.client.1.smithi133.stdout:3/280: write d0/d15/d2b/d39/d3f/f1a [1209834,35142] 0 2024-02-15T18:27:05.950 INFO:tasks.workunit.client.0.smithi084.stdout:5/643: link d9/d5f/d68/f83 d9/d5b/d7e/db5/fd2 0 2024-02-15T18:27:05.951 INFO:tasks.workunit.client.1.smithi133.stdout:1/448: symlink d6/d2a/d59/d5a/la7 0 2024-02-15T18:27:05.951 INFO:tasks.workunit.client.1.smithi133.stdout:1/449: stat d6/d1e/d3a/d82/d85/l6b 0 2024-02-15T18:27:05.951 INFO:tasks.workunit.client.1.smithi133.stdout:1/450: dread - d6/d17/f3c zero size 2024-02-15T18:27:05.951 INFO:tasks.workunit.client.1.smithi133.stdout:1/451: chown d6/d1e/f88 4065509 1 2024-02-15T18:27:05.952 INFO:tasks.workunit.client.0.smithi084.stdout:8/603: symlink db/lc7 0 2024-02-15T18:27:05.952 INFO:tasks.workunit.client.0.smithi084.stdout:8/604: write db/dd/d1f/d66/da2/fac [895276,58295] 0 2024-02-15T18:27:05.952 INFO:tasks.workunit.client.1.smithi133.stdout:9/192: dread d0/d8/d10/f14 [0,4194304] 0 2024-02-15T18:27:05.952 INFO:tasks.workunit.client.0.smithi084.stdout:9/623: getdents d4/d81 0 2024-02-15T18:27:05.953 INFO:tasks.workunit.client.1.smithi133.stdout:1/452: symlink d6/d89/la8 0 2024-02-15T18:27:05.954 INFO:tasks.workunit.client.0.smithi084.stdout:9/624: write d4/d2b/d3c/d20/f5a [3631173,106935] 0 2024-02-15T18:27:05.954 INFO:tasks.workunit.client.0.smithi084.stdout:1/494: mknod d9/d54/d76/caa 0 2024-02-15T18:27:05.956 INFO:tasks.workunit.client.1.smithi133.stdout:9/193: truncate d0/f16 137874 0 2024-02-15T18:27:05.956 INFO:tasks.workunit.client.1.smithi133.stdout:1/453: symlink d6/d1e/d3a/d82/d85/d67/da6/la9 0 2024-02-15T18:27:05.956 INFO:tasks.workunit.client.0.smithi084.stdout:7/513: link df/d1d/d1a/d4d/d55/l68 df/d1d/d1a/d4b/l9e 0 2024-02-15T18:27:05.956 INFO:tasks.workunit.client.0.smithi084.stdout:7/514: fdatasync df/f3b 0 2024-02-15T18:27:05.958 INFO:tasks.workunit.client.1.smithi133.stdout:9/194: symlink d0/d8/l3d 0 2024-02-15T18:27:05.959 INFO:tasks.workunit.client.0.smithi084.stdout:8/605: link db/dd/d1f/l82 db/daf/lc8 0 2024-02-15T18:27:05.960 INFO:tasks.workunit.client.0.smithi084.stdout:9/625: creat d4/d3d/da5/fc7 x:0 0 0 2024-02-15T18:27:05.960 INFO:tasks.workunit.client.0.smithi084.stdout:9/626: readlink d4/l9a 0 2024-02-15T18:27:05.960 INFO:tasks.workunit.client.0.smithi084.stdout:9/627: chown d4/d3d/l92 117026 1 2024-02-15T18:27:05.960 INFO:tasks.workunit.client.0.smithi084.stdout:7/515: rename df/c29 to df/d1d/d44/d8d/c9f 0 2024-02-15T18:27:05.960 INFO:tasks.workunit.client.0.smithi084.stdout:4/613: dread d2/d2b/d47/d31/f86 [0,4194304] 0 2024-02-15T18:27:05.962 INFO:tasks.workunit.client.0.smithi084.stdout:8/606: symlink db/dd/d1f/d66/lc9 0 2024-02-15T18:27:05.962 INFO:tasks.workunit.client.1.smithi133.stdout:2/272: dwrite d7/d2c/d3b/f4d [0,4194304] 0 2024-02-15T18:27:05.963 INFO:tasks.workunit.client.0.smithi084.stdout:9/628: creat d4/d2b/d3c/d20/d75/d87/fc8 x:0 0 0 2024-02-15T18:27:05.965 INFO:tasks.workunit.client.1.smithi133.stdout:0/202: getdents d9/d10 0 2024-02-15T18:27:05.965 INFO:tasks.workunit.client.0.smithi084.stdout:7/516: creat df/d1d/d1a/d4d/d55/fa0 x:0 0 0 2024-02-15T18:27:05.966 INFO:tasks.workunit.client.0.smithi084.stdout:9/629: dread d4/d81/f89 [0,4194304] 0 2024-02-15T18:27:05.967 INFO:tasks.workunit.client.0.smithi084.stdout:4/614: symlink d2/d4/d28/d3d/d5c/d5d/lba 0 2024-02-15T18:27:05.976 INFO:tasks.workunit.client.0.smithi084.stdout:8/607: creat db/dd/d1f/d3e/fca x:0 0 0 2024-02-15T18:27:05.976 INFO:tasks.workunit.client.0.smithi084.stdout:8/608: write db/f3a [167163,20874] 0 2024-02-15T18:27:05.976 INFO:tasks.workunit.client.0.smithi084.stdout:8/609: write db/d3f/d59/f3b [1359918,54605] 0 2024-02-15T18:27:05.977 INFO:tasks.workunit.client.0.smithi084.stdout:8/610: chown db/c1b 290 1 2024-02-15T18:27:05.978 INFO:tasks.workunit.client.0.smithi084.stdout:4/615: mknod d2/d4/d28/d71/cbb 0 2024-02-15T18:27:05.980 INFO:tasks.workunit.client.0.smithi084.stdout:8/611: rename db/dd/c17 to db/dd/d1f/ccb 0 2024-02-15T18:27:05.980 INFO:tasks.workunit.client.0.smithi084.stdout:8/612: fdatasync db/d6a/f9c 0 2024-02-15T18:27:05.981 INFO:tasks.workunit.client.0.smithi084.stdout:8/613: read db/f25 [3039533,60584] 0 2024-02-15T18:27:05.981 INFO:tasks.workunit.client.0.smithi084.stdout:8/614: fdatasync db/d1a/f1d 0 2024-02-15T18:27:05.982 INFO:tasks.workunit.client.1.smithi133.stdout:0/203: dread f4 [0,4194304] 0 2024-02-15T18:27:05.982 INFO:tasks.workunit.client.1.smithi133.stdout:7/165: dread d9/db/f2d [0,4194304] 0 2024-02-15T18:27:05.982 INFO:tasks.workunit.client.0.smithi084.stdout:3/500: dwrite d8/d40/d58/f83 [0,4194304] 0 2024-02-15T18:27:05.983 INFO:tasks.workunit.client.0.smithi084.stdout:4/616: rename d2/d2b/d47/d31/d62 to d2/d4/d28/d3d/d5c/dbc 0 2024-02-15T18:27:05.983 INFO:tasks.workunit.client.0.smithi084.stdout:3/501: rename d8 to d8/d40/d43/d71/dab 22 2024-02-15T18:27:05.984 INFO:tasks.workunit.client.1.smithi133.stdout:7/166: mkdir d9/d36/d39 0 2024-02-15T18:27:05.986 INFO:tasks.workunit.client.1.smithi133.stdout:0/204: creat d9/d10/d22/d32/f48 x:0 0 0 2024-02-15T18:27:05.987 INFO:tasks.workunit.client.0.smithi084.stdout:8/615: rmdir db/dd/d4d/d97 39 2024-02-15T18:27:05.987 INFO:tasks.workunit.client.0.smithi084.stdout:8/616: fsync db/f74 0 2024-02-15T18:27:05.988 INFO:tasks.workunit.client.1.smithi133.stdout:9/195: dread d0/f20 [0,4194304] 0 2024-02-15T18:27:05.990 INFO:tasks.workunit.client.0.smithi084.stdout:4/617: unlink d2/d64/d74/d8f/l95 0 2024-02-15T18:27:05.991 INFO:tasks.workunit.client.1.smithi133.stdout:3/281: dwrite d0/d15/f16 [0,4194304] 0 2024-02-15T18:27:05.991 INFO:tasks.workunit.client.1.smithi133.stdout:2/273: dread d7/f13 [4194304,4194304] 0 2024-02-15T18:27:05.991 INFO:tasks.workunit.client.0.smithi084.stdout:8/617: mkdir db/dd/dcc 0 2024-02-15T18:27:05.997 INFO:tasks.workunit.client.1.smithi133.stdout:9/196: dread d0/f16 [0,4194304] 0 2024-02-15T18:27:05.997 INFO:tasks.workunit.client.1.smithi133.stdout:9/197: stat d0/l35 0 2024-02-15T18:27:05.997 INFO:tasks.workunit.client.1.smithi133.stdout:3/282: getdents d0/d15/d37/d4a 0 2024-02-15T18:27:05.998 INFO:tasks.workunit.client.1.smithi133.stdout:2/274: truncate d7/f13 4067118 0 2024-02-15T18:27:06.000 INFO:tasks.workunit.client.0.smithi084.stdout:7/517: dwrite df/d1d/d1a/d4b/f50 [0,4194304] 0 2024-02-15T18:27:06.000 INFO:tasks.workunit.client.0.smithi084.stdout:7/518: write df/d1d/d1a/f75 [800753,64425] 0 2024-02-15T18:27:06.001 INFO:tasks.workunit.client.1.smithi133.stdout:3/283: rename d0/d15/d37/l4f to d0/d15/d2b/l56 0 2024-02-15T18:27:06.001 INFO:tasks.workunit.client.1.smithi133.stdout:3/284: fsync d0/d15/d37/f40 0 2024-02-15T18:27:06.004 INFO:tasks.workunit.client.1.smithi133.stdout:2/275: write d7/d18/f40 [980679,15860] 0 2024-02-15T18:27:06.007 INFO:tasks.workunit.client.1.smithi133.stdout:2/276: creat d7/db/d35/d4a/d54/f57 x:0 0 0 2024-02-15T18:27:06.007 INFO:tasks.workunit.client.1.smithi133.stdout:2/277: chown d7/d18/l1a 8618773 1 2024-02-15T18:27:06.007 INFO:tasks.workunit.client.1.smithi133.stdout:3/285: write d0/d15/f24 [3253458,48134] 0 2024-02-15T18:27:06.009 INFO:tasks.workunit.client.1.smithi133.stdout:3/286: truncate d0/f2d 348117 0 2024-02-15T18:27:06.009 INFO:tasks.workunit.client.1.smithi133.stdout:3/287: write d0/d15/d37/d4a/f4c [480947,10365] 0 2024-02-15T18:27:06.009 INFO:tasks.workunit.client.1.smithi133.stdout:2/278: mkdir d7/db/d35/d4a/d58 0 2024-02-15T18:27:06.010 INFO:tasks.workunit.client.0.smithi084.stdout:7/519: creat df/d1d/d1a/d4d/d55/fa1 x:0 0 0 2024-02-15T18:27:06.011 INFO:tasks.workunit.client.1.smithi133.stdout:3/288: creat d0/d15/d2b/f57 x:0 0 0 2024-02-15T18:27:06.011 INFO:tasks.workunit.client.1.smithi133.stdout:3/289: write d0/d15/d37/f53 [229088,15652] 0 2024-02-15T18:27:06.011 INFO:tasks.workunit.client.1.smithi133.stdout:3/290: dread - d0/f50 zero size 2024-02-15T18:27:06.011 INFO:tasks.workunit.client.1.smithi133.stdout:3/291: chown d0/d15/c1f 55 1 2024-02-15T18:27:06.011 INFO:tasks.workunit.client.1.smithi133.stdout:3/292: chown d0/d15/d2b/d39/d3f/f1a 1898 1 2024-02-15T18:27:06.012 INFO:tasks.workunit.client.0.smithi084.stdout:7/520: mknod df/d1d/d44/d8d/ca2 0 2024-02-15T18:27:06.012 INFO:tasks.workunit.client.0.smithi084.stdout:7/521: write df/d70/f6d [1039356,97103] 0 2024-02-15T18:27:06.012 INFO:tasks.workunit.client.0.smithi084.stdout:7/522: dread - df/d1d/d1a/d4d/d55/fa1 zero size 2024-02-15T18:27:06.012 INFO:tasks.workunit.client.0.smithi084.stdout:4/618: write d2/d64/d74/f7f [2901176,105893] 0 2024-02-15T18:27:06.013 INFO:tasks.workunit.client.0.smithi084.stdout:7/523: creat df/d1d/d1a/d4d/d55/fa3 x:0 0 0 2024-02-15T18:27:06.014 INFO:tasks.workunit.client.0.smithi084.stdout:7/524: mknod df/d1d/ca4 0 2024-02-15T18:27:06.015 INFO:tasks.workunit.client.1.smithi133.stdout:3/293: unlink d0/d15/d2b/d39/d3f/f1a 0 2024-02-15T18:27:06.017 INFO:tasks.workunit.client.1.smithi133.stdout:3/294: link d0/d15/d2b/d39/d3f/f22 d0/d15/d2b/f58 0 2024-02-15T18:27:06.018 INFO:tasks.workunit.client.1.smithi133.stdout:3/295: chown d0 209610979 1 2024-02-15T18:27:06.019 INFO:tasks.workunit.client.1.smithi133.stdout:3/296: creat d0/d15/d37/f59 x:0 0 0 2024-02-15T18:27:06.019 INFO:tasks.workunit.client.1.smithi133.stdout:3/297: chown d0/d15/d2b/d39/d3f/f20 26945 1 2024-02-15T18:27:06.020 INFO:tasks.workunit.client.1.smithi133.stdout:3/298: creat d0/d15/d37/f5a x:0 0 0 2024-02-15T18:27:06.020 INFO:tasks.workunit.client.1.smithi133.stdout:3/299: readlink d0/d15/l35 0 2024-02-15T18:27:06.022 INFO:tasks.workunit.client.1.smithi133.stdout:3/300: rename d0/d15/d37/f5a to d0/d15/d54/f5b 0 2024-02-15T18:27:06.025 INFO:tasks.workunit.client.0.smithi084.stdout:7/525: dread df/d1d/d1a/d4d/d55/f7a [0,4194304] 0 2024-02-15T18:27:06.027 INFO:tasks.workunit.client.0.smithi084.stdout:7/526: write df/d1d/d1a/f60 [2594825,86336] 0 2024-02-15T18:27:06.028 INFO:tasks.workunit.client.0.smithi084.stdout:9/630: dwrite d4/d3d/f7e [0,4194304] 0 2024-02-15T18:27:06.029 INFO:tasks.workunit.client.0.smithi084.stdout:9/631: write d4/d2b/d3c/f49 [301751,88273] 0 2024-02-15T18:27:06.029 INFO:tasks.workunit.client.0.smithi084.stdout:3/502: dwrite d8/d40/f59 [0,4194304] 0 2024-02-15T18:27:06.029 INFO:tasks.workunit.client.0.smithi084.stdout:3/503: chown d8/d40/d43/f8b 1915 1 2024-02-15T18:27:06.029 INFO:tasks.workunit.client.0.smithi084.stdout:3/504: fdatasync d8/d22/f34 0 2024-02-15T18:27:06.031 INFO:tasks.workunit.client.1.smithi133.stdout:0/205: dwrite d9/d10/d19/f3d [0,4194304] 0 2024-02-15T18:27:06.032 INFO:tasks.workunit.client.0.smithi084.stdout:8/618: dwrite db/d3f/d59/f28 [0,4194304] 0 2024-02-15T18:27:06.032 INFO:tasks.workunit.client.1.smithi133.stdout:9/198: dwrite d0/d8/d10/f30 [0,4194304] 0 2024-02-15T18:27:06.032 INFO:tasks.workunit.client.1.smithi133.stdout:7/167: dwrite d9/d36/f2e [0,4194304] 0 2024-02-15T18:27:06.033 INFO:tasks.workunit.client.0.smithi084.stdout:7/527: mkdir df/d1d/d1a/d6a/d8b/da5 0 2024-02-15T18:27:06.036 INFO:tasks.workunit.client.1.smithi133.stdout:7/168: write d9/d36/f2e [1114108,26406] 0 2024-02-15T18:27:06.037 INFO:tasks.workunit.client.0.smithi084.stdout:3/505: creat d8/fac x:0 0 0 2024-02-15T18:27:06.038 INFO:tasks.workunit.client.0.smithi084.stdout:3/506: read d8/d40/f59 [1657557,22846] 0 2024-02-15T18:27:06.039 INFO:tasks.workunit.client.1.smithi133.stdout:0/206: symlink d9/d10/l49 0 2024-02-15T18:27:06.039 INFO:tasks.workunit.client.0.smithi084.stdout:7/528: rename df/d1d/d44/f54 to df/fa6 0 2024-02-15T18:27:06.040 INFO:tasks.workunit.client.1.smithi133.stdout:2/279: rmdir d7 39 2024-02-15T18:27:06.040 INFO:tasks.workunit.client.0.smithi084.stdout:3/507: symlink d8/d1f/d2d/lad 0 2024-02-15T18:27:06.042 INFO:tasks.workunit.client.1.smithi133.stdout:9/199: rmdir d0/d8/d9 39 2024-02-15T18:27:06.043 INFO:tasks.workunit.client.0.smithi084.stdout:7/529: unlink df/d1d/d44/d8d/ca2 0 2024-02-15T18:27:06.045 INFO:tasks.workunit.client.1.smithi133.stdout:7/169: link d9/d36/f2e d9/db/d16/f3a 0 2024-02-15T18:27:06.046 INFO:tasks.workunit.client.1.smithi133.stdout:0/207: creat d9/d28/f4a x:0 0 0 2024-02-15T18:27:06.046 INFO:tasks.workunit.client.1.smithi133.stdout:0/208: chown d9/d10/d22/d32/f40 106690614 1 2024-02-15T18:27:06.048 INFO:tasks.workunit.client.1.smithi133.stdout:9/200: symlink d0/d8/l3e 0 2024-02-15T18:27:06.050 INFO:tasks.workunit.client.1.smithi133.stdout:9/201: read d0/d8/d10/f15 [567287,76044] 0 2024-02-15T18:27:06.050 INFO:tasks.workunit.client.1.smithi133.stdout:9/202: chown d0/d8/d10/f2f 0 1 2024-02-15T18:27:06.052 INFO:tasks.workunit.client.1.smithi133.stdout:9/203: creat d0/d8/d9/d12/f3f x:0 0 0 2024-02-15T18:27:06.055 INFO:tasks.workunit.client.1.smithi133.stdout:9/204: truncate d0/d8/d9/d12/d2a/f2e 1846062 0 2024-02-15T18:27:06.055 INFO:tasks.workunit.client.1.smithi133.stdout:9/205: write d0/d8/d10/f2f [2353,10461] 0 2024-02-15T18:27:06.057 INFO:tasks.workunit.client.0.smithi084.stdout:4/619: dwrite d2/d64/d74/f7f [4194304,4194304] 0 2024-02-15T18:27:06.058 INFO:tasks.workunit.client.0.smithi084.stdout:4/620: rmdir d2/d2b/d47/d31/d50/db4 39 2024-02-15T18:27:06.064 INFO:tasks.workunit.client.0.smithi084.stdout:4/621: truncate d2/d4/fd 5836273 0 2024-02-15T18:27:06.066 INFO:tasks.workunit.client.1.smithi133.stdout:7/170: rmdir d9/db/d16 39 2024-02-15T18:27:06.068 INFO:tasks.workunit.client.1.smithi133.stdout:7/171: creat d9/da/f3b x:0 0 0 2024-02-15T18:27:06.068 INFO:tasks.workunit.client.1.smithi133.stdout:7/172: write d9/db/d16/f3a [4196465,37848] 0 2024-02-15T18:27:06.069 INFO:tasks.workunit.client.1.smithi133.stdout:7/173: creat d9/db/f3c x:0 0 0 2024-02-15T18:27:06.069 INFO:tasks.workunit.client.1.smithi133.stdout:7/174: chown d9/db/f11 13 1 2024-02-15T18:27:06.070 INFO:tasks.workunit.client.1.smithi133.stdout:7/175: stat d9/db/ce 0 2024-02-15T18:27:06.070 INFO:tasks.workunit.client.1.smithi133.stdout:7/176: write d9/db/dc/f35 [494445,33668] 0 2024-02-15T18:27:06.075 INFO:tasks.workunit.client.0.smithi084.stdout:6/540: sync 2024-02-15T18:27:06.077 INFO:tasks.workunit.client.0.smithi084.stdout:2/533: sync 2024-02-15T18:27:06.078 INFO:tasks.workunit.client.0.smithi084.stdout:2/534: symlink d3/d5/d1a/d2d/lb3 0 2024-02-15T18:27:06.078 INFO:tasks.workunit.client.0.smithi084.stdout:2/535: write d3/d5/f22 [765574,56104] 0 2024-02-15T18:27:06.079 INFO:tasks.workunit.client.0.smithi084.stdout:2/536: chown d3/d5/d1a/d1e/d47/c57 1397276 1 2024-02-15T18:27:06.080 INFO:tasks.workunit.client.0.smithi084.stdout:2/537: creat d3/d19/d24/d91/fb4 x:0 0 0 2024-02-15T18:27:06.080 INFO:tasks.workunit.client.0.smithi084.stdout:6/541: write f10 [5663743,69013] 0 2024-02-15T18:27:06.081 INFO:tasks.workunit.client.1.smithi133.stdout:9/206: dwrite d0/d8/d9/f31 [0,4194304] 0 2024-02-15T18:27:06.081 INFO:tasks.workunit.client.1.smithi133.stdout:9/207: chown d0/d8/d9/d12/d2a 45 1 2024-02-15T18:27:06.082 INFO:tasks.workunit.client.0.smithi084.stdout:2/538: mkdir d3/d5/d1a/d1e/d47/d76/db5 0 2024-02-15T18:27:06.082 INFO:tasks.workunit.client.0.smithi084.stdout:6/542: mkdir d14/d22/d25/d2f/da9/d9b/dac 0 2024-02-15T18:27:06.082 INFO:tasks.workunit.client.0.smithi084.stdout:2/539: stat d3/d5/d1a/d1e/l1f 0 2024-02-15T18:27:06.082 INFO:tasks.workunit.client.0.smithi084.stdout:2/540: chown d3/d28 560 1 2024-02-15T18:27:06.082 INFO:tasks.workunit.client.0.smithi084.stdout:2/541: truncate d3/d19/d24/f44 4963452 0 2024-02-15T18:27:06.083 INFO:tasks.workunit.client.1.smithi133.stdout:9/208: creat d0/d8/d9/d12/d2a/f40 x:0 0 0 2024-02-15T18:27:06.083 INFO:tasks.workunit.client.0.smithi084.stdout:6/543: getdents d14/d22/d25/d2f/d31/d30 0 2024-02-15T18:27:06.084 INFO:tasks.workunit.client.0.smithi084.stdout:6/544: readlink l2 0 2024-02-15T18:27:06.084 INFO:tasks.workunit.client.0.smithi084.stdout:3/508: dwrite d8/d73/f9f [0,4194304] 0 2024-02-15T18:27:06.087 INFO:tasks.workunit.client.0.smithi084.stdout:6/545: link d14/d22/d25/d2f/c5f d14/d22/d25/d2f/d31/cad 0 2024-02-15T18:27:06.087 INFO:tasks.workunit.client.0.smithi084.stdout:6/546: chown d14/d22/d25/d2f/d31/d30/d4f/c58 0 1 2024-02-15T18:27:06.089 INFO:tasks.workunit.client.0.smithi084.stdout:3/509: symlink d8/d73/lae 0 2024-02-15T18:27:06.091 INFO:tasks.workunit.client.0.smithi084.stdout:6/547: creat d14/d22/d25/d41/d43/d97/fae x:0 0 0 2024-02-15T18:27:06.092 INFO:tasks.workunit.client.0.smithi084.stdout:4/622: dwrite d2/d2b/f60 [0,4194304] 0 2024-02-15T18:27:06.092 INFO:tasks.workunit.client.0.smithi084.stdout:4/623: chown d2/d4/d28/d3d/f53 29413019 1 2024-02-15T18:27:06.095 INFO:tasks.workunit.client.0.smithi084.stdout:3/510: mknod d8/d40/d43/d71/d8c/d94/da3/caf 0 2024-02-15T18:27:06.096 INFO:tasks.workunit.client.0.smithi084.stdout:6/548: symlink d14/d22/d25/d2f/d31/d30/d45/laf 0 2024-02-15T18:27:06.097 INFO:tasks.workunit.client.1.smithi133.stdout:2/280: dwrite f1 [4194304,4194304] 0 2024-02-15T18:27:06.097 INFO:tasks.workunit.client.1.smithi133.stdout:3/301: dwrite d0/d15/d37/f53 [0,4194304] 0 2024-02-15T18:27:06.099 INFO:tasks.workunit.client.0.smithi084.stdout:3/511: mknod d8/d40/d43/cb0 0 2024-02-15T18:27:06.099 INFO:tasks.workunit.client.1.smithi133.stdout:2/281: read d7/ff [1927605,113936] 0 2024-02-15T18:27:06.100 INFO:tasks.workunit.client.0.smithi084.stdout:6/549: mknod d14/d22/d25/d2f/d31/d30/d45/cb0 0 2024-02-15T18:27:06.101 INFO:tasks.workunit.client.0.smithi084.stdout:6/550: write d14/d22/d25/d2f/d31/d30/d4f/fa3 [89326,22049] 0 2024-02-15T18:27:06.101 INFO:tasks.workunit.client.0.smithi084.stdout:3/512: mkdir d8/d40/db1 0 2024-02-15T18:27:06.103 INFO:tasks.workunit.client.0.smithi084.stdout:6/551: rename d14/d22/d25/d2f/c8c to d14/d22/d25/d2f/d31/d3f/cb1 0 2024-02-15T18:27:06.104 INFO:tasks.workunit.client.1.smithi133.stdout:3/302: getdents d0/d15/d37 0 2024-02-15T18:27:06.106 INFO:tasks.workunit.client.0.smithi084.stdout:6/552: mknod d14/d22/d25/d2f/cb2 0 2024-02-15T18:27:06.107 INFO:tasks.workunit.client.1.smithi133.stdout:3/303: unlink d0/d15/d2b/l33 0 2024-02-15T18:27:06.109 INFO:tasks.workunit.client.0.smithi084.stdout:6/553: getdents d14/d22/d25/d2f/d31/d30/d4f/d7f 0 2024-02-15T18:27:06.109 INFO:tasks.workunit.client.0.smithi084.stdout:6/554: fsync d14/d22/d25/f44 0 2024-02-15T18:27:06.111 INFO:tasks.workunit.client.0.smithi084.stdout:6/555: link d14/d22/d25/d28/f2a d14/d22/d25/d2f/d31/d30/d45/d52/fb3 0 2024-02-15T18:27:06.112 INFO:tasks.workunit.client.0.smithi084.stdout:6/556: write d14/d22/d25/d2f/d31/d3f/d4a/f8d [843691,127434] 0 2024-02-15T18:27:06.113 INFO:tasks.workunit.client.1.smithi133.stdout:2/282: dread d7/d2c/d3b/f4d [0,4194304] 0 2024-02-15T18:27:06.114 INFO:tasks.workunit.client.0.smithi084.stdout:6/557: creat d14/d22/d25/d41/fb4 x:0 0 0 2024-02-15T18:27:06.118 INFO:tasks.workunit.client.0.smithi084.stdout:6/558: creat d14/d22/d25/d2f/d31/d30/d4f/d7f/fb5 x:0 0 0 2024-02-15T18:27:06.119 INFO:tasks.workunit.client.0.smithi084.stdout:6/559: write d14/d22/d25/d2f/d31/d30/d45/d52/f53 [627426,58563] 0 2024-02-15T18:27:06.122 INFO:tasks.workunit.client.1.smithi133.stdout:9/209: dwrite d0/d8/d10/f29 [0,4194304] 0 2024-02-15T18:27:06.122 INFO:tasks.workunit.client.0.smithi084.stdout:2/542: dwrite d3/d5/d1a/d1e/d30/f67 [0,4194304] 0 2024-02-15T18:27:06.122 INFO:tasks.workunit.client.0.smithi084.stdout:2/543: read - d3/d19/f6f zero size 2024-02-15T18:27:06.122 INFO:tasks.workunit.client.0.smithi084.stdout:2/544: truncate d3/d5/d1a/d1e/d47/d76/fa2 709875 0 2024-02-15T18:27:06.122 INFO:tasks.workunit.client.0.smithi084.stdout:6/560: link d14/d22/d25/d2f/d31/d30/d45/d54/f88 d14/d22/d25/d2f/d31/d30/d45/d52/d8a/fb6 0 2024-02-15T18:27:06.125 INFO:tasks.workunit.client.1.smithi133.stdout:9/210: creat d0/d8/d9/f41 x:0 0 0 2024-02-15T18:27:06.125 INFO:tasks.workunit.client.0.smithi084.stdout:2/545: unlink d3/d19/d24/f44 0 2024-02-15T18:27:06.125 INFO:tasks.workunit.client.0.smithi084.stdout:2/546: stat d3/d5/d1a/d1e/d47/d76 0 2024-02-15T18:27:06.125 INFO:tasks.workunit.client.0.smithi084.stdout:6/561: write d14/d22/d25/d2f/d31/d30/d45/d54/f88 [6285402,25760] 0 2024-02-15T18:27:06.126 INFO:tasks.workunit.client.0.smithi084.stdout:2/547: rmdir d3/d5/d1a/d1e/d4b/da6 39 2024-02-15T18:27:06.128 INFO:tasks.workunit.client.0.smithi084.stdout:2/548: unlink d3/d5/d1a/d1e/d4b/c79 0 2024-02-15T18:27:06.128 INFO:tasks.workunit.client.0.smithi084.stdout:2/549: stat d3/d5/d1a/f4e 0 2024-02-15T18:27:06.146 INFO:tasks.workunit.client.0.smithi084.stdout:0/572: sync 2024-02-15T18:27:06.148 INFO:tasks.workunit.client.0.smithi084.stdout:0/573: creat d0/d2f/d3f/d4c/faf x:0 0 0 2024-02-15T18:27:06.148 INFO:tasks.workunit.client.0.smithi084.stdout:0/574: write d0/d2f/d3f/f17 [803391,103435] 0 2024-02-15T18:27:06.148 INFO:tasks.workunit.client.0.smithi084.stdout:0/575: chown d0/d2f/d3f/f17 2 1 2024-02-15T18:27:06.148 INFO:tasks.workunit.client.0.smithi084.stdout:0/576: fsync d0/f99 0 2024-02-15T18:27:06.148 INFO:tasks.workunit.client.1.smithi133.stdout:5/203: sync 2024-02-15T18:27:06.148 INFO:tasks.workunit.client.1.smithi133.stdout:6/349: sync 2024-02-15T18:27:06.148 INFO:tasks.workunit.client.1.smithi133.stdout:4/185: sync 2024-02-15T18:27:06.149 INFO:tasks.workunit.client.0.smithi084.stdout:0/577: mkdir d0/d2f/d4b/dae/db0 0 2024-02-15T18:27:06.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/204: rename d17/c1b to d17/d20/d32/c40 0 2024-02-15T18:27:06.149 INFO:tasks.workunit.client.1.smithi133.stdout:6/350: mknod d0/db/d29/d34/d5d/c74 0 2024-02-15T18:27:06.150 INFO:tasks.workunit.client.0.smithi084.stdout:0/578: mkdir d0/d39/d90/db1 0 2024-02-15T18:27:06.150 INFO:tasks.workunit.client.1.smithi133.stdout:4/186: truncate d2/d5/d2b/fe 345529 0 2024-02-15T18:27:06.150 INFO:tasks.workunit.client.1.smithi133.stdout:4/187: write d2/d5/d2b/d21/d2d/f3c [384991,109886] 0 2024-02-15T18:27:06.153 INFO:tasks.workunit.client.0.smithi084.stdout:4/624: dwrite d2/d4/d28/d3d/d5c/d65/f76 [0,4194304] 0 2024-02-15T18:27:06.155 INFO:tasks.workunit.client.0.smithi084.stdout:3/513: dwrite d8/f12 [0,4194304] 0 2024-02-15T18:27:06.155 INFO:tasks.workunit.client.0.smithi084.stdout:3/514: chown d8/c19 0 1 2024-02-15T18:27:06.156 INFO:tasks.workunit.client.0.smithi084.stdout:4/625: write d2/d4/d28/f4b [140795,73274] 0 2024-02-15T18:27:06.156 INFO:tasks.workunit.client.0.smithi084.stdout:0/579: truncate d0/d2f/d3f/f30 1486243 0 2024-02-15T18:27:06.156 INFO:tasks.workunit.client.0.smithi084.stdout:4/626: write d2/d2b/f3e [2068669,10388] 0 2024-02-15T18:27:06.157 INFO:tasks.workunit.client.1.smithi133.stdout:2/283: dwrite d7/d2c/d31/f4b [4194304,4194304] 0 2024-02-15T18:27:06.157 INFO:tasks.workunit.client.1.smithi133.stdout:9/211: dwrite d0/f7 [4194304,4194304] 0 2024-02-15T18:27:06.157 INFO:tasks.workunit.client.1.smithi133.stdout:9/212: fdatasync d0/d8/d9/ff 0 2024-02-15T18:27:06.157 INFO:tasks.workunit.client.0.smithi084.stdout:3/515: write d8/d40/f59 [734283,6608] 0 2024-02-15T18:27:06.159 INFO:tasks.workunit.client.0.smithi084.stdout:2/550: dwrite d3/d5/d1a/d1e/d4b/da6/d5c/f5f [0,4194304] 0 2024-02-15T18:27:06.161 INFO:tasks.workunit.client.1.smithi133.stdout:4/188: rename d2/ca to d2/d5/d2b/d21/d36/c42 0 2024-02-15T18:27:06.161 INFO:tasks.workunit.client.1.smithi133.stdout:8/232: sync 2024-02-15T18:27:06.161 INFO:tasks.workunit.client.1.smithi133.stdout:8/233: truncate d3/d1c/f51 429644 0 2024-02-15T18:27:06.172 INFO:tasks.workunit.client.1.smithi133.stdout:8/234: creat d3/de/f53 x:0 0 0 2024-02-15T18:27:06.172 INFO:tasks.workunit.client.1.smithi133.stdout:8/235: dread - d3/f46 zero size 2024-02-15T18:27:06.172 INFO:tasks.workunit.client.0.smithi084.stdout:4/627: creat d2/d4/d28/d3d/d5c/d65/fbd x:0 0 0 2024-02-15T18:27:06.173 INFO:tasks.workunit.client.1.smithi133.stdout:5/205: dread d17/d2a/f2d [0,4194304] 0 2024-02-15T18:27:06.174 INFO:tasks.workunit.client.1.smithi133.stdout:2/284: mkdir d7/d2c/d3b/d48/d59 0 2024-02-15T18:27:06.175 INFO:tasks.workunit.client.0.smithi084.stdout:2/551: symlink d3/d19/d24/d91/lb6 0 2024-02-15T18:27:06.175 INFO:tasks.workunit.client.1.smithi133.stdout:4/189: symlink d2/d5/d2b/d21/d36/l43 0 2024-02-15T18:27:06.176 INFO:tasks.workunit.client.1.smithi133.stdout:3/304: dwrite d0/fc [0,4194304] 0 2024-02-15T18:27:06.178 INFO:tasks.workunit.client.1.smithi133.stdout:8/236: symlink d3/d1f/d4f/l54 0 2024-02-15T18:27:06.179 INFO:tasks.workunit.client.1.smithi133.stdout:3/305: write d0/d15/f16 [4768166,103168] 0 2024-02-15T18:27:06.182 INFO:tasks.workunit.client.1.smithi133.stdout:2/285: rmdir d7/db/d35/d4a 39 2024-02-15T18:27:06.183 INFO:tasks.workunit.client.1.smithi133.stdout:4/190: unlink d2/d5/d2b/f1e 0 2024-02-15T18:27:06.183 INFO:tasks.workunit.client.1.smithi133.stdout:4/191: fdatasync d2/d5/d2b/f24 0 2024-02-15T18:27:06.184 INFO:tasks.workunit.client.1.smithi133.stdout:8/237: rmdir d3/d1f/d3f 39 2024-02-15T18:27:06.185 INFO:tasks.workunit.client.1.smithi133.stdout:4/192: mkdir d2/d5/d2b/d21/d2d/d44 0 2024-02-15T18:27:06.186 INFO:tasks.workunit.client.1.smithi133.stdout:8/238: unlink d3/d7/lc 0 2024-02-15T18:27:06.186 INFO:tasks.workunit.client.1.smithi133.stdout:4/193: symlink d2/l45 0 2024-02-15T18:27:06.190 INFO:tasks.workunit.client.1.smithi133.stdout:8/239: rename d3/d1c/d2f/l33 to d3/d1c/l55 0 2024-02-15T18:27:06.194 INFO:tasks.workunit.client.1.smithi133.stdout:4/194: rename d2/d5/d2b/f32 to d2/d5/d2b/d21/d2d/d44/f46 0 2024-02-15T18:27:06.195 INFO:tasks.workunit.client.1.smithi133.stdout:4/195: chown d2/d5 451557692 1 2024-02-15T18:27:06.197 INFO:tasks.workunit.client.0.smithi084.stdout:2/552: rename d3/d28/f86 to d3/fb7 0 2024-02-15T18:27:06.245 INFO:tasks.workunit.client.1.smithi133.stdout:8/240: dwrite d3/f5 [0,4194304] 0 2024-02-15T18:27:06.245 INFO:tasks.workunit.client.1.smithi133.stdout:2/286: dwrite d7/db/f21 [0,4194304] 0 2024-02-15T18:27:06.245 INFO:tasks.workunit.client.1.smithi133.stdout:2/287: stat d7 0 2024-02-15T18:27:06.253 INFO:tasks.workunit.client.1.smithi133.stdout:2/288: dread d7/ff [0,4194304] 0 2024-02-15T18:27:06.253 INFO:tasks.workunit.client.1.smithi133.stdout:2/289: truncate d7/d2c/f44 643027 0 2024-02-15T18:27:06.254 INFO:tasks.workunit.client.0.smithi084.stdout:3/516: dwrite d8/f21 [0,4194304] 0 2024-02-15T18:27:06.254 INFO:tasks.workunit.client.1.smithi133.stdout:5/206: dwrite d17/d20/f35 [0,4194304] 0 2024-02-15T18:27:06.255 INFO:tasks.workunit.client.1.smithi133.stdout:6/351: dwrite d0/d3b/f6d [0,4194304] 0 2024-02-15T18:27:06.256 INFO:tasks.workunit.client.1.smithi133.stdout:4/196: dwrite d2/f12 [0,4194304] 0 2024-02-15T18:27:06.256 INFO:tasks.workunit.client.1.smithi133.stdout:8/241: creat d3/d7/d52/f56 x:0 0 0 2024-02-15T18:27:06.256 INFO:tasks.workunit.client.1.smithi133.stdout:8/242: dread - d3/d1f/f31 zero size 2024-02-15T18:27:06.256 INFO:tasks.workunit.client.1.smithi133.stdout:8/243: readlink d3/l6 0 2024-02-15T18:27:06.257 INFO:tasks.workunit.client.0.smithi084.stdout:0/580: dwrite d0/d39/d45/f5e [0,4194304] 0 2024-02-15T18:27:06.257 INFO:tasks.workunit.client.0.smithi084.stdout:0/581: fdatasync d0/d4/d66/fa6 0 2024-02-15T18:27:06.258 INFO:tasks.workunit.client.0.smithi084.stdout:3/517: creat d8/d1f/d2d/fb2 x:0 0 0 2024-02-15T18:27:06.258 INFO:tasks.workunit.client.0.smithi084.stdout:3/518: chown d8/d40/fa2 806 1 2024-02-15T18:27:06.258 INFO:tasks.workunit.client.0.smithi084.stdout:4/628: dwrite d2/d4/d28/d2e/fb6 [0,4194304] 0 2024-02-15T18:27:06.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/213: dwrite d0/d8/d9/f41 [0,4194304] 0 2024-02-15T18:27:06.260 INFO:tasks.workunit.client.0.smithi084.stdout:2/553: dwrite d3/faf [0,4194304] 0 2024-02-15T18:27:06.260 INFO:tasks.workunit.client.0.smithi084.stdout:2/554: getdents d3/d5/d1a/d1e/d30/d82 0 2024-02-15T18:27:06.263 INFO:tasks.workunit.client.0.smithi084.stdout:4/629: symlink d2/d2b/lbe 0 2024-02-15T18:27:06.263 INFO:tasks.workunit.client.1.smithi133.stdout:5/207: rmdir d17/d20 39 2024-02-15T18:27:06.264 INFO:tasks.workunit.client.1.smithi133.stdout:1/454: sync 2024-02-15T18:27:06.264 INFO:tasks.workunit.client.1.smithi133.stdout:6/352: creat d0/db/d21/f75 x:0 0 0 2024-02-15T18:27:06.264 INFO:tasks.workunit.client.1.smithi133.stdout:6/353: readlink d0/db/d29/d34/d48/l5f 0 2024-02-15T18:27:06.265 INFO:tasks.workunit.client.1.smithi133.stdout:6/354: readlink d0/db/d29/l42 0 2024-02-15T18:27:06.267 INFO:tasks.workunit.client.1.smithi133.stdout:4/197: creat d2/d5/d2b/d21/d2d/d44/f47 x:0 0 0 2024-02-15T18:27:06.268 INFO:tasks.workunit.client.1.smithi133.stdout:8/244: rename d3/d1c/c3c to d3/de/d3e/c57 0 2024-02-15T18:27:06.270 INFO:tasks.workunit.client.0.smithi084.stdout:3/519: dread d8/d1f/d2d/f92 [0,4194304] 0 2024-02-15T18:27:06.272 INFO:tasks.workunit.client.1.smithi133.stdout:5/208: link d17/f1c d17/d2a/f41 0 2024-02-15T18:27:06.272 INFO:tasks.workunit.client.1.smithi133.stdout:9/214: mkdir d0/d8/d9/d12/d2a/d42 0 2024-02-15T18:27:06.273 INFO:tasks.workunit.client.0.smithi084.stdout:0/582: dread d0/d2f/d3f/da4/fab [0,4194304] 0 2024-02-15T18:27:06.274 INFO:tasks.workunit.client.0.smithi084.stdout:1/495: sync 2024-02-15T18:27:06.274 INFO:tasks.workunit.client.0.smithi084.stdout:5/644: sync 2024-02-15T18:27:06.274 INFO:tasks.workunit.client.1.smithi133.stdout:1/455: mkdir d6/d2a/d59/d5a/da4/daa 0 2024-02-15T18:27:06.275 INFO:tasks.workunit.client.1.smithi133.stdout:6/355: creat d0/d3b/d41/f76 x:0 0 0 2024-02-15T18:27:06.275 INFO:tasks.workunit.client.1.smithi133.stdout:6/356: write d0/db/f3f [1640852,62242] 0 2024-02-15T18:27:06.276 INFO:tasks.workunit.client.1.smithi133.stdout:4/198: write d2/d5/d2b/f1d [414308,6513] 0 2024-02-15T18:27:06.277 INFO:tasks.workunit.client.1.smithi133.stdout:5/209: creat d17/d2a/f42 x:0 0 0 2024-02-15T18:27:06.278 INFO:tasks.workunit.client.0.smithi084.stdout:4/630: symlink d2/d64/da5/dae/lbf 0 2024-02-15T18:27:06.278 INFO:tasks.workunit.client.0.smithi084.stdout:3/520: creat d8/fb3 x:0 0 0 2024-02-15T18:27:06.280 INFO:tasks.workunit.client.0.smithi084.stdout:1/496: creat d9/d54/d1b/d2c/d35/fab x:0 0 0 2024-02-15T18:27:06.280 INFO:tasks.workunit.client.1.smithi133.stdout:6/357: link d0/d3b/f45 d0/db/d21/f77 0 2024-02-15T18:27:06.280 INFO:tasks.workunit.client.1.smithi133.stdout:6/358: chown d0/d3b/d41/f60 458 1 2024-02-15T18:27:06.285 INFO:tasks.workunit.client.1.smithi133.stdout:4/199: mkdir d2/d48 0 2024-02-15T18:27:06.286 INFO:tasks.workunit.client.1.smithi133.stdout:5/210: creat d17/d20/f43 x:0 0 0 2024-02-15T18:27:06.286 INFO:tasks.workunit.client.1.smithi133.stdout:5/211: write d17/d2a/f42 [68904,79710] 0 2024-02-15T18:27:06.288 INFO:tasks.workunit.client.1.smithi133.stdout:1/456: dread d6/d17/f6e [0,4194304] 0 2024-02-15T18:27:06.289 INFO:tasks.workunit.client.0.smithi084.stdout:5/645: link d9/d35/d65/f56 d9/d5f/fd3 0 2024-02-15T18:27:06.289 INFO:tasks.workunit.client.0.smithi084.stdout:4/631: truncate d2/f39 475891 0 2024-02-15T18:27:06.289 INFO:tasks.workunit.client.0.smithi084.stdout:4/632: stat d2/d64/d74/laf 0 2024-02-15T18:27:06.291 INFO:tasks.workunit.client.0.smithi084.stdout:4/633: getdents d2/d4/d28/d3d/d5c/d65 0 2024-02-15T18:27:06.292 INFO:tasks.workunit.client.0.smithi084.stdout:4/634: write d2/f11 [686286,33064] 0 2024-02-15T18:27:06.292 INFO:tasks.workunit.client.1.smithi133.stdout:4/200: chown d2/d5/d2b/d21/d2d/l3e 260810283 1 2024-02-15T18:27:06.292 INFO:tasks.workunit.client.0.smithi084.stdout:5/646: mknod d9/da/d3d/d44/d55/cd4 0 2024-02-15T18:27:06.293 INFO:tasks.workunit.client.1.smithi133.stdout:4/201: mkdir d2/d5/d2b/d21/d3b/d49 0 2024-02-15T18:27:06.304 INFO:tasks.workunit.client.0.smithi084.stdout:5/647: creat d9/d35/d65/fd5 x:0 0 0 2024-02-15T18:27:06.307 INFO:tasks.workunit.client.0.smithi084.stdout:5/648: mkdir d9/d35/d65/d7f/dd6 0 2024-02-15T18:27:06.307 INFO:tasks.workunit.client.0.smithi084.stdout:5/649: truncate d9/da/d3d/f91 667322 0 2024-02-15T18:27:06.310 INFO:tasks.workunit.client.0.smithi084.stdout:5/650: rename d9/da/d3d/f91 to d9/d5b/d7e/db5/fd7 0 2024-02-15T18:27:06.310 INFO:tasks.workunit.client.0.smithi084.stdout:4/635: dread d2/f3 [0,4194304] 0 2024-02-15T18:27:06.322 INFO:tasks.workunit.client.1.smithi133.stdout:7/177: sync 2024-02-15T18:27:06.322 INFO:tasks.workunit.client.1.smithi133.stdout:7/178: chown d9/db/dc/f30 225130559 1 2024-02-15T18:27:06.323 INFO:tasks.workunit.client.0.smithi084.stdout:5/651: dread d9/f15 [0,4194304] 0 2024-02-15T18:27:06.323 INFO:tasks.workunit.client.0.smithi084.stdout:5/652: chown d9/d23/dac 2 1 2024-02-15T18:27:06.328 INFO:tasks.workunit.client.0.smithi084.stdout:5/653: creat d9/d23/dac/fd8 x:0 0 0 2024-02-15T18:27:06.328 INFO:tasks.workunit.client.0.smithi084.stdout:5/654: write d9/d23/f37 [3409223,103005] 0 2024-02-15T18:27:06.328 INFO:tasks.workunit.client.0.smithi084.stdout:5/655: fsync d9/da/d3d/f72 0 2024-02-15T18:27:06.331 INFO:tasks.workunit.client.0.smithi084.stdout:5/656: getdents d9/da 0 2024-02-15T18:27:06.334 INFO:tasks.workunit.client.1.smithi133.stdout:0/209: sync 2024-02-15T18:27:06.342 INFO:tasks.workunit.client.0.smithi084.stdout:5/657: dread d9/f26 [0,4194304] 0 2024-02-15T18:27:06.345 INFO:tasks.workunit.client.0.smithi084.stdout:2/555: dwrite d3/d19/d24/d89/f39 [0,4194304] 0 2024-02-15T18:27:06.345 INFO:tasks.workunit.client.1.smithi133.stdout:8/245: dwrite d3/f4 [0,4194304] 0 2024-02-15T18:27:06.346 INFO:tasks.workunit.client.1.smithi133.stdout:5/212: dwrite d17/f36 [0,4194304] 0 2024-02-15T18:27:06.346 INFO:tasks.workunit.client.1.smithi133.stdout:5/213: readlink d17/l39 0 2024-02-15T18:27:06.346 INFO:tasks.workunit.client.1.smithi133.stdout:8/246: chown d3/d7/l10 21 1 2024-02-15T18:27:06.348 INFO:tasks.workunit.client.0.smithi084.stdout:2/556: truncate d3/d5/d1a/d2d/f4a 3389378 0 2024-02-15T18:27:06.350 INFO:tasks.workunit.client.0.smithi084.stdout:1/497: dwrite d9/d54/d1b/f56 [0,4194304] 0 2024-02-15T18:27:06.350 INFO:tasks.workunit.client.0.smithi084.stdout:8/619: sync 2024-02-15T18:27:06.351 INFO:tasks.workunit.client.0.smithi084.stdout:9/632: sync 2024-02-15T18:27:06.351 INFO:tasks.workunit.client.0.smithi084.stdout:8/620: fsync db/d1a/d2b/d7b/fbf 0 2024-02-15T18:27:06.351 INFO:tasks.workunit.client.0.smithi084.stdout:8/621: truncate db/dd/d1f/d3e/fca 142946 0 2024-02-15T18:27:06.351 INFO:tasks.workunit.client.0.smithi084.stdout:8/622: readlink db/dd/d1f/l29 0 2024-02-15T18:27:06.351 INFO:tasks.workunit.client.0.smithi084.stdout:8/623: chown db/dd/d1f/ccb 697 1 2024-02-15T18:27:06.351 INFO:tasks.workunit.client.0.smithi084.stdout:7/530: sync 2024-02-15T18:27:06.352 INFO:tasks.workunit.client.0.smithi084.stdout:6/562: sync 2024-02-15T18:27:06.352 INFO:tasks.workunit.client.0.smithi084.stdout:0/583: dwrite d0/f37 [0,4194304] 0 2024-02-15T18:27:06.352 INFO:tasks.workunit.client.1.smithi133.stdout:0/210: dread d9/d10/d19/f3d [0,4194304] 0 2024-02-15T18:27:06.353 INFO:tasks.workunit.client.1.smithi133.stdout:9/215: dwrite d0/d8/d9/ff [4194304,4194304] 0 2024-02-15T18:27:06.353 INFO:tasks.workunit.client.1.smithi133.stdout:9/216: read d0/d8/d10/f2f [5182,7680] 0 2024-02-15T18:27:06.353 INFO:tasks.workunit.client.1.smithi133.stdout:6/359: dwrite d0/d3b/d41/f56 [0,4194304] 0 2024-02-15T18:27:06.353 INFO:tasks.workunit.client.1.smithi133.stdout:6/360: truncate d0/db/f33 695578 0 2024-02-15T18:27:06.353 INFO:tasks.workunit.client.1.smithi133.stdout:6/361: read - d0/d3b/d41/f76 zero size 2024-02-15T18:27:06.353 INFO:tasks.workunit.client.1.smithi133.stdout:6/362: write d0/d3b/f45 [765734,44261] 0 2024-02-15T18:27:06.354 INFO:tasks.workunit.client.0.smithi084.stdout:1/498: link d9/d54/d1b/d2c/d35/fab d9/d54/d1b/d2c/d4b/d4c/d79/d92/fac 0 2024-02-15T18:27:06.357 INFO:tasks.workunit.client.1.smithi133.stdout:5/214: symlink d17/d20/l44 0 2024-02-15T18:27:06.357 INFO:tasks.workunit.client.1.smithi133.stdout:4/202: getdents d2/d5/d2b/d21 0 2024-02-15T18:27:06.358 INFO:tasks.workunit.client.0.smithi084.stdout:1/499: write d9/d54/d1b/d2c/d4b/d4c/d79/f9c [2501248,27652] 0 2024-02-15T18:27:06.358 INFO:tasks.workunit.client.0.smithi084.stdout:9/633: unlink d4/d2b/d3c/d20/d43/f1f 0 2024-02-15T18:27:06.359 INFO:tasks.workunit.client.0.smithi084.stdout:8/624: mkdir db/d3f/d59/dcd 0 2024-02-15T18:27:06.359 INFO:tasks.workunit.client.0.smithi084.stdout:7/531: creat df/d1d/d1a/d6a/d8b/d48/fa7 x:0 0 0 2024-02-15T18:27:06.359 INFO:tasks.workunit.client.0.smithi084.stdout:7/532: fsync df/d1d/d1a/f9d 0 2024-02-15T18:27:06.360 INFO:tasks.workunit.client.0.smithi084.stdout:6/563: getdents d14/d22/d25/d41/d43 0 2024-02-15T18:27:06.362 INFO:tasks.workunit.client.1.smithi133.stdout:6/363: mkdir d0/d3b/d78 0 2024-02-15T18:27:06.362 INFO:tasks.workunit.client.1.smithi133.stdout:0/211: creat d9/d10/d19/d1a/f4b x:0 0 0 2024-02-15T18:27:06.363 INFO:tasks.workunit.client.1.smithi133.stdout:9/217: link d0/d8/d9/l1d d0/d37/l43 0 2024-02-15T18:27:06.363 INFO:tasks.workunit.client.1.smithi133.stdout:9/218: readlink d0/d8/d9/le 0 2024-02-15T18:27:06.363 INFO:tasks.workunit.client.1.smithi133.stdout:9/219: write d0/d8/d10/f2f [823093,121980] 0 2024-02-15T18:27:06.364 INFO:tasks.workunit.client.1.smithi133.stdout:5/215: write ff [2023643,98939] 0 2024-02-15T18:27:06.364 INFO:tasks.workunit.client.1.smithi133.stdout:5/216: fdatasync d17/f19 0 2024-02-15T18:27:06.364 INFO:tasks.workunit.client.1.smithi133.stdout:4/203: link d2/f9 d2/d5/d2b/d21/d3b/d49/f4a 0 2024-02-15T18:27:06.364 INFO:tasks.workunit.client.1.smithi133.stdout:4/204: readlink d2/d5/l28 0 2024-02-15T18:27:06.365 INFO:tasks.workunit.client.0.smithi084.stdout:1/500: unlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/c50 0 2024-02-15T18:27:06.365 INFO:tasks.workunit.client.0.smithi084.stdout:9/634: mknod d4/d2b/d67/cc9 0 2024-02-15T18:27:06.366 INFO:tasks.workunit.client.1.smithi133.stdout:9/220: mkdir d0/d8/d9/d12/d2a/d42/d44 0 2024-02-15T18:27:06.366 INFO:tasks.workunit.client.1.smithi133.stdout:6/364: symlink d0/db/d21/l79 0 2024-02-15T18:27:06.369 INFO:tasks.workunit.client.1.smithi133.stdout:6/365: creat d0/db/d29/d34/d5d/d40/f7a x:0 0 0 2024-02-15T18:27:06.369 INFO:tasks.workunit.client.0.smithi084.stdout:4/636: dwrite d2/d2b/d47/d31/fa6 [0,4194304] 0 2024-02-15T18:27:06.369 INFO:tasks.workunit.client.0.smithi084.stdout:4/637: fdatasync d2/d2b/d47/d31/d61/f8c 0 2024-02-15T18:27:06.370 INFO:tasks.workunit.client.1.smithi133.stdout:5/217: symlink d17/d2a/l45 0 2024-02-15T18:27:06.371 INFO:tasks.workunit.client.0.smithi084.stdout:1/501: rename d9/d54/d1b/d38/d4d/c8c to d9/d54/d32/cad 0 2024-02-15T18:27:06.372 INFO:tasks.workunit.client.1.smithi133.stdout:5/218: write d17/d2a/f42 [773009,82883] 0 2024-02-15T18:27:06.373 INFO:tasks.workunit.client.1.smithi133.stdout:0/212: dread d9/d10/d19/d1a/f25 [0,4194304] 0 2024-02-15T18:27:06.373 INFO:tasks.workunit.client.1.smithi133.stdout:0/213: write d9/f3e [268424,119861] 0 2024-02-15T18:27:06.374 INFO:tasks.workunit.client.1.smithi133.stdout:6/366: rename d0/db/d21/f6f to d0/db/d29/d34/d48/f7b 0 2024-02-15T18:27:06.377 INFO:tasks.workunit.client.1.smithi133.stdout:7/179: dwrite d9/db/dc/f35 [0,4194304] 0 2024-02-15T18:27:06.377 INFO:tasks.workunit.client.1.smithi133.stdout:7/180: fsync d9/d36/f2b 0 2024-02-15T18:27:06.378 INFO:tasks.workunit.client.1.smithi133.stdout:0/214: creat d9/d10/d22/d2f/d30/d44/f4c x:0 0 0 2024-02-15T18:27:06.383 INFO:tasks.workunit.client.1.smithi133.stdout:6/367: mkdir d0/db/d29/d34/d7c 0 2024-02-15T18:27:06.383 INFO:tasks.workunit.client.1.smithi133.stdout:7/181: write d9/db/f1f [375630,88364] 0 2024-02-15T18:27:06.383 INFO:tasks.workunit.client.1.smithi133.stdout:7/182: chown d9 476041 1 2024-02-15T18:27:06.390 INFO:tasks.workunit.client.1.smithi133.stdout:7/183: mkdir d9/d36/d3d 0 2024-02-15T18:27:06.390 INFO:tasks.workunit.client.1.smithi133.stdout:0/215: creat d9/d2b/f4d x:0 0 0 2024-02-15T18:27:06.390 INFO:tasks.workunit.client.1.smithi133.stdout:0/216: chown d9/d10/d22/d32 0 1 2024-02-15T18:27:06.390 INFO:tasks.workunit.client.1.smithi133.stdout:0/217: truncate d9/d28/f3a 814367 0 2024-02-15T18:27:06.390 INFO:tasks.workunit.client.1.smithi133.stdout:0/218: chown d9/l1f 18623 1 2024-02-15T18:27:06.390 INFO:tasks.workunit.client.1.smithi133.stdout:0/219: write d9/d28/f3a [1309459,126463] 0 2024-02-15T18:27:06.390 INFO:tasks.workunit.client.1.smithi133.stdout:6/368: mknod d0/db/d29/d34/c7d 0 2024-02-15T18:27:06.391 INFO:tasks.workunit.client.0.smithi084.stdout:5/658: fdatasync d9/fe 0 2024-02-15T18:27:06.395 INFO:tasks.workunit.client.1.smithi133.stdout:8/247: dwrite d3/f44 [0,4194304] 0 2024-02-15T18:27:06.395 INFO:tasks.workunit.client.1.smithi133.stdout:6/369: mkdir d0/db/d29/d34/d7c/d7e 0 2024-02-15T18:27:06.397 INFO:tasks.workunit.client.0.smithi084.stdout:5/659: creat d9/d5b/d79/db7/fd9 x:0 0 0 2024-02-15T18:27:06.399 INFO:tasks.workunit.client.1.smithi133.stdout:6/370: mkdir d0/d3b/d78/d7f 0 2024-02-15T18:27:06.399 INFO:tasks.workunit.client.1.smithi133.stdout:6/371: chown d0/d3b/d67 1669939 1 2024-02-15T18:27:06.399 INFO:tasks.workunit.client.1.smithi133.stdout:6/372: fsync d0/f24 0 2024-02-15T18:27:06.401 INFO:tasks.workunit.client.0.smithi084.stdout:5/660: creat d9/d23/dac/fda x:0 0 0 2024-02-15T18:27:06.402 INFO:tasks.workunit.client.1.smithi133.stdout:7/184: dread d9/db/d16/f3a [0,4194304] 0 2024-02-15T18:27:06.402 INFO:tasks.workunit.client.1.smithi133.stdout:6/373: unlink d0/d5/f4a 0 2024-02-15T18:27:06.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/638: fsync d2/d2b/d47/d31/d50/d94/f97 0 2024-02-15T18:27:06.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/639: dread - d2/d2b/d47/d31/d61/fa0 zero size 2024-02-15T18:27:06.404 INFO:tasks.workunit.client.0.smithi084.stdout:4/640: write d2/d4/d28/d3d/f53 [4968902,92375] 0 2024-02-15T18:27:06.404 INFO:tasks.workunit.client.0.smithi084.stdout:5/661: write d9/da/d3d/f72 [551135,7128] 0 2024-02-15T18:27:06.404 INFO:tasks.workunit.client.0.smithi084.stdout:5/662: stat d9/d23/f47 0 2024-02-15T18:27:06.406 INFO:tasks.workunit.client.0.smithi084.stdout:4/641: unlink d2/d2b/d47/d31/d50/l6a 0 2024-02-15T18:27:06.406 INFO:tasks.workunit.client.0.smithi084.stdout:4/642: chown d2/d2b/d47/d31/d61/f8c 2397001 1 2024-02-15T18:27:06.408 INFO:tasks.workunit.client.0.smithi084.stdout:5/663: symlink d9/da/d3d/d44/d55/d70/d84/ldb 0 2024-02-15T18:27:06.408 INFO:tasks.workunit.client.0.smithi084.stdout:5/664: stat d9/d5f/d68/d9a/f6f 0 2024-02-15T18:27:06.408 INFO:tasks.workunit.client.0.smithi084.stdout:5/665: fsync d9/f28 0 2024-02-15T18:27:06.409 INFO:tasks.workunit.client.1.smithi133.stdout:6/374: symlink d0/db/d29/d34/d5d/l80 0 2024-02-15T18:27:06.409 INFO:tasks.workunit.client.1.smithi133.stdout:7/185: rename d9/db/d16/f29 to d9/db/f3e 0 2024-02-15T18:27:06.410 INFO:tasks.workunit.client.0.smithi084.stdout:5/666: truncate d9/d5f/d68/f83 2482265 0 2024-02-15T18:27:06.410 INFO:tasks.workunit.client.0.smithi084.stdout:5/667: dread - d9/d5f/da7/fca zero size 2024-02-15T18:27:06.410 INFO:tasks.workunit.client.0.smithi084.stdout:7/533: write df/d1d/f18 [1244702,110274] 0 2024-02-15T18:27:06.411 INFO:tasks.workunit.client.0.smithi084.stdout:7/534: write df/d1d/d1a/d4d/f6f [673664,116221] 0 2024-02-15T18:27:06.411 INFO:tasks.workunit.client.1.smithi133.stdout:6/375: unlink d0/db/c1d 0 2024-02-15T18:27:06.411 INFO:tasks.workunit.client.1.smithi133.stdout:6/376: write d0/f32 [1509186,41079] 0 2024-02-15T18:27:06.411 INFO:tasks.workunit.client.1.smithi133.stdout:6/377: truncate d0/d3b/d53/f6e 741071 0 2024-02-15T18:27:06.411 INFO:tasks.workunit.client.1.smithi133.stdout:6/378: write d0/d3b/d41/f76 [205701,107723] 0 2024-02-15T18:27:06.411 INFO:tasks.workunit.client.1.smithi133.stdout:7/186: mknod d9/d36/d31/c3f 0 2024-02-15T18:27:06.413 INFO:tasks.workunit.client.1.smithi133.stdout:6/379: rmdir d0/d3b/d78 39 2024-02-15T18:27:06.413 INFO:tasks.workunit.client.1.smithi133.stdout:7/187: link d9/db/c15 d9/db/d16/c40 0 2024-02-15T18:27:06.413 INFO:tasks.workunit.client.1.smithi133.stdout:6/380: getdents d0/db/d29/d34/d7c/d7e 0 2024-02-15T18:27:06.413 INFO:tasks.workunit.client.1.smithi133.stdout:6/381: chown d0/db/d29/d34/d48 375739125 1 2024-02-15T18:27:06.414 INFO:tasks.workunit.client.1.smithi133.stdout:7/188: mknod d9/d36/d3d/c41 0 2024-02-15T18:27:06.414 INFO:tasks.workunit.client.0.smithi084.stdout:7/535: truncate df/d1d/d1a/d6a/d8b/d48/f5c 2413519 0 2024-02-15T18:27:06.414 INFO:tasks.workunit.client.0.smithi084.stdout:7/536: chown df/d1d/d1a/f81 27608 1 2024-02-15T18:27:06.415 INFO:tasks.workunit.client.1.smithi133.stdout:6/382: creat d0/d3b/d67/f81 x:0 0 0 2024-02-15T18:27:06.415 INFO:tasks.workunit.client.1.smithi133.stdout:6/383: dread - d0/d3b/d53/f65 zero size 2024-02-15T18:27:06.415 INFO:tasks.workunit.client.1.smithi133.stdout:0/220: write d9/d10/d19/f3d [2043243,77099] 0 2024-02-15T18:27:06.415 INFO:tasks.workunit.client.1.smithi133.stdout:0/221: readlink d9/d10/d19/l43 0 2024-02-15T18:27:06.415 INFO:tasks.workunit.client.1.smithi133.stdout:0/222: chown d9/d10/d2c/l46 28442436 1 2024-02-15T18:27:06.417 INFO:tasks.workunit.client.0.smithi084.stdout:3/521: dwrite d8/d40/f59 [4194304,4194304] 0 2024-02-15T18:27:06.417 INFO:tasks.workunit.client.0.smithi084.stdout:3/522: write d8/d1f/f20 [4798002,81419] 0 2024-02-15T18:27:06.418 INFO:tasks.workunit.client.0.smithi084.stdout:8/625: dwrite db/d3f/d59/d69/f6b [0,4194304] 0 2024-02-15T18:27:06.418 INFO:tasks.workunit.client.0.smithi084.stdout:4/643: write d2/d4/d28/d2e/f49 [3157322,4755] 0 2024-02-15T18:27:06.419 INFO:tasks.workunit.client.1.smithi133.stdout:6/384: creat d0/db/f82 x:0 0 0 2024-02-15T18:27:06.424 INFO:tasks.workunit.client.0.smithi084.stdout:7/537: dread df/d1d/d1a/d6a/d8e/f71 [0,4194304] 0 2024-02-15T18:27:06.424 INFO:tasks.workunit.client.0.smithi084.stdout:7/538: readlink df/d1d/d44/l5f 0 2024-02-15T18:27:06.425 INFO:tasks.workunit.client.1.smithi133.stdout:6/385: dread d0/db/f17 [0,4194304] 0 2024-02-15T18:27:06.425 INFO:tasks.workunit.client.1.smithi133.stdout:0/223: write f5 [2730895,104684] 0 2024-02-15T18:27:06.427 INFO:tasks.workunit.client.1.smithi133.stdout:0/224: symlink d9/d10/d22/d2f/l4e 0 2024-02-15T18:27:06.428 INFO:tasks.workunit.client.0.smithi084.stdout:3/523: rename d8/d73/f90 to d8/d40/d43/d71/d8c/fb4 0 2024-02-15T18:27:06.428 INFO:tasks.workunit.client.1.smithi133.stdout:0/225: write d9/fa [2509393,114748] 0 2024-02-15T18:27:06.429 INFO:tasks.workunit.client.1.smithi133.stdout:0/226: getdents d9/d10/d22/d2f/d30 0 2024-02-15T18:27:06.430 INFO:tasks.workunit.client.0.smithi084.stdout:8/626: symlink db/dd/d1f/d3e/lce 0 2024-02-15T18:27:06.430 INFO:tasks.workunit.client.0.smithi084.stdout:8/627: write db/dd/d4d/f63 [416751,52706] 0 2024-02-15T18:27:06.430 INFO:tasks.workunit.client.0.smithi084.stdout:4/644: symlink d2/d4/d28/d3d/da4/lc0 0 2024-02-15T18:27:06.432 INFO:tasks.workunit.client.1.smithi133.stdout:0/227: link d9/d10/d22/d2f/d30/d44/f4c d9/d10/d22/d2f/d30/d44/f4f 0 2024-02-15T18:27:06.434 INFO:tasks.workunit.client.0.smithi084.stdout:3/524: rename d8/d40/d58/f83 to d8/d40/d43/d71/fb5 0 2024-02-15T18:27:06.434 INFO:tasks.workunit.client.0.smithi084.stdout:3/525: write d8/d40/d58/f72 [1366694,107237] 0 2024-02-15T18:27:06.434 INFO:tasks.workunit.client.0.smithi084.stdout:9/635: dwrite d4/d3d/f94 [0,4194304] 0 2024-02-15T18:27:06.435 INFO:tasks.workunit.client.0.smithi084.stdout:1/502: dwrite d9/f9d [0,4194304] 0 2024-02-15T18:27:06.436 INFO:tasks.workunit.client.0.smithi084.stdout:4/645: truncate d2/d4/f1c 1942068 0 2024-02-15T18:27:06.436 INFO:tasks.workunit.client.0.smithi084.stdout:3/526: mkdir d8/d22/db6 0 2024-02-15T18:27:06.437 INFO:tasks.workunit.client.0.smithi084.stdout:3/527: chown d8/d40/d58/d80/d6b/c95 713676781 1 2024-02-15T18:27:06.439 INFO:tasks.workunit.client.1.smithi133.stdout:6/386: dread d0/ff [0,4194304] 0 2024-02-15T18:27:06.439 INFO:tasks.workunit.client.1.smithi133.stdout:6/387: fdatasync d0/db/f18 0 2024-02-15T18:27:06.440 INFO:tasks.workunit.client.0.smithi084.stdout:8/628: dread db/d1a/d2b/f37 [0,4194304] 0 2024-02-15T18:27:06.441 INFO:tasks.workunit.client.1.smithi133.stdout:4/205: dwrite d2/d5/d2b/d21/d2d/f2e [0,4194304] 0 2024-02-15T18:27:06.444 INFO:tasks.workunit.client.1.smithi133.stdout:0/228: dread f7 [0,4194304] 0 2024-02-15T18:27:06.446 INFO:tasks.workunit.client.0.smithi084.stdout:6/564: dwrite d14/d22/d25/d2f/d31/d30/f6b [0,4194304] 0 2024-02-15T18:27:06.446 INFO:tasks.workunit.client.0.smithi084.stdout:8/629: link db/f3a db/dd/d1f/d66/da2/fcf 0 2024-02-15T18:27:06.447 INFO:tasks.workunit.client.0.smithi084.stdout:3/528: chown d8/d40/d58/d80/l39 26980 1 2024-02-15T18:27:06.447 INFO:tasks.workunit.client.0.smithi084.stdout:3/529: chown d8/d40/d58/d80 22347266 1 2024-02-15T18:27:06.447 INFO:tasks.workunit.client.0.smithi084.stdout:1/503: unlink d9/d54/d1b/d38/d4d/fa0 0 2024-02-15T18:27:06.449 INFO:tasks.workunit.client.0.smithi084.stdout:3/530: write d8/d73/f9f [2393202,12424] 0 2024-02-15T18:27:06.450 INFO:tasks.workunit.client.1.smithi133.stdout:6/388: link d0/db/d29/l6c d0/d3b/d52/l83 0 2024-02-15T18:27:06.455 INFO:tasks.workunit.client.1.smithi133.stdout:4/206: symlink d2/d5/d2b/d21/d2d/l4b 0 2024-02-15T18:27:06.456 INFO:tasks.workunit.client.1.smithi133.stdout:0/229: mknod d9/d10/d22/d2f/c50 0 2024-02-15T18:27:06.456 INFO:tasks.workunit.client.1.smithi133.stdout:8/248: dwrite d3/d1f/f31 [0,4194304] 0 2024-02-15T18:27:06.456 INFO:tasks.workunit.client.1.smithi133.stdout:6/389: rename d0/f14 to d0/db/d29/f84 0 2024-02-15T18:27:06.456 INFO:tasks.workunit.client.1.smithi133.stdout:6/390: fdatasync d0/d5/f1b 0 2024-02-15T18:27:06.459 INFO:tasks.workunit.client.1.smithi133.stdout:6/391: mkdir d0/d3b/d85 0 2024-02-15T18:27:06.459 INFO:tasks.workunit.client.1.smithi133.stdout:6/392: truncate d0/db/d21/f23 911796 0 2024-02-15T18:27:06.461 INFO:tasks.workunit.client.1.smithi133.stdout:6/393: creat d0/d3b/d67/f86 x:0 0 0 2024-02-15T18:27:06.467 INFO:tasks.workunit.client.0.smithi084.stdout:8/630: rmdir db/dd/d1f/d7a/da8 39 2024-02-15T18:27:06.467 INFO:tasks.workunit.client.0.smithi084.stdout:4/646: dwrite d2/d64/f85 [0,4194304] 0 2024-02-15T18:27:06.468 INFO:tasks.workunit.client.1.smithi133.stdout:6/394: link d0/d3b/d67/f81 d0/d3b/d52/f87 0 2024-02-15T18:27:06.468 INFO:tasks.workunit.client.1.smithi133.stdout:6/395: fdatasync d0/db/d29/f47 0 2024-02-15T18:27:06.468 INFO:tasks.workunit.client.1.smithi133.stdout:6/396: dread - d0/d3b/d52/f87 zero size 2024-02-15T18:27:06.468 INFO:tasks.workunit.client.1.smithi133.stdout:6/397: dread - d0/d3b/d52/f58 zero size 2024-02-15T18:27:06.468 INFO:tasks.workunit.client.1.smithi133.stdout:0/230: dread d9/d10/d22/f23 [0,4194304] 0 2024-02-15T18:27:06.468 INFO:tasks.workunit.client.1.smithi133.stdout:0/231: chown d9/d10/d22/d2f/c31 608 1 2024-02-15T18:27:06.468 INFO:tasks.workunit.client.1.smithi133.stdout:6/398: dread d0/f9 [0,4194304] 0 2024-02-15T18:27:06.468 INFO:tasks.workunit.client.1.smithi133.stdout:6/399: chown d0/d3b/d41/f60 133469 1 2024-02-15T18:27:06.470 INFO:tasks.workunit.client.0.smithi084.stdout:9/636: rename d4/d2b/d3c/d20/d43 to d4/d2b/d3c/d24/dca 0 2024-02-15T18:27:06.472 INFO:tasks.workunit.client.0.smithi084.stdout:3/531: link d8/d40/d43/d71/fb5 d8/d40/d43/d71/d8c/fb7 0 2024-02-15T18:27:06.476 INFO:tasks.workunit.client.0.smithi084.stdout:8/631: getdents db/dd/d13/db9 0 2024-02-15T18:27:06.477 INFO:tasks.workunit.client.1.smithi133.stdout:0/232: creat d9/d10/d22/d2f/f51 x:0 0 0 2024-02-15T18:27:06.477 INFO:tasks.workunit.client.1.smithi133.stdout:6/400: unlink d0/db/d29/d34/d5d/c30 0 2024-02-15T18:27:06.480 INFO:tasks.workunit.client.0.smithi084.stdout:6/565: rename fc to d14/d22/d25/d2f/da9/d9b/dac/fb7 0 2024-02-15T18:27:06.480 INFO:tasks.workunit.client.0.smithi084.stdout:3/532: mknod d8/d73/d93/cb8 0 2024-02-15T18:27:06.480 INFO:tasks.workunit.client.0.smithi084.stdout:3/533: fsync d8/d40/d58/d80/f7c 0 2024-02-15T18:27:06.485 INFO:tasks.workunit.client.0.smithi084.stdout:8/632: rmdir db/dd/dcc 0 2024-02-15T18:27:06.485 INFO:tasks.workunit.client.0.smithi084.stdout:8/633: dread - db/dd/d1f/d66/f7f zero size 2024-02-15T18:27:06.485 INFO:tasks.workunit.client.0.smithi084.stdout:3/534: mkdir d8/d73/db9 0 2024-02-15T18:27:06.486 INFO:tasks.workunit.client.0.smithi084.stdout:3/535: dread - d8/d1f/d2d/fb2 zero size 2024-02-15T18:27:06.487 INFO:tasks.workunit.client.0.smithi084.stdout:8/634: rename db/dd/d1f/d9b/da0 to db/dd/d1f/d7a/da8/dd0 0 2024-02-15T18:27:06.488 INFO:tasks.workunit.client.0.smithi084.stdout:3/536: mkdir d8/d40/d43/d71/d8c/d94/da3/dba 0 2024-02-15T18:27:06.489 INFO:tasks.workunit.client.0.smithi084.stdout:9/637: mkdir d4/d2b/d3c/d24/dca/d15/d4b/dcb 0 2024-02-15T18:27:06.490 INFO:tasks.workunit.client.0.smithi084.stdout:1/504: dwrite d9/d54/d1b/f25 [0,4194304] 0 2024-02-15T18:27:06.495 INFO:tasks.workunit.client.1.smithi133.stdout:3/306: sync 2024-02-15T18:27:06.496 INFO:tasks.workunit.client.1.smithi133.stdout:6/401: truncate d0/db/f17 269880 0 2024-02-15T18:27:06.498 INFO:tasks.workunit.client.1.smithi133.stdout:6/402: getdents d0 0 2024-02-15T18:27:06.508 INFO:tasks.workunit.client.1.smithi133.stdout:4/207: dwrite d2/d5/d2b/d21/d3b/d49/f4a [4194304,4194304] 0 2024-02-15T18:27:06.509 INFO:tasks.workunit.client.0.smithi084.stdout:4/647: dwrite d2/d2b/d47/d31/d50/f98 [0,4194304] 0 2024-02-15T18:27:06.510 INFO:tasks.workunit.client.1.smithi133.stdout:8/249: dwrite d3/f44 [4194304,4194304] 0 2024-02-15T18:27:06.513 INFO:tasks.workunit.client.1.smithi133.stdout:4/208: rename d2/d5/d2b/c37 to d2/c4c 0 2024-02-15T18:27:06.513 INFO:tasks.workunit.client.0.smithi084.stdout:6/566: dwrite d14/d22/d25/d2f/da9/f9e [0,4194304] 0 2024-02-15T18:27:06.513 INFO:tasks.workunit.client.0.smithi084.stdout:6/567: read - d14/d22/d25/d41/d43/fa6 zero size 2024-02-15T18:27:06.516 INFO:tasks.workunit.client.1.smithi133.stdout:8/250: unlink d3/l47 0 2024-02-15T18:27:06.516 INFO:tasks.workunit.client.0.smithi084.stdout:4/648: mkdir d2/d64/d74/d8f/dc1 0 2024-02-15T18:27:06.516 INFO:tasks.workunit.client.1.smithi133.stdout:4/209: unlink d2/d5/d2b/d21/f22 0 2024-02-15T18:27:06.518 INFO:tasks.workunit.client.1.smithi133.stdout:8/251: unlink d3/d1c/l55 0 2024-02-15T18:27:06.519 INFO:tasks.workunit.client.0.smithi084.stdout:4/649: link d2/d2b/d47/f3b d2/d4/d28/d3d/da4/fc2 0 2024-02-15T18:27:06.521 INFO:tasks.workunit.client.1.smithi133.stdout:4/210: rename d2/d5/d2b/d21/l19 to d2/d5/d2b/d21/d3b/l4d 0 2024-02-15T18:27:06.521 INFO:tasks.workunit.client.1.smithi133.stdout:8/252: getdents d3/de 0 2024-02-15T18:27:06.523 INFO:tasks.workunit.client.0.smithi084.stdout:4/650: mkdir d2/d4/d28/d3d/dc3 0 2024-02-15T18:27:06.543 INFO:tasks.workunit.client.0.smithi084.stdout:9/638: dwrite d4/d2b/d3c/d24/dca/ff [0,4194304] 0 2024-02-15T18:27:06.546 INFO:tasks.workunit.client.0.smithi084.stdout:9/639: read d4/d2b/d3c/f8b [4161263,62980] 0 2024-02-15T18:27:06.551 INFO:tasks.workunit.client.0.smithi084.stdout:3/537: dwrite d8/d40/d43/d71/f9b [0,4194304] 0 2024-02-15T18:27:06.553 INFO:tasks.workunit.client.0.smithi084.stdout:1/505: dwrite d9/d54/d32/d5b/f8d [0,4194304] 0 2024-02-15T18:27:06.553 INFO:tasks.workunit.client.1.smithi133.stdout:3/307: dwrite d0/d15/d37/f48 [0,4194304] 0 2024-02-15T18:27:06.553 INFO:tasks.workunit.client.1.smithi133.stdout:0/233: dwrite d9/d10/d19/f3d [4194304,4194304] 0 2024-02-15T18:27:06.555 INFO:tasks.workunit.client.0.smithi084.stdout:3/538: rename d8/d40/d58/d80/d6b/c95 to d8/d40/d58/cbb 0 2024-02-15T18:27:06.555 INFO:tasks.workunit.client.0.smithi084.stdout:3/539: fdatasync d8/f1d 0 2024-02-15T18:27:06.555 INFO:tasks.workunit.client.0.smithi084.stdout:3/540: chown d8/d40/fa2 2243177 1 2024-02-15T18:27:06.555 INFO:tasks.workunit.client.0.smithi084.stdout:6/568: dwrite d14/d22/d25/f32 [0,4194304] 0 2024-02-15T18:27:06.556 INFO:tasks.workunit.client.1.smithi133.stdout:8/253: dwrite d3/de/f25 [0,4194304] 0 2024-02-15T18:27:06.556 INFO:tasks.workunit.client.0.smithi084.stdout:1/506: unlink d9/d54/d1b/d2c/d35/f8a 0 2024-02-15T18:27:06.560 INFO:tasks.workunit.client.0.smithi084.stdout:4/651: dwrite d2/d2b/d47/d31/fa6 [0,4194304] 0 2024-02-15T18:27:06.560 INFO:tasks.workunit.client.0.smithi084.stdout:4/652: write d2/d64/f85 [5174891,61765] 0 2024-02-15T18:27:06.560 INFO:tasks.workunit.client.0.smithi084.stdout:4/653: chown d2/d4/d28/d71/c8e 0 1 2024-02-15T18:27:06.561 INFO:tasks.workunit.client.0.smithi084.stdout:4/654: truncate d2/d64/f85 5312452 0 2024-02-15T18:27:06.561 INFO:tasks.workunit.client.0.smithi084.stdout:4/655: write d2/d4/d25/d66/fa3 [302890,90418] 0 2024-02-15T18:27:06.561 INFO:tasks.workunit.client.0.smithi084.stdout:3/541: creat d8/d40/d58/d80/fbc x:0 0 0 2024-02-15T18:27:06.561 INFO:tasks.workunit.client.0.smithi084.stdout:3/542: stat d8/d40/d43/d71/d8c/d94/fa6 0 2024-02-15T18:27:06.564 INFO:tasks.workunit.client.0.smithi084.stdout:6/569: mkdir d14/d22/d25/d2f/d31/d30/d45/d52/d8a/db8 0 2024-02-15T18:27:06.565 INFO:tasks.workunit.client.1.smithi133.stdout:3/308: link d0/d15/d2b/d39/d3f/f22 d0/d15/d2b/f5c 0 2024-02-15T18:27:06.566 INFO:tasks.workunit.client.0.smithi084.stdout:1/507: rename d9/d54/d32/l5f to d9/d54/d1b/d2c/d4b/d4c/d79/d36/lae 0 2024-02-15T18:27:06.569 INFO:tasks.workunit.client.1.smithi133.stdout:8/254: rmdir d3/d7 39 2024-02-15T18:27:06.569 INFO:tasks.workunit.client.0.smithi084.stdout:6/570: mknod d14/d22/d25/d2f/da9/d9b/dac/cb9 0 2024-02-15T18:27:06.569 INFO:tasks.workunit.client.0.smithi084.stdout:6/571: stat d14/d22/d25/d2f/d31/d30/d93 0 2024-02-15T18:27:06.570 INFO:tasks.workunit.client.1.smithi133.stdout:3/309: symlink d0/d15/d2b/d39/d3f/l5d 0 2024-02-15T18:27:06.570 INFO:tasks.workunit.client.1.smithi133.stdout:3/310: fsync d0/f3a 0 2024-02-15T18:27:06.571 INFO:tasks.workunit.client.1.smithi133.stdout:8/255: mkdir d3/d1f/d3f/d58 0 2024-02-15T18:27:06.571 INFO:tasks.workunit.client.1.smithi133.stdout:8/256: chown d3/f4 95772513 1 2024-02-15T18:27:06.571 INFO:tasks.workunit.client.1.smithi133.stdout:8/257: stat d3/d7/l29 0 2024-02-15T18:27:06.572 INFO:tasks.workunit.client.0.smithi084.stdout:9/640: dwrite d4/d81/f89 [0,4194304] 0 2024-02-15T18:27:06.572 INFO:tasks.workunit.client.1.smithi133.stdout:3/311: mkdir d0/d15/d2f/d5e 0 2024-02-15T18:27:06.573 INFO:tasks.workunit.client.1.smithi133.stdout:8/258: rename d3/d1f/l21 to d3/l59 0 2024-02-15T18:27:06.573 INFO:tasks.workunit.client.1.smithi133.stdout:8/259: write d3/f4a [996197,129775] 0 2024-02-15T18:27:06.574 INFO:tasks.workunit.client.1.smithi133.stdout:3/312: creat d0/d15/d2b/d39/d3f/f5f x:0 0 0 2024-02-15T18:27:06.574 INFO:tasks.workunit.client.1.smithi133.stdout:3/313: chown d0/d15/l35 32574 1 2024-02-15T18:27:06.574 INFO:tasks.workunit.client.0.smithi084.stdout:1/508: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/caf 0 2024-02-15T18:27:06.574 INFO:tasks.workunit.client.0.smithi084.stdout:1/509: rename d9/d54/d1b/d2c/d4b/d4c/d79 to d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/db0 22 2024-02-15T18:27:06.574 INFO:tasks.workunit.client.0.smithi084.stdout:1/510: write d9/d54/d32/d5b/d69/fa3 [220154,2467] 0 2024-02-15T18:27:06.574 INFO:tasks.workunit.client.0.smithi084.stdout:1/511: truncate d9/d54/d1b/d2c/d4b/d4c/f61 808950 0 2024-02-15T18:27:06.576 INFO:tasks.workunit.client.1.smithi133.stdout:3/314: truncate d0/d15/d2b/f44 311312 0 2024-02-15T18:27:06.576 INFO:tasks.workunit.client.1.smithi133.stdout:3/315: fdatasync d0/f50 0 2024-02-15T18:27:06.577 INFO:tasks.workunit.client.0.smithi084.stdout:9/641: symlink d4/d2b/d67/lcc 0 2024-02-15T18:27:06.578 INFO:tasks.workunit.client.0.smithi084.stdout:1/512: link d9/d54/d1b/d2c/d4b/f9e d9/d54/d32/d5b/d69/fb1 0 2024-02-15T18:27:06.578 INFO:tasks.workunit.client.0.smithi084.stdout:3/543: write d8/d1f/f20 [501455,18793] 0 2024-02-15T18:27:06.579 INFO:tasks.workunit.client.1.smithi133.stdout:8/260: write d3/d1f/f2c [355732,17950] 0 2024-02-15T18:27:06.581 INFO:tasks.workunit.client.0.smithi084.stdout:3/544: fdatasync d8/d40/d58/d80/f7b 0 2024-02-15T18:27:06.581 INFO:tasks.workunit.client.0.smithi084.stdout:3/545: readlink d8/d1f/d2d/l66 0 2024-02-15T18:27:06.581 INFO:tasks.workunit.client.1.smithi133.stdout:8/261: mkdir d3/d1c/d37/d5a 0 2024-02-15T18:27:06.583 INFO:tasks.workunit.client.0.smithi084.stdout:3/546: link d8/d73/f86 d8/d40/d43/d71/d8c/d94/fbd 0 2024-02-15T18:27:06.583 INFO:tasks.workunit.client.0.smithi084.stdout:3/547: readlink d8/d73/lae 0 2024-02-15T18:27:06.583 INFO:tasks.workunit.client.0.smithi084.stdout:3/548: chown d8/d40/d58 776 1 2024-02-15T18:27:06.585 INFO:tasks.workunit.client.0.smithi084.stdout:3/549: unlink d8/c19 0 2024-02-15T18:27:06.585 INFO:tasks.workunit.client.0.smithi084.stdout:9/642: write d4/f19 [2055607,15796] 0 2024-02-15T18:27:06.586 INFO:tasks.workunit.client.0.smithi084.stdout:3/550: link d8/d1f/d25/l46 d8/d40/d43/d71/d8c/d94/da3/lbe 0 2024-02-15T18:27:06.587 INFO:tasks.workunit.client.1.smithi133.stdout:0/234: dwrite f6 [0,4194304] 0 2024-02-15T18:27:06.588 INFO:tasks.workunit.client.0.smithi084.stdout:9/643: symlink d4/d2b/d3c/d24/dca/d15/d4f/lcd 0 2024-02-15T18:27:06.588 INFO:tasks.workunit.client.0.smithi084.stdout:9/644: fdatasync d4/f9d 0 2024-02-15T18:27:06.589 INFO:tasks.workunit.client.0.smithi084.stdout:9/645: symlink d4/d2b/d3c/d20/lce 0 2024-02-15T18:27:06.590 INFO:tasks.workunit.client.1.smithi133.stdout:0/235: link d9/fe d9/d10/f52 0 2024-02-15T18:27:06.590 INFO:tasks.workunit.client.1.smithi133.stdout:0/236: stat d9/d10/d22/d32/f48 0 2024-02-15T18:27:06.590 INFO:tasks.workunit.client.0.smithi084.stdout:4/656: dwrite d2/d2b/d47/f3b [4194304,4194304] 0 2024-02-15T18:27:06.590 INFO:tasks.workunit.client.0.smithi084.stdout:4/657: fdatasync d2/f11 0 2024-02-15T18:27:06.591 INFO:tasks.workunit.client.0.smithi084.stdout:4/658: chown d2/d2b/lbe 2230393 1 2024-02-15T18:27:06.591 INFO:tasks.workunit.client.0.smithi084.stdout:9/646: symlink d4/lcf 0 2024-02-15T18:27:06.593 INFO:tasks.workunit.client.0.smithi084.stdout:6/572: dread f9 [0,4194304] 0 2024-02-15T18:27:06.593 INFO:tasks.workunit.client.0.smithi084.stdout:6/573: write d14/d22/d25/f44 [1480407,117722] 0 2024-02-15T18:27:06.596 INFO:tasks.workunit.client.1.smithi133.stdout:8/262: write d3/f5 [1723383,99874] 0 2024-02-15T18:27:06.599 INFO:tasks.workunit.client.1.smithi133.stdout:8/263: mknod d3/d1f/d3f/d58/c5b 0 2024-02-15T18:27:06.602 INFO:tasks.workunit.client.0.smithi084.stdout:1/513: dread d9/d54/f82 [0,4194304] 0 2024-02-15T18:27:06.604 INFO:tasks.workunit.client.0.smithi084.stdout:1/514: write d9/d54/d1b/d2c/d4b/d7a/d89/f9a [2583527,3824] 0 2024-02-15T18:27:06.606 INFO:tasks.workunit.client.0.smithi084.stdout:9/647: mknod d4/d2b/d3c/d24/dca/cd0 0 2024-02-15T18:27:06.606 INFO:tasks.workunit.client.1.smithi133.stdout:3/316: dwrite d0/d15/d2b/d39/d3f/f20 [0,4194304] 0 2024-02-15T18:27:06.606 INFO:tasks.workunit.client.0.smithi084.stdout:6/574: mkdir d14/d22/d25/d2f/d31/d3f/dba 0 2024-02-15T18:27:06.607 INFO:tasks.workunit.client.0.smithi084.stdout:4/659: dread d2/d64/d74/fb7 [0,4194304] 0 2024-02-15T18:27:06.607 INFO:tasks.workunit.client.0.smithi084.stdout:1/515: rmdir d9/d54/d1b/d2c/d4b/d4c/d79/d39 39 2024-02-15T18:27:06.607 INFO:tasks.workunit.client.1.smithi133.stdout:3/317: read d0/d15/f3b [1646178,63595] 0 2024-02-15T18:27:06.608 INFO:tasks.workunit.client.1.smithi133.stdout:3/318: chown d0/d15/d37/d4a 2561 1 2024-02-15T18:27:06.608 INFO:tasks.workunit.client.1.smithi133.stdout:3/319: chown d0/d15/d37/f48 35780 1 2024-02-15T18:27:06.609 INFO:tasks.workunit.client.0.smithi084.stdout:6/575: mkdir d14/dbb 0 2024-02-15T18:27:06.609 INFO:tasks.workunit.client.1.smithi133.stdout:2/290: sync 2024-02-15T18:27:06.610 INFO:tasks.workunit.client.0.smithi084.stdout:3/551: dread d8/d40/fa2 [0,4194304] 0 2024-02-15T18:27:06.611 INFO:tasks.workunit.client.1.smithi133.stdout:3/320: creat d0/d15/d37/d4a/f60 x:0 0 0 2024-02-15T18:27:06.612 INFO:tasks.workunit.client.0.smithi084.stdout:4/660: rename d2/d2b/d47/d31/d50 to d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4 0 2024-02-15T18:27:06.614 INFO:tasks.workunit.client.0.smithi084.stdout:6/576: dread d14/d22/d25/d2f/d31/d30/d45/d52/f53 [0,4194304] 0 2024-02-15T18:27:06.614 INFO:tasks.workunit.client.0.smithi084.stdout:1/516: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/db2 0 2024-02-15T18:27:06.614 INFO:tasks.workunit.client.0.smithi084.stdout:6/577: read d14/d22/d25/d2f/d31/f79 [3018595,50673] 0 2024-02-15T18:27:06.614 INFO:tasks.workunit.client.0.smithi084.stdout:9/648: rmdir d4/d2b/d3c/d24/dca/d15/d33 39 2024-02-15T18:27:06.616 INFO:tasks.workunit.client.0.smithi084.stdout:3/552: rename d8/d22 to d8/d1f/dbf 0 2024-02-15T18:27:06.617 INFO:tasks.workunit.client.1.smithi133.stdout:0/237: dwrite d9/d10/f52 [0,4194304] 0 2024-02-15T18:27:06.617 INFO:tasks.workunit.client.1.smithi133.stdout:0/238: chown d9/d10/l12 22105912 1 2024-02-15T18:27:06.617 INFO:tasks.workunit.client.0.smithi084.stdout:4/661: creat d2/d4/d28/d3d/d5c/dbc/d88/db0/fc5 x:0 0 0 2024-02-15T18:27:06.618 INFO:tasks.workunit.client.0.smithi084.stdout:1/517: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3 0 2024-02-15T18:27:06.620 INFO:tasks.workunit.client.1.smithi133.stdout:0/239: rename d9/d10/f35 to d9/d2b/f53 0 2024-02-15T18:27:06.621 INFO:tasks.workunit.client.1.smithi133.stdout:0/240: rename d9/f2d to d9/d10/f54 0 2024-02-15T18:27:06.621 INFO:tasks.workunit.client.0.smithi084.stdout:3/553: read d8/f15 [6325331,64955] 0 2024-02-15T18:27:06.622 INFO:tasks.workunit.client.1.smithi133.stdout:0/241: mknod d9/c55 0 2024-02-15T18:27:06.622 INFO:tasks.workunit.client.1.smithi133.stdout:0/242: chown d9/d10 20 1 2024-02-15T18:27:06.623 INFO:tasks.workunit.client.1.smithi133.stdout:0/243: mknod d9/d10/d47/c56 0 2024-02-15T18:27:06.623 INFO:tasks.workunit.client.0.smithi084.stdout:6/578: rename d14/d22/d25/d2f/d31/c5d to d14/d22/d25/d2f/d31/d30/d93/d99/cbc 0 2024-02-15T18:27:06.628 INFO:tasks.workunit.client.1.smithi133.stdout:3/321: dread d0/d15/d37/f48 [0,4194304] 0 2024-02-15T18:27:06.628 INFO:tasks.workunit.client.1.smithi133.stdout:3/322: fsync d0/d15/d37/f53 0 2024-02-15T18:27:06.628 INFO:tasks.workunit.client.1.smithi133.stdout:3/323: fsync d0/d15/d2b/d39/d3f/f22 0 2024-02-15T18:27:06.630 INFO:tasks.workunit.client.0.smithi084.stdout:4/662: unlink d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4/fb9 0 2024-02-15T18:27:06.631 INFO:tasks.workunit.client.0.smithi084.stdout:4/663: fdatasync d2/d64/d74/f78 0 2024-02-15T18:27:06.632 INFO:tasks.workunit.client.0.smithi084.stdout:3/554: creat d8/d40/d58/d80/d6b/fc0 x:0 0 0 2024-02-15T18:27:06.633 INFO:tasks.workunit.client.0.smithi084.stdout:3/555: write d8/d73/f86 [524932,114646] 0 2024-02-15T18:27:06.633 INFO:tasks.workunit.client.1.smithi133.stdout:2/291: dwrite d7/d18/d32/f4c [0,4194304] 0 2024-02-15T18:27:06.634 INFO:tasks.workunit.client.0.smithi084.stdout:3/556: read d8/d40/d58/f5e [2248576,125612] 0 2024-02-15T18:27:06.634 INFO:tasks.workunit.client.0.smithi084.stdout:9/649: dread d4/d2b/d3c/d20/d75/d87/fa8 [0,4194304] 0 2024-02-15T18:27:06.636 INFO:tasks.workunit.client.0.smithi084.stdout:4/664: symlink d2/lc6 0 2024-02-15T18:27:06.636 INFO:tasks.workunit.client.0.smithi084.stdout:3/557: read d8/f12 [2314745,4009] 0 2024-02-15T18:27:06.636 INFO:tasks.workunit.client.0.smithi084.stdout:3/558: truncate d8/d40/d43/d71/f81 1758377 0 2024-02-15T18:27:06.640 INFO:tasks.workunit.client.0.smithi084.stdout:6/579: write d14/f6f [1164100,68930] 0 2024-02-15T18:27:06.641 INFO:tasks.workunit.client.1.smithi133.stdout:0/244: truncate d9/d2b/f45 3257810 0 2024-02-15T18:27:06.642 INFO:tasks.workunit.client.1.smithi133.stdout:0/245: write f7 [414449,38411] 0 2024-02-15T18:27:06.643 INFO:tasks.workunit.client.1.smithi133.stdout:2/292: truncate d7/d2c/d3b/f50 60297 0 2024-02-15T18:27:06.645 INFO:tasks.workunit.client.0.smithi084.stdout:4/665: read d2/d4/f8 [862132,8340] 0 2024-02-15T18:27:06.649 INFO:tasks.workunit.client.1.smithi133.stdout:0/246: rename d9/d1c/l26 to d9/d10/d47/l57 0 2024-02-15T18:27:06.649 INFO:tasks.workunit.client.1.smithi133.stdout:2/293: mkdir d7/d2c/d5a 0 2024-02-15T18:27:06.651 INFO:tasks.workunit.client.1.smithi133.stdout:2/294: mkdir d7/db/d35/d4a/d58/d5b 0 2024-02-15T18:27:06.654 INFO:tasks.workunit.client.0.smithi084.stdout:3/559: dread d8/d40/d58/d80/f3c [0,4194304] 0 2024-02-15T18:27:06.654 INFO:tasks.workunit.client.0.smithi084.stdout:1/518: dwrite d9/d54/f82 [0,4194304] 0 2024-02-15T18:27:06.654 INFO:tasks.workunit.client.0.smithi084.stdout:3/560: write d8/d1f/d2d/fb2 [1001115,80534] 0 2024-02-15T18:27:06.654 INFO:tasks.workunit.client.0.smithi084.stdout:3/561: stat d8/d40/d43/d71/d8c/c99 0 2024-02-15T18:27:06.657 INFO:tasks.workunit.client.1.smithi133.stdout:2/295: rename d7/db/c1f to d7/d2c/d3b/d48/c5c 0 2024-02-15T18:27:06.658 INFO:tasks.workunit.client.0.smithi084.stdout:1/519: rename d9/d54/d1b/d2c/d4b/d4c/d79/d36/c88 to d9/d54/d32/d5b/cb4 0 2024-02-15T18:27:06.659 INFO:tasks.workunit.client.0.smithi084.stdout:1/520: dread - d9/d54/d76/f80 zero size 2024-02-15T18:27:06.659 INFO:tasks.workunit.client.1.smithi133.stdout:2/296: unlink d7/d18/l1e 0 2024-02-15T18:27:06.659 INFO:tasks.workunit.client.0.smithi084.stdout:3/562: link d8/d40/d43/l47 d8/d1f/lc1 0 2024-02-15T18:27:06.660 INFO:tasks.workunit.client.0.smithi084.stdout:3/563: dread - d8/fb3 zero size 2024-02-15T18:27:06.665 INFO:tasks.workunit.client.1.smithi133.stdout:2/297: dread d7/f26 [0,4194304] 0 2024-02-15T18:27:06.667 INFO:tasks.workunit.client.1.smithi133.stdout:2/298: creat d7/db/d35/d4a/d58/f5d x:0 0 0 2024-02-15T18:27:06.671 INFO:tasks.workunit.client.1.smithi133.stdout:2/299: mknod d7/db/d35/d4a/d54/c5e 0 2024-02-15T18:27:06.671 INFO:tasks.workunit.client.1.smithi133.stdout:2/300: creat d7/d2c/d31/f5f x:0 0 0 2024-02-15T18:27:06.671 INFO:tasks.workunit.client.1.smithi133.stdout:2/301: creat d7/d2c/d5a/f60 x:0 0 0 2024-02-15T18:27:06.672 INFO:tasks.workunit.client.0.smithi084.stdout:1/521: dread d9/d54/f82 [0,4194304] 0 2024-02-15T18:27:06.673 INFO:tasks.workunit.client.0.smithi084.stdout:1/522: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5 0 2024-02-15T18:27:06.677 INFO:tasks.workunit.client.1.smithi133.stdout:2/302: creat d7/d2c/d3b/d48/d59/f61 x:0 0 0 2024-02-15T18:27:06.677 INFO:tasks.workunit.client.1.smithi133.stdout:2/303: getdents d7/db/d35/d4a/d58/d5b 0 2024-02-15T18:27:06.677 INFO:tasks.workunit.client.1.smithi133.stdout:2/304: chown d7/d2c/d31/f4b 26083918 1 2024-02-15T18:27:06.677 INFO:tasks.workunit.client.1.smithi133.stdout:2/305: chown d7/db/d35/d4a/d58/d5b 2273 1 2024-02-15T18:27:06.678 INFO:tasks.workunit.client.0.smithi084.stdout:9/650: dwrite d4/d2b/d3c/d20/d75/d87/fa8 [0,4194304] 0 2024-02-15T18:27:06.679 INFO:tasks.workunit.client.1.smithi133.stdout:2/306: mknod d7/d2c/c62 0 2024-02-15T18:27:06.680 INFO:tasks.workunit.client.0.smithi084.stdout:1/523: write d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 [3642391,57634] 0 2024-02-15T18:27:06.681 INFO:tasks.workunit.client.0.smithi084.stdout:9/651: link d4/f9c d4/da3/db0/dc5/fd1 0 2024-02-15T18:27:06.682 INFO:tasks.workunit.client.0.smithi084.stdout:1/524: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db6 0 2024-02-15T18:27:06.682 INFO:tasks.workunit.client.0.smithi084.stdout:1/525: write d9/d54/d32/d5b/d69/fa3 [285983,85735] 0 2024-02-15T18:27:06.683 INFO:tasks.workunit.client.0.smithi084.stdout:9/652: link d4/d2b/d3c/d24/dca/ff d4/d2b/d3c/d24/dca/d15/d33/d7b/fd2 0 2024-02-15T18:27:06.683 INFO:tasks.workunit.client.0.smithi084.stdout:9/653: write d4/d2b/d3c/d24/dca/d15/d33/f53 [4237273,32921] 0 2024-02-15T18:27:06.684 INFO:tasks.workunit.client.0.smithi084.stdout:9/654: write d4/d2b/d3c/d24/dca/d15/d33/d7b/fd2 [4621334,81052] 0 2024-02-15T18:27:06.684 INFO:tasks.workunit.client.0.smithi084.stdout:1/526: truncate d9/d54/d32/d5b/f8d 425935 0 2024-02-15T18:27:06.685 INFO:tasks.workunit.client.0.smithi084.stdout:9/655: creat d4/d2b/d3c/d24/fd3 x:0 0 0 2024-02-15T18:27:06.687 INFO:tasks.workunit.client.0.smithi084.stdout:9/656: symlink d4/d2b/d3c/d24/dca/d15/d4f/ld4 0 2024-02-15T18:27:06.688 INFO:tasks.workunit.client.0.smithi084.stdout:9/657: write d4/d2b/d3c/d24/dca/d15/d4b/f51 [265393,44239] 0 2024-02-15T18:27:06.688 INFO:tasks.workunit.client.0.smithi084.stdout:9/658: chown d4/da3/la4 1 1 2024-02-15T18:27:06.689 INFO:tasks.workunit.client.1.smithi133.stdout:2/307: dread d7/f13 [0,4194304] 0 2024-02-15T18:27:06.689 INFO:tasks.workunit.client.1.smithi133.stdout:2/308: write d7/ff [3132476,123183] 0 2024-02-15T18:27:06.689 INFO:tasks.workunit.client.1.smithi133.stdout:2/309: write d7/d2c/d5a/f60 [223486,115056] 0 2024-02-15T18:27:06.691 INFO:tasks.workunit.client.0.smithi084.stdout:6/580: dwrite d14/d22/d25/d2f/d31/f79 [4194304,4194304] 0 2024-02-15T18:27:06.691 INFO:tasks.workunit.client.1.smithi133.stdout:3/324: dwrite d0/f50 [0,4194304] 0 2024-02-15T18:27:06.693 INFO:tasks.workunit.client.0.smithi084.stdout:9/659: write d4/d2b/f50 [1469387,44084] 0 2024-02-15T18:27:06.694 INFO:tasks.workunit.client.0.smithi084.stdout:6/581: mkdir d14/d22/d25/d2f/d31/d30/d45/d54/dbd 0 2024-02-15T18:27:06.695 INFO:tasks.workunit.client.0.smithi084.stdout:4/666: dwrite d2/d2b/d47/d31/f43 [0,4194304] 0 2024-02-15T18:27:06.697 INFO:tasks.workunit.client.0.smithi084.stdout:9/660: creat d4/d2b/d3c/d24/dca/d15/fd5 x:0 0 0 2024-02-15T18:27:06.697 INFO:tasks.workunit.client.0.smithi084.stdout:3/564: dwrite d8/d40/f70 [0,4194304] 0 2024-02-15T18:27:06.697 INFO:tasks.workunit.client.0.smithi084.stdout:3/565: chown d8/fac 2570 1 2024-02-15T18:27:06.698 INFO:tasks.workunit.client.1.smithi133.stdout:0/247: dwrite d9/d28/f36 [0,4194304] 0 2024-02-15T18:27:06.698 INFO:tasks.workunit.client.1.smithi133.stdout:3/325: write d0/d15/d2b/f58 [3925123,18365] 0 2024-02-15T18:27:06.711 INFO:tasks.workunit.client.0.smithi084.stdout:1/527: dwrite d9/d54/d5c/d81/f6c [0,4194304] 0 2024-02-15T18:27:06.711 INFO:tasks.workunit.client.1.smithi133.stdout:0/248: getdents d9/d10/d2c 0 2024-02-15T18:27:06.711 INFO:tasks.workunit.client.1.smithi133.stdout:3/326: unlink d0/d15/d2b/c2c 0 2024-02-15T18:27:06.715 INFO:tasks.workunit.client.1.smithi133.stdout:3/327: rename d0/d15/d2f/l38 to d0/d15/l61 0 2024-02-15T18:27:06.715 INFO:tasks.workunit.client.1.smithi133.stdout:3/328: chown d0/c36 10 1 2024-02-15T18:27:06.716 INFO:tasks.workunit.client.0.smithi084.stdout:1/528: write d9/d54/d1b/d2c/d4b/d63/f6a [1967191,118037] 0 2024-02-15T18:27:06.717 INFO:tasks.workunit.client.0.smithi084.stdout:1/529: fdatasync d9/d54/f82 0 2024-02-15T18:27:06.720 INFO:tasks.workunit.client.1.smithi133.stdout:3/329: read d0/d15/d37/f48 [350629,52516] 0 2024-02-15T18:27:06.721 INFO:tasks.workunit.client.1.smithi133.stdout:2/310: dwrite d7/d2c/d31/f4b [4194304,4194304] 0 2024-02-15T18:27:06.723 INFO:tasks.workunit.client.0.smithi084.stdout:9/661: creat d4/fd6 x:0 0 0 2024-02-15T18:27:06.727 INFO:tasks.workunit.client.1.smithi133.stdout:2/311: write d7/f14 [1161049,52818] 0 2024-02-15T18:27:06.727 INFO:tasks.workunit.client.1.smithi133.stdout:2/312: readlink d7/l12 0 2024-02-15T18:27:06.730 INFO:tasks.workunit.client.1.smithi133.stdout:2/313: symlink d7/d18/d32/l63 0 2024-02-15T18:27:06.736 INFO:tasks.workunit.client.0.smithi084.stdout:9/662: dread d4/f4d [0,4194304] 0 2024-02-15T18:27:06.739 INFO:tasks.workunit.client.0.smithi084.stdout:4/667: dwrite d2/d4/d28/d3d/f46 [0,4194304] 0 2024-02-15T18:27:06.739 INFO:tasks.workunit.client.0.smithi084.stdout:9/663: unlink d4/d2b/d3c/d20/c69 0 2024-02-15T18:27:06.739 INFO:tasks.workunit.client.0.smithi084.stdout:3/566: dwrite d8/d1f/d25/f75 [0,4194304] 0 2024-02-15T18:27:06.739 INFO:tasks.workunit.client.0.smithi084.stdout:3/567: chown d8/d1f/d2d/l66 54513804 1 2024-02-15T18:27:06.740 INFO:tasks.workunit.client.0.smithi084.stdout:6/582: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/fa4 [0,4194304] 0 2024-02-15T18:27:06.740 INFO:tasks.workunit.client.0.smithi084.stdout:3/568: truncate d8/fac 356367 0 2024-02-15T18:27:06.740 INFO:tasks.workunit.client.0.smithi084.stdout:3/569: fdatasync d8/fac 0 2024-02-15T18:27:06.740 INFO:tasks.workunit.client.0.smithi084.stdout:4/668: mknod d2/d4/d28/d2e/cc7 0 2024-02-15T18:27:06.741 INFO:tasks.workunit.client.0.smithi084.stdout:9/664: creat d4/d81/fd7 x:0 0 0 2024-02-15T18:27:06.742 INFO:tasks.workunit.client.0.smithi084.stdout:6/583: write d14/d22/d25/d2f/da9/f9e [2823859,120586] 0 2024-02-15T18:27:06.742 INFO:tasks.workunit.client.0.smithi084.stdout:6/584: write fb [3279698,100785] 0 2024-02-15T18:27:06.743 INFO:tasks.workunit.client.0.smithi084.stdout:3/570: truncate d8/d1f/d25/f8e 2182591 0 2024-02-15T18:27:06.744 INFO:tasks.workunit.client.0.smithi084.stdout:4/669: truncate d2/d64/d74/f7f 61928 0 2024-02-15T18:27:06.745 INFO:tasks.workunit.client.0.smithi084.stdout:9/665: fdatasync d4/d2b/d3c/d24/dca/d15/f44 0 2024-02-15T18:27:06.745 INFO:tasks.workunit.client.0.smithi084.stdout:3/571: read d8/d1f/d2d/f4f [1705409,45421] 0 2024-02-15T18:27:06.746 INFO:tasks.workunit.client.0.smithi084.stdout:4/670: rename d2/d2b/d47/d31/f86 to d2/d64/d74/fc8 0 2024-02-15T18:27:06.747 INFO:tasks.workunit.client.0.smithi084.stdout:4/671: mknod d2/d4/d28/d3d/d5c/dbc/d88/db0/cc9 0 2024-02-15T18:27:06.747 INFO:tasks.workunit.client.0.smithi084.stdout:4/672: truncate d2/d4/d28/f96 240670 0 2024-02-15T18:27:06.751 INFO:tasks.workunit.client.0.smithi084.stdout:4/673: write d2/d4/d28/d2e/f49 [3176481,96334] 0 2024-02-15T18:27:06.751 INFO:tasks.workunit.client.0.smithi084.stdout:4/674: truncate d2/d4/d28/d3d/d5c/d5d/f7e 661582 0 2024-02-15T18:27:06.751 INFO:tasks.workunit.client.0.smithi084.stdout:4/675: truncate d2/d4/d25/d66/fa3 1088560 0 2024-02-15T18:27:06.751 INFO:tasks.workunit.client.0.smithi084.stdout:4/676: truncate d2/d2b/d47/f3b 8293691 0 2024-02-15T18:27:06.752 INFO:tasks.workunit.client.0.smithi084.stdout:4/677: mknod d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/cca 0 2024-02-15T18:27:06.754 INFO:tasks.workunit.client.0.smithi084.stdout:4/678: truncate d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/f7d 63533 0 2024-02-15T18:27:06.757 INFO:tasks.workunit.client.0.smithi084.stdout:1/530: dwrite d9/d54/d1b/f56 [0,4194304] 0 2024-02-15T18:27:06.757 INFO:tasks.workunit.client.0.smithi084.stdout:9/666: dread d4/d2b/d67/f6d [0,4194304] 0 2024-02-15T18:27:06.757 INFO:tasks.workunit.client.0.smithi084.stdout:1/531: fdatasync d9/d54/d5c/d81/f6c 0 2024-02-15T18:27:06.758 INFO:tasks.workunit.client.1.smithi133.stdout:9/221: sync 2024-02-15T18:27:06.758 INFO:tasks.workunit.client.1.smithi133.stdout:1/457: sync 2024-02-15T18:27:06.758 INFO:tasks.workunit.client.1.smithi133.stdout:0/249: dwrite d9/fb [0,4194304] 0 2024-02-15T18:27:06.759 INFO:tasks.workunit.client.1.smithi133.stdout:3/330: dwrite d0/d15/d2b/f58 [0,4194304] 0 2024-02-15T18:27:06.759 INFO:tasks.workunit.client.1.smithi133.stdout:3/331: readlink d0/d15/d2b/d39/d3f/d3e/l42 0 2024-02-15T18:27:06.759 INFO:tasks.workunit.client.1.smithi133.stdout:2/314: dwrite d7/d2c/d31/f4b [4194304,4194304] 0 2024-02-15T18:27:06.759 INFO:tasks.workunit.client.1.smithi133.stdout:2/315: chown d7/db/d35/d4a/d54/f57 1006 1 2024-02-15T18:27:06.759 INFO:tasks.workunit.client.0.smithi084.stdout:6/585: dread d14/f38 [0,4194304] 0 2024-02-15T18:27:06.760 INFO:tasks.workunit.client.0.smithi084.stdout:3/572: read d8/d40/fa2 [3973350,82771] 0 2024-02-15T18:27:06.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/586: write d14/d22/d25/d2f/d31/d30/d45/fa2 [893260,123738] 0 2024-02-15T18:27:06.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:04.685678+0000 mgr.smithi084.hjmnez (mgr.14596) 20 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.2 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 79 MiB/s rd, 156 MiB/s wr, 295 op/s 2024-02-15T18:27:06.761 INFO:tasks.workunit.client.1.smithi133.stdout:9/222: creat d0/d8/d9/d12/d2a/d42/f45 x:0 0 0 2024-02-15T18:27:06.761 INFO:tasks.workunit.client.1.smithi133.stdout:9/223: chown d0/f16 1674 1 2024-02-15T18:27:06.761 INFO:tasks.workunit.client.1.smithi133.stdout:1/458: creat d6/d1e/d3a/d79/fab x:0 0 0 2024-02-15T18:27:06.762 INFO:tasks.workunit.client.1.smithi133.stdout:3/332: mkdir d0/d15/d2b/d62 0 2024-02-15T18:27:06.763 INFO:tasks.workunit.client.1.smithi133.stdout:3/333: chown d0/d15/d2b 5578 1 2024-02-15T18:27:06.763 INFO:tasks.workunit.client.0.smithi084.stdout:5/668: sync 2024-02-15T18:27:06.763 INFO:tasks.workunit.client.0.smithi084.stdout:7/539: sync 2024-02-15T18:27:06.763 INFO:tasks.workunit.client.0.smithi084.stdout:0/584: sync 2024-02-15T18:27:06.763 INFO:tasks.workunit.client.0.smithi084.stdout:8/635: sync 2024-02-15T18:27:06.763 INFO:tasks.workunit.client.0.smithi084.stdout:2/557: sync 2024-02-15T18:27:06.764 INFO:tasks.workunit.client.0.smithi084.stdout:8/636: chown fa 69 1 2024-02-15T18:27:06.764 INFO:tasks.workunit.client.0.smithi084.stdout:5/669: chown d9/d23/c54 38071 1 2024-02-15T18:27:06.764 INFO:tasks.workunit.client.0.smithi084.stdout:7/540: dread - df/f6e zero size 2024-02-15T18:27:06.764 INFO:tasks.workunit.client.0.smithi084.stdout:5/670: chown d9/d5b/d7e/db5/fbd 11 1 2024-02-15T18:27:06.764 INFO:tasks.workunit.client.0.smithi084.stdout:8/637: dread - db/dd/d4d/f70 zero size 2024-02-15T18:27:06.764 INFO:tasks.workunit.client.0.smithi084.stdout:5/671: truncate d9/d5f/d68/d9a/f9d 327498 0 2024-02-15T18:27:06.764 INFO:tasks.workunit.client.1.smithi133.stdout:2/316: creat d7/db/d35/d4a/d58/f64 x:0 0 0 2024-02-15T18:27:06.765 INFO:tasks.workunit.client.1.smithi133.stdout:1/459: truncate d6/d1e/d41/f54 241349 0 2024-02-15T18:27:06.773 INFO:tasks.workunit.client.1.smithi133.stdout:9/224: dread d0/d8/d9/ff [4194304,4194304] 0 2024-02-15T18:27:06.774 INFO:tasks.workunit.client.0.smithi084.stdout:0/585: dread d0/d4/d3a/f74 [0,4194304] 0 2024-02-15T18:27:06.774 INFO:tasks.workunit.client.0.smithi084.stdout:9/667: rename d4/d2b/d3c/d24/dca/d15/d4f/lcd to d4/d2b/d3c/d24/dca/d15/d4f/ld8 0 2024-02-15T18:27:06.775 INFO:tasks.workunit.client.0.smithi084.stdout:9/668: write d4/d2b/d3c/d24/dca/d15/f44 [2679896,3008] 0 2024-02-15T18:27:06.777 INFO:tasks.workunit.client.1.smithi133.stdout:9/225: link d0/l1f d0/d8/d9/d3c/l46 0 2024-02-15T18:27:06.777 INFO:tasks.workunit.client.1.smithi133.stdout:9/226: read d0/d8/d9/ff [6376179,92251] 0 2024-02-15T18:27:06.778 INFO:tasks.workunit.client.0.smithi084.stdout:3/573: creat d8/d40/d43/d71/fc2 x:0 0 0 2024-02-15T18:27:06.778 INFO:tasks.workunit.client.0.smithi084.stdout:1/532: truncate d9/d54/d1b/d2c/d4b/d4c/d79/f9c 726033 0 2024-02-15T18:27:06.779 INFO:tasks.workunit.client.0.smithi084.stdout:6/587: link d14/d22/d25/d2f/d31/c33 d14/d22/d25/d2f/da9/d9b/dac/cbe 0 2024-02-15T18:27:06.779 INFO:tasks.workunit.client.1.smithi133.stdout:9/227: creat d0/d8/f47 x:0 0 0 2024-02-15T18:27:06.782 INFO:tasks.workunit.client.0.smithi084.stdout:0/586: dread d0/d25/f2a [0,4194304] 0 2024-02-15T18:27:06.782 INFO:tasks.workunit.client.0.smithi084.stdout:3/574: stat d8/d40/d43/l6d 0 2024-02-15T18:27:06.782 INFO:tasks.workunit.client.0.smithi084.stdout:5/672: mknod d9/da/d3d/d44/d55/d70/d84/da1/cdc 0 2024-02-15T18:27:06.782 INFO:tasks.workunit.client.0.smithi084.stdout:7/541: dread df/d1d/d44/d8d/f8f [0,4194304] 0 2024-02-15T18:27:06.782 INFO:tasks.workunit.client.0.smithi084.stdout:7/542: dread - df/f6e zero size 2024-02-15T18:27:06.783 INFO:tasks.workunit.client.0.smithi084.stdout:5/673: write d9/d23/f2a [324042,10685] 0 2024-02-15T18:27:06.783 INFO:tasks.workunit.client.1.smithi133.stdout:0/250: dread d9/fc [0,4194304] 0 2024-02-15T18:27:06.783 INFO:tasks.workunit.client.1.smithi133.stdout:0/251: truncate d9/f1e 629241 0 2024-02-15T18:27:06.785 INFO:tasks.workunit.client.1.smithi133.stdout:3/334: write d0/fc [3213155,10885] 0 2024-02-15T18:27:06.786 INFO:tasks.workunit.client.1.smithi133.stdout:2/317: rename d7/db/d35/d4a to d7/d18/d32/d65 0 2024-02-15T18:27:06.787 INFO:tasks.workunit.client.0.smithi084.stdout:2/558: mkdir d3/d19/d24/db8 0 2024-02-15T18:27:06.787 INFO:tasks.workunit.client.0.smithi084.stdout:2/559: stat d3/d5/d1a/d1e/l1f 0 2024-02-15T18:27:06.787 INFO:tasks.workunit.client.1.smithi133.stdout:3/335: creat d0/d15/d2b/d39/f63 x:0 0 0 2024-02-15T18:27:06.788 INFO:tasks.workunit.client.1.smithi133.stdout:3/336: chown d0/d15/d2b/d39/d3f/f5f 1149 1 2024-02-15T18:27:06.788 INFO:tasks.workunit.client.1.smithi133.stdout:0/252: symlink d9/d10/d22/d2f/d30/d44/l58 0 2024-02-15T18:27:06.788 INFO:tasks.workunit.client.1.smithi133.stdout:0/253: write d9/fe [4605847,125686] 0 2024-02-15T18:27:06.788 INFO:tasks.workunit.client.1.smithi133.stdout:2/318: mkdir d7/d2c/d5a/d66 0 2024-02-15T18:27:06.788 INFO:tasks.workunit.client.1.smithi133.stdout:3/337: symlink d0/d15/d54/l64 0 2024-02-15T18:27:06.789 INFO:tasks.workunit.client.0.smithi084.stdout:7/543: creat df/fa8 x:0 0 0 2024-02-15T18:27:06.789 INFO:tasks.workunit.client.1.smithi133.stdout:0/254: mknod d9/d10/d22/d2f/d30/c59 0 2024-02-15T18:27:06.790 INFO:tasks.workunit.client.1.smithi133.stdout:2/319: truncate d7/f15 2867447 0 2024-02-15T18:27:06.790 INFO:tasks.workunit.client.1.smithi133.stdout:0/255: write d9/d1c/f3f [14055,122977] 0 2024-02-15T18:27:06.791 INFO:tasks.workunit.client.0.smithi084.stdout:5/674: creat d9/da/d3d/d44/d55/d70/fdd x:0 0 0 2024-02-15T18:27:06.791 INFO:tasks.workunit.client.1.smithi133.stdout:9/228: write d0/f6 [1179879,41153] 0 2024-02-15T18:27:06.791 INFO:tasks.workunit.client.1.smithi133.stdout:3/338: unlink d0/ld 0 2024-02-15T18:27:06.793 INFO:tasks.workunit.client.0.smithi084.stdout:2/560: mkdir d3/d5/d1a/d74/db9 0 2024-02-15T18:27:06.793 INFO:tasks.workunit.client.0.smithi084.stdout:2/561: stat d3/d5e/f7e 0 2024-02-15T18:27:06.795 INFO:tasks.workunit.client.0.smithi084.stdout:7/544: dread df/d1d/d1a/f2d [0,4194304] 0 2024-02-15T18:27:06.795 INFO:tasks.workunit.client.0.smithi084.stdout:5/675: unlink d9/da/d3d/d44/d55/d70/d84/laf 0 2024-02-15T18:27:06.797 INFO:tasks.workunit.client.0.smithi084.stdout:5/676: read d9/d5f/d68/d9a/fa6 [528865,121471] 0 2024-02-15T18:27:06.797 INFO:tasks.workunit.client.0.smithi084.stdout:6/588: write d14/d22/d25/d2f/d31/d3f/f74 [1057553,97159] 0 2024-02-15T18:27:06.797 INFO:tasks.workunit.client.1.smithi133.stdout:1/460: dwrite d6/d1e/d3a/d82/d85/d67/f87 [0,4194304] 0 2024-02-15T18:27:06.797 INFO:tasks.workunit.client.1.smithi133.stdout:1/461: getdents d6/d2a/d59/d5a/da4/daa 0 2024-02-15T18:27:06.797 INFO:tasks.workunit.client.1.smithi133.stdout:2/320: dread d7/db/f43 [0,4194304] 0 2024-02-15T18:27:06.797 INFO:tasks.workunit.client.1.smithi133.stdout:0/256: link d9/d10/d22/d32/f40 d9/d10/d47/f5a 0 2024-02-15T18:27:06.798 INFO:tasks.workunit.client.1.smithi133.stdout:3/339: mknod d0/d15/c65 0 2024-02-15T18:27:06.798 INFO:tasks.workunit.client.0.smithi084.stdout:2/562: unlink d3/d19/d24/f26 0 2024-02-15T18:27:06.799 INFO:tasks.workunit.client.0.smithi084.stdout:7/545: truncate df/d1d/f18 2803097 0 2024-02-15T18:27:06.800 INFO:tasks.workunit.client.0.smithi084.stdout:5/677: mknod d9/d5b/d7e/db5/cde 0 2024-02-15T18:27:06.800 INFO:tasks.workunit.client.1.smithi133.stdout:1/462: creat d6/d17/fac x:0 0 0 2024-02-15T18:27:06.800 INFO:tasks.workunit.client.0.smithi084.stdout:6/589: creat d14/d22/d25/d2f/d31/d3f/fbf x:0 0 0 2024-02-15T18:27:06.803 INFO:tasks.workunit.client.0.smithi084.stdout:2/563: rename d3/d28/l73 to d3/d5/d1a/d1e/d47/lba 0 2024-02-15T18:27:06.803 INFO:tasks.workunit.client.0.smithi084.stdout:2/564: rename d3/d5/d1a/d1e to d3/d5/d1a/d1e/d4b/dbb 22 2024-02-15T18:27:06.804 INFO:tasks.workunit.client.0.smithi084.stdout:7/546: rename df/d1d/d1a/d6a/d8e/c5d to df/d1d/d1a/d6a/d8e/ca9 0 2024-02-15T18:27:06.805 INFO:tasks.workunit.client.1.smithi133.stdout:3/340: mknod d0/d15/c66 0 2024-02-15T18:27:06.806 INFO:tasks.workunit.client.1.smithi133.stdout:2/321: mkdir d7/db/d67 0 2024-02-15T18:27:06.806 INFO:tasks.workunit.client.1.smithi133.stdout:2/322: fdatasync d7/db/d35/f3d 0 2024-02-15T18:27:06.807 INFO:tasks.workunit.client.1.smithi133.stdout:2/323: chown d7/db/f43 0 1 2024-02-15T18:27:06.807 INFO:tasks.workunit.client.1.smithi133.stdout:2/324: chown d7 8717 1 2024-02-15T18:27:06.807 INFO:tasks.workunit.client.0.smithi084.stdout:7/547: creat df/d1d/d1a/d6a/d8e/faa x:0 0 0 2024-02-15T18:27:06.808 INFO:tasks.workunit.client.1.smithi133.stdout:3/341: creat d0/d15/f67 x:0 0 0 2024-02-15T18:27:06.808 INFO:tasks.workunit.client.1.smithi133.stdout:3/342: write d0/d15/d37/f59 [1008085,78642] 0 2024-02-15T18:27:06.808 INFO:tasks.workunit.client.0.smithi084.stdout:7/548: symlink df/d70/d9c/lab 0 2024-02-15T18:27:06.808 INFO:tasks.workunit.client.1.smithi133.stdout:2/325: creat d7/d2c/f68 x:0 0 0 2024-02-15T18:27:06.809 INFO:tasks.workunit.client.1.smithi133.stdout:3/343: creat d0/d15/d2f/f68 x:0 0 0 2024-02-15T18:27:06.812 INFO:tasks.workunit.client.1.smithi133.stdout:2/326: link d7/f26 d7/d2c/d3b/d48/d59/f69 0 2024-02-15T18:27:06.815 INFO:tasks.workunit.client.0.smithi084.stdout:9/669: getdents d4/d2b/d3c/d24/dca/d15/d4f 0 2024-02-15T18:27:06.818 INFO:tasks.workunit.client.0.smithi084.stdout:3/575: dread d8/f21 [0,4194304] 0 2024-02-15T18:27:06.822 INFO:tasks.workunit.client.0.smithi084.stdout:9/670: read d4/d3d/f7e [1554438,99391] 0 2024-02-15T18:27:06.822 INFO:tasks.workunit.client.0.smithi084.stdout:9/671: readlink d4/d2b/d3c/lb9 0 2024-02-15T18:27:06.822 INFO:tasks.workunit.client.0.smithi084.stdout:9/672: stat d4/da3/db0/dc5 0 2024-02-15T18:27:06.822 INFO:tasks.workunit.client.0.smithi084.stdout:2/565: dread d3/d5/d1a/d74/fac [0,4194304] 0 2024-02-15T18:27:06.822 INFO:tasks.workunit.client.0.smithi084.stdout:2/566: readlink d3/d5/d53/lae 0 2024-02-15T18:27:06.822 INFO:tasks.workunit.client.0.smithi084.stdout:3/576: symlink d8/d73/db9/lc3 0 2024-02-15T18:27:06.822 INFO:tasks.workunit.client.0.smithi084.stdout:9/673: creat d4/d81/fd9 x:0 0 0 2024-02-15T18:27:06.825 INFO:tasks.workunit.client.0.smithi084.stdout:3/577: readlink d8/d1f/dbf/l69 0 2024-02-15T18:27:06.825 INFO:tasks.workunit.client.0.smithi084.stdout:2/567: mknod d3/d5/d1a/d1e/d47/cbc 0 2024-02-15T18:27:06.825 INFO:tasks.workunit.client.0.smithi084.stdout:2/568: stat d3/d5/d1a/l2b 0 2024-02-15T18:27:06.825 INFO:tasks.workunit.client.0.smithi084.stdout:2/569: chown d3/d5/d1a/f4e 160751 1 2024-02-15T18:27:06.825 INFO:tasks.workunit.client.0.smithi084.stdout:2/570: chown d3/d5/d1a/d1e/d30/l97 2 1 2024-02-15T18:27:06.825 INFO:tasks.workunit.client.0.smithi084.stdout:2/571: dread - d3/d5/d1a/d74/d8e/d96/fa9 zero size 2024-02-15T18:27:06.826 INFO:tasks.workunit.client.0.smithi084.stdout:9/674: rmdir d4/d3d/da5 39 2024-02-15T18:27:06.827 INFO:tasks.workunit.client.0.smithi084.stdout:9/675: chown d4/d2b/d3c/d24/fd3 0 1 2024-02-15T18:27:06.827 INFO:tasks.workunit.client.0.smithi084.stdout:9/676: read - d4/fd6 zero size 2024-02-15T18:27:06.827 INFO:tasks.workunit.client.1.smithi133.stdout:2/327: truncate d7/f14 67668 0 2024-02-15T18:27:06.829 INFO:tasks.workunit.client.1.smithi133.stdout:2/328: creat d7/d2c/d31/f6a x:0 0 0 2024-02-15T18:27:06.830 INFO:tasks.workunit.client.0.smithi084.stdout:8/638: dwrite db/dd/d4d/d97/f9a [0,4194304] 0 2024-02-15T18:27:06.830 INFO:tasks.workunit.client.0.smithi084.stdout:8/639: chown db/d3f/d59/f28 0 1 2024-02-15T18:27:06.830 INFO:tasks.workunit.client.0.smithi084.stdout:8/640: stat db/d1a/d5e 0 2024-02-15T18:27:06.830 INFO:tasks.workunit.client.0.smithi084.stdout:8/641: chown db/dd/d1f/d7a/da8/dd0/fad 213698 1 2024-02-15T18:27:06.831 INFO:tasks.workunit.client.0.smithi084.stdout:8/642: rename db/d3f/d59/d69 to db/d3f/d59/d69/dd1 22 2024-02-15T18:27:06.831 INFO:tasks.workunit.client.0.smithi084.stdout:2/572: write d3/ff [1892266,78428] 0 2024-02-15T18:27:06.831 INFO:tasks.workunit.client.0.smithi084.stdout:4/679: dwrite d2/d2b/d47/d31/f9e [0,4194304] 0 2024-02-15T18:27:06.832 INFO:tasks.workunit.client.1.smithi133.stdout:2/329: write d7/db/f1d [4381043,79243] 0 2024-02-15T18:27:06.832 INFO:tasks.workunit.client.0.smithi084.stdout:2/573: read d3/d5/d1a/f4e [1074546,108695] 0 2024-02-15T18:27:06.833 INFO:tasks.workunit.client.1.smithi133.stdout:9/229: getdents d0/d8/d9/d3c 0 2024-02-15T18:27:06.833 INFO:tasks.workunit.client.0.smithi084.stdout:4/680: read d2/f34 [1353837,106796] 0 2024-02-15T18:27:06.835 INFO:tasks.workunit.client.0.smithi084.stdout:8/643: mknod db/dd/d13/d42/d79/da6/cd2 0 2024-02-15T18:27:06.835 INFO:tasks.workunit.client.0.smithi084.stdout:8/644: chown db/dd/d13/d42/d90/c95 27556 1 2024-02-15T18:27:06.838 INFO:tasks.workunit.client.1.smithi133.stdout:9/230: creat d0/d8/f48 x:0 0 0 2024-02-15T18:27:06.838 INFO:tasks.workunit.client.0.smithi084.stdout:3/578: write d8/d73/f9f [2144868,35973] 0 2024-02-15T18:27:06.839 INFO:tasks.workunit.client.0.smithi084.stdout:2/574: truncate d3/d28/f45 5068574 0 2024-02-15T18:27:06.841 INFO:tasks.workunit.client.0.smithi084.stdout:4/681: mknod d2/d4/d28/d3d/ccb 0 2024-02-15T18:27:06.841 INFO:tasks.workunit.client.0.smithi084.stdout:9/677: write d4/d2b/d3c/d20/f5a [7205057,26498] 0 2024-02-15T18:27:06.841 INFO:tasks.workunit.client.0.smithi084.stdout:9/678: readlink d4/d36/l7d 0 2024-02-15T18:27:06.841 INFO:tasks.workunit.client.0.smithi084.stdout:4/682: readlink d2/d2b/d47/l3a 0 2024-02-15T18:27:06.842 INFO:tasks.workunit.client.0.smithi084.stdout:9/679: read d4/d2b/d3c/d20/f62 [4021773,5040] 0 2024-02-15T18:27:06.842 INFO:tasks.workunit.client.0.smithi084.stdout:4/683: write d2/d4/d25/f4a [18716,54546] 0 2024-02-15T18:27:06.842 INFO:tasks.workunit.client.0.smithi084.stdout:4/684: chown d2/d2b/d47/l30 156375 1 2024-02-15T18:27:06.843 INFO:tasks.workunit.client.0.smithi084.stdout:2/575: mkdir d3/d5/dbd 0 2024-02-15T18:27:06.843 INFO:tasks.workunit.client.0.smithi084.stdout:2/576: chown d3/f42 2090 1 2024-02-15T18:27:06.844 INFO:tasks.workunit.client.1.smithi133.stdout:9/231: rmdir d0/d8/d9 39 2024-02-15T18:27:06.847 INFO:tasks.workunit.client.0.smithi084.stdout:1/533: dwrite d9/d54/d1b/d2c/f43 [0,4194304] 0 2024-02-15T18:27:06.848 INFO:tasks.workunit.client.0.smithi084.stdout:6/590: dwrite d14/d22/d25/d41/f68 [0,4194304] 0 2024-02-15T18:27:06.849 INFO:tasks.workunit.client.0.smithi084.stdout:4/685: rename d2/d4/d28/d3d/d5c/dbc/l70 to d2/d4/d28/d2e/lcc 0 2024-02-15T18:27:06.849 INFO:tasks.workunit.client.0.smithi084.stdout:1/534: write d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 [3307502,76222] 0 2024-02-15T18:27:06.849 INFO:tasks.workunit.client.0.smithi084.stdout:3/579: mkdir d8/d40/d58/d80/dc4 0 2024-02-15T18:27:06.852 INFO:tasks.workunit.client.0.smithi084.stdout:6/591: link d14/d22/d25/d2f/d31/d30/d45/c83 d14/d22/d25/d28/dab/cc0 0 2024-02-15T18:27:06.853 INFO:tasks.workunit.client.0.smithi084.stdout:5/678: dwrite d9/d35/f58 [0,4194304] 0 2024-02-15T18:27:06.853 INFO:tasks.workunit.client.0.smithi084.stdout:5/679: chown d9/d5b/cba 2077 1 2024-02-15T18:27:06.853 INFO:tasks.workunit.client.0.smithi084.stdout:3/580: dread d8/fac [0,4194304] 0 2024-02-15T18:27:06.853 INFO:tasks.workunit.client.0.smithi084.stdout:3/581: chown d8/l63 118782674 1 2024-02-15T18:27:06.855 INFO:tasks.workunit.client.0.smithi084.stdout:0/587: dwrite d0/d25/f67 [0,4194304] 0 2024-02-15T18:27:06.855 INFO:tasks.workunit.client.0.smithi084.stdout:0/588: readlink d0/d1e/l75 0 2024-02-15T18:27:06.855 INFO:tasks.workunit.client.0.smithi084.stdout:0/589: chown d0/d1e/da2 30471571 1 2024-02-15T18:27:06.857 INFO:tasks.workunit.client.0.smithi084.stdout:3/582: chown d8/d1f/dbf/ca5 6 1 2024-02-15T18:27:06.864 INFO:tasks.workunit.client.1.smithi133.stdout:5/219: sync 2024-02-15T18:27:06.864 INFO:tasks.workunit.client.1.smithi133.stdout:7/189: sync 2024-02-15T18:27:06.866 INFO:tasks.workunit.client.0.smithi084.stdout:0/590: creat d0/d1e/da2/fb2 x:0 0 0 2024-02-15T18:27:06.866 INFO:tasks.workunit.client.0.smithi084.stdout:2/577: dread d3/d5/d1a/d1e/d4b/da6/f8c [4194304,4194304] 0 2024-02-15T18:27:06.866 INFO:tasks.workunit.client.0.smithi084.stdout:4/686: dread d2/d4/d28/d3d/d5c/d5d/f7e [0,4194304] 0 2024-02-15T18:27:06.866 INFO:tasks.workunit.client.0.smithi084.stdout:2/578: write d3/f42 [449932,91977] 0 2024-02-15T18:27:06.866 INFO:tasks.workunit.client.1.smithi133.stdout:5/220: link d17/d20/f28 d17/f46 0 2024-02-15T18:27:06.866 INFO:tasks.workunit.client.1.smithi133.stdout:5/221: read - d17/d2a/f3b zero size 2024-02-15T18:27:06.867 INFO:tasks.workunit.client.0.smithi084.stdout:3/583: mkdir d8/d1f/d2d/dc5 0 2024-02-15T18:27:06.867 INFO:tasks.workunit.client.0.smithi084.stdout:3/584: chown d8/d40/d43/d71/d8c/d94/da3/lbe 93900758 1 2024-02-15T18:27:06.868 INFO:tasks.workunit.client.0.smithi084.stdout:3/585: readlink d8/d40/d43/d71/d8c/d94/da3/lbe 0 2024-02-15T18:27:06.868 INFO:tasks.workunit.client.0.smithi084.stdout:3/586: dread - d8/d1f/d2d/f96 zero size 2024-02-15T18:27:06.868 INFO:tasks.workunit.client.0.smithi084.stdout:0/591: rmdir d0/d4/d3a/d5c 39 2024-02-15T18:27:06.869 INFO:tasks.workunit.client.1.smithi133.stdout:5/222: rename d17/d20/f28 to d17/f47 0 2024-02-15T18:27:06.871 INFO:tasks.workunit.client.1.smithi133.stdout:5/223: link d17/f36 d17/d20/d32/d38/f48 0 2024-02-15T18:27:06.872 INFO:tasks.workunit.client.0.smithi084.stdout:2/579: creat d3/d19/d75/fbe x:0 0 0 2024-02-15T18:27:06.873 INFO:tasks.workunit.client.1.smithi133.stdout:0/257: dwrite d9/d10/d19/f3d [4194304,4194304] 0 2024-02-15T18:27:06.875 INFO:tasks.workunit.client.0.smithi084.stdout:3/587: mknod d8/d1f/cc6 0 2024-02-15T18:27:06.875 INFO:tasks.workunit.client.0.smithi084.stdout:3/588: fsync d8/d1f/d25/f7f 0 2024-02-15T18:27:06.876 INFO:tasks.workunit.client.1.smithi133.stdout:0/258: symlink d9/d2b/l5b 0 2024-02-15T18:27:06.876 INFO:tasks.workunit.client.1.smithi133.stdout:0/259: chown d9/d10/d22/d2f/d30/c59 3665028 1 2024-02-15T18:27:06.876 INFO:tasks.workunit.client.0.smithi084.stdout:2/580: symlink d3/d19/d24/db8/lbf 0 2024-02-15T18:27:06.877 INFO:tasks.workunit.client.0.smithi084.stdout:2/581: chown d3/d5e 181016368 1 2024-02-15T18:27:06.877 INFO:tasks.workunit.client.0.smithi084.stdout:2/582: readlink d3/d5/d1a/d2d/lb3 0 2024-02-15T18:27:06.877 INFO:tasks.workunit.client.1.smithi133.stdout:2/330: dwrite d7/d18/f40 [0,4194304] 0 2024-02-15T18:27:06.878 INFO:tasks.workunit.client.1.smithi133.stdout:2/331: dread d7/f26 [0,4194304] 0 2024-02-15T18:27:06.880 INFO:tasks.workunit.client.0.smithi084.stdout:2/583: link d3/d19/d24/d89/f72 d3/d5/d1a/d1e/d47/d76/fc0 0 2024-02-15T18:27:06.882 INFO:tasks.workunit.client.0.smithi084.stdout:5/680: dwrite d9/da/d3d/d44/d55/d70/d84/da1/f9f [4194304,4194304] 0 2024-02-15T18:27:06.886 INFO:tasks.workunit.client.1.smithi133.stdout:1/463: dwrite d6/f90 [0,4194304] 0 2024-02-15T18:27:06.886 INFO:tasks.workunit.client.1.smithi133.stdout:1/464: dread - d6/d2a/d59/d5a/f9b zero size 2024-02-15T18:27:06.891 INFO:tasks.workunit.client.1.smithi133.stdout:1/465: rename d6/f15 to d6/d2a/d59/fad 0 2024-02-15T18:27:06.891 INFO:tasks.workunit.client.1.smithi133.stdout:5/224: dread f15 [0,4194304] 0 2024-02-15T18:27:06.891 INFO:tasks.workunit.client.0.smithi084.stdout:6/592: truncate fb 2090050 0 2024-02-15T18:27:06.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:04.685678+0000 mgr.smithi084.hjmnez (mgr.14596) 20 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 1.2 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 79 MiB/s rd, 156 MiB/s wr, 295 op/s 2024-02-15T18:27:06.892 INFO:tasks.workunit.client.1.smithi133.stdout:0/260: dread f4 [0,4194304] 0 2024-02-15T18:27:06.892 INFO:tasks.workunit.client.1.smithi133.stdout:5/225: symlink d17/d26/l49 0 2024-02-15T18:27:06.893 INFO:tasks.workunit.client.0.smithi084.stdout:9/680: dwrite d4/d2b/d3c/d24/dca/f95 [0,4194304] 0 2024-02-15T18:27:06.893 INFO:tasks.workunit.client.0.smithi084.stdout:8/645: dwrite db/dd/d4d/f7c [4194304,4194304] 0 2024-02-15T18:27:06.894 INFO:tasks.workunit.client.0.smithi084.stdout:5/681: dread d9/d23/f37 [0,4194304] 0 2024-02-15T18:27:06.895 INFO:tasks.workunit.client.1.smithi133.stdout:5/226: creat d17/f4a x:0 0 0 2024-02-15T18:27:06.901 INFO:tasks.workunit.client.1.smithi133.stdout:0/261: write d9/d2b/f45 [1179328,26494] 0 2024-02-15T18:27:06.904 INFO:tasks.workunit.client.0.smithi084.stdout:9/681: mknod d4/d2b/d3c/d24/dca/dc6/cda 0 2024-02-15T18:27:06.904 INFO:tasks.workunit.client.0.smithi084.stdout:8/646: symlink db/dd/d13/d42/d79/ld3 0 2024-02-15T18:27:06.905 INFO:tasks.workunit.client.1.smithi133.stdout:0/262: symlink d9/d10/d22/d2f/d30/l5c 0 2024-02-15T18:27:06.905 INFO:tasks.workunit.client.1.smithi133.stdout:0/263: chown d9/l41 406772 1 2024-02-15T18:27:06.907 INFO:tasks.workunit.client.1.smithi133.stdout:0/264: creat d9/d10/d2c/f5d x:0 0 0 2024-02-15T18:27:06.907 INFO:tasks.workunit.client.0.smithi084.stdout:6/593: rename d14/d22/d25/d41/f68 to d14/d22/d25/d2f/fc1 0 2024-02-15T18:27:06.912 INFO:tasks.workunit.client.0.smithi084.stdout:6/594: rmdir d14/d22/d25/d2f/d31/d30/d45/d54/dbd 0 2024-02-15T18:27:06.912 INFO:tasks.workunit.client.0.smithi084.stdout:5/682: rename d9/d23/c54 to d9/da/d3d/d44/d55/cdf 0 2024-02-15T18:27:06.912 INFO:tasks.workunit.client.1.smithi133.stdout:0/265: mkdir d9/d10/d47/d5e 0 2024-02-15T18:27:06.915 INFO:tasks.workunit.client.1.smithi133.stdout:0/266: rename d9/d10/d22/d2f/d30/l5c to d9/d2b/l5f 0 2024-02-15T18:27:06.915 INFO:tasks.workunit.client.1.smithi133.stdout:0/267: fsync d9/d10/d22/d2f/d30/d44/f4f 0 2024-02-15T18:27:06.917 INFO:tasks.workunit.client.1.smithi133.stdout:0/268: creat d9/d2b/f60 x:0 0 0 2024-02-15T18:27:06.917 INFO:tasks.workunit.client.1.smithi133.stdout:0/269: dread - d9/d10/d22/d2f/d30/d44/f4c zero size 2024-02-15T18:27:06.917 INFO:tasks.workunit.client.1.smithi133.stdout:0/270: fdatasync d9/d2b/f53 0 2024-02-15T18:27:06.917 INFO:tasks.workunit.client.1.smithi133.stdout:0/271: dread - d9/d10/d22/d2f/f51 zero size 2024-02-15T18:27:06.918 INFO:tasks.workunit.client.0.smithi084.stdout:5/683: mknod d9/d5b/d7e/db5/ce0 0 2024-02-15T18:27:06.918 INFO:tasks.workunit.client.0.smithi084.stdout:5/684: readlink d9/l94 0 2024-02-15T18:27:06.920 INFO:tasks.workunit.client.0.smithi084.stdout:6/595: write f9 [2678778,84526] 0 2024-02-15T18:27:06.920 INFO:tasks.workunit.client.1.smithi133.stdout:0/272: rename d9/fe to d9/d10/d19/d1a/f61 0 2024-02-15T18:27:06.920 INFO:tasks.workunit.client.0.smithi084.stdout:5/685: symlink d9/d5b/d7e/le1 0 2024-02-15T18:27:06.922 INFO:tasks.workunit.client.0.smithi084.stdout:6/596: creat d14/d22/d25/d2f/d31/d30/d93/d99/fc2 x:0 0 0 2024-02-15T18:27:06.922 INFO:tasks.workunit.client.1.smithi133.stdout:0/273: creat d9/d10/d47/f62 x:0 0 0 2024-02-15T18:27:06.923 INFO:tasks.workunit.client.1.smithi133.stdout:6/403: sync 2024-02-15T18:27:06.924 INFO:tasks.workunit.client.1.smithi133.stdout:6/404: stat d0/d62/d66/c43 0 2024-02-15T18:27:06.924 INFO:tasks.workunit.client.1.smithi133.stdout:6/405: getdents d0/d3b/d85 0 2024-02-15T18:27:06.925 INFO:tasks.workunit.client.1.smithi133.stdout:0/274: creat d9/d10/d19/f63 x:0 0 0 2024-02-15T18:27:06.925 INFO:tasks.workunit.client.0.smithi084.stdout:6/597: link d14/d22/d25/d2f/d31/d3f/d4a/fa0 d14/d22/d25/d41/d94/fc3 0 2024-02-15T18:27:06.927 INFO:tasks.workunit.client.1.smithi133.stdout:0/275: read d9/d10/f17 [3442356,116709] 0 2024-02-15T18:27:06.927 INFO:tasks.workunit.client.1.smithi133.stdout:6/406: rename d0/la to d0/d3b/d52/l88 0 2024-02-15T18:27:06.929 INFO:tasks.workunit.client.0.smithi084.stdout:6/598: symlink d14/lc4 0 2024-02-15T18:27:06.931 INFO:tasks.workunit.client.0.smithi084.stdout:6/599: creat d14/d22/d25/d2f/d31/d3f/d4a/fc5 x:0 0 0 2024-02-15T18:27:06.931 INFO:tasks.workunit.client.1.smithi133.stdout:0/276: rename d9/d2b/f4d to d9/d10/d22/d32/f64 0 2024-02-15T18:27:06.931 INFO:tasks.workunit.client.1.smithi133.stdout:6/407: stat d0/db/c35 0 2024-02-15T18:27:06.936 INFO:tasks.workunit.client.1.smithi133.stdout:8/264: sync 2024-02-15T18:27:06.936 INFO:tasks.workunit.client.1.smithi133.stdout:4/211: sync 2024-02-15T18:27:06.936 INFO:tasks.workunit.client.1.smithi133.stdout:8/265: write d3/f43 [30308,23956] 0 2024-02-15T18:27:06.936 INFO:tasks.workunit.client.1.smithi133.stdout:8/266: chown d3/d7/l3d 27 1 2024-02-15T18:27:06.936 INFO:tasks.workunit.client.1.smithi133.stdout:8/267: truncate d3/f42 1204087 0 2024-02-15T18:27:06.936 INFO:tasks.workunit.client.1.smithi133.stdout:8/268: stat d3/de/f1d 0 2024-02-15T18:27:06.937 INFO:tasks.workunit.client.1.smithi133.stdout:6/408: write d0/db/f17 [224382,38712] 0 2024-02-15T18:27:06.937 INFO:tasks.workunit.client.1.smithi133.stdout:4/212: rename d2/d5/d2b/d21/d2d/l3e to d2/d5/d2b/d21/d2d/d44/l4e 0 2024-02-15T18:27:06.937 INFO:tasks.workunit.client.1.smithi133.stdout:4/213: truncate d2/d5/d2b/d21/d2d/f3c 973012 0 2024-02-15T18:27:06.938 INFO:tasks.workunit.client.1.smithi133.stdout:6/409: read d0/f50 [2369966,92625] 0 2024-02-15T18:27:06.938 INFO:tasks.workunit.client.1.smithi133.stdout:6/410: dread - d0/d3b/d52/f58 zero size 2024-02-15T18:27:06.938 INFO:tasks.workunit.client.1.smithi133.stdout:6/411: chown d0/db/d29/d34/l68 114326164 1 2024-02-15T18:27:06.938 INFO:tasks.workunit.client.1.smithi133.stdout:6/412: chown d0/c31 1532 1 2024-02-15T18:27:06.938 INFO:tasks.workunit.client.1.smithi133.stdout:4/214: mkdir d2/d5/d2b/d21/d2d/d4f 0 2024-02-15T18:27:06.939 INFO:tasks.workunit.client.1.smithi133.stdout:6/413: rmdir d0/d3b/d52 39 2024-02-15T18:27:06.944 INFO:tasks.workunit.client.0.smithi084.stdout:6/600: write d14/d22/d25/d2f/d31/d3f/d4a/f98 [1140948,65688] 0 2024-02-15T18:27:06.944 INFO:tasks.workunit.client.1.smithi133.stdout:6/414: read d0/ff [2069920,57933] 0 2024-02-15T18:27:06.944 INFO:tasks.workunit.client.1.smithi133.stdout:6/415: stat d0/d3b/d52 0 2024-02-15T18:27:06.945 INFO:tasks.workunit.client.1.smithi133.stdout:5/227: dwrite d17/d20/d32/d38/f48 [4194304,4194304] 0 2024-02-15T18:27:06.947 INFO:tasks.workunit.client.1.smithi133.stdout:6/416: link d0/c31 d0/d3b/d53/c89 0 2024-02-15T18:27:06.948 INFO:tasks.workunit.client.1.smithi133.stdout:2/332: dwrite d7/d18/d32/d65/d54/f57 [0,4194304] 0 2024-02-15T18:27:06.948 INFO:tasks.workunit.client.0.smithi084.stdout:3/589: dwrite d8/d40/d43/d71/d8c/d94/fbd [0,4194304] 0 2024-02-15T18:27:06.948 INFO:tasks.workunit.client.0.smithi084.stdout:0/592: dwrite d0/d2f/d3f/f30 [0,4194304] 0 2024-02-15T18:27:06.949 INFO:tasks.workunit.client.1.smithi133.stdout:7/190: dwrite d9/db/f11 [0,4194304] 0 2024-02-15T18:27:06.950 INFO:tasks.workunit.client.1.smithi133.stdout:5/228: mknod d17/d20/d32/c4b 0 2024-02-15T18:27:06.950 INFO:tasks.workunit.client.1.smithi133.stdout:5/229: chown d17/f4a 885 1 2024-02-15T18:27:06.952 INFO:tasks.workunit.client.1.smithi133.stdout:6/417: creat d0/d3b/d67/f8a x:0 0 0 2024-02-15T18:27:06.954 INFO:tasks.workunit.client.1.smithi133.stdout:7/191: mkdir d9/db/dc/d42 0 2024-02-15T18:27:06.957 INFO:tasks.workunit.client.0.smithi084.stdout:3/590: symlink d8/d1f/dbf/db6/lc7 0 2024-02-15T18:27:06.963 INFO:tasks.workunit.client.1.smithi133.stdout:8/269: dread d3/d1c/d2f/f3b [0,4194304] 0 2024-02-15T18:27:06.963 INFO:tasks.workunit.client.1.smithi133.stdout:8/270: chown d3/d1f/l4c 6786 1 2024-02-15T18:27:06.965 INFO:tasks.workunit.client.1.smithi133.stdout:8/271: mkdir d3/d1c/d37/d5c 0 2024-02-15T18:27:06.965 INFO:tasks.workunit.client.1.smithi133.stdout:8/272: stat d3/d7/d40 0 2024-02-15T18:27:06.968 INFO:tasks.workunit.client.1.smithi133.stdout:7/192: dread d9/d36/f2b [0,4194304] 0 2024-02-15T18:27:06.972 INFO:tasks.workunit.client.1.smithi133.stdout:7/193: creat d9/d36/d3d/f43 x:0 0 0 2024-02-15T18:27:06.975 INFO:tasks.workunit.client.1.smithi133.stdout:7/194: symlink d9/db/dc/l44 0 2024-02-15T18:27:06.975 INFO:tasks.workunit.client.1.smithi133.stdout:7/195: fdatasync d9/d36/f37 0 2024-02-15T18:27:06.984 INFO:tasks.workunit.client.0.smithi084.stdout:2/584: dwrite d3/d5/d1a/d1e/d30/f67 [0,4194304] 0 2024-02-15T18:27:06.985 INFO:tasks.workunit.client.1.smithi133.stdout:1/466: dwrite d6/fa5 [0,4194304] 0 2024-02-15T18:27:06.985 INFO:tasks.workunit.client.1.smithi133.stdout:1/467: chown d6/d1e/d41/d7c/d7e 27686655 1 2024-02-15T18:27:06.986 INFO:tasks.workunit.client.0.smithi084.stdout:9/682: dwrite d4/d2b/d3c/d20/fa7 [0,4194304] 0 2024-02-15T18:27:06.986 INFO:tasks.workunit.client.0.smithi084.stdout:9/683: write d4/d2b/d3c/d24/dca/f99 [390808,100672] 0 2024-02-15T18:27:06.988 INFO:tasks.workunit.client.1.smithi133.stdout:1/468: write d6/d17/f1c [483006,10568] 0 2024-02-15T18:27:06.989 INFO:tasks.workunit.client.0.smithi084.stdout:9/684: rename d4/d36/f5e to d4/dc2/fdb 0 2024-02-15T18:27:06.992 INFO:tasks.workunit.client.0.smithi084.stdout:2/585: dread d3/d28/f45 [4194304,4194304] 0 2024-02-15T18:27:06.995 INFO:tasks.workunit.client.0.smithi084.stdout:2/586: symlink d3/d19/d24/lc1 0 2024-02-15T18:27:06.996 INFO:tasks.workunit.client.1.smithi133.stdout:1/469: creat d6/d1e/d3a/d75/fae x:0 0 0 2024-02-15T18:27:06.996 INFO:tasks.workunit.client.1.smithi133.stdout:1/470: write d6/d1e/f7b [8198,50672] 0 2024-02-15T18:27:06.996 INFO:tasks.workunit.client.1.smithi133.stdout:1/471: write d6/f16 [3206923,174] 0 2024-02-15T18:27:06.997 INFO:tasks.workunit.client.0.smithi084.stdout:2/587: rmdir d3/d5/d1a/d1e/d47/d76 39 2024-02-15T18:27:06.997 INFO:tasks.workunit.client.0.smithi084.stdout:2/588: fsync d3/d28/f9d 0 2024-02-15T18:27:06.997 INFO:tasks.workunit.client.0.smithi084.stdout:2/589: readlink d3/d5/d1a/d2d/lb3 0 2024-02-15T18:27:06.998 INFO:tasks.workunit.client.0.smithi084.stdout:2/590: symlink d3/d19/d24/d91/lc2 0 2024-02-15T18:27:06.998 INFO:tasks.workunit.client.1.smithi133.stdout:1/472: creat d6/d1e/d3a/d79/faf x:0 0 0 2024-02-15T18:27:06.999 INFO:tasks.workunit.client.1.smithi133.stdout:7/196: dread d9/db/f27 [0,4194304] 0 2024-02-15T18:27:07.000 INFO:tasks.workunit.client.1.smithi133.stdout:0/277: dwrite d9/d10/d22/d32/f39 [0,4194304] 0 2024-02-15T18:27:07.001 INFO:tasks.workunit.client.0.smithi084.stdout:5/686: dwrite d9/d23/f30 [0,4194304] 0 2024-02-15T18:27:07.002 INFO:tasks.workunit.client.1.smithi133.stdout:7/197: symlink d9/db/dc/l45 0 2024-02-15T18:27:07.002 INFO:tasks.workunit.client.1.smithi133.stdout:7/198: chown d9/d36/d3d/f43 256 1 2024-02-15T18:27:07.002 INFO:tasks.workunit.client.1.smithi133.stdout:1/473: rmdir d6/d1e/d3a/d82 39 2024-02-15T18:27:07.002 INFO:tasks.workunit.client.0.smithi084.stdout:6/601: dwrite d14/d22/d25/d2f/d31/d3f/f96 [0,4194304] 0 2024-02-15T18:27:07.002 INFO:tasks.workunit.client.0.smithi084.stdout:8/647: dwrite db/dd/d1f/f23 [0,4194304] 0 2024-02-15T18:27:07.002 INFO:tasks.workunit.client.0.smithi084.stdout:6/602: write d14/d22/d25/f2b [8588420,119192] 0 2024-02-15T18:27:07.002 INFO:tasks.workunit.client.0.smithi084.stdout:6/603: chown d14/d22/d25/d2f/cb2 943712 1 2024-02-15T18:27:07.002 INFO:tasks.workunit.client.0.smithi084.stdout:6/604: read - d14/d22/d25/d41/fb4 zero size 2024-02-15T18:27:07.003 INFO:tasks.workunit.client.1.smithi133.stdout:4/215: dwrite d2/f23 [0,4194304] 0 2024-02-15T18:27:07.003 INFO:tasks.workunit.client.0.smithi084.stdout:2/591: mkdir d3/d19/d24/dc3 0 2024-02-15T18:27:07.003 INFO:tasks.workunit.client.0.smithi084.stdout:2/592: write d3/d5/d1a/d1e/d4b/da6/f50 [882400,14416] 0 2024-02-15T18:27:07.004 INFO:tasks.workunit.client.1.smithi133.stdout:0/278: rename d9/fa to d9/d10/d2c/f65 0 2024-02-15T18:27:07.004 INFO:tasks.workunit.client.1.smithi133.stdout:2/333: dwrite d7/d2c/d31/f38 [0,4194304] 0 2024-02-15T18:27:07.006 INFO:tasks.workunit.client.0.smithi084.stdout:5/687: getdents d9/d35 0 2024-02-15T18:27:07.013 INFO:tasks.workunit.client.0.smithi084.stdout:8/648: creat db/dd/d1f/fd4 x:0 0 0 2024-02-15T18:27:07.014 INFO:tasks.workunit.client.1.smithi133.stdout:4/216: mkdir d2/d5/d2b/d21/d3b/d49/d50 0 2024-02-15T18:27:07.015 INFO:tasks.workunit.client.0.smithi084.stdout:6/605: link l2 d14/d22/d25/d2f/d31/d30/d45/d52/d8a/db8/lc6 0 2024-02-15T18:27:07.015 INFO:tasks.workunit.client.0.smithi084.stdout:2/593: truncate d3/faf 1167599 0 2024-02-15T18:27:07.017 INFO:tasks.workunit.client.1.smithi133.stdout:0/279: link d9/d10/d19/d1a/f4b d9/d10/d19/d1a/f66 0 2024-02-15T18:27:07.017 INFO:tasks.workunit.client.1.smithi133.stdout:0/280: dread - d9/d10/d22/d2f/d30/d44/f4f zero size 2024-02-15T18:27:07.017 INFO:tasks.workunit.client.0.smithi084.stdout:0/593: dwrite d0/d4/d3a/d5c/f81 [0,4194304] 0 2024-02-15T18:27:07.018 INFO:tasks.workunit.client.0.smithi084.stdout:3/591: dwrite d8/d40/d58/d80/d6b/f6c [0,4194304] 0 2024-02-15T18:27:07.019 INFO:tasks.workunit.client.1.smithi133.stdout:2/334: mknod d7/db/d67/c6b 0 2024-02-15T18:27:07.019 INFO:tasks.workunit.client.1.smithi133.stdout:2/335: stat d7/d18/d32 0 2024-02-15T18:27:07.020 INFO:tasks.workunit.client.0.smithi084.stdout:8/649: rename db/dd/d13/db9/lbc to db/d1a/d2b/d7b/ld5 0 2024-02-15T18:27:07.020 INFO:tasks.workunit.client.0.smithi084.stdout:5/688: dread d9/d23/fbe [0,4194304] 0 2024-02-15T18:27:07.020 INFO:tasks.workunit.client.0.smithi084.stdout:5/689: truncate d9/d5b/d79/f87 880935 0 2024-02-15T18:27:07.021 INFO:tasks.workunit.client.0.smithi084.stdout:5/690: write d9/d23/f88 [92236,112031] 0 2024-02-15T18:27:07.021 INFO:tasks.workunit.client.0.smithi084.stdout:5/691: chown d9/d5b/d7e 0 1 2024-02-15T18:27:07.021 INFO:tasks.workunit.client.0.smithi084.stdout:5/692: dread - d9/d5b/d7e/d92/fc3 zero size 2024-02-15T18:27:07.021 INFO:tasks.workunit.client.1.smithi133.stdout:6/418: dwrite d0/db/d29/d34/f73 [0,4194304] 0 2024-02-15T18:27:07.021 INFO:tasks.workunit.client.1.smithi133.stdout:1/474: dread d6/d1e/d3a/d75/f7d [0,4194304] 0 2024-02-15T18:27:07.021 INFO:tasks.workunit.client.1.smithi133.stdout:1/475: dread - d6/d1e/d41/d7c/d7e/f94 zero size 2024-02-15T18:27:07.022 INFO:tasks.workunit.client.0.smithi084.stdout:3/592: creat d8/fc8 x:0 0 0 2024-02-15T18:27:07.024 INFO:tasks.workunit.client.1.smithi133.stdout:8/273: dwrite d3/f22 [0,4194304] 0 2024-02-15T18:27:07.024 INFO:tasks.workunit.client.1.smithi133.stdout:4/217: mkdir d2/d5/d2b/d21/d2d/d44/d51 0 2024-02-15T18:27:07.024 INFO:tasks.workunit.client.1.smithi133.stdout:4/218: readlink d2/d5/d2b/d21/d2d/l4b 0 2024-02-15T18:27:07.025 INFO:tasks.workunit.client.0.smithi084.stdout:8/650: rmdir db/dd/d13/d42/d79/dbe 0 2024-02-15T18:27:07.025 INFO:tasks.workunit.client.0.smithi084.stdout:6/606: read d14/d22/d25/d2f/fc1 [2359682,113139] 0 2024-02-15T18:27:07.026 INFO:tasks.workunit.client.0.smithi084.stdout:6/607: readlink d14/l59 0 2024-02-15T18:27:07.027 INFO:tasks.workunit.client.0.smithi084.stdout:5/693: mkdir d9/dc6/de2 0 2024-02-15T18:27:07.032 INFO:tasks.workunit.client.1.smithi133.stdout:1/476: rename d6/f74 to d6/d1e/d3a/d75/fb0 0 2024-02-15T18:27:07.032 INFO:tasks.workunit.client.1.smithi133.stdout:1/477: readlink d6/d1e/d41/l55 0 2024-02-15T18:27:07.033 INFO:tasks.workunit.client.1.smithi133.stdout:8/274: write d3/de/f1d [3685136,25497] 0 2024-02-15T18:27:07.035 INFO:tasks.workunit.client.0.smithi084.stdout:0/594: dread d0/d2f/d3f/f49 [0,4194304] 0 2024-02-15T18:27:07.035 INFO:tasks.workunit.client.0.smithi084.stdout:0/595: stat d0/d4/c22 0 2024-02-15T18:27:07.035 INFO:tasks.workunit.client.1.smithi133.stdout:1/478: dread d6/d1e/d41/d7c/d7e/f99 [0,4194304] 0 2024-02-15T18:27:07.035 INFO:tasks.workunit.client.1.smithi133.stdout:1/479: readlink d6/l1f 0 2024-02-15T18:27:07.036 INFO:tasks.workunit.client.1.smithi133.stdout:1/480: write d6/d1e/d41/d7c/f98 [578183,123733] 0 2024-02-15T18:27:07.036 INFO:tasks.workunit.client.1.smithi133.stdout:1/481: write d6/d2a/d59/f80 [560693,33563] 0 2024-02-15T18:27:07.036 INFO:tasks.workunit.client.1.smithi133.stdout:8/275: creat d3/d1c/d37/f5d x:0 0 0 2024-02-15T18:27:07.038 INFO:tasks.workunit.client.1.smithi133.stdout:4/219: creat d2/d5/d2b/d21/d2d/d44/d51/f52 x:0 0 0 2024-02-15T18:27:07.040 INFO:tasks.workunit.client.0.smithi084.stdout:4/687: sync 2024-02-15T18:27:07.040 INFO:tasks.workunit.client.0.smithi084.stdout:7/549: sync 2024-02-15T18:27:07.040 INFO:tasks.workunit.client.0.smithi084.stdout:1/535: sync 2024-02-15T18:27:07.041 INFO:tasks.workunit.client.0.smithi084.stdout:1/536: chown d9/d54/d1b/da7 2638 1 2024-02-15T18:27:07.041 INFO:tasks.workunit.client.0.smithi084.stdout:1/537: fsync d9/f27 0 2024-02-15T18:27:07.041 INFO:tasks.workunit.client.1.smithi133.stdout:1/482: creat d6/fb1 x:0 0 0 2024-02-15T18:27:07.045 INFO:tasks.workunit.client.1.smithi133.stdout:4/220: link d2/d5/d2b/f1d d2/d5/d2b/d21/d2d/d4f/f53 0 2024-02-15T18:27:07.045 INFO:tasks.workunit.client.1.smithi133.stdout:4/221: rename d2/d5 to d2/d5/d2b/d21/d3b/d49/d50/d54 22 2024-02-15T18:27:07.048 INFO:tasks.workunit.client.0.smithi084.stdout:6/608: mkdir d14/d22/d25/d2f/d31/d30/d4f/d7f/dc7 0 2024-02-15T18:27:07.048 INFO:tasks.workunit.client.0.smithi084.stdout:8/651: rename db/dd/d1f/d3e/l75 to db/dd/d4d/ld6 0 2024-02-15T18:27:07.051 INFO:tasks.workunit.client.0.smithi084.stdout:0/596: mkdir d0/d4/d3a/db3 0 2024-02-15T18:27:07.052 INFO:tasks.workunit.client.0.smithi084.stdout:4/688: truncate d2/d4/d25/d66/fa3 522582 0 2024-02-15T18:27:07.052 INFO:tasks.workunit.client.0.smithi084.stdout:4/689: write d2/d4/f4f [4600245,54504] 0 2024-02-15T18:27:07.054 INFO:tasks.workunit.client.1.smithi133.stdout:0/281: dwrite d9/d10/d47/f5a [4194304,4194304] 0 2024-02-15T18:27:07.055 INFO:tasks.workunit.client.1.smithi133.stdout:0/282: chown d9/fb 3867 1 2024-02-15T18:27:07.055 INFO:tasks.workunit.client.1.smithi133.stdout:0/283: stat d9/d10/d2c 0 2024-02-15T18:27:07.056 INFO:tasks.workunit.client.1.smithi133.stdout:0/284: write d9/d10/d2c/f65 [2466090,22480] 0 2024-02-15T18:27:07.056 INFO:tasks.workunit.client.0.smithi084.stdout:7/550: creat df/d1d/d1a/d6a/fac x:0 0 0 2024-02-15T18:27:07.056 INFO:tasks.workunit.client.0.smithi084.stdout:1/538: mkdir d9/d54/d7f/db7 0 2024-02-15T18:27:07.058 INFO:tasks.workunit.client.1.smithi133.stdout:0/285: mkdir d9/d10/d19/d29/d67 0 2024-02-15T18:27:07.059 INFO:tasks.workunit.client.0.smithi084.stdout:8/652: creat db/dd/d4d/fd7 x:0 0 0 2024-02-15T18:27:07.060 INFO:tasks.workunit.client.0.smithi084.stdout:6/609: creat d14/d22/d25/d2f/d31/d30/d93/d99/fc8 x:0 0 0 2024-02-15T18:27:07.060 INFO:tasks.workunit.client.0.smithi084.stdout:8/653: dread - db/d1a/d2b/d7b/fc0 zero size 2024-02-15T18:27:07.060 INFO:tasks.workunit.client.0.smithi084.stdout:5/694: rename d9/da/d3d/d44/d55/cd4 to d9/da/ce3 0 2024-02-15T18:27:07.060 INFO:tasks.workunit.client.0.smithi084.stdout:5/695: write d9/da/d3d/d44/d55/d70/fdd [696754,90077] 0 2024-02-15T18:27:07.060 INFO:tasks.workunit.client.1.smithi133.stdout:0/286: mkdir d9/d10/d19/d29/d67/d68 0 2024-02-15T18:27:07.061 INFO:tasks.workunit.client.1.smithi133.stdout:0/287: write d9/d10/d19/d1a/f61 [3237025,93991] 0 2024-02-15T18:27:07.065 INFO:tasks.workunit.client.1.smithi133.stdout:0/288: rename d9/cd to d9/d10/d19/d29/c69 0 2024-02-15T18:27:07.065 INFO:tasks.workunit.client.1.smithi133.stdout:0/289: write d9/d10/d47/f62 [847294,9542] 0 2024-02-15T18:27:07.065 INFO:tasks.workunit.client.1.smithi133.stdout:0/290: dread - d9/d2b/f53 zero size 2024-02-15T18:27:07.066 INFO:tasks.workunit.client.0.smithi084.stdout:5/696: creat d9/da/fe4 x:0 0 0 2024-02-15T18:27:07.069 INFO:tasks.workunit.client.0.smithi084.stdout:5/697: mkdir d9/d5f/d68/d9a/d8d/de5 0 2024-02-15T18:27:07.069 INFO:tasks.workunit.client.0.smithi084.stdout:5/698: readlink d9/d23/l62 0 2024-02-15T18:27:07.069 INFO:tasks.workunit.client.0.smithi084.stdout:5/699: dread - d9/d23/dac/fd8 zero size 2024-02-15T18:27:07.074 INFO:tasks.workunit.client.0.smithi084.stdout:5/700: read d9/da/d3d/f50 [1776935,4321] 0 2024-02-15T18:27:07.074 INFO:tasks.workunit.client.0.smithi084.stdout:5/701: write d9/d5b/d79/f87 [550435,56599] 0 2024-02-15T18:27:07.075 INFO:tasks.workunit.client.0.smithi084.stdout:5/702: chown d9/d5f/d68/f83 8316 1 2024-02-15T18:27:07.079 INFO:tasks.workunit.client.0.smithi084.stdout:5/703: write d9/da/f1b [942377,83278] 0 2024-02-15T18:27:07.079 INFO:tasks.workunit.client.0.smithi084.stdout:5/704: write d9/fe [3494292,50338] 0 2024-02-15T18:27:07.080 INFO:tasks.workunit.client.0.smithi084.stdout:5/705: mknod d9/d35/d65/d7f/dd6/ce6 0 2024-02-15T18:27:07.088 INFO:tasks.workunit.client.1.smithi133.stdout:2/336: dwrite d7/db/f43 [0,4194304] 0 2024-02-15T18:27:07.089 INFO:tasks.workunit.client.0.smithi084.stdout:2/594: dwrite d3/d5/d1a/d1e/d4b/f59 [0,4194304] 0 2024-02-15T18:27:07.089 INFO:tasks.workunit.client.1.smithi133.stdout:6/419: dwrite d0/d3b/d67/f86 [0,4194304] 0 2024-02-15T18:27:07.089 INFO:tasks.workunit.client.1.smithi133.stdout:6/420: chown d0/db/c1f 32433 1 2024-02-15T18:27:07.090 INFO:tasks.workunit.client.1.smithi133.stdout:2/337: creat d7/d18/d32/d65/d54/f6c x:0 0 0 2024-02-15T18:27:07.091 INFO:tasks.workunit.client.0.smithi084.stdout:2/595: creat d3/d5e/fc4 x:0 0 0 2024-02-15T18:27:07.092 INFO:tasks.workunit.client.1.smithi133.stdout:6/421: unlink d0/d3b/d53/c5e 0 2024-02-15T18:27:07.094 INFO:tasks.workunit.client.1.smithi133.stdout:2/338: mkdir d7/d2c/d3b/d48/d6d 0 2024-02-15T18:27:07.094 INFO:tasks.workunit.client.1.smithi133.stdout:2/339: write d7/d2c/d3b/f4d [4625527,108508] 0 2024-02-15T18:27:07.094 INFO:tasks.workunit.client.1.smithi133.stdout:2/340: truncate d7/f14 836198 0 2024-02-15T18:27:07.095 INFO:tasks.workunit.client.1.smithi133.stdout:6/422: rename d0/db/c35 to d0/db/d21/c8b 0 2024-02-15T18:27:07.095 INFO:tasks.workunit.client.1.smithi133.stdout:4/222: truncate d2/f23 2413227 0 2024-02-15T18:27:07.099 INFO:tasks.workunit.client.1.smithi133.stdout:2/341: creat d7/d2c/d46/f6e x:0 0 0 2024-02-15T18:27:07.099 INFO:tasks.workunit.client.1.smithi133.stdout:6/423: dread d0/d3b/f45 [0,4194304] 0 2024-02-15T18:27:07.100 INFO:tasks.workunit.client.1.smithi133.stdout:2/342: link d7/d18/d32/d65/f56 d7/d18/f6f 0 2024-02-15T18:27:07.100 INFO:tasks.workunit.client.1.smithi133.stdout:2/343: read d7/f26 [1299,116199] 0 2024-02-15T18:27:07.101 INFO:tasks.workunit.client.1.smithi133.stdout:2/344: mkdir d7/d2c/d5a/d66/d70 0 2024-02-15T18:27:07.111 INFO:tasks.workunit.client.1.smithi133.stdout:1/483: dread d6/d1e/d41/d7c/f98 [0,4194304] 0 2024-02-15T18:27:07.113 INFO:tasks.workunit.client.1.smithi133.stdout:1/484: rename d6/d1e/d3a/f9d to d6/d1e/d3a/d79/d8e/fb2 0 2024-02-15T18:27:07.116 INFO:tasks.workunit.client.1.smithi133.stdout:1/485: symlink d6/d1e/d41/d7c/lb3 0 2024-02-15T18:27:07.116 INFO:tasks.workunit.client.1.smithi133.stdout:4/223: dread d2/d5/d2b/d21/f31 [0,4194304] 0 2024-02-15T18:27:07.117 INFO:tasks.workunit.client.0.smithi084.stdout:3/593: dwrite d8/d1f/d2d/fb2 [0,4194304] 0 2024-02-15T18:27:07.118 INFO:tasks.workunit.client.0.smithi084.stdout:3/594: dread - d8/d40/d58/d80/d6b/fc0 zero size 2024-02-15T18:27:07.118 INFO:tasks.workunit.client.0.smithi084.stdout:3/595: chown d8/d1f/l9c 113680 1 2024-02-15T18:27:07.118 INFO:tasks.workunit.client.1.smithi133.stdout:6/424: dread d0/f24 [0,4194304] 0 2024-02-15T18:27:07.118 INFO:tasks.workunit.client.1.smithi133.stdout:6/425: fsync d0/db/d29/d34/d5d/d40/f7a 0 2024-02-15T18:27:07.120 INFO:tasks.workunit.client.1.smithi133.stdout:2/345: dread d7/f13 [0,4194304] 0 2024-02-15T18:27:07.120 INFO:tasks.workunit.client.1.smithi133.stdout:8/276: dwrite d3/f14 [0,4194304] 0 2024-02-15T18:27:07.122 INFO:tasks.workunit.client.0.smithi084.stdout:4/690: dwrite d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/f7d [0,4194304] 0 2024-02-15T18:27:07.122 INFO:tasks.workunit.client.1.smithi133.stdout:7/199: dwrite d9/d36/f23 [0,4194304] 0 2024-02-15T18:27:07.122 INFO:tasks.workunit.client.1.smithi133.stdout:6/426: dread d0/db/d29/d34/d48/f49 [0,4194304] 0 2024-02-15T18:27:07.123 INFO:tasks.workunit.client.0.smithi084.stdout:4/691: read d2/f84 [672563,75134] 0 2024-02-15T18:27:07.125 INFO:tasks.workunit.client.1.smithi133.stdout:1/486: dread d6/d17/f60 [0,4194304] 0 2024-02-15T18:27:07.125 INFO:tasks.workunit.client.0.smithi084.stdout:3/596: dread d8/d40/d58/d80/f84 [0,4194304] 0 2024-02-15T18:27:07.126 INFO:tasks.workunit.client.1.smithi133.stdout:8/277: symlink d3/d7/d40/l5e 0 2024-02-15T18:27:07.126 INFO:tasks.workunit.client.1.smithi133.stdout:7/200: creat d9/f46 x:0 0 0 2024-02-15T18:27:07.126 INFO:tasks.workunit.client.1.smithi133.stdout:0/291: dwrite d9/d28/f4a [0,4194304] 0 2024-02-15T18:27:07.128 INFO:tasks.workunit.client.0.smithi084.stdout:1/539: rmdir d9 39 2024-02-15T18:27:07.128 INFO:tasks.workunit.client.0.smithi084.stdout:1/540: truncate d9/d54/d1b/d2c/d35/fab 417422 0 2024-02-15T18:27:07.128 INFO:tasks.workunit.client.0.smithi084.stdout:1/541: chown d9/d54/d5c 3 1 2024-02-15T18:27:07.128 INFO:tasks.workunit.client.0.smithi084.stdout:7/551: dwrite df/d1d/d44/d8d/f8f [0,4194304] 0 2024-02-15T18:27:07.128 INFO:tasks.workunit.client.1.smithi133.stdout:6/427: dread d0/db/f17 [0,4194304] 0 2024-02-15T18:27:07.129 INFO:tasks.workunit.client.0.smithi084.stdout:0/597: dwrite d0/d4/d1b/d26/f84 [0,4194304] 0 2024-02-15T18:27:07.129 INFO:tasks.workunit.client.0.smithi084.stdout:0/598: dread - d0/d2f/faa zero size 2024-02-15T18:27:07.129 INFO:tasks.workunit.client.0.smithi084.stdout:0/599: dread - d0/d4/d3a/fa5 zero size 2024-02-15T18:27:07.129 INFO:tasks.workunit.client.0.smithi084.stdout:0/600: fsync d0/d25/f47 0 2024-02-15T18:27:07.129 INFO:tasks.workunit.client.0.smithi084.stdout:0/601: truncate d0/d4/d1b/f40 515620 0 2024-02-15T18:27:07.130 INFO:tasks.workunit.client.0.smithi084.stdout:3/597: creat d8/d1f/dbf/fc9 x:0 0 0 2024-02-15T18:27:07.130 INFO:tasks.workunit.client.0.smithi084.stdout:3/598: dread - d8/d40/faa zero size 2024-02-15T18:27:07.131 INFO:tasks.workunit.client.0.smithi084.stdout:0/602: read d0/d4/d1b/f40 [239110,118867] 0 2024-02-15T18:27:07.131 INFO:tasks.workunit.client.0.smithi084.stdout:0/603: truncate d0/d25/f47 809194 0 2024-02-15T18:27:07.131 INFO:tasks.workunit.client.0.smithi084.stdout:4/692: dread d2/d4/f20 [0,4194304] 0 2024-02-15T18:27:07.131 INFO:tasks.workunit.client.0.smithi084.stdout:6/610: getdents d14/d22/d25/d2f/d31/d30/d93/d99 0 2024-02-15T18:27:07.133 INFO:tasks.workunit.client.0.smithi084.stdout:1/542: truncate d9/d54/d1b/d2c/d4b/d4c/f61 1271346 0 2024-02-15T18:27:07.134 INFO:tasks.workunit.client.1.smithi133.stdout:7/201: stat d9/db/d16/c40 0 2024-02-15T18:27:07.135 INFO:tasks.workunit.client.1.smithi133.stdout:7/202: readlink d9/l26 0 2024-02-15T18:27:07.135 INFO:tasks.workunit.client.1.smithi133.stdout:7/203: chown c8 115647 1 2024-02-15T18:27:07.135 INFO:tasks.workunit.client.1.smithi133.stdout:7/204: fdatasync d9/d36/f37 0 2024-02-15T18:27:07.136 INFO:tasks.workunit.client.1.smithi133.stdout:0/292: rmdir d9/d10 39 2024-02-15T18:27:07.137 INFO:tasks.workunit.client.0.smithi084.stdout:0/604: symlink d0/d4/d1b/d26/d43/da0/lb4 0 2024-02-15T18:27:07.137 INFO:tasks.workunit.client.0.smithi084.stdout:5/706: dwrite d9/da/d3d/d44/d55/d70/d84/da1/f81 [0,4194304] 0 2024-02-15T18:27:07.138 INFO:tasks.workunit.client.0.smithi084.stdout:5/707: truncate d9/da/d3d/d44/d55/d70/fdd 1192202 0 2024-02-15T18:27:07.138 INFO:tasks.workunit.client.1.smithi133.stdout:6/428: mkdir d0/db/d29/d34/d8c 0 2024-02-15T18:27:07.139 INFO:tasks.workunit.client.1.smithi133.stdout:6/429: write d0/db/f70 [318575,75006] 0 2024-02-15T18:27:07.139 INFO:tasks.workunit.client.1.smithi133.stdout:6/430: getdents d0/d3b/d78/d7f 0 2024-02-15T18:27:07.139 INFO:tasks.workunit.client.1.smithi133.stdout:6/431: chown d0/d5/f1b 131207406 1 2024-02-15T18:27:07.139 INFO:tasks.workunit.client.1.smithi133.stdout:0/293: write d9/d28/f4a [1763956,34840] 0 2024-02-15T18:27:07.139 INFO:tasks.workunit.client.1.smithi133.stdout:7/205: creat d9/f47 x:0 0 0 2024-02-15T18:27:07.139 INFO:tasks.workunit.client.1.smithi133.stdout:1/487: dread d6/d1e/d3a/d82/d85/d67/f87 [0,4194304] 0 2024-02-15T18:27:07.140 INFO:tasks.workunit.client.0.smithi084.stdout:4/693: rename d2/d4/d28/d71/c8e to d2/d4/d28/d3d/d5c/d65/d9f/ccd 0 2024-02-15T18:27:07.140 INFO:tasks.workunit.client.0.smithi084.stdout:6/611: rename d14/d22 to d14/d22/d25/d2f/d31/d30/d93/dc9 22 2024-02-15T18:27:07.140 INFO:tasks.workunit.client.1.smithi133.stdout:1/488: read d6/d17/f1c [135365,100267] 0 2024-02-15T18:27:07.141 INFO:tasks.workunit.client.1.smithi133.stdout:6/432: rename d0/db/c19 to d0/db/d29/d34/d7c/d7e/c8d 0 2024-02-15T18:27:07.141 INFO:tasks.workunit.client.1.smithi133.stdout:6/433: dread - d0/db/d29/d34/d5d/f6b zero size 2024-02-15T18:27:07.142 INFO:tasks.workunit.client.1.smithi133.stdout:2/346: dread f1 [4194304,4194304] 0 2024-02-15T18:27:07.142 INFO:tasks.workunit.client.1.smithi133.stdout:2/347: chown d7/d2c/d31/f5f 103 1 2024-02-15T18:27:07.142 INFO:tasks.workunit.client.1.smithi133.stdout:2/348: write d7/d18/d32/d65/f52 [595482,54331] 0 2024-02-15T18:27:07.142 INFO:tasks.workunit.client.1.smithi133.stdout:7/206: mkdir d9/da/d48 0 2024-02-15T18:27:07.142 INFO:tasks.workunit.client.1.smithi133.stdout:7/207: readlink d9/db/dc/l45 0 2024-02-15T18:27:07.142 INFO:tasks.workunit.client.1.smithi133.stdout:7/208: readlink l4 0 2024-02-15T18:27:07.143 INFO:tasks.workunit.client.0.smithi084.stdout:6/612: link d14/d22/d25/d2f/d31/d3f/d4a/c87 d14/d22/d25/d41/cca 0 2024-02-15T18:27:07.143 INFO:tasks.workunit.client.1.smithi133.stdout:1/489: creat d6/fb4 x:0 0 0 2024-02-15T18:27:07.143 INFO:tasks.workunit.client.1.smithi133.stdout:1/490: write d6/d1e/d41/d7c/d7e/f99 [803417,56302] 0 2024-02-15T18:27:07.144 INFO:tasks.workunit.client.1.smithi133.stdout:1/491: fsync d6/d2a/d59/d5a/f6f 0 2024-02-15T18:27:07.146 INFO:tasks.workunit.client.1.smithi133.stdout:4/224: dwrite d2/d5/d2b/f1a [0,4194304] 0 2024-02-15T18:27:07.148 INFO:tasks.workunit.client.0.smithi084.stdout:1/543: dread d9/d54/d1b/d38/f4a [0,4194304] 0 2024-02-15T18:27:07.148 INFO:tasks.workunit.client.1.smithi133.stdout:1/492: link d6/d1e/d3a/d82/d85/c91 d6/d2a/d59/cb5 0 2024-02-15T18:27:07.148 INFO:tasks.workunit.client.1.smithi133.stdout:2/349: unlink d7/l12 0 2024-02-15T18:27:07.148 INFO:tasks.workunit.client.1.smithi133.stdout:2/350: write d7/d2c/f68 [820754,34953] 0 2024-02-15T18:27:07.151 INFO:tasks.workunit.client.1.smithi133.stdout:0/294: fdatasync d9/d10/d47/f62 0 2024-02-15T18:27:07.152 INFO:tasks.workunit.client.0.smithi084.stdout:0/605: dread d0/d2f/d3f/f5a [0,4194304] 0 2024-02-15T18:27:07.152 INFO:tasks.workunit.client.0.smithi084.stdout:8/654: dwrite db/f74 [4194304,4194304] 0 2024-02-15T18:27:07.153 INFO:tasks.workunit.client.0.smithi084.stdout:8/655: readlink db/dd/lc1 0 2024-02-15T18:27:07.154 INFO:tasks.workunit.client.0.smithi084.stdout:1/544: truncate d9/d54/d1b/d38/f4a 2259330 0 2024-02-15T18:27:07.154 INFO:tasks.workunit.client.1.smithi133.stdout:0/295: write d9/d28/f3a [936551,71044] 0 2024-02-15T18:27:07.154 INFO:tasks.workunit.client.1.smithi133.stdout:4/225: unlink d2/fd 0 2024-02-15T18:27:07.160 INFO:tasks.workunit.client.1.smithi133.stdout:0/296: creat d9/d10/d22/d2f/d30/d44/f6a x:0 0 0 2024-02-15T18:27:07.161 INFO:tasks.workunit.client.1.smithi133.stdout:2/351: mknod d7/db/c71 0 2024-02-15T18:27:07.161 INFO:tasks.workunit.client.1.smithi133.stdout:4/226: rename d2/d5/d25 to d2/d5/d2b/d21/d2d/d44/d51/d55 0 2024-02-15T18:27:07.161 INFO:tasks.workunit.client.1.smithi133.stdout:4/227: write d2/d5/d2b/d21/d2d/d44/f46 [15555,49791] 0 2024-02-15T18:27:07.164 INFO:tasks.workunit.client.1.smithi133.stdout:4/228: rmdir d2/d5/d2b/d21/d3b/d49/d50 0 2024-02-15T18:27:07.166 INFO:tasks.workunit.client.0.smithi084.stdout:0/606: creat d0/d4/d1b/d26/d43/d6d/fb5 x:0 0 0 2024-02-15T18:27:07.169 INFO:tasks.workunit.client.1.smithi133.stdout:8/278: dwrite d3/d1f/d3f/f4e [4194304,4194304] 0 2024-02-15T18:27:07.170 INFO:tasks.workunit.client.0.smithi084.stdout:6/613: dread f3 [0,4194304] 0 2024-02-15T18:27:07.170 INFO:tasks.workunit.client.0.smithi084.stdout:6/614: write d14/d22/d25/d2f/d31/d3f/fbf [173630,54108] 0 2024-02-15T18:27:07.170 INFO:tasks.workunit.client.0.smithi084.stdout:8/656: rename db/d1a/d2b/c44 to db/dd/d13/d42/d79/da6/cd8 0 2024-02-15T18:27:07.170 INFO:tasks.workunit.client.0.smithi084.stdout:8/657: fsync db/dd/d4d/d97/f9a 0 2024-02-15T18:27:07.171 INFO:tasks.workunit.client.0.smithi084.stdout:1/545: creat d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/fb8 x:0 0 0 2024-02-15T18:27:07.175 INFO:tasks.workunit.client.0.smithi084.stdout:8/658: creat db/dd/fd9 x:0 0 0 2024-02-15T18:27:07.175 INFO:tasks.workunit.client.0.smithi084.stdout:8/659: truncate db/f3a 2179706 0 2024-02-15T18:27:07.176 INFO:tasks.workunit.client.0.smithi084.stdout:1/546: mkdir d9/d54/d5c/d81/d94/db9 0 2024-02-15T18:27:07.176 INFO:tasks.workunit.client.0.smithi084.stdout:1/547: truncate d9/d54/d1b/d2c/d4b/d7a/d89/f98 497485 0 2024-02-15T18:27:07.178 INFO:tasks.workunit.client.1.smithi133.stdout:8/279: truncate d3/f4 3276326 0 2024-02-15T18:27:07.182 INFO:tasks.workunit.client.0.smithi084.stdout:7/552: dwrite df/d1d/d1a/d6a/d8b/d7f/f94 [0,4194304] 0 2024-02-15T18:27:07.183 INFO:tasks.workunit.client.0.smithi084.stdout:8/660: dread db/d1a/f5f [0,4194304] 0 2024-02-15T18:27:07.187 INFO:tasks.workunit.client.0.smithi084.stdout:7/553: creat df/d1d/d1a/fad x:0 0 0 2024-02-15T18:27:07.190 INFO:tasks.workunit.client.0.smithi084.stdout:7/554: link df/d1d/d1a/d6a/d8e/faa df/d1d/fae 0 2024-02-15T18:27:07.190 INFO:tasks.workunit.client.0.smithi084.stdout:7/555: chown df/d1d/d1a/d4d/f6f 16 1 2024-02-15T18:27:07.196 INFO:tasks.workunit.client.1.smithi133.stdout:9/232: sync 2024-02-15T18:27:07.196 INFO:tasks.workunit.client.1.smithi133.stdout:9/233: chown d0/d8/d9/d12/f3f 2659 1 2024-02-15T18:27:07.197 INFO:tasks.workunit.client.1.smithi133.stdout:3/344: sync 2024-02-15T18:27:07.197 INFO:tasks.workunit.client.1.smithi133.stdout:5/230: sync 2024-02-15T18:27:07.198 INFO:tasks.workunit.client.1.smithi133.stdout:9/234: mkdir d0/d8/d9/d49 0 2024-02-15T18:27:07.198 INFO:tasks.workunit.client.1.smithi133.stdout:5/231: mknod d17/d20/c4c 0 2024-02-15T18:27:07.199 INFO:tasks.workunit.client.1.smithi133.stdout:3/345: mkdir d0/d15/d37/d69 0 2024-02-15T18:27:07.200 INFO:tasks.workunit.client.1.smithi133.stdout:5/232: truncate f15 2388362 0 2024-02-15T18:27:07.201 INFO:tasks.workunit.client.1.smithi133.stdout:3/346: rename d0/d15/d2b/l56 to d0/l6a 0 2024-02-15T18:27:07.201 INFO:tasks.workunit.client.1.smithi133.stdout:5/233: rmdir d17/d20/d32 39 2024-02-15T18:27:07.202 INFO:tasks.workunit.client.1.smithi133.stdout:3/347: link d0/f2d d0/d15/f6b 0 2024-02-15T18:27:07.205 INFO:tasks.workunit.client.1.smithi133.stdout:3/348: dread d0/d15/d2b/f41 [0,4194304] 0 2024-02-15T18:27:07.206 INFO:tasks.workunit.client.1.smithi133.stdout:3/349: dread d0/d15/d2b/f45 [0,4194304] 0 2024-02-15T18:27:07.207 INFO:tasks.workunit.client.0.smithi084.stdout:4/694: dwrite d2/d4/f1c [0,4194304] 0 2024-02-15T18:27:07.209 INFO:tasks.workunit.client.1.smithi133.stdout:2/352: dread d7/db/f1d [4194304,4194304] 0 2024-02-15T18:27:07.209 INFO:tasks.workunit.client.1.smithi133.stdout:2/353: write d7/d18/d32/d65/f52 [908922,1108] 0 2024-02-15T18:27:07.210 INFO:tasks.workunit.client.0.smithi084.stdout:4/695: creat d2/d2b/d47/d31/fce x:0 0 0 2024-02-15T18:27:07.210 INFO:tasks.workunit.client.0.smithi084.stdout:4/696: write d2/d4/d28/d3d/f53 [5193962,89420] 0 2024-02-15T18:27:07.216 INFO:tasks.workunit.client.1.smithi133.stdout:3/350: rename d0/d15/d2b/d39/d3f/l1b to d0/l6c 0 2024-02-15T18:27:07.221 INFO:tasks.workunit.client.0.smithi084.stdout:6/615: dread d14/d22/d25/d2f/d31/d3f/f96 [0,4194304] 0 2024-02-15T18:27:07.229 INFO:tasks.workunit.client.1.smithi133.stdout:7/209: dwrite d9/db/dc/f35 [0,4194304] 0 2024-02-15T18:27:07.229 INFO:tasks.workunit.client.1.smithi133.stdout:6/434: dwrite d0/d5/f3a [0,4194304] 0 2024-02-15T18:27:07.230 INFO:tasks.workunit.client.1.smithi133.stdout:6/435: dread - d0/d3b/d53/f65 zero size 2024-02-15T18:27:07.230 INFO:tasks.workunit.client.1.smithi133.stdout:6/436: readlink d0/db/d29/l42 0 2024-02-15T18:27:07.233 INFO:tasks.workunit.client.1.smithi133.stdout:6/437: unlink d0/db/f33 0 2024-02-15T18:27:07.234 INFO:tasks.workunit.client.1.smithi133.stdout:6/438: write d0/d3b/f45 [1150440,101407] 0 2024-02-15T18:27:07.248 INFO:tasks.workunit.client.0.smithi084.stdout:6/616: dread d14/d22/d25/d2f/d31/d30/d45/d54/f88 [0,4194304] 0 2024-02-15T18:27:07.249 INFO:tasks.workunit.client.0.smithi084.stdout:6/617: symlink d14/d22/d25/d2f/d31/d30/d45/d52/d8a/db8/lcb 0 2024-02-15T18:27:07.256 INFO:tasks.workunit.client.0.smithi084.stdout:5/708: dwrite d9/d35/f58 [0,4194304] 0 2024-02-15T18:27:07.256 INFO:tasks.workunit.client.0.smithi084.stdout:6/618: dread f3 [0,4194304] 0 2024-02-15T18:27:07.260 INFO:tasks.workunit.client.1.smithi133.stdout:0/297: getdents d9/d10/d22/d2f/d30/d44 0 2024-02-15T18:27:07.261 INFO:tasks.workunit.client.0.smithi084.stdout:5/709: rename d9/d5b/d7e/lc7 to d9/da/d3d/d44/le7 0 2024-02-15T18:27:07.261 INFO:tasks.workunit.client.0.smithi084.stdout:5/710: readlink d9/da/l76 0 2024-02-15T18:27:07.261 INFO:tasks.workunit.client.0.smithi084.stdout:6/619: truncate d14/d22/d25/d2f/d31/d30/d45/d52/d8a/fb6 3393516 0 2024-02-15T18:27:07.263 INFO:tasks.workunit.client.0.smithi084.stdout:5/711: unlink d9/d23/f88 0 2024-02-15T18:27:07.264 INFO:tasks.workunit.client.0.smithi084.stdout:6/620: creat d14/d22/d25/d2f/d31/d30/d45/d52/d8a/fcc x:0 0 0 2024-02-15T18:27:07.265 INFO:tasks.workunit.client.0.smithi084.stdout:6/621: rmdir d14/d22/d25/d41/d95 39 2024-02-15T18:27:07.265 INFO:tasks.workunit.client.0.smithi084.stdout:1/548: dwrite d9/d54/d32/d5b/f75 [0,4194304] 0 2024-02-15T18:27:07.265 INFO:tasks.workunit.client.0.smithi084.stdout:6/622: write d14/d22/d25/d2f/f66 [2752203,110799] 0 2024-02-15T18:27:07.265 INFO:tasks.workunit.client.0.smithi084.stdout:1/549: dread - d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/fb8 zero size 2024-02-15T18:27:07.266 INFO:tasks.workunit.client.1.smithi133.stdout:0/298: creat d9/d10/d47/d5e/f6b x:0 0 0 2024-02-15T18:27:07.266 INFO:tasks.workunit.client.0.smithi084.stdout:3/599: dwrite d8/d1f/d2d/f3d [0,4194304] 0 2024-02-15T18:27:07.266 INFO:tasks.workunit.client.0.smithi084.stdout:3/600: write d8/d40/f70 [4322492,68645] 0 2024-02-15T18:27:07.268 INFO:tasks.workunit.client.0.smithi084.stdout:9/685: sync 2024-02-15T18:27:07.268 INFO:tasks.workunit.client.0.smithi084.stdout:9/686: write d4/d2b/d3c/d24/f8a [553367,42100] 0 2024-02-15T18:27:07.268 INFO:tasks.workunit.client.0.smithi084.stdout:9/687: chown d4/d2b/d3c/d24/dca/d15/fd5 262784 1 2024-02-15T18:27:07.269 INFO:tasks.workunit.client.1.smithi133.stdout:4/229: dwrite d2/d5/d2b/d21/f1b [0,4194304] 0 2024-02-15T18:27:07.269 INFO:tasks.workunit.client.0.smithi084.stdout:0/607: dwrite d0/d4/d66/f6c [4194304,4194304] 0 2024-02-15T18:27:07.270 INFO:tasks.workunit.client.1.smithi133.stdout:8/280: dwrite d3/de/ff [0,4194304] 0 2024-02-15T18:27:07.270 INFO:tasks.workunit.client.1.smithi133.stdout:2/354: dwrite d7/db/f21 [0,4194304] 0 2024-02-15T18:27:07.271 INFO:tasks.workunit.client.1.smithi133.stdout:2/355: readlink d7/d18/l1a 0 2024-02-15T18:27:07.271 INFO:tasks.workunit.client.1.smithi133.stdout:9/235: dwrite d0/d8/d9/f41 [0,4194304] 0 2024-02-15T18:27:07.271 INFO:tasks.workunit.client.1.smithi133.stdout:9/236: write d0/d8/d9/d12/f3f [806173,91502] 0 2024-02-15T18:27:07.271 INFO:tasks.workunit.client.0.smithi084.stdout:6/623: symlink d14/d22/d25/d2f/d31/d30/d45/d52/lcd 0 2024-02-15T18:27:07.271 INFO:tasks.workunit.client.0.smithi084.stdout:6/624: readlink d14/d22/d25/d2f/d31/d30/d45/d52/d8a/db8/lc6 0 2024-02-15T18:27:07.272 INFO:tasks.workunit.client.0.smithi084.stdout:6/625: fdatasync d14/d22/d25/d2f/d31/d3f/f42 0 2024-02-15T18:27:07.272 INFO:tasks.workunit.client.1.smithi133.stdout:3/351: dwrite d0/d15/f3b [0,4194304] 0 2024-02-15T18:27:07.272 INFO:tasks.workunit.client.1.smithi133.stdout:5/234: dwrite d17/d2a/f42 [0,4194304] 0 2024-02-15T18:27:07.272 INFO:tasks.workunit.client.1.smithi133.stdout:5/235: fdatasync d17/f47 0 2024-02-15T18:27:07.272 INFO:tasks.workunit.client.1.smithi133.stdout:5/236: fsync d17/f19 0 2024-02-15T18:27:07.272 INFO:tasks.workunit.client.1.smithi133.stdout:5/237: fsync ff 0 2024-02-15T18:27:07.273 INFO:tasks.workunit.client.0.smithi084.stdout:3/601: mkdir d8/d73/db9/dca 0 2024-02-15T18:27:07.274 INFO:tasks.workunit.client.0.smithi084.stdout:9/688: link d4/d2b/d67/cc9 d4/d36/cdc 0 2024-02-15T18:27:07.274 INFO:tasks.workunit.client.0.smithi084.stdout:9/689: chown d4/da3/dc3 1284359743 1 2024-02-15T18:27:07.274 INFO:tasks.workunit.client.1.smithi133.stdout:6/439: dwrite d0/f10 [0,4194304] 0 2024-02-15T18:27:07.274 INFO:tasks.workunit.client.0.smithi084.stdout:0/608: write d0/d39/d45/f5e [1614401,80039] 0 2024-02-15T18:27:07.277 INFO:tasks.workunit.client.1.smithi133.stdout:6/440: read d0/db/d29/d34/f73 [249160,25012] 0 2024-02-15T18:27:07.277 INFO:tasks.workunit.client.1.smithi133.stdout:1/493: dwrite d6/d1e/d3a/d82/d85/d67/f8b [0,4194304] 0 2024-02-15T18:27:07.278 INFO:tasks.workunit.client.1.smithi133.stdout:8/281: dread d3/d1c/d2f/f3b [0,4194304] 0 2024-02-15T18:27:07.278 INFO:tasks.workunit.client.1.smithi133.stdout:8/282: read d3/f43 [13983,89686] 0 2024-02-15T18:27:07.279 INFO:tasks.workunit.client.1.smithi133.stdout:4/230: creat d2/d5/d2b/d21/d2d/f56 x:0 0 0 2024-02-15T18:27:07.283 INFO:tasks.workunit.client.1.smithi133.stdout:2/356: creat d7/d2c/d46/f72 x:0 0 0 2024-02-15T18:27:07.286 INFO:tasks.workunit.client.1.smithi133.stdout:9/237: link d0/l1f d0/d8/d9/l4a 0 2024-02-15T18:27:07.288 INFO:tasks.workunit.client.0.smithi084.stdout:5/712: dwrite d9/d5f/d68/f83 [0,4194304] 0 2024-02-15T18:27:07.288 INFO:tasks.workunit.client.1.smithi133.stdout:3/352: truncate d0/d15/d2b/d39/d3f/f22 3072105 0 2024-02-15T18:27:07.289 INFO:tasks.workunit.client.1.smithi133.stdout:3/353: fdatasync d0/d15/d37/d4a/f60 0 2024-02-15T18:27:07.289 INFO:tasks.workunit.client.1.smithi133.stdout:3/354: write d0/f3a [478064,24836] 0 2024-02-15T18:27:07.291 INFO:tasks.workunit.client.1.smithi133.stdout:4/231: dread d2/f23 [0,4194304] 0 2024-02-15T18:27:07.291 INFO:tasks.workunit.client.1.smithi133.stdout:5/238: rename cd to d17/c4d 0 2024-02-15T18:27:07.291 INFO:tasks.workunit.client.1.smithi133.stdout:6/441: getdents d0/db/d29/d34/d7c/d7e 0 2024-02-15T18:27:07.292 INFO:tasks.workunit.client.0.smithi084.stdout:6/626: link d14/d22/d25/d2f/d31/d30/d4f/fa3 d14/d22/d25/d41/d95/fce 0 2024-02-15T18:27:07.293 INFO:tasks.workunit.client.0.smithi084.stdout:6/627: write d14/d22/d25/d28/f77 [504030,78758] 0 2024-02-15T18:27:07.296 INFO:tasks.workunit.client.0.smithi084.stdout:3/602: mknod d8/d73/db9/ccb 0 2024-02-15T18:27:07.296 INFO:tasks.workunit.client.0.smithi084.stdout:0/609: mkdir d0/d4/d1b/d26/d43/d6d/db6 0 2024-02-15T18:27:07.296 INFO:tasks.workunit.client.0.smithi084.stdout:0/610: write d0/d2f/d3f/d4c/d9a/fa3 [483941,126408] 0 2024-02-15T18:27:07.297 INFO:tasks.workunit.client.1.smithi133.stdout:0/299: truncate d9/d28/f3a 836899 0 2024-02-15T18:27:07.297 INFO:tasks.workunit.client.0.smithi084.stdout:5/713: unlink d9/d35/d65/l71 0 2024-02-15T18:27:07.298 INFO:tasks.workunit.client.1.smithi133.stdout:1/494: rmdir d6/d1e/d3a/d79 39 2024-02-15T18:27:07.298 INFO:tasks.workunit.client.0.smithi084.stdout:6/628: mkdir d14/d22/d25/d2f/d31/dcf 0 2024-02-15T18:27:07.299 INFO:tasks.workunit.client.0.smithi084.stdout:6/629: read d14/d22/d25/d41/d95/fce [26509,3652] 0 2024-02-15T18:27:07.299 INFO:tasks.workunit.client.0.smithi084.stdout:6/630: chown d14/f78 961128 1 2024-02-15T18:27:07.300 INFO:tasks.workunit.client.0.smithi084.stdout:9/690: rename d4/d6b/l91 to d4/d2b/d3c/d24/dca/d15/ldd 0 2024-02-15T18:27:07.300 INFO:tasks.workunit.client.0.smithi084.stdout:9/691: chown d4/d2b/f50 4096 1 2024-02-15T18:27:07.300 INFO:tasks.workunit.client.0.smithi084.stdout:9/692: write d4/fd6 [731629,67520] 0 2024-02-15T18:27:07.301 INFO:tasks.workunit.client.0.smithi084.stdout:3/603: mkdir d8/d40/d43/d71/dcc 0 2024-02-15T18:27:07.301 INFO:tasks.workunit.client.0.smithi084.stdout:3/604: truncate d8/f1d 5082525 0 2024-02-15T18:27:07.304 INFO:tasks.workunit.client.1.smithi133.stdout:8/283: stat d3/d1c/d37/l50 0 2024-02-15T18:27:07.306 INFO:tasks.workunit.client.0.smithi084.stdout:5/714: creat d9/d23/dac/dc9/fe8 x:0 0 0 2024-02-15T18:27:07.307 INFO:tasks.workunit.client.1.smithi133.stdout:9/238: mknod d0/d8/d9/d12/d2a/d42/c4b 0 2024-02-15T18:27:07.308 INFO:tasks.workunit.client.0.smithi084.stdout:6/631: rename d14/d22/d25/c6a to d14/d22/d25/d41/d43/cd0 0 2024-02-15T18:27:07.309 INFO:tasks.workunit.client.1.smithi133.stdout:2/357: symlink d7/d18/l73 0 2024-02-15T18:27:07.310 INFO:tasks.workunit.client.1.smithi133.stdout:2/358: readlink d7/d18/d32/d65/l4e 0 2024-02-15T18:27:07.310 INFO:tasks.workunit.client.0.smithi084.stdout:9/693: creat d4/d3d/da5/fde x:0 0 0 2024-02-15T18:27:07.310 INFO:tasks.workunit.client.0.smithi084.stdout:9/694: chown d4 111501753 1 2024-02-15T18:27:07.313 INFO:tasks.workunit.client.0.smithi084.stdout:3/605: symlink d8/d40/d58/d80/dc4/lcd 0 2024-02-15T18:27:07.316 INFO:tasks.workunit.client.1.smithi133.stdout:3/355: creat d0/d15/f6d x:0 0 0 2024-02-15T18:27:07.316 INFO:tasks.workunit.client.1.smithi133.stdout:5/239: truncate d17/d20/f22 1554530 0 2024-02-15T18:27:07.316 INFO:tasks.workunit.client.1.smithi133.stdout:5/240: stat d17/f36 0 2024-02-15T18:27:07.316 INFO:tasks.workunit.client.1.smithi133.stdout:5/241: read - d17/d20/f2f zero size 2024-02-15T18:27:07.317 INFO:tasks.workunit.client.1.smithi133.stdout:5/242: stat f15 0 2024-02-15T18:27:07.317 INFO:tasks.workunit.client.1.smithi133.stdout:6/442: mkdir d0/d3b/d85/d8e 0 2024-02-15T18:27:07.317 INFO:tasks.workunit.client.0.smithi084.stdout:6/632: link c1 d14/d22/d25/d2f/d31/d30/d45/d52/d8a/cd1 0 2024-02-15T18:27:07.317 INFO:tasks.workunit.client.0.smithi084.stdout:9/695: creat d4/d2b/d3c/d24/dca/d15/d4b/dcb/fdf x:0 0 0 2024-02-15T18:27:07.319 INFO:tasks.workunit.client.1.smithi133.stdout:4/232: dwrite d2/d5/d2b/d21/d2d/f56 [0,4194304] 0 2024-02-15T18:27:07.322 INFO:tasks.workunit.client.1.smithi133.stdout:9/239: mkdir d0/d8/d9/d49/d4c 0 2024-02-15T18:27:07.322 INFO:tasks.workunit.client.1.smithi133.stdout:2/359: mkdir d7/d2c/d3b/d48/d59/d74 0 2024-02-15T18:27:07.322 INFO:tasks.workunit.client.1.smithi133.stdout:5/243: mknod d17/d20/d32/c4e 0 2024-02-15T18:27:07.322 INFO:tasks.workunit.client.1.smithi133.stdout:6/443: write d0/f24 [4977742,9791] 0 2024-02-15T18:27:07.322 INFO:tasks.workunit.client.1.smithi133.stdout:6/444: fsync d0/f26 0 2024-02-15T18:27:07.323 INFO:tasks.workunit.client.1.smithi133.stdout:5/244: write d17/f33 [184377,15042] 0 2024-02-15T18:27:07.323 INFO:tasks.workunit.client.1.smithi133.stdout:5/245: readlink d17/d20/l29 0 2024-02-15T18:27:07.323 INFO:tasks.workunit.client.1.smithi133.stdout:6/445: write d0/d3b/d41/f60 [944247,66190] 0 2024-02-15T18:27:07.323 INFO:tasks.workunit.client.1.smithi133.stdout:6/446: fdatasync d0/f9 0 2024-02-15T18:27:07.323 INFO:tasks.workunit.client.1.smithi133.stdout:6/447: read - d0/db/d21/f75 zero size 2024-02-15T18:27:07.323 INFO:tasks.workunit.client.0.smithi084.stdout:9/696: rename d4/d2b/d3c/d24/dca/l70 to d4/d36/d6f/le0 0 2024-02-15T18:27:07.324 INFO:tasks.workunit.client.0.smithi084.stdout:9/697: chown d4/d2b/d3c/d24/f71 1 1 2024-02-15T18:27:07.324 INFO:tasks.workunit.client.0.smithi084.stdout:9/698: stat d4/da3/db0 0 2024-02-15T18:27:07.324 INFO:tasks.workunit.client.0.smithi084.stdout:2/596: sync 2024-02-15T18:27:07.326 INFO:tasks.workunit.client.0.smithi084.stdout:2/597: getdents d3/d19 0 2024-02-15T18:27:07.327 INFO:tasks.workunit.client.1.smithi133.stdout:4/233: fsync d2/d5/d2b/d21/f1c 0 2024-02-15T18:27:07.327 INFO:tasks.workunit.client.1.smithi133.stdout:6/448: symlink d0/d3b/d85/l8f 0 2024-02-15T18:27:07.327 INFO:tasks.workunit.client.1.smithi133.stdout:5/246: mkdir d17/d20/d4f 0 2024-02-15T18:27:07.329 INFO:tasks.workunit.client.1.smithi133.stdout:6/449: creat d0/db/d29/d34/d48/f90 x:0 0 0 2024-02-15T18:27:07.329 INFO:tasks.workunit.client.1.smithi133.stdout:6/450: write d0/db/d29/d34/d48/f90 [857937,105251] 0 2024-02-15T18:27:07.329 INFO:tasks.workunit.client.1.smithi133.stdout:6/451: write d0/f12 [4563529,67953] 0 2024-02-15T18:27:07.331 INFO:tasks.workunit.client.1.smithi133.stdout:5/247: rmdir d17/d3c 0 2024-02-15T18:27:07.331 INFO:tasks.workunit.client.1.smithi133.stdout:5/248: fdatasync d17/d20/f43 0 2024-02-15T18:27:07.333 INFO:tasks.workunit.client.1.smithi133.stdout:6/452: rename d0/db/d29/d34/f73 to d0/d3b/d67/f91 0 2024-02-15T18:27:07.335 INFO:tasks.workunit.client.1.smithi133.stdout:5/249: creat d17/f50 x:0 0 0 2024-02-15T18:27:07.335 INFO:tasks.workunit.client.1.smithi133.stdout:5/250: dread d17/d20/f23 [0,4194304] 0 2024-02-15T18:27:07.337 INFO:tasks.workunit.client.1.smithi133.stdout:6/453: rename d0/db/d29/l5c to d0/db/d29/l92 0 2024-02-15T18:27:07.338 INFO:tasks.workunit.client.1.smithi133.stdout:5/251: rename d17/d20/d32/c4e to d17/d20/c51 0 2024-02-15T18:27:07.343 INFO:tasks.workunit.client.1.smithi133.stdout:6/454: unlink d0/db/d29/d34/c6a 0 2024-02-15T18:27:07.343 INFO:tasks.workunit.client.1.smithi133.stdout:5/252: creat d17/d26/f52 x:0 0 0 2024-02-15T18:27:07.343 INFO:tasks.workunit.client.1.smithi133.stdout:5/253: dread - d17/f50 zero size 2024-02-15T18:27:07.344 INFO:tasks.workunit.client.1.smithi133.stdout:3/356: dread d0/d15/d37/f53 [0,4194304] 0 2024-02-15T18:27:07.344 INFO:tasks.workunit.client.1.smithi133.stdout:3/357: fsync d0/d15/d2b/f58 0 2024-02-15T18:27:07.344 INFO:tasks.workunit.client.1.smithi133.stdout:6/455: symlink d0/d62/d66/l93 0 2024-02-15T18:27:07.344 INFO:tasks.workunit.client.1.smithi133.stdout:6/456: chown d0/db/d29/d34/d48/l5f 263 1 2024-02-15T18:27:07.345 INFO:tasks.workunit.client.1.smithi133.stdout:5/254: creat d17/d20/f53 x:0 0 0 2024-02-15T18:27:07.345 INFO:tasks.workunit.client.1.smithi133.stdout:5/255: readlink la 0 2024-02-15T18:27:07.345 INFO:tasks.workunit.client.1.smithi133.stdout:4/234: dread d2/d5/d2b/d21/d2d/f3c [0,4194304] 0 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:6/457: chown d0/d5/l16 7676819 1 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:5/256: creat d17/d20/d32/d38/f54 x:0 0 0 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:3/358: mknod d0/d15/d54/c6e 0 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:5/257: stat d17/d20/f35 0 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:6/458: chown d0/db/d21/c3e 41392 1 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:5/258: readlink l8 0 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:3/359: chown d0/d15/d37/c49 981860 1 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:3/360: write d0/d15/d37/d4a/f60 [438491,2324] 0 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:6/459: write d0/db/d29/d34/d5d/d40/f7a [326853,110482] 0 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:3/361: chown d0/d15/d2b/f44 4089 1 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:6/460: getdents d0/db/d29/d34/d7c/d7e 0 2024-02-15T18:27:07.349 INFO:tasks.workunit.client.1.smithi133.stdout:6/461: readlink d0/db/d29/d34/d5d/d40/l46 0 2024-02-15T18:27:07.350 INFO:tasks.workunit.client.1.smithi133.stdout:4/235: truncate d2/f12 579918 0 2024-02-15T18:27:07.350 INFO:tasks.workunit.client.1.smithi133.stdout:6/462: getdents d0/d3b/d53 0 2024-02-15T18:27:07.351 INFO:tasks.workunit.client.1.smithi133.stdout:3/362: creat d0/d15/d2b/d62/f6f x:0 0 0 2024-02-15T18:27:07.352 INFO:tasks.workunit.client.1.smithi133.stdout:4/236: creat d2/d5/d2b/d21/d3b/d49/f57 x:0 0 0 2024-02-15T18:27:07.352 INFO:tasks.workunit.client.1.smithi133.stdout:4/237: fdatasync d2/d5/f10 0 2024-02-15T18:27:07.353 INFO:tasks.workunit.client.1.smithi133.stdout:6/463: creat d0/d3b/d41/f94 x:0 0 0 2024-02-15T18:27:07.353 INFO:tasks.workunit.client.1.smithi133.stdout:3/363: creat d0/d15/d37/d4a/f70 x:0 0 0 2024-02-15T18:27:07.354 INFO:tasks.workunit.client.1.smithi133.stdout:3/364: getdents d0/d15/d2f 0 2024-02-15T18:27:07.355 INFO:tasks.workunit.client.1.smithi133.stdout:6/464: dread d0/d3b/d53/f6e [0,4194304] 0 2024-02-15T18:27:07.356 INFO:tasks.workunit.client.1.smithi133.stdout:3/365: creat d0/d15/d2b/d62/f71 x:0 0 0 2024-02-15T18:27:07.358 INFO:tasks.workunit.client.1.smithi133.stdout:6/465: unlink d0/db/f17 0 2024-02-15T18:27:07.358 INFO:tasks.workunit.client.1.smithi133.stdout:3/366: mkdir d0/d15/d2b/d72 0 2024-02-15T18:27:07.358 INFO:tasks.workunit.client.1.smithi133.stdout:1/495: dwrite d6/d1e/d3a/d79/faf [0,4194304] 0 2024-02-15T18:27:07.359 INFO:tasks.workunit.client.1.smithi133.stdout:3/367: mknod d0/d15/d37/c73 0 2024-02-15T18:27:07.359 INFO:tasks.workunit.client.1.smithi133.stdout:3/368: write d0/d15/d2b/f44 [1288642,34015] 0 2024-02-15T18:27:07.359 INFO:tasks.workunit.client.1.smithi133.stdout:4/238: write d2/d5/d2b/d21/d2d/f56 [3292254,19984] 0 2024-02-15T18:27:07.361 INFO:tasks.workunit.client.1.smithi133.stdout:1/496: mkdir d6/d1e/d41/d7c/d7e/d7f/db6 0 2024-02-15T18:27:07.361 INFO:tasks.workunit.client.1.smithi133.stdout:1/497: fdatasync d6/d1e/d3a/d79/faf 0 2024-02-15T18:27:07.362 INFO:tasks.workunit.client.1.smithi133.stdout:6/466: rename d0/d5/le to d0/d62/d66/l95 0 2024-02-15T18:27:07.363 INFO:tasks.workunit.client.1.smithi133.stdout:3/369: mkdir d0/d15/d2b/d62/d74 0 2024-02-15T18:27:07.363 INFO:tasks.workunit.client.1.smithi133.stdout:3/370: truncate d0/d15/d2f/f68 131043 0 2024-02-15T18:27:07.363 INFO:tasks.workunit.client.1.smithi133.stdout:3/371: readlink d0/d15/d2f/l21 0 2024-02-15T18:27:07.363 INFO:tasks.workunit.client.1.smithi133.stdout:3/372: readlink d0/d15/d2f/l2e 0 2024-02-15T18:27:07.364 INFO:tasks.workunit.client.1.smithi133.stdout:4/239: link d2/d5/d2b/f24 d2/f58 0 2024-02-15T18:27:07.365 INFO:tasks.workunit.client.1.smithi133.stdout:1/498: mknod d6/d1e/d41/d7c/d7e/d7f/cb7 0 2024-02-15T18:27:07.365 INFO:tasks.workunit.client.1.smithi133.stdout:1/499: write d6/d1e/d3a/f61 [901378,13399] 0 2024-02-15T18:27:07.366 INFO:tasks.workunit.client.1.smithi133.stdout:6/467: rename d0/d3b/d41/f94 to d0/db/d29/d34/d7c/d7e/f96 0 2024-02-15T18:27:07.366 INFO:tasks.workunit.client.1.smithi133.stdout:3/373: creat d0/d15/d2b/d39/f75 x:0 0 0 2024-02-15T18:27:07.367 INFO:tasks.workunit.client.1.smithi133.stdout:1/500: mknod d6/d1e/d3a/d9e/cb8 0 2024-02-15T18:27:07.369 INFO:tasks.workunit.client.1.smithi133.stdout:1/501: creat d6/d1e/d3a/fb9 x:0 0 0 2024-02-15T18:27:07.369 INFO:tasks.workunit.client.1.smithi133.stdout:1/502: write d6/d1e/f86 [283354,4312] 0 2024-02-15T18:27:07.369 INFO:tasks.workunit.client.1.smithi133.stdout:1/503: stat d6/d17/f1d 0 2024-02-15T18:27:07.369 INFO:tasks.workunit.client.1.smithi133.stdout:0/300: dwrite d9/d10/d22/d32/f39 [4194304,4194304] 0 2024-02-15T18:27:07.370 INFO:tasks.workunit.client.1.smithi133.stdout:1/504: creat d6/d1e/d41/d7c/d7e/fba x:0 0 0 2024-02-15T18:27:07.373 INFO:tasks.workunit.client.1.smithi133.stdout:0/301: creat d9/d2b/f6c x:0 0 0 2024-02-15T18:27:07.373 INFO:tasks.workunit.client.1.smithi133.stdout:0/302: readlink d9/l18 0 2024-02-15T18:27:07.373 INFO:tasks.workunit.client.1.smithi133.stdout:0/303: chown d9/l18 234594 1 2024-02-15T18:27:07.380 INFO:tasks.workunit.client.1.smithi133.stdout:8/284: dwrite d3/d1c/f51 [0,4194304] 0 2024-02-15T18:27:07.380 INFO:tasks.workunit.client.1.smithi133.stdout:4/240: dread d2/d5/d2b/f1d [0,4194304] 0 2024-02-15T18:27:07.380 INFO:tasks.workunit.client.1.smithi133.stdout:4/241: readlink d2/d5/l16 0 2024-02-15T18:27:07.381 INFO:tasks.workunit.client.0.smithi084.stdout:0/611: dwrite d0/d4/d1b/d26/f84 [0,4194304] 0 2024-02-15T18:27:07.381 INFO:tasks.workunit.client.0.smithi084.stdout:0/612: chown d0/d2f/d3f/d4f/d61/c68 244259520 1 2024-02-15T18:27:07.381 INFO:tasks.workunit.client.0.smithi084.stdout:5/715: dwrite d9/d23/fcd [0,4194304] 0 2024-02-15T18:27:07.381 INFO:tasks.workunit.client.0.smithi084.stdout:5/716: chown d9/d5b/d79/f7d 1333128 1 2024-02-15T18:27:07.383 INFO:tasks.workunit.client.1.smithi133.stdout:8/285: dread d3/f42 [0,4194304] 0 2024-02-15T18:27:07.385 INFO:tasks.workunit.client.0.smithi084.stdout:3/606: dwrite d8/fac [0,4194304] 0 2024-02-15T18:27:07.389 INFO:tasks.workunit.client.1.smithi133.stdout:8/286: symlink d3/d7/l5f 0 2024-02-15T18:27:07.389 INFO:tasks.workunit.client.1.smithi133.stdout:8/287: readlink d3/d1f/l39 0 2024-02-15T18:27:07.390 INFO:tasks.workunit.client.0.smithi084.stdout:0/613: creat d0/d39/d45/fb7 x:0 0 0 2024-02-15T18:27:07.391 INFO:tasks.workunit.client.0.smithi084.stdout:9/699: rename d4/d2b/d3c/d24/dca/d15/d4b to d4/da3/dc3/de1 0 2024-02-15T18:27:07.392 INFO:tasks.workunit.client.0.smithi084.stdout:5/717: symlink d9/dc6/le9 0 2024-02-15T18:27:07.392 INFO:tasks.workunit.client.0.smithi084.stdout:5/718: chown d9/d23/dac/dc9 5033 1 2024-02-15T18:27:07.396 INFO:tasks.workunit.client.1.smithi133.stdout:8/288: link d3/l6 d3/de/d3e/l60 0 2024-02-15T18:27:07.396 INFO:tasks.workunit.client.1.smithi133.stdout:8/289: chown d3/d1f/l39 14 1 2024-02-15T18:27:07.396 INFO:tasks.workunit.client.0.smithi084.stdout:0/614: rmdir d0/d4/d1b/d26/d43/d6d 39 2024-02-15T18:27:07.396 INFO:tasks.workunit.client.0.smithi084.stdout:5/719: symlink d9/da/d3d/d44/d55/d96/lea 0 2024-02-15T18:27:07.397 INFO:tasks.workunit.client.0.smithi084.stdout:3/607: mkdir d8/d40/d58/d80/dce 0 2024-02-15T18:27:07.397 INFO:tasks.workunit.client.1.smithi133.stdout:8/290: read d3/f44 [752327,90573] 0 2024-02-15T18:27:07.397 INFO:tasks.workunit.client.1.smithi133.stdout:8/291: chown d3/d1c/d2f/l35 1 1 2024-02-15T18:27:07.397 INFO:tasks.workunit.client.1.smithi133.stdout:8/292: mkdir d3/d7/d40/d61 0 2024-02-15T18:27:07.397 INFO:tasks.workunit.client.1.smithi133.stdout:4/242: dwrite d2/d5/d2b/f24 [0,4194304] 0 2024-02-15T18:27:07.398 INFO:tasks.workunit.client.0.smithi084.stdout:0/615: mknod d0/d4/d1b/d26/d43/cb8 0 2024-02-15T18:27:07.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/293: mknod d3/d7/c62 0 2024-02-15T18:27:07.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/294: truncate d3/d1c/f1e 9369056 0 2024-02-15T18:27:07.399 INFO:tasks.workunit.client.0.smithi084.stdout:5/720: mkdir d9/d35/d65/d7f/dd6/deb 0 2024-02-15T18:27:07.400 INFO:tasks.workunit.client.0.smithi084.stdout:3/608: symlink d8/d1f/dbf/db6/lcf 0 2024-02-15T18:27:07.400 INFO:tasks.workunit.client.0.smithi084.stdout:3/609: write d8/d40/d43/d71/fa4 [974715,3701] 0 2024-02-15T18:27:07.400 INFO:tasks.workunit.client.0.smithi084.stdout:3/610: read - d8/d40/faa zero size 2024-02-15T18:27:07.400 INFO:tasks.workunit.client.1.smithi133.stdout:8/295: symlink d3/de/d3e/l63 0 2024-02-15T18:27:07.403 INFO:tasks.workunit.client.1.smithi133.stdout:8/296: write d3/f4 [1552144,104075] 0 2024-02-15T18:27:07.403 INFO:tasks.workunit.client.1.smithi133.stdout:8/297: chown d3/d7/d40/l5e 82492 1 2024-02-15T18:27:07.405 INFO:tasks.workunit.client.0.smithi084.stdout:0/616: rename d0/d4/d1b/d26/c57 to d0/cb9 0 2024-02-15T18:27:07.407 INFO:tasks.workunit.client.0.smithi084.stdout:0/617: mknod d0/d2f/d3f/d4c/d9a/cba 0 2024-02-15T18:27:07.407 INFO:tasks.workunit.client.0.smithi084.stdout:0/618: dread - d0/d2f/d3f/d4f/d61/d79/f87 zero size 2024-02-15T18:27:07.407 INFO:tasks.workunit.client.1.smithi133.stdout:8/298: rename d3/f5 to d3/d1f/d4f/f64 0 2024-02-15T18:27:07.408 INFO:tasks.workunit.client.1.smithi133.stdout:8/299: write d3/d7/f4d [841422,22535] 0 2024-02-15T18:27:07.410 INFO:tasks.workunit.client.1.smithi133.stdout:0/304: write d9/d28/f4a [1767722,102644] 0 2024-02-15T18:27:07.410 INFO:tasks.workunit.client.1.smithi133.stdout:0/305: fsync d9/d10/d22/d32/f48 0 2024-02-15T18:27:07.411 INFO:tasks.workunit.client.0.smithi084.stdout:2/598: dwrite d3/d5/d1a/d1e/d4b/da6/f55 [0,4194304] 0 2024-02-15T18:27:07.411 INFO:tasks.workunit.client.1.smithi133.stdout:0/306: read d9/d10/d47/f62 [491766,22476] 0 2024-02-15T18:27:07.411 INFO:tasks.workunit.client.1.smithi133.stdout:0/307: chown d9/d10/d47/c56 14842415 1 2024-02-15T18:27:07.412 INFO:tasks.workunit.client.0.smithi084.stdout:6/633: dwrite d14/d22/d25/d2f/d31/d3f/d4a/f8d [0,4194304] 0 2024-02-15T18:27:07.412 INFO:tasks.workunit.client.0.smithi084.stdout:6/634: fsync d14/d22/d25/d2f/d31/d3f/d4a/f98 0 2024-02-15T18:27:07.412 INFO:tasks.workunit.client.0.smithi084.stdout:6/635: write d14/d22/d25/d2f/d31/d30/d45/d54/f6e [8830226,42830] 0 2024-02-15T18:27:07.413 INFO:tasks.workunit.client.1.smithi133.stdout:0/308: rename d9/d2b/l5b to d9/d10/d19/d1a/l6d 0 2024-02-15T18:27:07.413 INFO:tasks.workunit.client.1.smithi133.stdout:0/309: truncate d9/d10/d22/d2f/d30/d44/f6a 351644 0 2024-02-15T18:27:07.414 INFO:tasks.workunit.client.1.smithi133.stdout:5/259: dwrite fc [0,4194304] 0 2024-02-15T18:27:07.414 INFO:tasks.workunit.client.1.smithi133.stdout:5/260: stat d17/f47 0 2024-02-15T18:27:07.414 INFO:tasks.workunit.client.1.smithi133.stdout:0/310: mknod d9/d2b/c6e 0 2024-02-15T18:27:07.415 INFO:tasks.workunit.client.0.smithi084.stdout:2/599: write d3/d5/d1a/d1e/d4b/da6/d5c/f68 [1852852,44453] 0 2024-02-15T18:27:07.415 INFO:tasks.workunit.client.0.smithi084.stdout:2/600: truncate d3/d5/d1a/d1e/d47/f56 3797346 0 2024-02-15T18:27:07.415 INFO:tasks.workunit.client.1.smithi133.stdout:2/360: dwrite d7/d2c/d31/f5f [0,4194304] 0 2024-02-15T18:27:07.424 INFO:tasks.workunit.client.0.smithi084.stdout:3/611: dwrite d8/d1f/d2d/f96 [0,4194304] 0 2024-02-15T18:27:07.424 INFO:tasks.workunit.client.0.smithi084.stdout:3/612: dread - d8/d1f/dbf/fc9 zero size 2024-02-15T18:27:07.424 INFO:tasks.workunit.client.0.smithi084.stdout:6/636: mkdir d14/d22/dd2 0 2024-02-15T18:27:07.428 INFO:tasks.workunit.client.0.smithi084.stdout:6/637: getdents d14/d22/d25/d41/d43 0 2024-02-15T18:27:07.428 INFO:tasks.workunit.client.0.smithi084.stdout:6/638: dread - d14/d22/d25/d41/d43/fa6 zero size 2024-02-15T18:27:07.430 INFO:tasks.workunit.client.1.smithi133.stdout:1/505: dwrite d6/f24 [0,4194304] 0 2024-02-15T18:27:07.430 INFO:tasks.workunit.client.1.smithi133.stdout:1/506: truncate d6/d1e/d41/d7c/d7e/f9a 177348 0 2024-02-15T18:27:07.430 INFO:tasks.workunit.client.1.smithi133.stdout:8/300: dread d3/d1f/f2a [0,4194304] 0 2024-02-15T18:27:07.431 INFO:tasks.workunit.client.0.smithi084.stdout:6/639: mkdir d14/d22/d25/d2f/d31/d30/d45/d52/dd3 0 2024-02-15T18:27:07.431 INFO:tasks.workunit.client.0.smithi084.stdout:6/640: chown d14/d22/d25/l5e 329 1 2024-02-15T18:27:07.431 INFO:tasks.workunit.client.0.smithi084.stdout:2/601: dread d3/d5/d1a/d74/f77 [0,4194304] 0 2024-02-15T18:27:07.440 INFO:tasks.workunit.client.1.smithi133.stdout:6/468: truncate d0/f12 1632514 0 2024-02-15T18:27:07.440 INFO:tasks.workunit.client.1.smithi133.stdout:6/469: chown d0/db/d21/c8b 4082071 1 2024-02-15T18:27:07.440 INFO:tasks.workunit.client.1.smithi133.stdout:6/470: truncate d0/d3b/d41/f76 663984 0 2024-02-15T18:27:07.443 INFO:tasks.workunit.client.0.smithi084.stdout:5/721: dwrite d9/d5f/fd3 [8388608,4194304] 0 2024-02-15T18:27:07.443 INFO:tasks.workunit.client.0.smithi084.stdout:3/613: dread d8/d1f/dbf/f54 [0,4194304] 0 2024-02-15T18:27:07.444 INFO:tasks.workunit.client.0.smithi084.stdout:3/614: read d8/d40/d58/f72 [833348,31128] 0 2024-02-15T18:27:07.444 INFO:tasks.workunit.client.0.smithi084.stdout:9/700: dwrite d4/d6b/f97 [0,4194304] 0 2024-02-15T18:27:07.446 INFO:tasks.workunit.client.0.smithi084.stdout:3/615: link d8/d40/d43/l6d d8/d40/d58/d80/d6b/ld0 0 2024-02-15T18:27:07.447 INFO:tasks.workunit.client.0.smithi084.stdout:9/701: getdents d4/d2b/d3c/d24/dca/d15/d33/d7b 0 2024-02-15T18:27:07.447 INFO:tasks.workunit.client.1.smithi133.stdout:0/311: creat d9/d10/d19/d29/d67/f6f x:0 0 0 2024-02-15T18:27:07.448 INFO:tasks.workunit.client.0.smithi084.stdout:0/619: dwrite d0/d2f/d3f/d4f/d61/f70 [0,4194304] 0 2024-02-15T18:27:07.449 INFO:tasks.workunit.client.1.smithi133.stdout:2/361: symlink d7/d2c/d3b/d48/d59/l75 0 2024-02-15T18:27:07.450 INFO:tasks.workunit.client.0.smithi084.stdout:9/702: read d4/d2b/d3c/d24/dca/f14 [1685138,55645] 0 2024-02-15T18:27:07.453 INFO:tasks.workunit.client.1.smithi133.stdout:1/507: rmdir d6/d1e/d41/d7c 39 2024-02-15T18:27:07.454 INFO:tasks.workunit.client.1.smithi133.stdout:8/301: rename d3/d1f/f23 to d3/d7/d40/d61/f65 0 2024-02-15T18:27:07.455 INFO:tasks.workunit.client.1.smithi133.stdout:6/471: truncate d0/d3b/f6d 4035752 0 2024-02-15T18:27:07.456 INFO:tasks.workunit.client.1.smithi133.stdout:5/261: mknod d17/d20/d32/d38/c55 0 2024-02-15T18:27:07.456 INFO:tasks.workunit.client.0.smithi084.stdout:5/722: dread d9/d5f/d68/d9a/d8d/f8f [0,4194304] 0 2024-02-15T18:27:07.456 INFO:tasks.workunit.client.0.smithi084.stdout:5/723: write d9/fe [3691018,87410] 0 2024-02-15T18:27:07.457 INFO:tasks.workunit.client.0.smithi084.stdout:4/697: sync 2024-02-15T18:27:07.459 INFO:tasks.workunit.client.0.smithi084.stdout:8/661: sync 2024-02-15T18:27:07.459 INFO:tasks.workunit.client.0.smithi084.stdout:7/556: sync 2024-02-15T18:27:07.460 INFO:tasks.workunit.client.1.smithi133.stdout:5/262: truncate d17/d26/f21 2731816 0 2024-02-15T18:27:07.460 INFO:tasks.workunit.client.1.smithi133.stdout:8/302: creat d3/de/f66 x:0 0 0 2024-02-15T18:27:07.464 INFO:tasks.workunit.client.0.smithi084.stdout:0/620: mkdir d0/dbb 0 2024-02-15T18:27:07.464 INFO:tasks.workunit.client.0.smithi084.stdout:9/703: stat d4/d36/la6 0 2024-02-15T18:27:07.465 INFO:tasks.workunit.client.1.smithi133.stdout:5/263: creat d17/d20/d32/f56 x:0 0 0 2024-02-15T18:27:07.466 INFO:tasks.workunit.client.0.smithi084.stdout:9/704: mkdir d4/d2b/d3c/d20/d75/d87/de2 0 2024-02-15T18:27:07.467 INFO:tasks.workunit.client.0.smithi084.stdout:0/621: creat d0/d2f/d3f/d4f/d59/fbc x:0 0 0 2024-02-15T18:27:07.469 INFO:tasks.workunit.client.0.smithi084.stdout:9/705: truncate d4/d2b/d3c/f8b 415506 0 2024-02-15T18:27:07.469 INFO:tasks.workunit.client.1.smithi133.stdout:2/362: dread d7/d18/d32/d65/d54/f57 [0,4194304] 0 2024-02-15T18:27:07.470 INFO:tasks.workunit.client.0.smithi084.stdout:7/557: dread df/d70/f6d [0,4194304] 0 2024-02-15T18:27:07.470 INFO:tasks.workunit.client.0.smithi084.stdout:6/641: dwrite fb [0,4194304] 0 2024-02-15T18:27:07.473 INFO:tasks.workunit.client.0.smithi084.stdout:7/558: symlink df/d70/laf 0 2024-02-15T18:27:07.473 INFO:tasks.workunit.client.0.smithi084.stdout:7/559: read - df/f6e zero size 2024-02-15T18:27:07.473 INFO:tasks.workunit.client.0.smithi084.stdout:7/560: fdatasync df/d1d/d1a/d4b/f57 0 2024-02-15T18:27:07.473 INFO:tasks.workunit.client.0.smithi084.stdout:7/561: chown df/d1d/d1a/f60 52488769 1 2024-02-15T18:27:07.473 INFO:tasks.workunit.client.0.smithi084.stdout:7/562: write df/d1d/d1a/d6a/d8b/d7f/f9a [765300,100688] 0 2024-02-15T18:27:07.475 INFO:tasks.workunit.client.0.smithi084.stdout:8/662: dread db/dd/d13/d42/f80 [0,4194304] 0 2024-02-15T18:27:07.476 INFO:tasks.workunit.client.1.smithi133.stdout:6/472: write d0/d5/f1b [1303629,84315] 0 2024-02-15T18:27:07.478 INFO:tasks.workunit.client.0.smithi084.stdout:7/563: creat df/d70/fb0 x:0 0 0 2024-02-15T18:27:07.479 INFO:tasks.workunit.client.0.smithi084.stdout:6/642: read d14/d22/d25/d2f/d31/d3f/d4a/f4c [3260392,86749] 0 2024-02-15T18:27:07.479 INFO:tasks.workunit.client.0.smithi084.stdout:6/643: dread - d14/d22/d25/d41/fb4 zero size 2024-02-15T18:27:07.480 INFO:tasks.workunit.client.0.smithi084.stdout:6/644: fdatasync d14/d22/d25/d2f/d31/d3f/f42 0 2024-02-15T18:27:07.482 INFO:tasks.workunit.client.1.smithi133.stdout:6/473: unlink d0/db/d21/f23 0 2024-02-15T18:27:07.483 INFO:tasks.workunit.client.0.smithi084.stdout:6/645: creat d14/d22/d25/d2f/d31/d3f/d4a/fd4 x:0 0 0 2024-02-15T18:27:07.485 INFO:tasks.workunit.client.0.smithi084.stdout:2/602: dwrite d3/d5/d1a/f4e [0,4194304] 0 2024-02-15T18:27:07.485 INFO:tasks.workunit.client.0.smithi084.stdout:2/603: chown d3/d5/d1a/d1e/d4b/da6/f8c 54 1 2024-02-15T18:27:07.487 INFO:tasks.workunit.client.0.smithi084.stdout:8/663: dread db/dd/d4d/f8a [0,4194304] 0 2024-02-15T18:27:07.488 INFO:tasks.workunit.client.0.smithi084.stdout:3/616: dwrite d8/f12 [4194304,4194304] 0 2024-02-15T18:27:07.488 INFO:tasks.workunit.client.0.smithi084.stdout:3/617: chown d8/d1f/f20 20115010 1 2024-02-15T18:27:07.488 INFO:tasks.workunit.client.0.smithi084.stdout:3/618: readlink d8/d1f/dbf/db6/lc7 0 2024-02-15T18:27:07.489 INFO:tasks.workunit.client.0.smithi084.stdout:2/604: mkdir d3/d19/dc5 0 2024-02-15T18:27:07.489 INFO:tasks.workunit.client.0.smithi084.stdout:2/605: chown d3/d5/d1a/d1e/d4b/c54 219032 1 2024-02-15T18:27:07.491 INFO:tasks.workunit.client.0.smithi084.stdout:3/619: creat d8/d40/d58/d80/d6b/fd1 x:0 0 0 2024-02-15T18:27:07.492 INFO:tasks.workunit.client.0.smithi084.stdout:0/622: dread d0/d39/d45/f5e [0,4194304] 0 2024-02-15T18:27:07.494 INFO:tasks.workunit.client.0.smithi084.stdout:9/706: write d4/d2b/d3c/d20/d75/d87/fa8 [1140363,122150] 0 2024-02-15T18:27:07.494 INFO:tasks.workunit.client.0.smithi084.stdout:0/623: mknod d0/d4/d1b/d26/d43/d6d/cbd 0 2024-02-15T18:27:07.495 INFO:tasks.workunit.client.1.smithi133.stdout:6/474: creat d0/db/d29/d34/f97 x:0 0 0 2024-02-15T18:27:07.497 INFO:tasks.workunit.client.0.smithi084.stdout:1/550: sync 2024-02-15T18:27:07.497 INFO:tasks.workunit.client.0.smithi084.stdout:9/707: symlink d4/da3/dc3/le3 0 2024-02-15T18:27:07.497 INFO:tasks.workunit.client.0.smithi084.stdout:0/624: link d0/d2f/d3f/lac d0/d2f/d4b/dae/lbe 0 2024-02-15T18:27:07.498 INFO:tasks.workunit.client.0.smithi084.stdout:9/708: creat d4/d3d/da5/fe4 x:0 0 0 2024-02-15T18:27:07.498 INFO:tasks.workunit.client.0.smithi084.stdout:9/709: chown d4/d2b/f50 10567275 1 2024-02-15T18:27:07.498 INFO:tasks.workunit.client.0.smithi084.stdout:9/710: fsync d4/d2b/d3c/d20/d75/f7a 0 2024-02-15T18:27:07.500 INFO:tasks.workunit.client.0.smithi084.stdout:0/625: rename d0/d2f/d3f/d4f/fad to d0/d4/d3a/fbf 0 2024-02-15T18:27:07.502 INFO:tasks.workunit.client.0.smithi084.stdout:7/564: write df/d1d/f18 [1397632,29685] 0 2024-02-15T18:27:07.503 INFO:tasks.workunit.client.0.smithi084.stdout:8/664: write db/d1a/d2b/f51 [1188026,38115] 0 2024-02-15T18:27:07.505 INFO:tasks.workunit.client.1.smithi133.stdout:6/475: rename d0/db/d29/d34/d7c/d7e to d0/db/d29/d34/d8c/d98 0 2024-02-15T18:27:07.505 INFO:tasks.workunit.client.1.smithi133.stdout:6/476: chown d0/db/f4f 1295 1 2024-02-15T18:27:07.505 INFO:tasks.workunit.client.1.smithi133.stdout:6/477: chown d0/db/d29/d34/d8c/d98/f96 10119009 1 2024-02-15T18:27:07.506 INFO:tasks.workunit.client.1.smithi133.stdout:6/478: creat d0/d3b/f99 x:0 0 0 2024-02-15T18:27:07.507 INFO:tasks.workunit.client.0.smithi084.stdout:0/626: write d0/d2f/d3f/d4f/d61/f70 [2325260,92887] 0 2024-02-15T18:27:07.508 INFO:tasks.workunit.client.1.smithi133.stdout:6/479: mkdir d0/d3b/d67/d9a 0 2024-02-15T18:27:07.513 INFO:tasks.workunit.client.0.smithi084.stdout:2/606: dread d3/d5/d1a/d1e/d4b/da6/f8c [0,4194304] 0 2024-02-15T18:27:07.519 INFO:tasks.workunit.client.0.smithi084.stdout:1/551: dread d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 [0,4194304] 0 2024-02-15T18:27:07.519 INFO:tasks.workunit.client.0.smithi084.stdout:5/724: dwrite d9/d23/f6d [0,4194304] 0 2024-02-15T18:27:07.520 INFO:tasks.workunit.client.0.smithi084.stdout:9/711: dread d4/d2b/d3c/d20/d75/f7a [0,4194304] 0 2024-02-15T18:27:07.525 INFO:tasks.workunit.client.1.smithi133.stdout:1/508: dwrite d6/d1e/f23 [4194304,4194304] 0 2024-02-15T18:27:07.526 INFO:tasks.workunit.client.1.smithi133.stdout:0/312: dwrite d9/ff [0,4194304] 0 2024-02-15T18:27:07.528 INFO:tasks.workunit.client.1.smithi133.stdout:8/303: dwrite d3/d1c/f1e [0,4194304] 0 2024-02-15T18:27:07.528 INFO:tasks.workunit.client.1.smithi133.stdout:0/313: symlink d9/d2b/l70 0 2024-02-15T18:27:07.529 INFO:tasks.workunit.client.0.smithi084.stdout:4/698: dwrite d2/d4/f55 [0,4194304] 0 2024-02-15T18:27:07.529 INFO:tasks.workunit.client.0.smithi084.stdout:6/646: dwrite d14/d22/d25/d2f/d31/d3f/fbf [0,4194304] 0 2024-02-15T18:27:07.530 INFO:tasks.workunit.client.0.smithi084.stdout:6/647: write d14/d22/d25/f2b [9063438,32407] 0 2024-02-15T18:27:07.530 INFO:tasks.workunit.client.0.smithi084.stdout:3/620: dwrite d8/d40/d43/f8b [4194304,4194304] 0 2024-02-15T18:27:07.530 INFO:tasks.workunit.client.1.smithi133.stdout:2/363: dwrite d7/ff [0,4194304] 0 2024-02-15T18:27:07.530 INFO:tasks.workunit.client.1.smithi133.stdout:2/364: dread - d7/d18/d32/d65/f55 zero size 2024-02-15T18:27:07.530 INFO:tasks.workunit.client.1.smithi133.stdout:2/365: write d7/d2c/d46/f6e [66026,33619] 0 2024-02-15T18:27:07.531 INFO:tasks.workunit.client.1.smithi133.stdout:5/264: dwrite d17/d20/d32/f56 [0,4194304] 0 2024-02-15T18:27:07.531 INFO:tasks.workunit.client.1.smithi133.stdout:5/265: fdatasync d17/d20/d32/f56 0 2024-02-15T18:27:07.531 INFO:tasks.workunit.client.1.smithi133.stdout:8/304: unlink d3/d1f/d3f/f4e 0 2024-02-15T18:27:07.535 INFO:tasks.workunit.client.1.smithi133.stdout:2/366: symlink d7/d18/d32/l76 0 2024-02-15T18:27:07.535 INFO:tasks.workunit.client.1.smithi133.stdout:2/367: dread - d7/d2c/d46/f72 zero size 2024-02-15T18:27:07.535 INFO:tasks.workunit.client.1.smithi133.stdout:2/368: readlink d7/l25 0 2024-02-15T18:27:07.535 INFO:tasks.workunit.client.1.smithi133.stdout:2/369: fsync d7/d2c/f68 0 2024-02-15T18:27:07.541 INFO:tasks.workunit.client.1.smithi133.stdout:6/480: getdents d0/db/d21 0 2024-02-15T18:27:07.544 INFO:tasks.workunit.client.1.smithi133.stdout:8/305: symlink d3/d7/l67 0 2024-02-15T18:27:07.544 INFO:tasks.workunit.client.1.smithi133.stdout:5/266: creat d17/d20/f57 x:0 0 0 2024-02-15T18:27:07.546 INFO:tasks.workunit.client.1.smithi133.stdout:2/370: symlink d7/d2c/d46/l77 0 2024-02-15T18:27:07.546 INFO:tasks.workunit.client.1.smithi133.stdout:2/371: truncate d7/d2c/d3b/d48/d59/f69 1045272 0 2024-02-15T18:27:07.546 INFO:tasks.workunit.client.1.smithi133.stdout:2/372: chown d7/db/d35 8126 1 2024-02-15T18:27:07.546 INFO:tasks.workunit.client.1.smithi133.stdout:5/267: write d17/d20/f22 [1266304,65917] 0 2024-02-15T18:27:07.546 INFO:tasks.workunit.client.1.smithi133.stdout:5/268: fsync d17/d2a/f41 0 2024-02-15T18:27:07.546 INFO:tasks.workunit.client.1.smithi133.stdout:8/306: unlink d3/d1c/d2f/f36 0 2024-02-15T18:27:07.547 INFO:tasks.workunit.client.1.smithi133.stdout:5/269: creat d17/d26/f58 x:0 0 0 2024-02-15T18:27:07.547 INFO:tasks.workunit.client.1.smithi133.stdout:5/270: chown f15 269 1 2024-02-15T18:27:07.548 INFO:tasks.workunit.client.1.smithi133.stdout:5/271: link d17/d20/d32/d38/f54 d17/f59 0 2024-02-15T18:27:07.548 INFO:tasks.workunit.client.1.smithi133.stdout:5/272: chown d17/d20/f2f 1050112 1 2024-02-15T18:27:07.549 INFO:tasks.workunit.client.1.smithi133.stdout:5/273: symlink d17/d20/d32/l5a 0 2024-02-15T18:27:07.550 INFO:tasks.workunit.client.1.smithi133.stdout:5/274: mknod d17/d20/c5b 0 2024-02-15T18:27:07.550 INFO:tasks.workunit.client.1.smithi133.stdout:5/275: write d17/d2a/f31 [200724,29796] 0 2024-02-15T18:27:07.550 INFO:tasks.workunit.client.1.smithi133.stdout:5/276: chown d17/d2a/l45 23 1 2024-02-15T18:27:07.550 INFO:tasks.workunit.client.1.smithi133.stdout:6/481: write d0/d5/f3a [3538536,61683] 0 2024-02-15T18:27:07.552 INFO:tasks.workunit.client.1.smithi133.stdout:5/277: rename c14 to d17/d20/c5c 0 2024-02-15T18:27:07.555 INFO:tasks.workunit.client.1.smithi133.stdout:6/482: symlink d0/d3b/d67/l9b 0 2024-02-15T18:27:07.555 INFO:tasks.workunit.client.1.smithi133.stdout:6/483: fsync d0/db/d21/f75 0 2024-02-15T18:27:07.555 INFO:tasks.workunit.client.1.smithi133.stdout:5/278: creat d17/d26/f5d x:0 0 0 2024-02-15T18:27:07.555 INFO:tasks.workunit.client.1.smithi133.stdout:5/279: write d17/f4a [934637,1025] 0 2024-02-15T18:27:07.555 INFO:tasks.workunit.client.1.smithi133.stdout:5/280: stat d17/f33 0 2024-02-15T18:27:07.556 INFO:tasks.workunit.client.1.smithi133.stdout:2/373: dread d7/f15 [0,4194304] 0 2024-02-15T18:27:07.556 INFO:tasks.workunit.client.1.smithi133.stdout:6/484: mkdir d0/d62/d9c 0 2024-02-15T18:27:07.560 INFO:tasks.workunit.client.1.smithi133.stdout:2/374: creat d7/d2c/d3b/d48/d6d/f78 x:0 0 0 2024-02-15T18:27:07.564 INFO:tasks.workunit.client.1.smithi133.stdout:2/375: rmdir d7/d18/d32/d65/d58/d5b 0 2024-02-15T18:27:07.568 INFO:tasks.workunit.client.1.smithi133.stdout:1/509: dwrite d6/d1e/d41/d7c/d7e/f94 [0,4194304] 0 2024-02-15T18:27:07.568 INFO:tasks.workunit.client.1.smithi133.stdout:0/314: dwrite f0 [0,4194304] 0 2024-02-15T18:27:07.577 INFO:tasks.workunit.client.1.smithi133.stdout:9/240: sync 2024-02-15T18:27:07.577 INFO:tasks.workunit.client.1.smithi133.stdout:9/241: stat d0 0 2024-02-15T18:27:07.577 INFO:tasks.workunit.client.1.smithi133.stdout:9/242: write d0/d8/d9/d12/f3f [836465,99904] 0 2024-02-15T18:27:07.577 INFO:tasks.workunit.client.1.smithi133.stdout:9/243: fsync d0/f16 0 2024-02-15T18:27:07.577 INFO:tasks.workunit.client.1.smithi133.stdout:3/374: sync 2024-02-15T18:27:07.579 INFO:tasks.workunit.client.1.smithi133.stdout:9/244: truncate d0/f6 4692297 0 2024-02-15T18:27:07.579 INFO:tasks.workunit.client.1.smithi133.stdout:9/245: fdatasync d0/d8/d9/f31 0 2024-02-15T18:27:07.580 INFO:tasks.workunit.client.1.smithi133.stdout:4/243: sync 2024-02-15T18:27:07.581 INFO:tasks.workunit.client.1.smithi133.stdout:0/315: read d9/d10/d22/f23 [123655,79655] 0 2024-02-15T18:27:07.581 INFO:tasks.workunit.client.1.smithi133.stdout:3/375: creat d0/d15/d2f/d5e/f76 x:0 0 0 2024-02-15T18:27:07.581 INFO:tasks.workunit.client.1.smithi133.stdout:3/376: chown d0/d15/d2b/d62/f71 4779525 1 2024-02-15T18:27:07.584 INFO:tasks.workunit.client.1.smithi133.stdout:0/316: creat d9/d10/d22/d2f/f71 x:0 0 0 2024-02-15T18:27:07.584 INFO:tasks.workunit.client.1.smithi133.stdout:4/244: creat d2/d5/f59 x:0 0 0 2024-02-15T18:27:07.585 INFO:tasks.workunit.client.1.smithi133.stdout:5/281: dwrite d17/f33 [0,4194304] 0 2024-02-15T18:27:07.585 INFO:tasks.workunit.client.0.smithi084.stdout:8/665: mknod db/dd/d4d/cda 0 2024-02-15T18:27:07.585 INFO:tasks.workunit.client.0.smithi084.stdout:8/666: fsync db/f16 0 2024-02-15T18:27:07.585 INFO:tasks.workunit.client.0.smithi084.stdout:7/565: creat df/d1d/d1a/d6a/d8b/d7f/fb1 x:0 0 0 2024-02-15T18:27:07.587 INFO:tasks.workunit.client.1.smithi133.stdout:3/377: unlink d0/c36 0 2024-02-15T18:27:07.587 INFO:tasks.workunit.client.1.smithi133.stdout:3/378: chown d0/f2d 89 1 2024-02-15T18:27:07.588 INFO:tasks.workunit.client.1.smithi133.stdout:6/485: dwrite d0/db/d21/f3c [0,4194304] 0 2024-02-15T18:27:07.588 INFO:tasks.workunit.client.1.smithi133.stdout:0/317: creat d9/d2b/f72 x:0 0 0 2024-02-15T18:27:07.589 INFO:tasks.workunit.client.1.smithi133.stdout:4/245: mknod d2/d5/c5a 0 2024-02-15T18:27:07.589 INFO:tasks.workunit.client.1.smithi133.stdout:0/318: chown d9/d10/d22/d32 9911 1 2024-02-15T18:27:07.589 INFO:tasks.workunit.client.1.smithi133.stdout:5/282: mkdir d17/d20/d5e 0 2024-02-15T18:27:07.590 INFO:tasks.workunit.client.1.smithi133.stdout:8/307: dwrite d3/f4 [0,4194304] 0 2024-02-15T18:27:07.590 INFO:tasks.workunit.client.1.smithi133.stdout:8/308: write d3/d7/d52/f56 [841853,110854] 0 2024-02-15T18:27:07.590 INFO:tasks.workunit.client.1.smithi133.stdout:3/379: rename d0/d15/d37/c49 to d0/d15/d54/c77 0 2024-02-15T18:27:07.594 INFO:tasks.workunit.client.1.smithi133.stdout:6/486: mkdir d0/d3b/d9d 0 2024-02-15T18:27:07.595 INFO:tasks.workunit.client.1.smithi133.stdout:0/319: link d9/d2b/f72 d9/d10/d19/f73 0 2024-02-15T18:27:07.597 INFO:tasks.workunit.client.1.smithi133.stdout:4/246: creat d2/d5/d2b/f5b x:0 0 0 2024-02-15T18:27:07.597 INFO:tasks.workunit.client.1.smithi133.stdout:0/320: read d9/d2b/f45 [2458519,77682] 0 2024-02-15T18:27:07.599 INFO:tasks.workunit.client.1.smithi133.stdout:5/283: mkdir d17/d20/d4f/d5f 0 2024-02-15T18:27:07.599 INFO:tasks.workunit.client.1.smithi133.stdout:8/309: mknod d3/d7/d40/c68 0 2024-02-15T18:27:07.599 INFO:tasks.workunit.client.1.smithi133.stdout:8/310: write d3/d1c/f51 [5136206,108046] 0 2024-02-15T18:27:07.600 INFO:tasks.workunit.client.1.smithi133.stdout:3/380: mkdir d0/d15/d2b/d62/d74/d78 0 2024-02-15T18:27:07.602 INFO:tasks.workunit.client.0.smithi084.stdout:1/552: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/lba 0 2024-02-15T18:27:07.603 INFO:tasks.workunit.client.0.smithi084.stdout:1/553: chown d9/d54/d1b/d2c/d4b/d7a/d89/f98 6293912 1 2024-02-15T18:27:07.603 INFO:tasks.workunit.client.0.smithi084.stdout:1/554: fsync d9/d54/d1b/d2c/d35/f73 0 2024-02-15T18:27:07.604 INFO:tasks.workunit.client.1.smithi133.stdout:2/376: dwrite d7/d2c/d5a/f60 [0,4194304] 0 2024-02-15T18:27:07.604 INFO:tasks.workunit.client.0.smithi084.stdout:1/555: write d9/d54/f99 [3652933,24896] 0 2024-02-15T18:27:07.605 INFO:tasks.workunit.client.1.smithi133.stdout:6/487: rename d0/db/d29/d34/d5d/c2c to d0/d3b/d78/d7f/c9e 0 2024-02-15T18:27:07.606 INFO:tasks.workunit.client.0.smithi084.stdout:5/725: mkdir d9/d23/dac/dc9/dec 0 2024-02-15T18:27:07.607 INFO:tasks.workunit.client.1.smithi133.stdout:1/510: dwrite d6/d1e/d3a/d82/d85/d67/f87 [0,4194304] 0 2024-02-15T18:27:07.607 INFO:tasks.workunit.client.0.smithi084.stdout:4/699: mkdir d2/d4/d28/d3d/d5c/d5d/dcf 0 2024-02-15T18:27:07.608 INFO:tasks.workunit.client.1.smithi133.stdout:7/210: sync 2024-02-15T18:27:07.608 INFO:tasks.workunit.client.1.smithi133.stdout:7/211: readlink d9/db/dc/l45 0 2024-02-15T18:27:07.608 INFO:tasks.workunit.client.1.smithi133.stdout:0/321: dread d9/d10/d19/f3d [0,4194304] 0 2024-02-15T18:27:07.608 INFO:tasks.workunit.client.1.smithi133.stdout:0/322: write d9/f3e [1157309,90056] 0 2024-02-15T18:27:07.608 INFO:tasks.workunit.client.1.smithi133.stdout:0/323: dread - d9/d10/d19/d1a/f4b zero size 2024-02-15T18:27:07.610 INFO:tasks.workunit.client.0.smithi084.stdout:5/726: write d9/da/d3d/d44/d55/d70/d84/da1/f9f [7411251,3769] 0 2024-02-15T18:27:07.616 INFO:tasks.workunit.client.1.smithi133.stdout:5/284: creat d17/d20/d4f/d5f/f60 x:0 0 0 2024-02-15T18:27:07.617 INFO:tasks.workunit.client.1.smithi133.stdout:8/311: truncate d3/d1f/f2c 1881283 0 2024-02-15T18:27:07.622 INFO:tasks.workunit.client.1.smithi133.stdout:2/377: dread d7/f15 [0,4194304] 0 2024-02-15T18:27:07.626 INFO:tasks.workunit.client.1.smithi133.stdout:7/212: creat d9/db/d16/f49 x:0 0 0 2024-02-15T18:27:07.626 INFO:tasks.workunit.client.1.smithi133.stdout:0/324: creat d9/d10/d22/d32/f74 x:0 0 0 2024-02-15T18:27:07.626 INFO:tasks.workunit.client.1.smithi133.stdout:5/285: symlink d17/d20/l61 0 2024-02-15T18:27:07.626 INFO:tasks.workunit.client.1.smithi133.stdout:0/325: fdatasync d9/d10/d19/d1a/f61 0 2024-02-15T18:27:07.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/326: chown d9/d10/d19/d1a/f4b 4859 1 2024-02-15T18:27:07.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/327: write f5 [4980540,91961] 0 2024-02-15T18:27:07.628 INFO:tasks.workunit.client.1.smithi133.stdout:8/312: symlink d3/d1c/l69 0 2024-02-15T18:27:07.628 INFO:tasks.workunit.client.1.smithi133.stdout:8/313: rename d3/d1f to d3/d1f/d3f/d6a 22 2024-02-15T18:27:07.628 INFO:tasks.workunit.client.1.smithi133.stdout:5/286: creat d17/f62 x:0 0 0 2024-02-15T18:27:07.629 INFO:tasks.workunit.client.1.smithi133.stdout:6/488: dread d0/d3b/f6d [0,4194304] 0 2024-02-15T18:27:07.630 INFO:tasks.workunit.client.1.smithi133.stdout:5/287: rename d17/f19 to d17/d26/f63 0 2024-02-15T18:27:07.630 INFO:tasks.workunit.client.1.smithi133.stdout:5/288: chown d17/f62 1204 1 2024-02-15T18:27:07.633 INFO:tasks.workunit.client.1.smithi133.stdout:2/378: write f1 [1210251,8830] 0 2024-02-15T18:27:07.634 INFO:tasks.workunit.client.1.smithi133.stdout:5/289: link d17/d20/f2f d17/d20/d4f/f64 0 2024-02-15T18:27:07.635 INFO:tasks.workunit.client.1.smithi133.stdout:5/290: stat l8 0 2024-02-15T18:27:07.635 INFO:tasks.workunit.client.1.smithi133.stdout:4/247: dwrite d2/f23 [0,4194304] 0 2024-02-15T18:27:07.635 INFO:tasks.workunit.client.1.smithi133.stdout:4/248: chown d2/d48 31204 1 2024-02-15T18:27:07.635 INFO:tasks.workunit.client.1.smithi133.stdout:8/314: dread d3/f43 [0,4194304] 0 2024-02-15T18:27:07.635 INFO:tasks.workunit.client.1.smithi133.stdout:8/315: truncate d3/f46 361852 0 2024-02-15T18:27:07.635 INFO:tasks.workunit.client.1.smithi133.stdout:2/379: truncate d7/d18/d32/f4c 1352834 0 2024-02-15T18:27:07.636 INFO:tasks.workunit.client.1.smithi133.stdout:4/249: mkdir d2/d48/d5c 0 2024-02-15T18:27:07.637 INFO:tasks.workunit.client.1.smithi133.stdout:6/489: link d0/db/f82 d0/db/f9f 0 2024-02-15T18:27:07.638 INFO:tasks.workunit.client.0.smithi084.stdout:9/712: creat d4/d2b/d3c/d24/dca/d15/fe5 x:0 0 0 2024-02-15T18:27:07.639 INFO:tasks.workunit.client.1.smithi133.stdout:4/250: creat d2/d5/d2b/d21/d2d/f5d x:0 0 0 2024-02-15T18:27:07.639 INFO:tasks.workunit.client.1.smithi133.stdout:2/380: dread d7/d2c/d46/f6e [0,4194304] 0 2024-02-15T18:27:07.639 INFO:tasks.workunit.client.1.smithi133.stdout:3/381: dwrite d0/d15/d2b/d39/d3f/f22 [0,4194304] 0 2024-02-15T18:27:07.639 INFO:tasks.workunit.client.1.smithi133.stdout:3/382: truncate d0/d15/d37/f4b 638440 0 2024-02-15T18:27:07.639 INFO:tasks.workunit.client.1.smithi133.stdout:8/316: rename d3/d1c/d37/l50 to d3/de/l6b 0 2024-02-15T18:27:07.639 INFO:tasks.workunit.client.1.smithi133.stdout:3/383: rename d0/d15/d2b/d62 to d0/d15/d2b/d62/d74/d78/d79 22 2024-02-15T18:27:07.641 INFO:tasks.workunit.client.1.smithi133.stdout:6/490: unlink d0/db/l20 0 2024-02-15T18:27:07.641 INFO:tasks.workunit.client.1.smithi133.stdout:6/491: fdatasync d0/f50 0 2024-02-15T18:27:07.642 INFO:tasks.workunit.client.1.smithi133.stdout:2/381: creat d7/d18/d32/f79 x:0 0 0 2024-02-15T18:27:07.642 INFO:tasks.workunit.client.1.smithi133.stdout:2/382: dread - d7/d2c/d46/f72 zero size 2024-02-15T18:27:07.642 INFO:tasks.workunit.client.1.smithi133.stdout:6/492: read d0/db/d29/d34/d5d/d40/f7a [27300,62011] 0 2024-02-15T18:27:07.646 INFO:tasks.workunit.client.1.smithi133.stdout:2/383: creat d7/d2c/d3b/d48/d59/d74/f7a x:0 0 0 2024-02-15T18:27:07.647 INFO:tasks.workunit.client.1.smithi133.stdout:6/493: rename d0/d3b/d53/f6e to d0/d3b/d41/fa0 0 2024-02-15T18:27:07.648 INFO:tasks.workunit.client.1.smithi133.stdout:2/384: mkdir d7/db/d67/d7b 0 2024-02-15T18:27:07.648 INFO:tasks.workunit.client.1.smithi133.stdout:2/385: stat d7/d18/d32/f4c 0 2024-02-15T18:27:07.649 INFO:tasks.workunit.client.1.smithi133.stdout:2/386: dread - d7/d2c/d3b/d48/d6d/f78 zero size 2024-02-15T18:27:07.650 INFO:tasks.workunit.client.1.smithi133.stdout:1/511: dwrite d6/d2a/d59/d5a/f9b [0,4194304] 0 2024-02-15T18:27:07.651 INFO:tasks.workunit.client.1.smithi133.stdout:1/512: stat d6/d1e/d3a/f61 0 2024-02-15T18:27:07.651 INFO:tasks.workunit.client.1.smithi133.stdout:6/494: mkdir d0/db/d29/d34/d48/da1 0 2024-02-15T18:27:07.654 INFO:tasks.workunit.client.1.smithi133.stdout:6/495: symlink d0/db/d29/d34/la2 0 2024-02-15T18:27:07.655 INFO:tasks.workunit.client.1.smithi133.stdout:6/496: write d0/d3b/f45 [1307902,42332] 0 2024-02-15T18:27:07.655 INFO:tasks.workunit.client.1.smithi133.stdout:7/213: dwrite d9/db/dc/f35 [0,4194304] 0 2024-02-15T18:27:07.655 INFO:tasks.workunit.client.1.smithi133.stdout:7/214: readlink d9/da/l33 0 2024-02-15T18:27:07.659 INFO:tasks.workunit.client.1.smithi133.stdout:3/384: dread d0/d15/f24 [0,4194304] 0 2024-02-15T18:27:07.659 INFO:tasks.workunit.client.1.smithi133.stdout:7/215: read d9/db/f3e [2065400,33249] 0 2024-02-15T18:27:07.661 INFO:tasks.workunit.client.1.smithi133.stdout:6/497: unlink d0/ff 0 2024-02-15T18:27:07.661 INFO:tasks.workunit.client.1.smithi133.stdout:6/498: write d0/db/f82 [159559,76674] 0 2024-02-15T18:27:07.661 INFO:tasks.workunit.client.1.smithi133.stdout:4/251: getdents d2/d5/d2b 0 2024-02-15T18:27:07.663 INFO:tasks.workunit.client.1.smithi133.stdout:3/385: creat d0/d15/d2b/f7a x:0 0 0 2024-02-15T18:27:07.663 INFO:tasks.workunit.client.1.smithi133.stdout:3/386: write d0/d15/d2f/f30 [989137,17293] 0 2024-02-15T18:27:07.663 INFO:tasks.workunit.client.1.smithi133.stdout:3/387: stat d0/d15/d2f/l2e 0 2024-02-15T18:27:07.663 INFO:tasks.workunit.client.1.smithi133.stdout:3/388: chown d0/d15/d2b/f58 2343638 1 2024-02-15T18:27:07.664 INFO:tasks.workunit.client.1.smithi133.stdout:3/389: fdatasync d0/d15/d2b/f5c 0 2024-02-15T18:27:07.664 INFO:tasks.workunit.client.1.smithi133.stdout:7/216: truncate d9/d36/f2e 1832476 0 2024-02-15T18:27:07.664 INFO:tasks.workunit.client.1.smithi133.stdout:4/252: mkdir d2/d5/d2b/d21/d2d/d44/d51/d55/d5e 0 2024-02-15T18:27:07.666 INFO:tasks.workunit.client.1.smithi133.stdout:7/217: creat d9/db/f4a x:0 0 0 2024-02-15T18:27:07.666 INFO:tasks.workunit.client.1.smithi133.stdout:4/253: symlink d2/d5/d2b/l5f 0 2024-02-15T18:27:07.667 INFO:tasks.workunit.client.1.smithi133.stdout:0/328: dread f5 [0,4194304] 0 2024-02-15T18:27:07.667 INFO:tasks.workunit.client.1.smithi133.stdout:6/499: dread d0/f32 [0,4194304] 0 2024-02-15T18:27:07.668 INFO:tasks.workunit.client.1.smithi133.stdout:7/218: creat d9/db/d16/f4b x:0 0 0 2024-02-15T18:27:07.668 INFO:tasks.workunit.client.1.smithi133.stdout:7/219: getdents d9/d36/d39 0 2024-02-15T18:27:07.670 INFO:tasks.workunit.client.1.smithi133.stdout:7/220: write d9/f2a [413034,109965] 0 2024-02-15T18:27:07.670 INFO:tasks.workunit.client.1.smithi133.stdout:7/221: dread - d9/db/f3c zero size 2024-02-15T18:27:07.670 INFO:tasks.workunit.client.1.smithi133.stdout:7/222: fdatasync d9/d36/f23 0 2024-02-15T18:27:07.670 INFO:tasks.workunit.client.1.smithi133.stdout:0/329: creat d9/f75 x:0 0 0 2024-02-15T18:27:07.670 INFO:tasks.workunit.client.1.smithi133.stdout:0/330: fsync d9/f14 0 2024-02-15T18:27:07.670 INFO:tasks.workunit.client.1.smithi133.stdout:0/331: dread - d9/d10/d22/d2f/d30/d44/f4c zero size 2024-02-15T18:27:07.671 INFO:tasks.workunit.client.1.smithi133.stdout:6/500: rename d0/d5/f1b to d0/d3b/d85/fa3 0 2024-02-15T18:27:07.671 INFO:tasks.workunit.client.1.smithi133.stdout:6/501: readlink d0/d3b/d67/l9b 0 2024-02-15T18:27:07.671 INFO:tasks.workunit.client.1.smithi133.stdout:6/502: dread - d0/db/d29/d34/d5d/f6b zero size 2024-02-15T18:27:07.673 INFO:tasks.workunit.client.1.smithi133.stdout:6/503: mknod d0/db/d29/d34/ca4 0 2024-02-15T18:27:07.674 INFO:tasks.workunit.client.1.smithi133.stdout:0/332: symlink d9/d10/d47/d5e/l76 0 2024-02-15T18:27:07.674 INFO:tasks.workunit.client.1.smithi133.stdout:6/504: mkdir d0/db/d29/d34/d8c/da5 0 2024-02-15T18:27:07.675 INFO:tasks.workunit.client.1.smithi133.stdout:6/505: chown d0/db/d29/d34/ca4 113067430 1 2024-02-15T18:27:07.677 INFO:tasks.workunit.client.1.smithi133.stdout:6/506: unlink d0/db/c4d 0 2024-02-15T18:27:07.677 INFO:tasks.workunit.client.1.smithi133.stdout:6/507: chown d0/d3b/d52/f59 411450 1 2024-02-15T18:27:07.678 INFO:tasks.workunit.client.1.smithi133.stdout:6/508: creat d0/db/d29/d34/d5d/fa6 x:0 0 0 2024-02-15T18:27:07.682 INFO:tasks.workunit.client.0.smithi084.stdout:0/627: rename d0/d4/d1b/f3c to d0/d98/fc0 0 2024-02-15T18:27:07.682 INFO:tasks.workunit.client.0.smithi084.stdout:0/628: fsync d0/d4/d3a/fbf 0 2024-02-15T18:27:07.682 INFO:tasks.workunit.client.0.smithi084.stdout:0/629: dread - d0/d2f/faa zero size 2024-02-15T18:27:07.685 INFO:tasks.workunit.client.1.smithi133.stdout:6/509: dread d0/d3b/d52/f59 [0,4194304] 0 2024-02-15T18:27:07.689 INFO:tasks.workunit.client.0.smithi084.stdout:6/648: mkdir d14/d22/d25/d2f/d31/d30/d45/d52/dd5 0 2024-02-15T18:27:07.693 INFO:tasks.workunit.client.1.smithi133.stdout:5/291: dwrite d17/d20/d32/f37 [0,4194304] 0 2024-02-15T18:27:07.693 INFO:tasks.workunit.client.0.smithi084.stdout:3/621: creat d8/d73/fd2 x:0 0 0 2024-02-15T18:27:07.694 INFO:tasks.workunit.client.0.smithi084.stdout:8/667: getdents db/d1a/d2b/d7b 0 2024-02-15T18:27:07.694 INFO:tasks.workunit.client.0.smithi084.stdout:8/668: chown db/d3f/d59/d69/c8d 129009 1 2024-02-15T18:27:07.694 INFO:tasks.workunit.client.0.smithi084.stdout:8/669: chown db/d3f/d59/d69/f6b 660 1 2024-02-15T18:27:07.694 INFO:tasks.workunit.client.0.smithi084.stdout:8/670: chown db/d6a/d76/f8e 8172 1 2024-02-15T18:27:07.697 INFO:tasks.workunit.client.1.smithi133.stdout:1/513: dwrite d6/d1e/f86 [0,4194304] 0 2024-02-15T18:27:07.697 INFO:tasks.workunit.client.1.smithi133.stdout:7/223: dwrite d9/f46 [0,4194304] 0 2024-02-15T18:27:07.697 INFO:tasks.workunit.client.1.smithi133.stdout:7/224: chown d9/da/l33 132 1 2024-02-15T18:27:07.697 INFO:tasks.workunit.client.1.smithi133.stdout:7/225: chown d9/db/c14 13898 1 2024-02-15T18:27:07.698 INFO:tasks.workunit.client.0.smithi084.stdout:1/556: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/cbb 0 2024-02-15T18:27:07.699 INFO:tasks.workunit.client.0.smithi084.stdout:4/700: truncate d2/d2b/f5f 110558 0 2024-02-15T18:27:07.699 INFO:tasks.workunit.client.0.smithi084.stdout:5/727: mknod d9/d23/dac/dc9/dec/ced 0 2024-02-15T18:27:07.699 INFO:tasks.workunit.client.0.smithi084.stdout:4/701: chown d2/d4/d28/c7c 1864 1 2024-02-15T18:27:07.700 INFO:tasks.workunit.client.1.smithi133.stdout:8/317: dwrite d3/d1f/d3f/f41 [0,4194304] 0 2024-02-15T18:27:07.702 INFO:tasks.workunit.client.0.smithi084.stdout:9/713: creat d4/d3d/da5/dc1/fe6 x:0 0 0 2024-02-15T18:27:07.703 INFO:tasks.workunit.client.1.smithi133.stdout:1/514: write d6/fd [6265867,117650] 0 2024-02-15T18:27:07.704 INFO:tasks.workunit.client.1.smithi133.stdout:1/515: dread d6/d1e/d41/f58 [0,4194304] 0 2024-02-15T18:27:07.705 INFO:tasks.workunit.client.1.smithi133.stdout:3/390: getdents d0/d15/d2b 0 2024-02-15T18:27:07.705 INFO:tasks.workunit.client.1.smithi133.stdout:3/391: write d0/d15/f6d [803384,116970] 0 2024-02-15T18:27:07.705 INFO:tasks.workunit.client.1.smithi133.stdout:5/292: mknod d17/d26/c65 0 2024-02-15T18:27:07.708 INFO:tasks.workunit.client.0.smithi084.stdout:0/630: creat d0/d2f/d3f/d8a/fc1 x:0 0 0 2024-02-15T18:27:07.711 INFO:tasks.workunit.client.1.smithi133.stdout:1/516: write d6/d17/f1d [1730740,61142] 0 2024-02-15T18:27:07.711 INFO:tasks.workunit.client.1.smithi133.stdout:1/517: readlink d6/d1e/d3a/d82/d85/l5d 0 2024-02-15T18:27:07.716 INFO:tasks.workunit.client.1.smithi133.stdout:0/333: dwrite d9/d10/d19/d29/d67/f6f [0,4194304] 0 2024-02-15T18:27:07.717 INFO:tasks.workunit.client.0.smithi084.stdout:3/622: unlink d8/d40/d43/l87 0 2024-02-15T18:27:07.717 INFO:tasks.workunit.client.0.smithi084.stdout:6/649: rename d14/d22/d25/d2f/d31/d30/d4f/l50 to d14/d22/d25/d2f/d31/d30/ld6 0 2024-02-15T18:27:07.717 INFO:tasks.workunit.client.0.smithi084.stdout:6/650: stat d14/l18 0 2024-02-15T18:27:07.717 INFO:tasks.workunit.client.0.smithi084.stdout:8/671: mknod db/d1a/da5/cdb 0 2024-02-15T18:27:07.717 INFO:tasks.workunit.client.0.smithi084.stdout:1/557: chown d9/d54/d1b/d2c/d4b/d4c/d79/d39/l2e 10565687 1 2024-02-15T18:27:07.718 INFO:tasks.workunit.client.0.smithi084.stdout:5/728: rmdir d9/da/d3d/d44/d55 39 2024-02-15T18:27:07.718 INFO:tasks.workunit.client.1.smithi133.stdout:5/293: unlink d17/f3a 0 2024-02-15T18:27:07.718 INFO:tasks.workunit.client.1.smithi133.stdout:5/294: truncate d17/d20/d4f/d5f/f60 658822 0 2024-02-15T18:27:07.719 INFO:tasks.workunit.client.0.smithi084.stdout:1/558: dread d9/d54/d1b/d2c/d4b/d4c/d79/d92/fac [0,4194304] 0 2024-02-15T18:27:07.719 INFO:tasks.workunit.client.0.smithi084.stdout:1/559: chown d9/d54/f82 285277986 1 2024-02-15T18:27:07.719 INFO:tasks.workunit.client.0.smithi084.stdout:1/560: chown d9/d54/d1b/d2c/d4b/d4c/d79/d92 2 1 2024-02-15T18:27:07.719 INFO:tasks.workunit.client.0.smithi084.stdout:1/561: read d9/d54/d1b/d2c/d4b/d7a/d89/f98 [269592,13856] 0 2024-02-15T18:27:07.719 INFO:tasks.workunit.client.0.smithi084.stdout:1/562: write d9/d54/d1b/d2c/d4b/d4c/d79/d39/f30 [4790117,94487] 0 2024-02-15T18:27:07.720 INFO:tasks.workunit.client.1.smithi133.stdout:1/518: rename d6/d17/fac to d6/d17/fbb 0 2024-02-15T18:27:07.720 INFO:tasks.workunit.client.0.smithi084.stdout:4/702: creat d2/d64/da5/dae/fd0 x:0 0 0 2024-02-15T18:27:07.722 INFO:tasks.workunit.client.1.smithi133.stdout:0/334: mkdir d9/d10/d19/d77 0 2024-02-15T18:27:07.722 INFO:tasks.workunit.client.1.smithi133.stdout:0/335: chown d9/d10/d22/d2f/d30/d44/f4c 21720 1 2024-02-15T18:27:07.722 INFO:tasks.workunit.client.1.smithi133.stdout:0/336: chown f0 18658 1 2024-02-15T18:27:07.722 INFO:tasks.workunit.client.1.smithi133.stdout:0/337: write d9/d10/f54 [39759,52126] 0 2024-02-15T18:27:07.723 INFO:tasks.workunit.client.0.smithi084.stdout:9/714: truncate d4/d3d/f7e 3545479 0 2024-02-15T18:27:07.723 INFO:tasks.workunit.client.1.smithi133.stdout:3/392: dread d0/d15/f16 [0,4194304] 0 2024-02-15T18:27:07.723 INFO:tasks.workunit.client.1.smithi133.stdout:3/393: chown d0/d15/d37/c73 57 1 2024-02-15T18:27:07.725 INFO:tasks.workunit.client.1.smithi133.stdout:5/295: mknod d17/d26/c66 0 2024-02-15T18:27:07.725 INFO:tasks.workunit.client.1.smithi133.stdout:5/296: chown d17/d20/d32/l5a 11979282 1 2024-02-15T18:27:07.725 INFO:tasks.workunit.client.1.smithi133.stdout:1/519: mknod d6/d1e/d3a/d82/d85/cbc 0 2024-02-15T18:27:07.725 INFO:tasks.workunit.client.1.smithi133.stdout:6/510: dwrite d0/d3b/d67/f81 [0,4194304] 0 2024-02-15T18:27:07.725 INFO:tasks.workunit.client.0.smithi084.stdout:0/631: creat d0/d2f/d3f/d4f/d59/da7/fc2 x:0 0 0 2024-02-15T18:27:07.725 INFO:tasks.workunit.client.0.smithi084.stdout:0/632: dread - d0/d2f/d3f/d8a/f8b zero size 2024-02-15T18:27:07.725 INFO:tasks.workunit.client.0.smithi084.stdout:0/633: truncate d0/d4/d3a/fbf 98281 0 2024-02-15T18:27:07.725 INFO:tasks.workunit.client.0.smithi084.stdout:0/634: truncate d0/d2f/d3f/d4c/d9a/fa3 1527475 0 2024-02-15T18:27:07.726 INFO:tasks.workunit.client.0.smithi084.stdout:0/635: fsync d0/f99 0 2024-02-15T18:27:07.726 INFO:tasks.workunit.client.0.smithi084.stdout:6/651: creat d14/d22/d25/d2f/fd7 x:0 0 0 2024-02-15T18:27:07.726 INFO:tasks.workunit.client.0.smithi084.stdout:8/672: mknod db/cdc 0 2024-02-15T18:27:07.727 INFO:tasks.workunit.client.0.smithi084.stdout:8/673: chown db/d6a 10136053 1 2024-02-15T18:27:07.727 INFO:tasks.workunit.client.1.smithi133.stdout:0/338: stat l1 0 2024-02-15T18:27:07.727 INFO:tasks.workunit.client.1.smithi133.stdout:0/339: chown d9/f3e 355091 1 2024-02-15T18:27:07.727 INFO:tasks.workunit.client.1.smithi133.stdout:0/340: chown d9/d10/d22/d2f/d30 14797886 1 2024-02-15T18:27:07.727 INFO:tasks.workunit.client.1.smithi133.stdout:5/297: truncate d17/f4a 37758 0 2024-02-15T18:27:07.727 INFO:tasks.workunit.client.1.smithi133.stdout:5/298: read d17/f47 [116514,61771] 0 2024-02-15T18:27:07.728 INFO:tasks.workunit.client.1.smithi133.stdout:8/318: dwrite d3/d7/d40/d61/f65 [0,4194304] 0 2024-02-15T18:27:07.728 INFO:tasks.workunit.client.1.smithi133.stdout:4/254: dwrite d2/d5/d2b/d21/f31 [0,4194304] 0 2024-02-15T18:27:07.728 INFO:tasks.workunit.client.1.smithi133.stdout:4/255: write d2/d5/d2b/f5b [907898,54953] 0 2024-02-15T18:27:07.729 INFO:tasks.workunit.client.0.smithi084.stdout:5/729: symlink d9/da/d3d/d44/d55/d70/d84/da1/lee 0 2024-02-15T18:27:07.729 INFO:tasks.workunit.client.1.smithi133.stdout:3/394: write d0/f3a [25192,80696] 0 2024-02-15T18:27:07.729 INFO:tasks.workunit.client.1.smithi133.stdout:3/395: chown d0/d15/d2b/f58 1563 1 2024-02-15T18:27:07.730 INFO:tasks.workunit.client.0.smithi084.stdout:7/566: mknod df/d1d/d1a/cb2 0 2024-02-15T18:27:07.738 INFO:tasks.workunit.client.1.smithi133.stdout:8/319: dread d3/f2e [0,4194304] 0 2024-02-15T18:27:07.739 INFO:tasks.workunit.client.1.smithi133.stdout:1/520: truncate d6/f29 69639 0 2024-02-15T18:27:07.739 INFO:tasks.workunit.client.1.smithi133.stdout:8/320: write d3/f2e [716493,41354] 0 2024-02-15T18:27:07.744 INFO:tasks.workunit.client.0.smithi084.stdout:1/563: truncate d9/d54/d1b/d2c/d4b/d63/f6a 4262962 0 2024-02-15T18:27:07.744 INFO:tasks.workunit.client.0.smithi084.stdout:0/636: rmdir d0/d2f/d4b 39 2024-02-15T18:27:07.744 INFO:tasks.workunit.client.0.smithi084.stdout:4/703: symlink d2/d64/d74/d8f/dc1/ld1 0 2024-02-15T18:27:07.744 INFO:tasks.workunit.client.0.smithi084.stdout:0/637: write d0/d4/d1b/f91 [761118,11652] 0 2024-02-15T18:27:07.744 INFO:tasks.workunit.client.0.smithi084.stdout:4/704: chown d2/d4/f55 0 1 2024-02-15T18:27:07.745 INFO:tasks.workunit.client.0.smithi084.stdout:3/623: rename d8/d40/d58/d80/f7b to d8/d1f/dbf/fd3 0 2024-02-15T18:27:07.746 INFO:tasks.workunit.client.1.smithi133.stdout:6/511: link d0/d3b/d53/f65 d0/d3b/d78/d7f/fa7 0 2024-02-15T18:27:07.746 INFO:tasks.workunit.client.1.smithi133.stdout:0/341: rename d9/d10/d22/d32/f39 to d9/d10/d19/f78 0 2024-02-15T18:27:07.746 INFO:tasks.workunit.client.1.smithi133.stdout:0/342: readlink d9/l18 0 2024-02-15T18:27:07.747 INFO:tasks.workunit.client.0.smithi084.stdout:7/567: dread fb [0,4194304] 0 2024-02-15T18:27:07.747 INFO:tasks.workunit.client.0.smithi084.stdout:5/730: mknod d9/d35/d65/d7f/dd6/deb/cef 0 2024-02-15T18:27:07.748 INFO:tasks.workunit.client.0.smithi084.stdout:3/624: creat d8/d73/db9/fd4 x:0 0 0 2024-02-15T18:27:07.748 INFO:tasks.workunit.client.1.smithi133.stdout:5/299: link d17/d20/d32/c4b d17/d20/d5e/c67 0 2024-02-15T18:27:07.750 INFO:tasks.workunit.client.0.smithi084.stdout:5/731: write d9/d23/f4a [88645,51872] 0 2024-02-15T18:27:07.750 INFO:tasks.workunit.client.0.smithi084.stdout:5/732: dread - d9/da/fe4 zero size 2024-02-15T18:27:07.750 INFO:tasks.workunit.client.0.smithi084.stdout:5/733: fdatasync d9/d5f/fad 0 2024-02-15T18:27:07.751 INFO:tasks.workunit.client.1.smithi133.stdout:4/256: mkdir d2/d5/d2b/d21/d2d/d44/d51/d60 0 2024-02-15T18:27:07.753 INFO:tasks.workunit.client.0.smithi084.stdout:9/715: rename d4/d2b/d3c/f49 to d4/d2b/fe7 0 2024-02-15T18:27:07.753 INFO:tasks.workunit.client.0.smithi084.stdout:3/625: symlink d8/d40/d43/d71/d8c/ld5 0 2024-02-15T18:27:07.754 INFO:tasks.workunit.client.1.smithi133.stdout:1/521: rmdir d6/d1e/d3a/d82 39 2024-02-15T18:27:07.754 INFO:tasks.workunit.client.1.smithi133.stdout:3/396: mkdir d0/d15/d37/d7b 0 2024-02-15T18:27:07.754 INFO:tasks.workunit.client.1.smithi133.stdout:1/522: chown d6/d1e/d3a/d75 9 1 2024-02-15T18:27:07.755 INFO:tasks.workunit.client.1.smithi133.stdout:8/321: mknod d3/d1c/d37/d5a/c6c 0 2024-02-15T18:27:07.755 INFO:tasks.workunit.client.1.smithi133.stdout:8/322: fdatasync d3/d1f/f2c 0 2024-02-15T18:27:07.755 INFO:tasks.workunit.client.0.smithi084.stdout:5/734: mkdir d9/d35/d65/d7f/dd6/deb/df0 0 2024-02-15T18:27:07.757 INFO:tasks.workunit.client.1.smithi133.stdout:6/512: link d0/d3b/d52/l83 d0/db/d29/d34/d8c/d98/la8 0 2024-02-15T18:27:07.758 INFO:tasks.workunit.client.1.smithi133.stdout:0/343: creat d9/d2b/f79 x:0 0 0 2024-02-15T18:27:07.759 INFO:tasks.workunit.client.0.smithi084.stdout:8/674: rename db/d3f/d59/f2c to db/daf/db6/fdd 0 2024-02-15T18:27:07.760 INFO:tasks.workunit.client.1.smithi133.stdout:4/257: mknod d2/d5/c61 0 2024-02-15T18:27:07.760 INFO:tasks.workunit.client.0.smithi084.stdout:1/564: write d9/d54/d1b/d2c/f43 [3211977,107647] 0 2024-02-15T18:27:07.761 INFO:tasks.workunit.client.0.smithi084.stdout:9/716: unlink d4/d2b/d3c/d24/dca/lbc 0 2024-02-15T18:27:07.762 INFO:tasks.workunit.client.0.smithi084.stdout:5/735: mkdir d9/dc6/de2/df1 0 2024-02-15T18:27:07.762 INFO:tasks.workunit.client.1.smithi133.stdout:5/300: truncate d17/f27 822427 0 2024-02-15T18:27:07.762 INFO:tasks.workunit.client.1.smithi133.stdout:3/397: rename d0/d15/d2b/f57 to d0/d15/d2b/d62/d74/d78/f7c 0 2024-02-15T18:27:07.763 INFO:tasks.workunit.client.0.smithi084.stdout:3/626: mknod d8/d40/d43/d71/dcc/cd6 0 2024-02-15T18:27:07.764 INFO:tasks.workunit.client.0.smithi084.stdout:7/568: dread df/d1d/d1a/d4d/f67 [0,4194304] 0 2024-02-15T18:27:07.764 INFO:tasks.workunit.client.0.smithi084.stdout:7/569: stat df/d1d/d1a/d4b/f57 0 2024-02-15T18:27:07.764 INFO:tasks.workunit.client.1.smithi133.stdout:4/258: write d2/f1f [2543465,24105] 0 2024-02-15T18:27:07.764 INFO:tasks.workunit.client.1.smithi133.stdout:4/259: chown d2/f23 200 1 2024-02-15T18:27:07.765 INFO:tasks.workunit.client.1.smithi133.stdout:1/523: mkdir d6/d1e/d3a/d79/dbd 0 2024-02-15T18:27:07.767 INFO:tasks.workunit.client.1.smithi133.stdout:8/323: symlink d3/d1c/d37/l6d 0 2024-02-15T18:27:07.767 INFO:tasks.workunit.client.1.smithi133.stdout:6/513: rmdir d0/db/d29/d34/d48 39 2024-02-15T18:27:07.771 INFO:tasks.workunit.client.1.smithi133.stdout:5/301: read d17/d2a/f31 [118022,107376] 0 2024-02-15T18:27:07.771 INFO:tasks.workunit.client.1.smithi133.stdout:5/302: fsync f10 0 2024-02-15T18:27:07.771 INFO:tasks.workunit.client.1.smithi133.stdout:5/303: chown d17/d26 3534 1 2024-02-15T18:27:07.771 INFO:tasks.workunit.client.1.smithi133.stdout:5/304: truncate d17/d20/f53 552123 0 2024-02-15T18:27:07.772 INFO:tasks.workunit.client.0.smithi084.stdout:8/675: dread db/dd/d1f/d7a/da8/dd0/fad [0,4194304] 0 2024-02-15T18:27:07.772 INFO:tasks.workunit.client.0.smithi084.stdout:6/652: dwrite d14/d22/d25/d2f/d31/d3f/d4a/f4c [4194304,4194304] 0 2024-02-15T18:27:07.773 INFO:tasks.workunit.client.1.smithi133.stdout:1/524: dread d6/d1e/d41/d7c/f9c [0,4194304] 0 2024-02-15T18:27:07.774 INFO:tasks.workunit.client.0.smithi084.stdout:5/736: creat d9/dc6/ff2 x:0 0 0 2024-02-15T18:27:07.774 INFO:tasks.workunit.client.0.smithi084.stdout:1/565: truncate d9/d54/d1b/d2c/d4b/d4c/d79/d39/f23 3065300 0 2024-02-15T18:27:07.775 INFO:tasks.workunit.client.0.smithi084.stdout:2/607: sync 2024-02-15T18:27:07.779 INFO:tasks.workunit.client.0.smithi084.stdout:9/717: dread d4/d3d/f61 [0,4194304] 0 2024-02-15T18:27:07.781 INFO:tasks.workunit.client.1.smithi133.stdout:8/324: mknod d3/d7/d52/c6e 0 2024-02-15T18:27:07.781 INFO:tasks.workunit.client.0.smithi084.stdout:8/676: dread db/dd/d1f/f38 [0,4194304] 0 2024-02-15T18:27:07.783 INFO:tasks.workunit.client.1.smithi133.stdout:6/514: dread d0/f50 [0,4194304] 0 2024-02-15T18:27:07.785 INFO:tasks.workunit.client.1.smithi133.stdout:1/525: mkdir d6/d1e/d3a/d79/dbd/dbe 0 2024-02-15T18:27:07.785 INFO:tasks.workunit.client.0.smithi084.stdout:7/570: rename df/d1d/d1a/d6a/d8b/d48/fa7 to df/d1d/d44/d8d/fb3 0 2024-02-15T18:27:07.787 INFO:tasks.workunit.client.1.smithi133.stdout:8/325: symlink d3/d7/l6f 0 2024-02-15T18:27:07.787 INFO:tasks.workunit.client.1.smithi133.stdout:6/515: mknod d0/d3b/ca9 0 2024-02-15T18:27:07.787 INFO:tasks.workunit.client.0.smithi084.stdout:1/566: getdents d9/d54/d1b/d38 0 2024-02-15T18:27:07.789 INFO:tasks.workunit.client.0.smithi084.stdout:9/718: getdents d4/da3/db0/dc5 0 2024-02-15T18:27:07.789 INFO:tasks.workunit.client.1.smithi133.stdout:1/526: link d6/f90 d6/d1e/d3a/d79/dbd/dbe/fbf 0 2024-02-15T18:27:07.790 INFO:tasks.workunit.client.0.smithi084.stdout:3/627: dread d8/d40/d58/d80/f2a [0,4194304] 0 2024-02-15T18:27:07.791 INFO:tasks.workunit.client.0.smithi084.stdout:3/628: fsync d8/d1f/d25/f8e 0 2024-02-15T18:27:07.791 INFO:tasks.workunit.client.0.smithi084.stdout:9/719: creat d4/da3/fe8 x:0 0 0 2024-02-15T18:27:07.791 INFO:tasks.workunit.client.0.smithi084.stdout:9/720: chown d4/d2b/d3c/f8b 40199 1 2024-02-15T18:27:07.791 INFO:tasks.workunit.client.1.smithi133.stdout:8/326: getdents d3/d7/d40 0 2024-02-15T18:27:07.791 INFO:tasks.workunit.client.1.smithi133.stdout:6/516: creat d0/d3b/d85/faa x:0 0 0 2024-02-15T18:27:07.792 INFO:tasks.workunit.client.1.smithi133.stdout:1/527: symlink d6/d1e/d41/d7c/d7e/d7f/db6/lc0 0 2024-02-15T18:27:07.792 INFO:tasks.workunit.client.0.smithi084.stdout:2/608: rename d3/d5/d1a/d1e/d47/d76 to d3/dc6 0 2024-02-15T18:27:07.793 INFO:tasks.workunit.client.1.smithi133.stdout:8/327: link d3/c9 d3/d7/d40/d61/c70 0 2024-02-15T18:27:07.795 INFO:tasks.workunit.client.1.smithi133.stdout:1/528: symlink d6/d1e/d3a/d79/lc1 0 2024-02-15T18:27:07.799 INFO:tasks.workunit.client.0.smithi084.stdout:3/629: link d8/d40/d58/d80/f2a d8/d40/d43/d71/fd7 0 2024-02-15T18:27:07.799 INFO:tasks.workunit.client.0.smithi084.stdout:9/721: mkdir d4/d2b/d3c/d24/dca/d15/d33/de9 0 2024-02-15T18:27:07.799 INFO:tasks.workunit.client.0.smithi084.stdout:2/609: truncate d3/f94 1256941 0 2024-02-15T18:27:07.800 INFO:tasks.workunit.client.1.smithi133.stdout:1/529: creat d6/d2a/d59/fc2 x:0 0 0 2024-02-15T18:27:07.801 INFO:tasks.workunit.client.0.smithi084.stdout:9/722: mkdir d4/d2b/d3c/d20/d75/d87/de2/dea 0 2024-02-15T18:27:07.802 INFO:tasks.workunit.client.0.smithi084.stdout:4/705: dwrite d2/d4/d25/d66/fa3 [0,4194304] 0 2024-02-15T18:27:07.802 INFO:tasks.workunit.client.0.smithi084.stdout:2/610: mknod d3/d5/d1a/d74/db9/cc7 0 2024-02-15T18:27:07.806 INFO:tasks.workunit.client.0.smithi084.stdout:6/653: dread d14/f38 [0,4194304] 0 2024-02-15T18:27:07.806 INFO:tasks.workunit.client.0.smithi084.stdout:0/638: dwrite d0/f95 [0,4194304] 0 2024-02-15T18:27:07.807 INFO:tasks.workunit.client.0.smithi084.stdout:2/611: read d3/d28/f45 [4408866,61554] 0 2024-02-15T18:27:07.808 INFO:tasks.workunit.client.0.smithi084.stdout:2/612: truncate d3/d19/d24/f32 2839410 0 2024-02-15T18:27:07.812 INFO:tasks.workunit.client.0.smithi084.stdout:9/723: link d4/d2b/d3c/d20/d75/d87/lac d4/d36/leb 0 2024-02-15T18:27:07.812 INFO:tasks.workunit.client.0.smithi084.stdout:9/724: dread - d4/d2b/d3c/d24/dca/d15/fd5 zero size 2024-02-15T18:27:07.813 INFO:tasks.workunit.client.1.smithi133.stdout:0/344: dwrite d9/d10/d22/d2f/d30/d44/f4f [0,4194304] 0 2024-02-15T18:27:07.816 INFO:tasks.workunit.client.1.smithi133.stdout:1/530: creat d6/d1e/d3a/d79/dbd/dbe/fc3 x:0 0 0 2024-02-15T18:27:07.819 INFO:tasks.workunit.client.0.smithi084.stdout:6/654: mkdir d14/d22/d25/d2f/d31/dcf/dd8 0 2024-02-15T18:27:07.819 INFO:tasks.workunit.client.0.smithi084.stdout:0/639: rename d0/d39/f8e to d0/d2f/d4b/dae/db0/fc3 0 2024-02-15T18:27:07.819 INFO:tasks.workunit.client.0.smithi084.stdout:6/655: dread - d14/d22/d25/d41/d94/fc3 zero size 2024-02-15T18:27:07.822 INFO:tasks.workunit.client.1.smithi133.stdout:5/305: dwrite d17/d20/f35 [0,4194304] 0 2024-02-15T18:27:07.822 INFO:tasks.workunit.client.1.smithi133.stdout:8/328: dread d3/de/f25 [0,4194304] 0 2024-02-15T18:27:07.823 INFO:tasks.workunit.client.1.smithi133.stdout:0/345: creat d9/d2b/f7a x:0 0 0 2024-02-15T18:27:07.823 INFO:tasks.workunit.client.1.smithi133.stdout:0/346: readlink d9/d10/d47/l57 0 2024-02-15T18:27:07.823 INFO:tasks.workunit.client.1.smithi133.stdout:8/329: symlink d3/d1c/d2f/l71 0 2024-02-15T18:27:07.824 INFO:tasks.workunit.client.1.smithi133.stdout:8/330: fdatasync d3/d1f/d4f/f64 0 2024-02-15T18:27:07.825 INFO:tasks.workunit.client.1.smithi133.stdout:3/398: dwrite d0/f2d [0,4194304] 0 2024-02-15T18:27:07.825 INFO:tasks.workunit.client.0.smithi084.stdout:6/656: rmdir d14/dbb 0 2024-02-15T18:27:07.826 INFO:tasks.workunit.client.1.smithi133.stdout:0/347: symlink d9/d10/l7b 0 2024-02-15T18:27:07.827 INFO:tasks.workunit.client.1.smithi133.stdout:8/331: creat d3/d7/f72 x:0 0 0 2024-02-15T18:27:07.827 INFO:tasks.workunit.client.1.smithi133.stdout:8/332: chown d3/f4a 3781682 1 2024-02-15T18:27:07.827 INFO:tasks.workunit.client.0.smithi084.stdout:0/640: mknod d0/d4/d1b/d26/d43/da0/cc4 0 2024-02-15T18:27:07.829 INFO:tasks.workunit.client.0.smithi084.stdout:0/641: getdents d0/d4/d1b/d26/d43/d6d 0 2024-02-15T18:27:07.830 INFO:tasks.workunit.client.1.smithi133.stdout:0/348: creat d9/d10/d2c/f7c x:0 0 0 2024-02-15T18:27:07.830 INFO:tasks.workunit.client.1.smithi133.stdout:0/349: fsync d9/d10/d19/d29/d67/f6f 0 2024-02-15T18:27:07.838 INFO:tasks.workunit.client.0.smithi084.stdout:5/737: dwrite d9/da/d3d/d44/d55/fc0 [0,4194304] 0 2024-02-15T18:27:07.839 INFO:tasks.workunit.client.1.smithi133.stdout:1/531: dread d6/fe [0,4194304] 0 2024-02-15T18:27:07.844 INFO:tasks.workunit.client.1.smithi133.stdout:1/532: read d6/d1e/f27 [384931,34789] 0 2024-02-15T18:27:07.846 INFO:tasks.workunit.client.0.smithi084.stdout:2/613: dread d3/d5/d1a/d1e/d30/f67 [0,4194304] 0 2024-02-15T18:27:07.846 INFO:tasks.workunit.client.0.smithi084.stdout:9/725: write d4/f6 [4198086,92776] 0 2024-02-15T18:27:07.846 INFO:tasks.workunit.client.0.smithi084.stdout:9/726: fsync d4/d2b/d3c/d24/dca/f14 0 2024-02-15T18:27:07.846 INFO:tasks.workunit.client.0.smithi084.stdout:9/727: dread - d4/d81/fb3 zero size 2024-02-15T18:27:07.846 INFO:tasks.workunit.client.0.smithi084.stdout:6/657: write d14/d22/d25/d2f/d31/d30/d45/d52/fa4 [2941306,12205] 0 2024-02-15T18:27:07.850 INFO:tasks.workunit.client.1.smithi133.stdout:1/533: creat d6/d1e/d3a/d82/d85/d67/fc4 x:0 0 0 2024-02-15T18:27:07.855 INFO:tasks.workunit.client.0.smithi084.stdout:6/658: mknod d14/d22/d25/d2f/d31/d30/d4f/cd9 0 2024-02-15T18:27:07.858 INFO:tasks.workunit.client.0.smithi084.stdout:7/571: dwrite df/d1d/d1a/f81 [0,4194304] 0 2024-02-15T18:27:07.859 INFO:tasks.workunit.client.1.smithi133.stdout:4/260: dwrite d2/f1f [0,4194304] 0 2024-02-15T18:27:07.861 INFO:tasks.workunit.client.1.smithi133.stdout:4/261: creat d2/d48/d5c/f62 x:0 0 0 2024-02-15T18:27:07.862 INFO:tasks.workunit.client.0.smithi084.stdout:2/614: dread d3/d19/d24/f32 [0,4194304] 0 2024-02-15T18:27:07.862 INFO:tasks.workunit.client.0.smithi084.stdout:2/615: fsync d3/d19/d24/f32 0 2024-02-15T18:27:07.862 INFO:tasks.workunit.client.0.smithi084.stdout:7/572: unlink fb 0 2024-02-15T18:27:07.862 INFO:tasks.workunit.client.0.smithi084.stdout:7/573: chown df/d1d/d1a/d4d/d55/f99 1020201 1 2024-02-15T18:27:07.863 INFO:tasks.workunit.client.0.smithi084.stdout:7/574: chown df/d1d/d1a/d4d/l52 0 1 2024-02-15T18:27:07.863 INFO:tasks.workunit.client.0.smithi084.stdout:7/575: read - df/d1d/d1a/d6a/d8e/faa zero size 2024-02-15T18:27:07.865 INFO:tasks.workunit.client.0.smithi084.stdout:2/616: mknod d3/d5/d1a/d1e/d47/cc8 0 2024-02-15T18:27:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.869+0000 7f1bf8514700 1 -- 172.21.15.84:0/3543960554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 msgr2=0x7f1bf00f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.869+0000 7f1bf8514700 1 --2- 172.21.15.84:0/3543960554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 0x7f1bf00f92a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f1bec004660 tx=0x7f1bec009b30).stop 2024-02-15T18:27:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.869+0000 7f1bf8514700 1 -- 172.21.15.84:0/3543960554 shutdown_connections 2024-02-15T18:27:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.869+0000 7f1bf8514700 1 --2- 172.21.15.84:0/3543960554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bf00f9820 0x7f1bf00fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.869+0000 7f1bf8514700 1 --2- 172.21.15.84:0/3543960554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 0x7f1bf00f92a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.869+0000 7f1bf8514700 1 -- 172.21.15.84:0/3543960554 >> 172.21.15.84:0/3543960554 conn(0x7f1bf00f0d40 msgr2=0x7f1bf00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.869+0000 7f1bf8514700 1 -- 172.21.15.84:0/3543960554 shutdown_connections 2024-02-15T18:27:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.869+0000 7f1bf8514700 1 -- 172.21.15.84:0/3543960554 wait complete. 2024-02-15T18:27:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.869+0000 7f1bf8514700 1 Processor -- start 2024-02-15T18:27:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.870+0000 7f1bf8514700 1 -- start start 2024-02-15T18:27:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.870+0000 7f1bf8514700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 0x7f1bf00f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:07.867 INFO:tasks.workunit.client.0.smithi084.stdout:2/617: symlink d3/d5/d1a/d1e/d30/d82/lc9 0 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.870+0000 7f1bf8514700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bf00f9820 0x7f1bf00f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.870+0000 7f1bf8514700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf00f5790 con 0x7f1bf0060310 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.870+0000 7f1bf8514700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf00f58d0 con 0x7f1bf00f9820 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.870+0000 7f1bf62b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 0x7f1bf00f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.870+0000 7f1bf62b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 0x7f1bf00f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42156/0 (socket says 172.21.15.84:42156) 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.870+0000 7f1bf62b0700 1 -- 172.21.15.84:0/3084942704 learned_addr learned my addr 172.21.15.84:0/3084942704 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.871+0000 7f1bf62b0700 1 -- 172.21.15.84:0/3084942704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bf00f9820 msgr2=0x7f1bf00f51a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.871+0000 7f1bf62b0700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bf00f9820 0x7f1bf00f51a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.871+0000 7f1bf62b0700 1 -- 172.21.15.84:0/3084942704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec005040 con 0x7f1bf0060310 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.871+0000 7f1bf62b0700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 0x7f1bf00f6d20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f1bec009f50 tx=0x7f1bec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.871+0000 7f1be6ffd700 1 -- 172.21.15.84:0/3084942704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bec018070 con 0x7f1bf0060310 2024-02-15T18:27:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.871+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf00f5b50 con 0x7f1bf0060310 2024-02-15T18:27:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.871+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf010f060 con 0x7f1bf0060310 2024-02-15T18:27:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.871+0000 7f1be6ffd700 1 -- 172.21.15.84:0/3084942704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f1bec007d70 con 0x7f1bf0060310 2024-02-15T18:27:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.871+0000 7f1be6ffd700 1 -- 172.21.15.84:0/3084942704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bec01c620 con 0x7f1bf0060310 2024-02-15T18:27:07.869 INFO:tasks.workunit.client.1.smithi133.stdout:1/534: fsync d6/d2a/d59/fc2 0 2024-02-15T18:27:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.872+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf00f49b0 con 0x7f1bf0060310 2024-02-15T18:27:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.873+0000 7f1be6ffd700 1 -- 172.21.15.84:0/3084942704 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 28) v1 ==== 77194+0+0 (secure 0 0 0) 0x7f1bec01c890 con 0x7f1bf0060310 2024-02-15T18:27:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.874+0000 7f1be6ffd700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1bdc060fb0 0x7f1bdc063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.874+0000 7f1be6ffd700 1 -- 172.21.15.84:0/3084942704 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f1bec07e5e0 con 0x7f1bf0060310 2024-02-15T18:27:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.874+0000 7f1bf5aaf700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1bdc060fb0 0x7f1bdc063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.875+0000 7f1bf5aaf700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1bdc060fb0 0x7f1bdc063470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f1bf00600e0 tx=0x7f1be0006ad0).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:07.871 INFO:tasks.workunit.client.0.smithi084.stdout:2/618: rename d3/d19/d24 to d3/d5/d53/dca 0 2024-02-15T18:27:07.874 INFO:tasks.workunit.client.1.smithi133.stdout:3/399: dread d0/d15/f6b [0,4194304] 0 2024-02-15T18:27:07.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:07.878+0000 7f1be6ffd700 1 -- 172.21.15.84:0/3084942704 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f1bec04e990 con 0x7f1bf0060310 2024-02-15T18:27:07.875 INFO:tasks.workunit.client.1.smithi133.stdout:3/400: write d0/d15/d2b/d39/d3f/f22 [1148990,19106] 0 2024-02-15T18:27:07.875 INFO:tasks.workunit.client.1.smithi133.stdout:3/401: dread - d0/d15/d2b/f43 zero size 2024-02-15T18:27:07.876 INFO:tasks.workunit.client.0.smithi084.stdout:8/677: dwrite db/d3f/d59/f28 [0,4194304] 0 2024-02-15T18:27:07.878 INFO:tasks.workunit.client.0.smithi084.stdout:8/678: mkdir db/d1a/d2b/d7b/dde 0 2024-02-15T18:27:07.880 INFO:tasks.workunit.client.0.smithi084.stdout:8/679: mknod db/dd/d13/d42/d90/cdf 0 2024-02-15T18:27:07.884 INFO:tasks.workunit.client.1.smithi133.stdout:4/262: dread d2/f2a [0,4194304] 0 2024-02-15T18:27:07.884 INFO:tasks.workunit.client.1.smithi133.stdout:4/263: chown d2/d5/d2b/l5f 119 1 2024-02-15T18:27:07.885 INFO:tasks.workunit.client.0.smithi084.stdout:2/619: write d3/f14 [342669,61538] 0 2024-02-15T18:27:07.885 INFO:tasks.workunit.client.0.smithi084.stdout:2/620: truncate d3/fad 1430646 0 2024-02-15T18:27:07.886 INFO:tasks.workunit.client.1.smithi133.stdout:1/535: dread f2 [0,4194304] 0 2024-02-15T18:27:07.886 INFO:tasks.workunit.client.1.smithi133.stdout:4/264: write d2/f29 [241100,110991] 0 2024-02-15T18:27:07.886 INFO:tasks.workunit.client.0.smithi084.stdout:3/630: dwrite d8/d1f/d25/f9a [0,4194304] 0 2024-02-15T18:27:07.887 INFO:tasks.workunit.client.0.smithi084.stdout:3/631: chown d8/d40/d43/d71/f9b 37083899 1 2024-02-15T18:27:07.887 INFO:tasks.workunit.client.0.smithi084.stdout:8/680: mkdir db/dd/d13/de0 0 2024-02-15T18:27:07.888 INFO:tasks.workunit.client.0.smithi084.stdout:2/621: write d3/d5/f21 [4033923,117022] 0 2024-02-15T18:27:07.888 INFO:tasks.workunit.client.1.smithi133.stdout:4/265: mkdir d2/d5/d2b/d21/d2d/d44/d51/d60/d63 0 2024-02-15T18:27:07.889 INFO:tasks.workunit.client.0.smithi084.stdout:8/681: symlink db/d3f/d59/le1 0 2024-02-15T18:27:07.891 INFO:tasks.workunit.client.0.smithi084.stdout:2/622: symlink d3/dc6/lcb 0 2024-02-15T18:27:07.891 INFO:tasks.workunit.client.0.smithi084.stdout:2/623: stat d3/d19/f5b 0 2024-02-15T18:27:07.891 INFO:tasks.workunit.client.0.smithi084.stdout:2/624: dread - d3/d5/d53/dca/d91/fb4 zero size 2024-02-15T18:27:07.892 INFO:tasks.workunit.client.0.smithi084.stdout:3/632: dread d8/d40/d43/d71/fa4 [0,4194304] 0 2024-02-15T18:27:07.892 INFO:tasks.workunit.client.0.smithi084.stdout:8/682: symlink db/d1a/d2b/le2 0 2024-02-15T18:27:07.892 INFO:tasks.workunit.client.0.smithi084.stdout:8/683: write db/d6a/fb4 [210761,29662] 0 2024-02-15T18:27:07.893 INFO:tasks.workunit.client.1.smithi133.stdout:4/266: dread d2/d5/d2b/fe [0,4194304] 0 2024-02-15T18:27:07.893 INFO:tasks.workunit.client.0.smithi084.stdout:2/625: mknod d3/d5/d1a/ccc 0 2024-02-15T18:27:07.893 INFO:tasks.workunit.client.0.smithi084.stdout:2/626: readlink d3/l4d 0 2024-02-15T18:27:07.893 INFO:tasks.workunit.client.0.smithi084.stdout:2/627: write d3/d5/d1a/d1e/faa [9062515,130136] 0 2024-02-15T18:27:07.894 INFO:tasks.workunit.client.0.smithi084.stdout:3/633: link d8/d1f/d2d/f4f d8/d40/d43/fd8 0 2024-02-15T18:27:07.896 INFO:tasks.workunit.client.0.smithi084.stdout:8/684: creat db/dd/d13/de0/fe3 x:0 0 0 2024-02-15T18:27:07.896 INFO:tasks.workunit.client.0.smithi084.stdout:8/685: write db/dd/d4d/f63 [835974,90877] 0 2024-02-15T18:27:07.898 INFO:tasks.workunit.client.0.smithi084.stdout:2/628: creat d3/dc6/db5/fcd x:0 0 0 2024-02-15T18:27:07.900 INFO:tasks.workunit.client.0.smithi084.stdout:3/634: mkdir d8/d40/d43/d71/dd9 0 2024-02-15T18:27:07.901 INFO:tasks.workunit.client.0.smithi084.stdout:2/629: rename d3/d5/d1a/d1e/d4b/da6/f3c to d3/d5/d1a/d1e/fce 0 2024-02-15T18:27:07.905 INFO:tasks.workunit.client.0.smithi084.stdout:2/630: creat d3/d5/d1a/d1e/fcf x:0 0 0 2024-02-15T18:27:07.905 INFO:tasks.workunit.client.0.smithi084.stdout:3/635: write d8/d1f/dbf/f54 [3688168,44637] 0 2024-02-15T18:27:07.918 INFO:tasks.workunit.client.0.smithi084.stdout:4/706: dwrite d2/d4/d28/d3d/f53 [4194304,4194304] 0 2024-02-15T18:27:07.918 INFO:tasks.workunit.client.0.smithi084.stdout:4/707: chown d2/f3 136857 1 2024-02-15T18:27:07.919 INFO:tasks.workunit.client.1.smithi133.stdout:6/517: dwrite d0/db/d29/d34/d5d/fa6 [0,4194304] 0 2024-02-15T18:27:07.919 INFO:tasks.workunit.client.1.smithi133.stdout:5/306: dwrite d17/d20/f57 [0,4194304] 0 2024-02-15T18:27:07.922 INFO:tasks.workunit.client.0.smithi084.stdout:4/708: rename d2/d2b/d47/d31/d61/ca1 to d2/d2b/d47/d31/cd2 0 2024-02-15T18:27:07.922 INFO:tasks.workunit.client.0.smithi084.stdout:0/642: dwrite d0/d2f/d3f/d4c/d9a/fa3 [0,4194304] 0 2024-02-15T18:27:07.930 INFO:tasks.workunit.client.0.smithi084.stdout:4/709: truncate d2/d4/d28/d3d/d5c/d65/f76 2745911 0 2024-02-15T18:27:07.930 INFO:tasks.workunit.client.0.smithi084.stdout:4/710: write d2/f3 [3153914,120517] 0 2024-02-15T18:27:07.930 INFO:tasks.workunit.client.0.smithi084.stdout:4/711: chown d2/d4/d28/d3d 1 1 2024-02-15T18:27:07.930 INFO:tasks.workunit.client.0.smithi084.stdout:0/643: mkdir d0/d4/da8/dc5 0 2024-02-15T18:27:07.933 INFO:tasks.workunit.client.0.smithi084.stdout:4/712: creat d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4/fd3 x:0 0 0 2024-02-15T18:27:07.933 INFO:tasks.workunit.client.0.smithi084.stdout:0/644: unlink d0/d2f/d3f/d4f/d61/d79/f87 0 2024-02-15T18:27:07.935 INFO:tasks.workunit.client.0.smithi084.stdout:0/645: mkdir d0/d2f/d4b/dc6 0 2024-02-15T18:27:07.936 INFO:tasks.workunit.client.0.smithi084.stdout:4/713: read d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/f97 [2342547,10211] 0 2024-02-15T18:27:07.939 INFO:tasks.workunit.client.0.smithi084.stdout:4/714: write d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/f7d [2508184,25285] 0 2024-02-15T18:27:07.941 INFO:tasks.workunit.client.0.smithi084.stdout:4/715: creat d2/d4/d25/d66/fd4 x:0 0 0 2024-02-15T18:27:07.942 INFO:tasks.workunit.client.0.smithi084.stdout:4/716: stat d2/d4/d28/d3d/d5c/dbc/d88/db0/cb3 0 2024-02-15T18:27:07.943 INFO:tasks.workunit.client.0.smithi084.stdout:4/717: mknod d2/d64/d74/d8f/cd5 0 2024-02-15T18:27:07.944 INFO:tasks.workunit.client.0.smithi084.stdout:5/738: dwrite d9/da/d3d/d44/f97 [0,4194304] 0 2024-02-15T18:27:07.960 INFO:tasks.workunit.client.1.smithi133.stdout:4/267: dwrite d2/d5/d2b/f5b [0,4194304] 0 2024-02-15T18:27:07.960 INFO:tasks.workunit.client.1.smithi133.stdout:4/268: chown d2/d5/c5a 897771477 1 2024-02-15T18:27:07.961 INFO:tasks.workunit.client.1.smithi133.stdout:4/269: chown d2/c4c 105 1 2024-02-15T18:27:07.965 INFO:tasks.workunit.client.0.smithi084.stdout:9/728: dwrite d4/d2b/d3c/d24/dca/f6a [0,4194304] 0 2024-02-15T18:27:07.965 INFO:tasks.workunit.client.0.smithi084.stdout:9/729: write d4/d3d/da5/fde [219333,22143] 0 2024-02-15T18:27:07.965 INFO:tasks.workunit.client.0.smithi084.stdout:9/730: fdatasync d4/f29 0 2024-02-15T18:27:07.966 INFO:tasks.workunit.client.0.smithi084.stdout:6/659: dwrite d14/f6f [0,4194304] 0 2024-02-15T18:27:07.966 INFO:tasks.workunit.client.0.smithi084.stdout:6/660: stat d14/d22/d25/d41/l76 0 2024-02-15T18:27:07.966 INFO:tasks.workunit.client.0.smithi084.stdout:7/576: dwrite df/d1d/d1a/d4d/d55/fa0 [0,4194304] 0 2024-02-15T18:27:07.966 INFO:tasks.workunit.client.0.smithi084.stdout:6/661: chown d14/d22/d25/d2f/d31/d30/ld6 77488 1 2024-02-15T18:27:07.966 INFO:tasks.workunit.client.1.smithi133.stdout:0/350: dwrite d9/f75 [0,4194304] 0 2024-02-15T18:27:07.966 INFO:tasks.workunit.client.1.smithi133.stdout:4/270: stat d2/d5/d2b/d21/d36/l43 0 2024-02-15T18:27:07.966 INFO:tasks.workunit.client.1.smithi133.stdout:4/271: chown d2/d5/d2b/d21/d2d/d44/d51/d55/c3f 4557046 1 2024-02-15T18:27:07.966 INFO:tasks.workunit.client.1.smithi133.stdout:4/272: chown d2/d5/d2b/d21/d2d/l4b 7 1 2024-02-15T18:27:07.967 INFO:tasks.workunit.client.1.smithi133.stdout:3/402: dwrite d0/d15/f6b [4194304,4194304] 0 2024-02-15T18:27:07.967 INFO:tasks.workunit.client.1.smithi133.stdout:3/403: write d0/d15/d2f/f68 [139540,39595] 0 2024-02-15T18:27:07.967 INFO:tasks.workunit.client.1.smithi133.stdout:0/351: mknod d9/d10/d19/d29/c7d 0 2024-02-15T18:27:07.969 INFO:tasks.workunit.client.1.smithi133.stdout:1/536: dwrite d6/d2a/d59/fc2 [0,4194304] 0 2024-02-15T18:27:07.969 INFO:tasks.workunit.client.1.smithi133.stdout:1/537: fsync d6/fb4 0 2024-02-15T18:27:07.969 INFO:tasks.workunit.client.1.smithi133.stdout:1/538: fsync d6/d1e/d41/d7c/d7e/f99 0 2024-02-15T18:27:07.969 INFO:tasks.workunit.client.1.smithi133.stdout:5/307: dwrite d17/d20/d32/d38/f54 [0,4194304] 0 2024-02-15T18:27:07.969 INFO:tasks.workunit.client.1.smithi133.stdout:6/518: dwrite d0/db/f70 [0,4194304] 0 2024-02-15T18:27:07.970 INFO:tasks.workunit.client.0.smithi084.stdout:8/686: dwrite db/dd/d1f/d3e/f43 [0,4194304] 0 2024-02-15T18:27:07.970 INFO:tasks.workunit.client.0.smithi084.stdout:4/718: dwrite d2/f5e [4194304,4194304] 0 2024-02-15T18:27:07.970 INFO:tasks.workunit.client.1.smithi133.stdout:4/273: creat d2/d5/d2b/d21/d36/f64 x:0 0 0 2024-02-15T18:27:07.970 INFO:tasks.workunit.client.1.smithi133.stdout:4/274: truncate d2/d5/d2b/fe 643880 0 2024-02-15T18:27:07.975 INFO:tasks.workunit.client.1.smithi133.stdout:6/519: dread d0/d3b/d41/f60 [0,4194304] 0 2024-02-15T18:27:07.976 INFO:tasks.workunit.client.1.smithi133.stdout:3/404: creat d0/d15/d2f/f7d x:0 0 0 2024-02-15T18:27:07.976 INFO:tasks.workunit.client.1.smithi133.stdout:3/405: truncate d0/d15/d37/d4a/f4e 1009073 0 2024-02-15T18:27:07.977 INFO:tasks.workunit.client.0.smithi084.stdout:2/631: dwrite d3/d5/d1a/d1e/d4b/da6/fa3 [0,4194304] 0 2024-02-15T18:27:07.980 INFO:tasks.workunit.client.1.smithi133.stdout:5/308: mknod d17/d20/d4f/c68 0 2024-02-15T18:27:07.983 INFO:tasks.workunit.client.1.smithi133.stdout:6/520: symlink d0/db/d29/d34/d8c/lab 0 2024-02-15T18:27:07.984 INFO:tasks.workunit.client.1.smithi133.stdout:3/406: creat d0/d15/d2b/d39/d3f/d3e/f7e x:0 0 0 2024-02-15T18:27:07.985 INFO:tasks.workunit.client.1.smithi133.stdout:5/309: truncate d17/d20/f22 147137 0 2024-02-15T18:27:07.987 INFO:tasks.workunit.client.0.smithi084.stdout:9/731: dwrite d4/d2b/d3c/d24/dca/f64 [0,4194304] 0 2024-02-15T18:27:07.989 INFO:tasks.workunit.client.1.smithi133.stdout:6/521: symlink d0/lac 0 2024-02-15T18:27:07.989 INFO:tasks.workunit.client.1.smithi133.stdout:5/310: mknod d17/d20/d4f/d5f/c69 0 2024-02-15T18:27:07.990 INFO:tasks.workunit.client.1.smithi133.stdout:5/311: mknod d17/d20/c6a 0 2024-02-15T18:27:07.993 INFO:tasks.workunit.client.0.smithi084.stdout:6/662: unlink d14/d22/d25/d2f/d31/d30/d45/c51 0 2024-02-15T18:27:07.994 INFO:tasks.workunit.client.0.smithi084.stdout:7/577: mknod df/d1d/d44/d96/cb4 0 2024-02-15T18:27:07.994 INFO:tasks.workunit.client.0.smithi084.stdout:7/578: chown df/l13 0 1 2024-02-15T18:27:07.995 INFO:tasks.workunit.client.0.smithi084.stdout:6/663: write d14/f17 [3524573,109229] 0 2024-02-15T18:27:07.996 INFO:tasks.workunit.client.1.smithi133.stdout:0/352: dwrite f7 [0,4194304] 0 2024-02-15T18:27:07.998 INFO:tasks.workunit.client.1.smithi133.stdout:3/407: dread d0/d15/f3b [0,4194304] 0 2024-02-15T18:27:07.998 INFO:tasks.workunit.client.1.smithi133.stdout:3/408: fsync d0/d15/d2b/f44 0 2024-02-15T18:27:07.998 INFO:tasks.workunit.client.1.smithi133.stdout:3/409: chown d0/d15/d2b/d39/d3f 10537533 1 2024-02-15T18:27:07.999 INFO:tasks.workunit.client.1.smithi133.stdout:4/275: truncate d2/f1f 3386929 0 2024-02-15T18:27:07.999 INFO:tasks.workunit.client.1.smithi133.stdout:2/387: sync 2024-02-15T18:27:07.999 INFO:tasks.workunit.client.1.smithi133.stdout:2/388: fsync d7/ff 0 2024-02-15T18:27:07.999 INFO:tasks.workunit.client.1.smithi133.stdout:9/246: sync 2024-02-15T18:27:08.002 INFO:tasks.workunit.client.0.smithi084.stdout:8/687: symlink db/daf/db6/le4 0 2024-02-15T18:27:08.003 INFO:tasks.workunit.client.1.smithi133.stdout:4/276: dread d2/d5/d2b/fe [0,4194304] 0 2024-02-15T18:27:08.005 INFO:tasks.workunit.client.1.smithi133.stdout:0/353: unlink d9/d10/d47/d5e/f6b 0 2024-02-15T18:27:08.005 INFO:tasks.workunit.client.1.smithi133.stdout:0/354: fsync d9/d10/d2c/f5d 0 2024-02-15T18:27:08.006 INFO:tasks.workunit.client.1.smithi133.stdout:3/410: creat d0/d15/d2f/f7f x:0 0 0 2024-02-15T18:27:08.008 INFO:tasks.workunit.client.1.smithi133.stdout:2/389: rename d7/db/d35/f3d to d7/d2c/d5a/d66/f7c 0 2024-02-15T18:27:08.008 INFO:tasks.workunit.client.1.smithi133.stdout:2/390: readlink d7/d18/l73 0 2024-02-15T18:27:08.009 INFO:tasks.workunit.client.0.smithi084.stdout:4/719: link d2/f34 d2/d2b/fd6 0 2024-02-15T18:27:08.009 INFO:tasks.workunit.client.1.smithi133.stdout:0/355: mknod d9/d10/d19/d29/d67/d68/c7e 0 2024-02-15T18:27:08.010 INFO:tasks.workunit.client.0.smithi084.stdout:4/720: read d2/f34 [1478772,15865] 0 2024-02-15T18:27:08.010 INFO:tasks.workunit.client.0.smithi084.stdout:4/721: stat d2/d4/d28/d71/cbb 0 2024-02-15T18:27:08.011 INFO:tasks.workunit.client.0.smithi084.stdout:4/722: chown d2/d4/d28/d3d/d5c/d65/c8a 0 1 2024-02-15T18:27:08.012 INFO:tasks.workunit.client.1.smithi133.stdout:6/522: dwrite d0/d3b/d78/d7f/fa7 [0,4194304] 0 2024-02-15T18:27:08.012 INFO:tasks.workunit.client.0.smithi084.stdout:2/632: rmdir d3/d5/d1a/d74 39 2024-02-15T18:27:08.013 INFO:tasks.workunit.client.1.smithi133.stdout:2/391: rename d7/f53 to d7/d18/d32/d65/f7d 0 2024-02-15T18:27:08.014 INFO:tasks.workunit.client.1.smithi133.stdout:2/392: readlink d7/d2c/d46/l4f 0 2024-02-15T18:27:08.014 INFO:tasks.workunit.client.1.smithi133.stdout:2/393: fsync d7/f13 0 2024-02-15T18:27:08.014 INFO:tasks.workunit.client.1.smithi133.stdout:2/394: fdatasync d7/f16 0 2024-02-15T18:27:08.014 INFO:tasks.workunit.client.1.smithi133.stdout:0/356: unlink d9/d10/f52 0 2024-02-15T18:27:08.014 INFO:tasks.workunit.client.1.smithi133.stdout:0/357: fdatasync d9/d28/f36 0 2024-02-15T18:27:08.015 INFO:tasks.workunit.client.1.smithi133.stdout:7/226: sync 2024-02-15T18:27:08.015 INFO:tasks.workunit.client.1.smithi133.stdout:7/227: fdatasync d9/db/f4a 0 2024-02-15T18:27:08.017 INFO:tasks.workunit.client.0.smithi084.stdout:9/732: symlink d4/d36/d6f/lec 0 2024-02-15T18:27:08.017 INFO:tasks.workunit.client.0.smithi084.stdout:9/733: chown d4/d36/leb 55568443 1 2024-02-15T18:27:08.018 INFO:tasks.workunit.client.0.smithi084.stdout:7/579: unlink df/d1d/d1a/d6a/d8b/f65 0 2024-02-15T18:27:08.020 INFO:tasks.workunit.client.1.smithi133.stdout:9/247: dwrite d0/d8/d10/f36 [4194304,4194304] 0 2024-02-15T18:27:08.020 INFO:tasks.workunit.client.0.smithi084.stdout:9/734: write d4/d2b/d3c/f22 [245901,32815] 0 2024-02-15T18:27:08.021 INFO:tasks.workunit.client.1.smithi133.stdout:9/248: write d0/d8/d9/ff [1907365,74568] 0 2024-02-15T18:27:08.021 INFO:tasks.workunit.client.1.smithi133.stdout:6/523: symlink d0/db/d29/d34/d48/lad 0 2024-02-15T18:27:08.021 INFO:tasks.workunit.client.1.smithi133.stdout:6/524: read - d0/db/d29/d34/d5d/f6b zero size 2024-02-15T18:27:08.022 INFO:tasks.workunit.client.0.smithi084.stdout:6/664: unlink d14/l26 0 2024-02-15T18:27:08.022 INFO:tasks.workunit.client.0.smithi084.stdout:8/688: creat db/dd/d1f/d66/da2/fe5 x:0 0 0 2024-02-15T18:27:08.022 INFO:tasks.workunit.client.1.smithi133.stdout:2/395: symlink d7/d18/d32/l7e 0 2024-02-15T18:27:08.023 INFO:tasks.workunit.client.0.smithi084.stdout:4/723: creat d2/d64/d74/d8f/dc1/fd7 x:0 0 0 2024-02-15T18:27:08.023 INFO:tasks.workunit.client.0.smithi084.stdout:4/724: truncate d2/d2b/d47/f7a 242083 0 2024-02-15T18:27:08.023 INFO:tasks.workunit.client.0.smithi084.stdout:2/633: truncate d3/d5/d1a/d1e/d4b/da6/d5c/f68 2376448 0 2024-02-15T18:27:08.024 INFO:tasks.workunit.client.0.smithi084.stdout:2/634: readlink d3/d19/l1c 0 2024-02-15T18:27:08.025 INFO:tasks.workunit.client.1.smithi133.stdout:0/358: rmdir d9/d10/d19/d77 0 2024-02-15T18:27:08.025 INFO:tasks.workunit.client.1.smithi133.stdout:0/359: fsync d9/d10/f54 0 2024-02-15T18:27:08.025 INFO:tasks.workunit.client.1.smithi133.stdout:0/360: fdatasync d9/d10/d22/d2f/d30/d44/f4c 0 2024-02-15T18:27:08.025 INFO:tasks.workunit.client.1.smithi133.stdout:0/361: fsync f5 0 2024-02-15T18:27:08.026 INFO:tasks.workunit.client.0.smithi084.stdout:7/580: symlink df/lb5 0 2024-02-15T18:27:08.026 INFO:tasks.workunit.client.0.smithi084.stdout:7/581: truncate df/d1d/d1a/d4d/d55/f99 738296 0 2024-02-15T18:27:08.026 INFO:tasks.workunit.client.0.smithi084.stdout:7/582: stat df/d1d/d1a/d6a/d8b/l76 0 2024-02-15T18:27:08.026 INFO:tasks.workunit.client.0.smithi084.stdout:7/583: write df/d1d/d1a/d4d/d55/fa1 [404491,44374] 0 2024-02-15T18:27:08.026 INFO:tasks.workunit.client.1.smithi133.stdout:7/228: mkdir d9/d36/d3d/d4c 0 2024-02-15T18:27:08.028 INFO:tasks.workunit.client.0.smithi084.stdout:8/689: dread db/dd/d1f/f23 [4194304,4194304] 0 2024-02-15T18:27:08.029 INFO:tasks.workunit.client.0.smithi084.stdout:2/635: write d3/d5/d1a/f81 [3867660,43133] 0 2024-02-15T18:27:08.029 INFO:tasks.workunit.client.0.smithi084.stdout:6/665: creat d14/d22/d25/d2f/d31/d30/d93/fda x:0 0 0 2024-02-15T18:27:08.029 INFO:tasks.workunit.client.0.smithi084.stdout:6/666: getdents d14/d22/dd2 0 2024-02-15T18:27:08.029 INFO:tasks.workunit.client.0.smithi084.stdout:6/667: fsync d14/d22/d25/d2f/f66 0 2024-02-15T18:27:08.030 INFO:tasks.workunit.client.1.smithi133.stdout:4/277: dwrite d2/f1f [0,4194304] 0 2024-02-15T18:27:08.030 INFO:tasks.workunit.client.1.smithi133.stdout:4/278: write d2/d5/d2b/d21/d2d/d44/f47 [937352,112811] 0 2024-02-15T18:27:08.030 INFO:tasks.workunit.client.0.smithi084.stdout:7/584: mkdir df/d1d/d1a/d6a/d8b/da5/db6 0 2024-02-15T18:27:08.031 INFO:tasks.workunit.client.0.smithi084.stdout:8/690: creat db/d3f/d59/fe6 x:0 0 0 2024-02-15T18:27:08.032 INFO:tasks.workunit.client.1.smithi133.stdout:9/249: mkdir d0/d8/d10/d4d 0 2024-02-15T18:27:08.033 INFO:tasks.workunit.client.1.smithi133.stdout:9/250: write d0/d8/d10/f36 [969485,110706] 0 2024-02-15T18:27:08.034 INFO:tasks.workunit.client.0.smithi084.stdout:2/636: creat d3/d5/d1a/fd0 x:0 0 0 2024-02-15T18:27:08.034 INFO:tasks.workunit.client.0.smithi084.stdout:2/637: chown d3/d5/d53/dca/d91/lc2 97970 1 2024-02-15T18:27:08.036 INFO:tasks.workunit.client.1.smithi133.stdout:6/525: creat d0/d3b/d78/fae x:0 0 0 2024-02-15T18:27:08.038 INFO:tasks.workunit.client.1.smithi133.stdout:0/362: mkdir d9/d10/d22/d32/d7f 0 2024-02-15T18:27:08.038 INFO:tasks.workunit.client.0.smithi084.stdout:6/668: creat d14/d22/d25/d2f/d31/d30/d4f/fdb x:0 0 0 2024-02-15T18:27:08.039 INFO:tasks.workunit.client.0.smithi084.stdout:7/585: creat df/d70/fb7 x:0 0 0 2024-02-15T18:27:08.039 INFO:tasks.workunit.client.0.smithi084.stdout:9/735: dread d4/d2b/d3c/d24/dca/d15/f37 [4194304,4194304] 0 2024-02-15T18:27:08.039 INFO:tasks.workunit.client.0.smithi084.stdout:2/638: getdents d3/d5/d1a/d2d 0 2024-02-15T18:27:08.041 INFO:tasks.workunit.client.0.smithi084.stdout:7/586: creat df/d1d/d1a/d4b/fb8 x:0 0 0 2024-02-15T18:27:08.043 INFO:tasks.workunit.client.0.smithi084.stdout:9/736: mknod d4/d2b/d3c/d20/ced 0 2024-02-15T18:27:08.043 INFO:tasks.workunit.client.1.smithi133.stdout:9/251: truncate d0/d8/d9/f31 1899239 0 2024-02-15T18:27:08.043 INFO:tasks.workunit.client.1.smithi133.stdout:9/252: fdatasync d0/d8/d10/f15 0 2024-02-15T18:27:08.043 INFO:tasks.workunit.client.1.smithi133.stdout:9/253: chown d0/d8/d9/f31 0 1 2024-02-15T18:27:08.044 INFO:tasks.workunit.client.1.smithi133.stdout:9/254: fsync d0/d8/d9/ff 0 2024-02-15T18:27:08.044 INFO:tasks.workunit.client.1.smithi133.stdout:9/255: stat d0/d8 0 2024-02-15T18:27:08.045 INFO:tasks.workunit.client.1.smithi133.stdout:6/526: link d0/d3b/d53/f65 d0/d3b/d85/faf 0 2024-02-15T18:27:08.045 INFO:tasks.workunit.client.0.smithi084.stdout:2/639: link d3/d5/d1a/d74/db9/cc7 d3/d5/d1a/d1e/d47/cd1 0 2024-02-15T18:27:08.046 INFO:tasks.workunit.client.0.smithi084.stdout:7/587: unlink df/d1d/d1a/d6a/d8b/d48/f72 0 2024-02-15T18:27:08.046 INFO:tasks.workunit.client.1.smithi133.stdout:4/279: unlink d2/d5/f59 0 2024-02-15T18:27:08.046 INFO:tasks.workunit.client.0.smithi084.stdout:8/691: dread db/dd/d1f/f38 [0,4194304] 0 2024-02-15T18:27:08.047 INFO:tasks.workunit.client.0.smithi084.stdout:7/588: read df/d1d/d1a/d4d/d55/fa1 [214883,50781] 0 2024-02-15T18:27:08.047 INFO:tasks.workunit.client.1.smithi133.stdout:2/396: rename d7/db/l29 to d7/d2c/d3b/d48/d59/l7f 0 2024-02-15T18:27:08.047 INFO:tasks.workunit.client.1.smithi133.stdout:0/363: stat d9/d10/d19/d29/c69 0 2024-02-15T18:27:08.048 INFO:tasks.workunit.client.0.smithi084.stdout:9/737: getdents d4/d3d 0 2024-02-15T18:27:08.048 INFO:tasks.workunit.client.0.smithi084.stdout:6/669: write d14/d22/d25/d2f/d31/d3f/f74 [167601,10906] 0 2024-02-15T18:27:08.049 INFO:tasks.workunit.client.0.smithi084.stdout:9/738: read d4/d2b/d3c/d24/dca/f99 [381713,65360] 0 2024-02-15T18:27:08.049 INFO:tasks.workunit.client.0.smithi084.stdout:8/692: stat db/dd/d4d/ld6 0 2024-02-15T18:27:08.049 INFO:tasks.workunit.client.0.smithi084.stdout:8/693: readlink db/dd/d1f/d66/lc9 0 2024-02-15T18:27:08.050 INFO:tasks.workunit.client.0.smithi084.stdout:6/670: write d14/d22/d25/d2f/d31/d30/d45/d52/fb3 [4265389,94590] 0 2024-02-15T18:27:08.050 INFO:tasks.workunit.client.1.smithi133.stdout:9/256: mknod d0/c4e 0 2024-02-15T18:27:08.051 INFO:tasks.workunit.client.1.smithi133.stdout:2/397: read d7/d2c/d31/f4b [1074692,109412] 0 2024-02-15T18:27:08.052 INFO:tasks.workunit.client.0.smithi084.stdout:4/725: dwrite d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/faa [0,4194304] 0 2024-02-15T18:27:08.052 INFO:tasks.workunit.client.0.smithi084.stdout:7/589: mkdir df/d1d/d44/db9 0 2024-02-15T18:27:08.054 INFO:tasks.workunit.client.0.smithi084.stdout:8/694: rmdir db/dd/d4d 39 2024-02-15T18:27:08.054 INFO:tasks.workunit.client.0.smithi084.stdout:2/640: dread d3/d5/d1a/d1e/d4b/da6/f70 [0,4194304] 0 2024-02-15T18:27:08.054 INFO:tasks.workunit.client.0.smithi084.stdout:2/641: readlink d3/d28/l8b 0 2024-02-15T18:27:08.054 INFO:tasks.workunit.client.0.smithi084.stdout:2/642: chown d3/d5/d53/dca/lc1 82478 1 2024-02-15T18:27:08.055 INFO:tasks.workunit.client.1.smithi133.stdout:9/257: mkdir d0/d8/d9/d12/d4f 0 2024-02-15T18:27:08.055 INFO:tasks.workunit.client.1.smithi133.stdout:4/280: mkdir d2/d5/d2b/d21/d3b/d49/d65 0 2024-02-15T18:27:08.068 INFO:tasks.workunit.client.0.smithi084.stdout:8/695: symlink db/d3f/d59/le7 0 2024-02-15T18:27:08.068 INFO:tasks.workunit.client.0.smithi084.stdout:8/696: chown db/daf/db6/le4 83056 1 2024-02-15T18:27:08.068 INFO:tasks.workunit.client.0.smithi084.stdout:2/643: creat d3/d5/d53/dca/d91/fd2 x:0 0 0 2024-02-15T18:27:08.068 INFO:tasks.workunit.client.0.smithi084.stdout:7/590: dread df/d1d/d1a/d6a/d8b/d7f/f9a [0,4194304] 0 2024-02-15T18:27:08.069 INFO:tasks.workunit.client.1.smithi133.stdout:4/281: creat d2/d5/d2b/d21/d3b/f66 x:0 0 0 2024-02-15T18:27:08.071 INFO:tasks.workunit.client.0.smithi084.stdout:2/644: mkdir d3/d5/d1a/d1e/d4b/da6/d5c/dd3 0 2024-02-15T18:27:08.072 INFO:tasks.workunit.client.0.smithi084.stdout:3/636: sync 2024-02-15T18:27:08.072 INFO:tasks.workunit.client.0.smithi084.stdout:0/646: sync 2024-02-15T18:27:08.073 INFO:tasks.workunit.client.0.smithi084.stdout:7/591: mknod df/d1d/d1a/d4d/d55/d88/cba 0 2024-02-15T18:27:08.073 INFO:tasks.workunit.client.0.smithi084.stdout:8/697: write db/d1a/d2b/f31 [4704956,7094] 0 2024-02-15T18:27:08.074 INFO:tasks.workunit.client.0.smithi084.stdout:2/645: rmdir d3/d5/d1a/d1e/d4b/da6 39 2024-02-15T18:27:08.077 INFO:tasks.workunit.client.0.smithi084.stdout:1/567: sync 2024-02-15T18:27:08.077 INFO:tasks.workunit.client.0.smithi084.stdout:1/568: write d9/f14 [8524274,113407] 0 2024-02-15T18:27:08.077 INFO:tasks.workunit.client.0.smithi084.stdout:5/739: sync 2024-02-15T18:27:08.078 INFO:tasks.workunit.client.0.smithi084.stdout:2/646: creat d3/dc6/fd4 x:0 0 0 2024-02-15T18:27:08.079 INFO:tasks.workunit.client.0.smithi084.stdout:7/592: read df/d1d/d1a/d6a/d8b/f73 [734594,57961] 0 2024-02-15T18:27:08.079 INFO:tasks.workunit.client.0.smithi084.stdout:4/726: dwrite d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/fb1 [0,4194304] 0 2024-02-15T18:27:08.079 INFO:tasks.workunit.client.0.smithi084.stdout:3/637: write d8/d1f/d2d/f3d [1483534,28998] 0 2024-02-15T18:27:08.080 INFO:tasks.workunit.client.1.smithi133.stdout:4/282: dread d2/d5/d2b/f5b [0,4194304] 0 2024-02-15T18:27:08.080 INFO:tasks.workunit.client.0.smithi084.stdout:9/739: dwrite d4/d81/fd9 [0,4194304] 0 2024-02-15T18:27:08.081 INFO:tasks.workunit.client.0.smithi084.stdout:0/647: dread d0/d2f/d3f/f49 [0,4194304] 0 2024-02-15T18:27:08.081 INFO:tasks.workunit.client.0.smithi084.stdout:0/648: chown d0/d4/f4e 39 1 2024-02-15T18:27:08.082 INFO:tasks.workunit.client.0.smithi084.stdout:7/593: mkdir df/d1d/d44/dbb 0 2024-02-15T18:27:08.089 INFO:tasks.workunit.client.0.smithi084.stdout:9/740: mknod d4/d3d/cee 0 2024-02-15T18:27:08.089 INFO:tasks.workunit.client.0.smithi084.stdout:3/638: mkdir d8/d40/dda 0 2024-02-15T18:27:08.091 INFO:tasks.workunit.client.0.smithi084.stdout:7/594: creat df/d1d/d1a/d6a/d8e/fbc x:0 0 0 2024-02-15T18:27:08.093 INFO:tasks.workunit.client.0.smithi084.stdout:3/639: creat d8/d40/d43/d71/d8c/d94/da3/dba/fdb x:0 0 0 2024-02-15T18:27:08.093 INFO:tasks.workunit.client.0.smithi084.stdout:3/640: dread - d8/d1f/dbf/fc9 zero size 2024-02-15T18:27:08.099 INFO:tasks.workunit.client.0.smithi084.stdout:7/595: truncate df/d1d/d1a/d6a/d8b/d48/f5c 1830226 0 2024-02-15T18:27:08.099 INFO:tasks.workunit.client.0.smithi084.stdout:7/596: chown df/d70/fb7 127966 1 2024-02-15T18:27:08.100 INFO:tasks.workunit.client.0.smithi084.stdout:3/641: mknod d8/d73/db9/cdc 0 2024-02-15T18:27:08.101 INFO:tasks.workunit.client.0.smithi084.stdout:9/741: dread d4/d81/fd9 [0,4194304] 0 2024-02-15T18:27:08.104 INFO:tasks.workunit.client.0.smithi084.stdout:9/742: write d4/d2b/d3c/f22 [2072101,2899] 0 2024-02-15T18:27:08.106 INFO:tasks.workunit.client.0.smithi084.stdout:7/597: symlink df/d1d/d44/d96/lbd 0 2024-02-15T18:27:08.109 INFO:tasks.workunit.client.0.smithi084.stdout:3/642: unlink d8/f21 0 2024-02-15T18:27:08.109 INFO:tasks.workunit.client.0.smithi084.stdout:3/643: write d8/d1f/dbf/fd3 [901366,90846] 0 2024-02-15T18:27:08.110 INFO:tasks.workunit.client.0.smithi084.stdout:2/647: dread d3/d19/f5b [0,4194304] 0 2024-02-15T18:27:08.111 INFO:tasks.workunit.client.0.smithi084.stdout:9/743: mkdir d4/dc2/def 0 2024-02-15T18:27:08.113 INFO:tasks.workunit.client.0.smithi084.stdout:7/598: creat df/d1d/d1a/d4d/fbe x:0 0 0 2024-02-15T18:27:08.113 INFO:tasks.workunit.client.0.smithi084.stdout:7/599: fdatasync df/d70/fb0 0 2024-02-15T18:27:08.114 INFO:tasks.workunit.client.0.smithi084.stdout:3/644: mknod d8/d40/d43/d71/d8c/d94/cdd 0 2024-02-15T18:27:08.115 INFO:tasks.workunit.client.0.smithi084.stdout:2/648: rename d3/d5/d53/dca/d89/fb2 to d3/d19/d75/fd5 0 2024-02-15T18:27:08.117 INFO:tasks.workunit.client.0.smithi084.stdout:9/744: mknod d4/d36/d6f/cf0 0 2024-02-15T18:27:08.117 INFO:tasks.workunit.client.0.smithi084.stdout:9/745: chown d4/d2b/d3c/d24 7655498 1 2024-02-15T18:27:08.118 INFO:tasks.workunit.client.0.smithi084.stdout:9/746: fsync d4/da3/db0/dc5/fd1 0 2024-02-15T18:27:08.118 INFO:tasks.workunit.client.0.smithi084.stdout:9/747: readlink d4/d36/la6 0 2024-02-15T18:27:08.118 INFO:tasks.workunit.client.0.smithi084.stdout:7/600: creat df/d1d/d44/fbf x:0 0 0 2024-02-15T18:27:08.119 INFO:tasks.workunit.client.0.smithi084.stdout:9/748: symlink d4/d2b/d3c/d24/dca/d15/d33/lf1 0 2024-02-15T18:27:08.121 INFO:tasks.workunit.client.0.smithi084.stdout:7/601: creat df/d1d/d1a/fc0 x:0 0 0 2024-02-15T18:27:08.123 INFO:tasks.workunit.client.0.smithi084.stdout:3/645: read d8/d40/fa2 [389784,53234] 0 2024-02-15T18:27:08.123 INFO:tasks.workunit.client.0.smithi084.stdout:7/602: unlink df/d1d/d1a/d6a/d8e/l80 0 2024-02-15T18:27:08.125 INFO:tasks.workunit.client.0.smithi084.stdout:7/603: creat df/d1d/d1a/fc1 x:0 0 0 2024-02-15T18:27:08.125 INFO:tasks.workunit.client.0.smithi084.stdout:7/604: fsync df/d1d/d1a/f53 0 2024-02-15T18:27:08.127 INFO:tasks.workunit.client.0.smithi084.stdout:7/605: creat df/d1d/d44/dbb/fc2 x:0 0 0 2024-02-15T18:27:08.127 INFO:tasks.workunit.client.0.smithi084.stdout:7/606: write df/fa8 [929203,47996] 0 2024-02-15T18:27:08.127 INFO:tasks.workunit.client.0.smithi084.stdout:7/607: chown df/d1d/d1a/f64 17406 1 2024-02-15T18:27:08.129 INFO:tasks.workunit.client.0.smithi084.stdout:7/608: creat df/d1d/d1a/d6a/d8e/d79/fc3 x:0 0 0 2024-02-15T18:27:08.131 INFO:tasks.workunit.client.0.smithi084.stdout:7/609: symlink df/d1d/d1a/d4d/d55/lc4 0 2024-02-15T18:27:08.131 INFO:tasks.workunit.client.0.smithi084.stdout:7/610: readlink df/l13 0 2024-02-15T18:27:08.132 INFO:tasks.workunit.client.0.smithi084.stdout:7/611: mknod df/d1d/d1a/d6a/d8b/d7f/cc5 0 2024-02-15T18:27:08.135 INFO:tasks.workunit.client.0.smithi084.stdout:3/646: dread d8/d1f/d25/f75 [0,4194304] 0 2024-02-15T18:27:08.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.164+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bf00ff1a0 con 0x7f1bdc060fb0 2024-02-15T18:27:08.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.165+0000 7f1be6ffd700 1 -- 172.21.15.84:0/3084942704 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1bf00ff1a0 con 0x7f1bdc060fb0 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1bdc060fb0 msgr2=0x7f1bdc063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1bdc060fb0 0x7f1bdc063470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f1bf00600e0 tx=0x7f1be0006ad0).stop 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 msgr2=0x7f1bf00f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 0x7f1bf00f6d20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f1bec009f50 tx=0x7f1bec009b30).stop 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 shutdown_connections 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1bdc060fb0 0x7f1bdc063470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bf0060310 0x7f1bf00f6d20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 --2- 172.21.15.84:0/3084942704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bf00f9820 0x7f1bf00f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 >> 172.21.15.84:0/3084942704 conn(0x7f1bf00f0d40 msgr2=0x7f1bf00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 shutdown_connections 2024-02-15T18:27:08.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.167+0000 7f1bf8514700 1 -- 172.21.15.84:0/3084942704 wait complete. 2024-02-15T18:27:08.164 INFO:tasks.workunit.client.1.smithi133.stdout:0/364: dwrite d9/d10/d19/d29/d67/f6f [0,4194304] 0 2024-02-15T18:27:08.164 INFO:tasks.workunit.client.1.smithi133.stdout:4/283: dwrite d2/d5/d2b/f1d [4194304,4194304] 0 2024-02-15T18:27:08.165 INFO:tasks.workunit.client.0.smithi084.stdout:5/740: dwrite d9/da/d3d/d44/d55/d70/f8a [0,4194304] 0 2024-02-15T18:27:08.165 INFO:tasks.workunit.client.0.smithi084.stdout:5/741: chown d9/da/d3d 15 1 2024-02-15T18:27:08.165 INFO:tasks.workunit.client.0.smithi084.stdout:5/742: chown d9/d5f/da7/fca 0 1 2024-02-15T18:27:08.165 INFO:tasks.workunit.client.0.smithi084.stdout:5/743: write d9/fc8 [3450002,32177] 0 2024-02-15T18:27:08.165 INFO:tasks.workunit.client.0.smithi084.stdout:1/569: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/d92/fac [0,4194304] 0 2024-02-15T18:27:08.165 INFO:tasks.workunit.client.0.smithi084.stdout:8/698: dwrite db/dd/d4d/f7c [4194304,4194304] 0 2024-02-15T18:27:08.165 INFO:tasks.workunit.client.0.smithi084.stdout:8/699: chown db/dd/d1f/c2a 45311 1 2024-02-15T18:27:08.165 INFO:tasks.workunit.client.0.smithi084.stdout:4/727: dwrite d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/f97 [0,4194304] 0 2024-02-15T18:27:08.166 INFO:tasks.workunit.client.0.smithi084.stdout:0/649: dwrite d0/d2f/d3f/d4f/d59/fbc [0,4194304] 0 2024-02-15T18:27:08.166 INFO:tasks.workunit.client.0.smithi084.stdout:3/647: dwrite d8/d1f/d25/f8e [0,4194304] 0 2024-02-15T18:27:08.167 INFO:tasks.workunit.client.1.smithi133.stdout:0/365: write d9/f3e [749222,5185] 0 2024-02-15T18:27:08.167 INFO:tasks.workunit.client.1.smithi133.stdout:0/366: chown d9/d28/c2a 19443844 1 2024-02-15T18:27:08.167 INFO:tasks.workunit.client.1.smithi133.stdout:4/284: creat d2/d5/d2b/d21/d2d/d44/d51/f67 x:0 0 0 2024-02-15T18:27:08.167 INFO:tasks.workunit.client.1.smithi133.stdout:9/258: dwrite d0/d8/d9/f41 [0,4194304] 0 2024-02-15T18:27:08.167 INFO:tasks.workunit.client.1.smithi133.stdout:0/367: truncate d9/d10/f17 1616599 0 2024-02-15T18:27:08.167 INFO:tasks.workunit.client.0.smithi084.stdout:2/649: dwrite d3/d5/d53/dca/d7b/f9a [0,4194304] 0 2024-02-15T18:27:08.167 INFO:tasks.workunit.client.0.smithi084.stdout:2/650: truncate d3/d5/d1a/d74/d8e/d96/fa9 259005 0 2024-02-15T18:27:08.167 INFO:tasks.workunit.client.0.smithi084.stdout:2/651: readlink d3/d5/d53/la8 0 2024-02-15T18:27:08.168 INFO:tasks.workunit.client.1.smithi133.stdout:4/285: symlink d2/d5/d2b/d21/d2d/d44/d51/d55/d5e/l68 0 2024-02-15T18:27:08.170 INFO:tasks.workunit.client.1.smithi133.stdout:9/259: rename d0/d37/l43 to d0/d8/d9/l50 0 2024-02-15T18:27:08.171 INFO:tasks.workunit.client.1.smithi133.stdout:0/368: unlink d9/d10/d19/d1a/l3b 0 2024-02-15T18:27:08.171 INFO:tasks.workunit.client.1.smithi133.stdout:9/260: read d0/d8/d9/d12/f21 [1671727,62300] 0 2024-02-15T18:27:08.171 INFO:tasks.workunit.client.0.smithi084.stdout:5/744: rename d9/d35/lce to d9/da/d3d/d44/d55/d96/lf3 0 2024-02-15T18:27:08.172 INFO:tasks.workunit.client.0.smithi084.stdout:5/745: readlink d9/d5b/d7e/le1 0 2024-02-15T18:27:08.172 INFO:tasks.workunit.client.1.smithi133.stdout:9/261: read d0/d8/d10/f2f [116730,52232] 0 2024-02-15T18:27:08.172 INFO:tasks.workunit.client.0.smithi084.stdout:3/648: dread d8/d1f/d25/f75 [0,4194304] 0 2024-02-15T18:27:08.173 INFO:tasks.workunit.client.1.smithi133.stdout:0/369: write d9/d10/d22/d2f/d30/d44/f4f [2150499,101418] 0 2024-02-15T18:27:08.175 INFO:tasks.workunit.client.1.smithi133.stdout:9/262: creat d0/d8/d9/d49/f51 x:0 0 0 2024-02-15T18:27:08.175 INFO:tasks.workunit.client.1.smithi133.stdout:9/263: truncate d0/d8/d10/f30 4824500 0 2024-02-15T18:27:08.176 INFO:tasks.workunit.client.0.smithi084.stdout:3/649: write d8/d40/d58/d80/d6b/f85 [2339013,23372] 0 2024-02-15T18:27:08.178 INFO:tasks.workunit.client.0.smithi084.stdout:1/570: symlink d9/d54/d1b/d2c/d4b/d4c/d79/db2/lbc 0 2024-02-15T18:27:08.179 INFO:tasks.workunit.client.0.smithi084.stdout:8/700: unlink db/dd/fbd 0 2024-02-15T18:27:08.179 INFO:tasks.workunit.client.0.smithi084.stdout:8/701: chown db/dd/d1f/d7a/ca7 6167012 1 2024-02-15T18:27:08.179 INFO:tasks.workunit.client.0.smithi084.stdout:8/702: chown db/l27 126173 1 2024-02-15T18:27:08.180 INFO:tasks.workunit.client.0.smithi084.stdout:8/703: write db/f3a [2272288,86633] 0 2024-02-15T18:27:08.180 INFO:tasks.workunit.client.0.smithi084.stdout:4/728: rmdir d2/d64/da5 39 2024-02-15T18:27:08.180 INFO:tasks.workunit.client.1.smithi133.stdout:9/264: creat d0/d8/f52 x:0 0 0 2024-02-15T18:27:08.180 INFO:tasks.workunit.client.1.smithi133.stdout:9/265: chown d0/d8/d9/d3c 5 1 2024-02-15T18:27:08.182 INFO:tasks.workunit.client.0.smithi084.stdout:1/571: read d9/d54/d1b/d2c/f43 [1900851,99907] 0 2024-02-15T18:27:08.182 INFO:tasks.workunit.client.0.smithi084.stdout:1/572: fsync d9/d54/d5c/f67 0 2024-02-15T18:27:08.182 INFO:tasks.workunit.client.0.smithi084.stdout:0/650: symlink d0/d4/d1b/d26/d43/d6d/db6/lc7 0 2024-02-15T18:27:08.182 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:27:08.183 INFO:tasks.workunit.client.1.smithi133.stdout:9/266: symlink d0/d8/d9/d12/d2a/d42/d44/l53 0 2024-02-15T18:27:08.194 INFO:tasks.workunit.client.0.smithi084.stdout:3/650: dread d8/d1f/d25/f7f [0,4194304] 0 2024-02-15T18:27:08.198 INFO:tasks.workunit.client.1.smithi133.stdout:0/370: dwrite d9/d10/f54 [0,4194304] 0 2024-02-15T18:27:08.199 INFO:tasks.workunit.client.0.smithi084.stdout:2/652: mknod d3/d19/dc5/cd6 0 2024-02-15T18:27:08.203 INFO:tasks.workunit.client.0.smithi084.stdout:5/746: symlink d9/d35/d65/d7f/lf4 0 2024-02-15T18:27:08.204 INFO:tasks.workunit.client.0.smithi084.stdout:8/704: mknod db/d6a/ce8 0 2024-02-15T18:27:08.204 INFO:tasks.workunit.client.0.smithi084.stdout:8/705: chown db/fe 0 1 2024-02-15T18:27:08.204 INFO:tasks.workunit.client.0.smithi084.stdout:4/729: rmdir d2/d4/d28/d3d/da4 39 2024-02-15T18:27:08.205 INFO:tasks.workunit.client.0.smithi084.stdout:0/651: rmdir d0/d4/d1b/d7a 39 2024-02-15T18:27:08.205 INFO:tasks.workunit.client.0.smithi084.stdout:0/652: chown d0/d2f/d3f/d4f/d59/da7 814 1 2024-02-15T18:27:08.205 INFO:tasks.workunit.client.0.smithi084.stdout:0/653: chown d0/d98/fc0 2028 1 2024-02-15T18:27:08.206 INFO:tasks.workunit.client.0.smithi084.stdout:3/651: stat d8/d40/d43/ca7 0 2024-02-15T18:27:08.206 INFO:tasks.workunit.client.0.smithi084.stdout:2/653: read d3/d5/d1a/f81 [2827763,128602] 0 2024-02-15T18:27:08.206 INFO:tasks.workunit.client.0.smithi084.stdout:2/654: chown d3/d5/d1a/d1e/d4b 643 1 2024-02-15T18:27:08.206 INFO:tasks.workunit.client.0.smithi084.stdout:5/747: symlink d9/d23/dac/dc9/lf5 0 2024-02-15T18:27:08.208 INFO:tasks.workunit.client.0.smithi084.stdout:2/655: creat d3/d5/d53/dca/db8/fd7 x:0 0 0 2024-02-15T18:27:08.208 INFO:tasks.workunit.client.0.smithi084.stdout:5/748: mknod d9/da/d3d/d44/d55/d96/cf6 0 2024-02-15T18:27:08.210 INFO:tasks.workunit.client.0.smithi084.stdout:2/656: creat d3/d5/d1a/d2d/fd8 x:0 0 0 2024-02-15T18:27:08.210 INFO:tasks.workunit.client.0.smithi084.stdout:2/657: stat d3/d5/d1a/d1e/d4b/f59 0 2024-02-15T18:27:08.210 INFO:tasks.workunit.client.0.smithi084.stdout:2/658: fsync d3/d5/d1a/d1e/f58 0 2024-02-15T18:27:08.212 INFO:tasks.workunit.client.0.smithi084.stdout:2/659: mknod d3/d5/d1a/d1e/d30/d8d/cd9 0 2024-02-15T18:27:08.212 INFO:tasks.workunit.client.0.smithi084.stdout:4/730: write d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/f97 [174825,73892] 0 2024-02-15T18:27:08.212 INFO:tasks.workunit.client.0.smithi084.stdout:2/660: chown d3/d5/d1a/d1e/d4b 215 1 2024-02-15T18:27:08.213 INFO:tasks.workunit.client.1.smithi133.stdout:0/371: dread d9/d10/d19/f3d [0,4194304] 0 2024-02-15T18:27:08.214 INFO:tasks.workunit.client.1.smithi133.stdout:9/267: dwrite d0/d8/d10/f29 [4194304,4194304] 0 2024-02-15T18:27:08.214 INFO:tasks.workunit.client.1.smithi133.stdout:9/268: write d0/f16 [722871,65429] 0 2024-02-15T18:27:08.215 INFO:tasks.workunit.client.0.smithi084.stdout:1/573: dwrite d9/d54/d32/d5b/f90 [0,4194304] 0 2024-02-15T18:27:08.216 INFO:tasks.workunit.client.0.smithi084.stdout:4/731: unlink d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/f7d 0 2024-02-15T18:27:08.218 INFO:tasks.workunit.client.0.smithi084.stdout:1/574: read d9/d54/d1b/d2c/d35/f72 [1498394,48163] 0 2024-02-15T18:27:08.218 INFO:tasks.workunit.client.0.smithi084.stdout:4/732: write d2/d4/f82 [1306978,70288] 0 2024-02-15T18:27:08.220 INFO:tasks.workunit.client.1.smithi133.stdout:9/269: write d0/f27 [2941192,118947] 0 2024-02-15T18:27:08.222 INFO:tasks.workunit.client.0.smithi084.stdout:4/733: link d2/d2b/d47/f56 d2/d4/d28/d2e/fd8 0 2024-02-15T18:27:08.222 INFO:tasks.workunit.client.0.smithi084.stdout:4/734: chown d2/d4/d28/d2e/cc7 1625 1 2024-02-15T18:27:08.222 INFO:tasks.workunit.client.1.smithi133.stdout:9/270: mknod d0/d8/d10/c54 0 2024-02-15T18:27:08.225 INFO:tasks.workunit.client.0.smithi084.stdout:4/735: rmdir d2/d64/da5/dae 39 2024-02-15T18:27:08.229 INFO:tasks.workunit.client.1.smithi133.stdout:9/271: write d0/d8/d9/d12/f21 [4417136,87048] 0 2024-02-15T18:27:08.230 INFO:tasks.workunit.client.1.smithi133.stdout:9/272: creat d0/f55 x:0 0 0 2024-02-15T18:27:08.231 INFO:tasks.workunit.client.1.smithi133.stdout:9/273: getdents d0/d8/d9 0 2024-02-15T18:27:08.232 INFO:tasks.workunit.client.1.smithi133.stdout:9/274: truncate d0/d8/d9/ff 1966668 0 2024-02-15T18:27:08.233 INFO:tasks.workunit.client.0.smithi084.stdout:1/575: dread d9/d54/d1b/d2c/d4b/d4c/d79/d39/f30 [0,4194304] 0 2024-02-15T18:27:08.233 INFO:tasks.workunit.client.0.smithi084.stdout:1/576: dread - d9/d54/d32/d5b/d69/fb1 zero size 2024-02-15T18:27:08.234 INFO:tasks.workunit.client.0.smithi084.stdout:3/652: dwrite d8/d1f/d25/f75 [0,4194304] 0 2024-02-15T18:27:08.234 INFO:tasks.workunit.client.0.smithi084.stdout:3/653: readlink d8/d40/d58/l88 0 2024-02-15T18:27:08.234 INFO:tasks.workunit.client.0.smithi084.stdout:3/654: dread - d8/d73/db9/fd4 zero size 2024-02-15T18:27:08.234 INFO:tasks.workunit.client.1.smithi133.stdout:9/275: link d0/d8/d9/d12/d2a/f2e d0/d8/f56 0 2024-02-15T18:27:08.235 INFO:tasks.workunit.client.1.smithi133.stdout:9/276: mknod d0/d8/d9/d3c/c57 0 2024-02-15T18:27:08.235 INFO:tasks.workunit.client.0.smithi084.stdout:3/655: mknod d8/d40/d58/cde 0 2024-02-15T18:27:08.236 INFO:tasks.workunit.client.0.smithi084.stdout:3/656: mknod d8/d40/cdf 0 2024-02-15T18:27:08.236 INFO:tasks.workunit.client.0.smithi084.stdout:3/657: creat d8/d73/fe0 x:0 0 0 2024-02-15T18:27:08.246 INFO:tasks.workunit.client.1.smithi133.stdout:0/372: dwrite f6 [0,4194304] 0 2024-02-15T18:27:08.246 INFO:tasks.workunit.client.0.smithi084.stdout:5/749: dwrite d9/d35/d65/f56 [0,4194304] 0 2024-02-15T18:27:08.246 INFO:tasks.workunit.client.0.smithi084.stdout:5/750: chown d9/d23/dac/dc9/fe8 0 1 2024-02-15T18:27:08.250 INFO:tasks.workunit.client.0.smithi084.stdout:2/661: dwrite d3/d5/d1a/d1e/d4b/da6/f8c [4194304,4194304] 0 2024-02-15T18:27:08.250 INFO:tasks.workunit.client.0.smithi084.stdout:3/658: dread d8/d40/f59 [4194304,4194304] 0 2024-02-15T18:27:08.255 INFO:tasks.workunit.client.0.smithi084.stdout:5/751: rename d9/f15 to d9/da/ff7 0 2024-02-15T18:27:08.256 INFO:tasks.workunit.client.0.smithi084.stdout:1/577: dwrite d9/d54/d1b/f56 [0,4194304] 0 2024-02-15T18:27:08.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/277: write d0/d8/d9/ff [167086,91633] 0 2024-02-15T18:27:08.261 INFO:tasks.workunit.client.1.smithi133.stdout:9/278: creat d0/d8/d9/d49/d4c/f58 x:0 0 0 2024-02-15T18:27:08.261 INFO:tasks.workunit.client.1.smithi133.stdout:9/279: truncate d0/d8/d9/d49/d4c/f58 71932 0 2024-02-15T18:27:08.262 INFO:tasks.workunit.client.0.smithi084.stdout:3/659: symlink d8/d1f/d2d/le1 0 2024-02-15T18:27:08.262 INFO:tasks.workunit.client.0.smithi084.stdout:2/662: symlink d3/d5/d1a/d1e/d4b/lda 0 2024-02-15T18:27:08.262 INFO:tasks.workunit.client.0.smithi084.stdout:3/660: chown d8/d1f/d2d/f96 228427430 1 2024-02-15T18:27:08.262 INFO:tasks.workunit.client.0.smithi084.stdout:1/578: symlink d9/d54/d1b/d38/lbd 0 2024-02-15T18:27:08.263 INFO:tasks.workunit.client.1.smithi133.stdout:9/280: fdatasync d0/f7 0 2024-02-15T18:27:08.263 INFO:tasks.workunit.client.1.smithi133.stdout:8/333: sync 2024-02-15T18:27:08.264 INFO:tasks.workunit.client.0.smithi084.stdout:1/579: dread d9/d54/d5c/d81/fa2 [0,4194304] 0 2024-02-15T18:27:08.265 INFO:tasks.workunit.client.1.smithi133.stdout:9/281: link d0/f20 d0/d8/d9/d12/d2a/d42/f59 0 2024-02-15T18:27:08.267 INFO:tasks.workunit.client.1.smithi133.stdout:8/334: mkdir d3/d1c/d37/d5a/d73 0 2024-02-15T18:27:08.268 INFO:tasks.workunit.client.0.smithi084.stdout:1/580: creat d9/d54/d1b/da7/fbe x:0 0 0 2024-02-15T18:27:08.268 INFO:tasks.workunit.client.0.smithi084.stdout:1/581: stat d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f 0 2024-02-15T18:27:08.269 INFO:tasks.workunit.client.1.smithi133.stdout:9/282: unlink d0/d8/d9/d49/f51 0 2024-02-15T18:27:08.270 INFO:tasks.workunit.client.0.smithi084.stdout:1/582: symlink d9/d54/d1b/d38/d4d/lbf 0 2024-02-15T18:27:08.270 INFO:tasks.workunit.client.0.smithi084.stdout:1/583: chown d9/d54/f82 69 1 2024-02-15T18:27:08.270 INFO:tasks.workunit.client.0.smithi084.stdout:1/584: chown d9/d54/d1b/d2c/d4b/d4c/d79/d92 17193 1 2024-02-15T18:27:08.271 INFO:tasks.workunit.client.1.smithi133.stdout:9/283: symlink d0/d8/d9/d49/l5a 0 2024-02-15T18:27:08.272 INFO:tasks.workunit.client.0.smithi084.stdout:1/585: rename d9/d54/d1b/d2c/d4b/d63 to d9/d54/d7f/db7/dc0 0 2024-02-15T18:27:08.274 INFO:tasks.workunit.client.0.smithi084.stdout:1/586: write d9/d54/d1b/d2c/d4b/d7a/d89/f9a [608660,107046] 0 2024-02-15T18:27:08.277 INFO:tasks.workunit.client.0.smithi084.stdout:1/587: symlink d9/d54/d5c/d81/lc1 0 2024-02-15T18:27:08.277 INFO:tasks.workunit.client.0.smithi084.stdout:1/588: rename d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3 to d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/dc2 22 2024-02-15T18:27:08.279 INFO:tasks.workunit.client.1.smithi133.stdout:9/284: dread d0/d8/d9/d12/f3f [0,4194304] 0 2024-02-15T18:27:08.279 INFO:tasks.workunit.client.1.smithi133.stdout:9/285: write d0/d8/d9/d12/f1b [5194324,38082] 0 2024-02-15T18:27:08.281 INFO:tasks.workunit.client.1.smithi133.stdout:9/286: link d0/d8/f22 d0/d8/d9/d3c/f5b 0 2024-02-15T18:27:08.282 INFO:tasks.workunit.client.1.smithi133.stdout:9/287: symlink d0/d8/d9/d12/d2a/l5c 0 2024-02-15T18:27:08.282 INFO:tasks.workunit.client.1.smithi133.stdout:9/288: rmdir d0/d8/d9/d3c 39 2024-02-15T18:27:08.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/289: creat d0/d8/d9/d3c/f5d x:0 0 0 2024-02-15T18:27:08.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/290: chown d0/d8/d9/d12/d2a/d42/d44 282152114 1 2024-02-15T18:27:08.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/291: stat d0/d8/fd 0 2024-02-15T18:27:08.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/292: creat d0/d8/d10/d4d/f5e x:0 0 0 2024-02-15T18:27:08.285 INFO:tasks.workunit.client.1.smithi133.stdout:9/293: symlink d0/d8/d9/d3c/l5f 0 2024-02-15T18:27:08.286 INFO:tasks.workunit.client.1.smithi133.stdout:9/294: write d0/d8/d9/d12/f3f [718897,21314] 0 2024-02-15T18:27:08.286 INFO:tasks.workunit.client.1.smithi133.stdout:9/295: stat d0/c4e 0 2024-02-15T18:27:08.286 INFO:tasks.workunit.client.1.smithi133.stdout:9/296: chown d0/d8/d9/d12/f3f 134 1 2024-02-15T18:27:08.287 INFO:tasks.workunit.client.1.smithi133.stdout:9/297: symlink d0/d8/d9/d12/d4f/l60 0 2024-02-15T18:27:08.288 INFO:tasks.workunit.client.1.smithi133.stdout:9/298: creat d0/d8/d9/d12/d2a/d42/f61 x:0 0 0 2024-02-15T18:27:08.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/299: rename d0/f27 to d0/d8/d9/d3c/f62 0 2024-02-15T18:27:08.291 INFO:tasks.workunit.client.1.smithi133.stdout:9/300: readlink d0/d8/d9/d12/d2a/d42/d44/l53 0 2024-02-15T18:27:08.291 INFO:tasks.workunit.client.0.smithi084.stdout:2/663: dwrite d3/f42 [0,4194304] 0 2024-02-15T18:27:08.291 INFO:tasks.workunit.client.0.smithi084.stdout:3/661: dwrite d8/d1f/dbf/f49 [0,4194304] 0 2024-02-15T18:27:08.291 INFO:tasks.workunit.client.0.smithi084.stdout:1/589: dread d9/d54/d1b/f53 [0,4194304] 0 2024-02-15T18:27:08.292 INFO:tasks.workunit.client.0.smithi084.stdout:2/664: write d3/d28/f78 [767623,58099] 0 2024-02-15T18:27:08.294 INFO:tasks.workunit.client.1.smithi133.stdout:8/335: dwrite d3/d1f/f2c [0,4194304] 0 2024-02-15T18:27:08.295 INFO:tasks.workunit.client.0.smithi084.stdout:1/590: creat d9/d54/d76/fc3 x:0 0 0 2024-02-15T18:27:08.296 INFO:tasks.workunit.client.1.smithi133.stdout:8/336: link d3/d1f/f2c d3/d1f/d3f/f74 0 2024-02-15T18:27:08.296 INFO:tasks.workunit.client.0.smithi084.stdout:1/591: dread d9/d54/d5c/d81/fa2 [0,4194304] 0 2024-02-15T18:27:08.299 INFO:tasks.workunit.client.1.smithi133.stdout:8/337: rename d3/d1c/d37/l49 to d3/d1f/d4f/l75 0 2024-02-15T18:27:08.299 INFO:tasks.workunit.client.1.smithi133.stdout:8/338: truncate d3/d7/f72 25721 0 2024-02-15T18:27:08.299 INFO:tasks.workunit.client.0.smithi084.stdout:3/662: unlink d8/d1f/dbf/fa9 0 2024-02-15T18:27:08.300 INFO:tasks.workunit.client.1.smithi133.stdout:9/301: dread d0/d8/d10/f29 [4194304,4194304] 0 2024-02-15T18:27:08.300 INFO:tasks.workunit.client.1.smithi133.stdout:9/302: chown d0/d8/d9/d3c/f62 850143 1 2024-02-15T18:27:08.300 INFO:tasks.workunit.client.1.smithi133.stdout:8/339: write d3/d1f/d3f/f41 [1445624,7752] 0 2024-02-15T18:27:08.303 INFO:tasks.workunit.client.1.smithi133.stdout:8/340: mkdir d3/d1c/d2f/d76 0 2024-02-15T18:27:08.303 INFO:tasks.workunit.client.1.smithi133.stdout:8/341: chown d3/d7/d52/f56 42714315 1 2024-02-15T18:27:08.304 INFO:tasks.workunit.client.0.smithi084.stdout:1/592: write d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 [3479917,38697] 0 2024-02-15T18:27:08.304 INFO:tasks.workunit.client.0.smithi084.stdout:1/593: write d9/d54/d1b/d38/d4d/f7e [822152,126693] 0 2024-02-15T18:27:08.304 INFO:tasks.workunit.client.0.smithi084.stdout:1/594: chown d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8 6918409 1 2024-02-15T18:27:08.304 INFO:tasks.workunit.client.0.smithi084.stdout:1/595: fsync d9/f9d 0 2024-02-15T18:27:08.304 INFO:tasks.workunit.client.0.smithi084.stdout:1/596: dread - d9/d54/d76/fc3 zero size 2024-02-15T18:27:08.304 INFO:tasks.workunit.client.0.smithi084.stdout:1/597: write d9/d54/d1b/d2c/d4b/d7a/d89/f96 [731869,30691] 0 2024-02-15T18:27:08.307 INFO:tasks.workunit.client.0.smithi084.stdout:1/598: unlink d9/d54/d7f/l8b 0 2024-02-15T18:27:08.307 INFO:tasks.workunit.client.0.smithi084.stdout:1/599: write d9/f9d [5047124,79677] 0 2024-02-15T18:27:08.317 INFO:tasks.workunit.client.1.smithi133.stdout:9/303: dread d0/f20 [0,4194304] 0 2024-02-15T18:27:08.317 INFO:tasks.workunit.client.1.smithi133.stdout:9/304: readlink d0/d8/d9/l50 0 2024-02-15T18:27:08.318 INFO:tasks.workunit.client.1.smithi133.stdout:9/305: truncate d0/d8/d9/d12/f21 1258852 0 2024-02-15T18:27:08.318 INFO:tasks.workunit.client.1.smithi133.stdout:9/306: readlink d0/l1f 0 2024-02-15T18:27:08.323 INFO:tasks.workunit.client.0.smithi084.stdout:2/665: dwrite d3/d5/d1a/d74/fac [0,4194304] 0 2024-02-15T18:27:08.323 INFO:tasks.workunit.client.0.smithi084.stdout:2/666: write d3/d5/d53/dca/d91/fb4 [922013,120817] 0 2024-02-15T18:27:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.327+0000 7f939fd5d700 1 -- 172.21.15.84:0/1163410282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9398060310 msgr2=0x7f93980f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.327+0000 7f939fd5d700 1 --2- 172.21.15.84:0/1163410282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9398060310 0x7f93980f92a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f9394004660 tx=0x7f9394009b30).stop 2024-02-15T18:27:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.327+0000 7f939fd5d700 1 -- 172.21.15.84:0/1163410282 shutdown_connections 2024-02-15T18:27:08.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.327+0000 7f939fd5d700 1 --2- 172.21.15.84:0/1163410282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93980f9820 0x7f93980fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.327+0000 7f939fd5d700 1 --2- 172.21.15.84:0/1163410282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9398060310 0x7f93980f92a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.327+0000 7f939fd5d700 1 -- 172.21.15.84:0/1163410282 >> 172.21.15.84:0/1163410282 conn(0x7f93980f0d40 msgr2=0x7f93980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:08.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.327+0000 7f939fd5d700 1 -- 172.21.15.84:0/1163410282 shutdown_connections 2024-02-15T18:27:08.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.327+0000 7f939fd5d700 1 -- 172.21.15.84:0/1163410282 wait complete. 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939fd5d700 1 Processor -- start 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939fd5d700 1 -- start start 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939fd5d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9398060310 0x7f9398106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939fd5d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93980f9820 0x7f93981074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939fd5d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9398107a90 con 0x7f9398060310 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939fd5d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9398107bd0 con 0x7f93980f9820 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939d2f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93980f9820 0x7f93981074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939d2f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93980f9820 0x7f93981074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.84:54362/0 (socket says 172.21.15.84:54362) 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939d2f8700 1 -- 172.21.15.84:0/2271206920 learned_addr learned my addr 172.21.15.84:0/2271206920 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:08.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.328+0000 7f939daf9700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9398060310 0x7f9398106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:08.326 INFO:tasks.workunit.client.0.smithi084.stdout:2/667: symlink d3/d5/d53/dca/d91/ldb 0 2024-02-15T18:27:08.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.329+0000 7f939d2f8700 1 -- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9398060310 msgr2=0x7f9398106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:08.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.329+0000 7f939d2f8700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9398060310 0x7f9398106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.329+0000 7f939d2f8700 1 -- 172.21.15.84:0/2271206920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9394005040 con 0x7f93980f9820 2024-02-15T18:27:08.326 INFO:tasks.workunit.client.0.smithi084.stdout:3/663: dwrite d8/d1f/d2d/f4f [4194304,4194304] 0 2024-02-15T18:27:08.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.329+0000 7f939d2f8700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93980f9820 0x7f93981074e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f9388004fa0 tx=0x7f9388009d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:08.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.329+0000 7f938e7fc700 1 -- 172.21.15.84:0/2271206920 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9388002ab0 con 0x7f93980f9820 2024-02-15T18:27:08.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.329+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9398108570 con 0x7f93980f9820 2024-02-15T18:27:08.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.329+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9398108b30 con 0x7f93980f9820 2024-02-15T18:27:08.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.329+0000 7f938e7fc700 1 -- 172.21.15.84:0/2271206920 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9388009600 con 0x7f93980f9820 2024-02-15T18:27:08.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.329+0000 7f938e7fc700 1 -- 172.21.15.84:0/2271206920 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f938801d3a0 con 0x7f93980f9820 2024-02-15T18:27:08.328 INFO:tasks.workunit.client.0.smithi084.stdout:2/668: creat d3/d5/d53/fdc x:0 0 0 2024-02-15T18:27:08.328 INFO:tasks.workunit.client.0.smithi084.stdout:2/669: chown d3/d19 19 1 2024-02-15T18:27:08.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.330+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9380004fa0 con 0x7f93980f9820 2024-02-15T18:27:08.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.331+0000 7f938e7fc700 1 -- 172.21.15.84:0/2271206920 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 77194+0+0 (secure 0 0 0) 0x7f9388025070 con 0x7f93980f9820 2024-02-15T18:27:08.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.331+0000 7f938e7fc700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9384060fb0 0x7f9384063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:08.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.332+0000 7f938e7fc700 1 -- 172.21.15.84:0/2271206920 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9388084720 con 0x7f93980f9820 2024-02-15T18:27:08.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.332+0000 7f939daf9700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9384060fb0 0x7f9384063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:08.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.332+0000 7f939daf9700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9384060fb0 0x7f9384063470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9394005010 tx=0x7f9394009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:08.329 INFO:tasks.workunit.client.0.smithi084.stdout:3/664: rmdir d8/d40/d43/d71/d8c/d94/da3/dba 39 2024-02-15T18:27:08.330 INFO:tasks.workunit.client.1.smithi133.stdout:8/342: dwrite d3/f42 [0,4194304] 0 2024-02-15T18:27:08.330 INFO:tasks.workunit.client.1.smithi133.stdout:8/343: read d3/f4a [1088518,20466] 0 2024-02-15T18:27:08.330 INFO:tasks.workunit.client.1.smithi133.stdout:9/307: dread d0/d8/d10/f29 [0,4194304] 0 2024-02-15T18:27:08.330 INFO:tasks.workunit.client.1.smithi133.stdout:8/344: dread d3/d7/f4d [0,4194304] 0 2024-02-15T18:27:08.332 INFO:tasks.workunit.client.0.smithi084.stdout:1/600: write d9/d54/d1b/d2c/d4b/d4c/f61 [950053,21859] 0 2024-02-15T18:27:08.334 INFO:tasks.workunit.client.0.smithi084.stdout:2/670: truncate d3/d28/f45 1779922 0 2024-02-15T18:27:08.334 INFO:tasks.workunit.client.0.smithi084.stdout:2/671: chown d3/f14 2422 1 2024-02-15T18:27:08.334 INFO:tasks.workunit.client.0.smithi084.stdout:1/601: dread d9/d54/d32/d5b/d69/fa3 [0,4194304] 0 2024-02-15T18:27:08.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.339+0000 7f938e7fc700 1 -- 172.21.15.84:0/2271206920 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f9388058500 con 0x7f93980f9820 2024-02-15T18:27:08.336 INFO:tasks.workunit.client.0.smithi084.stdout:6/671: sync 2024-02-15T18:27:08.336 INFO:tasks.workunit.client.0.smithi084.stdout:6/672: chown d14/d22/d25/d2f/d31/d30/d45/d52/lcd 47 1 2024-02-15T18:27:08.336 INFO:tasks.workunit.client.0.smithi084.stdout:6/673: fdatasync d14/d22/d25/d2f/d31/d3f/d4a/f98 0 2024-02-15T18:27:08.338 INFO:tasks.workunit.client.1.smithi133.stdout:9/308: mknod d0/d8/d9/d49/c63 0 2024-02-15T18:27:08.339 INFO:tasks.workunit.client.0.smithi084.stdout:2/672: rmdir d3/d5/d1a/d1e/d30 39 2024-02-15T18:27:08.341 INFO:tasks.workunit.client.0.smithi084.stdout:1/602: getdents d9/d54/d1b/d2c/d4b/d7a 0 2024-02-15T18:27:08.341 INFO:tasks.workunit.client.0.smithi084.stdout:1/603: fsync d9/d54/d1b/d38/f4a 0 2024-02-15T18:27:08.341 INFO:tasks.workunit.client.0.smithi084.stdout:2/673: stat d3/d5e/c62 0 2024-02-15T18:27:08.342 INFO:tasks.workunit.client.0.smithi084.stdout:2/674: chown d3/d5/d1a/c84 166137 1 2024-02-15T18:27:08.342 INFO:tasks.workunit.client.0.smithi084.stdout:2/675: chown d3/d5/d1a/d74/db9 470572914 1 2024-02-15T18:27:08.342 INFO:tasks.workunit.client.0.smithi084.stdout:2/676: mkdir d3/d5/d53/dca/d7b/db0/ddd 0 2024-02-15T18:27:08.346 INFO:tasks.workunit.client.0.smithi084.stdout:1/604: write d9/f15 [2009090,41309] 0 2024-02-15T18:27:08.351 INFO:tasks.workunit.client.1.smithi133.stdout:8/345: dwrite d3/f4a [0,4194304] 0 2024-02-15T18:27:08.351 INFO:tasks.workunit.client.1.smithi133.stdout:8/346: fsync d3/f46 0 2024-02-15T18:27:08.353 INFO:tasks.workunit.client.0.smithi084.stdout:1/605: write d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 [637428,90222] 0 2024-02-15T18:27:08.356 INFO:tasks.workunit.client.1.smithi133.stdout:8/347: dread d3/d7/d40/d61/f65 [0,4194304] 0 2024-02-15T18:27:08.357 INFO:tasks.workunit.client.0.smithi084.stdout:1/606: write d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 [4049191,118181] 0 2024-02-15T18:27:08.359 INFO:tasks.workunit.client.0.smithi084.stdout:1/607: link d9/d54/d1b/d2c/d4b/d4c/d79/d39/f30 d9/d54/d1b/d2c/d4b/d4c/fc4 0 2024-02-15T18:27:08.367 INFO:tasks.workunit.client.1.smithi133.stdout:9/309: dwrite d0/d8/d9/ff [0,4194304] 0 2024-02-15T18:27:08.367 INFO:tasks.workunit.client.1.smithi133.stdout:9/310: chown d0/c19 108170411 1 2024-02-15T18:27:08.367 INFO:tasks.workunit.client.1.smithi133.stdout:1/539: sync 2024-02-15T18:27:08.368 INFO:tasks.workunit.client.0.smithi084.stdout:3/665: dwrite d8/d1f/d25/f7f [0,4194304] 0 2024-02-15T18:27:08.370 INFO:tasks.workunit.client.1.smithi133.stdout:9/311: dread d0/d8/d10/f29 [0,4194304] 0 2024-02-15T18:27:08.370 INFO:tasks.workunit.client.1.smithi133.stdout:9/312: chown d0/d8/d9/d3c/l5f 80637067 1 2024-02-15T18:27:08.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/313: stat d0/d8/d9/l4a 0 2024-02-15T18:27:08.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/314: fdatasync d0/d8/d9/f31 0 2024-02-15T18:27:08.372 INFO:tasks.workunit.client.1.smithi133.stdout:9/315: unlink d0/d8/d9/d3c/f5b 0 2024-02-15T18:27:08.372 INFO:tasks.workunit.client.0.smithi084.stdout:3/666: write d8/d40/d43/d71/fb5 [3533791,109356] 0 2024-02-15T18:27:08.375 INFO:tasks.workunit.client.0.smithi084.stdout:3/667: symlink d8/d40/d43/d71/d8c/le2 0 2024-02-15T18:27:08.376 INFO:tasks.workunit.client.0.smithi084.stdout:3/668: mkdir d8/d40/d43/d71/d8c/d94/da3/dba/de3 0 2024-02-15T18:27:08.378 INFO:tasks.workunit.client.0.smithi084.stdout:3/669: link d8/d40/f59 d8/d73/db9/dca/fe4 0 2024-02-15T18:27:08.379 INFO:tasks.workunit.client.0.smithi084.stdout:3/670: write d8/d40/fa8 [908016,92522] 0 2024-02-15T18:27:08.379 INFO:tasks.workunit.client.1.smithi133.stdout:8/348: dwrite d3/f2e [0,4194304] 0 2024-02-15T18:27:08.380 INFO:tasks.workunit.client.1.smithi133.stdout:8/349: chown d3/d1f/d4f/l54 928 1 2024-02-15T18:27:08.380 INFO:tasks.workunit.client.0.smithi084.stdout:3/671: mkdir d8/d40/d43/d71/d8c/d94/da3/de5 0 2024-02-15T18:27:08.381 INFO:tasks.workunit.client.1.smithi133.stdout:8/350: creat d3/d1c/d2f/d76/f77 x:0 0 0 2024-02-15T18:27:08.381 INFO:tasks.workunit.client.1.smithi133.stdout:8/351: chown d3/d7/l2b 265221162 1 2024-02-15T18:27:08.382 INFO:tasks.workunit.client.0.smithi084.stdout:3/672: creat d8/d40/d43/d71/d8c/d94/da3/de5/fe6 x:0 0 0 2024-02-15T18:27:08.382 INFO:tasks.workunit.client.1.smithi133.stdout:1/540: dread d6/d1e/d41/f46 [0,4194304] 0 2024-02-15T18:27:08.382 INFO:tasks.workunit.client.0.smithi084.stdout:3/673: truncate d8/d1f/dbf/f49 1071847 0 2024-02-15T18:27:08.383 INFO:tasks.workunit.client.1.smithi133.stdout:8/352: creat d3/d1f/d3f/d58/f78 x:0 0 0 2024-02-15T18:27:08.384 INFO:tasks.workunit.client.1.smithi133.stdout:8/353: readlink d3/d1c/d37/l6d 0 2024-02-15T18:27:08.384 INFO:tasks.workunit.client.1.smithi133.stdout:1/541: creat d6/d1e/d3a/d82/fc5 x:0 0 0 2024-02-15T18:27:08.385 INFO:tasks.workunit.client.0.smithi084.stdout:1/608: dread d9/d54/d1b/d2c/f43 [0,4194304] 0 2024-02-15T18:27:08.386 INFO:tasks.workunit.client.1.smithi133.stdout:8/354: unlink d3/d1c/d2f/f3b 0 2024-02-15T18:27:08.387 INFO:tasks.workunit.client.1.smithi133.stdout:1/542: truncate d6/d2a/f2f 1290256 0 2024-02-15T18:27:08.388 INFO:tasks.workunit.client.1.smithi133.stdout:8/355: rename d3/f4a to d3/d1c/d37/d5a/f79 0 2024-02-15T18:27:08.409 INFO:tasks.workunit.client.1.smithi133.stdout:9/316: dwrite d0/f20 [4194304,4194304] 0 2024-02-15T18:27:08.412 INFO:tasks.workunit.client.0.smithi084.stdout:1/609: dread d9/d54/d1b/d38/f4a [0,4194304] 0 2024-02-15T18:27:08.412 INFO:tasks.workunit.client.0.smithi084.stdout:1/610: fsync d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 0 2024-02-15T18:27:08.412 INFO:tasks.workunit.client.0.smithi084.stdout:3/674: fsync d8/d73/db9/dca/fe4 0 2024-02-15T18:27:08.412 INFO:tasks.workunit.client.1.smithi133.stdout:9/317: getdents d0/d8/d9/d49 0 2024-02-15T18:27:08.414 INFO:tasks.workunit.client.1.smithi133.stdout:9/318: write d0/f6 [135028,87400] 0 2024-02-15T18:27:08.415 INFO:tasks.workunit.client.0.smithi084.stdout:1/611: link d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f84 d9/d54/d1b/d2c/d4b/d4c/d79/fc5 0 2024-02-15T18:27:08.416 INFO:tasks.workunit.client.0.smithi084.stdout:1/612: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/dc6 0 2024-02-15T18:27:08.417 INFO:tasks.workunit.client.0.smithi084.stdout:1/613: mkdir d9/d54/d32/d5b/d69/dc7 0 2024-02-15T18:27:08.417 INFO:tasks.workunit.client.0.smithi084.stdout:1/614: truncate d9/d54/d32/d5b/d69/fb1 57139 0 2024-02-15T18:27:08.419 INFO:tasks.workunit.client.0.smithi084.stdout:1/615: dread d9/d54/d1b/d2c/d4b/d4c/f61 [0,4194304] 0 2024-02-15T18:27:08.426 INFO:tasks.workunit.client.1.smithi133.stdout:9/319: truncate d0/f20 1894809 0 2024-02-15T18:27:08.427 INFO:tasks.workunit.client.1.smithi133.stdout:9/320: creat d0/d8/d9/d12/f64 x:0 0 0 2024-02-15T18:27:08.432 INFO:tasks.workunit.client.1.smithi133.stdout:1/543: dwrite d6/d2a/f2f [0,4194304] 0 2024-02-15T18:27:08.435 INFO:tasks.workunit.client.0.smithi084.stdout:1/616: dread d9/f27 [0,4194304] 0 2024-02-15T18:27:08.437 INFO:tasks.workunit.client.1.smithi133.stdout:1/544: rename d6/d2a/c64 to d6/d2a/d59/d5a/da4/cc6 0 2024-02-15T18:27:08.439 INFO:tasks.workunit.client.1.smithi133.stdout:1/545: mkdir d6/d1e/d3a/d82/d85/dc7 0 2024-02-15T18:27:08.439 INFO:tasks.workunit.client.0.smithi084.stdout:1/617: read d9/d54/d1b/f91 [1569291,69774] 0 2024-02-15T18:27:08.439 INFO:tasks.workunit.client.0.smithi084.stdout:9/749: sync 2024-02-15T18:27:08.439 INFO:tasks.workunit.client.0.smithi084.stdout:7/612: sync 2024-02-15T18:27:08.441 INFO:tasks.workunit.client.1.smithi133.stdout:1/546: rename d6/d1e/f23 to d6/d1e/d3a/d79/dbd/dbe/fc8 0 2024-02-15T18:27:08.442 INFO:tasks.workunit.client.0.smithi084.stdout:1/618: truncate d9/d54/d1b/f53 2264472 0 2024-02-15T18:27:08.442 INFO:tasks.workunit.client.0.smithi084.stdout:1/619: chown d9/d54 1 1 2024-02-15T18:27:08.443 INFO:tasks.workunit.client.1.smithi133.stdout:1/547: creat d6/d1e/d41/d7c/d7e/fc9 x:0 0 0 2024-02-15T18:27:08.444 INFO:tasks.workunit.client.0.smithi084.stdout:7/613: write df/f63 [103324,106629] 0 2024-02-15T18:27:08.445 INFO:tasks.workunit.client.1.smithi133.stdout:1/548: creat d6/d1e/d3a/d82/d85/dc7/fca x:0 0 0 2024-02-15T18:27:08.446 INFO:tasks.workunit.client.1.smithi133.stdout:1/549: read d6/d1e/d3a/d82/d85/d67/f87 [1280078,51730] 0 2024-02-15T18:27:08.446 INFO:tasks.workunit.client.1.smithi133.stdout:1/550: stat d6/d2a/f40 0 2024-02-15T18:27:08.446 INFO:tasks.workunit.client.1.smithi133.stdout:1/551: write d6/d1e/d3a/d79/d8e/fb2 [722826,75441] 0 2024-02-15T18:27:08.446 INFO:tasks.workunit.client.0.smithi084.stdout:9/750: link d4/d36/l76 d4/d2b/d3c/d20/d75/d87/lf2 0 2024-02-15T18:27:08.448 INFO:tasks.workunit.client.1.smithi133.stdout:1/552: creat d6/d89/fcb x:0 0 0 2024-02-15T18:27:08.448 INFO:tasks.workunit.client.0.smithi084.stdout:7/614: symlink df/d1d/d1a/d6a/d8b/d7f/lc6 0 2024-02-15T18:27:08.448 INFO:tasks.workunit.client.0.smithi084.stdout:7/615: write df/d1d/d1a/f9d [749234,5271] 0 2024-02-15T18:27:08.449 INFO:tasks.workunit.client.0.smithi084.stdout:9/751: chown d4/d2b/d3c/d24/dca/d15/c5b 163029 1 2024-02-15T18:27:08.450 INFO:tasks.workunit.client.0.smithi084.stdout:7/616: rename df/d1d/d1a/d4d/d55/lc4 to df/d1d/d1a/d4d/d55/d88/lc7 0 2024-02-15T18:27:08.451 INFO:tasks.workunit.client.0.smithi084.stdout:7/617: fsync df/d1d/d1a/d6a/d8b/d48/f43 0 2024-02-15T18:27:08.451 INFO:tasks.workunit.client.0.smithi084.stdout:7/618: dread - df/d1d/d1a/d6a/d8e/d79/f8c zero size 2024-02-15T18:27:08.451 INFO:tasks.workunit.client.0.smithi084.stdout:9/752: creat d4/d2b/d3c/d20/ff3 x:0 0 0 2024-02-15T18:27:08.452 INFO:tasks.workunit.client.0.smithi084.stdout:7/619: creat df/d1d/d44/dbb/fc8 x:0 0 0 2024-02-15T18:27:08.452 INFO:tasks.workunit.client.0.smithi084.stdout:7/620: dread - df/d1d/d1a/d6a/d8e/faa zero size 2024-02-15T18:27:08.452 INFO:tasks.workunit.client.0.smithi084.stdout:7/621: getdents df/d1d/d1a/d4d/d55/d88/d98 0 2024-02-15T18:27:08.454 INFO:tasks.workunit.client.0.smithi084.stdout:7/622: write df/d1d/d1a/d6a/d8b/d7f/f9a [486476,25134] 0 2024-02-15T18:27:08.454 INFO:tasks.workunit.client.0.smithi084.stdout:9/753: rename d4/d2b/c35 to d4/d36/d6f/cf4 0 2024-02-15T18:27:08.455 INFO:tasks.workunit.client.0.smithi084.stdout:7/623: mkdir df/d1d/d1a/d6a/d8b/dc9 0 2024-02-15T18:27:08.456 INFO:tasks.workunit.client.1.smithi133.stdout:9/321: dwrite d0/d8/d9/f31 [0,4194304] 0 2024-02-15T18:27:08.457 INFO:tasks.workunit.client.0.smithi084.stdout:9/754: unlink d4/d2b/d3c/d24/dca/ff 0 2024-02-15T18:27:08.457 INFO:tasks.workunit.client.0.smithi084.stdout:9/755: fdatasync d4/fd6 0 2024-02-15T18:27:08.457 INFO:tasks.workunit.client.0.smithi084.stdout:7/624: write df/d1d/f3e [764302,88449] 0 2024-02-15T18:27:08.458 INFO:tasks.workunit.client.1.smithi133.stdout:9/322: read d0/d8/d10/f29 [8151056,5664] 0 2024-02-15T18:27:08.458 INFO:tasks.workunit.client.1.smithi133.stdout:1/553: dread d6/d2a/d59/d5a/f9b [0,4194304] 0 2024-02-15T18:27:08.458 INFO:tasks.workunit.client.0.smithi084.stdout:9/756: mknod d4/dc2/cf5 0 2024-02-15T18:27:08.458 INFO:tasks.workunit.client.1.smithi133.stdout:9/323: creat d0/d8/d9/f65 x:0 0 0 2024-02-15T18:27:08.461 INFO:tasks.workunit.client.1.smithi133.stdout:1/554: truncate d6/f16 1743654 0 2024-02-15T18:27:08.461 INFO:tasks.workunit.client.1.smithi133.stdout:1/555: dread - d6/d1e/d3a/fb9 zero size 2024-02-15T18:27:08.464 INFO:tasks.workunit.client.1.smithi133.stdout:9/324: getdents d0 0 2024-02-15T18:27:08.466 INFO:tasks.workunit.client.1.smithi133.stdout:1/556: mkdir d6/d1e/d41/dcc 0 2024-02-15T18:27:08.466 INFO:tasks.workunit.client.1.smithi133.stdout:1/557: dread - d6/d1e/d3a/d79/f93 zero size 2024-02-15T18:27:08.466 INFO:tasks.workunit.client.1.smithi133.stdout:1/558: write d6/f2d [1073849,17873] 0 2024-02-15T18:27:08.466 INFO:tasks.workunit.client.1.smithi133.stdout:1/559: fsync f2 0 2024-02-15T18:27:08.466 INFO:tasks.workunit.client.1.smithi133.stdout:1/560: write d6/d2a/f2c [412381,78508] 0 2024-02-15T18:27:08.466 INFO:tasks.workunit.client.1.smithi133.stdout:1/561: write d6/d1e/d3a/d79/dbd/dbe/fc3 [669011,93782] 0 2024-02-15T18:27:08.467 INFO:tasks.workunit.client.1.smithi133.stdout:9/325: rename d0/d8/d9/f65 to d0/d8/d10/d4d/f66 0 2024-02-15T18:27:08.468 INFO:tasks.workunit.client.1.smithi133.stdout:1/562: creat d6/d1e/d41/dcc/fcd x:0 0 0 2024-02-15T18:27:08.469 INFO:tasks.workunit.client.1.smithi133.stdout:1/563: creat d6/d1e/d3a/d75/fce x:0 0 0 2024-02-15T18:27:08.470 INFO:tasks.workunit.client.1.smithi133.stdout:1/564: symlink d6/d1e/d41/d7c/lcf 0 2024-02-15T18:27:08.471 INFO:tasks.workunit.client.0.smithi084.stdout:1/620: dwrite d9/d54/d1b/d2c/d35/f72 [0,4194304] 0 2024-02-15T18:27:08.471 INFO:tasks.workunit.client.1.smithi133.stdout:9/326: dread d0/d8/f56 [0,4194304] 0 2024-02-15T18:27:08.471 INFO:tasks.workunit.client.1.smithi133.stdout:9/327: fdatasync d0/f20 0 2024-02-15T18:27:08.471 INFO:tasks.workunit.client.1.smithi133.stdout:1/565: creat d6/d1e/d3a/d79/d8e/fd0 x:0 0 0 2024-02-15T18:27:08.472 INFO:tasks.workunit.client.1.smithi133.stdout:1/566: chown d6/d1e/d3a/d82/d85/dc7 66 1 2024-02-15T18:27:08.472 INFO:tasks.workunit.client.0.smithi084.stdout:7/625: dwrite df/f14 [0,4194304] 0 2024-02-15T18:27:08.472 INFO:tasks.workunit.client.1.smithi133.stdout:9/328: rename d0/d8/d10/l2d to d0/d8/d10/l67 0 2024-02-15T18:27:08.475 INFO:tasks.workunit.client.1.smithi133.stdout:1/567: unlink d6/d1e/d3a/d82/d85/c91 0 2024-02-15T18:27:08.475 INFO:tasks.workunit.client.1.smithi133.stdout:1/568: dread - d6/d1e/d3a/d97/fa1 zero size 2024-02-15T18:27:08.478 INFO:tasks.workunit.client.1.smithi133.stdout:9/329: symlink d0/d8/d9/d12/d2a/l68 0 2024-02-15T18:27:08.479 INFO:tasks.workunit.client.1.smithi133.stdout:1/569: mknod d6/d89/cd1 0 2024-02-15T18:27:08.480 INFO:tasks.workunit.client.1.smithi133.stdout:9/330: write d0/d8/d10/f30 [2690156,104538] 0 2024-02-15T18:27:08.481 INFO:tasks.workunit.client.0.smithi084.stdout:1/621: dread d9/d54/f99 [0,4194304] 0 2024-02-15T18:27:08.481 INFO:tasks.workunit.client.0.smithi084.stdout:7/626: dread df/d1d/d1a/d6a/d8b/d7f/f9a [0,4194304] 0 2024-02-15T18:27:08.482 INFO:tasks.workunit.client.1.smithi133.stdout:1/570: creat d6/d1e/d3a/d82/d85/dc7/fd2 x:0 0 0 2024-02-15T18:27:08.482 INFO:tasks.workunit.client.1.smithi133.stdout:1/571: getdents d6/d2a/d59/d5a/da4/daa 0 2024-02-15T18:27:08.482 INFO:tasks.workunit.client.1.smithi133.stdout:1/572: truncate d6/fc 4606295 0 2024-02-15T18:27:08.482 INFO:tasks.workunit.client.1.smithi133.stdout:9/331: truncate d0/f7 344637 0 2024-02-15T18:27:08.483 INFO:tasks.workunit.client.1.smithi133.stdout:1/573: truncate d6/d89/f81 21045 0 2024-02-15T18:27:08.483 INFO:tasks.workunit.client.1.smithi133.stdout:1/574: write d6/d1e/d41/d7c/f8c [490410,109239] 0 2024-02-15T18:27:08.485 INFO:tasks.workunit.client.0.smithi084.stdout:1/622: unlink d9/f9d 0 2024-02-15T18:27:08.486 INFO:tasks.workunit.client.1.smithi133.stdout:9/332: unlink d0/d8/d9/d3c/l46 0 2024-02-15T18:27:08.486 INFO:tasks.workunit.client.1.smithi133.stdout:1/575: mkdir d6/d1e/d3a/d82/d85/d67/dd3 0 2024-02-15T18:27:08.486 INFO:tasks.workunit.client.1.smithi133.stdout:1/576: symlink d6/d1e/d41/d7c/d7e/d7f/ld4 0 2024-02-15T18:27:08.487 INFO:tasks.workunit.client.0.smithi084.stdout:7/627: mkdir df/d1d/d1a/d6a/d8b/d48/dca 0 2024-02-15T18:27:08.487 INFO:tasks.workunit.client.0.smithi084.stdout:7/628: chown df/d1d/d1a/d4d/f78 58696665 1 2024-02-15T18:27:08.487 INFO:tasks.workunit.client.0.smithi084.stdout:1/623: rmdir d9/d54/d1b/d2c/d4b/d4c/d79 39 2024-02-15T18:27:08.489 INFO:tasks.workunit.client.0.smithi084.stdout:7/629: symlink df/d1d/d1a/d4b/lcb 0 2024-02-15T18:27:08.490 INFO:tasks.workunit.client.0.smithi084.stdout:1/624: creat d9/d54/d7f/db7/fc8 x:0 0 0 2024-02-15T18:27:08.490 INFO:tasks.workunit.client.0.smithi084.stdout:1/625: chown d9/d54/d1b/d2c/d4b/d7a/d89 11 1 2024-02-15T18:27:08.491 INFO:tasks.workunit.client.0.smithi084.stdout:1/626: write d9/d54/d1b/f91 [1477595,85273] 0 2024-02-15T18:27:08.491 INFO:tasks.workunit.client.0.smithi084.stdout:1/627: dread - d9/d54/d76/f80 zero size 2024-02-15T18:27:08.494 INFO:tasks.workunit.client.1.smithi133.stdout:1/577: creat d6/d1e/d41/d7c/d7e/d7f/fd5 x:0 0 0 2024-02-15T18:27:08.495 INFO:tasks.workunit.client.1.smithi133.stdout:1/578: symlink d6/d1e/d3a/d79/dbd/dbe/ld6 0 2024-02-15T18:27:08.495 INFO:tasks.workunit.client.1.smithi133.stdout:1/579: write d6/d1e/d3a/d82/fc5 [672656,14287] 0 2024-02-15T18:27:08.495 INFO:tasks.workunit.client.1.smithi133.stdout:3/411: sync 2024-02-15T18:27:08.496 INFO:tasks.workunit.client.1.smithi133.stdout:5/312: sync 2024-02-15T18:27:08.497 INFO:tasks.workunit.client.0.smithi084.stdout:7/630: rename f0 to df/d1d/d1a/d6a/d8b/da5/db6/fcc 0 2024-02-15T18:27:08.499 INFO:tasks.workunit.client.1.smithi133.stdout:3/412: truncate d0/d15/d2b/f5c 453637 0 2024-02-15T18:27:08.499 INFO:tasks.workunit.client.1.smithi133.stdout:5/313: link d17/d20/c5b d17/d26/c6b 0 2024-02-15T18:27:08.500 INFO:tasks.workunit.client.1.smithi133.stdout:3/413: symlink d0/d15/l80 0 2024-02-15T18:27:08.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/414: truncate d0/d15/d2b/d39/d3f/f22 1254961 0 2024-02-15T18:27:08.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/415: dread - d0/d15/d2b/d39/d3f/d3e/f7e zero size 2024-02-15T18:27:08.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/416: truncate d0/d15/d2b/f7a 393902 0 2024-02-15T18:27:08.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/417: chown d0/d15/d2b/d39/d3f/l11 263268 1 2024-02-15T18:27:08.504 INFO:tasks.workunit.client.1.smithi133.stdout:1/580: dread d6/d1e/d3a/f61 [0,4194304] 0 2024-02-15T18:27:08.506 INFO:tasks.workunit.client.1.smithi133.stdout:3/418: creat d0/d15/d2b/d72/f81 x:0 0 0 2024-02-15T18:27:08.511 INFO:tasks.workunit.client.1.smithi133.stdout:9/333: dwrite d0/d8/d9/ff [0,4194304] 0 2024-02-15T18:27:08.512 INFO:tasks.workunit.client.0.smithi084.stdout:7/631: creat df/d1d/d1a/d6a/d8b/fcd x:0 0 0 2024-02-15T18:27:08.512 INFO:tasks.workunit.client.0.smithi084.stdout:7/632: read - df/d1d/d44/fbf zero size 2024-02-15T18:27:08.517 INFO:tasks.workunit.client.1.smithi133.stdout:5/314: dread d17/d2a/f42 [0,4194304] 0 2024-02-15T18:27:08.521 INFO:tasks.workunit.client.0.smithi084.stdout:1/628: dwrite d9/d54/d7f/db7/fc8 [0,4194304] 0 2024-02-15T18:27:08.522 INFO:tasks.workunit.client.1.smithi133.stdout:5/315: dread d17/f46 [0,4194304] 0 2024-02-15T18:27:08.522 INFO:tasks.workunit.client.1.smithi133.stdout:1/581: dread d6/d1e/d3a/d82/d85/f83 [0,4194304] 0 2024-02-15T18:27:08.522 INFO:tasks.workunit.client.1.smithi133.stdout:5/316: chown d17/d26/c34 6838311 1 2024-02-15T18:27:08.524 INFO:tasks.workunit.client.1.smithi133.stdout:5/317: rmdir d17/d20/d4f/d5f 39 2024-02-15T18:27:08.525 INFO:tasks.workunit.client.1.smithi133.stdout:1/582: symlink d6/d1e/d41/dcc/ld7 0 2024-02-15T18:27:08.525 INFO:tasks.workunit.client.0.smithi084.stdout:7/633: dread df/d1d/d1a/d4d/f67 [0,4194304] 0 2024-02-15T18:27:08.525 INFO:tasks.workunit.client.0.smithi084.stdout:7/634: chown df/d1d/d44/d8d/f8f 1 1 2024-02-15T18:27:08.526 INFO:tasks.workunit.client.1.smithi133.stdout:5/318: rmdir d17/d20 39 2024-02-15T18:27:08.527 INFO:tasks.workunit.client.1.smithi133.stdout:3/419: dwrite d0/d15/d2b/f41 [0,4194304] 0 2024-02-15T18:27:08.527 INFO:tasks.workunit.client.1.smithi133.stdout:1/583: write d6/d2a/d59/d5a/f71 [1011284,3948] 0 2024-02-15T18:27:08.527 INFO:tasks.workunit.client.1.smithi133.stdout:1/584: dread - d6/d1e/d3a/d82/d85/dc7/fca zero size 2024-02-15T18:27:08.529 INFO:tasks.workunit.client.1.smithi133.stdout:8/356: sync 2024-02-15T18:27:08.530 INFO:tasks.workunit.client.1.smithi133.stdout:2/398: sync 2024-02-15T18:27:08.530 INFO:tasks.workunit.client.1.smithi133.stdout:7/229: sync 2024-02-15T18:27:08.530 INFO:tasks.workunit.client.1.smithi133.stdout:6/527: sync 2024-02-15T18:27:08.530 INFO:tasks.workunit.client.1.smithi133.stdout:4/286: sync 2024-02-15T18:27:08.530 INFO:tasks.workunit.client.1.smithi133.stdout:0/373: sync 2024-02-15T18:27:08.530 INFO:tasks.workunit.client.1.smithi133.stdout:0/374: chown d9/d2b/f45 247574900 1 2024-02-15T18:27:08.531 INFO:tasks.workunit.client.1.smithi133.stdout:7/230: write d9/d36/f23 [255743,47776] 0 2024-02-15T18:27:08.532 INFO:tasks.workunit.client.0.smithi084.stdout:1/629: mknod d9/d54/d1b/d38/d4d/cc9 0 2024-02-15T18:27:08.533 INFO:tasks.workunit.client.1.smithi133.stdout:3/420: rename d0/d15/c65 to d0/d15/d2b/d62/d74/c82 0 2024-02-15T18:27:08.533 INFO:tasks.workunit.client.1.smithi133.stdout:5/319: mknod d17/d20/d32/d38/c6c 0 2024-02-15T18:27:08.534 INFO:tasks.workunit.client.0.smithi084.stdout:7/635: rmdir df/d70 39 2024-02-15T18:27:08.535 INFO:tasks.workunit.client.1.smithi133.stdout:2/399: creat d7/db/d67/f80 x:0 0 0 2024-02-15T18:27:08.535 INFO:tasks.workunit.client.1.smithi133.stdout:4/287: creat d2/d5/d2b/d21/d3b/d49/f69 x:0 0 0 2024-02-15T18:27:08.538 INFO:tasks.workunit.client.1.smithi133.stdout:7/231: mknod d9/d36/d39/c4d 0 2024-02-15T18:27:08.538 INFO:tasks.workunit.client.1.smithi133.stdout:4/288: write d2/d5/d2b/d21/f31 [1129517,62843] 0 2024-02-15T18:27:08.539 INFO:tasks.workunit.client.1.smithi133.stdout:1/585: dread d6/d1e/d3a/d82/d85/f45 [0,4194304] 0 2024-02-15T18:27:08.539 INFO:tasks.workunit.client.1.smithi133.stdout:3/421: mkdir d0/d15/d2b/d62/d74/d78/d83 0 2024-02-15T18:27:08.539 INFO:tasks.workunit.client.1.smithi133.stdout:3/422: write d0/d15/f6d [923967,15199] 0 2024-02-15T18:27:08.539 INFO:tasks.workunit.client.1.smithi133.stdout:2/400: rmdir d7/d18/d32/d65/d58 39 2024-02-15T18:27:08.540 INFO:tasks.workunit.client.0.smithi084.stdout:1/630: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/cca 0 2024-02-15T18:27:08.541 INFO:tasks.workunit.client.1.smithi133.stdout:1/586: write d6/d2a/f2c [41947,128818] 0 2024-02-15T18:27:08.541 INFO:tasks.workunit.client.1.smithi133.stdout:1/587: write d6/d1e/d41/d7c/d7e/d7f/fd5 [472439,80819] 0 2024-02-15T18:27:08.542 INFO:tasks.workunit.client.1.smithi133.stdout:4/289: unlink d2/f12 0 2024-02-15T18:27:08.542 INFO:tasks.workunit.client.1.smithi133.stdout:3/423: mknod d0/d15/d2b/d62/c84 0 2024-02-15T18:27:08.543 INFO:tasks.workunit.client.1.smithi133.stdout:2/401: creat d7/d2c/d31/f81 x:0 0 0 2024-02-15T18:27:08.543 INFO:tasks.workunit.client.1.smithi133.stdout:8/357: dread d3/f4 [0,4194304] 0 2024-02-15T18:27:08.543 INFO:tasks.workunit.client.1.smithi133.stdout:1/588: link d6/d1e/d3a/d9e/cb8 d6/d1e/d3a/d82/d85/dc7/cd8 0 2024-02-15T18:27:08.544 INFO:tasks.workunit.client.1.smithi133.stdout:3/424: symlink d0/d15/d2b/d39/d3f/d3e/l85 0 2024-02-15T18:27:08.548 INFO:tasks.workunit.client.1.smithi133.stdout:2/402: rename d7/d2c/d46/l77 to d7/d2c/d5a/l82 0 2024-02-15T18:27:08.548 INFO:tasks.workunit.client.1.smithi133.stdout:2/403: chown d7/d2c 75 1 2024-02-15T18:27:08.549 INFO:tasks.workunit.client.1.smithi133.stdout:7/232: dread d9/d36/f2e [0,4194304] 0 2024-02-15T18:27:08.551 INFO:tasks.workunit.client.1.smithi133.stdout:8/358: dread d3/d1c/f1e [8388608,4194304] 0 2024-02-15T18:27:08.552 INFO:tasks.workunit.client.1.smithi133.stdout:1/589: truncate d6/d17/f18 1979513 0 2024-02-15T18:27:08.552 INFO:tasks.workunit.client.1.smithi133.stdout:1/590: chown d6/d17/f1d 116750 1 2024-02-15T18:27:08.552 INFO:tasks.workunit.client.1.smithi133.stdout:1/591: write d6/f4b [330817,69483] 0 2024-02-15T18:27:08.552 INFO:tasks.workunit.client.1.smithi133.stdout:1/592: truncate d6/f24 4225538 0 2024-02-15T18:27:08.554 INFO:tasks.workunit.client.1.smithi133.stdout:3/425: creat d0/d15/d37/f86 x:0 0 0 2024-02-15T18:27:08.556 INFO:tasks.workunit.client.0.smithi084.stdout:7/636: write df/d1d/d1a/f26 [156409,56339] 0 2024-02-15T18:27:08.558 INFO:tasks.workunit.client.1.smithi133.stdout:2/404: creat d7/d18/d32/d65/d54/f83 x:0 0 0 2024-02-15T18:27:08.559 INFO:tasks.workunit.client.1.smithi133.stdout:8/359: truncate d3/d1c/d37/d5a/f79 2133870 0 2024-02-15T18:27:08.559 INFO:tasks.workunit.client.1.smithi133.stdout:8/360: readlink d3/d7/l5f 0 2024-02-15T18:27:08.559 INFO:tasks.workunit.client.1.smithi133.stdout:8/361: fdatasync d3/d1f/f31 0 2024-02-15T18:27:08.559 INFO:tasks.workunit.client.1.smithi133.stdout:8/362: dread - d3/d1c/d2f/d76/f77 zero size 2024-02-15T18:27:08.559 INFO:tasks.workunit.client.1.smithi133.stdout:1/593: mknod d6/d1e/d3a/d82/d85/d67/da6/cd9 0 2024-02-15T18:27:08.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/426: mknod d0/d15/d2b/d39/c87 0 2024-02-15T18:27:08.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/427: truncate d0/d15/d2b/d39/f75 547298 0 2024-02-15T18:27:08.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/428: write d0/d15/d2f/f68 [601120,2218] 0 2024-02-15T18:27:08.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/429: fdatasync d0/f3a 0 2024-02-15T18:27:08.561 INFO:tasks.workunit.client.1.smithi133.stdout:6/528: dwrite d0/db/d21/f77 [0,4194304] 0 2024-02-15T18:27:08.561 INFO:tasks.workunit.client.1.smithi133.stdout:5/320: dwrite f10 [0,4194304] 0 2024-02-15T18:27:08.561 INFO:tasks.workunit.client.1.smithi133.stdout:0/375: dwrite d9/ff [0,4194304] 0 2024-02-15T18:27:08.562 INFO:tasks.workunit.client.1.smithi133.stdout:4/290: dread d2/d5/d2b/d21/d2d/f2e [0,4194304] 0 2024-02-15T18:27:08.562 INFO:tasks.workunit.client.1.smithi133.stdout:4/291: chown d2/d5/d2b/l2c 42363165 1 2024-02-15T18:27:08.563 INFO:tasks.workunit.client.1.smithi133.stdout:8/363: rename d3/de/l6b to d3/d1f/d4f/l7a 0 2024-02-15T18:27:08.564 INFO:tasks.workunit.client.1.smithi133.stdout:1/594: mkdir d6/d1e/d3a/d97/dda 0 2024-02-15T18:27:08.565 INFO:tasks.workunit.client.0.smithi084.stdout:8/706: sync 2024-02-15T18:27:08.566 INFO:tasks.workunit.client.1.smithi133.stdout:5/321: creat d17/f6d x:0 0 0 2024-02-15T18:27:08.567 INFO:tasks.workunit.client.1.smithi133.stdout:6/529: dread d0/db/d29/d34/d5d/d40/f7a [0,4194304] 0 2024-02-15T18:27:08.570 INFO:tasks.workunit.client.1.smithi133.stdout:4/292: mkdir d2/d48/d6a 0 2024-02-15T18:27:08.570 INFO:tasks.workunit.client.1.smithi133.stdout:8/364: truncate d3/d1f/d3f/f74 2550131 0 2024-02-15T18:27:08.570 INFO:tasks.workunit.client.1.smithi133.stdout:0/376: symlink d9/d2b/l80 0 2024-02-15T18:27:08.570 INFO:tasks.workunit.client.1.smithi133.stdout:0/377: truncate d9/d10/d47/f62 1660356 0 2024-02-15T18:27:08.570 INFO:tasks.workunit.client.1.smithi133.stdout:4/293: write d2/f1f [4480901,101697] 0 2024-02-15T18:27:08.570 INFO:tasks.workunit.client.1.smithi133.stdout:4/294: chown d2/d5/d2b/d21/d2d/d44/d51/d60/d63 502082 1 2024-02-15T18:27:08.570 INFO:tasks.workunit.client.1.smithi133.stdout:1/595: mkdir d6/d1e/d3a/d82/d85/d67/ddb 0 2024-02-15T18:27:08.571 INFO:tasks.workunit.client.0.smithi084.stdout:4/736: sync 2024-02-15T18:27:08.571 INFO:tasks.workunit.client.0.smithi084.stdout:4/737: chown d2/d4/d28/d3d 818452 1 2024-02-15T18:27:08.571 INFO:tasks.workunit.client.0.smithi084.stdout:4/738: write d2/d2b/d47/f7a [784351,113162] 0 2024-02-15T18:27:08.571 INFO:tasks.workunit.client.0.smithi084.stdout:4/739: fsync d2/f5e 0 2024-02-15T18:27:08.571 INFO:tasks.workunit.client.0.smithi084.stdout:0/654: sync 2024-02-15T18:27:08.571 INFO:tasks.workunit.client.0.smithi084.stdout:0/655: truncate d0/d25/f34 119004 0 2024-02-15T18:27:08.571 INFO:tasks.workunit.client.0.smithi084.stdout:8/707: rename db/dd/d13/f8c to db/dd/d1f/d56/fe9 0 2024-02-15T18:27:08.572 INFO:tasks.workunit.client.1.smithi133.stdout:5/322: link d17/d26/f63 d17/f6e 0 2024-02-15T18:27:08.572 INFO:tasks.workunit.client.1.smithi133.stdout:5/323: write d17/d20/f23 [622128,62508] 0 2024-02-15T18:27:08.572 INFO:tasks.workunit.client.1.smithi133.stdout:5/324: write d17/d26/f5d [439614,92202] 0 2024-02-15T18:27:08.573 INFO:tasks.workunit.client.1.smithi133.stdout:6/530: mknod d0/d3b/d67/cb0 0 2024-02-15T18:27:08.574 INFO:tasks.workunit.client.1.smithi133.stdout:5/325: write d17/d2a/f42 [817868,92296] 0 2024-02-15T18:27:08.574 INFO:tasks.workunit.client.1.smithi133.stdout:8/365: creat d3/d1c/d37/f7b x:0 0 0 2024-02-15T18:27:08.574 INFO:tasks.workunit.client.1.smithi133.stdout:8/366: chown d3/d1f/l4c 7245778 1 2024-02-15T18:27:08.574 INFO:tasks.workunit.client.1.smithi133.stdout:8/367: chown d3/l48 15466884 1 2024-02-15T18:27:08.576 INFO:tasks.workunit.client.1.smithi133.stdout:0/378: mknod d9/d10/d47/d5e/c81 0 2024-02-15T18:27:08.576 INFO:tasks.workunit.client.1.smithi133.stdout:4/295: mkdir d2/d5/d2b/d21/d2d/d44/d6b 0 2024-02-15T18:27:08.576 INFO:tasks.workunit.client.1.smithi133.stdout:0/379: chown d9/d28/f36 507 1 2024-02-15T18:27:08.576 INFO:tasks.workunit.client.1.smithi133.stdout:0/380: fsync f5 0 2024-02-15T18:27:08.579 INFO:tasks.workunit.client.1.smithi133.stdout:4/296: creat d2/d5/d2b/d21/d2d/d44/d51/d55/f6c x:0 0 0 2024-02-15T18:27:08.584 INFO:tasks.workunit.client.1.smithi133.stdout:4/297: mknod d2/d5/d2b/c6d 0 2024-02-15T18:27:08.585 INFO:tasks.workunit.client.1.smithi133.stdout:4/298: chown d2/d5/d2b/d21/d2d/f3c 11 1 2024-02-15T18:27:08.587 INFO:tasks.workunit.client.1.smithi133.stdout:4/299: write d2/d5/d2b/d21/d2d/d44/f47 [470777,74325] 0 2024-02-15T18:27:08.588 INFO:tasks.workunit.client.1.smithi133.stdout:4/300: symlink d2/d5/d2b/d21/d2d/d44/d51/d55/d5e/l6e 0 2024-02-15T18:27:08.593 INFO:tasks.workunit.client.1.smithi133.stdout:6/531: dread d0/db/d21/f3c [0,4194304] 0 2024-02-15T18:27:08.593 INFO:tasks.workunit.client.1.smithi133.stdout:6/532: fsync d0/d3b/d52/f58 0 2024-02-15T18:27:08.593 INFO:tasks.workunit.client.1.smithi133.stdout:6/533: chown d0/d3b/d85/l8f 408 1 2024-02-15T18:27:08.593 INFO:tasks.workunit.client.1.smithi133.stdout:6/534: truncate d0/d3b/d52/f59 537434 0 2024-02-15T18:27:08.593 INFO:tasks.workunit.client.1.smithi133.stdout:6/535: truncate d0/db/f4f 476973 0 2024-02-15T18:27:08.598 INFO:tasks.workunit.client.1.smithi133.stdout:6/536: dread d0/f24 [4194304,4194304] 0 2024-02-15T18:27:08.600 INFO:tasks.workunit.client.1.smithi133.stdout:6/537: mkdir d0/d3b/db1 0 2024-02-15T18:27:08.600 INFO:tasks.workunit.client.1.smithi133.stdout:6/538: stat d0/f32 0 2024-02-15T18:27:08.601 INFO:tasks.workunit.client.0.smithi084.stdout:7/637: dwrite df/d1d/d44/d8d/fb3 [0,4194304] 0 2024-02-15T18:27:08.601 INFO:tasks.workunit.client.0.smithi084.stdout:7/638: write df/fa8 [1140304,24264] 0 2024-02-15T18:27:08.604 INFO:tasks.workunit.client.1.smithi133.stdout:5/326: dwrite d17/f36 [0,4194304] 0 2024-02-15T18:27:08.604 INFO:tasks.workunit.client.1.smithi133.stdout:5/327: stat d17/d20/c30 0 2024-02-15T18:27:08.604 INFO:tasks.workunit.client.1.smithi133.stdout:5/328: fsync d17/f4a 0 2024-02-15T18:27:08.604 INFO:tasks.workunit.client.1.smithi133.stdout:5/329: chown d17/d26/c65 19302125 1 2024-02-15T18:27:08.604 INFO:tasks.workunit.client.1.smithi133.stdout:8/368: dread d3/f2e [0,4194304] 0 2024-02-15T18:27:08.604 INFO:tasks.workunit.client.1.smithi133.stdout:8/369: write d3/d1c/d2f/d76/f77 [200374,37031] 0 2024-02-15T18:27:08.605 INFO:tasks.workunit.client.0.smithi084.stdout:7/639: getdents df/d1d/d1a 0 2024-02-15T18:27:08.605 INFO:tasks.workunit.client.0.smithi084.stdout:7/640: creat df/d1d/d1a/d6a/d8e/fce x:0 0 0 2024-02-15T18:27:08.605 INFO:tasks.workunit.client.0.smithi084.stdout:7/641: readlink df/d1d/d1a/d6a/d8b/d7f/lc6 0 2024-02-15T18:27:08.605 INFO:tasks.workunit.client.0.smithi084.stdout:7/642: chown df/f32 2223713 1 2024-02-15T18:27:08.605 INFO:tasks.workunit.client.0.smithi084.stdout:7/643: truncate df/d1d/d44/dbb/fc8 1005120 0 2024-02-15T18:27:08.606 INFO:tasks.workunit.client.1.smithi133.stdout:2/405: rmdir d7/d2c/d5a 39 2024-02-15T18:27:08.606 INFO:tasks.workunit.client.0.smithi084.stdout:7/644: mknod df/d1d/d1a/d6a/d8b/d48/ccf 0 2024-02-15T18:27:08.606 INFO:tasks.workunit.client.0.smithi084.stdout:1/631: dwrite d9/d54/d1b/d2c/f31 [0,4194304] 0 2024-02-15T18:27:08.606 INFO:tasks.workunit.client.1.smithi133.stdout:7/233: dwrite d9/db/d16/f4b [0,4194304] 0 2024-02-15T18:27:08.609 INFO:tasks.workunit.client.0.smithi084.stdout:1/632: rename d9/d54/d32/cad to d9/d54/d1b/d2c/d4b/d4c/da9/ccb 0 2024-02-15T18:27:08.610 INFO:tasks.workunit.client.1.smithi133.stdout:3/430: dwrite d0/d15/d2b/d62/f71 [0,4194304] 0 2024-02-15T18:27:08.610 INFO:tasks.workunit.client.0.smithi084.stdout:1/633: mkdir d9/d54/d76/dcc 0 2024-02-15T18:27:08.612 INFO:tasks.workunit.client.0.smithi084.stdout:1/634: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/lcd 0 2024-02-15T18:27:08.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.617+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9380000b90 con 0x7f9384060fb0 2024-02-15T18:27:08.614 INFO:tasks.workunit.client.1.smithi133.stdout:0/381: dwrite d9/d10/d22/d32/f64 [0,4194304] 0 2024-02-15T18:27:08.615 INFO:tasks.workunit.client.0.smithi084.stdout:0/656: dread d0/f95 [0,4194304] 0 2024-02-15T18:27:08.615 INFO:tasks.workunit.client.0.smithi084.stdout:0/657: dread - d0/d2f/d3f/d4f/d59/da7/fc2 zero size 2024-02-15T18:27:08.615 INFO:tasks.workunit.client.0.smithi084.stdout:1/635: link d9/d54/d1b/d2c/d4b/d4c/d79/l6b d9/d54/d5c/lce 0 2024-02-15T18:27:08.615 INFO:tasks.workunit.client.0.smithi084.stdout:1/636: fdatasync d9/d54/d1b/f70 0 2024-02-15T18:27:08.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.619+0000 7f938e7fc700 1 -- 172.21.15.84:0/2271206920 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9380000b90 con 0x7f9384060fb0 2024-02-15T18:27:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.622+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9384060fb0 msgr2=0x7f9384063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.622+0000 7f939fd5d700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9384060fb0 0x7f9384063470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9394005010 tx=0x7f9394009b30).stop 2024-02-15T18:27:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.622+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93980f9820 msgr2=0x7f93981074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.622+0000 7f939fd5d700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93980f9820 0x7f93981074e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f9388004fa0 tx=0x7f9388009d60).stop 2024-02-15T18:27:08.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.622+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 shutdown_connections 2024-02-15T18:27:08.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.622+0000 7f939fd5d700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9384060fb0 0x7f9384063470 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.622+0000 7f939fd5d700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9398060310 0x7f9398106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.622+0000 7f939fd5d700 1 --2- 172.21.15.84:0/2271206920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93980f9820 0x7f93981074e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.622+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 >> 172.21.15.84:0/2271206920 conn(0x7f93980f0d40 msgr2=0x7f93980f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:08.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.623+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 shutdown_connections 2024-02-15T18:27:08.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.623+0000 7f939fd5d700 1 -- 172.21.15.84:0/2271206920 wait complete. 2024-02-15T18:27:08.620 INFO:tasks.workunit.client.1.smithi133.stdout:6/539: creat d0/fb2 x:0 0 0 2024-02-15T18:27:08.621 INFO:tasks.workunit.client.0.smithi084.stdout:1/637: creat d9/d54/d1b/fcf x:0 0 0 2024-02-15T18:27:08.622 INFO:tasks.workunit.client.1.smithi133.stdout:8/370: rename d3/d7/l29 to d3/d1c/l7c 0 2024-02-15T18:27:08.622 INFO:tasks.workunit.client.1.smithi133.stdout:8/371: chown d3/d1f/d3f/d58/c5b 426 1 2024-02-15T18:27:08.623 INFO:tasks.workunit.client.1.smithi133.stdout:2/406: creat d7/d18/d32/d65/d58/f84 x:0 0 0 2024-02-15T18:27:08.623 INFO:tasks.workunit.client.1.smithi133.stdout:2/407: chown d7/d18/d32/d65/d54/c5e 1640148036 1 2024-02-15T18:27:08.624 INFO:tasks.workunit.client.1.smithi133.stdout:7/234: mknod d9/d36/d3d/d4c/c4e 0 2024-02-15T18:27:08.631 INFO:tasks.workunit.client.0.smithi084.stdout:0/658: dread d0/d2f/d3f/d4c/d9a/fa3 [0,4194304] 0 2024-02-15T18:27:08.633 INFO:tasks.workunit.client.0.smithi084.stdout:0/659: symlink d0/d4/da8/lc8 0 2024-02-15T18:27:08.636 INFO:tasks.workunit.client.0.smithi084.stdout:0/660: mkdir d0/d4/da8/dc9 0 2024-02-15T18:27:08.636 INFO:tasks.workunit.client.0.smithi084.stdout:7/645: dwrite df/d1d/d1a/f26 [4194304,4194304] 0 2024-02-15T18:27:08.638 INFO:tasks.workunit.client.1.smithi133.stdout:3/431: dwrite d0/d15/d2b/d39/f75 [0,4194304] 0 2024-02-15T18:27:08.639 INFO:tasks.workunit.client.0.smithi084.stdout:0/661: dread d0/d25/f34 [0,4194304] 0 2024-02-15T18:27:08.643 INFO:tasks.workunit.client.0.smithi084.stdout:0/662: stat d0/d2f/d3f/lac 0 2024-02-15T18:27:08.647 INFO:tasks.workunit.client.0.smithi084.stdout:6/674: sync 2024-02-15T18:27:08.647 INFO:tasks.workunit.client.0.smithi084.stdout:5/752: sync 2024-02-15T18:27:08.647 INFO:tasks.workunit.client.0.smithi084.stdout:6/675: write d14/d22/d25/d2f/d31/d30/d4f/d7f/fb5 [43662,68043] 0 2024-02-15T18:27:08.647 INFO:tasks.workunit.client.0.smithi084.stdout:6/676: write d14/d22/d25/d2f/d31/d30/d4f/d7f/fb5 [175080,113928] 0 2024-02-15T18:27:08.647 INFO:tasks.workunit.client.0.smithi084.stdout:6/677: chown d14/d22/d25/f2b 47606 1 2024-02-15T18:27:08.648 INFO:tasks.workunit.client.1.smithi133.stdout:0/382: mkdir d9/d10/d22/d32/d7f/d82 0 2024-02-15T18:27:08.649 INFO:tasks.workunit.client.0.smithi084.stdout:5/753: mknod d9/d35/d65/d7f/dd1/cf8 0 2024-02-15T18:27:08.652 INFO:tasks.workunit.client.1.smithi133.stdout:5/330: symlink d17/d20/d32/d38/l6f 0 2024-02-15T18:27:08.652 INFO:tasks.workunit.client.0.smithi084.stdout:5/754: mknod d9/d5f/d68/d9a/d8d/cf9 0 2024-02-15T18:27:08.652 INFO:tasks.workunit.client.0.smithi084.stdout:5/755: truncate d9/d35/d65/d7f/f80 551830 0 2024-02-15T18:27:08.653 INFO:tasks.workunit.client.0.smithi084.stdout:5/756: chown d9/da/d3d/f50 1324840639 1 2024-02-15T18:27:08.654 INFO:tasks.workunit.client.1.smithi133.stdout:6/540: rename d0/d3b/d41 to d0/d3b/d9d/db3 0 2024-02-15T18:27:08.654 INFO:tasks.workunit.client.1.smithi133.stdout:2/408: getdents d7/db/d35 0 2024-02-15T18:27:08.656 INFO:tasks.workunit.client.0.smithi084.stdout:5/757: write d9/d5b/d7e/db5/fd2 [2573507,2239] 0 2024-02-15T18:27:08.657 INFO:tasks.workunit.client.1.smithi133.stdout:2/409: dread d7/d2c/f68 [0,4194304] 0 2024-02-15T18:27:08.657 INFO:tasks.workunit.client.0.smithi084.stdout:5/758: truncate d9/d5b/d7e/db5/fbd 515714 0 2024-02-15T18:27:08.658 INFO:tasks.workunit.client.0.smithi084.stdout:5/759: chown d9/da/d3d/d44/d55/fc0 48 1 2024-02-15T18:27:08.658 INFO:tasks.workunit.client.0.smithi084.stdout:5/760: stat d9/da/d3d/d44/d55/d70/d84/da1/cdc 0 2024-02-15T18:27:08.658 INFO:tasks.workunit.client.1.smithi133.stdout:3/432: getdents d0/d15/d2f/d5e 0 2024-02-15T18:27:08.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/383: symlink d9/d10/d22/d2f/d30/d44/l83 0 2024-02-15T18:27:08.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/384: fdatasync d9/d10/d19/d1a/f25 0 2024-02-15T18:27:08.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/385: chown d9/d10/d22/d32/f48 140533737 1 2024-02-15T18:27:08.659 INFO:tasks.workunit.client.0.smithi084.stdout:5/761: mkdir d9/da/d3d/d44/d55/d70/dfa 0 2024-02-15T18:27:08.661 INFO:tasks.workunit.client.1.smithi133.stdout:5/331: getdents d17 0 2024-02-15T18:27:08.661 INFO:tasks.workunit.client.1.smithi133.stdout:5/332: stat ff 0 2024-02-15T18:27:08.663 INFO:tasks.workunit.client.1.smithi133.stdout:6/541: creat d0/d62/fb4 x:0 0 0 2024-02-15T18:27:08.663 INFO:tasks.workunit.client.1.smithi133.stdout:6/542: chown d0/db/d29/d34/d5d/d40/f7a 18982 1 2024-02-15T18:27:08.664 INFO:tasks.workunit.client.0.smithi084.stdout:6/678: dread d14/d22/d25/d28/f48 [0,4194304] 0 2024-02-15T18:27:08.664 INFO:tasks.workunit.client.0.smithi084.stdout:6/679: truncate d14/d22/d25/f84 462534 0 2024-02-15T18:27:08.664 INFO:tasks.workunit.client.1.smithi133.stdout:7/235: truncate d9/db/d16/f4b 2229428 0 2024-02-15T18:27:08.664 INFO:tasks.workunit.client.1.smithi133.stdout:7/236: truncate d9/db/f3c 705146 0 2024-02-15T18:27:08.665 INFO:tasks.workunit.client.0.smithi084.stdout:6/680: unlink c6 0 2024-02-15T18:27:08.665 INFO:tasks.workunit.client.1.smithi133.stdout:2/410: link d7/d2c/d3b/f50 d7/d2c/d5a/f85 0 2024-02-15T18:27:08.666 INFO:tasks.workunit.client.1.smithi133.stdout:3/433: creat d0/d15/d37/f88 x:0 0 0 2024-02-15T18:27:08.668 INFO:tasks.workunit.client.1.smithi133.stdout:0/386: rmdir d9/d10/d19 39 2024-02-15T18:27:08.668 INFO:tasks.workunit.client.1.smithi133.stdout:0/387: dread - d9/d10/d19/d1a/f4b zero size 2024-02-15T18:27:08.670 INFO:tasks.workunit.client.1.smithi133.stdout:6/543: creat d0/db/d29/d34/d48/da1/fb5 x:0 0 0 2024-02-15T18:27:08.671 INFO:tasks.workunit.client.0.smithi084.stdout:1/638: dwrite d9/d54/d32/d5b/f8d [0,4194304] 0 2024-02-15T18:27:08.671 INFO:tasks.workunit.client.1.smithi133.stdout:7/237: truncate d9/db/f11 4938751 0 2024-02-15T18:27:08.671 INFO:tasks.workunit.client.1.smithi133.stdout:8/372: dwrite d3/d1c/f1e [8388608,4194304] 0 2024-02-15T18:27:08.671 INFO:tasks.workunit.client.1.smithi133.stdout:8/373: stat d3/d1c/l30 0 2024-02-15T18:27:08.672 INFO:tasks.workunit.client.0.smithi084.stdout:7/646: dwrite df/d1d/d1a/d4d/d55/f99 [0,4194304] 0 2024-02-15T18:27:08.672 INFO:tasks.workunit.client.0.smithi084.stdout:7/647: truncate df/d1d/d1a/d4d/d55/f66 567647 0 2024-02-15T18:27:08.673 INFO:tasks.workunit.client.1.smithi133.stdout:2/411: unlink c4 0 2024-02-15T18:27:08.675 INFO:tasks.workunit.client.1.smithi133.stdout:3/434: mkdir d0/d15/d2b/d39/d3f/d3e/d89 0 2024-02-15T18:27:08.676 INFO:tasks.workunit.client.0.smithi084.stdout:0/663: dwrite d0/f99 [0,4194304] 0 2024-02-15T18:27:08.676 INFO:tasks.workunit.client.0.smithi084.stdout:0/664: write d0/d2f/faa [163545,84080] 0 2024-02-15T18:27:08.677 INFO:tasks.workunit.client.1.smithi133.stdout:3/435: write d0/d15/d2b/f44 [180375,70867] 0 2024-02-15T18:27:08.678 INFO:tasks.workunit.client.0.smithi084.stdout:0/665: dread d0/d25/f47 [0,4194304] 0 2024-02-15T18:27:08.681 INFO:tasks.workunit.client.1.smithi133.stdout:0/388: getdents d9/d10/d47 0 2024-02-15T18:27:08.683 INFO:tasks.workunit.client.1.smithi133.stdout:0/389: write d9/f3e [254857,93466] 0 2024-02-15T18:27:08.683 INFO:tasks.workunit.client.1.smithi133.stdout:0/390: chown d9/d10/d19/c33 9049537 1 2024-02-15T18:27:08.683 INFO:tasks.workunit.client.1.smithi133.stdout:0/391: dread - d9/d10/d22/d32/f74 zero size 2024-02-15T18:27:08.685 INFO:tasks.workunit.client.1.smithi133.stdout:7/238: rmdir d9/db/d16 39 2024-02-15T18:27:08.685 INFO:tasks.workunit.client.1.smithi133.stdout:6/544: mkdir d0/db/db6 0 2024-02-15T18:27:08.685 INFO:tasks.workunit.client.1.smithi133.stdout:7/239: stat d9/d36/f2e 0 2024-02-15T18:27:08.685 INFO:tasks.workunit.client.1.smithi133.stdout:6/545: chown d0/db/d29/d34/d5d/l2a 2213 1 2024-02-15T18:27:08.688 INFO:tasks.workunit.client.0.smithi084.stdout:0/666: creat d0/d2f/d4b/dc6/fca x:0 0 0 2024-02-15T18:27:08.688 INFO:tasks.workunit.client.0.smithi084.stdout:0/667: write d0/d1e/f9f [534759,53789] 0 2024-02-15T18:27:08.689 INFO:tasks.workunit.client.1.smithi133.stdout:2/412: mknod d7/d18/d32/c86 0 2024-02-15T18:27:08.689 INFO:tasks.workunit.client.1.smithi133.stdout:8/374: creat d3/d1c/d2f/f7d x:0 0 0 2024-02-15T18:27:08.690 INFO:tasks.workunit.client.1.smithi133.stdout:3/436: rename d0/d15/d37/d4a/f60 to d0/d15/d54/f8a 0 2024-02-15T18:27:08.694 INFO:tasks.workunit.client.1.smithi133.stdout:7/240: rmdir d9/db/dc/d42 0 2024-02-15T18:27:08.694 INFO:tasks.workunit.client.1.smithi133.stdout:6/546: creat d0/db/d29/d34/fb7 x:0 0 0 2024-02-15T18:27:08.695 INFO:tasks.workunit.client.1.smithi133.stdout:6/547: readlink d0/l1 0 2024-02-15T18:27:08.695 INFO:tasks.workunit.client.1.smithi133.stdout:6/548: chown d0/db/f25 7 1 2024-02-15T18:27:08.695 INFO:tasks.workunit.client.1.smithi133.stdout:8/375: truncate d3/f2e 1031192 0 2024-02-15T18:27:08.695 INFO:tasks.workunit.client.1.smithi133.stdout:7/241: mkdir d9/db/d16/d4f 0 2024-02-15T18:27:08.695 INFO:tasks.workunit.client.1.smithi133.stdout:7/242: write d9/f2a [933216,102366] 0 2024-02-15T18:27:08.696 INFO:tasks.workunit.client.1.smithi133.stdout:6/549: creat d0/d3b/d67/fb8 x:0 0 0 2024-02-15T18:27:08.696 INFO:tasks.workunit.client.1.smithi133.stdout:6/550: write d0/db/d29/d34/d8c/d98/f96 [439904,111196] 0 2024-02-15T18:27:08.697 INFO:tasks.workunit.client.0.smithi084.stdout:7/648: dread f5 [0,4194304] 0 2024-02-15T18:27:08.698 INFO:tasks.workunit.client.1.smithi133.stdout:7/243: creat d9/db/f50 x:0 0 0 2024-02-15T18:27:08.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/551: symlink d0/db/lb9 0 2024-02-15T18:27:08.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/552: write d0/db/d21/f72 [276330,89588] 0 2024-02-15T18:27:08.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/553: readlink d0/d3b/d52/l5a 0 2024-02-15T18:27:08.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/554: chown d0/db/d29/d34/d7c 0 1 2024-02-15T18:27:08.700 INFO:tasks.workunit.client.1.smithi133.stdout:6/555: chown d0/c31 7216505 1 2024-02-15T18:27:08.702 INFO:tasks.workunit.client.0.smithi084.stdout:7/649: mkdir df/d1d/d1a/d4d/d55/d88/d98/dd0 0 2024-02-15T18:27:08.704 INFO:tasks.workunit.client.1.smithi133.stdout:6/556: creat d0/d3b/d9d/fba x:0 0 0 2024-02-15T18:27:08.704 INFO:tasks.workunit.client.1.smithi133.stdout:7/244: dread d9/d36/f2e [0,4194304] 0 2024-02-15T18:27:08.704 INFO:tasks.workunit.client.1.smithi133.stdout:7/245: write d9/da/f3b [189483,70231] 0 2024-02-15T18:27:08.704 INFO:tasks.workunit.client.1.smithi133.stdout:7/246: chown d9/d36/f37 55010 1 2024-02-15T18:27:08.704 INFO:tasks.workunit.client.1.smithi133.stdout:7/247: readlink d9/db/l13 0 2024-02-15T18:27:08.705 INFO:tasks.workunit.client.0.smithi084.stdout:7/650: read df/d1d/d1a/d4d/d55/f99 [1784813,301] 0 2024-02-15T18:27:08.706 INFO:tasks.workunit.client.0.smithi084.stdout:1/639: dwrite d9/d54/d1b/d2c/d4b/f9e [0,4194304] 0 2024-02-15T18:27:08.706 INFO:tasks.workunit.client.0.smithi084.stdout:6/681: dwrite d14/d22/d25/d2f/d31/d3f/d4a/fd4 [0,4194304] 0 2024-02-15T18:27:08.708 INFO:tasks.workunit.client.1.smithi133.stdout:7/248: mknod d9/db/d16/c51 0 2024-02-15T18:27:08.708 INFO:tasks.workunit.client.1.smithi133.stdout:7/249: write d9/da/f3b [1099052,36061] 0 2024-02-15T18:27:08.710 INFO:tasks.workunit.client.1.smithi133.stdout:7/250: creat d9/d36/d39/f52 x:0 0 0 2024-02-15T18:27:08.710 INFO:tasks.workunit.client.1.smithi133.stdout:7/251: write d9/da/f3b [1108153,71356] 0 2024-02-15T18:27:08.714 INFO:tasks.workunit.client.1.smithi133.stdout:8/376: write d3/f42 [2749861,92179] 0 2024-02-15T18:27:08.714 INFO:tasks.workunit.client.1.smithi133.stdout:8/377: read - d3/d1f/d3f/d58/f78 zero size 2024-02-15T18:27:08.718 INFO:tasks.workunit.client.0.smithi084.stdout:7/651: dread f4 [0,4194304] 0 2024-02-15T18:27:08.718 INFO:tasks.workunit.client.0.smithi084.stdout:7/652: dread - df/d1d/d1a/fad zero size 2024-02-15T18:27:08.720 INFO:tasks.workunit.client.0.smithi084.stdout:7/653: mkdir df/d1d/d1a/dd1 0 2024-02-15T18:27:08.720 INFO:tasks.workunit.client.0.smithi084.stdout:3/675: sync 2024-02-15T18:27:08.721 INFO:tasks.workunit.client.1.smithi133.stdout:8/378: unlink d3/f22 0 2024-02-15T18:27:08.721 INFO:tasks.workunit.client.0.smithi084.stdout:7/654: rename df/d1d/d1a/d6a/d8b/f73 to df/d1d/d1a/d6a/fd2 0 2024-02-15T18:27:08.722 INFO:tasks.workunit.client.0.smithi084.stdout:1/640: dread d9/d54/d5c/d81/f6c [0,4194304] 0 2024-02-15T18:27:08.722 INFO:tasks.workunit.client.0.smithi084.stdout:3/676: creat d8/d73/d93/fe7 x:0 0 0 2024-02-15T18:27:08.723 INFO:tasks.workunit.client.0.smithi084.stdout:7/655: dread df/d1d/d1a/f2d [0,4194304] 0 2024-02-15T18:27:08.724 INFO:tasks.workunit.client.0.smithi084.stdout:1/641: write d9/d54/d1b/d2c/d4b/d4c/fc4 [3853879,37998] 0 2024-02-15T18:27:08.724 INFO:tasks.workunit.client.0.smithi084.stdout:6/682: dread d14/d22/d25/d2f/da9/f9e [0,4194304] 0 2024-02-15T18:27:08.728 INFO:tasks.workunit.client.0.smithi084.stdout:1/642: read d9/d54/d7f/db7/dc0/f6a [414632,37376] 0 2024-02-15T18:27:08.733 INFO:tasks.workunit.client.0.smithi084.stdout:9/757: sync 2024-02-15T18:27:08.733 INFO:tasks.workunit.client.0.smithi084.stdout:2/677: sync 2024-02-15T18:27:08.735 INFO:tasks.workunit.client.0.smithi084.stdout:3/677: creat d8/d40/d43/d71/d8c/d94/da3/dba/fe8 x:0 0 0 2024-02-15T18:27:08.735 INFO:tasks.workunit.client.0.smithi084.stdout:0/668: dwrite d0/f95 [0,4194304] 0 2024-02-15T18:27:08.735 INFO:tasks.workunit.client.0.smithi084.stdout:0/669: fdatasync d0/d39/d45/f5e 0 2024-02-15T18:27:08.736 INFO:tasks.workunit.client.1.smithi133.stdout:3/437: dwrite d0/d15/d2b/d39/d3f/f5f [0,4194304] 0 2024-02-15T18:27:08.736 INFO:tasks.workunit.client.1.smithi133.stdout:3/438: write d0/d15/d2f/f7f [795085,34492] 0 2024-02-15T18:27:08.739 INFO:tasks.workunit.client.1.smithi133.stdout:3/439: rename d0/d15/d37/f40 to d0/d15/d2f/d5e/f8b 0 2024-02-15T18:27:08.740 INFO:tasks.workunit.client.0.smithi084.stdout:2/678: creat d3/fde x:0 0 0 2024-02-15T18:27:08.740 INFO:tasks.workunit.client.0.smithi084.stdout:9/758: mkdir d4/dc2/def/df6 0 2024-02-15T18:27:08.741 INFO:tasks.workunit.client.1.smithi133.stdout:3/440: symlink d0/d15/d37/d7b/l8c 0 2024-02-15T18:27:08.742 INFO:tasks.workunit.client.0.smithi084.stdout:0/670: truncate d0/d2f/d3f/d4f/d59/fbc 3189325 0 2024-02-15T18:27:08.742 INFO:tasks.workunit.client.0.smithi084.stdout:0/671: chown d0/d2f/l38 1441 1 2024-02-15T18:27:08.743 INFO:tasks.workunit.client.0.smithi084.stdout:6/683: mkdir d14/d22/d25/d2f/d31/d30/d93/ddc 0 2024-02-15T18:27:08.744 INFO:tasks.workunit.client.0.smithi084.stdout:9/759: mknod d4/da3/db0/cf7 0 2024-02-15T18:27:08.746 INFO:tasks.workunit.client.0.smithi084.stdout:6/684: write d14/f17 [1275438,23322] 0 2024-02-15T18:27:08.746 INFO:tasks.workunit.client.0.smithi084.stdout:6/685: chown d14/d22/d25/d2f/d31/d30/d45/d54/f57 19177 1 2024-02-15T18:27:08.746 INFO:tasks.workunit.client.0.smithi084.stdout:2/679: creat d3/d5/d1a/d1e/d30/d8d/fdf x:0 0 0 2024-02-15T18:27:08.746 INFO:tasks.workunit.client.0.smithi084.stdout:2/680: stat d3/d5/d53/dca/l65 0 2024-02-15T18:27:08.746 INFO:tasks.workunit.client.0.smithi084.stdout:9/760: read d4/d2b/d3c/d20/f52 [3498914,101330] 0 2024-02-15T18:27:08.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/681: read d3/d5/d1a/f81 [614441,58896] 0 2024-02-15T18:27:08.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/682: chown d3/d5e/c62 5 1 2024-02-15T18:27:08.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/683: readlink d3/d5/d53/dca/d89/l98 0 2024-02-15T18:27:08.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/684: getdents d3/d5/dbd 0 2024-02-15T18:27:08.748 INFO:tasks.workunit.client.0.smithi084.stdout:0/672: unlink d0/d25/f47 0 2024-02-15T18:27:08.750 INFO:tasks.workunit.client.0.smithi084.stdout:2/685: write d3/d19/f33 [3570639,110964] 0 2024-02-15T18:27:08.751 INFO:tasks.workunit.client.0.smithi084.stdout:6/686: rename d14/d22/d25/d41 to d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd 0 2024-02-15T18:27:08.753 INFO:tasks.workunit.client.0.smithi084.stdout:9/761: creat d4/d3d/da5/dc1/ff8 x:0 0 0 2024-02-15T18:27:08.753 INFO:tasks.workunit.client.0.smithi084.stdout:9/762: getdents d4/d2b/d3c/d24/dca/d15/d4f 0 2024-02-15T18:27:08.753 INFO:tasks.workunit.client.1.smithi133.stdout:6/557: dwrite d0/d3b/f45 [4194304,4194304] 0 2024-02-15T18:27:08.754 INFO:tasks.workunit.client.1.smithi133.stdout:6/558: chown d0/db/d29/d34/d5d/c74 355 1 2024-02-15T18:27:08.754 INFO:tasks.workunit.client.1.smithi133.stdout:0/392: dwrite d9/d10/f54 [0,4194304] 0 2024-02-15T18:27:08.755 INFO:tasks.workunit.client.0.smithi084.stdout:2/686: mknod d3/d5/d1a/d1e/d4b/da6/d5c/dd3/ce0 0 2024-02-15T18:27:08.755 INFO:tasks.workunit.client.0.smithi084.stdout:1/643: dwrite d9/d54/d5c/d81/f6c [0,4194304] 0 2024-02-15T18:27:08.756 INFO:tasks.workunit.client.1.smithi133.stdout:8/379: dwrite d3/d1c/d37/f7b [0,4194304] 0 2024-02-15T18:27:08.757 INFO:tasks.workunit.client.1.smithi133.stdout:6/559: creat d0/d62/d66/fbb x:0 0 0 2024-02-15T18:27:08.757 INFO:tasks.workunit.client.1.smithi133.stdout:6/560: write d0/d3b/f99 [573784,2672] 0 2024-02-15T18:27:08.758 INFO:tasks.workunit.client.1.smithi133.stdout:7/252: fsync d9/d36/d39/f52 0 2024-02-15T18:27:08.758 INFO:tasks.workunit.client.1.smithi133.stdout:0/393: mknod d9/d10/d19/d1a/c84 0 2024-02-15T18:27:08.759 INFO:tasks.workunit.client.1.smithi133.stdout:0/394: dread - d9/d10/d19/f63 zero size 2024-02-15T18:27:08.759 INFO:tasks.workunit.client.1.smithi133.stdout:0/395: truncate d9/d10/d19/d1a/f25 730963 0 2024-02-15T18:27:08.759 INFO:tasks.workunit.client.1.smithi133.stdout:0/396: write d9/fc [9187119,24998] 0 2024-02-15T18:27:08.759 INFO:tasks.workunit.client.0.smithi084.stdout:9/763: rename d4/d6b/l6e to d4/d2b/d3c/d24/dca/d15/d33/lf9 0 2024-02-15T18:27:08.759 INFO:tasks.workunit.client.0.smithi084.stdout:6/687: mkdir d14/d22/dde 0 2024-02-15T18:27:08.759 INFO:tasks.workunit.client.0.smithi084.stdout:9/764: write d4/d2b/d3c/d24/dca/f6a [4618055,63236] 0 2024-02-15T18:27:08.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:06.685998+0000 mgr.smithi084.hjmnez (mgr.14596) 21 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 1.2 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 73 MiB/s rd, 144 MiB/s wr, 225 op/s 2024-02-15T18:27:08.760 INFO:tasks.workunit.client.0.smithi084.stdout:7/656: rmdir df/d1d/d1a/d6a 39 2024-02-15T18:27:08.763 INFO:tasks.workunit.client.1.smithi133.stdout:7/253: creat d9/db/d16/f53 x:0 0 0 2024-02-15T18:27:08.763 INFO:tasks.workunit.client.1.smithi133.stdout:0/397: mkdir d9/d10/d85 0 2024-02-15T18:27:08.764 INFO:tasks.workunit.client.1.smithi133.stdout:6/561: rename d0/db/c63 to d0/d62/d9c/cbc 0 2024-02-15T18:27:08.764 INFO:tasks.workunit.client.1.smithi133.stdout:3/441: dwrite d0/d15/d2b/d39/d3f/d3e/f7e [0,4194304] 0 2024-02-15T18:27:08.764 INFO:tasks.workunit.client.1.smithi133.stdout:7/254: link d9/d36/f2e d9/d19/f54 0 2024-02-15T18:27:08.765 INFO:tasks.workunit.client.0.smithi084.stdout:7/657: dread df/f4c [0,4194304] 0 2024-02-15T18:27:08.765 INFO:tasks.workunit.client.0.smithi084.stdout:7/658: fsync df/d1d/d1a/d6a/d8e/d79/fc3 0 2024-02-15T18:27:08.766 INFO:tasks.workunit.client.1.smithi133.stdout:0/398: link d9/d10/d22/d32/f64 d9/d10/d47/d5e/f86 0 2024-02-15T18:27:08.768 INFO:tasks.workunit.client.0.smithi084.stdout:1/644: creat d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/fd0 x:0 0 0 2024-02-15T18:27:08.768 INFO:tasks.workunit.client.0.smithi084.stdout:1/645: stat d9/d54/d5c/d81/d94 0 2024-02-15T18:27:08.769 INFO:tasks.workunit.client.1.smithi133.stdout:6/562: write d0/d3b/d85/faf [903653,124217] 0 2024-02-15T18:27:08.770 INFO:tasks.workunit.client.1.smithi133.stdout:6/563: dread d0/d3b/d9d/db3/f60 [0,4194304] 0 2024-02-15T18:27:08.772 INFO:tasks.workunit.client.1.smithi133.stdout:3/442: creat d0/f8d x:0 0 0 2024-02-15T18:27:08.772 INFO:tasks.workunit.client.1.smithi133.stdout:7/255: truncate d9/d36/f23 5247745 0 2024-02-15T18:27:08.773 INFO:tasks.workunit.client.1.smithi133.stdout:3/443: chown d0/d15/d37/f59 0 1 2024-02-15T18:27:08.773 INFO:tasks.workunit.client.1.smithi133.stdout:3/444: truncate d0/d15/d2b/f7a 538141 0 2024-02-15T18:27:08.773 INFO:tasks.workunit.client.1.smithi133.stdout:0/399: creat d9/d10/d47/f87 x:0 0 0 2024-02-15T18:27:08.773 INFO:tasks.workunit.client.1.smithi133.stdout:0/400: fdatasync d9/d28/f4a 0 2024-02-15T18:27:08.773 INFO:tasks.workunit.client.1.smithi133.stdout:3/445: read d0/d15/d37/d4a/f4e [551884,80803] 0 2024-02-15T18:27:08.773 INFO:tasks.workunit.client.1.smithi133.stdout:3/446: write d0/f8d [432290,130395] 0 2024-02-15T18:27:08.773 INFO:tasks.workunit.client.0.smithi084.stdout:9/765: creat d4/ffa x:0 0 0 2024-02-15T18:27:08.774 INFO:tasks.workunit.client.0.smithi084.stdout:1/646: creat d9/fd1 x:0 0 0 2024-02-15T18:27:08.774 INFO:tasks.workunit.client.0.smithi084.stdout:6/688: creat d14/d22/d25/d2f/d31/d3f/fdf x:0 0 0 2024-02-15T18:27:08.774 INFO:tasks.workunit.client.0.smithi084.stdout:2/687: dread d3/d5/d1a/d1e/d4b/da6/fa3 [0,4194304] 0 2024-02-15T18:27:08.775 INFO:tasks.workunit.client.0.smithi084.stdout:9/766: link d4/d3d/lc0 d4/da3/dc3/lfb 0 2024-02-15T18:27:08.775 INFO:tasks.workunit.client.1.smithi133.stdout:6/564: symlink d0/d3b/d53/lbd 0 2024-02-15T18:27:08.776 INFO:tasks.workunit.client.0.smithi084.stdout:1/647: symlink d9/d54/d7f/ld2 0 2024-02-15T18:27:08.776 INFO:tasks.workunit.client.1.smithi133.stdout:7/256: mkdir d9/db/d55 0 2024-02-15T18:27:08.778 INFO:tasks.workunit.client.0.smithi084.stdout:1/648: creat d9/d54/fd3 x:0 0 0 2024-02-15T18:27:08.781 INFO:tasks.workunit.client.1.smithi133.stdout:0/401: rename d9/d10/d22/d2f/d30/d44/l58 to d9/d2b/l88 0 2024-02-15T18:27:08.781 INFO:tasks.workunit.client.1.smithi133.stdout:6/565: mknod d0/db/d29/d34/d48/cbe 0 2024-02-15T18:27:08.782 INFO:tasks.workunit.client.1.smithi133.stdout:8/380: dwrite d3/d1c/d2f/d76/f77 [0,4194304] 0 2024-02-15T18:27:08.782 INFO:tasks.workunit.client.0.smithi084.stdout:6/689: creat d14/d22/d25/d2f/d31/dcf/fe0 x:0 0 0 2024-02-15T18:27:08.782 INFO:tasks.workunit.client.0.smithi084.stdout:6/690: write d14/d22/d25/d2f/d31/d30/d45/d54/f88 [3452793,105235] 0 2024-02-15T18:27:08.782 INFO:tasks.workunit.client.0.smithi084.stdout:1/649: mknod d9/d54/d1b/da7/cd4 0 2024-02-15T18:27:08.782 INFO:tasks.workunit.client.0.smithi084.stdout:1/650: readlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/lcd 0 2024-02-15T18:27:08.782 INFO:tasks.workunit.client.0.smithi084.stdout:1/651: fsync d9/d54/d1b/d2c/d4b/d4c/d79/f2f 0 2024-02-15T18:27:08.783 INFO:tasks.workunit.client.1.smithi133.stdout:6/566: rmdir d0/d3b/d78 39 2024-02-15T18:27:08.784 INFO:tasks.workunit.client.0.smithi084.stdout:9/767: dread d4/d2b/d3c/d24/dca/f14 [0,4194304] 0 2024-02-15T18:27:08.784 INFO:tasks.workunit.client.0.smithi084.stdout:0/673: dwrite d0/d39/d45/fb7 [0,4194304] 0 2024-02-15T18:27:08.785 INFO:tasks.workunit.client.0.smithi084.stdout:9/768: chown d4/d2b/d3c/d20/f62 401948289 1 2024-02-15T18:27:08.787 INFO:tasks.workunit.client.1.smithi133.stdout:7/257: dread d9/d36/f2b [0,4194304] 0 2024-02-15T18:27:08.787 INFO:tasks.workunit.client.0.smithi084.stdout:1/652: write d9/f27 [3797396,55675] 0 2024-02-15T18:27:08.791 INFO:tasks.workunit.client.0.smithi084.stdout:9/769: creat d4/d2b/d67/ffc x:0 0 0 2024-02-15T18:27:08.791 INFO:tasks.workunit.client.1.smithi133.stdout:0/402: rmdir d9/d10/d22/d32 39 2024-02-15T18:27:08.791 INFO:tasks.workunit.client.1.smithi133.stdout:8/381: dread d3/d1c/d37/d5a/f79 [0,4194304] 0 2024-02-15T18:27:08.792 INFO:tasks.workunit.client.0.smithi084.stdout:0/674: dread d0/d25/f34 [0,4194304] 0 2024-02-15T18:27:08.792 INFO:tasks.workunit.client.1.smithi133.stdout:3/447: rename d0/c18 to d0/d15/d2b/d62/c8e 0 2024-02-15T18:27:08.793 INFO:tasks.workunit.client.0.smithi084.stdout:9/770: unlink d4/d2b/f3b 0 2024-02-15T18:27:08.793 INFO:tasks.workunit.client.0.smithi084.stdout:9/771: fdatasync d4/da3/dc3/de1/dcb/fdf 0 2024-02-15T18:27:08.794 INFO:tasks.workunit.client.1.smithi133.stdout:0/403: write d9/d10/d19/f3d [1039937,66129] 0 2024-02-15T18:27:08.794 INFO:tasks.workunit.client.1.smithi133.stdout:0/404: fdatasync d9/d10/f54 0 2024-02-15T18:27:08.795 INFO:tasks.workunit.client.0.smithi084.stdout:0/675: mkdir d0/d4/d3a/d82/dcb 0 2024-02-15T18:27:08.795 INFO:tasks.workunit.client.0.smithi084.stdout:0/676: chown d0/d25/f67 64498936 1 2024-02-15T18:27:08.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.799+0000 7fd3c359e700 1 -- 172.21.15.84:0/2978758319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c40680c0 msgr2=0x7fd3c4068540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:08.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.799+0000 7fd3c359e700 1 --2- 172.21.15.84:0/2978758319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c40680c0 0x7fd3c4068540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fd3b80045a0 tx=0x7fd3b8009b30).stop 2024-02-15T18:27:08.796 INFO:tasks.workunit.client.1.smithi133.stdout:6/567: creat d0/db/d29/d34/d8c/da5/fbf x:0 0 0 2024-02-15T18:27:08.796 INFO:tasks.workunit.client.1.smithi133.stdout:7/258: creat d9/db/dc/f56 x:0 0 0 2024-02-15T18:27:08.796 INFO:tasks.workunit.client.1.smithi133.stdout:8/382: truncate d3/f14 204261 0 2024-02-15T18:27:08.796 INFO:tasks.workunit.client.0.smithi084.stdout:0/677: rename d0/d1e/l48 to d0/d39/d90/db1/lcc 0 2024-02-15T18:27:08.797 INFO:tasks.workunit.client.1.smithi133.stdout:3/448: creat d0/d15/d2b/d39/f8f x:0 0 0 2024-02-15T18:27:08.797 INFO:tasks.workunit.client.0.smithi084.stdout:0/678: symlink d0/d4/lcd 0 2024-02-15T18:27:08.798 INFO:tasks.workunit.client.1.smithi133.stdout:0/405: rename d9/d10/d19/d1a/f25 to d9/d10/d47/d5e/f89 0 2024-02-15T18:27:08.798 INFO:tasks.workunit.client.1.smithi133.stdout:0/406: dread - d9/d10/d19/d1a/f4b zero size 2024-02-15T18:27:08.799 INFO:tasks.workunit.client.1.smithi133.stdout:6/568: rmdir d0/db/d29/d34/d8c 39 2024-02-15T18:27:08.801 INFO:tasks.workunit.client.1.smithi133.stdout:7/259: creat d9/db/f57 x:0 0 0 2024-02-15T18:27:08.801 INFO:tasks.workunit.client.0.smithi084.stdout:7/659: dwrite df/d1d/d1a/d6a/d8b/da5/db6/fcc [4194304,4194304] 0 2024-02-15T18:27:08.801 INFO:tasks.workunit.client.0.smithi084.stdout:7/660: readlink df/d1d/d1a/d6a/d8b/d48/l9b 0 2024-02-15T18:27:08.801 INFO:tasks.workunit.client.0.smithi084.stdout:0/679: unlink d0/d4/d1b/d26/l27 0 2024-02-15T18:27:08.803 INFO:tasks.workunit.client.0.smithi084.stdout:0/680: write d0/d2f/d3f/da4/fab [4029708,102627] 0 2024-02-15T18:27:08.803 INFO:tasks.workunit.client.0.smithi084.stdout:0/681: stat d0/d4/d1b/f42 0 2024-02-15T18:27:08.803 INFO:tasks.workunit.client.0.smithi084.stdout:0/682: write d0/d2f/d4b/dae/db0/fc3 [973764,63607] 0 2024-02-15T18:27:08.803 INFO:tasks.workunit.client.0.smithi084.stdout:0/683: fdatasync d0/d4/d1b/d26/f2d 0 2024-02-15T18:27:08.803 INFO:tasks.workunit.client.0.smithi084.stdout:0/684: dread - d0/d4/d1b/d26/d43/d6d/fb5 zero size 2024-02-15T18:27:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.807+0000 7fd3c359e700 1 -- 172.21.15.84:0/2978758319 shutdown_connections 2024-02-15T18:27:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.807+0000 7fd3c359e700 1 --2- 172.21.15.84:0/2978758319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c40680c0 0x7fd3c4068540 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.807+0000 7fd3c359e700 1 --2- 172.21.15.84:0/2978758319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4069540 0x7fd3c4067bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.807+0000 7fd3c359e700 1 -- 172.21.15.84:0/2978758319 >> 172.21.15.84:0/2978758319 conn(0x7fd3c4063530 msgr2=0x7fd3c4065950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:08.805 INFO:tasks.workunit.client.0.smithi084.stdout:9/772: write d4/d2b/d3c/d20/d75/f7a [1741568,109726] 0 2024-02-15T18:27:08.805 INFO:tasks.workunit.client.0.smithi084.stdout:9/773: dread - d4/d36/d6f/fab zero size 2024-02-15T18:27:08.805 INFO:tasks.workunit.client.0.smithi084.stdout:9/774: write d4/d2b/fbd [867319,26257] 0 2024-02-15T18:27:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.807+0000 7fd3c359e700 1 -- 172.21.15.84:0/2978758319 shutdown_connections 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.808+0000 7fd3c359e700 1 -- 172.21.15.84:0/2978758319 wait complete. 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.808+0000 7fd3c359e700 1 Processor -- start 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.809+0000 7fd3c359e700 1 -- start start 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.809+0000 7fd3c359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c40680c0 0x7fd3c410c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.809+0000 7fd3c359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c4069540 0x7fd3c410ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.809+0000 7fd3c359e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c410d260 con 0x7fd3c4069540 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.809+0000 7fd3c359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c410d3a0 con 0x7fd3c40680c0 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.809+0000 7fd3c1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c4069540 0x7fd3c410ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.809+0000 7fd3c1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c4069540 0x7fd3c410ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42180/0 (socket says 172.21.15.84:42180) 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.809+0000 7fd3c1d9b700 1 -- 172.21.15.84:0/2222754534 learned_addr learned my addr 172.21.15.84:0/2222754534 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.810+0000 7fd3c259c700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c40680c0 0x7fd3c410c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.810+0000 7fd3c1d9b700 1 -- 172.21.15.84:0/2222754534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c40680c0 msgr2=0x7fd3c410c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.810+0000 7fd3c1d9b700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c40680c0 0x7fd3c410c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.810+0000 7fd3c1d9b700 1 -- 172.21.15.84:0/2222754534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b8005040 con 0x7fd3c4069540 2024-02-15T18:27:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.810+0000 7fd3c1d9b700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c4069540 0x7fd3c410ccb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fd3b80097f0 tx=0x7fd3b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:08.808 INFO:tasks.workunit.client.1.smithi133.stdout:0/407: creat d9/d10/d2c/f8a x:0 0 0 2024-02-15T18:27:08.808 INFO:tasks.workunit.client.1.smithi133.stdout:6/569: rename d0/db/d29/d34/d8c/da5/fbf to d0/db/d29/fc0 0 2024-02-15T18:27:08.808 INFO:tasks.workunit.client.1.smithi133.stdout:7/260: creat d9/d36/d31/f58 x:0 0 0 2024-02-15T18:27:08.808 INFO:tasks.workunit.client.1.smithi133.stdout:7/261: dread - d9/db/dc/f56 zero size 2024-02-15T18:27:08.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/262: truncate d9/db/d16/f49 712348 0 2024-02-15T18:27:08.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/263: chown d9/d36/f32 31 1 2024-02-15T18:27:08.809 INFO:tasks.workunit.client.1.smithi133.stdout:6/570: unlink d0/f26 0 2024-02-15T18:27:08.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/264: rename d9/d36/f2b to d9/d36/d31/f59 0 2024-02-15T18:27:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.810+0000 7fd3b2ffd700 1 -- 172.21.15.84:0/2222754534 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3b8019070 con 0x7fd3c4069540 2024-02-15T18:27:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.810+0000 7fd3b2ffd700 1 -- 172.21.15.84:0/2222754534 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd3b8009820 con 0x7fd3c4069540 2024-02-15T18:27:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.810+0000 7fd3b2ffd700 1 -- 172.21.15.84:0/2222754534 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3b8014420 con 0x7fd3c4069540 2024-02-15T18:27:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.811+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c411f920 con 0x7fd3c4069540 2024-02-15T18:27:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.811+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c411fe00 con 0x7fd3c4069540 2024-02-15T18:27:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.813+0000 7fd3b2ffd700 1 -- 172.21.15.84:0/2222754534 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 28) v1 ==== 77194+0+0 (secure 0 0 0) 0x7fd3b801e420 con 0x7fd3c4069540 2024-02-15T18:27:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.813+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c4045ad0 con 0x7fd3c4069540 2024-02-15T18:27:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.813+0000 7fd3b2ffd700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd3ac0610a0 0x7fd3ac063560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.813+0000 7fd3b2ffd700 1 -- 172.21.15.84:0/2222754534 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd3b807db80 con 0x7fd3c4069540 2024-02-15T18:27:08.811 INFO:tasks.workunit.client.0.smithi084.stdout:2/688: dwrite d3/d5/f22 [0,4194304] 0 2024-02-15T18:27:08.811 INFO:tasks.workunit.client.0.smithi084.stdout:2/689: fdatasync d3/d5/d1a/d1e/d4b/da6/d5c/f68 0 2024-02-15T18:27:08.811 INFO:tasks.workunit.client.0.smithi084.stdout:7/661: rmdir df/d1d/d1a/d6a/d8b/dc9 0 2024-02-15T18:27:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.813+0000 7fd3c259c700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd3ac0610a0 0x7fd3ac063560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.814+0000 7fd3c259c700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd3ac0610a0 0x7fd3ac063560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd3c4067ac0 tx=0x7fd3bc004d00).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:08.814 INFO:tasks.workunit.client.0.smithi084.stdout:4/740: sync 2024-02-15T18:27:08.814 INFO:tasks.workunit.client.0.smithi084.stdout:8/708: sync 2024-02-15T18:27:08.814 INFO:tasks.workunit.client.0.smithi084.stdout:8/709: chown db/d3f/d59/f48 1382366 1 2024-02-15T18:27:08.815 INFO:tasks.workunit.client.0.smithi084.stdout:8/710: fdatasync db/d3f/d59/fe6 0 2024-02-15T18:27:08.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:08.819+0000 7fd3b2ffd700 1 -- 172.21.15.84:0/2222754534 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7fd3b8051960 con 0x7fd3c4069540 2024-02-15T18:27:08.816 INFO:tasks.workunit.client.0.smithi084.stdout:0/685: mkdir d0/d39/dce 0 2024-02-15T18:27:08.816 INFO:tasks.workunit.client.0.smithi084.stdout:9/775: creat d4/d81/ffd x:0 0 0 2024-02-15T18:27:08.819 INFO:tasks.workunit.client.0.smithi084.stdout:2/690: creat d3/d5/d53/dca/d91/fe1 x:0 0 0 2024-02-15T18:27:08.819 INFO:tasks.workunit.client.0.smithi084.stdout:6/691: dread d14/d22/d25/d2f/d31/d30/d45/d54/f57 [0,4194304] 0 2024-02-15T18:27:08.819 INFO:tasks.workunit.client.0.smithi084.stdout:7/662: creat df/d1d/d44/db9/fd3 x:0 0 0 2024-02-15T18:27:08.820 INFO:tasks.workunit.client.0.smithi084.stdout:4/741: mknod d2/d4/d28/d3d/d5c/d65/d9f/cd9 0 2024-02-15T18:27:08.820 INFO:tasks.workunit.client.1.smithi133.stdout:6/571: dread d0/db/f70 [0,4194304] 0 2024-02-15T18:27:08.823 INFO:tasks.workunit.client.0.smithi084.stdout:7/663: creat df/d1d/d1a/d6a/d8b/d7f/fd4 x:0 0 0 2024-02-15T18:27:08.824 INFO:tasks.workunit.client.0.smithi084.stdout:4/742: symlink d2/d4/d28/d3d/d5c/d65/d9f/lda 0 2024-02-15T18:27:08.824 INFO:tasks.workunit.client.0.smithi084.stdout:4/743: dread - d2/d4/fb2 zero size 2024-02-15T18:27:08.824 INFO:tasks.workunit.client.0.smithi084.stdout:7/664: write f4 [4013677,97928] 0 2024-02-15T18:27:08.824 INFO:tasks.workunit.client.0.smithi084.stdout:9/776: creat d4/d2b/d3c/d20/d75/d87/de2/dea/ffe x:0 0 0 2024-02-15T18:27:08.825 INFO:tasks.workunit.client.1.smithi133.stdout:7/265: mkdir d9/da/d48/d5a 0 2024-02-15T18:27:08.825 INFO:tasks.workunit.client.0.smithi084.stdout:9/777: chown d4/d2b/d67/lcc 1317555540 1 2024-02-15T18:27:08.826 INFO:tasks.workunit.client.0.smithi084.stdout:4/744: read d2/d4/d28/d2e/fb6 [3606865,116293] 0 2024-02-15T18:27:08.826 INFO:tasks.workunit.client.0.smithi084.stdout:1/653: dwrite d9/d54/d1b/f56 [0,4194304] 0 2024-02-15T18:27:08.826 INFO:tasks.workunit.client.0.smithi084.stdout:0/686: write d0/d4/d1b/f40 [209084,96340] 0 2024-02-15T18:27:08.826 INFO:tasks.workunit.client.0.smithi084.stdout:1/654: fsync d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 0 2024-02-15T18:27:08.826 INFO:tasks.workunit.client.0.smithi084.stdout:7/665: symlink df/d1d/d1a/d4d/ld5 0 2024-02-15T18:27:08.827 INFO:tasks.workunit.client.1.smithi133.stdout:8/383: dwrite d3/f43 [0,4194304] 0 2024-02-15T18:27:08.827 INFO:tasks.workunit.client.1.smithi133.stdout:8/384: fsync d3/de/f25 0 2024-02-15T18:27:08.827 INFO:tasks.workunit.client.1.smithi133.stdout:8/385: write d3/f42 [4538897,123139] 0 2024-02-15T18:27:08.827 INFO:tasks.workunit.client.1.smithi133.stdout:8/386: readlink d3/l6 0 2024-02-15T18:27:08.827 INFO:tasks.workunit.client.0.smithi084.stdout:4/745: truncate d2/d4/d28/d2e/fb6 3030609 0 2024-02-15T18:27:08.835 INFO:tasks.workunit.client.0.smithi084.stdout:0/687: dread d0/d4/d1b/f3e [0,4194304] 0 2024-02-15T18:27:08.835 INFO:tasks.workunit.client.0.smithi084.stdout:0/688: read - d0/d1e/da2/fb2 zero size 2024-02-15T18:27:08.837 INFO:tasks.workunit.client.0.smithi084.stdout:1/655: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/ld5 0 2024-02-15T18:27:08.837 INFO:tasks.workunit.client.0.smithi084.stdout:1/656: truncate d9/d54/d1b/d2c/d4b/d4c/d79/f2f 4939401 0 2024-02-15T18:27:08.838 INFO:tasks.workunit.client.0.smithi084.stdout:7/666: mkdir df/d1d/d1a/dd1/dd6 0 2024-02-15T18:27:08.838 INFO:tasks.workunit.client.0.smithi084.stdout:4/746: symlink d2/d64/d74/d8f/dc1/ldb 0 2024-02-15T18:27:08.840 INFO:tasks.workunit.client.0.smithi084.stdout:0/689: mknod d0/d39/d90/db1/ccf 0 2024-02-15T18:27:08.844 INFO:tasks.workunit.client.0.smithi084.stdout:1/657: symlink d9/d54/d1b/d2c/ld6 0 2024-02-15T18:27:08.844 INFO:tasks.workunit.client.0.smithi084.stdout:1/658: getdents d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/dc6 0 2024-02-15T18:27:08.844 INFO:tasks.workunit.client.0.smithi084.stdout:1/659: chown d9/d54/d5c/d81/d94/l97 116783345 1 2024-02-15T18:27:08.844 INFO:tasks.workunit.client.0.smithi084.stdout:1/660: dread - d9/d54/d1b/da7/fbe zero size 2024-02-15T18:27:08.844 INFO:tasks.workunit.client.0.smithi084.stdout:1/661: readlink d9/d54/d1b/d38/d4d/lbf 0 2024-02-15T18:27:08.845 INFO:tasks.workunit.client.1.smithi133.stdout:6/572: rename d0/db/d29/d34/d7c to d0/d3b/d67/d9a/dc1 0 2024-02-15T18:27:08.845 INFO:tasks.workunit.client.1.smithi133.stdout:7/266: mkdir d9/d5b 0 2024-02-15T18:27:08.845 INFO:tasks.workunit.client.1.smithi133.stdout:8/387: creat d3/d1c/d2f/d76/f7e x:0 0 0 2024-02-15T18:27:08.845 INFO:tasks.workunit.client.1.smithi133.stdout:8/388: readlink d3/d1c/l69 0 2024-02-15T18:27:08.846 INFO:tasks.workunit.client.0.smithi084.stdout:2/691: dread d3/d28/f78 [0,4194304] 0 2024-02-15T18:27:08.846 INFO:tasks.workunit.client.0.smithi084.stdout:0/690: link d0/d4/d3a/d5c/fa1 d0/d2f/d3f/d4f/d59/fd0 0 2024-02-15T18:27:08.849 INFO:tasks.workunit.client.1.smithi133.stdout:6/573: rmdir d0/d3b/d78 39 2024-02-15T18:27:08.849 INFO:tasks.workunit.client.1.smithi133.stdout:7/267: creat d9/d36/d39/f5c x:0 0 0 2024-02-15T18:27:08.849 INFO:tasks.workunit.client.1.smithi133.stdout:6/574: fsync d0/d3b/d85/faa 0 2024-02-15T18:27:08.851 INFO:tasks.workunit.client.1.smithi133.stdout:6/575: unlink d0/d3b/d52/l83 0 2024-02-15T18:27:08.855 INFO:tasks.workunit.client.1.smithi133.stdout:6/576: read d0/d3b/d67/f81 [890486,7492] 0 2024-02-15T18:27:08.855 INFO:tasks.workunit.client.1.smithi133.stdout:6/577: readlink d0/d3b/d9d/db3/l64 0 2024-02-15T18:27:08.855 INFO:tasks.workunit.client.0.smithi084.stdout:2/692: mknod d3/d5/d1a/d1e/d30/d82/ce2 0 2024-02-15T18:27:08.855 INFO:tasks.workunit.client.0.smithi084.stdout:2/693: stat d3/d5/d53/dca/db8/fd7 0 2024-02-15T18:27:08.857 INFO:tasks.workunit.client.1.smithi133.stdout:6/578: symlink d0/db/db6/lc2 0 2024-02-15T18:27:08.857 INFO:tasks.workunit.client.1.smithi133.stdout:6/579: dread - d0/db/d29/d34/f97 zero size 2024-02-15T18:27:08.858 INFO:tasks.workunit.client.1.smithi133.stdout:6/580: stat d0/d62/d66 0 2024-02-15T18:27:08.858 INFO:tasks.workunit.client.1.smithi133.stdout:8/389: dread d3/d1f/f31 [0,4194304] 0 2024-02-15T18:27:08.858 INFO:tasks.workunit.client.1.smithi133.stdout:8/390: chown d3/d7/d52/c6e 13 1 2024-02-15T18:27:08.858 INFO:tasks.workunit.client.1.smithi133.stdout:8/391: truncate d3/f14 1206340 0 2024-02-15T18:27:08.858 INFO:tasks.workunit.client.0.smithi084.stdout:2/694: dread d3/d5/d1a/d2d/f38 [0,4194304] 0 2024-02-15T18:27:08.859 INFO:tasks.workunit.client.1.smithi133.stdout:6/581: getdents d0/db/d29/d34/d48/da1 0 2024-02-15T18:27:08.859 INFO:tasks.workunit.client.1.smithi133.stdout:6/582: read - d0/d3b/d85/faa zero size 2024-02-15T18:27:08.861 INFO:tasks.workunit.client.0.smithi084.stdout:2/695: link d3/d5/d1a/d1e/d4b/da6/c6d d3/d5/d1a/d74/d8e/d96/ce3 0 2024-02-15T18:27:08.861 INFO:tasks.workunit.client.0.smithi084.stdout:1/662: dread d9/d54/d1b/d2c/d4b/d4c/fc4 [0,4194304] 0 2024-02-15T18:27:08.861 INFO:tasks.workunit.client.0.smithi084.stdout:2/696: getdents d3/d5/d1a/d1e/d4b/da6/d5c/dd3 0 2024-02-15T18:27:08.862 INFO:tasks.workunit.client.1.smithi133.stdout:6/583: creat d0/d3b/d85/fc3 x:0 0 0 2024-02-15T18:27:08.862 INFO:tasks.workunit.client.1.smithi133.stdout:7/268: dread d9/db/f27 [0,4194304] 0 2024-02-15T18:27:08.863 INFO:tasks.workunit.client.1.smithi133.stdout:7/269: write d9/db/f3c [1374923,128664] 0 2024-02-15T18:27:08.863 INFO:tasks.workunit.client.0.smithi084.stdout:1/663: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/ld7 0 2024-02-15T18:27:08.864 INFO:tasks.workunit.client.0.smithi084.stdout:1/664: getdents d9/d54/d5c/d81 0 2024-02-15T18:27:08.864 INFO:tasks.workunit.client.0.smithi084.stdout:1/665: truncate d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/fd0 163007 0 2024-02-15T18:27:08.866 INFO:tasks.workunit.client.0.smithi084.stdout:1/666: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/ld8 0 2024-02-15T18:27:08.866 INFO:tasks.workunit.client.0.smithi084.stdout:1/667: fsync d9/d54/d1b/d2c/f43 0 2024-02-15T18:27:08.866 INFO:tasks.workunit.client.1.smithi133.stdout:7/270: write d9/db/dc/f35 [641801,104743] 0 2024-02-15T18:27:08.868 INFO:tasks.workunit.client.0.smithi084.stdout:1/668: rmdir d9/d54/d1b/d38/d4d 39 2024-02-15T18:27:08.878 INFO:tasks.workunit.client.1.smithi133.stdout:0/408: dwrite f0 [0,4194304] 0 2024-02-15T18:27:08.878 INFO:tasks.workunit.client.0.smithi084.stdout:4/747: dwrite d2/d2b/d47/f3b [4194304,4194304] 0 2024-02-15T18:27:08.880 INFO:tasks.workunit.client.1.smithi133.stdout:8/392: dread d3/f44 [0,4194304] 0 2024-02-15T18:27:08.881 INFO:tasks.workunit.client.0.smithi084.stdout:9/778: dwrite d4/d2b/d3c/d24/f2a [0,4194304] 0 2024-02-15T18:27:08.881 INFO:tasks.workunit.client.0.smithi084.stdout:8/711: dwrite db/dd/d4d/d97/f9a [0,4194304] 0 2024-02-15T18:27:08.881 INFO:tasks.workunit.client.0.smithi084.stdout:8/712: dread - db/dd/d1f/d3e/fb5 zero size 2024-02-15T18:27:08.881 INFO:tasks.workunit.client.1.smithi133.stdout:8/393: read d3/d1c/d37/d5a/f79 [1863725,26306] 0 2024-02-15T18:27:08.883 INFO:tasks.workunit.client.1.smithi133.stdout:0/409: symlink d9/d10/d22/d2f/d30/d44/l8b 0 2024-02-15T18:27:08.883 INFO:tasks.workunit.client.1.smithi133.stdout:0/410: write d9/f1e [735370,20987] 0 2024-02-15T18:27:08.884 INFO:tasks.workunit.client.0.smithi084.stdout:7/667: dwrite df/d1d/d1a/d4d/d55/f66 [0,4194304] 0 2024-02-15T18:27:08.885 INFO:tasks.workunit.client.0.smithi084.stdout:8/713: truncate db/d1a/d2b/f6c 2301105 0 2024-02-15T18:27:08.889 INFO:tasks.workunit.client.0.smithi084.stdout:7/668: creat df/d1d/d1a/d6a/d8e/fd7 x:0 0 0 2024-02-15T18:27:08.889 INFO:tasks.workunit.client.0.smithi084.stdout:7/669: write df/d1d/d1a/d6a/d8e/d79/fc3 [860832,23324] 0 2024-02-15T18:27:08.889 INFO:tasks.workunit.client.0.smithi084.stdout:7/670: write df/d1d/fae [964697,70950] 0 2024-02-15T18:27:08.890 INFO:tasks.workunit.client.0.smithi084.stdout:2/697: dwrite d3/d5/d1a/d1e/d4b/da6/d5c/f5f [0,4194304] 0 2024-02-15T18:27:08.891 INFO:tasks.workunit.client.1.smithi133.stdout:8/394: rename d3/d1c/d2f/l35 to d3/d1c/d2f/l7f 0 2024-02-15T18:27:08.892 INFO:tasks.workunit.client.1.smithi133.stdout:0/411: getdents d9/d10/d19/d1a 0 2024-02-15T18:27:08.892 INFO:tasks.workunit.client.0.smithi084.stdout:8/714: unlink db/d6a/f9c 0 2024-02-15T18:27:08.893 INFO:tasks.workunit.client.0.smithi084.stdout:8/715: chown db/daf/lc8 3327 1 2024-02-15T18:27:08.893 INFO:tasks.workunit.client.0.smithi084.stdout:7/671: symlink df/d1d/d44/dbb/ld8 0 2024-02-15T18:27:08.893 INFO:tasks.workunit.client.0.smithi084.stdout:7/672: fdatasync df/d1d/d1a/d6a/d8b/d48/f43 0 2024-02-15T18:27:08.893 INFO:tasks.workunit.client.0.smithi084.stdout:7/673: dread - df/f6e zero size 2024-02-15T18:27:08.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:06.685998+0000 mgr.smithi084.hjmnez (mgr.14596) 21 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 1.2 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 73 MiB/s rd, 144 MiB/s wr, 225 op/s 2024-02-15T18:27:08.894 INFO:tasks.workunit.client.0.smithi084.stdout:6/692: dwrite d14/d22/d25/d2f/fd7 [0,4194304] 0 2024-02-15T18:27:08.894 INFO:tasks.workunit.client.1.smithi133.stdout:0/412: mkdir d9/d10/d19/d8c 0 2024-02-15T18:27:08.896 INFO:tasks.workunit.client.0.smithi084.stdout:8/716: write db/d1a/f5f [150155,42533] 0 2024-02-15T18:27:08.896 INFO:tasks.workunit.client.1.smithi133.stdout:0/413: stat d9/d10/d19/d1a/f61 0 2024-02-15T18:27:08.897 INFO:tasks.workunit.client.0.smithi084.stdout:2/698: write d3/d5/d1a/d1e/d4b/da6/f8c [7722760,104044] 0 2024-02-15T18:27:08.899 INFO:tasks.workunit.client.1.smithi133.stdout:0/414: link d9/l18 d9/d10/d2c/l8d 0 2024-02-15T18:27:08.901 INFO:tasks.workunit.client.1.smithi133.stdout:0/415: truncate d9/d10/d22/d32/f40 5235488 0 2024-02-15T18:27:08.901 INFO:tasks.workunit.client.1.smithi133.stdout:0/416: write d9/d2b/f53 [318057,60850] 0 2024-02-15T18:27:08.904 INFO:tasks.workunit.client.0.smithi084.stdout:8/717: rename db/dd/d13/d42/d79/da6 to db/dd/d13/db9/dea 0 2024-02-15T18:27:08.904 INFO:tasks.workunit.client.1.smithi133.stdout:0/417: link d9/d10/d19/f73 d9/d10/d47/d5e/f8e 0 2024-02-15T18:27:08.904 INFO:tasks.workunit.client.1.smithi133.stdout:0/418: chown d9/d10/d19/d29 186 1 2024-02-15T18:27:08.905 INFO:tasks.workunit.client.0.smithi084.stdout:2/699: symlink d3/d5/d1a/d74/d8e/le4 0 2024-02-15T18:27:08.905 INFO:tasks.workunit.client.0.smithi084.stdout:2/700: fdatasync d3/d5/d1a/d74/fac 0 2024-02-15T18:27:08.908 INFO:tasks.workunit.client.0.smithi084.stdout:8/718: rename db/dd/d1f/la1 to db/dd/d4d/leb 0 2024-02-15T18:27:08.908 INFO:tasks.workunit.client.1.smithi133.stdout:6/584: dwrite d0/f12 [0,4194304] 0 2024-02-15T18:27:08.908 INFO:tasks.workunit.client.0.smithi084.stdout:8/719: read db/dd/d4d/f63 [68472,104095] 0 2024-02-15T18:27:08.909 INFO:tasks.workunit.client.1.smithi133.stdout:0/419: write d9/d10/d19/f3d [2674806,47837] 0 2024-02-15T18:27:08.909 INFO:tasks.workunit.client.0.smithi084.stdout:2/701: getdents d3/d5/d1a 0 2024-02-15T18:27:08.910 INFO:tasks.workunit.client.1.smithi133.stdout:8/395: dread d3/f42 [0,4194304] 0 2024-02-15T18:27:08.911 INFO:tasks.workunit.client.1.smithi133.stdout:6/585: creat d0/db/d29/d34/d5d/fc4 x:0 0 0 2024-02-15T18:27:08.912 INFO:tasks.workunit.client.1.smithi133.stdout:0/420: rename d9/d10/d22/f23 to d9/d10/d19/d29/f8f 0 2024-02-15T18:27:08.912 INFO:tasks.workunit.client.1.smithi133.stdout:0/421: truncate d9/d1c/f1d 9279095 0 2024-02-15T18:27:08.913 INFO:tasks.workunit.client.0.smithi084.stdout:8/720: rename db/d1a/d2b/c4c to db/dd/d1f/d7a/cec 0 2024-02-15T18:27:08.915 INFO:tasks.workunit.client.1.smithi133.stdout:9/334: sync 2024-02-15T18:27:08.915 INFO:tasks.workunit.client.1.smithi133.stdout:9/335: dread - d0/d8/d9/d12/d2a/d42/f61 zero size 2024-02-15T18:27:08.918 INFO:tasks.workunit.client.1.smithi133.stdout:0/422: mknod d9/d10/d47/c90 0 2024-02-15T18:27:08.918 INFO:tasks.workunit.client.1.smithi133.stdout:0/423: write d9/d10/d22/d32/f74 [466848,91037] 0 2024-02-15T18:27:08.919 INFO:tasks.workunit.client.1.smithi133.stdout:0/424: creat d9/d10/d2c/f91 x:0 0 0 2024-02-15T18:27:08.919 INFO:tasks.workunit.client.1.smithi133.stdout:0/425: stat d9/d10/d47/d5e 0 2024-02-15T18:27:08.922 INFO:tasks.workunit.client.0.smithi084.stdout:8/721: mknod db/daf/ced 0 2024-02-15T18:27:08.922 INFO:tasks.workunit.client.1.smithi133.stdout:1/596: sync 2024-02-15T18:27:08.924 INFO:tasks.workunit.client.1.smithi133.stdout:7/271: dwrite d9/d36/d31/f58 [0,4194304] 0 2024-02-15T18:27:08.934 INFO:tasks.workunit.client.1.smithi133.stdout:7/272: write f6 [1368045,115400] 0 2024-02-15T18:27:08.937 INFO:tasks.workunit.client.1.smithi133.stdout:7/273: mkdir d9/db/d16/d5d 0 2024-02-15T18:27:08.937 INFO:tasks.workunit.client.1.smithi133.stdout:7/274: read - d9/d36/d3d/f43 zero size 2024-02-15T18:27:08.937 INFO:tasks.workunit.client.1.smithi133.stdout:7/275: chown d9/d36/d39/f5c 6982987 1 2024-02-15T18:27:08.946 INFO:tasks.workunit.client.1.smithi133.stdout:1/597: dread d6/d2a/d59/fad [0,4194304] 0 2024-02-15T18:27:08.948 INFO:tasks.workunit.client.1.smithi133.stdout:1/598: creat d6/d1e/d41/d7c/d7e/d7f/db6/fdc x:0 0 0 2024-02-15T18:27:08.948 INFO:tasks.workunit.client.1.smithi133.stdout:1/599: fsync d6/d2a/d59/fad 0 2024-02-15T18:27:08.958 INFO:tasks.workunit.client.0.smithi084.stdout:9/779: dwrite d4/d3d/da5/fe4 [0,4194304] 0 2024-02-15T18:27:08.958 INFO:tasks.workunit.client.0.smithi084.stdout:9/780: write d4/d2b/daf/fbb [822762,6896] 0 2024-02-15T18:27:08.963 INFO:tasks.workunit.client.0.smithi084.stdout:7/674: rmdir df/d1d/d1a/d6a/d8e 39 2024-02-15T18:27:08.965 INFO:tasks.workunit.client.0.smithi084.stdout:9/781: dread d4/d81/fd9 [0,4194304] 0 2024-02-15T18:27:08.966 INFO:tasks.workunit.client.0.smithi084.stdout:7/675: symlink df/d1d/d1a/d4d/ld9 0 2024-02-15T18:27:08.969 INFO:tasks.workunit.client.0.smithi084.stdout:5/762: sync 2024-02-15T18:27:08.971 INFO:tasks.workunit.client.0.smithi084.stdout:5/763: link d9/d23/c6b d9/d23/cfb 0 2024-02-15T18:27:08.971 INFO:tasks.workunit.client.0.smithi084.stdout:5/764: dread - d9/d5b/d79/fbb zero size 2024-02-15T18:27:08.972 INFO:tasks.workunit.client.0.smithi084.stdout:5/765: truncate d9/d5f/da7/fa9 68333 0 2024-02-15T18:27:08.972 INFO:tasks.workunit.client.0.smithi084.stdout:5/766: write d9/da/f1b [4409241,87272] 0 2024-02-15T18:27:08.974 INFO:tasks.workunit.client.0.smithi084.stdout:5/767: creat d9/d35/d65/d7f/dd6/deb/ffc x:0 0 0 2024-02-15T18:27:08.975 INFO:tasks.workunit.client.0.smithi084.stdout:5/768: truncate d9/d23/f67 1455177 0 2024-02-15T18:27:08.976 INFO:tasks.workunit.client.0.smithi084.stdout:5/769: rmdir d9/da/d3d/d44/d55/d96 39 2024-02-15T18:27:08.977 INFO:tasks.workunit.client.0.smithi084.stdout:6/693: dwrite d14/d22/d25/f44 [0,4194304] 0 2024-02-15T18:27:08.978 INFO:tasks.workunit.client.0.smithi084.stdout:2/702: dwrite d3/d5/f18 [0,4194304] 0 2024-02-15T18:27:08.978 INFO:tasks.workunit.client.0.smithi084.stdout:4/748: dwrite d2/f39 [0,4194304] 0 2024-02-15T18:27:08.979 INFO:tasks.workunit.client.0.smithi084.stdout:1/669: dwrite d9/d54/d1b/d2c/d35/f73 [0,4194304] 0 2024-02-15T18:27:08.980 INFO:tasks.workunit.client.1.smithi133.stdout:8/396: dwrite d3/d1f/d3f/f41 [4194304,4194304] 0 2024-02-15T18:27:08.980 INFO:tasks.workunit.client.0.smithi084.stdout:4/749: read d2/d2b/fd6 [1212714,107933] 0 2024-02-15T18:27:08.980 INFO:tasks.workunit.client.0.smithi084.stdout:4/750: chown d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4 770 1 2024-02-15T18:27:08.981 INFO:tasks.workunit.client.0.smithi084.stdout:4/751: chown d2/f5e 403577 1 2024-02-15T18:27:08.982 INFO:tasks.workunit.client.0.smithi084.stdout:6/694: mkdir d14/d22/d25/d2f/d31/d30/d93/d99/de1 0 2024-02-15T18:27:08.982 INFO:tasks.workunit.client.0.smithi084.stdout:8/722: truncate db/d1a/f5f 2858454 0 2024-02-15T18:27:08.983 INFO:tasks.workunit.client.0.smithi084.stdout:8/723: write db/dd/d1f/d7a/da8/fab [580450,61714] 0 2024-02-15T18:27:08.983 INFO:tasks.workunit.client.0.smithi084.stdout:8/724: fsync db/f77 0 2024-02-15T18:27:08.983 INFO:tasks.workunit.client.1.smithi133.stdout:8/397: truncate d3/f43 3172536 0 2024-02-15T18:27:08.983 INFO:tasks.workunit.client.1.smithi133.stdout:8/398: truncate d3/de/f53 24401 0 2024-02-15T18:27:08.983 INFO:tasks.workunit.client.1.smithi133.stdout:8/399: chown d3/d1c/l69 268661562 1 2024-02-15T18:27:08.984 INFO:tasks.workunit.client.1.smithi133.stdout:8/400: chown d3/d7/d40 8783441 1 2024-02-15T18:27:08.984 INFO:tasks.workunit.client.1.smithi133.stdout:8/401: write d3/f46 [1246174,51392] 0 2024-02-15T18:27:08.984 INFO:tasks.workunit.client.0.smithi084.stdout:4/752: dread d2/d2b/d47/f7a [0,4194304] 0 2024-02-15T18:27:08.984 INFO:tasks.workunit.client.0.smithi084.stdout:4/753: fdatasync d2/d4/d25/f51 0 2024-02-15T18:27:08.984 INFO:tasks.workunit.client.0.smithi084.stdout:4/754: truncate d2/d4/d28/d2e/f77 345469 0 2024-02-15T18:27:08.985 INFO:tasks.workunit.client.0.smithi084.stdout:2/703: creat d3/d19/d75/fe5 x:0 0 0 2024-02-15T18:27:08.985 INFO:tasks.workunit.client.0.smithi084.stdout:2/704: dread - d3/dc6/fd4 zero size 2024-02-15T18:27:08.985 INFO:tasks.workunit.client.0.smithi084.stdout:2/705: stat d3/d5/d1a/c84 0 2024-02-15T18:27:08.987 INFO:tasks.workunit.client.1.smithi133.stdout:8/402: mkdir d3/d1c/d2f/d80 0 2024-02-15T18:27:08.989 INFO:tasks.workunit.client.1.smithi133.stdout:1/600: dwrite d6/f22 [0,4194304] 0 2024-02-15T18:27:08.989 INFO:tasks.workunit.client.1.smithi133.stdout:0/426: dwrite d9/d10/f54 [0,4194304] 0 2024-02-15T18:27:08.990 INFO:tasks.workunit.client.1.smithi133.stdout:7/276: dwrite d9/db/d16/f49 [0,4194304] 0 2024-02-15T18:27:08.990 INFO:tasks.workunit.client.1.smithi133.stdout:7/277: fdatasync d9/db/d16/f4b 0 2024-02-15T18:27:08.990 INFO:tasks.workunit.client.1.smithi133.stdout:7/278: truncate d9/d36/d39/f52 372174 0 2024-02-15T18:27:08.991 INFO:tasks.workunit.client.0.smithi084.stdout:7/676: dwrite df/d70/fb7 [0,4194304] 0 2024-02-15T18:27:08.991 INFO:tasks.workunit.client.0.smithi084.stdout:8/725: getdents db 0 2024-02-15T18:27:08.991 INFO:tasks.workunit.client.1.smithi133.stdout:9/336: dwrite d0/d8/d9/d3c/f5d [0,4194304] 0 2024-02-15T18:27:08.992 INFO:tasks.workunit.client.0.smithi084.stdout:4/755: link d2/d4/d28/d3d/d5c/dbc/d88/db0/cb3 d2/d4/d28/cdc 0 2024-02-15T18:27:08.992 INFO:tasks.workunit.client.0.smithi084.stdout:4/756: chown d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4/fd3 761834 1 2024-02-15T18:27:08.993 INFO:tasks.workunit.client.1.smithi133.stdout:0/427: write d9/f14 [3312770,12913] 0 2024-02-15T18:27:08.994 INFO:tasks.workunit.client.1.smithi133.stdout:7/279: read d9/f2a [837066,124523] 0 2024-02-15T18:27:08.994 INFO:tasks.workunit.client.1.smithi133.stdout:8/403: creat d3/f81 x:0 0 0 2024-02-15T18:27:08.994 INFO:tasks.workunit.client.0.smithi084.stdout:7/677: write df/f3b [169305,6334] 0 2024-02-15T18:27:08.995 INFO:tasks.workunit.client.0.smithi084.stdout:4/757: dread d2/f11 [0,4194304] 0 2024-02-15T18:27:08.995 INFO:tasks.workunit.client.0.smithi084.stdout:4/758: readlink d2/d2b/d47/l30 0 2024-02-15T18:27:08.995 INFO:tasks.workunit.client.0.smithi084.stdout:4/759: chown d2/d64/da5 303 1 2024-02-15T18:27:08.997 INFO:tasks.workunit.client.1.smithi133.stdout:4/301: sync 2024-02-15T18:27:08.998 INFO:tasks.workunit.client.0.smithi084.stdout:7/678: rename df/d1d/d1a/d6a/d8b/d48/c42 to df/d1d/d1a/cda 0 2024-02-15T18:27:08.998 INFO:tasks.workunit.client.1.smithi133.stdout:3/449: sync 2024-02-15T18:27:08.998 INFO:tasks.workunit.client.1.smithi133.stdout:5/333: sync 2024-02-15T18:27:08.998 INFO:tasks.workunit.client.1.smithi133.stdout:3/450: dread - d0/d15/d2f/d5e/f76 zero size 2024-02-15T18:27:08.998 INFO:tasks.workunit.client.1.smithi133.stdout:3/451: chown d0/d15/d37/d4a 618 1 2024-02-15T18:27:08.999 INFO:tasks.workunit.client.1.smithi133.stdout:5/334: dread - d17/f6d zero size 2024-02-15T18:27:08.999 INFO:tasks.workunit.client.1.smithi133.stdout:2/413: sync 2024-02-15T18:27:09.000 INFO:tasks.workunit.client.1.smithi133.stdout:2/414: read d7/d2c/f44 [291406,93547] 0 2024-02-15T18:27:09.000 INFO:tasks.workunit.client.1.smithi133.stdout:1/601: rmdir d6/d1e/d3a/d79/dbd 39 2024-02-15T18:27:09.000 INFO:tasks.workunit.client.0.smithi084.stdout:7/679: symlink df/d1d/d1a/d4d/d55/d88/ldb 0 2024-02-15T18:27:09.001 INFO:tasks.workunit.client.1.smithi133.stdout:2/415: dread d7/f20 [0,4194304] 0 2024-02-15T18:27:09.001 INFO:tasks.workunit.client.1.smithi133.stdout:2/416: dread - d7/d2c/d31/f6a zero size 2024-02-15T18:27:09.003 INFO:tasks.workunit.client.0.smithi084.stdout:4/760: write d2/d2b/d47/d31/fa6 [3022647,61011] 0 2024-02-15T18:27:09.003 INFO:tasks.workunit.client.0.smithi084.stdout:4/761: chown d2/d64/c83 1936 1 2024-02-15T18:27:09.003 INFO:tasks.workunit.client.0.smithi084.stdout:6/695: dwrite d14/d22/d25/d2f/da9/fa8 [0,4194304] 0 2024-02-15T18:27:09.004 INFO:tasks.workunit.client.0.smithi084.stdout:6/696: write d14/d22/d25/d2f/d31/d30/d93/d99/fc2 [962160,51692] 0 2024-02-15T18:27:09.004 INFO:tasks.workunit.client.1.smithi133.stdout:0/428: mknod d9/d10/d22/d2f/c92 0 2024-02-15T18:27:09.004 INFO:tasks.workunit.client.1.smithi133.stdout:1/602: write d6/fd [2996773,40302] 0 2024-02-15T18:27:09.004 INFO:tasks.workunit.client.1.smithi133.stdout:7/280: mkdir d9/d36/d3d/d4c/d5e 0 2024-02-15T18:27:09.005 INFO:tasks.workunit.client.0.smithi084.stdout:5/770: getdents d9/d23 0 2024-02-15T18:27:09.007 INFO:tasks.workunit.client.1.smithi133.stdout:3/452: creat d0/d15/d37/f90 x:0 0 0 2024-02-15T18:27:09.008 INFO:tasks.workunit.client.1.smithi133.stdout:0/429: mknod d9/d10/d19/d29/d67/d68/c93 0 2024-02-15T18:27:09.010 INFO:tasks.workunit.client.0.smithi084.stdout:3/678: sync 2024-02-15T18:27:09.013 INFO:tasks.workunit.client.1.smithi133.stdout:0/430: mknod d9/c94 0 2024-02-15T18:27:09.013 INFO:tasks.workunit.client.1.smithi133.stdout:7/281: mknod d9/d19/c5f 0 2024-02-15T18:27:09.013 INFO:tasks.workunit.client.1.smithi133.stdout:1/603: unlink d6/d1e/f7b 0 2024-02-15T18:27:09.014 INFO:tasks.workunit.client.1.smithi133.stdout:7/282: write d9/d36/d39/f5c [161742,100063] 0 2024-02-15T18:27:09.014 INFO:tasks.workunit.client.1.smithi133.stdout:7/283: write d9/d36/f32 [2678661,67397] 0 2024-02-15T18:27:09.014 INFO:tasks.workunit.client.1.smithi133.stdout:7/284: fsync d9/d36/d3d/f43 0 2024-02-15T18:27:09.015 INFO:tasks.workunit.client.1.smithi133.stdout:0/431: mkdir d9/d10/d22/d32/d7f/d82/d95 0 2024-02-15T18:27:09.016 INFO:tasks.workunit.client.0.smithi084.stdout:7/680: mkdir df/d1d/d1a/d6a/d8e/d79/ddc 0 2024-02-15T18:27:09.017 INFO:tasks.workunit.client.0.smithi084.stdout:3/679: creat d8/d1f/dbf/fe9 x:0 0 0 2024-02-15T18:27:09.019 INFO:tasks.workunit.client.0.smithi084.stdout:3/680: mkdir d8/d40/d43/d71/d8c/d94/da3/dea 0 2024-02-15T18:27:09.019 INFO:tasks.workunit.client.1.smithi133.stdout:1/604: rename d6/d1e/c28 to d6/d1e/d3a/d79/d8e/cdd 0 2024-02-15T18:27:09.019 INFO:tasks.workunit.client.1.smithi133.stdout:7/285: rmdir d9/d36/d3d/d4c/d5e 0 2024-02-15T18:27:09.022 INFO:tasks.workunit.client.0.smithi084.stdout:3/681: truncate d8/d40/d43/d71/d8c/d94/fbd 3630065 0 2024-02-15T18:27:09.022 INFO:tasks.workunit.client.0.smithi084.stdout:5/771: dread d9/d23/fcd [0,4194304] 0 2024-02-15T18:27:09.022 INFO:tasks.workunit.client.0.smithi084.stdout:5/772: truncate d9/f12 4516246 0 2024-02-15T18:27:09.023 INFO:tasks.workunit.client.1.smithi133.stdout:4/302: write d2/f9 [4894971,76684] 0 2024-02-15T18:27:09.023 INFO:tasks.workunit.client.0.smithi084.stdout:3/682: read d8/d40/d43/d71/f9b [745925,46120] 0 2024-02-15T18:27:09.024 INFO:tasks.workunit.client.1.smithi133.stdout:0/432: rename d9/d10/d22/d2f/d30 to d9/d10/d19/d29/d67/d68/d96 0 2024-02-15T18:27:09.024 INFO:tasks.workunit.client.1.smithi133.stdout:1/605: mknod d6/d2a/d59/d5a/da4/cde 0 2024-02-15T18:27:09.024 INFO:tasks.workunit.client.1.smithi133.stdout:7/286: mknod d9/c60 0 2024-02-15T18:27:09.024 INFO:tasks.workunit.client.1.smithi133.stdout:7/287: truncate d9/db/d16/f25 5523640 0 2024-02-15T18:27:09.025 INFO:tasks.workunit.client.0.smithi084.stdout:7/681: dread df/d1d/d1a/d4b/f7e [0,4194304] 0 2024-02-15T18:27:09.025 INFO:tasks.workunit.client.1.smithi133.stdout:4/303: rmdir d2/d5/d2b/d21 39 2024-02-15T18:27:09.026 INFO:tasks.workunit.client.1.smithi133.stdout:0/433: getdents d9/d10/d19/d29/d67/d68/d96/d44 0 2024-02-15T18:27:09.028 INFO:tasks.workunit.client.1.smithi133.stdout:7/288: rename d9/d36/d31/f58 to d9/d36/d3d/d4c/f61 0 2024-02-15T18:27:09.029 INFO:tasks.workunit.client.1.smithi133.stdout:1/606: write d6/d2a/f2f [139141,10122] 0 2024-02-15T18:27:09.029 INFO:tasks.workunit.client.1.smithi133.stdout:7/289: write d9/d36/d31/f59 [2126115,18883] 0 2024-02-15T18:27:09.029 INFO:tasks.workunit.client.1.smithi133.stdout:7/290: truncate d9/db/f11 5978178 0 2024-02-15T18:27:09.031 INFO:tasks.workunit.client.1.smithi133.stdout:1/607: creat d6/d1e/d3a/d82/fdf x:0 0 0 2024-02-15T18:27:09.031 INFO:tasks.workunit.client.1.smithi133.stdout:1/608: write d6/d1e/d41/d7c/d7e/fc9 [28067,104145] 0 2024-02-15T18:27:09.033 INFO:tasks.workunit.client.1.smithi133.stdout:7/291: mkdir d9/da/d48/d62 0 2024-02-15T18:27:09.033 INFO:tasks.workunit.client.0.smithi084.stdout:5/773: symlink d9/d35/d65/d7f/dd6/deb/df0/lfd 0 2024-02-15T18:27:09.046 INFO:tasks.workunit.client.1.smithi133.stdout:9/337: dwrite d0/d8/d9/d12/f1b [0,4194304] 0 2024-02-15T18:27:09.046 INFO:tasks.workunit.client.0.smithi084.stdout:3/683: dread d8/d1f/d2d/f96 [0,4194304] 0 2024-02-15T18:27:09.049 INFO:tasks.workunit.client.1.smithi133.stdout:9/338: symlink d0/d8/d9/d12/l69 0 2024-02-15T18:27:09.049 INFO:tasks.workunit.client.1.smithi133.stdout:9/339: write d0/d8/d9/d3c/f62 [5240050,7253] 0 2024-02-15T18:27:09.053 INFO:tasks.workunit.client.1.smithi133.stdout:9/340: creat d0/d8/d9/d12/d2a/d42/f6a x:0 0 0 2024-02-15T18:27:09.055 INFO:tasks.workunit.client.1.smithi133.stdout:9/341: mkdir d0/d8/d9/d3c/d6b 0 2024-02-15T18:27:09.059 INFO:tasks.workunit.client.1.smithi133.stdout:3/453: dwrite d0/d15/d54/f8a [0,4194304] 0 2024-02-15T18:27:09.059 INFO:tasks.workunit.client.1.smithi133.stdout:3/454: dread d0/d15/d2b/f45 [0,4194304] 0 2024-02-15T18:27:09.060 INFO:tasks.workunit.client.1.smithi133.stdout:9/342: rmdir d0/d8/d10/d4d 39 2024-02-15T18:27:09.060 INFO:tasks.workunit.client.1.smithi133.stdout:9/343: chown d0/d8/d9/d12/d2a/l33 475109 1 2024-02-15T18:27:09.061 INFO:tasks.workunit.client.1.smithi133.stdout:9/344: read - d0/d8/d10/d4d/f66 zero size 2024-02-15T18:27:09.061 INFO:tasks.workunit.client.1.smithi133.stdout:3/455: rename d0/l6c to d0/d15/d2b/d62/l91 0 2024-02-15T18:27:09.061 INFO:tasks.workunit.client.1.smithi133.stdout:3/456: fdatasync d0/f50 0 2024-02-15T18:27:09.061 INFO:tasks.workunit.client.1.smithi133.stdout:3/457: fdatasync d0/d15/f16 0 2024-02-15T18:27:09.062 INFO:tasks.workunit.client.1.smithi133.stdout:5/335: dwrite f10 [0,4194304] 0 2024-02-15T18:27:09.062 INFO:tasks.workunit.client.1.smithi133.stdout:9/345: mkdir d0/d8/d6c 0 2024-02-15T18:27:09.063 INFO:tasks.workunit.client.1.smithi133.stdout:3/458: mknod d0/d15/d2b/d39/d3f/d3e/c92 0 2024-02-15T18:27:09.064 INFO:tasks.workunit.client.1.smithi133.stdout:5/336: dread d17/f47 [0,4194304] 0 2024-02-15T18:27:09.064 INFO:tasks.workunit.client.1.smithi133.stdout:5/337: truncate d17/d26/f5d 1093731 0 2024-02-15T18:27:09.064 INFO:tasks.workunit.client.1.smithi133.stdout:5/338: write d17/d20/d4f/f64 [959966,69088] 0 2024-02-15T18:27:09.064 INFO:tasks.workunit.client.1.smithi133.stdout:5/339: write d17/d20/f2f [1025385,55588] 0 2024-02-15T18:27:09.064 INFO:tasks.workunit.client.1.smithi133.stdout:3/459: write d0/d15/d2b/f44 [539507,113416] 0 2024-02-15T18:27:09.068 INFO:tasks.workunit.client.1.smithi133.stdout:3/460: mknod d0/d15/d2b/d62/d74/c93 0 2024-02-15T18:27:09.068 INFO:tasks.workunit.client.1.smithi133.stdout:3/461: write d0/d15/d2b/d39/f55 [746267,3859] 0 2024-02-15T18:27:09.068 INFO:tasks.workunit.client.1.smithi133.stdout:9/346: write d0/f5 [771995,90357] 0 2024-02-15T18:27:09.069 INFO:tasks.workunit.client.1.smithi133.stdout:5/340: mkdir d17/d20/d32/d38/d70 0 2024-02-15T18:27:09.069 INFO:tasks.workunit.client.1.smithi133.stdout:3/462: symlink d0/d15/d54/l94 0 2024-02-15T18:27:09.071 INFO:tasks.workunit.client.1.smithi133.stdout:9/347: creat d0/d8/d9/d12/f6d x:0 0 0 2024-02-15T18:27:09.072 INFO:tasks.workunit.client.1.smithi133.stdout:9/348: truncate d0/d8/f22 3561958 0 2024-02-15T18:27:09.073 INFO:tasks.workunit.client.1.smithi133.stdout:9/349: link d0/d8/c28 d0/d8/c6e 0 2024-02-15T18:27:09.074 INFO:tasks.workunit.client.1.smithi133.stdout:2/417: dwrite d7/d2c/d46/f72 [0,4194304] 0 2024-02-15T18:27:09.075 INFO:tasks.workunit.client.1.smithi133.stdout:9/350: unlink d0/d8/d9/d12/f6d 0 2024-02-15T18:27:09.075 INFO:tasks.workunit.client.1.smithi133.stdout:9/351: fdatasync d0/d8/d9/f3b 0 2024-02-15T18:27:09.076 INFO:tasks.workunit.client.0.smithi084.stdout:4/762: dwrite d2/d4/d28/d3d/da4/fc2 [4194304,4194304] 0 2024-02-15T18:27:09.076 INFO:tasks.workunit.client.0.smithi084.stdout:4/763: stat d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4 0 2024-02-15T18:27:09.078 INFO:tasks.workunit.client.0.smithi084.stdout:4/764: write d2/d4/d28/f38 [4187025,103673] 0 2024-02-15T18:27:09.080 INFO:tasks.workunit.client.1.smithi133.stdout:5/341: dread ff [0,4194304] 0 2024-02-15T18:27:09.082 INFO:tasks.workunit.client.1.smithi133.stdout:5/342: mkdir d17/d20/d5e/d71 0 2024-02-15T18:27:09.082 INFO:tasks.workunit.client.1.smithi133.stdout:5/343: chown c7 3325 1 2024-02-15T18:27:09.082 INFO:tasks.workunit.client.1.smithi133.stdout:5/344: chown d17/d20/d32/d38/f48 21 1 2024-02-15T18:27:09.083 INFO:tasks.workunit.client.0.smithi084.stdout:4/765: write d2/d64/d74/f78 [2624560,111492] 0 2024-02-15T18:27:09.088 INFO:tasks.workunit.client.0.smithi084.stdout:4/766: mknod d2/d4/d28/d71/cdd 0 2024-02-15T18:27:09.088 INFO:tasks.workunit.client.0.smithi084.stdout:4/767: fsync d2/f21 0 2024-02-15T18:27:09.089 INFO:tasks.workunit.client.1.smithi133.stdout:0/434: dwrite d9/d1c/f1d [4194304,4194304] 0 2024-02-15T18:27:09.090 INFO:tasks.workunit.client.1.smithi133.stdout:1/609: dwrite d6/fb1 [0,4194304] 0 2024-02-15T18:27:09.090 INFO:tasks.workunit.client.0.smithi084.stdout:4/768: unlink d2/d2b/d47/d31/d61/f8c 0 2024-02-15T18:27:09.094 INFO:tasks.workunit.client.0.smithi084.stdout:5/774: dwrite d9/d5b/d7e/d92/fb0 [0,4194304] 0 2024-02-15T18:27:09.094 INFO:tasks.workunit.client.0.smithi084.stdout:5/775: chown d9/d35/d65/d7f/dd6/deb/ffc 95 1 2024-02-15T18:27:09.094 INFO:tasks.workunit.client.0.smithi084.stdout:5/776: fsync d9/d5b/fae 0 2024-02-15T18:27:09.094 INFO:tasks.workunit.client.1.smithi133.stdout:0/435: rename f7 to d9/d10/d22/d32/d7f/d82/d95/f97 0 2024-02-15T18:27:09.095 INFO:tasks.workunit.client.1.smithi133.stdout:0/436: stat d9/d10/d22 0 2024-02-15T18:27:09.096 INFO:tasks.workunit.client.0.smithi084.stdout:7/682: dwrite df/d1d/d1a/d4d/f6f [0,4194304] 0 2024-02-15T18:27:09.099 INFO:tasks.workunit.client.0.smithi084.stdout:7/683: creat df/d1d/d1a/d6a/d8b/d48/dca/fdd x:0 0 0 2024-02-15T18:27:09.102 INFO:tasks.workunit.client.0.smithi084.stdout:7/684: getdents df/d1d/d1a/d4b 0 2024-02-15T18:27:09.104 INFO:tasks.workunit.client.0.smithi084.stdout:7/685: read df/d1d/d1a/d4d/f6f [3792748,114663] 0 2024-02-15T18:27:09.104 INFO:tasks.workunit.client.1.smithi133.stdout:7/292: dwrite d9/db/f1f [0,4194304] 0 2024-02-15T18:27:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.112+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3c410dd90 con 0x7fd3ac0610a0 2024-02-15T18:27:09.112 INFO:tasks.workunit.client.0.smithi084.stdout:3/684: dwrite d8/d40/d43/f8b [8388608,4194304] 0 2024-02-15T18:27:09.112 INFO:tasks.workunit.client.0.smithi084.stdout:3/685: fdatasync d8/d40/d58/d80/f2b 0 2024-02-15T18:27:09.123 INFO:tasks.workunit.client.1.smithi133.stdout:7/293: mkdir d9/db/d55/d63 0 2024-02-15T18:27:09.124 INFO:tasks.workunit.client.1.smithi133.stdout:7/294: mkdir d9/da/d48/d62/d64 0 2024-02-15T18:27:09.124 INFO:tasks.workunit.client.1.smithi133.stdout:7/295: write d9/d36/d31/f59 [812037,115044] 0 2024-02-15T18:27:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.127+0000 7fd3b2ffd700 1 -- 172.21.15.84:0/2222754534 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd3c410dd90 con 0x7fd3ac0610a0 2024-02-15T18:27:09.125 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:27:09.125 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (6m) 23s ago 8m 15.4M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:27:09.125 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (8m) 23s ago 8m 6387k - 16.2.4 8d91d370c2b8 cfe2961e55e3 2024-02-15T18:27:09.125 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (7m) 26s ago 7m 6400k - 16.2.4 8d91d370c2b8 d52ceb5fe65b 2024-02-15T18:27:09.125 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (6m) 23s ago 7m 34.4M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:27:09.125 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (2m) 23s ago 2m 82.1M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:27:09.125 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (2m) 23s ago 2m 12.6M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:27:09.125 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (3m) 26s ago 3m 120M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (2m) 26s ago 2m 13.2M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (40s) 23s ago 9m 409M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (77s) 26s ago 7m 53.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc db78861bd359 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (9m) 23s ago 9m 51.2M 2048M 16.2.4 8d91d370c2b8 77f1f72e867c 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (7m) 26s ago 7m 47.7M 2048M 16.2.4 8d91d370c2b8 c65c0defe0dd 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (7m) 23s ago 7m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (6m) 26s ago 6m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (6m) 23s ago 6m 87.1M 4096M 16.2.4 8d91d370c2b8 20023f9a2292 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 23s ago 6m 88.5M 4096M 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (5m) 23s ago 5m 72.5M 4096M 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (5m) 26s ago 5m 82.3M 4096M 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (4m) 26s ago 4m 78.8M 4096M 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (4m) 26s ago 4m 83.8M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:27:09.126 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (46s) 23s ago 7m 44.0M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:27:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd3ac0610a0 msgr2=0x7fd3ac063560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd3ac0610a0 0x7fd3ac063560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd3c4067ac0 tx=0x7fd3bc004d00).stop 2024-02-15T18:27:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c4069540 msgr2=0x7fd3c410ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c4069540 0x7fd3c410ccb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fd3b80097f0 tx=0x7fd3b800b040).stop 2024-02-15T18:27:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 shutdown_connections 2024-02-15T18:27:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd3ac0610a0 0x7fd3ac063560 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c40680c0 0x7fd3c410c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 --2- 172.21.15.84:0/2222754534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3c4069540 0x7fd3c410ccb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 >> 172.21.15.84:0/2222754534 conn(0x7fd3c4063530 msgr2=0x7fd3c4101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 shutdown_connections 2024-02-15T18:27:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.129+0000 7fd3c359e700 1 -- 172.21.15.84:0/2222754534 wait complete. 2024-02-15T18:27:09.128 INFO:tasks.workunit.client.1.smithi133.stdout:4/304: dwrite d2/d5/d2b/d21/d3b/d49/f4a [4194304,4194304] 0 2024-02-15T18:27:09.129 INFO:tasks.workunit.client.1.smithi133.stdout:4/305: link c1 d2/d5/d2b/d21/d36/c6f 0 2024-02-15T18:27:09.129 INFO:tasks.workunit.client.1.smithi133.stdout:4/306: symlink d2/d48/d5c/l70 0 2024-02-15T18:27:09.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/307: chown d2/d5/d2b/d21/f31 0 1 2024-02-15T18:27:09.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/308: chown d2/d5/d2b/d21/d2d/d44/d51/d55/f6c 7227804 1 2024-02-15T18:27:09.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/309: chown d2/d5/l17 1518 1 2024-02-15T18:27:09.131 INFO:tasks.workunit.client.1.smithi133.stdout:5/345: dwrite d17/f47 [0,4194304] 0 2024-02-15T18:27:09.131 INFO:tasks.workunit.client.1.smithi133.stdout:4/310: rename d2/f58 to d2/d5/d2b/d21/d2d/f71 0 2024-02-15T18:27:09.132 INFO:tasks.workunit.client.1.smithi133.stdout:2/418: dwrite d7/d18/d32/d65/f7d [0,4194304] 0 2024-02-15T18:27:09.132 INFO:tasks.workunit.client.1.smithi133.stdout:2/419: chown d7/d2c/d31/f4b 104 1 2024-02-15T18:27:09.133 INFO:tasks.workunit.client.1.smithi133.stdout:9/352: dwrite d0/d8/d10/f15 [0,4194304] 0 2024-02-15T18:27:09.133 INFO:tasks.workunit.client.1.smithi133.stdout:9/353: chown d0/d8/d10/d4d/f66 4328815 1 2024-02-15T18:27:09.135 INFO:tasks.workunit.client.0.smithi084.stdout:5/777: dwrite d9/d5b/d79/fc1 [0,4194304] 0 2024-02-15T18:27:09.135 INFO:tasks.workunit.client.0.smithi084.stdout:7/686: dwrite df/d1d/d1a/f26 [4194304,4194304] 0 2024-02-15T18:27:09.136 INFO:tasks.workunit.client.1.smithi133.stdout:1/610: dwrite d6/d2a/f48 [0,4194304] 0 2024-02-15T18:27:09.136 INFO:tasks.workunit.client.1.smithi133.stdout:5/346: rmdir d17/d20/d5e/d71 0 2024-02-15T18:27:09.136 INFO:tasks.workunit.client.1.smithi133.stdout:1/611: write d6/d2a/f3f [990254,99336] 0 2024-02-15T18:27:09.138 INFO:tasks.workunit.client.0.smithi084.stdout:5/778: write d9/da/f99 [7584184,77058] 0 2024-02-15T18:27:09.138 INFO:tasks.workunit.client.1.smithi133.stdout:0/437: rmdir d9 39 2024-02-15T18:27:09.140 INFO:tasks.workunit.client.1.smithi133.stdout:4/311: creat d2/f72 x:0 0 0 2024-02-15T18:27:09.147 INFO:tasks.workunit.client.1.smithi133.stdout:5/347: dread d17/d20/f57 [0,4194304] 0 2024-02-15T18:27:09.147 INFO:tasks.workunit.client.1.smithi133.stdout:2/420: rename d7/l8 to d7/d2c/d3b/l87 0 2024-02-15T18:27:09.148 INFO:tasks.workunit.client.0.smithi084.stdout:5/779: rename d9/d23 to d9/da/d3d/d44/d55/dfe 0 2024-02-15T18:27:09.148 INFO:tasks.workunit.client.0.smithi084.stdout:7/687: mknod df/d1d/d1a/d4b/cde 0 2024-02-15T18:27:09.148 INFO:tasks.workunit.client.0.smithi084.stdout:7/688: read df/d1d/d1a/f81 [1066553,44855] 0 2024-02-15T18:27:09.148 INFO:tasks.workunit.client.0.smithi084.stdout:7/689: chown df/d1d/d1a/d4d/d55/d88/d98 1336353 1 2024-02-15T18:27:09.149 INFO:tasks.workunit.client.1.smithi133.stdout:5/348: dread d17/d26/f5d [0,4194304] 0 2024-02-15T18:27:09.149 INFO:tasks.workunit.client.1.smithi133.stdout:9/354: creat d0/d8/d9/d49/f6f x:0 0 0 2024-02-15T18:27:09.150 INFO:tasks.workunit.client.1.smithi133.stdout:5/349: chown d17/d26/l1f 435648777 1 2024-02-15T18:27:09.151 INFO:tasks.workunit.client.0.smithi084.stdout:7/690: unlink df/d70/l86 0 2024-02-15T18:27:09.152 INFO:tasks.workunit.client.0.smithi084.stdout:7/691: truncate df/d1d/f18 1118668 0 2024-02-15T18:27:09.153 INFO:tasks.workunit.client.0.smithi084.stdout:7/692: creat df/d1d/d1a/d6a/d8b/d48/fdf x:0 0 0 2024-02-15T18:27:09.154 INFO:tasks.workunit.client.0.smithi084.stdout:7/693: creat df/d1d/d44/db9/fe0 x:0 0 0 2024-02-15T18:27:09.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/612: symlink d6/d2a/d59/d5a/da4/le0 0 2024-02-15T18:27:09.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/613: fdatasync d6/d1e/d3a/d82/fdf 0 2024-02-15T18:27:09.156 INFO:tasks.workunit.client.0.smithi084.stdout:7/694: mknod df/d1d/d1a/d6a/d8b/ce1 0 2024-02-15T18:27:09.156 INFO:tasks.workunit.client.0.smithi084.stdout:7/695: write df/d1d/d1a/d6a/d8b/d7f/fb1 [229006,15207] 0 2024-02-15T18:27:09.157 INFO:tasks.workunit.client.1.smithi133.stdout:0/438: creat d9/d10/d19/f98 x:0 0 0 2024-02-15T18:27:09.158 INFO:tasks.workunit.client.0.smithi084.stdout:7/696: rmdir df/d1d/d1a/d6a/d8b/d7f 39 2024-02-15T18:27:09.158 INFO:tasks.workunit.client.1.smithi133.stdout:2/421: dread d7/db/f1d [4194304,4194304] 0 2024-02-15T18:27:09.158 INFO:tasks.workunit.client.1.smithi133.stdout:4/312: creat d2/d5/d2b/d21/d2d/d44/d51/d55/d5e/f73 x:0 0 0 2024-02-15T18:27:09.159 INFO:tasks.workunit.client.1.smithi133.stdout:2/422: read d7/d18/f40 [3392404,103802] 0 2024-02-15T18:27:09.160 INFO:tasks.workunit.client.1.smithi133.stdout:2/423: write d7/f26 [1608872,88690] 0 2024-02-15T18:27:09.160 INFO:tasks.workunit.client.0.smithi084.stdout:7/697: creat df/d1d/d1a/d4d/fe2 x:0 0 0 2024-02-15T18:27:09.161 INFO:tasks.workunit.client.1.smithi133.stdout:9/355: symlink d0/d8/d9/d12/d2a/d42/l70 0 2024-02-15T18:27:09.161 INFO:tasks.workunit.client.1.smithi133.stdout:1/614: mknod d6/d1e/d3a/d82/d85/d67/ddb/ce1 0 2024-02-15T18:27:09.164 INFO:tasks.workunit.client.1.smithi133.stdout:0/439: rename f4 to d9/d10/d22/d32/d7f/d82/d95/f99 0 2024-02-15T18:27:09.166 INFO:tasks.workunit.client.1.smithi133.stdout:2/424: creat d7/d2c/d31/f88 x:0 0 0 2024-02-15T18:27:09.168 INFO:tasks.workunit.client.1.smithi133.stdout:9/356: mknod d0/d8/d9/d3c/c71 0 2024-02-15T18:27:09.170 INFO:tasks.workunit.client.1.smithi133.stdout:0/440: rename d9/d10/d19/d1a/l6d to d9/d10/d85/l9a 0 2024-02-15T18:27:09.175 INFO:tasks.workunit.client.0.smithi084.stdout:5/780: dread d9/da/d3d/f50 [0,4194304] 0 2024-02-15T18:27:09.175 INFO:tasks.workunit.client.0.smithi084.stdout:5/781: truncate d9/da/f38 2754148 0 2024-02-15T18:27:09.175 INFO:tasks.workunit.client.1.smithi133.stdout:0/441: write d9/d10/d19/d1a/f61 [2326650,93174] 0 2024-02-15T18:27:09.179 INFO:tasks.workunit.client.1.smithi133.stdout:5/350: dwrite d17/f46 [0,4194304] 0 2024-02-15T18:27:09.180 INFO:tasks.workunit.client.1.smithi133.stdout:0/442: symlink d9/d10/d19/d29/l9b 0 2024-02-15T18:27:09.194 INFO:tasks.workunit.client.1.smithi133.stdout:4/313: dwrite d2/d5/d2b/f1a [0,4194304] 0 2024-02-15T18:27:09.194 INFO:tasks.workunit.client.1.smithi133.stdout:4/314: write d2/d5/d2b/f1a [4371043,83405] 0 2024-02-15T18:27:09.196 INFO:tasks.workunit.client.0.smithi084.stdout:0/691: sync 2024-02-15T18:27:09.207 INFO:tasks.workunit.client.0.smithi084.stdout:0/692: dread d0/f37 [0,4194304] 0 2024-02-15T18:27:09.207 INFO:tasks.workunit.client.1.smithi133.stdout:9/357: dwrite d0/d8/d9/f31 [0,4194304] 0 2024-02-15T18:27:09.208 INFO:tasks.workunit.client.1.smithi133.stdout:9/358: creat d0/d8/d6c/f72 x:0 0 0 2024-02-15T18:27:09.208 INFO:tasks.workunit.client.0.smithi084.stdout:0/693: symlink d0/d4/d3a/ld1 0 2024-02-15T18:27:09.209 INFO:tasks.workunit.client.0.smithi084.stdout:7/698: dwrite df/d1d/d1a/f28 [0,4194304] 0 2024-02-15T18:27:09.209 INFO:tasks.workunit.client.0.smithi084.stdout:7/699: fdatasync df/d1d/d1a/d6a/d8e/f83 0 2024-02-15T18:27:09.209 INFO:tasks.workunit.client.0.smithi084.stdout:7/700: fsync df/d1d/d1a/d6a/d8b/d7f/fd4 0 2024-02-15T18:27:09.210 INFO:tasks.workunit.client.1.smithi133.stdout:2/425: dwrite d7/d18/d32/f79 [0,4194304] 0 2024-02-15T18:27:09.210 INFO:tasks.workunit.client.1.smithi133.stdout:9/359: mknod d0/d8/d9/d12/d4f/c73 0 2024-02-15T18:27:09.210 INFO:tasks.workunit.client.0.smithi084.stdout:5/782: dwrite d9/dc6/ff2 [0,4194304] 0 2024-02-15T18:27:09.210 INFO:tasks.workunit.client.0.smithi084.stdout:0/694: rename d0/d39/l5b to d0/d4/da8/dc5/ld2 0 2024-02-15T18:27:09.212 INFO:tasks.workunit.client.0.smithi084.stdout:7/701: creat df/d1d/d1a/d6a/d8b/da5/db6/fe3 x:0 0 0 2024-02-15T18:27:09.212 INFO:tasks.workunit.client.0.smithi084.stdout:7/702: fsync df/d1d/d1a/f53 0 2024-02-15T18:27:09.212 INFO:tasks.workunit.client.0.smithi084.stdout:5/783: write d9/da/d3d/d44/d55/fc0 [3141002,57279] 0 2024-02-15T18:27:09.214 INFO:tasks.workunit.client.1.smithi133.stdout:9/360: write d0/d8/d9/d12/d2a/f2e [1636392,114423] 0 2024-02-15T18:27:09.214 INFO:tasks.workunit.client.0.smithi084.stdout:7/703: write df/d1d/d1a/d4b/f50 [2877371,52599] 0 2024-02-15T18:27:09.215 INFO:tasks.workunit.client.1.smithi133.stdout:0/443: rename d9/d10/d22/d32/d7f/d82 to d9/d10/d19/d29/d67/d68/d9c 0 2024-02-15T18:27:09.216 INFO:tasks.workunit.client.1.smithi133.stdout:0/444: write d9/d1c/f1d [5771835,79383] 0 2024-02-15T18:27:09.218 INFO:tasks.workunit.client.0.smithi084.stdout:5/784: mkdir d9/d5b/d79/db7/dff 0 2024-02-15T18:27:09.219 INFO:tasks.workunit.client.0.smithi084.stdout:7/704: creat df/d1d/d1a/d6a/d8b/da5/db6/fe4 x:0 0 0 2024-02-15T18:27:09.219 INFO:tasks.workunit.client.1.smithi133.stdout:2/426: mknod d7/d2c/d3b/c89 0 2024-02-15T18:27:09.219 INFO:tasks.workunit.client.1.smithi133.stdout:2/427: write d7/d2c/d31/f6a [464582,102698] 0 2024-02-15T18:27:09.221 INFO:tasks.workunit.client.0.smithi084.stdout:5/785: rename d9/da/d3d/l89 to d9/d35/d65/l100 0 2024-02-15T18:27:09.221 INFO:tasks.workunit.client.1.smithi133.stdout:0/445: truncate d9/d10/f17 177371 0 2024-02-15T18:27:09.221 INFO:tasks.workunit.client.1.smithi133.stdout:0/446: stat d9/d10/d19/d29/d67/d68/d96 0 2024-02-15T18:27:09.222 INFO:tasks.workunit.client.1.smithi133.stdout:0/447: creat d9/d10/d19/d1a/f9d x:0 0 0 2024-02-15T18:27:09.222 INFO:tasks.workunit.client.0.smithi084.stdout:5/786: creat d9/d5f/d68/d9a/f101 x:0 0 0 2024-02-15T18:27:09.223 INFO:tasks.workunit.client.0.smithi084.stdout:5/787: getdents d9/d5f/d68/d9a/d8d/de5 0 2024-02-15T18:27:09.224 INFO:tasks.workunit.client.0.smithi084.stdout:5/788: rename d9/d5b/d7e/d92/f9e to d9/d5b/d79/db7/f102 0 2024-02-15T18:27:09.224 INFO:tasks.workunit.client.0.smithi084.stdout:5/789: readlink d9/da/d3d/d44/d55/d70/d84/ldb 0 2024-02-15T18:27:09.225 INFO:tasks.workunit.client.0.smithi084.stdout:5/790: getdents d9/dc6 0 2024-02-15T18:27:09.226 INFO:tasks.workunit.client.1.smithi133.stdout:2/428: write d7/d2c/d31/f4b [887832,76665] 0 2024-02-15T18:27:09.226 INFO:tasks.workunit.client.1.smithi133.stdout:9/361: write d0/f5 [3217380,49399] 0 2024-02-15T18:27:09.228 INFO:tasks.workunit.client.0.smithi084.stdout:5/791: getdents d9/da/d3d/d44/d55/d70/d84 0 2024-02-15T18:27:09.231 INFO:tasks.workunit.client.0.smithi084.stdout:7/705: dread df/d1d/d1a/d4d/d55/f7a [0,4194304] 0 2024-02-15T18:27:09.231 INFO:tasks.workunit.client.0.smithi084.stdout:7/706: readlink df/d1d/d44/l49 0 2024-02-15T18:27:09.231 INFO:tasks.workunit.client.0.smithi084.stdout:5/792: rename d9/d5f/d68/d9a/d8d/l8e to d9/d5f/d68/l103 0 2024-02-15T18:27:09.233 INFO:tasks.workunit.client.1.smithi133.stdout:4/315: dwrite d2/f9 [4194304,4194304] 0 2024-02-15T18:27:09.233 INFO:tasks.workunit.client.0.smithi084.stdout:7/707: mkdir df/d1d/d1a/d6a/d8b/da5/db6/de5 0 2024-02-15T18:27:09.233 INFO:tasks.workunit.client.0.smithi084.stdout:5/793: symlink d9/d35/d65/d7f/dd6/l104 0 2024-02-15T18:27:09.234 INFO:tasks.workunit.client.1.smithi133.stdout:9/362: write d0/f6 [395281,41726] 0 2024-02-15T18:27:09.237 INFO:tasks.workunit.client.0.smithi084.stdout:7/708: creat df/d1d/d1a/d6a/fe6 x:0 0 0 2024-02-15T18:27:09.240 INFO:tasks.workunit.client.0.smithi084.stdout:0/695: dwrite d0/d4/d1b/d26/f84 [0,4194304] 0 2024-02-15T18:27:09.240 INFO:tasks.workunit.client.0.smithi084.stdout:0/696: truncate d0/d4/d3a/fa5 877093 0 2024-02-15T18:27:09.241 INFO:tasks.workunit.client.0.smithi084.stdout:5/794: truncate d9/f1e 7529482 0 2024-02-15T18:27:09.242 INFO:tasks.workunit.client.1.smithi133.stdout:9/363: symlink d0/d8/d6c/l74 0 2024-02-15T18:27:09.245 INFO:tasks.workunit.client.0.smithi084.stdout:7/709: unlink df/d1d/d44/db9/fe0 0 2024-02-15T18:27:09.246 INFO:tasks.workunit.client.0.smithi084.stdout:0/697: creat d0/d2f/d3f/d4f/d59/da7/fd3 x:0 0 0 2024-02-15T18:27:09.247 INFO:tasks.workunit.client.0.smithi084.stdout:0/698: write d0/d1e/f44 [1113827,92529] 0 2024-02-15T18:27:09.247 INFO:tasks.workunit.client.0.smithi084.stdout:0/699: chown d0/d4/d3a/f74 1870 1 2024-02-15T18:27:09.247 INFO:tasks.workunit.client.0.smithi084.stdout:0/700: chown d0/d4/da8/lc8 548 1 2024-02-15T18:27:09.247 INFO:tasks.workunit.client.0.smithi084.stdout:0/701: dread - d0/d1e/da2/fb2 zero size 2024-02-15T18:27:09.248 INFO:tasks.workunit.client.1.smithi133.stdout:0/448: dwrite d9/d2b/f45 [0,4194304] 0 2024-02-15T18:27:09.249 INFO:tasks.workunit.client.1.smithi133.stdout:4/316: dwrite d2/d5/d2b/d21/d3b/f66 [0,4194304] 0 2024-02-15T18:27:09.250 INFO:tasks.workunit.client.0.smithi084.stdout:7/710: read df/d1d/d1a/d4d/d55/f99 [45969,129024] 0 2024-02-15T18:27:09.250 INFO:tasks.workunit.client.0.smithi084.stdout:5/795: rename d9/d5b/d7e/db5/cde to d9/dc6/de2/c105 0 2024-02-15T18:27:09.250 INFO:tasks.workunit.client.0.smithi084.stdout:5/796: dread - d9/d35/f6e zero size 2024-02-15T18:27:09.250 INFO:tasks.workunit.client.0.smithi084.stdout:5/797: truncate d9/d5b/fae 781040 0 2024-02-15T18:27:09.250 INFO:tasks.workunit.client.0.smithi084.stdout:5/798: write d9/d5b/d79/db7/fd9 [225100,77319] 0 2024-02-15T18:27:09.250 INFO:tasks.workunit.client.0.smithi084.stdout:5/799: mknod d9/da/d3d/d44/d55/d96/c106 0 2024-02-15T18:27:09.251 INFO:tasks.workunit.client.0.smithi084.stdout:5/800: chown d9/d35/d65/d7f/c93 1384105 1 2024-02-15T18:27:09.253 INFO:tasks.workunit.client.0.smithi084.stdout:0/702: rename d0/d2f/d4b/dae/db0/fc3 to d0/d4/fd4 0 2024-02-15T18:27:09.254 INFO:tasks.workunit.client.0.smithi084.stdout:5/801: symlink d9/d35/d65/d7f/l107 0 2024-02-15T18:27:09.254 INFO:tasks.workunit.client.0.smithi084.stdout:5/802: write d9/d35/d65/fd5 [548968,31770] 0 2024-02-15T18:27:09.255 INFO:tasks.workunit.client.0.smithi084.stdout:0/703: write d0/d2f/d3f/d4c/d9a/fa3 [4093079,21864] 0 2024-02-15T18:27:09.256 INFO:tasks.workunit.client.0.smithi084.stdout:0/704: write d0/d2f/d3f/d8a/fc1 [370995,59183] 0 2024-02-15T18:27:09.257 INFO:tasks.workunit.client.0.smithi084.stdout:5/803: mkdir d9/da/d3d/d44/d55/d96/d108 0 2024-02-15T18:27:09.257 INFO:tasks.workunit.client.0.smithi084.stdout:5/804: stat d9/da/d3d/d44/d55/d70/d84/lbf 0 2024-02-15T18:27:09.259 INFO:tasks.workunit.client.1.smithi133.stdout:6/586: sync 2024-02-15T18:27:09.259 INFO:tasks.workunit.client.1.smithi133.stdout:4/317: getdents d2/d5/d2b 0 2024-02-15T18:27:09.259 INFO:tasks.workunit.client.0.smithi084.stdout:0/705: write d0/d4/d66/f72 [744836,120280] 0 2024-02-15T18:27:09.259 INFO:tasks.workunit.client.0.smithi084.stdout:5/805: symlink d9/d5b/d7e/l109 0 2024-02-15T18:27:09.260 INFO:tasks.workunit.client.0.smithi084.stdout:0/706: creat d0/d4/d1b/d7a/fd5 x:0 0 0 2024-02-15T18:27:09.262 INFO:tasks.workunit.client.0.smithi084.stdout:0/707: creat d0/d2f/d3f/d4c/d9a/fd6 x:0 0 0 2024-02-15T18:27:09.263 INFO:tasks.workunit.client.1.smithi133.stdout:4/318: write d2/f23 [3741639,22219] 0 2024-02-15T18:27:09.263 INFO:tasks.workunit.client.1.smithi133.stdout:4/319: chown d2/d5/l16 1594755 1 2024-02-15T18:27:09.264 INFO:tasks.workunit.client.0.smithi084.stdout:0/708: mkdir d0/d4/d1b/d26/d43/dd7 0 2024-02-15T18:27:09.265 INFO:tasks.workunit.client.1.smithi133.stdout:4/320: creat d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 x:0 0 0 2024-02-15T18:27:09.265 INFO:tasks.workunit.client.1.smithi133.stdout:4/321: dread - d2/d5/d2b/d21/d36/f64 zero size 2024-02-15T18:27:09.271 INFO:tasks.workunit.client.0.smithi084.stdout:0/709: getdents d0/d2f/d3f 0 2024-02-15T18:27:09.273 INFO:tasks.workunit.client.0.smithi084.stdout:0/710: rename d0/d4/d1b/d26/d43/d6d/db6 to d0/d4/da8/dd8 0 2024-02-15T18:27:09.275 INFO:tasks.workunit.client.0.smithi084.stdout:0/711: mknod d0/d4/da8/cd9 0 2024-02-15T18:27:09.278 INFO:tasks.workunit.client.0.smithi084.stdout:0/712: symlink d0/d39/d90/db1/lda 0 2024-02-15T18:27:09.280 INFO:tasks.workunit.client.0.smithi084.stdout:0/713: symlink d0/d2f/d3f/d4f/d61/d79/ldb 0 2024-02-15T18:27:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 -- 172.21.15.84:0/2711316381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f4610 msgr2=0x7f12800f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 --2- 172.21.15.84:0/2711316381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f4610 0x7f12800f4a30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f1270004660 tx=0x7f1270009b30).stop 2024-02-15T18:27:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 -- 172.21.15.84:0/2711316381 shutdown_connections 2024-02-15T18:27:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 --2- 172.21.15.84:0/2711316381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12800f5770 0x7f12800f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 --2- 172.21.15.84:0/2711316381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f4610 0x7f12800f4a30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 -- 172.21.15.84:0/2711316381 >> 172.21.15.84:0/2711316381 conn(0x7f12800f0080 msgr2=0x7f12800f24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:09.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 -- 172.21.15.84:0/2711316381 shutdown_connections 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 -- 172.21.15.84:0/2711316381 wait complete. 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 Processor -- start 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.285+0000 7f1287393700 1 -- start start 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f1287393700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12800f4610 0x7f1280068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f1287393700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f5770 0x7f12800692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f1287393700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12800698f0 con 0x7f12800f5770 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f1287393700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280069a30 con 0x7f12800f4610 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f128492e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f5770 0x7f12800692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f128492e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f5770 0x7f12800692f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42198/0 (socket says 172.21.15.84:42198) 2024-02-15T18:27:09.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f128492e700 1 -- 172.21.15.84:0/272657030 learned_addr learned my addr 172.21.15.84:0/272657030 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f128512f700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12800f4610 0x7f1280068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f128492e700 1 -- 172.21.15.84:0/272657030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12800f4610 msgr2=0x7f1280068e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f128492e700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12800f4610 0x7f1280068e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f128492e700 1 -- 172.21.15.84:0/272657030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270005040 con 0x7f12800f5770 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f128512f700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12800f4610 0x7f1280068e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f128492e700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f5770 0x7f12800692f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f127800eb70 tx=0x7f127800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f1275ffb700 1 -- 172.21.15.84:0/272657030 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12780092e0 con 0x7f12800f5770 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f1275ffb700 1 -- 172.21.15.84:0/272657030 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f127800f040 con 0x7f12800f5770 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.286+0000 7f1275ffb700 1 -- 172.21.15.84:0/272657030 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127800cae0 con 0x7f12800f5770 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.287+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12800fc980 con 0x7f12800f5770 2024-02-15T18:27:09.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.287+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12800fcec0 con 0x7f12800f5770 2024-02-15T18:27:09.285 INFO:tasks.workunit.client.0.smithi084.stdout:0/714: write d0/d4/d1b/d26/d43/f9e [3661414,58303] 0 2024-02-15T18:27:09.285 INFO:tasks.workunit.client.0.smithi084.stdout:0/715: chown d0/d4/d3a/fbf 3540 1 2024-02-15T18:27:09.285 INFO:tasks.workunit.client.0.smithi084.stdout:0/716: truncate d0/d4/d3a/d5c/fa1 82784 0 2024-02-15T18:27:09.286 INFO:tasks.workunit.client.0.smithi084.stdout:0/717: chown d0/d4/d1b/d26/d43/f76 3 1 2024-02-15T18:27:09.286 INFO:tasks.workunit.client.0.smithi084.stdout:0/718: fsync d0/f95 0 2024-02-15T18:27:09.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.288+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1280045ad0 con 0x7f12800f5770 2024-02-15T18:27:09.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.288+0000 7f1275ffb700 1 -- 172.21.15.84:0/272657030 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 28) v1 ==== 77194+0+0 (secure 0 0 0) 0x7f127801b030 con 0x7f12800f5770 2024-02-15T18:27:09.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.288+0000 7f1275ffb700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f126c061020 0x7f126c0634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:09.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.289+0000 7f1275ffb700 1 -- 172.21.15.84:0/272657030 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f127807c300 con 0x7f12800f5770 2024-02-15T18:27:09.287 INFO:tasks.workunit.client.0.smithi084.stdout:0/719: link d0/d2f/d3f/d4f/d59/fd0 d0/d2f/d4b/dc6/fdc 0 2024-02-15T18:27:09.287 INFO:tasks.workunit.client.0.smithi084.stdout:0/720: truncate d0/d2f/d3f/da4/fab 4408024 0 2024-02-15T18:27:09.287 INFO:tasks.workunit.client.0.smithi084.stdout:0/721: fdatasync d0/d4/d1b/f42 0 2024-02-15T18:27:09.287 INFO:tasks.workunit.client.0.smithi084.stdout:0/722: chown d0/d2f/d3f/d4f/d61/l64 26539 1 2024-02-15T18:27:09.287 INFO:tasks.workunit.client.0.smithi084.stdout:0/723: fsync d0/d2f/d3f/f5a 0 2024-02-15T18:27:09.288 INFO:tasks.workunit.client.0.smithi084.stdout:0/724: creat d0/d4/d3a/d82/dcb/fdd x:0 0 0 2024-02-15T18:27:09.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.291+0000 7f128512f700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f126c061020 0x7f126c0634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:09.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.291+0000 7f128512f700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f126c061020 0x7f126c0634e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1270004d80 tx=0x7f127000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:09.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.293+0000 7f1275ffb700 1 -- 172.21.15.84:0/272657030 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f127804c6f0 con 0x7f12800f5770 2024-02-15T18:27:09.295 INFO:tasks.workunit.client.1.smithi133.stdout:0/449: dwrite d9/d2b/f45 [0,4194304] 0 2024-02-15T18:27:09.296 INFO:tasks.workunit.client.1.smithi133.stdout:0/450: rename d9/d10/f17 to d9/d10/d22/f9e 0 2024-02-15T18:27:09.297 INFO:tasks.workunit.client.1.smithi133.stdout:0/451: readlink d9/d10/d19/d29/d67/d68/d96/d44/l8b 0 2024-02-15T18:27:09.297 INFO:tasks.workunit.client.1.smithi133.stdout:0/452: mkdir d9/d10/d22/d2f/d9f 0 2024-02-15T18:27:09.297 INFO:tasks.workunit.client.1.smithi133.stdout:0/453: fdatasync d9/d10/d19/d29/d67/d68/d96/d44/f4f 0 2024-02-15T18:27:09.298 INFO:tasks.workunit.client.1.smithi133.stdout:0/454: chown d9/d1c/f3f 74 1 2024-02-15T18:27:09.298 INFO:tasks.workunit.client.1.smithi133.stdout:0/455: getdents d9/d28 0 2024-02-15T18:27:09.299 INFO:tasks.workunit.client.1.smithi133.stdout:9/364: dwrite d0/d8/d9/d12/f3f [0,4194304] 0 2024-02-15T18:27:09.299 INFO:tasks.workunit.client.1.smithi133.stdout:9/365: chown d0/l1f 165 1 2024-02-15T18:27:09.299 INFO:tasks.workunit.client.1.smithi133.stdout:0/456: link d9/f75 d9/d10/d47/fa0 0 2024-02-15T18:27:09.299 INFO:tasks.workunit.client.1.smithi133.stdout:0/457: fsync d9/d10/d19/f78 0 2024-02-15T18:27:09.301 INFO:tasks.workunit.client.1.smithi133.stdout:9/366: rmdir d0/d8/d9/d12/d2a 39 2024-02-15T18:27:09.302 INFO:tasks.workunit.client.1.smithi133.stdout:0/458: creat d9/d10/d22/d32/d7f/fa1 x:0 0 0 2024-02-15T18:27:09.302 INFO:tasks.workunit.client.1.smithi133.stdout:9/367: mknod d0/d8/d9/c75 0 2024-02-15T18:27:09.304 INFO:tasks.workunit.client.1.smithi133.stdout:9/368: link d0/d8/d9/c75 d0/d8/d10/c76 0 2024-02-15T18:27:09.304 INFO:tasks.workunit.client.1.smithi133.stdout:9/369: chown d0/d8/c6e 23 1 2024-02-15T18:27:09.308 INFO:tasks.workunit.client.1.smithi133.stdout:9/370: write d0/d8/d10/f30 [446064,74393] 0 2024-02-15T18:27:09.310 INFO:tasks.workunit.client.1.smithi133.stdout:9/371: symlink d0/d8/d9/d12/d2a/l77 0 2024-02-15T18:27:09.311 INFO:tasks.workunit.client.1.smithi133.stdout:9/372: dread d0/d8/d9/f3b [0,4194304] 0 2024-02-15T18:27:09.311 INFO:tasks.workunit.client.0.smithi084.stdout:7/711: dwrite df/d1d/d1a/f53 [0,4194304] 0 2024-02-15T18:27:09.312 INFO:tasks.workunit.client.1.smithi133.stdout:4/322: dwrite d2/d5/d2b/d21/d2d/d44/f47 [0,4194304] 0 2024-02-15T18:27:09.312 INFO:tasks.workunit.client.1.smithi133.stdout:4/323: chown d2/d5/d2b/d21/d2d/f71 30094 1 2024-02-15T18:27:09.314 INFO:tasks.workunit.client.1.smithi133.stdout:6/587: dwrite d0/d3b/d52/f58 [0,4194304] 0 2024-02-15T18:27:09.314 INFO:tasks.workunit.client.1.smithi133.stdout:0/459: dread d9/d10/d47/d5e/f86 [0,4194304] 0 2024-02-15T18:27:09.314 INFO:tasks.workunit.client.1.smithi133.stdout:6/588: write d0/db/d29/d34/d48/f7b [91192,66362] 0 2024-02-15T18:27:09.315 INFO:tasks.workunit.client.0.smithi084.stdout:5/806: dwrite d9/da/f1b [0,4194304] 0 2024-02-15T18:27:09.315 INFO:tasks.workunit.client.0.smithi084.stdout:5/807: chown d9/da/d3d/d44/d55/dfe/l62 1184189 1 2024-02-15T18:27:09.315 INFO:tasks.workunit.client.1.smithi133.stdout:4/324: symlink d2/d48/d6a/l75 0 2024-02-15T18:27:09.315 INFO:tasks.workunit.client.1.smithi133.stdout:4/325: write d2/d5/d2b/d21/d3b/d49/f69 [626425,29617] 0 2024-02-15T18:27:09.318 INFO:tasks.workunit.client.1.smithi133.stdout:6/589: creat d0/db/fc5 x:0 0 0 2024-02-15T18:27:09.318 INFO:tasks.workunit.client.1.smithi133.stdout:6/590: stat d0/db/d29/d34/f97 0 2024-02-15T18:27:09.323 INFO:tasks.workunit.client.0.smithi084.stdout:5/808: truncate d9/da/d3d/f4f 185326 0 2024-02-15T18:27:09.323 INFO:tasks.workunit.client.1.smithi133.stdout:6/591: creat d0/d3b/d52/fc6 x:0 0 0 2024-02-15T18:27:09.324 INFO:tasks.workunit.client.0.smithi084.stdout:5/809: truncate d9/da/ff7 120200 0 2024-02-15T18:27:09.326 INFO:tasks.workunit.client.1.smithi133.stdout:6/592: mknod d0/db/d29/d34/d8c/da5/cc7 0 2024-02-15T18:27:09.326 INFO:tasks.workunit.client.1.smithi133.stdout:6/593: readlink d0/d3b/d53/lbd 0 2024-02-15T18:27:09.326 INFO:tasks.workunit.client.1.smithi133.stdout:6/594: read - d0/d62/d66/fbb zero size 2024-02-15T18:27:09.326 INFO:tasks.workunit.client.1.smithi133.stdout:6/595: chown d0/db/d29/d34/d8c/d98 2 1 2024-02-15T18:27:09.327 INFO:tasks.workunit.client.0.smithi084.stdout:0/725: dwrite d0/d4/d1b/d26/f2d [0,4194304] 0 2024-02-15T18:27:09.328 INFO:tasks.workunit.client.0.smithi084.stdout:5/810: symlink d9/d35/d65/l10a 0 2024-02-15T18:27:09.329 INFO:tasks.workunit.client.1.smithi133.stdout:9/373: dread d0/d8/d9/f31 [0,4194304] 0 2024-02-15T18:27:09.329 INFO:tasks.workunit.client.1.smithi133.stdout:9/374: stat d0/f7 0 2024-02-15T18:27:09.329 INFO:tasks.workunit.client.0.smithi084.stdout:0/726: symlink d0/d2f/d3f/lde 0 2024-02-15T18:27:09.329 INFO:tasks.workunit.client.0.smithi084.stdout:5/811: rmdir d9/da/d3d/d44 39 2024-02-15T18:27:09.330 INFO:tasks.workunit.client.1.smithi133.stdout:6/596: creat d0/d3b/d67/d9a/fc8 x:0 0 0 2024-02-15T18:27:09.330 INFO:tasks.workunit.client.1.smithi133.stdout:6/597: write d0/db/d29/d34/d48/f7b [343836,5537] 0 2024-02-15T18:27:09.331 INFO:tasks.workunit.client.1.smithi133.stdout:9/375: creat d0/d8/d6c/f78 x:0 0 0 2024-02-15T18:27:09.331 INFO:tasks.workunit.client.0.smithi084.stdout:0/727: link d0/d25/f34 d0/d39/fdf 0 2024-02-15T18:27:09.331 INFO:tasks.workunit.client.0.smithi084.stdout:0/728: stat d0/d2f/d3f/d4c/d9a/fd6 0 2024-02-15T18:27:09.331 INFO:tasks.workunit.client.0.smithi084.stdout:0/729: stat d0/d4/da8/dd8/lc7 0 2024-02-15T18:27:09.331 INFO:tasks.workunit.client.0.smithi084.stdout:0/730: truncate d0/d4/d3a/d82/dcb/fdd 436189 0 2024-02-15T18:27:09.332 INFO:tasks.workunit.client.0.smithi084.stdout:5/812: mknod d9/d5f/d68/d9a/d8d/c10b 0 2024-02-15T18:27:09.332 INFO:tasks.workunit.client.0.smithi084.stdout:0/731: truncate d0/d4/d66/f6c 4992036 0 2024-02-15T18:27:09.333 INFO:tasks.workunit.client.1.smithi133.stdout:6/598: mkdir d0/db/d29/d34/d5d/dc9 0 2024-02-15T18:27:09.333 INFO:tasks.workunit.client.1.smithi133.stdout:9/376: mkdir d0/d8/d9/d12/d2a/d42/d79 0 2024-02-15T18:27:09.333 INFO:tasks.workunit.client.1.smithi133.stdout:9/377: dread - d0/d8/d9/d12/d2a/f40 zero size 2024-02-15T18:27:09.333 INFO:tasks.workunit.client.1.smithi133.stdout:6/599: truncate d0/db/d21/f77 8238521 0 2024-02-15T18:27:09.333 INFO:tasks.workunit.client.1.smithi133.stdout:9/378: creat d0/d8/d9/d12/d2a/d42/d44/f7a x:0 0 0 2024-02-15T18:27:09.334 INFO:tasks.workunit.client.0.smithi084.stdout:5/813: link d9/da/f38 d9/d5b/d7e/f10c 0 2024-02-15T18:27:09.334 INFO:tasks.workunit.client.1.smithi133.stdout:6/600: truncate d0/db/d29/d34/d5d/d40/f7a 111289 0 2024-02-15T18:27:09.334 INFO:tasks.workunit.client.1.smithi133.stdout:9/379: write d0/f6 [100933,83289] 0 2024-02-15T18:27:09.334 INFO:tasks.workunit.client.1.smithi133.stdout:9/380: fsync d0/d8/d10/f30 0 2024-02-15T18:27:09.335 INFO:tasks.workunit.client.0.smithi084.stdout:0/732: truncate d0/d25/f67 1745283 0 2024-02-15T18:27:09.336 INFO:tasks.workunit.client.0.smithi084.stdout:5/814: rename d9/d5b/fae to d9/d35/d65/d7f/dd6/f10d 0 2024-02-15T18:27:09.337 INFO:tasks.workunit.client.1.smithi133.stdout:8/404: sync 2024-02-15T18:27:09.337 INFO:tasks.workunit.client.1.smithi133.stdout:3/463: sync 2024-02-15T18:27:09.338 INFO:tasks.workunit.client.1.smithi133.stdout:8/405: write d3/d7/f26 [2070637,16041] 0 2024-02-15T18:27:09.338 INFO:tasks.workunit.client.1.smithi133.stdout:9/381: mkdir d0/d7b 0 2024-02-15T18:27:09.338 INFO:tasks.workunit.client.1.smithi133.stdout:9/382: chown d0/f20 3 1 2024-02-15T18:27:09.338 INFO:tasks.workunit.client.0.smithi084.stdout:0/733: symlink d0/d4/d1b/d26/d43/d6d/d71/le0 0 2024-02-15T18:27:09.339 INFO:tasks.workunit.client.1.smithi133.stdout:6/601: rename d0/db/d29/d34/d48/c57 to d0/d5/cca 0 2024-02-15T18:27:09.339 INFO:tasks.workunit.client.0.smithi084.stdout:5/815: symlink d9/da/l10e 0 2024-02-15T18:27:09.339 INFO:tasks.workunit.client.0.smithi084.stdout:5/816: truncate d9/da/fe4 871158 0 2024-02-15T18:27:09.341 INFO:tasks.workunit.client.0.smithi084.stdout:7/712: dwrite df/d1d/d1a/d6a/d8b/d48/fdf [0,4194304] 0 2024-02-15T18:27:09.341 INFO:tasks.workunit.client.0.smithi084.stdout:0/734: read d0/d2f/d3f/f30 [3620934,93608] 0 2024-02-15T18:27:09.341 INFO:tasks.workunit.client.0.smithi084.stdout:7/713: fsync df/d1d/d44/d8d/fb3 0 2024-02-15T18:27:09.341 INFO:tasks.workunit.client.0.smithi084.stdout:0/735: write d0/d39/fdf [429916,106742] 0 2024-02-15T18:27:09.342 INFO:tasks.workunit.client.1.smithi133.stdout:8/406: mkdir d3/de/d3e/d82 0 2024-02-15T18:27:09.344 INFO:tasks.workunit.client.0.smithi084.stdout:7/714: mknod df/d1d/d1a/dd1/dd6/ce7 0 2024-02-15T18:27:09.345 INFO:tasks.workunit.client.1.smithi133.stdout:4/326: dwrite d2/d5/d2b/d21/d2d/d44/d51/d55/d5e/f73 [0,4194304] 0 2024-02-15T18:27:09.354 INFO:tasks.workunit.client.1.smithi133.stdout:4/327: truncate d2/d5/d2b/d21/d2d/f3c 255083 0 2024-02-15T18:27:09.354 INFO:tasks.workunit.client.1.smithi133.stdout:4/328: fsync d2/f29 0 2024-02-15T18:27:09.354 INFO:tasks.workunit.client.1.smithi133.stdout:4/329: dread - d2/d5/d2b/d21/d2d/d44/d51/f52 zero size 2024-02-15T18:27:09.356 INFO:tasks.workunit.client.1.smithi133.stdout:4/330: mkdir d2/d5/d2b/d21/d2d/d44/d51/d55/d5e/d76 0 2024-02-15T18:27:09.364 INFO:tasks.workunit.client.1.smithi133.stdout:6/602: rmdir d0/db/d29/d34 39 2024-02-15T18:27:09.364 INFO:tasks.workunit.client.1.smithi133.stdout:1/615: sync 2024-02-15T18:27:09.364 INFO:tasks.workunit.client.1.smithi133.stdout:1/616: dread - d6/d1e/d41/d7c/fa2 zero size 2024-02-15T18:27:09.364 INFO:tasks.workunit.client.1.smithi133.stdout:1/617: truncate d6/d1e/d41/d7c/d7e/d7f/fd5 1039812 0 2024-02-15T18:27:09.364 INFO:tasks.workunit.client.1.smithi133.stdout:8/407: dwrite d3/f81 [0,4194304] 0 2024-02-15T18:27:09.369 INFO:tasks.workunit.client.1.smithi133.stdout:1/618: creat d6/d1e/d3a/d82/d85/d67/dd3/fe2 x:0 0 0 2024-02-15T18:27:09.375 INFO:tasks.workunit.client.1.smithi133.stdout:4/331: dread d2/d5/f10 [0,4194304] 0 2024-02-15T18:27:09.391 INFO:tasks.workunit.client.1.smithi133.stdout:3/464: dwrite d0/d15/d2b/d39/f8f [0,4194304] 0 2024-02-15T18:27:09.392 INFO:tasks.workunit.client.0.smithi084.stdout:7/715: dwrite df/d1d/d1a/d4d/d55/fa0 [0,4194304] 0 2024-02-15T18:27:09.394 INFO:tasks.workunit.client.1.smithi133.stdout:3/465: rename d0/d15/d37/d69 to d0/d15/d37/d95 0 2024-02-15T18:27:09.394 INFO:tasks.workunit.client.1.smithi133.stdout:3/466: chown d0/d15/d2b/d39/f55 254 1 2024-02-15T18:27:09.395 INFO:tasks.workunit.client.1.smithi133.stdout:7/296: sync 2024-02-15T18:27:09.395 INFO:tasks.workunit.client.1.smithi133.stdout:5/351: sync 2024-02-15T18:27:09.399 INFO:tasks.workunit.client.0.smithi084.stdout:5/817: dwrite d9/d5b/d79/db7/f102 [0,4194304] 0 2024-02-15T18:27:09.401 INFO:tasks.workunit.client.0.smithi084.stdout:7/716: symlink df/d1d/d1a/d6a/d8b/le8 0 2024-02-15T18:27:09.401 INFO:tasks.workunit.client.1.smithi133.stdout:3/467: creat d0/d15/d2b/d62/d74/d78/f96 x:0 0 0 2024-02-15T18:27:09.401 INFO:tasks.workunit.client.1.smithi133.stdout:7/297: symlink d9/db/d55/l65 0 2024-02-15T18:27:09.401 INFO:tasks.workunit.client.1.smithi133.stdout:7/298: read d9/d36/d31/f59 [3999703,35170] 0 2024-02-15T18:27:09.408 INFO:tasks.workunit.client.0.smithi084.stdout:7/717: rename df/d1d/d1a/d6a/d8b/l76 to df/d1d/d1a/d6a/d8e/le9 0 2024-02-15T18:27:09.408 INFO:tasks.workunit.client.0.smithi084.stdout:7/718: rename df/d1d/d1a/d6a/d8b/d48/fdf to df/d1d/d44/d8d/fea 0 2024-02-15T18:27:09.408 INFO:tasks.workunit.client.1.smithi133.stdout:3/468: rmdir d0/d15/d37/d4a 39 2024-02-15T18:27:09.408 INFO:tasks.workunit.client.1.smithi133.stdout:7/299: creat d9/d5b/f66 x:0 0 0 2024-02-15T18:27:09.408 INFO:tasks.workunit.client.1.smithi133.stdout:3/469: unlink d0/d15/f24 0 2024-02-15T18:27:09.409 INFO:tasks.workunit.client.1.smithi133.stdout:7/300: mknod d9/db/d16/c67 0 2024-02-15T18:27:09.409 INFO:tasks.workunit.client.0.smithi084.stdout:7/719: mknod df/d1d/d1a/d6a/d8b/d7f/ceb 0 2024-02-15T18:27:09.409 INFO:tasks.workunit.client.0.smithi084.stdout:7/720: mknod df/d70/cec 0 2024-02-15T18:27:09.410 INFO:tasks.workunit.client.1.smithi133.stdout:8/408: dwrite d3/d7/f4d [0,4194304] 0 2024-02-15T18:27:09.413 INFO:tasks.workunit.client.0.smithi084.stdout:5/818: dread d9/f26 [0,4194304] 0 2024-02-15T18:27:09.413 INFO:tasks.workunit.client.0.smithi084.stdout:5/819: chown d9/da/d3d/d44/le7 0 1 2024-02-15T18:27:09.413 INFO:tasks.workunit.client.0.smithi084.stdout:5/820: stat d9/d35 0 2024-02-15T18:27:09.415 INFO:tasks.workunit.client.1.smithi133.stdout:3/470: creat d0/d15/d2f/d5e/f97 x:0 0 0 2024-02-15T18:27:09.415 INFO:tasks.workunit.client.1.smithi133.stdout:7/301: mkdir d9/db/d16/d5d/d68 0 2024-02-15T18:27:09.415 INFO:tasks.workunit.client.1.smithi133.stdout:7/302: truncate d9/f2a 1359151 0 2024-02-15T18:27:09.416 INFO:tasks.workunit.client.0.smithi084.stdout:7/721: link df/d1d/d1a/d6a/d8b/d48/c36 df/d1d/d1a/d6a/d8b/da5/db6/ced 0 2024-02-15T18:27:09.416 INFO:tasks.workunit.client.0.smithi084.stdout:5/821: mknod d9/d5f/d68/d9a/d8d/c10f 0 2024-02-15T18:27:09.417 INFO:tasks.workunit.client.1.smithi133.stdout:8/409: dread d3/f44 [0,4194304] 0 2024-02-15T18:27:09.417 INFO:tasks.workunit.client.1.smithi133.stdout:8/410: truncate d3/f14 2190695 0 2024-02-15T18:27:09.417 INFO:tasks.workunit.client.1.smithi133.stdout:8/411: chown d3/d1c/d37/f5d 120 1 2024-02-15T18:27:09.417 INFO:tasks.workunit.client.1.smithi133.stdout:3/471: unlink d0/f50 0 2024-02-15T18:27:09.417 INFO:tasks.workunit.client.1.smithi133.stdout:3/472: readlink d0/d15/l80 0 2024-02-15T18:27:09.418 INFO:tasks.workunit.client.1.smithi133.stdout:7/303: truncate d9/d36/d31/f59 1038392 0 2024-02-15T18:27:09.418 INFO:tasks.workunit.client.0.smithi084.stdout:7/722: creat df/d1d/d1a/d4b/fee x:0 0 0 2024-02-15T18:27:09.419 INFO:tasks.workunit.client.0.smithi084.stdout:7/723: truncate df/d1d/d1a/d6a/fac 1028230 0 2024-02-15T18:27:09.419 INFO:tasks.workunit.client.0.smithi084.stdout:7/724: chown df/f4c 712322517 1 2024-02-15T18:27:09.419 INFO:tasks.workunit.client.0.smithi084.stdout:7/725: fdatasync df/d1d/d1a/d6a/d8e/f83 0 2024-02-15T18:27:09.419 INFO:tasks.workunit.client.0.smithi084.stdout:5/822: mknod d9/d5b/d79/db7/c110 0 2024-02-15T18:27:09.419 INFO:tasks.workunit.client.1.smithi133.stdout:3/473: mknod d0/d15/d37/d4a/c98 0 2024-02-15T18:27:09.420 INFO:tasks.workunit.client.0.smithi084.stdout:7/726: creat df/d1d/fef x:0 0 0 2024-02-15T18:27:09.421 INFO:tasks.workunit.client.1.smithi133.stdout:3/474: truncate d0/d15/d54/f8a 1086729 0 2024-02-15T18:27:09.421 INFO:tasks.workunit.client.1.smithi133.stdout:8/412: write d3/d1f/f2a [2746399,74552] 0 2024-02-15T18:27:09.422 INFO:tasks.workunit.client.0.smithi084.stdout:7/727: mkdir df/d1d/d1a/d6a/d8e/d79/ddc/df0 0 2024-02-15T18:27:09.423 INFO:tasks.workunit.client.1.smithi133.stdout:3/475: symlink d0/d15/d37/d4a/l99 0 2024-02-15T18:27:09.423 INFO:tasks.workunit.client.1.smithi133.stdout:3/476: chown d0/d15/l46 0 1 2024-02-15T18:27:09.424 INFO:tasks.workunit.client.0.smithi084.stdout:7/728: truncate df/d1d/d1a/f75 618359 0 2024-02-15T18:27:09.424 INFO:tasks.workunit.client.0.smithi084.stdout:7/729: fdatasync df/d1d/d1a/d6a/d8e/fd7 0 2024-02-15T18:27:09.425 INFO:tasks.workunit.client.1.smithi133.stdout:6/603: dwrite d0/d3b/f99 [0,4194304] 0 2024-02-15T18:27:09.426 INFO:tasks.workunit.client.1.smithi133.stdout:6/604: write d0/db/d21/f72 [546856,14008] 0 2024-02-15T18:27:09.426 INFO:tasks.workunit.client.1.smithi133.stdout:6/605: stat d0/db/f4f 0 2024-02-15T18:27:09.426 INFO:tasks.workunit.client.1.smithi133.stdout:6/606: truncate d0/d5/f3a 4499411 0 2024-02-15T18:27:09.427 INFO:tasks.workunit.client.1.smithi133.stdout:4/332: dwrite d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 [0,4194304] 0 2024-02-15T18:27:09.427 INFO:tasks.workunit.client.1.smithi133.stdout:5/352: dwrite d17/f59 [0,4194304] 0 2024-02-15T18:27:09.427 INFO:tasks.workunit.client.1.smithi133.stdout:6/607: read d0/db/d29/d34/d48/f49 [8470,41767] 0 2024-02-15T18:27:09.427 INFO:tasks.workunit.client.1.smithi133.stdout:6/608: dread - d0/db/fc5 zero size 2024-02-15T18:27:09.427 INFO:tasks.workunit.client.1.smithi133.stdout:6/609: chown d0/l1 116007 1 2024-02-15T18:27:09.427 INFO:tasks.workunit.client.1.smithi133.stdout:6/610: chown d0/d3b/d9d/db3/c61 1867 1 2024-02-15T18:27:09.427 INFO:tasks.workunit.client.0.smithi084.stdout:7/730: unlink df/c3c 0 2024-02-15T18:27:09.428 INFO:tasks.workunit.client.1.smithi133.stdout:6/611: dread d0/db/d29/d34/d5d/d40/f7a [0,4194304] 0 2024-02-15T18:27:09.428 INFO:tasks.workunit.client.1.smithi133.stdout:6/612: write d0/f9 [735809,35863] 0 2024-02-15T18:27:09.432 INFO:tasks.workunit.client.0.smithi084.stdout:5/823: dread d9/d5b/d79/f7d [0,4194304] 0 2024-02-15T18:27:09.436 INFO:tasks.workunit.client.0.smithi084.stdout:5/824: rename d9/da/d3d/d44/d55/dfe/dac/fd8 to d9/d5b/d7e/db5/f111 0 2024-02-15T18:27:09.437 INFO:tasks.workunit.client.0.smithi084.stdout:1/670: sync 2024-02-15T18:27:09.437 INFO:tasks.workunit.client.0.smithi084.stdout:2/706: sync 2024-02-15T18:27:09.438 INFO:tasks.workunit.client.0.smithi084.stdout:9/782: sync 2024-02-15T18:27:09.442 INFO:tasks.workunit.client.0.smithi084.stdout:7/731: dread df/d1d/d1a/f28 [0,4194304] 0 2024-02-15T18:27:09.442 INFO:tasks.workunit.client.0.smithi084.stdout:7/732: truncate df/d1d/d1a/fc1 760668 0 2024-02-15T18:27:09.442 INFO:tasks.workunit.client.1.smithi133.stdout:4/333: rmdir d2/d5/d2b/d21/d2d/d44/d51 39 2024-02-15T18:27:09.442 INFO:tasks.workunit.client.1.smithi133.stdout:4/334: chown d2/d5/d2b/d21/d3b/l4d 45100770 1 2024-02-15T18:27:09.442 INFO:tasks.workunit.client.1.smithi133.stdout:4/335: chown d2/f1f 155474151 1 2024-02-15T18:27:09.442 INFO:tasks.workunit.client.1.smithi133.stdout:4/336: read d2/d5/d2b/f1d [1767388,84635] 0 2024-02-15T18:27:09.443 INFO:tasks.workunit.client.1.smithi133.stdout:4/337: write d2/d5/f10 [1661992,430] 0 2024-02-15T18:27:09.444 INFO:tasks.workunit.client.1.smithi133.stdout:5/353: getdents d17/d20/d4f 0 2024-02-15T18:27:09.446 INFO:tasks.workunit.client.1.smithi133.stdout:4/338: mknod d2/d48/c77 0 2024-02-15T18:27:09.447 INFO:tasks.workunit.client.1.smithi133.stdout:5/354: rmdir d17/d26 39 2024-02-15T18:27:09.449 INFO:tasks.workunit.client.1.smithi133.stdout:5/355: creat d17/d20/d32/d38/d70/f72 x:0 0 0 2024-02-15T18:27:09.449 INFO:tasks.workunit.client.0.smithi084.stdout:1/671: rename d9/d54/d5c to d9/d54/d7f/db7/dd9 0 2024-02-15T18:27:09.449 INFO:tasks.workunit.client.0.smithi084.stdout:2/707: symlink d3/d19/d75/le6 0 2024-02-15T18:27:09.451 INFO:tasks.workunit.client.0.smithi084.stdout:6/697: sync 2024-02-15T18:27:09.451 INFO:tasks.workunit.client.0.smithi084.stdout:8/726: sync 2024-02-15T18:27:09.451 INFO:tasks.workunit.client.0.smithi084.stdout:6/698: stat d14/d22/d25/d2f/cb2 0 2024-02-15T18:27:09.451 INFO:tasks.workunit.client.0.smithi084.stdout:9/783: dread d4/d2b/d3c/d20/f52 [0,4194304] 0 2024-02-15T18:27:09.452 INFO:tasks.workunit.client.0.smithi084.stdout:1/672: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/cda 0 2024-02-15T18:27:09.454 INFO:tasks.workunit.client.1.smithi133.stdout:4/339: dread d2/d5/d2b/d21/d2d/f56 [0,4194304] 0 2024-02-15T18:27:09.456 INFO:tasks.workunit.client.0.smithi084.stdout:7/733: link df/d1d/d1a/d4d/ld9 df/d1d/d1a/dd1/dd6/lf1 0 2024-02-15T18:27:09.456 INFO:tasks.workunit.client.0.smithi084.stdout:7/734: truncate df/d1d/d1a/d6a/d8e/d79/f8c 531051 0 2024-02-15T18:27:09.457 INFO:tasks.workunit.client.0.smithi084.stdout:6/699: mkdir d14/d22/d25/d2f/da9/de2 0 2024-02-15T18:27:09.457 INFO:tasks.workunit.client.0.smithi084.stdout:8/727: mkdir db/d6a/d76/dee 0 2024-02-15T18:27:09.457 INFO:tasks.workunit.client.1.smithi133.stdout:4/340: mknod d2/d5/d2b/d21/d3b/d49/c78 0 2024-02-15T18:27:09.457 INFO:tasks.workunit.client.1.smithi133.stdout:4/341: chown d2/d48/d5c 1147794 1 2024-02-15T18:27:09.458 INFO:tasks.workunit.client.1.smithi133.stdout:4/342: truncate d2/f9 8426148 0 2024-02-15T18:27:09.458 INFO:tasks.workunit.client.0.smithi084.stdout:5/825: dread d9/d5f/d68/d9a/f60 [0,4194304] 0 2024-02-15T18:27:09.458 INFO:tasks.workunit.client.0.smithi084.stdout:5/826: chown d9/da/d3d/d44/d55/d70/d84 52301010 1 2024-02-15T18:27:09.458 INFO:tasks.workunit.client.0.smithi084.stdout:6/700: rmdir d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd 39 2024-02-15T18:27:09.459 INFO:tasks.workunit.client.0.smithi084.stdout:7/735: creat df/d1d/d1a/d4d/d55/d88/d98/ff2 x:0 0 0 2024-02-15T18:27:09.462 INFO:tasks.workunit.client.0.smithi084.stdout:6/701: write d14/f38 [548539,53697] 0 2024-02-15T18:27:09.463 INFO:tasks.workunit.client.0.smithi084.stdout:2/708: dread d3/d5/d1a/d2d/f4a [0,4194304] 0 2024-02-15T18:27:09.463 INFO:tasks.workunit.client.0.smithi084.stdout:9/784: dread d4/da3/dc3/de1/f51 [0,4194304] 0 2024-02-15T18:27:09.464 INFO:tasks.workunit.client.0.smithi084.stdout:9/785: chown d4/d2b/d3c/d20/d75/d87/fa8 36354 1 2024-02-15T18:27:09.464 INFO:tasks.workunit.client.0.smithi084.stdout:8/728: dread db/dd/d1f/d7a/da8/fab [0,4194304] 0 2024-02-15T18:27:09.466 INFO:tasks.workunit.client.1.smithi133.stdout:8/413: dwrite d3/d1c/d2f/f7d [0,4194304] 0 2024-02-15T18:27:09.470 INFO:tasks.workunit.client.0.smithi084.stdout:6/702: rename d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/d97/fae to d14/d22/d25/d2f/d31/d30/d4f/d7f/fe3 0 2024-02-15T18:27:09.472 INFO:tasks.workunit.client.1.smithi133.stdout:8/414: unlink d3/f43 0 2024-02-15T18:27:09.472 INFO:tasks.workunit.client.1.smithi133.stdout:7/304: dwrite d9/f47 [0,4194304] 0 2024-02-15T18:27:09.472 INFO:tasks.workunit.client.0.smithi084.stdout:9/786: getdents d4/da3/dc3/de1/dcb 0 2024-02-15T18:27:09.473 INFO:tasks.workunit.client.0.smithi084.stdout:2/709: mkdir d3/d5/d1a/d1e/d47/de7 0 2024-02-15T18:27:09.479 INFO:tasks.workunit.client.1.smithi133.stdout:8/415: creat d3/d7/d52/f83 x:0 0 0 2024-02-15T18:27:09.480 INFO:tasks.workunit.client.1.smithi133.stdout:6/613: dwrite d0/d3b/f99 [0,4194304] 0 2024-02-15T18:27:09.482 INFO:tasks.workunit.client.0.smithi084.stdout:9/787: write d4/d2b/d3c/d20/f62 [573795,24317] 0 2024-02-15T18:27:09.484 INFO:tasks.workunit.client.0.smithi084.stdout:8/729: creat db/daf/db6/fef x:0 0 0 2024-02-15T18:27:09.484 INFO:tasks.workunit.client.0.smithi084.stdout:8/730: truncate db/dd/d1f/d66/f7f 923119 0 2024-02-15T18:27:09.484 INFO:tasks.workunit.client.0.smithi084.stdout:8/731: dread - db/d1a/d2b/d7b/fbf zero size 2024-02-15T18:27:09.484 INFO:tasks.workunit.client.1.smithi133.stdout:7/305: link d9/db/d55/l65 d9/db/d16/d5d/d68/l69 0 2024-02-15T18:27:09.485 INFO:tasks.workunit.client.0.smithi084.stdout:2/710: mkdir d3/d5/d1a/d74/db9/de8 0 2024-02-15T18:27:09.486 INFO:tasks.workunit.client.0.smithi084.stdout:3/686: sync 2024-02-15T18:27:09.487 INFO:tasks.workunit.client.0.smithi084.stdout:4/769: sync 2024-02-15T18:27:09.488 INFO:tasks.workunit.client.1.smithi133.stdout:6/614: creat d0/db/db6/fcb x:0 0 0 2024-02-15T18:27:09.488 INFO:tasks.workunit.client.1.smithi133.stdout:6/615: dread - d0/d62/d66/fbb zero size 2024-02-15T18:27:09.489 INFO:tasks.workunit.client.1.smithi133.stdout:6/616: symlink d0/d3b/d52/lcc 0 2024-02-15T18:27:09.489 INFO:tasks.workunit.client.1.smithi133.stdout:6/617: fdatasync d0/f32 0 2024-02-15T18:27:09.489 INFO:tasks.workunit.client.1.smithi133.stdout:6/618: readlink d0/d5/l16 0 2024-02-15T18:27:09.491 INFO:tasks.workunit.client.0.smithi084.stdout:9/788: rmdir d4 39 2024-02-15T18:27:09.493 INFO:tasks.workunit.client.0.smithi084.stdout:8/732: symlink db/dd/d1f/d7a/lf0 0 2024-02-15T18:27:09.493 INFO:tasks.workunit.client.0.smithi084.stdout:8/733: write db/dd/d13/f5c [4618101,44671] 0 2024-02-15T18:27:09.493 INFO:tasks.workunit.client.0.smithi084.stdout:8/734: chown db/d1a/d2b/d7b/fc0 291905383 1 2024-02-15T18:27:09.494 INFO:tasks.workunit.client.0.smithi084.stdout:6/703: link d14/d22/d25/d2f/d31/c71 d14/d22/d25/d2f/da9/d9b/dac/ce4 0 2024-02-15T18:27:09.494 INFO:tasks.workunit.client.0.smithi084.stdout:6/704: write d14/d22/d25/d2f/d31/d30/f6b [4502120,100766] 0 2024-02-15T18:27:09.494 INFO:tasks.workunit.client.1.smithi133.stdout:6/619: creat d0/d62/d66/fcd x:0 0 0 2024-02-15T18:27:09.496 INFO:tasks.workunit.client.1.smithi133.stdout:6/620: truncate d0/db/d29/d34/d48/f90 797811 0 2024-02-15T18:27:09.496 INFO:tasks.workunit.client.0.smithi084.stdout:3/687: creat d8/d40/d43/d71/dd9/feb x:0 0 0 2024-02-15T18:27:09.497 INFO:tasks.workunit.client.0.smithi084.stdout:9/789: creat d4/d2b/d3c/d24/dca/d15/fff x:0 0 0 2024-02-15T18:27:09.497 INFO:tasks.workunit.client.1.smithi133.stdout:6/621: symlink d0/db/d29/d34/d48/da1/lce 0 2024-02-15T18:27:09.497 INFO:tasks.workunit.client.1.smithi133.stdout:6/622: write d0/d3b/d52/fc6 [132159,102929] 0 2024-02-15T18:27:09.498 INFO:tasks.workunit.client.1.smithi133.stdout:3/477: dwrite d0/d15/d54/f8a [0,4194304] 0 2024-02-15T18:27:09.498 INFO:tasks.workunit.client.1.smithi133.stdout:3/478: write d0/d15/d2f/d5e/f76 [586572,127472] 0 2024-02-15T18:27:09.498 INFO:tasks.workunit.client.1.smithi133.stdout:3/479: write d0/d15/d2b/f43 [96450,23612] 0 2024-02-15T18:27:09.498 INFO:tasks.workunit.client.1.smithi133.stdout:3/480: truncate d0/d15/d2b/d39/d3f/f22 1374293 0 2024-02-15T18:27:09.498 INFO:tasks.workunit.client.0.smithi084.stdout:8/735: mkdir db/dd/d4d/df1 0 2024-02-15T18:27:09.499 INFO:tasks.workunit.client.0.smithi084.stdout:8/736: chown db/daf/ced 96371860 1 2024-02-15T18:27:09.499 INFO:tasks.workunit.client.0.smithi084.stdout:8/737: fdatasync db/d3f/d59/f3b 0 2024-02-15T18:27:09.500 INFO:tasks.workunit.client.0.smithi084.stdout:6/705: unlink d14/f6f 0 2024-02-15T18:27:09.501 INFO:tasks.workunit.client.0.smithi084.stdout:9/790: getdents d4/da3/dc3 0 2024-02-15T18:27:09.501 INFO:tasks.workunit.client.0.smithi084.stdout:3/688: write d8/f12 [8325061,60590] 0 2024-02-15T18:27:09.501 INFO:tasks.workunit.client.0.smithi084.stdout:3/689: fsync d8/d1f/d25/f9a 0 2024-02-15T18:27:09.503 INFO:tasks.workunit.client.1.smithi133.stdout:6/623: rmdir d0/d3b/d67 39 2024-02-15T18:27:09.508 INFO:tasks.workunit.client.0.smithi084.stdout:4/770: write d2/d2b/f60 [2294774,128082] 0 2024-02-15T18:27:09.508 INFO:tasks.workunit.client.0.smithi084.stdout:8/738: symlink db/dd/d4d/d97/lf2 0 2024-02-15T18:27:09.508 INFO:tasks.workunit.client.0.smithi084.stdout:9/791: mknod d4/d3d/da5/c100 0 2024-02-15T18:27:09.508 INFO:tasks.workunit.client.0.smithi084.stdout:3/690: unlink d8/d1f/cc6 0 2024-02-15T18:27:09.508 INFO:tasks.workunit.client.0.smithi084.stdout:3/691: chown d8/d40/d43/d71/f81 1766549541 1 2024-02-15T18:27:09.510 INFO:tasks.workunit.client.0.smithi084.stdout:8/739: unlink fa 0 2024-02-15T18:27:09.511 INFO:tasks.workunit.client.0.smithi084.stdout:9/792: write d4/f6c [2307699,128808] 0 2024-02-15T18:27:09.512 INFO:tasks.workunit.client.0.smithi084.stdout:8/740: dread db/dd/d4d/f55 [0,4194304] 0 2024-02-15T18:27:09.513 INFO:tasks.workunit.client.0.smithi084.stdout:8/741: fsync db/dd/d1f/f38 0 2024-02-15T18:27:09.513 INFO:tasks.workunit.client.0.smithi084.stdout:9/793: write d4/f6 [2646796,123529] 0 2024-02-15T18:27:09.514 INFO:tasks.workunit.client.0.smithi084.stdout:4/771: mknod d2/d2b/d47/d31/cde 0 2024-02-15T18:27:09.515 INFO:tasks.workunit.client.0.smithi084.stdout:8/742: mknod db/d3f/d59/cf3 0 2024-02-15T18:27:09.516 INFO:tasks.workunit.client.0.smithi084.stdout:9/794: chown d4/d2b/d3c/d24/dca/d15/c34 28 1 2024-02-15T18:27:09.517 INFO:tasks.workunit.client.0.smithi084.stdout:8/743: rename db/dd/d1f/l29 to db/dd/d1f/d3e/lf4 0 2024-02-15T18:27:09.519 INFO:tasks.workunit.client.0.smithi084.stdout:9/795: rename d4/da3/la4 to d4/d3d/da5/l101 0 2024-02-15T18:27:09.521 INFO:tasks.workunit.client.0.smithi084.stdout:4/772: dread d2/d4/d25/f4a [0,4194304] 0 2024-02-15T18:27:09.521 INFO:tasks.workunit.client.0.smithi084.stdout:1/673: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/d39/f30 [4194304,4194304] 0 2024-02-15T18:27:09.521 INFO:tasks.workunit.client.0.smithi084.stdout:1/674: rename d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8 to d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/ddb 22 2024-02-15T18:27:09.521 INFO:tasks.workunit.client.1.smithi133.stdout:4/343: dwrite d2/d5/d2b/d21/d2d/d44/d51/d55/f6c [0,4194304] 0 2024-02-15T18:27:09.523 INFO:tasks.workunit.client.0.smithi084.stdout:4/773: rmdir d2/d4/d28/d3d/d5c/dbc/d88/db0 39 2024-02-15T18:27:09.523 INFO:tasks.workunit.client.0.smithi084.stdout:4/774: chown d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/la9 171 1 2024-02-15T18:27:09.524 INFO:tasks.workunit.client.0.smithi084.stdout:4/775: write d2/d4/d28/d3d/d5c/d65/fbd [169463,17216] 0 2024-02-15T18:27:09.524 INFO:tasks.workunit.client.1.smithi133.stdout:5/356: dwrite d17/d26/f58 [0,4194304] 0 2024-02-15T18:27:09.524 INFO:tasks.workunit.client.0.smithi084.stdout:1/675: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ddc 0 2024-02-15T18:27:09.525 INFO:tasks.workunit.client.0.smithi084.stdout:1/676: write d9/d54/f6e [339157,71043] 0 2024-02-15T18:27:09.525 INFO:tasks.workunit.client.0.smithi084.stdout:8/744: dread db/dd/d4d/f5b [0,4194304] 0 2024-02-15T18:27:09.525 INFO:tasks.workunit.client.0.smithi084.stdout:4/776: mkdir d2/d2b/d47/d31/d61/ddf 0 2024-02-15T18:27:09.526 INFO:tasks.workunit.client.0.smithi084.stdout:8/745: rmdir db/dd/d1f/d7a/da8/dd0 39 2024-02-15T18:27:09.526 INFO:tasks.workunit.client.0.smithi084.stdout:1/677: write d9/d54/d7f/db7/dd9/f67 [1277405,26016] 0 2024-02-15T18:27:09.527 INFO:tasks.workunit.client.0.smithi084.stdout:4/777: dread d2/d4/f20 [0,4194304] 0 2024-02-15T18:27:09.528 INFO:tasks.workunit.client.0.smithi084.stdout:8/746: symlink db/d3f/lf5 0 2024-02-15T18:27:09.528 INFO:tasks.workunit.client.0.smithi084.stdout:8/747: fsync db/d3f/d59/f3b 0 2024-02-15T18:27:09.528 INFO:tasks.workunit.client.0.smithi084.stdout:4/778: write d2/f34 [505348,22616] 0 2024-02-15T18:27:09.528 INFO:tasks.workunit.client.0.smithi084.stdout:8/748: truncate db/d1a/f5f 772386 0 2024-02-15T18:27:09.531 INFO:tasks.workunit.client.0.smithi084.stdout:4/779: creat d2/d64/d74/fe0 x:0 0 0 2024-02-15T18:27:09.532 INFO:tasks.workunit.client.0.smithi084.stdout:4/780: rmdir d2/d4/d28/d3d/d5c/dbc 39 2024-02-15T18:27:09.535 INFO:tasks.workunit.client.0.smithi084.stdout:4/781: rename d2/d2b/d47/d31/d61/ddf to d2/d64/da5/dae/de1 0 2024-02-15T18:27:09.537 INFO:tasks.workunit.client.0.smithi084.stdout:4/782: mknod d2/d4/d28/d3d/d5c/d5d/dcf/ce2 0 2024-02-15T18:27:09.542 INFO:tasks.workunit.client.1.smithi133.stdout:7/306: dwrite f7 [0,4194304] 0 2024-02-15T18:27:09.544 INFO:tasks.workunit.client.1.smithi133.stdout:7/307: mknod d9/da/c6a 0 2024-02-15T18:27:09.544 INFO:tasks.workunit.client.1.smithi133.stdout:7/308: chown d9/f2a 2733 1 2024-02-15T18:27:09.544 INFO:tasks.workunit.client.1.smithi133.stdout:8/416: dwrite d3/d1f/f31 [4194304,4194304] 0 2024-02-15T18:27:09.546 INFO:tasks.workunit.client.1.smithi133.stdout:6/624: dread d0/d3b/d52/fc6 [0,4194304] 0 2024-02-15T18:27:09.547 INFO:tasks.workunit.client.0.smithi084.stdout:9/796: dread d4/d2b/d3c/d24/dca/d15/d33/f53 [0,4194304] 0 2024-02-15T18:27:09.550 INFO:tasks.workunit.client.0.smithi084.stdout:8/749: write db/d1a/da5/fba [1738307,98980] 0 2024-02-15T18:27:09.550 INFO:tasks.workunit.client.0.smithi084.stdout:8/750: chown db/dd/d1f/d3e/c93 5 1 2024-02-15T18:27:09.551 INFO:tasks.workunit.client.0.smithi084.stdout:6/706: dwrite d14/d22/d25/d2f/d31/d30/d45/d54/f88 [0,4194304] 0 2024-02-15T18:27:09.551 INFO:tasks.workunit.client.0.smithi084.stdout:7/736: dwrite df/d1d/d44/db9/fd3 [0,4194304] 0 2024-02-15T18:27:09.554 INFO:tasks.workunit.client.0.smithi084.stdout:4/783: dread d2/f21 [0,4194304] 0 2024-02-15T18:27:09.555 INFO:tasks.workunit.client.0.smithi084.stdout:4/784: fdatasync d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4/fd3 0 2024-02-15T18:27:09.555 INFO:tasks.workunit.client.0.smithi084.stdout:5/827: dwrite d9/da/d3d/d44/f97 [0,4194304] 0 2024-02-15T18:27:09.555 INFO:tasks.workunit.client.0.smithi084.stdout:5/828: truncate d9/da/d3d/d44/d55/dfe/dac/fda 624272 0 2024-02-15T18:27:09.555 INFO:tasks.workunit.client.0.smithi084.stdout:5/829: write d9/d5b/d79/f7d [4363362,35814] 0 2024-02-15T18:27:09.555 INFO:tasks.workunit.client.1.smithi133.stdout:7/309: dread d9/db/f3c [0,4194304] 0 2024-02-15T18:27:09.560 INFO:tasks.workunit.client.1.smithi133.stdout:8/417: dread d3/d1f/d3f/f41 [4194304,4194304] 0 2024-02-15T18:27:09.560 INFO:tasks.workunit.client.1.smithi133.stdout:8/418: chown d3/d7/l2b 1968 1 2024-02-15T18:27:09.560 INFO:tasks.workunit.client.1.smithi133.stdout:3/481: dwrite d0/d15/d2f/d5e/f97 [0,4194304] 0 2024-02-15T18:27:09.560 INFO:tasks.workunit.client.1.smithi133.stdout:3/482: readlink d0/d15/d2b/d39/d3f/l5d 0 2024-02-15T18:27:09.562 INFO:tasks.workunit.client.0.smithi084.stdout:4/785: read d2/d2b/d47/f56 [211890,13754] 0 2024-02-15T18:27:09.563 INFO:tasks.workunit.client.1.smithi133.stdout:8/419: mkdir d3/d1c/d37/d5a/d73/d84 0 2024-02-15T18:27:09.563 INFO:tasks.workunit.client.0.smithi084.stdout:9/797: dread d4/d2b/daf/fbb [0,4194304] 0 2024-02-15T18:27:09.566 INFO:tasks.workunit.client.1.smithi133.stdout:2/429: sync 2024-02-15T18:27:09.566 INFO:tasks.workunit.client.1.smithi133.stdout:2/430: chown d7/db/d67/d7b 16733368 1 2024-02-15T18:27:09.566 INFO:tasks.workunit.client.1.smithi133.stdout:3/483: creat d0/d15/d2b/f9a x:0 0 0 2024-02-15T18:27:09.566 INFO:tasks.workunit.client.1.smithi133.stdout:3/484: dread - d0/d15/d37/d4a/f70 zero size 2024-02-15T18:27:09.568 INFO:tasks.workunit.client.1.smithi133.stdout:8/420: rmdir d3/d1f/d3f/d58 39 2024-02-15T18:27:09.569 INFO:tasks.workunit.client.0.smithi084.stdout:2/711: getdents d3/d5/d1a/d1e/d47 0 2024-02-15T18:27:09.570 INFO:tasks.workunit.client.0.smithi084.stdout:6/707: link c1 d14/d22/d25/d2f/d31/dcf/dd8/ce5 0 2024-02-15T18:27:09.571 INFO:tasks.workunit.client.1.smithi133.stdout:8/421: creat d3/d1f/d3f/f85 x:0 0 0 2024-02-15T18:27:09.571 INFO:tasks.workunit.client.1.smithi133.stdout:8/422: chown d3/d1f/d3f/f85 121 1 2024-02-15T18:27:09.574 INFO:tasks.workunit.client.1.smithi133.stdout:7/310: dread d9/db/f1f [0,4194304] 0 2024-02-15T18:27:09.574 INFO:tasks.workunit.client.0.smithi084.stdout:7/737: unlink df/d1d/d1a/d4d/f6f 0 2024-02-15T18:27:09.574 INFO:tasks.workunit.client.0.smithi084.stdout:7/738: write df/d1d/d1a/d6a/d8b/da5/db6/fcc [8718474,9896] 0 2024-02-15T18:27:09.574 INFO:tasks.workunit.client.0.smithi084.stdout:7/739: fsync df/d1d/d1a/f81 0 2024-02-15T18:27:09.574 INFO:tasks.workunit.client.0.smithi084.stdout:4/786: creat d2/d4/d28/d3d/d5c/d65/fe3 x:0 0 0 2024-02-15T18:27:09.575 INFO:tasks.workunit.client.1.smithi133.stdout:5/357: dwrite d17/f62 [0,4194304] 0 2024-02-15T18:27:09.576 INFO:tasks.workunit.client.1.smithi133.stdout:5/358: stat d17/d20/d4f/f64 0 2024-02-15T18:27:09.576 INFO:tasks.workunit.client.1.smithi133.stdout:2/431: write d7/d2c/f49 [2090704,130512] 0 2024-02-15T18:27:09.578 INFO:tasks.workunit.client.0.smithi084.stdout:7/740: dread df/fa8 [0,4194304] 0 2024-02-15T18:27:09.578 INFO:tasks.workunit.client.0.smithi084.stdout:1/678: dwrite d9/d54/d1b/d38/f4a [0,4194304] 0 2024-02-15T18:27:09.578 INFO:tasks.workunit.client.0.smithi084.stdout:4/787: getdents d2/d64 0 2024-02-15T18:27:09.579 INFO:tasks.workunit.client.1.smithi133.stdout:8/423: creat d3/f86 x:0 0 0 2024-02-15T18:27:09.579 INFO:tasks.workunit.client.0.smithi084.stdout:1/679: write d9/d54/f99 [688775,112837] 0 2024-02-15T18:27:09.579 INFO:tasks.workunit.client.0.smithi084.stdout:1/680: fsync d9/d54/d1b/d2c/d35/f72 0 2024-02-15T18:27:09.579 INFO:tasks.workunit.client.0.smithi084.stdout:5/830: dread d9/d5f/d68/d9a/f6f [0,4194304] 0 2024-02-15T18:27:09.581 INFO:tasks.workunit.client.0.smithi084.stdout:7/741: mknod df/d1d/d1a/d4d/d55/d88/d98/cf3 0 2024-02-15T18:27:09.581 INFO:tasks.workunit.client.0.smithi084.stdout:7/742: stat df/d1d/d1a/f28 0 2024-02-15T18:27:09.582 INFO:tasks.workunit.client.1.smithi133.stdout:7/311: mkdir d9/da/d48/d6b 0 2024-02-15T18:27:09.583 INFO:tasks.workunit.client.1.smithi133.stdout:5/359: creat d17/d2a/f73 x:0 0 0 2024-02-15T18:27:09.583 INFO:tasks.workunit.client.1.smithi133.stdout:5/360: truncate d17/d20/d4f/f64 1104667 0 2024-02-15T18:27:09.584 INFO:tasks.workunit.client.0.smithi084.stdout:4/788: link d2/lc6 d2/d4/d25/d66/le4 0 2024-02-15T18:27:09.584 INFO:tasks.workunit.client.0.smithi084.stdout:4/789: truncate d2/d4/d28/d3d/d5c/dbc/d88/db0/fc5 904538 0 2024-02-15T18:27:09.584 INFO:tasks.workunit.client.1.smithi133.stdout:6/625: dwrite d0/db/d29/d34/d48/da1/fb5 [0,4194304] 0 2024-02-15T18:27:09.584 INFO:tasks.workunit.client.1.smithi133.stdout:2/432: creat d7/d18/f8a x:0 0 0 2024-02-15T18:27:09.584 INFO:tasks.workunit.client.1.smithi133.stdout:5/361: dread d17/d20/d4f/d5f/f60 [0,4194304] 0 2024-02-15T18:27:09.585 INFO:tasks.workunit.client.1.smithi133.stdout:2/433: chown d7/d18/d32/l76 1813590 1 2024-02-15T18:27:09.585 INFO:tasks.workunit.client.0.smithi084.stdout:5/831: mkdir d9/dc6/de2/d112 0 2024-02-15T18:27:09.585 INFO:tasks.workunit.client.0.smithi084.stdout:5/832: chown d9/d5b/d7e/db5/fd7 6292219 1 2024-02-15T18:27:09.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/743: dread df/fa8 [0,4194304] 0 2024-02-15T18:27:09.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/744: chown df/d1d/d1a/f28 2 1 2024-02-15T18:27:09.587 INFO:tasks.workunit.client.1.smithi133.stdout:4/344: dwrite d2/d5/d2b/f24 [0,4194304] 0 2024-02-15T18:27:09.588 INFO:tasks.workunit.client.1.smithi133.stdout:7/312: link d9/db/l13 d9/da/d48/d62/d64/l6c 0 2024-02-15T18:27:09.589 INFO:tasks.workunit.client.0.smithi084.stdout:5/833: dread d9/d5b/d79/f87 [0,4194304] 0 2024-02-15T18:27:09.591 INFO:tasks.workunit.client.0.smithi084.stdout:8/751: dwrite db/dd/d13/de0/fe3 [0,4194304] 0 2024-02-15T18:27:09.591 INFO:tasks.workunit.client.0.smithi084.stdout:8/752: write db/dd/fd9 [1030959,109523] 0 2024-02-15T18:27:09.591 INFO:tasks.workunit.client.0.smithi084.stdout:8/753: write db/dd/d1f/d3e/fb5 [956146,73161] 0 2024-02-15T18:27:09.593 INFO:tasks.workunit.client.1.smithi133.stdout:5/362: link d17/d20/c51 d17/d26/c74 0 2024-02-15T18:27:09.594 INFO:tasks.workunit.client.1.smithi133.stdout:4/345: mknod d2/d5/d2b/d21/d3b/d49/c79 0 2024-02-15T18:27:09.599 INFO:tasks.workunit.client.1.smithi133.stdout:2/434: creat d7/d2c/d3b/d48/d6d/f8b x:0 0 0 2024-02-15T18:27:09.599 INFO:tasks.workunit.client.1.smithi133.stdout:6/626: link d0/db/f70 d0/db/d29/d34/d48/da1/fcf 0 2024-02-15T18:27:09.599 INFO:tasks.workunit.client.1.smithi133.stdout:7/313: dread d9/d36/d39/f52 [0,4194304] 0 2024-02-15T18:27:09.601 INFO:tasks.workunit.client.1.smithi133.stdout:6/627: creat d0/d62/fd0 x:0 0 0 2024-02-15T18:27:09.601 INFO:tasks.workunit.client.1.smithi133.stdout:6/628: write d0/d3b/d78/fae [670532,9038] 0 2024-02-15T18:27:09.602 INFO:tasks.workunit.client.0.smithi084.stdout:5/834: symlink d9/da/d3d/d44/d55/l113 0 2024-02-15T18:27:09.605 INFO:tasks.workunit.client.1.smithi133.stdout:8/424: rename d3/d1c/d37/d5a to d3/d1c/d2f/d87 0 2024-02-15T18:27:09.605 INFO:tasks.workunit.client.1.smithi133.stdout:4/346: dread d2/f29 [0,4194304] 0 2024-02-15T18:27:09.605 INFO:tasks.workunit.client.1.smithi133.stdout:7/314: getdents d9/db 0 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:2/435: write d7/d2c/d31/f38 [1877445,46961] 0 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:7/315: chown d9/db/f27 2 1 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:7/316: readlink d9/db/l13 0 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:6/629: mkdir d0/db/d29/d34/d48/da1/dd1 0 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:6/630: getdents d0/d3b/db1 0 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:7/317: write d9/d36/f23 [6114980,83264] 0 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:6/631: fsync d0/db/d29/d34/fb7 0 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:7/318: chown d9/db/d16/d4f 928 1 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:6/632: readlink d0/d3b/d52/lcc 0 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:8/425: symlink d3/d7/d40/d61/l88 0 2024-02-15T18:27:09.606 INFO:tasks.workunit.client.1.smithi133.stdout:8/426: dread - d3/f86 zero size 2024-02-15T18:27:09.607 INFO:tasks.workunit.client.0.smithi084.stdout:9/798: dwrite d4/d2b/d3c/d20/f52 [0,4194304] 0 2024-02-15T18:27:09.609 INFO:tasks.workunit.client.1.smithi133.stdout:2/436: creat d7/d2c/d3b/d48/d6d/f8c x:0 0 0 2024-02-15T18:27:09.609 INFO:tasks.workunit.client.1.smithi133.stdout:2/437: write d7/f20 [2617052,83744] 0 2024-02-15T18:27:09.613 INFO:tasks.workunit.client.1.smithi133.stdout:6/633: creat d0/db/d21/fd2 x:0 0 0 2024-02-15T18:27:09.613 INFO:tasks.workunit.client.1.smithi133.stdout:7/319: symlink d9/d36/d39/l6d 0 2024-02-15T18:27:09.613 INFO:tasks.workunit.client.1.smithi133.stdout:6/634: write d0/db/db6/fcb [881687,47052] 0 2024-02-15T18:27:09.613 INFO:tasks.workunit.client.1.smithi133.stdout:6/635: stat d0/f27 0 2024-02-15T18:27:09.617 INFO:tasks.workunit.client.1.smithi133.stdout:6/636: write d0/d3b/f6d [3364376,120930] 0 2024-02-15T18:27:09.617 INFO:tasks.workunit.client.0.smithi084.stdout:7/745: dread df/d1d/d1a/d6a/d8b/d48/f5c [0,4194304] 0 2024-02-15T18:27:09.619 INFO:tasks.workunit.client.1.smithi133.stdout:6/637: mkdir d0/d3b/d9d/db3/dd3 0 2024-02-15T18:27:09.620 INFO:tasks.workunit.client.0.smithi084.stdout:7/746: mkdir df/d1d/d1a/d6a/d8b/da5/db6/df4 0 2024-02-15T18:27:09.622 INFO:tasks.workunit.client.1.smithi133.stdout:8/427: dread d3/f81 [0,4194304] 0 2024-02-15T18:27:09.622 INFO:tasks.workunit.client.1.smithi133.stdout:7/320: read d9/db/dc/f35 [4139286,12724] 0 2024-02-15T18:27:09.623 INFO:tasks.workunit.client.1.smithi133.stdout:4/347: dread d2/d5/d2b/f1a [0,4194304] 0 2024-02-15T18:27:09.624 INFO:tasks.workunit.client.1.smithi133.stdout:8/428: creat d3/d1c/d37/d5c/f89 x:0 0 0 2024-02-15T18:27:09.626 INFO:tasks.workunit.client.1.smithi133.stdout:7/321: symlink d9/da/d48/d62/l6e 0 2024-02-15T18:27:09.626 INFO:tasks.workunit.client.1.smithi133.stdout:4/348: mknod d2/d48/d5c/c7a 0 2024-02-15T18:27:09.626 INFO:tasks.workunit.client.1.smithi133.stdout:4/349: dread - d2/f72 zero size 2024-02-15T18:27:09.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/460: sync 2024-02-15T18:27:09.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/461: dread - d9/d10/d47/d5e/f8e zero size 2024-02-15T18:27:09.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/462: fdatasync d9/d10/d47/d5e/f86 0 2024-02-15T18:27:09.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/463: stat f0 0 2024-02-15T18:27:09.628 INFO:tasks.workunit.client.1.smithi133.stdout:0/464: chown d9/d10/d47 0 1 2024-02-15T18:27:09.630 INFO:tasks.workunit.client.1.smithi133.stdout:6/638: dread d0/db/d29/f84 [0,4194304] 0 2024-02-15T18:27:09.630 INFO:tasks.workunit.client.1.smithi133.stdout:8/429: mknod d3/de/c8a 0 2024-02-15T18:27:09.630 INFO:tasks.workunit.client.1.smithi133.stdout:8/430: chown d3/d7/c17 344234108 1 2024-02-15T18:27:09.632 INFO:tasks.workunit.client.1.smithi133.stdout:6/639: link d0/db/d29/d34/d48/lad d0/db/d29/d34/d5d/ld4 0 2024-02-15T18:27:09.636 INFO:tasks.workunit.client.1.smithi133.stdout:6/640: unlink d0/d3b/d9d/db3/f76 0 2024-02-15T18:27:09.638 INFO:tasks.workunit.client.1.smithi133.stdout:6/641: read d0/d3b/d52/f59 [490891,44299] 0 2024-02-15T18:27:09.638 INFO:tasks.workunit.client.1.smithi133.stdout:6/642: getdents d0/db/d29/d34/d48/da1/dd1 0 2024-02-15T18:27:09.643 INFO:tasks.workunit.client.0.smithi084.stdout:1/681: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/d92/fac [0,4194304] 0 2024-02-15T18:27:09.645 INFO:tasks.workunit.client.0.smithi084.stdout:1/682: unlink d9/d54/d1b/d2c/d4b/d4c/fc4 0 2024-02-15T18:27:09.646 INFO:tasks.workunit.client.0.smithi084.stdout:2/712: dwrite d3/d5/d1a/d1e/d4b/da6/fa3 [0,4194304] 0 2024-02-15T18:27:09.646 INFO:tasks.workunit.client.0.smithi084.stdout:6/708: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/fb3 [0,4194304] 0 2024-02-15T18:27:09.648 INFO:tasks.workunit.client.0.smithi084.stdout:2/713: write d3/d5/f18 [2742234,1152] 0 2024-02-15T18:27:09.649 INFO:tasks.workunit.client.0.smithi084.stdout:4/790: dwrite d2/f5e [4194304,4194304] 0 2024-02-15T18:27:09.650 INFO:tasks.workunit.client.0.smithi084.stdout:9/799: dwrite d4/d36/fba [0,4194304] 0 2024-02-15T18:27:09.650 INFO:tasks.workunit.client.0.smithi084.stdout:1/683: write d9/f15 [3603785,37717] 0 2024-02-15T18:27:09.650 INFO:tasks.workunit.client.0.smithi084.stdout:1/684: write d9/d54/d1b/d2c/f31 [4804396,77901] 0 2024-02-15T18:27:09.652 INFO:tasks.workunit.client.0.smithi084.stdout:9/800: read d4/d2b/f50 [3140022,51659] 0 2024-02-15T18:27:09.654 INFO:tasks.workunit.client.0.smithi084.stdout:7/747: dwrite df/d1d/d1a/d6a/d8b/fcd [0,4194304] 0 2024-02-15T18:27:09.656 INFO:tasks.workunit.client.0.smithi084.stdout:1/685: write d9/d54/d32/d5b/d69/fb1 [152761,129015] 0 2024-02-15T18:27:09.660 INFO:tasks.workunit.client.1.smithi133.stdout:1/619: sync 2024-02-15T18:27:09.660 INFO:tasks.workunit.client.1.smithi133.stdout:9/383: sync 2024-02-15T18:27:09.660 INFO:tasks.workunit.client.0.smithi084.stdout:5/835: dwrite d9/da/d3d/d44/d55/dfe/f67 [0,4194304] 0 2024-02-15T18:27:09.661 INFO:tasks.workunit.client.0.smithi084.stdout:2/714: mkdir d3/d5/d53/de9 0 2024-02-15T18:27:09.663 INFO:tasks.workunit.client.1.smithi133.stdout:1/620: truncate d6/d1e/d41/f66 3080220 0 2024-02-15T18:27:09.663 INFO:tasks.workunit.client.1.smithi133.stdout:0/465: dwrite d9/d10/d22/d32/d7f/fa1 [0,4194304] 0 2024-02-15T18:27:09.663 INFO:tasks.workunit.client.1.smithi133.stdout:0/466: read d9/d10/d47/d5e/f86 [1878323,21094] 0 2024-02-15T18:27:09.663 INFO:tasks.workunit.client.1.smithi133.stdout:0/467: write d9/d10/d47/d5e/f8e [941747,37268] 0 2024-02-15T18:27:09.664 INFO:tasks.workunit.client.0.smithi084.stdout:4/791: creat d2/d4/d28/fe5 x:0 0 0 2024-02-15T18:27:09.664 INFO:tasks.workunit.client.0.smithi084.stdout:4/792: chown d2/d4/d25/f4a 25 1 2024-02-15T18:27:09.664 INFO:tasks.workunit.client.0.smithi084.stdout:4/793: truncate d2/d4/d28/d3d/d5c/d65/fe3 294267 0 2024-02-15T18:27:09.664 INFO:tasks.workunit.client.1.smithi133.stdout:6/643: dwrite d0/f2d [0,4194304] 0 2024-02-15T18:27:09.665 INFO:tasks.workunit.client.1.smithi133.stdout:6/644: chown d0/db/d29/d34/d8c/d98/la8 4138556 1 2024-02-15T18:27:09.665 INFO:tasks.workunit.client.1.smithi133.stdout:9/384: write d0/d8/d9/d12/d2a/d42/f59 [193235,58708] 0 2024-02-15T18:27:09.666 INFO:tasks.workunit.client.1.smithi133.stdout:1/621: creat d6/d1e/d41/dcc/fe3 x:0 0 0 2024-02-15T18:27:09.666 INFO:tasks.workunit.client.1.smithi133.stdout:0/468: truncate d9/d28/f4a 3894781 0 2024-02-15T18:27:09.669 INFO:tasks.workunit.client.0.smithi084.stdout:9/801: unlink d4/d3d/da5/fc7 0 2024-02-15T18:27:09.669 INFO:tasks.workunit.client.0.smithi084.stdout:9/802: truncate d4/da3/dc3/de1/f9f 933272 0 2024-02-15T18:27:09.671 INFO:tasks.workunit.client.0.smithi084.stdout:7/748: mkdir df/d1d/d1a/d6a/d8b/da5/db6/df5 0 2024-02-15T18:27:09.671 INFO:tasks.workunit.client.0.smithi084.stdout:7/749: chown df/d1d/d1a/d6a/d8b/da5/db6/df5 318674 1 2024-02-15T18:27:09.671 INFO:tasks.workunit.client.0.smithi084.stdout:7/750: write df/d1d/d1a/d6a/d8b/da5/db6/fe4 [582797,62117] 0 2024-02-15T18:27:09.675 INFO:tasks.workunit.client.0.smithi084.stdout:5/836: rename d9/d5b/d7e/d92/fc3 to d9/d5b/f114 0 2024-02-15T18:27:09.675 INFO:tasks.workunit.client.0.smithi084.stdout:5/837: getdents d9/d5f/d68/d9a/d8d/de5 0 2024-02-15T18:27:09.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/385: creat d0/d8/d9/d12/d2a/f7c x:0 0 0 2024-02-15T18:27:09.676 INFO:tasks.workunit.client.1.smithi133.stdout:1/622: creat d6/d1e/d3a/d97/fe4 x:0 0 0 2024-02-15T18:27:09.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/386: write d0/d8/d9/f3b [747320,51418] 0 2024-02-15T18:27:09.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/387: write d0/d8/d9/f31 [5059051,20616] 0 2024-02-15T18:27:09.677 INFO:tasks.workunit.client.0.smithi084.stdout:4/794: mkdir d2/d4/d28/d3d/d5c/d65/de6 0 2024-02-15T18:27:09.677 INFO:tasks.workunit.client.0.smithi084.stdout:4/795: fsync d2/f11 0 2024-02-15T18:27:09.678 INFO:tasks.workunit.client.0.smithi084.stdout:4/796: chown d2/d64/d74/f7f 8 1 2024-02-15T18:27:09.678 INFO:tasks.workunit.client.0.smithi084.stdout:9/803: dread d4/d2b/d3c/d24/dca/d15/d33/f7c [0,4194304] 0 2024-02-15T18:27:09.679 INFO:tasks.workunit.client.0.smithi084.stdout:4/797: write d2/f34 [357697,24512] 0 2024-02-15T18:27:09.679 INFO:tasks.workunit.client.1.smithi133.stdout:7/322: truncate d9/d36/f23 784129 0 2024-02-15T18:27:09.679 INFO:tasks.workunit.client.1.smithi133.stdout:7/323: getdents d9/da/d48/d5a 0 2024-02-15T18:27:09.679 INFO:tasks.workunit.client.1.smithi133.stdout:7/324: getdents d9/db/d55/d63 0 2024-02-15T18:27:09.683 INFO:tasks.workunit.client.1.smithi133.stdout:1/623: creat d6/d1e/d3a/d82/fe5 x:0 0 0 2024-02-15T18:27:09.683 INFO:tasks.workunit.client.1.smithi133.stdout:9/388: creat d0/d8/d9/d49/d4c/f7d x:0 0 0 2024-02-15T18:27:09.683 INFO:tasks.workunit.client.1.smithi133.stdout:7/325: symlink d9/db/d16/l6f 0 2024-02-15T18:27:09.683 INFO:tasks.workunit.client.1.smithi133.stdout:7/326: stat d9/d36 0 2024-02-15T18:27:09.683 INFO:tasks.workunit.client.1.smithi133.stdout:0/469: getdents d9/d10/d22 0 2024-02-15T18:27:09.684 INFO:tasks.workunit.client.1.smithi133.stdout:1/624: mknod d6/d1e/d41/dcc/ce6 0 2024-02-15T18:27:09.684 INFO:tasks.workunit.client.0.smithi084.stdout:9/804: write d4/d2b/d3c/d24/dca/f14 [3788306,18316] 0 2024-02-15T18:27:09.684 INFO:tasks.workunit.client.0.smithi084.stdout:9/805: write d4/d2b/d3c/d20/ff3 [939723,127591] 0 2024-02-15T18:27:09.684 INFO:tasks.workunit.client.0.smithi084.stdout:1/686: dwrite d9/d54/d1b/d2c/d4b/d7a/d89/f96 [0,4194304] 0 2024-02-15T18:27:09.685 INFO:tasks.workunit.client.0.smithi084.stdout:1/687: chown d9/d54/fd3 3 1 2024-02-15T18:27:09.685 INFO:tasks.workunit.client.1.smithi133.stdout:9/389: mknod d0/d7b/c7e 0 2024-02-15T18:27:09.685 INFO:tasks.workunit.client.0.smithi084.stdout:0/736: sync 2024-02-15T18:27:09.686 INFO:tasks.workunit.client.1.smithi133.stdout:7/327: creat d9/db/d16/d5d/d68/f70 x:0 0 0 2024-02-15T18:27:09.686 INFO:tasks.workunit.client.1.smithi133.stdout:7/328: chown d9/db/d16/d5d/d68/f70 54934493 1 2024-02-15T18:27:09.686 INFO:tasks.workunit.client.0.smithi084.stdout:5/838: truncate d9/da/d3d/d44/d55/d70/fbc 3558541 0 2024-02-15T18:27:09.687 INFO:tasks.workunit.client.0.smithi084.stdout:9/806: dread d4/d2b/daf/fbb [0,4194304] 0 2024-02-15T18:27:09.690 INFO:tasks.workunit.client.1.smithi133.stdout:6/645: dwrite d0/db/d21/fd2 [0,4194304] 0 2024-02-15T18:27:09.690 INFO:tasks.workunit.client.1.smithi133.stdout:6/646: readlink d0/d62/d66/l95 0 2024-02-15T18:27:09.690 INFO:tasks.workunit.client.0.smithi084.stdout:6/709: dwrite d14/d22/f64 [0,4194304] 0 2024-02-15T18:27:09.690 INFO:tasks.workunit.client.1.smithi133.stdout:0/470: creat d9/d10/d22/d32/fa2 x:0 0 0 2024-02-15T18:27:09.691 INFO:tasks.workunit.client.1.smithi133.stdout:1/625: unlink d6/d1e/d3a/d79/d8e/fb2 0 2024-02-15T18:27:09.691 INFO:tasks.workunit.client.0.smithi084.stdout:7/751: dread f4 [4194304,4194304] 0 2024-02-15T18:27:09.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.695+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f12801055c0 con 0x7f12800f5770 2024-02-15T18:27:09.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.696+0000 7f1275ffb700 1 -- 172.21.15.84:0/272657030 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+697 (secure 0 0 0) 0x7f12780192d0 con 0x7f12800f5770 2024-02-15T18:27:09.693 INFO:tasks.workunit.client.0.smithi084.stdout:4/798: rename d2/d4/d28/d3d/d5c/d65/d9f/ccd to d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/ce7 0 2024-02-15T18:27:09.693 INFO:tasks.workunit.client.1.smithi133.stdout:9/390: mkdir d0/d8/d9/d12/d7f 0 2024-02-15T18:27:09.693 INFO:tasks.workunit.client.1.smithi133.stdout:9/391: truncate d0/f55 501208 0 2024-02-15T18:27:09.693 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:27:09.693 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:27:09.694 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2, 2024-02-15T18:27:09.695 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12 2024-02-15T18:27:09.695 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:27:09.695 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:27:09.695 INFO:tasks.workunit.client.1.smithi133.stdout:7/329: rmdir d9/da/d48/d6b 0 2024-02-15T18:27:09.696 INFO:tasks.workunit.client.1.smithi133.stdout:0/471: dread d9/d10/d47/d5e/f86 [0,4194304] 0 2024-02-15T18:27:09.696 INFO:tasks.workunit.client.1.smithi133.stdout:0/472: write d9/d2b/f72 [1597298,22490] 0 2024-02-15T18:27:09.696 INFO:tasks.workunit.client.1.smithi133.stdout:0/473: dread - d9/d10/d2c/f5d zero size 2024-02-15T18:27:09.696 INFO:tasks.workunit.client.1.smithi133.stdout:0/474: fsync d9/d2b/f6c 0 2024-02-15T18:27:09.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.702+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f126c061020 msgr2=0x7f126c0634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.702+0000 7f1287393700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f126c061020 0x7f126c0634e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1270004d80 tx=0x7f127000b040).stop 2024-02-15T18:27:09.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.702+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f5770 msgr2=0x7f12800692f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.702+0000 7f1287393700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f5770 0x7f12800692f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f127800eb70 tx=0x7f127800b040).stop 2024-02-15T18:27:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.702+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 shutdown_connections 2024-02-15T18:27:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.702+0000 7f1287393700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f126c061020 0x7f126c0634e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.702+0000 7f1287393700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12800f4610 0x7f1280068e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.702+0000 7f1287393700 1 --2- 172.21.15.84:0/272657030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800f5770 0x7f12800692f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.702+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 >> 172.21.15.84:0/272657030 conn(0x7f12800f0080 msgr2=0x7f12800f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:09.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.703+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 shutdown_connections 2024-02-15T18:27:09.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.703+0000 7f1287393700 1 -- 172.21.15.84:0/272657030 wait complete. 2024-02-15T18:27:09.700 INFO:tasks.workunit.client.0.smithi084.stdout:1/688: link d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/lcd d9/d54/d76/d9f/ldd 0 2024-02-15T18:27:09.701 INFO:tasks.workunit.client.0.smithi084.stdout:0/737: getdents d0/d2f/d4b/dae 0 2024-02-15T18:27:09.702 INFO:tasks.workunit.client.1.smithi133.stdout:6/647: mknod d0/d3b/d67/cd5 0 2024-02-15T18:27:09.702 INFO:tasks.workunit.client.1.smithi133.stdout:1/626: mkdir d6/d1e/d3a/d82/d85/de7 0 2024-02-15T18:27:09.703 INFO:tasks.workunit.client.1.smithi133.stdout:0/475: creat d9/d10/d22/d32/d7f/fa3 x:0 0 0 2024-02-15T18:27:09.703 INFO:tasks.workunit.client.1.smithi133.stdout:6/648: dread d0/d3b/d9d/db3/fa0 [0,4194304] 0 2024-02-15T18:27:09.703 INFO:tasks.workunit.client.1.smithi133.stdout:6/649: dread - d0/db/d29/d34/f97 zero size 2024-02-15T18:27:09.705 INFO:tasks.workunit.client.1.smithi133.stdout:1/627: symlink d6/d1e/d3a/d82/d85/d67/da6/le8 0 2024-02-15T18:27:09.707 INFO:tasks.workunit.client.1.smithi133.stdout:1/628: mknod d6/d2a/d59/d5a/da4/daa/ce9 0 2024-02-15T18:27:09.707 INFO:tasks.workunit.client.1.smithi133.stdout:1/629: chown d6/d1e/d3a/d82/d85/d67/ddb/ce1 75796 1 2024-02-15T18:27:09.713 INFO:tasks.workunit.client.0.smithi084.stdout:5/839: mkdir d9/d5f/dcc/d115 0 2024-02-15T18:27:09.713 INFO:tasks.workunit.client.0.smithi084.stdout:6/710: mknod d14/d22/d25/d2f/d31/d30/d45/d54/ce6 0 2024-02-15T18:27:09.713 INFO:tasks.workunit.client.0.smithi084.stdout:0/738: rmdir d0/d1e/da2 39 2024-02-15T18:27:09.713 INFO:tasks.workunit.client.0.smithi084.stdout:1/689: creat d9/d54/d7f/db7/dd9/d81/d94/fde x:0 0 0 2024-02-15T18:27:09.713 INFO:tasks.workunit.client.0.smithi084.stdout:1/690: dread - d9/d54/fd3 zero size 2024-02-15T18:27:09.713 INFO:tasks.workunit.client.0.smithi084.stdout:7/752: dwrite df/d1d/d1a/d4b/f50 [4194304,4194304] 0 2024-02-15T18:27:09.714 INFO:tasks.workunit.client.1.smithi133.stdout:0/476: dread d9/f14 [0,4194304] 0 2024-02-15T18:27:09.714 INFO:tasks.workunit.client.1.smithi133.stdout:0/477: chown d9/d10/d47/d5e/f8e 776 1 2024-02-15T18:27:09.714 INFO:tasks.workunit.client.1.smithi133.stdout:0/478: dread - d9/d10/d47/f87 zero size 2024-02-15T18:27:09.714 INFO:tasks.workunit.client.1.smithi133.stdout:0/479: truncate d9/d10/d19/d29/d67/d68/d96/d44/f6a 1231336 0 2024-02-15T18:27:09.716 INFO:tasks.workunit.client.0.smithi084.stdout:5/840: rmdir d9/d5f/d68 39 2024-02-15T18:27:09.716 INFO:tasks.workunit.client.0.smithi084.stdout:6/711: chown d14/d22/d25/d2f/d31/c9a 510361266 1 2024-02-15T18:27:09.718 INFO:tasks.workunit.client.0.smithi084.stdout:4/799: rename d2/d64/d74/fb7 to d2/d2b/fe8 0 2024-02-15T18:27:09.719 INFO:tasks.workunit.client.0.smithi084.stdout:1/691: mkdir d9/d54/d1b/d2c/d4b/ddf 0 2024-02-15T18:27:09.721 INFO:tasks.workunit.client.1.smithi133.stdout:9/392: dwrite d0/f6 [0,4194304] 0 2024-02-15T18:27:09.723 INFO:tasks.workunit.client.1.smithi133.stdout:1/630: dread d6/d89/f81 [0,4194304] 0 2024-02-15T18:27:09.723 INFO:tasks.workunit.client.1.smithi133.stdout:7/330: dread d9/db/f1f [0,4194304] 0 2024-02-15T18:27:09.723 INFO:tasks.workunit.client.0.smithi084.stdout:1/692: write d9/d54/d32/d5b/f90 [3760560,67290] 0 2024-02-15T18:27:09.727 INFO:tasks.workunit.client.0.smithi084.stdout:5/841: unlink d9/da/d3d/d44/d55/d70/f8a 0 2024-02-15T18:27:09.728 INFO:tasks.workunit.client.0.smithi084.stdout:6/712: rmdir d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43 39 2024-02-15T18:27:09.729 INFO:tasks.workunit.client.0.smithi084.stdout:7/753: rename df/d1d/d1a/d4d/f67 to df/d1d/d1a/d6a/d8e/d79/ddc/df0/ff6 0 2024-02-15T18:27:09.734 INFO:tasks.workunit.client.0.smithi084.stdout:5/842: link d9/d5b/d7e/d92/fb0 d9/f116 0 2024-02-15T18:27:09.735 INFO:tasks.workunit.client.0.smithi084.stdout:6/713: mkdir d14/d22/d25/d2f/d31/d30/d4f/d7f/de7 0 2024-02-15T18:27:09.737 INFO:tasks.workunit.client.0.smithi084.stdout:7/754: unlink df/d1d/d1a/d6a/fac 0 2024-02-15T18:27:09.738 INFO:tasks.workunit.client.1.smithi133.stdout:6/650: dwrite d0/d3b/d9d/db3/fa0 [0,4194304] 0 2024-02-15T18:27:09.741 INFO:tasks.workunit.client.0.smithi084.stdout:5/843: getdents d9/d5f/d68 0 2024-02-15T18:27:09.741 INFO:tasks.workunit.client.0.smithi084.stdout:6/714: mkdir d14/d22/d25/de8 0 2024-02-15T18:27:09.741 INFO:tasks.workunit.client.0.smithi084.stdout:7/755: getdents df/d1d/d44/d8d 0 2024-02-15T18:27:09.741 INFO:tasks.workunit.client.0.smithi084.stdout:7/756: dread - df/d1d/d1a/d4b/fb8 zero size 2024-02-15T18:27:09.743 INFO:tasks.workunit.client.1.smithi133.stdout:7/331: dread d9/f47 [0,4194304] 0 2024-02-15T18:27:09.744 INFO:tasks.workunit.client.0.smithi084.stdout:5/844: creat d9/d5f/dcc/f117 x:0 0 0 2024-02-15T18:27:09.744 INFO:tasks.workunit.client.0.smithi084.stdout:6/715: symlink d14/d22/d25/d2f/d31/dcf/dd8/le9 0 2024-02-15T18:27:09.745 INFO:tasks.workunit.client.0.smithi084.stdout:7/757: rename df/d1d/d1a/f75 to df/d1d/d1a/d4d/d55/d88/ff7 0 2024-02-15T18:27:09.751 INFO:tasks.workunit.client.0.smithi084.stdout:4/800: dwrite d2/d4/f20 [0,4194304] 0 2024-02-15T18:27:09.756 INFO:tasks.workunit.client.0.smithi084.stdout:6/716: rmdir d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95 39 2024-02-15T18:27:09.756 INFO:tasks.workunit.client.0.smithi084.stdout:0/739: dwrite d0/d4/d3a/d5c/fa1 [0,4194304] 0 2024-02-15T18:27:09.756 INFO:tasks.workunit.client.1.smithi133.stdout:9/393: dwrite d0/d8/d6c/f78 [0,4194304] 0 2024-02-15T18:27:09.758 INFO:tasks.workunit.client.0.smithi084.stdout:6/717: mkdir d14/d22/d25/d2f/d31/d30/d93/ddc/dea 0 2024-02-15T18:27:09.761 INFO:tasks.workunit.client.0.smithi084.stdout:1/693: truncate d9/d54/d32/d5b/f90 1564534 0 2024-02-15T18:27:09.761 INFO:tasks.workunit.client.0.smithi084.stdout:1/694: chown d9/d54/d32/l3e 5911599 1 2024-02-15T18:27:09.761 INFO:tasks.workunit.client.0.smithi084.stdout:1/695: readlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/lae 0 2024-02-15T18:27:09.762 INFO:tasks.workunit.client.0.smithi084.stdout:5/845: dwrite d9/d5f/da7/fca [0,4194304] 0 2024-02-15T18:27:09.764 INFO:tasks.workunit.client.1.smithi133.stdout:0/480: creat d9/d10/d19/d29/d67/fa4 x:0 0 0 2024-02-15T18:27:09.764 INFO:tasks.workunit.client.0.smithi084.stdout:6/718: mkdir d14/d22/d25/d2f/d31/deb 0 2024-02-15T18:27:09.765 INFO:tasks.workunit.client.1.smithi133.stdout:1/631: symlink d6/d1e/d3a/d82/d85/d67/da6/lea 0 2024-02-15T18:27:09.765 INFO:tasks.workunit.client.1.smithi133.stdout:0/481: write d9/d2b/f53 [127851,115431] 0 2024-02-15T18:27:09.766 INFO:tasks.workunit.client.1.smithi133.stdout:6/651: truncate d0/db/d29/d34/d5d/fa6 1118048 0 2024-02-15T18:27:09.767 INFO:tasks.workunit.client.0.smithi084.stdout:7/758: rename df/d1d/d1a/d4d/d55/d88 to df/d1d/d44/dbb/df8 0 2024-02-15T18:27:09.768 INFO:tasks.workunit.client.1.smithi133.stdout:7/332: creat d9/db/d16/d5d/d68/f71 x:0 0 0 2024-02-15T18:27:09.769 INFO:tasks.workunit.client.1.smithi133.stdout:9/394: mknod d0/d8/d10/d4d/c80 0 2024-02-15T18:27:09.769 INFO:tasks.workunit.client.1.smithi133.stdout:9/395: chown d0/d8/d9/d3c/c71 126568 1 2024-02-15T18:27:09.771 INFO:tasks.workunit.client.0.smithi084.stdout:5/846: mkdir d9/d35/d65/d7f/dd6/deb/df0/d118 0 2024-02-15T18:27:09.771 INFO:tasks.workunit.client.0.smithi084.stdout:7/759: symlink df/d1d/d1a/lf9 0 2024-02-15T18:27:09.771 INFO:tasks.workunit.client.0.smithi084.stdout:7/760: readlink df/d1d/d1a/d4d/d55/l5e 0 2024-02-15T18:27:09.771 INFO:tasks.workunit.client.0.smithi084.stdout:7/761: dread - df/d1d/fef zero size 2024-02-15T18:27:09.772 INFO:tasks.workunit.client.0.smithi084.stdout:1/696: rename d9/d54/d32/d5b/d69/c87 to d9/d54/d1b/d38/d4d/ce0 0 2024-02-15T18:27:09.773 INFO:tasks.workunit.client.0.smithi084.stdout:5/847: mkdir d9/d5b/d7e/db5/d119 0 2024-02-15T18:27:09.773 INFO:tasks.workunit.client.0.smithi084.stdout:7/762: getdents df/d70/d9c 0 2024-02-15T18:27:09.774 INFO:tasks.workunit.client.1.smithi133.stdout:1/632: getdents d6/d1e/d3a/d79/d8e 0 2024-02-15T18:27:09.774 INFO:tasks.workunit.client.1.smithi133.stdout:1/633: readlink d6/d1e/d41/l55 0 2024-02-15T18:27:09.776 INFO:tasks.workunit.client.1.smithi133.stdout:0/482: rename d9/d10/d19/d1a/c84 to d9/d10/d19/d29/d67/ca5 0 2024-02-15T18:27:09.777 INFO:tasks.workunit.client.0.smithi084.stdout:1/697: getdents d9/d54/d7f/db7/dc0 0 2024-02-15T18:27:09.777 INFO:tasks.workunit.client.0.smithi084.stdout:0/740: dwrite d0/d2f/d3f/d4c/faf [0,4194304] 0 2024-02-15T18:27:09.777 INFO:tasks.workunit.client.0.smithi084.stdout:5/848: stat d9/d35/c49 0 2024-02-15T18:27:09.777 INFO:tasks.workunit.client.0.smithi084.stdout:4/801: dwrite d2/d4/d28/d2e/fd8 [0,4194304] 0 2024-02-15T18:27:09.779 INFO:tasks.workunit.client.0.smithi084.stdout:1/698: dread d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/fd0 [0,4194304] 0 2024-02-15T18:27:09.780 INFO:tasks.workunit.client.0.smithi084.stdout:6/719: dread d14/d22/d25/d2f/d31/d3f/d4a/fd4 [0,4194304] 0 2024-02-15T18:27:09.780 INFO:tasks.workunit.client.0.smithi084.stdout:6/720: chown d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/ca1 31859708 1 2024-02-15T18:27:09.781 INFO:tasks.workunit.client.0.smithi084.stdout:5/849: rename d9/d5b/cba to d9/da/d3d/d44/d55/d96/c11a 0 2024-02-15T18:27:09.781 INFO:tasks.workunit.client.0.smithi084.stdout:5/850: dread - d9/d5b/d79/db7/f9c zero size 2024-02-15T18:27:09.781 INFO:tasks.workunit.client.1.smithi133.stdout:9/396: truncate d0/d8/d9/ff 2879043 0 2024-02-15T18:27:09.781 INFO:tasks.workunit.client.1.smithi133.stdout:9/397: fdatasync d0/f6 0 2024-02-15T18:27:09.781 INFO:tasks.workunit.client.1.smithi133.stdout:9/398: chown d0/d8/f22 486880 1 2024-02-15T18:27:09.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/333: creat d9/db/d55/f72 x:0 0 0 2024-02-15T18:27:09.781 INFO:tasks.workunit.client.1.smithi133.stdout:1/634: creat d6/d1e/d3a/d82/d85/d67/ddb/feb x:0 0 0 2024-02-15T18:27:09.782 INFO:tasks.workunit.client.1.smithi133.stdout:0/483: rename d9/l18 to d9/d10/d22/la6 0 2024-02-15T18:27:09.782 INFO:tasks.workunit.client.1.smithi133.stdout:1/635: write d6/d17/f60 [786038,62473] 0 2024-02-15T18:27:09.792 INFO:tasks.workunit.client.1.smithi133.stdout:3/485: sync 2024-02-15T18:27:09.792 INFO:tasks.workunit.client.1.smithi133.stdout:5/363: sync 2024-02-15T18:27:09.793 INFO:tasks.workunit.client.1.smithi133.stdout:2/438: sync 2024-02-15T18:27:09.793 INFO:tasks.workunit.client.1.smithi133.stdout:8/431: sync 2024-02-15T18:27:09.793 INFO:tasks.workunit.client.1.smithi133.stdout:4/350: sync 2024-02-15T18:27:09.793 INFO:tasks.workunit.client.1.smithi133.stdout:3/486: chown d0/d15/f16 43915399 1 2024-02-15T18:27:09.793 INFO:tasks.workunit.client.1.smithi133.stdout:8/432: dread - d3/de/f66 zero size 2024-02-15T18:27:09.793 INFO:tasks.workunit.client.1.smithi133.stdout:9/399: creat d0/d8/f81 x:0 0 0 2024-02-15T18:27:09.795 INFO:tasks.workunit.client.1.smithi133.stdout:7/334: mkdir d9/db/d16/d5d/d68/d73 0 2024-02-15T18:27:09.795 INFO:tasks.workunit.client.1.smithi133.stdout:0/484: mkdir d9/d10/d19/d29/d67/d68/d9c/da7 0 2024-02-15T18:27:09.796 INFO:tasks.workunit.client.1.smithi133.stdout:1/636: mknod d6/d1e/d3a/d9e/cec 0 2024-02-15T18:27:09.797 INFO:tasks.workunit.client.1.smithi133.stdout:2/439: mknod d7/db/d67/c8d 0 2024-02-15T18:27:09.798 INFO:tasks.workunit.client.1.smithi133.stdout:4/351: mknod d2/d48/d6a/c7b 0 2024-02-15T18:27:09.801 INFO:tasks.workunit.client.1.smithi133.stdout:3/487: rename d0/d15/d2b to d0/d15/d2f/d9b 0 2024-02-15T18:27:09.801 INFO:tasks.workunit.client.1.smithi133.stdout:3/488: chown d0 760992 1 2024-02-15T18:27:09.802 INFO:tasks.workunit.client.1.smithi133.stdout:9/400: rename d0/d8/d9/d12/d2a to d0/d8/d9/d12/d82 0 2024-02-15T18:27:09.803 INFO:tasks.workunit.client.1.smithi133.stdout:7/335: mknod d9/db/d16/c74 0 2024-02-15T18:27:09.803 INFO:tasks.workunit.client.1.smithi133.stdout:7/336: chown d9/d36 2 1 2024-02-15T18:27:09.803 INFO:tasks.workunit.client.1.smithi133.stdout:7/337: chown d9/c2c 507 1 2024-02-15T18:27:09.804 INFO:tasks.workunit.client.1.smithi133.stdout:0/485: creat d9/d10/d19/d29/d67/fa8 x:0 0 0 2024-02-15T18:27:09.804 INFO:tasks.workunit.client.1.smithi133.stdout:1/637: mkdir d6/d1e/d41/d7c/d7e/d7f/db6/ded 0 2024-02-15T18:27:09.806 INFO:tasks.workunit.client.1.smithi133.stdout:4/352: rename d2/d48/d6a/c7b to d2/d48/d5c/c7c 0 2024-02-15T18:27:09.806 INFO:tasks.workunit.client.1.smithi133.stdout:9/401: rename d0/d8 to d0/d8/d9/d49/d83 22 2024-02-15T18:27:09.806 INFO:tasks.workunit.client.1.smithi133.stdout:3/489: getdents d0/d15/d2f/d9b/d62/d74/d78 0 2024-02-15T18:27:09.806 INFO:tasks.workunit.client.1.smithi133.stdout:3/490: write d0/d15/d2f/d9b/d39/f8f [5209313,21174] 0 2024-02-15T18:27:09.807 INFO:tasks.workunit.client.1.smithi133.stdout:7/338: creat d9/db/d16/d5d/f75 x:0 0 0 2024-02-15T18:27:09.807 INFO:tasks.workunit.client.1.smithi133.stdout:7/339: truncate d9/d36/d31/f59 1813206 0 2024-02-15T18:27:09.807 INFO:tasks.workunit.client.1.smithi133.stdout:3/491: dread d0/d15/d2f/d9b/f45 [0,4194304] 0 2024-02-15T18:27:09.807 INFO:tasks.workunit.client.1.smithi133.stdout:3/492: write d0/d15/d2f/d9b/d62/f6f [154679,30540] 0 2024-02-15T18:27:09.808 INFO:tasks.workunit.client.1.smithi133.stdout:4/353: mknod d2/d5/d2b/d21/d2d/c7d 0 2024-02-15T18:27:09.808 INFO:tasks.workunit.client.1.smithi133.stdout:4/354: fsync d2/d5/d2b/d21/f31 0 2024-02-15T18:27:09.809 INFO:tasks.workunit.client.1.smithi133.stdout:9/402: creat d0/d8/d9/d12/d82/d42/d44/f84 x:0 0 0 2024-02-15T18:27:09.809 INFO:tasks.workunit.client.1.smithi133.stdout:9/403: truncate d0/d8/d9/d12/d82/f2e 2212752 0 2024-02-15T18:27:09.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/340: unlink d9/db/d16/d5d/f75 0 2024-02-15T18:27:09.818 INFO:tasks.workunit.client.1.smithi133.stdout:0/486: dread d9/d10/d22/d32/d7f/fa1 [0,4194304] 0 2024-02-15T18:27:09.819 INFO:tasks.workunit.client.1.smithi133.stdout:0/487: dread - d9/d10/d22/d32/fa2 zero size 2024-02-15T18:27:09.820 INFO:tasks.workunit.client.1.smithi133.stdout:0/488: mkdir d9/d10/d2c/da9 0 2024-02-15T18:27:09.828 INFO:tasks.workunit.client.0.smithi084.stdout:3/692: sync 2024-02-15T18:27:09.828 INFO:tasks.workunit.client.0.smithi084.stdout:8/754: sync 2024-02-15T18:27:09.839 INFO:tasks.workunit.client.1.smithi133.stdout:4/355: write d2/d5/d2b/f1a [3866051,58571] 0 2024-02-15T18:27:09.841 INFO:tasks.workunit.client.0.smithi084.stdout:4/802: unlink d2/d2b/d47/d31/f9e 0 2024-02-15T18:27:09.841 INFO:tasks.workunit.client.1.smithi133.stdout:4/356: symlink d2/d5/d2b/d21/d2d/d44/d51/l7e 0 2024-02-15T18:27:09.841 INFO:tasks.workunit.client.0.smithi084.stdout:1/699: mknod d9/d54/d76/d9f/ce1 0 2024-02-15T18:27:09.842 INFO:tasks.workunit.client.0.smithi084.stdout:6/721: truncate f3 3694485 0 2024-02-15T18:27:09.843 INFO:tasks.workunit.client.0.smithi084.stdout:0/741: dwrite d0/d2f/d3f/d8a/f8b [0,4194304] 0 2024-02-15T18:27:09.844 INFO:tasks.workunit.client.0.smithi084.stdout:5/851: symlink d9/da/d3d/d44/d55/d70/d84/l11b 0 2024-02-15T18:27:09.844 INFO:tasks.workunit.client.0.smithi084.stdout:5/852: getdents d9/d5b/d79/db7/dff 0 2024-02-15T18:27:09.844 INFO:tasks.workunit.client.0.smithi084.stdout:3/693: unlink d8/d73/f9f 0 2024-02-15T18:27:09.846 INFO:tasks.workunit.client.0.smithi084.stdout:8/755: link db/d1a/d2b/c61 db/dd/d13/de0/cf6 0 2024-02-15T18:27:09.846 INFO:tasks.workunit.client.0.smithi084.stdout:4/803: rmdir d2/d4/d28/d3d/d5c/d5d 39 2024-02-15T18:27:09.847 INFO:tasks.workunit.client.0.smithi084.stdout:4/804: write d2/d4/f82 [4056605,9695] 0 2024-02-15T18:27:09.847 INFO:tasks.workunit.client.0.smithi084.stdout:4/805: dread - d2/d4/fb2 zero size 2024-02-15T18:27:09.848 INFO:tasks.workunit.client.0.smithi084.stdout:1/700: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/le2 0 2024-02-15T18:27:09.848 INFO:tasks.workunit.client.0.smithi084.stdout:1/701: stat d9/d54/d1b/l3f 0 2024-02-15T18:27:09.848 INFO:tasks.workunit.client.0.smithi084.stdout:1/702: truncate d9/d54/d1b/fcf 511384 0 2024-02-15T18:27:09.849 INFO:tasks.workunit.client.0.smithi084.stdout:6/722: mkdir d14/d22/d25/d2f/d31/d3f/dec 0 2024-02-15T18:27:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.853+0000 7f12ed4d7700 1 -- 172.21.15.84:0/1298522000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f55e0 msgr2=0x7f12e80f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.853+0000 7f12ed4d7700 1 --2- 172.21.15.84:0/1298522000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f55e0 0x7f12e80f5a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f12d8004660 tx=0x7f12d8009b30).stop 2024-02-15T18:27:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.853+0000 7f12ed4d7700 1 -- 172.21.15.84:0/1298522000 shutdown_connections 2024-02-15T18:27:09.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.853+0000 7f12ed4d7700 1 --2- 172.21.15.84:0/1298522000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e80f5ef0 0x7f12e80f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.853+0000 7f12ed4d7700 1 --2- 172.21.15.84:0/1298522000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f55e0 0x7f12e80f5a00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.853+0000 7f12ed4d7700 1 -- 172.21.15.84:0/1298522000 >> 172.21.15.84:0/1298522000 conn(0x7f12e80f0de0 msgr2=0x7f12e80f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.853+0000 7f12ed4d7700 1 -- 172.21.15.84:0/1298522000 shutdown_connections 2024-02-15T18:27:09.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.853+0000 7f12ed4d7700 1 -- 172.21.15.84:0/1298522000 wait complete. 2024-02-15T18:27:09.850 INFO:tasks.workunit.client.0.smithi084.stdout:5/853: link d9/da/d3d/d44/d55/dfe/fbe d9/d5f/d68/d9a/d8d/de5/f11c 0 2024-02-15T18:27:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.854+0000 7f12ed4d7700 1 Processor -- start 2024-02-15T18:27:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.854+0000 7f12ed4d7700 1 -- start start 2024-02-15T18:27:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12ed4d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e80f55e0 0x7f12e80f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:09.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12ed4d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f5ef0 0x7f12e80f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12ed4d7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80f8250 con 0x7f12e80f5ef0 2024-02-15T18:27:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12ed4d7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80f8390 con 0x7f12e80f55e0 2024-02-15T18:27:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12e67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f5ef0 0x7f12e80f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12e67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f5ef0 0x7f12e80f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42214/0 (socket says 172.21.15.84:42214) 2024-02-15T18:27:09.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12e67fc700 1 -- 172.21.15.84:0/927140881 learned_addr learned my addr 172.21.15.84:0/927140881 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:09.852 INFO:tasks.workunit.client.0.smithi084.stdout:3/694: link d8/d40/d43/d71/d8c/d94/fbd d8/d40/d43/d71/d8c/d94/da3/dba/fec 0 2024-02-15T18:27:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12e67fc700 1 -- 172.21.15.84:0/927140881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e80f55e0 msgr2=0x7f12e80f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12e67fc700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e80f55e0 0x7f12e80f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.855+0000 7f12e67fc700 1 -- 172.21.15.84:0/927140881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d8005040 con 0x7f12e80f5ef0 2024-02-15T18:27:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.856+0000 7f12e67fc700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f5ef0 0x7f12e80f7c60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f12d000b410 tx=0x7f12d0006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.856+0000 7f12df7fe700 1 -- 172.21.15.84:0/927140881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12d00125f0 con 0x7f12e80f5ef0 2024-02-15T18:27:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.856+0000 7f12df7fe700 1 -- 172.21.15.84:0/927140881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f12d0012c40 con 0x7f12e80f5ef0 2024-02-15T18:27:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.856+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e80f8670 con 0x7f12e80f5ef0 2024-02-15T18:27:09.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.856+0000 7f12df7fe700 1 -- 172.21.15.84:0/927140881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12d0002b80 con 0x7f12e80f5ef0 2024-02-15T18:27:09.854 INFO:tasks.workunit.client.0.smithi084.stdout:8/756: creat db/dd/d13/d42/d79/ff7 x:0 0 0 2024-02-15T18:27:09.854 INFO:tasks.workunit.client.0.smithi084.stdout:8/757: chown db/dd/d1f/d3e/lf4 65194 1 2024-02-15T18:27:09.854 INFO:tasks.workunit.client.0.smithi084.stdout:1/703: truncate d9/d54/f99 4046399 0 2024-02-15T18:27:09.854 INFO:tasks.workunit.client.1.smithi133.stdout:1/638: dwrite d6/d1e/d3a/d82/d85/f39 [0,4194304] 0 2024-02-15T18:27:09.855 INFO:tasks.workunit.client.0.smithi084.stdout:4/806: write d2/d2b/d47/d31/f43 [3223591,87366] 0 2024-02-15T18:27:09.856 INFO:tasks.workunit.client.0.smithi084.stdout:5/854: rename d9/da/d3d/d44/d55/dfe/f67 to d9/da/d3d/d44/d55/d70/dfa/f11d 0 2024-02-15T18:27:09.856 INFO:tasks.workunit.client.0.smithi084.stdout:3/695: symlink d8/d40/d58/led 0 2024-02-15T18:27:09.856 INFO:tasks.workunit.client.0.smithi084.stdout:0/742: dread d0/d2f/d3f/d4f/d59/f60 [0,4194304] 0 2024-02-15T18:27:09.856 INFO:tasks.workunit.client.0.smithi084.stdout:8/758: mknod db/dd/d4d/df1/cf8 0 2024-02-15T18:27:09.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.856+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e810f0c0 con 0x7f12e80f5ef0 2024-02-15T18:27:09.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.859+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e8045ad0 con 0x7f12e80f5ef0 2024-02-15T18:27:09.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.859+0000 7f12df7fe700 1 -- 172.21.15.84:0/927140881 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 28) v1 ==== 77194+0+0 (secure 0 0 0) 0x7f12d000f030 con 0x7f12e80f5ef0 2024-02-15T18:27:09.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.859+0000 7f12df7fe700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f12d4060fb0 0x7f12d4063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:09.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.860+0000 7f12df7fe700 1 -- 172.21.15.84:0/927140881 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f12d007c5c0 con 0x7f12e80f5ef0 2024-02-15T18:27:09.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.861+0000 7f12e6ffd700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f12d4060fb0 0x7f12d4063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:09.857 INFO:tasks.workunit.client.1.smithi133.stdout:9/404: dwrite d0/d8/d9/d12/d82/d42/f45 [0,4194304] 0 2024-02-15T18:27:09.858 INFO:tasks.workunit.client.1.smithi133.stdout:9/405: readlink d0/d8/d9/d12/d82/l68 0 2024-02-15T18:27:09.858 INFO:tasks.workunit.client.0.smithi084.stdout:1/704: rmdir d9/d54/d7f/db7 39 2024-02-15T18:27:09.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.862+0000 7f12e6ffd700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f12d4060fb0 0x7f12d4063470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f12d8009f50 tx=0x7f12d8009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:09.859 INFO:tasks.workunit.client.1.smithi133.stdout:1/639: rmdir d6/d1e/d3a/d82/d85/d67 39 2024-02-15T18:27:09.859 INFO:tasks.workunit.client.0.smithi084.stdout:5/855: creat d9/da/d3d/d44/d55/f11e x:0 0 0 2024-02-15T18:27:09.859 INFO:tasks.workunit.client.0.smithi084.stdout:5/856: readlink d9/da/d3d/d44/d55/d96/lf3 0 2024-02-15T18:27:09.859 INFO:tasks.workunit.client.0.smithi084.stdout:0/743: mkdir d0/d2f/d3f/d4c/de1 0 2024-02-15T18:27:09.860 INFO:tasks.workunit.client.0.smithi084.stdout:8/759: creat db/dd/d1f/d9b/ff9 x:0 0 0 2024-02-15T18:27:09.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/406: rename d0/d8/d9/d12/d82/d42/f61 to d0/d8/d9/d12/d4f/f85 0 2024-02-15T18:27:09.861 INFO:tasks.workunit.client.0.smithi084.stdout:5/857: link d9/d5b/d7e/db5/fd2 d9/d35/d65/d7f/dd6/deb/df0/d118/f11f 0 2024-02-15T18:27:09.862 INFO:tasks.workunit.client.0.smithi084.stdout:8/760: mkdir db/dd/d13/d42/d79/dfa 0 2024-02-15T18:27:09.862 INFO:tasks.workunit.client.0.smithi084.stdout:3/696: dread d8/d40/fa8 [0,4194304] 0 2024-02-15T18:27:09.862 INFO:tasks.workunit.client.0.smithi084.stdout:6/723: write d14/d22/d25/d2f/d31/d30/f6b [1407993,1499] 0 2024-02-15T18:27:09.863 INFO:tasks.workunit.client.0.smithi084.stdout:6/724: chown l2 79 1 2024-02-15T18:27:09.863 INFO:tasks.workunit.client.0.smithi084.stdout:6/725: write d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/f69 [472081,49964] 0 2024-02-15T18:27:09.863 INFO:tasks.workunit.client.0.smithi084.stdout:5/858: symlink d9/d5b/d7e/l120 0 2024-02-15T18:27:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:09.867+0000 7f12df7fe700 1 -- 172.21.15.84:0/927140881 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f12d004ca30 con 0x7f12e80f5ef0 2024-02-15T18:27:09.866 INFO:tasks.workunit.client.0.smithi084.stdout:3/697: creat d8/d40/d58/d80/dc4/fee x:0 0 0 2024-02-15T18:27:09.867 INFO:tasks.workunit.client.0.smithi084.stdout:3/698: getdents d8/d40/d43/d71/d8c/d94/da3/dea 0 2024-02-15T18:27:09.867 INFO:tasks.workunit.client.0.smithi084.stdout:3/699: chown d8/d1f/dbf/fc9 95287975 1 2024-02-15T18:27:09.867 INFO:tasks.workunit.client.0.smithi084.stdout:4/807: write d2/f3 [1892147,16015] 0 2024-02-15T18:27:09.871 INFO:tasks.workunit.client.1.smithi133.stdout:8/433: dwrite d3/d1c/d37/d5c/f89 [0,4194304] 0 2024-02-15T18:27:09.872 INFO:tasks.workunit.client.0.smithi084.stdout:1/705: dread d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 [0,4194304] 0 2024-02-15T18:27:09.872 INFO:tasks.workunit.client.0.smithi084.stdout:1/706: chown d9/d54/d7f/db7/dd9/f67 350 1 2024-02-15T18:27:09.872 INFO:tasks.workunit.client.0.smithi084.stdout:4/808: rename d2/d4/d28/d3d/d5c/d5d/dcf to d2/d64/d74/de9 0 2024-02-15T18:27:09.873 INFO:tasks.workunit.client.1.smithi133.stdout:4/357: dwrite d2/d5/d2b/d21/d2d/f2e [0,4194304] 0 2024-02-15T18:27:09.874 INFO:tasks.workunit.client.0.smithi084.stdout:1/707: rmdir d9/d54/d7f/db7/dd9/d81/d94 39 2024-02-15T18:27:09.874 INFO:tasks.workunit.client.0.smithi084.stdout:1/708: stat d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f84 0 2024-02-15T18:27:09.874 INFO:tasks.workunit.client.0.smithi084.stdout:1/709: chown d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/l66 26013483 1 2024-02-15T18:27:09.875 INFO:tasks.workunit.client.1.smithi133.stdout:8/434: mkdir d3/de/d3e/d82/d8b 0 2024-02-15T18:27:09.875 INFO:tasks.workunit.client.1.smithi133.stdout:8/435: readlink d3/d1f/d4f/l7a 0 2024-02-15T18:27:09.875 INFO:tasks.workunit.client.1.smithi133.stdout:8/436: write d3/d1f/f31 [3820921,47282] 0 2024-02-15T18:27:09.876 INFO:tasks.workunit.client.0.smithi084.stdout:4/809: rename d2/d2b/d47/d31/cd2 to d2/d4/d28/d3d/d5c/d5d/cea 0 2024-02-15T18:27:09.878 INFO:tasks.workunit.client.1.smithi133.stdout:8/437: mkdir d3/d1f/d3f/d8c 0 2024-02-15T18:27:09.879 INFO:tasks.workunit.client.1.smithi133.stdout:8/438: creat d3/d1c/d2f/d80/f8d x:0 0 0 2024-02-15T18:27:09.885 INFO:tasks.workunit.client.0.smithi084.stdout:6/726: dread d14/d22/d25/d2f/fd7 [0,4194304] 0 2024-02-15T18:27:09.888 INFO:tasks.workunit.client.0.smithi084.stdout:6/727: rename d14/d22/d25/d2f/d31/d30/d93 to d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded 0 2024-02-15T18:27:09.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:08.165538+0000 mgr.smithi084.hjmnez (mgr.14596) 22 : audit [DBG] from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:09.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:08.619685+0000 mgr.smithi084.hjmnez (mgr.14596) 23 : audit [DBG] from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:09.895 INFO:tasks.workunit.client.0.smithi084.stdout:6/728: dread d14/d22/d25/d2f/f60 [0,4194304] 0 2024-02-15T18:27:09.898 INFO:tasks.workunit.client.1.smithi133.stdout:2/440: write d7/d2c/d5a/d66/f7c [143801,11809] 0 2024-02-15T18:27:09.898 INFO:tasks.workunit.client.1.smithi133.stdout:2/441: fdatasync d7/ff 0 2024-02-15T18:27:09.901 INFO:tasks.workunit.client.0.smithi084.stdout:8/761: write db/d3f/d59/d69/f6b [1972113,88901] 0 2024-02-15T18:27:09.902 INFO:tasks.workunit.client.0.smithi084.stdout:8/762: chown db/dd/d13/d42/f80 0 1 2024-02-15T18:27:09.902 INFO:tasks.workunit.client.0.smithi084.stdout:8/763: chown db/d1a/da5 28 1 2024-02-15T18:27:09.902 INFO:tasks.workunit.client.0.smithi084.stdout:0/744: write d0/d4/f54 [1064406,101823] 0 2024-02-15T18:27:09.902 INFO:tasks.workunit.client.1.smithi133.stdout:9/407: dwrite d0/d8/d10/f30 [0,4194304] 0 2024-02-15T18:27:09.903 INFO:tasks.workunit.client.1.smithi133.stdout:9/408: write d0/d8/f81 [840590,69606] 0 2024-02-15T18:27:09.903 INFO:tasks.workunit.client.1.smithi133.stdout:9/409: dread - d0/d8/f48 zero size 2024-02-15T18:27:09.905 INFO:tasks.workunit.client.0.smithi084.stdout:6/729: write d14/d22/f64 [1996465,94822] 0 2024-02-15T18:27:09.905 INFO:tasks.workunit.client.0.smithi084.stdout:6/730: fsync d14/d22/d25/d2f/fc1 0 2024-02-15T18:27:09.905 INFO:tasks.workunit.client.0.smithi084.stdout:4/810: dread d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/fb1 [0,4194304] 0 2024-02-15T18:27:09.906 INFO:tasks.workunit.client.0.smithi084.stdout:8/764: symlink db/d3f/d59/dcd/lfb 0 2024-02-15T18:27:09.906 INFO:tasks.workunit.client.0.smithi084.stdout:8/765: write db/dd/d13/f5c [5426532,54906] 0 2024-02-15T18:27:09.906 INFO:tasks.workunit.client.0.smithi084.stdout:8/766: chown db/d6a/cc6 128046371 1 2024-02-15T18:27:09.907 INFO:tasks.workunit.client.0.smithi084.stdout:8/767: truncate db/d1a/d2b/d7b/fbf 427204 0 2024-02-15T18:27:09.909 INFO:tasks.workunit.client.0.smithi084.stdout:0/745: rename d0/d4/d1b/d26 to d0/d4/d3a/d5c/de2 0 2024-02-15T18:27:09.910 INFO:tasks.workunit.client.0.smithi084.stdout:6/731: getdents d14/d22/d25/d2f/d31/d30/d45/d54 0 2024-02-15T18:27:09.911 INFO:tasks.workunit.client.1.smithi133.stdout:2/442: rename d7/db/c2f to d7/d2c/d31/c8e 0 2024-02-15T18:27:09.911 INFO:tasks.workunit.client.1.smithi133.stdout:2/443: write d7/d2c/d3b/f50 [197489,69811] 0 2024-02-15T18:27:09.911 INFO:tasks.workunit.client.1.smithi133.stdout:2/444: chown d7/d18/d32/l7e 1 1 2024-02-15T18:27:09.912 INFO:tasks.workunit.client.1.smithi133.stdout:9/410: symlink d0/d8/d10/d4d/l86 0 2024-02-15T18:27:09.912 INFO:tasks.workunit.client.1.smithi133.stdout:9/411: read - d0/d8/d9/d12/f64 zero size 2024-02-15T18:27:09.912 INFO:tasks.workunit.client.1.smithi133.stdout:9/412: chown d0/d8/d9/d12/d82/f7c 4 1 2024-02-15T18:27:09.913 INFO:tasks.workunit.client.1.smithi133.stdout:2/445: creat d7/d2c/d31/f8f x:0 0 0 2024-02-15T18:27:09.914 INFO:tasks.workunit.client.0.smithi084.stdout:4/811: creat d2/d64/d74/feb x:0 0 0 2024-02-15T18:27:09.914 INFO:tasks.workunit.client.0.smithi084.stdout:4/812: readlink d2/d4/la8 0 2024-02-15T18:27:09.915 INFO:tasks.workunit.client.1.smithi133.stdout:2/446: link d7/c3f d7/d2c/d5a/d66/c90 0 2024-02-15T18:27:09.915 INFO:tasks.workunit.client.0.smithi084.stdout:4/813: read d2/d2b/d47/f56 [683796,10353] 0 2024-02-15T18:27:09.917 INFO:tasks.workunit.client.1.smithi133.stdout:2/447: link d7/d2c/d31/c51 d7/db/c91 0 2024-02-15T18:27:09.918 INFO:tasks.workunit.client.0.smithi084.stdout:0/746: symlink d0/d2f/d3f/d4c/le3 0 2024-02-15T18:27:09.918 INFO:tasks.workunit.client.0.smithi084.stdout:0/747: chown d0/d1e/c3d 62212 1 2024-02-15T18:27:09.920 INFO:tasks.workunit.client.0.smithi084.stdout:4/814: chown d2/d2b/l6c 1432 1 2024-02-15T18:27:09.922 INFO:tasks.workunit.client.1.smithi133.stdout:9/413: write d0/d8/d6c/f78 [2805540,10123] 0 2024-02-15T18:27:09.922 INFO:tasks.workunit.client.1.smithi133.stdout:9/414: readlink d0/d8/l3e 0 2024-02-15T18:27:09.926 INFO:tasks.workunit.client.1.smithi133.stdout:9/415: unlink d0/d8/d9/d12/d82/c39 0 2024-02-15T18:27:09.927 INFO:tasks.workunit.client.0.smithi084.stdout:6/732: dread f10 [0,4194304] 0 2024-02-15T18:27:09.928 INFO:tasks.workunit.client.1.smithi133.stdout:9/416: mknod d0/d37/c87 0 2024-02-15T18:27:09.929 INFO:tasks.workunit.client.0.smithi084.stdout:6/733: creat d14/d22/d25/d2f/d31/deb/fee x:0 0 0 2024-02-15T18:27:09.931 INFO:tasks.workunit.client.1.smithi133.stdout:8/439: dwrite d3/d1c/d37/f7b [0,4194304] 0 2024-02-15T18:27:09.932 INFO:tasks.workunit.client.0.smithi084.stdout:6/734: mknod d14/d22/d25/d2f/d31/dcf/dd8/cef 0 2024-02-15T18:27:09.933 INFO:tasks.workunit.client.0.smithi084.stdout:6/735: fdatasync d14/d22/d25/d2f/d31/d3f/f96 0 2024-02-15T18:27:09.934 INFO:tasks.workunit.client.1.smithi133.stdout:8/440: mknod d3/d1c/d2f/d87/d73/d84/c8e 0 2024-02-15T18:27:09.934 INFO:tasks.workunit.client.1.smithi133.stdout:8/441: readlink d3/d7/d40/d61/l88 0 2024-02-15T18:27:09.934 INFO:tasks.workunit.client.1.smithi133.stdout:8/442: chown d3/d1f/d3f 302884273 1 2024-02-15T18:27:09.934 INFO:tasks.workunit.client.1.smithi133.stdout:8/443: dread d3/d7/f72 [0,4194304] 0 2024-02-15T18:27:09.936 INFO:tasks.workunit.client.1.smithi133.stdout:8/444: creat d3/d1f/d3f/f8f x:0 0 0 2024-02-15T18:27:09.936 INFO:tasks.workunit.client.1.smithi133.stdout:8/445: write d3/de/f25 [5020175,28179] 0 2024-02-15T18:27:09.936 INFO:tasks.workunit.client.1.smithi133.stdout:2/448: dread d7/db/f1d [0,4194304] 0 2024-02-15T18:27:09.937 INFO:tasks.workunit.client.1.smithi133.stdout:8/446: link d3/d1f/c2d d3/d1c/d2f/d87/d73/c90 0 2024-02-15T18:27:09.938 INFO:tasks.workunit.client.1.smithi133.stdout:2/449: mknod d7/d2c/c92 0 2024-02-15T18:27:09.938 INFO:tasks.workunit.client.1.smithi133.stdout:2/450: truncate d7/ff 1969028 0 2024-02-15T18:27:09.940 INFO:tasks.workunit.client.1.smithi133.stdout:2/451: symlink d7/l93 0 2024-02-15T18:27:09.940 INFO:tasks.workunit.client.1.smithi133.stdout:5/364: dwrite d17/d20/f2f [0,4194304] 0 2024-02-15T18:27:09.940 INFO:tasks.workunit.client.1.smithi133.stdout:5/365: readlink d17/d20/l61 0 2024-02-15T18:27:09.940 INFO:tasks.workunit.client.1.smithi133.stdout:5/366: truncate d17/d26/f52 550261 0 2024-02-15T18:27:09.941 INFO:tasks.workunit.client.1.smithi133.stdout:5/367: readlink d17/d20/d32/d38/l6f 0 2024-02-15T18:27:09.941 INFO:tasks.workunit.client.1.smithi133.stdout:5/368: write d17/f50 [778190,14932] 0 2024-02-15T18:27:09.941 INFO:tasks.workunit.client.1.smithi133.stdout:0/489: dwrite d9/d10/d22/d32/fa2 [0,4194304] 0 2024-02-15T18:27:09.941 INFO:tasks.workunit.client.1.smithi133.stdout:0/490: chown d9/d10/d19/d29/d67/d68/d96/d44/l83 1638 1 2024-02-15T18:27:09.942 INFO:tasks.workunit.client.1.smithi133.stdout:8/447: dread d3/d7/d52/f56 [0,4194304] 0 2024-02-15T18:27:09.942 INFO:tasks.workunit.client.1.smithi133.stdout:5/369: truncate d17/d2a/f41 5718473 0 2024-02-15T18:27:09.945 INFO:tasks.workunit.client.1.smithi133.stdout:8/448: read d3/de/ff [1249881,10551] 0 2024-02-15T18:27:09.945 INFO:tasks.workunit.client.1.smithi133.stdout:3/493: dwrite d0/d15/d37/f4b [0,4194304] 0 2024-02-15T18:27:09.946 INFO:tasks.workunit.client.1.smithi133.stdout:5/370: truncate d17/d26/f21 5568 0 2024-02-15T18:27:09.947 INFO:tasks.workunit.client.0.smithi084.stdout:1/710: dwrite d9/d54/d1b/d2c/d4b/d4c/f61 [0,4194304] 0 2024-02-15T18:27:09.947 INFO:tasks.workunit.client.1.smithi133.stdout:0/491: creat d9/d10/faa x:0 0 0 2024-02-15T18:27:09.947 INFO:tasks.workunit.client.1.smithi133.stdout:0/492: dread - d9/d10/d22/d2f/f51 zero size 2024-02-15T18:27:09.949 INFO:tasks.workunit.client.1.smithi133.stdout:1/640: dwrite d6/d1e/d3a/d82/fa3 [0,4194304] 0 2024-02-15T18:27:09.949 INFO:tasks.workunit.client.1.smithi133.stdout:5/371: write d17/d20/f22 [123925,103226] 0 2024-02-15T18:27:09.950 INFO:tasks.workunit.client.1.smithi133.stdout:5/372: chown d17/d20/c6a 3728 1 2024-02-15T18:27:09.952 INFO:tasks.workunit.client.0.smithi084.stdout:3/700: dwrite d8/d40/d43/d71/d8c/d94/da3/dba/fe8 [0,4194304] 0 2024-02-15T18:27:09.952 INFO:tasks.workunit.client.0.smithi084.stdout:3/701: chown d8/d1f/dbf/db6/lcf 11420927 1 2024-02-15T18:27:09.952 INFO:tasks.workunit.client.0.smithi084.stdout:8/768: dwrite db/d1a/f5f [0,4194304] 0 2024-02-15T18:27:09.952 INFO:tasks.workunit.client.0.smithi084.stdout:8/769: dread - db/d1a/d2b/fc5 zero size 2024-02-15T18:27:09.953 INFO:tasks.workunit.client.0.smithi084.stdout:3/702: write d8/d40/d58/d80/f2a [1508546,74856] 0 2024-02-15T18:27:09.953 INFO:tasks.workunit.client.0.smithi084.stdout:3/703: readlink d8/l63 0 2024-02-15T18:27:09.955 INFO:tasks.workunit.client.0.smithi084.stdout:4/815: dwrite d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/f98 [0,4194304] 0 2024-02-15T18:27:09.955 INFO:tasks.workunit.client.1.smithi133.stdout:8/449: mkdir d3/d7/d40/d91 0 2024-02-15T18:27:09.955 INFO:tasks.workunit.client.1.smithi133.stdout:1/641: write d6/d1e/d41/d7c/d7e/f94 [1680959,68499] 0 2024-02-15T18:27:09.955 INFO:tasks.workunit.client.1.smithi133.stdout:0/493: write d9/d28/f4a [550199,27584] 0 2024-02-15T18:27:09.959 INFO:tasks.workunit.client.0.smithi084.stdout:0/748: dwrite d0/d4/d1b/f55 [0,4194304] 0 2024-02-15T18:27:09.959 INFO:tasks.workunit.client.0.smithi084.stdout:0/749: chown d0/d2f/d3f/d4f/d61/c68 1304321 1 2024-02-15T18:27:09.964 INFO:tasks.workunit.client.1.smithi133.stdout:3/494: dwrite d0/d15/d2f/d5e/f97 [4194304,4194304] 0 2024-02-15T18:27:09.964 INFO:tasks.workunit.client.1.smithi133.stdout:4/358: write d2/d5/d2b/d21/f1b [2311491,90727] 0 2024-02-15T18:27:09.972 INFO:tasks.workunit.client.0.smithi084.stdout:6/736: dread d14/d22/d25/d2f/d31/d3f/f74 [0,4194304] 0 2024-02-15T18:27:09.972 INFO:tasks.workunit.client.0.smithi084.stdout:1/711: dread d9/d54/d7f/db7/dc0/f6a [0,4194304] 0 2024-02-15T18:27:09.977 INFO:tasks.workunit.client.0.smithi084.stdout:1/712: dread d9/f15 [4194304,4194304] 0 2024-02-15T18:27:09.978 INFO:tasks.workunit.client.1.smithi133.stdout:5/373: write d17/d20/d32/d38/f3d [671486,83699] 0 2024-02-15T18:27:09.978 INFO:tasks.workunit.client.1.smithi133.stdout:8/450: truncate d3/f3a 4442994 0 2024-02-15T18:27:09.979 INFO:tasks.workunit.client.0.smithi084.stdout:8/770: rename db/dd/f5a to db/dd/d1f/d7a/da8/ffc 0 2024-02-15T18:27:09.979 INFO:tasks.workunit.client.0.smithi084.stdout:8/771: fsync db/daf/db6/fef 0 2024-02-15T18:27:09.979 INFO:tasks.workunit.client.0.smithi084.stdout:8/772: truncate db/dd/d1f/d7a/da8/fab 1630083 0 2024-02-15T18:27:09.979 INFO:tasks.workunit.client.1.smithi133.stdout:2/452: dwrite d7/d2c/d46/f72 [0,4194304] 0 2024-02-15T18:27:09.980 INFO:tasks.workunit.client.1.smithi133.stdout:2/453: write d7/d2c/d5a/f85 [730727,8603] 0 2024-02-15T18:27:09.981 INFO:tasks.workunit.client.0.smithi084.stdout:4/816: mkdir d2/d64/d74/d8f/dc1/dec 0 2024-02-15T18:27:09.982 INFO:tasks.workunit.client.1.smithi133.stdout:0/494: rename d9/d10/d19/d29/d67/d68/d96/c59 to d9/d10/d2c/cab 0 2024-02-15T18:27:09.982 INFO:tasks.workunit.client.1.smithi133.stdout:0/495: truncate d9/d10/d19/f63 807210 0 2024-02-15T18:27:09.984 INFO:tasks.workunit.client.0.smithi084.stdout:2/715: sync 2024-02-15T18:27:09.986 INFO:tasks.workunit.client.0.smithi084.stdout:1/713: creat d9/d54/fe3 x:0 0 0 2024-02-15T18:27:09.986 INFO:tasks.workunit.client.0.smithi084.stdout:6/737: creat d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/ddc/dea/ff0 x:0 0 0 2024-02-15T18:27:09.988 INFO:tasks.workunit.client.1.smithi133.stdout:3/495: link d0/d15/d2f/d9b/f45 d0/d15/d37/d95/f9c 0 2024-02-15T18:27:09.990 INFO:tasks.workunit.client.1.smithi133.stdout:4/359: getdents d2/d5/d2b/d21/d2d/d44/d51/d55 0 2024-02-15T18:27:09.991 INFO:tasks.workunit.client.0.smithi084.stdout:3/704: rename d8/d40/d43/d71/d8c/d94/da3/dba/fec to d8/d40/d43/d71/d8c/d94/da3/de5/fef 0 2024-02-15T18:27:09.991 INFO:tasks.workunit.client.0.smithi084.stdout:3/705: fdatasync d8/d40/faa 0 2024-02-15T18:27:09.991 INFO:tasks.workunit.client.0.smithi084.stdout:8/773: creat db/d3f/d59/ffd x:0 0 0 2024-02-15T18:27:09.991 INFO:tasks.workunit.client.0.smithi084.stdout:8/774: dread - db/dd/d4d/f70 zero size 2024-02-15T18:27:09.993 INFO:tasks.workunit.client.0.smithi084.stdout:4/817: mkdir d2/d64/da5/dae/de1/ded 0 2024-02-15T18:27:09.994 INFO:tasks.workunit.client.0.smithi084.stdout:1/714: creat d9/d54/d7f/db7/dd9/d81/d94/db9/fe4 x:0 0 0 2024-02-15T18:27:09.997 INFO:tasks.workunit.client.1.smithi133.stdout:2/454: getdents d7/d2c/d3b 0 2024-02-15T18:27:09.997 INFO:tasks.workunit.client.1.smithi133.stdout:2/455: chown d7/d2c/c92 2768 1 2024-02-15T18:27:09.997 INFO:tasks.workunit.client.0.smithi084.stdout:2/716: rename d3/d5/d53/la8 to d3/d5/d53/dca/d7b/db0/ddd/lea 0 2024-02-15T18:27:09.997 INFO:tasks.workunit.client.0.smithi084.stdout:1/715: mkdir d9/d54/d1b/d2c/d4b/d4c/da9/de5 0 2024-02-15T18:27:09.998 INFO:tasks.workunit.client.0.smithi084.stdout:2/717: fdatasync d3/d5/d1a/d74/f77 0 2024-02-15T18:27:09.999 INFO:tasks.workunit.client.0.smithi084.stdout:4/818: write d2/d4/d28/f4b [912149,62793] 0 2024-02-15T18:27:10.001 INFO:tasks.workunit.client.1.smithi133.stdout:0/496: link d9/d10/d19/d29/c2e d9/d10/d19/d29/d67/cac 0 2024-02-15T18:27:10.001 INFO:tasks.workunit.client.1.smithi133.stdout:0/497: chown d9/l41 107438828 1 2024-02-15T18:27:10.001 INFO:tasks.workunit.client.0.smithi084.stdout:1/716: truncate d9/d54/d1b/f70 4142591 0 2024-02-15T18:27:10.006 INFO:tasks.workunit.client.1.smithi133.stdout:8/451: rename d3/d1c/d2f/d80 to d3/d92 0 2024-02-15T18:27:10.006 INFO:tasks.workunit.client.1.smithi133.stdout:8/452: fdatasync d3/d1f/d3f/f74 0 2024-02-15T18:27:10.007 INFO:tasks.workunit.client.1.smithi133.stdout:0/498: creat d9/d10/d19/fad x:0 0 0 2024-02-15T18:27:10.009 INFO:tasks.workunit.client.0.smithi084.stdout:2/718: unlink d3/d5/l6b 0 2024-02-15T18:27:10.009 INFO:tasks.workunit.client.0.smithi084.stdout:4/819: creat d2/d64/fee x:0 0 0 2024-02-15T18:27:10.010 INFO:tasks.workunit.client.1.smithi133.stdout:0/499: creat d9/d10/fae x:0 0 0 2024-02-15T18:27:10.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:08.165538+0000 mgr.smithi084.hjmnez (mgr.14596) 22 : audit [DBG] from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:10.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:08.619685+0000 mgr.smithi084.hjmnez (mgr.14596) 23 : audit [DBG] from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:10.011 INFO:tasks.workunit.client.0.smithi084.stdout:2/719: rename d3/d5/d53/dca/d89/f39 to d3/d5/feb 0 2024-02-15T18:27:10.012 INFO:tasks.workunit.client.1.smithi133.stdout:0/500: link d9/d10/d19/d29/c2e d9/d10/d19/d29/caf 0 2024-02-15T18:27:10.013 INFO:tasks.workunit.client.0.smithi084.stdout:4/820: mknod d2/d4/d28/d2e/cef 0 2024-02-15T18:27:10.013 INFO:tasks.workunit.client.0.smithi084.stdout:2/720: mkdir d3/d5/d53/dca/d89/dec 0 2024-02-15T18:27:10.013 INFO:tasks.workunit.client.0.smithi084.stdout:2/721: stat d3/d19/f33 0 2024-02-15T18:27:10.013 INFO:tasks.workunit.client.0.smithi084.stdout:2/722: dread - d3/d19/d75/fe5 zero size 2024-02-15T18:27:10.014 INFO:tasks.workunit.client.0.smithi084.stdout:2/723: truncate d3/d19/f33 1217583 0 2024-02-15T18:27:10.018 INFO:tasks.workunit.client.0.smithi084.stdout:2/724: read d3/d5/d1a/d1e/d30/d8d/f99 [952653,25384] 0 2024-02-15T18:27:10.018 INFO:tasks.workunit.client.0.smithi084.stdout:2/725: dread - d3/d5/d1a/d1e/d4b/da6/fa5 zero size 2024-02-15T18:27:10.024 INFO:tasks.workunit.client.1.smithi133.stdout:8/453: dread d3/d1f/f2a [0,4194304] 0 2024-02-15T18:27:10.025 INFO:tasks.workunit.client.1.smithi133.stdout:8/454: mknod d3/d1f/d4f/c93 0 2024-02-15T18:27:10.033 INFO:tasks.workunit.client.0.smithi084.stdout:1/717: dread d9/d54/d7f/db7/dc0/f6a [0,4194304] 0 2024-02-15T18:27:10.035 INFO:tasks.workunit.client.0.smithi084.stdout:1/718: symlink d9/d54/d32/d5b/d69/dc7/le6 0 2024-02-15T18:27:10.035 INFO:tasks.workunit.client.1.smithi133.stdout:3/496: dwrite d0/d15/d2f/d9b/f7a [0,4194304] 0 2024-02-15T18:27:10.038 INFO:tasks.workunit.client.0.smithi084.stdout:3/706: dwrite d8/d40/d58/d80/d6b/fc0 [0,4194304] 0 2024-02-15T18:27:10.038 INFO:tasks.workunit.client.0.smithi084.stdout:3/707: readlink d8/d1f/d2d/l79 0 2024-02-15T18:27:10.038 INFO:tasks.workunit.client.0.smithi084.stdout:3/708: chown d8/d40/d58/d80/f7c 1240812 1 2024-02-15T18:27:10.039 INFO:tasks.workunit.client.1.smithi133.stdout:3/497: read d0/d15/d37/f4b [794240,16051] 0 2024-02-15T18:27:10.041 INFO:tasks.workunit.client.1.smithi133.stdout:3/498: mkdir d0/d15/d2f/d9b/d9d 0 2024-02-15T18:27:10.041 INFO:tasks.workunit.client.1.smithi133.stdout:3/499: readlink d0/d15/d54/l94 0 2024-02-15T18:27:10.041 INFO:tasks.workunit.client.1.smithi133.stdout:3/500: chown d0/d15/d2f 2874969 1 2024-02-15T18:27:10.042 INFO:tasks.workunit.client.1.smithi133.stdout:3/501: creat d0/d15/d37/d95/f9e x:0 0 0 2024-02-15T18:27:10.043 INFO:tasks.workunit.client.1.smithi133.stdout:4/360: dwrite d2/d5/d2b/d21/d2d/f2e [0,4194304] 0 2024-02-15T18:27:10.043 INFO:tasks.workunit.client.1.smithi133.stdout:4/361: fsync d2/d5/d2b/d21/d3b/d49/f4a 0 2024-02-15T18:27:10.043 INFO:tasks.workunit.client.1.smithi133.stdout:3/502: link d0/d15/d2f/d9b/d62/c84 d0/d15/d2f/d5e/c9f 0 2024-02-15T18:27:10.044 INFO:tasks.workunit.client.1.smithi133.stdout:3/503: symlink d0/d15/d2f/d9b/d9d/la0 0 2024-02-15T18:27:10.045 INFO:tasks.workunit.client.0.smithi084.stdout:1/719: stat d9/d54/d1b/d2c/d35/c7d 0 2024-02-15T18:27:10.045 INFO:tasks.workunit.client.1.smithi133.stdout:3/504: creat d0/d15/d2f/d9b/d39/fa1 x:0 0 0 2024-02-15T18:27:10.045 INFO:tasks.workunit.client.1.smithi133.stdout:3/505: dread - d0/d15/d37/f86 zero size 2024-02-15T18:27:10.048 INFO:tasks.workunit.client.1.smithi133.stdout:3/506: read d0/d15/d2f/d9b/d39/d3f/d3e/f7e [1923245,57105] 0 2024-02-15T18:27:10.048 INFO:tasks.workunit.client.1.smithi133.stdout:3/507: write d0/d15/d2f/d9b/d39/fa1 [637093,128747] 0 2024-02-15T18:27:10.048 INFO:tasks.workunit.client.1.smithi133.stdout:3/508: dread - d0/d15/d37/d4a/f70 zero size 2024-02-15T18:27:10.049 INFO:tasks.workunit.client.0.smithi084.stdout:3/709: unlink d8/d40/cdf 0 2024-02-15T18:27:10.049 INFO:tasks.workunit.client.0.smithi084.stdout:1/720: creat d9/d54/fe7 x:0 0 0 2024-02-15T18:27:10.053 INFO:tasks.workunit.client.1.smithi133.stdout:0/501: dwrite d9/d10/fae [0,4194304] 0 2024-02-15T18:27:10.054 INFO:tasks.workunit.client.1.smithi133.stdout:0/502: dread - d9/d10/faa zero size 2024-02-15T18:27:10.054 INFO:tasks.workunit.client.1.smithi133.stdout:5/374: dwrite f15 [0,4194304] 0 2024-02-15T18:27:10.055 INFO:tasks.workunit.client.1.smithi133.stdout:3/509: mkdir d0/d15/d2f/d9b/d39/da2 0 2024-02-15T18:27:10.055 INFO:tasks.workunit.client.1.smithi133.stdout:3/510: dread - d0/d15/d2f/d9b/d39/f63 zero size 2024-02-15T18:27:10.056 INFO:tasks.workunit.client.1.smithi133.stdout:3/511: fdatasync d0/d15/d37/f88 0 2024-02-15T18:27:10.056 INFO:tasks.workunit.client.0.smithi084.stdout:2/726: dread d3/d5/d1a/d1e/faa [4194304,4194304] 0 2024-02-15T18:27:10.056 INFO:tasks.workunit.client.1.smithi133.stdout:0/503: write f6 [312573,85902] 0 2024-02-15T18:27:10.058 INFO:tasks.workunit.client.1.smithi133.stdout:5/375: creat d17/d20/d32/f75 x:0 0 0 2024-02-15T18:27:10.058 INFO:tasks.workunit.client.1.smithi133.stdout:8/455: dwrite d3/f14 [0,4194304] 0 2024-02-15T18:27:10.058 INFO:tasks.workunit.client.1.smithi133.stdout:8/456: chown d3/d1f/d4f 977037485 1 2024-02-15T18:27:10.059 INFO:tasks.workunit.client.0.smithi084.stdout:2/727: rmdir d3/d5/d1a/d1e/d30/d82 39 2024-02-15T18:27:10.059 INFO:tasks.workunit.client.0.smithi084.stdout:2/728: fsync d3/d5/d1a/d1e/d30/d8d/fdf 0 2024-02-15T18:27:10.059 INFO:tasks.workunit.client.0.smithi084.stdout:2/729: truncate d3/d5/d1a/d1e/fcf 621529 0 2024-02-15T18:27:10.059 INFO:tasks.workunit.client.0.smithi084.stdout:8/775: dwrite db/dd/d13/d42/d79/ff7 [0,4194304] 0 2024-02-15T18:27:10.061 INFO:tasks.workunit.client.0.smithi084.stdout:1/721: dread d9/d54/d32/d5b/f90 [0,4194304] 0 2024-02-15T18:27:10.061 INFO:tasks.workunit.client.0.smithi084.stdout:2/730: mknod d3/d5/d53/dca/db8/ced 0 2024-02-15T18:27:10.064 INFO:tasks.workunit.client.1.smithi133.stdout:3/512: rmdir d0/d15/d2f/d9b 39 2024-02-15T18:27:10.064 INFO:tasks.workunit.client.0.smithi084.stdout:8/776: link db/dd/d1f/d7a/da8/dd0/cb0 db/dd/d13/db9/cfe 0 2024-02-15T18:27:10.065 INFO:tasks.workunit.client.0.smithi084.stdout:1/722: getdents d9/d54/d1b/d2c/d4b/d4c/d79/d36 0 2024-02-15T18:27:10.065 INFO:tasks.workunit.client.0.smithi084.stdout:1/723: write d9/d54/d32/d5b/f90 [2543147,114093] 0 2024-02-15T18:27:10.067 INFO:tasks.workunit.client.0.smithi084.stdout:2/731: symlink d3/d5/d1a/d1e/d47/lee 0 2024-02-15T18:27:10.067 INFO:tasks.workunit.client.0.smithi084.stdout:2/732: stat d3/d19/dc5/cd6 0 2024-02-15T18:27:10.069 INFO:tasks.workunit.client.0.smithi084.stdout:1/724: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/le8 0 2024-02-15T18:27:10.070 INFO:tasks.workunit.client.1.smithi133.stdout:8/457: mkdir d3/de/d3e/d94 0 2024-02-15T18:27:10.070 INFO:tasks.workunit.client.0.smithi084.stdout:8/777: dread db/dd/d1f/d66/da2/fcf [0,4194304] 0 2024-02-15T18:27:10.071 INFO:tasks.workunit.client.1.smithi133.stdout:5/376: creat d17/d20/d4f/f76 x:0 0 0 2024-02-15T18:27:10.072 INFO:tasks.workunit.client.0.smithi084.stdout:8/778: getdents db/daf 0 2024-02-15T18:27:10.072 INFO:tasks.workunit.client.0.smithi084.stdout:8/779: dread - db/d6a/d76/f8e zero size 2024-02-15T18:27:10.076 INFO:tasks.workunit.client.1.smithi133.stdout:8/458: unlink d3/de/ff 0 2024-02-15T18:27:10.076 INFO:tasks.workunit.client.1.smithi133.stdout:8/459: readlink d3/d1c/l69 0 2024-02-15T18:27:10.076 INFO:tasks.workunit.client.0.smithi084.stdout:3/710: dwrite d8/d40/d43/f4d [0,4194304] 0 2024-02-15T18:27:10.076 INFO:tasks.workunit.client.0.smithi084.stdout:3/711: fsync d8/f1d 0 2024-02-15T18:27:10.077 INFO:tasks.workunit.client.1.smithi133.stdout:0/504: dwrite d9/d10/d22/d32/f64 [0,4194304] 0 2024-02-15T18:27:10.077 INFO:tasks.workunit.client.0.smithi084.stdout:3/712: mknod d8/d1f/d2d/dc5/cf0 0 2024-02-15T18:27:10.078 INFO:tasks.workunit.client.1.smithi133.stdout:5/377: rename d17/d20/f35 to d17/d20/d5e/f77 0 2024-02-15T18:27:10.078 INFO:tasks.workunit.client.1.smithi133.stdout:5/378: fsync d17/f27 0 2024-02-15T18:27:10.078 INFO:tasks.workunit.client.1.smithi133.stdout:5/379: chown d17/d20/d5e 20202179 1 2024-02-15T18:27:10.078 INFO:tasks.workunit.client.1.smithi133.stdout:8/460: creat d3/d7/f95 x:0 0 0 2024-02-15T18:27:10.079 INFO:tasks.workunit.client.1.smithi133.stdout:8/461: write d3/d1c/d2f/d76/f7e [713805,95867] 0 2024-02-15T18:27:10.079 INFO:tasks.workunit.client.1.smithi133.stdout:0/505: mknod d9/d10/d85/cb0 0 2024-02-15T18:27:10.080 INFO:tasks.workunit.client.1.smithi133.stdout:5/380: symlink d17/d20/d32/l78 0 2024-02-15T18:27:10.080 INFO:tasks.workunit.client.1.smithi133.stdout:8/462: symlink d3/d1f/d4f/l96 0 2024-02-15T18:27:10.082 INFO:tasks.workunit.client.1.smithi133.stdout:0/506: link d9/d2b/l88 d9/d10/d2c/lb1 0 2024-02-15T18:27:10.082 INFO:tasks.workunit.client.1.smithi133.stdout:0/507: chown d9/d10/d22/d32/f40 18 1 2024-02-15T18:27:10.082 INFO:tasks.workunit.client.1.smithi133.stdout:5/381: mknod d17/d20/d4f/d5f/c79 0 2024-02-15T18:27:10.083 INFO:tasks.workunit.client.0.smithi084.stdout:8/780: write db/dd/d1f/d56/fe9 [4694933,35248] 0 2024-02-15T18:27:10.083 INFO:tasks.workunit.client.0.smithi084.stdout:3/713: dread d8/d40/d43/d71/f81 [0,4194304] 0 2024-02-15T18:27:10.084 INFO:tasks.workunit.client.1.smithi133.stdout:8/463: creat d3/d1c/f97 x:0 0 0 2024-02-15T18:27:10.084 INFO:tasks.workunit.client.1.smithi133.stdout:8/464: fdatasync d3/d1c/f1e 0 2024-02-15T18:27:10.084 INFO:tasks.workunit.client.0.smithi084.stdout:4/821: dread d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/faa [0,4194304] 0 2024-02-15T18:27:10.084 INFO:tasks.workunit.client.0.smithi084.stdout:0/750: dwrite d0/d25/f67 [0,4194304] 0 2024-02-15T18:27:10.085 INFO:tasks.workunit.client.1.smithi133.stdout:0/508: link d9/d10/fae d9/d10/d22/d2f/d9f/fb2 0 2024-02-15T18:27:10.087 INFO:tasks.workunit.client.1.smithi133.stdout:5/382: rmdir d17/d2a 39 2024-02-15T18:27:10.087 INFO:tasks.workunit.client.1.smithi133.stdout:5/383: chown d17/d2a/f42 669950041 1 2024-02-15T18:27:10.087 INFO:tasks.workunit.client.0.smithi084.stdout:3/714: read d8/d40/d43/d71/d8c/fb7 [1719654,69085] 0 2024-02-15T18:27:10.087 INFO:tasks.workunit.client.1.smithi133.stdout:0/509: mknod d9/d10/d22/d32/cb3 0 2024-02-15T18:27:10.088 INFO:tasks.workunit.client.1.smithi133.stdout:0/510: write d9/d10/d19/d29/d67/d68/d96/d44/f4c [4638049,37910] 0 2024-02-15T18:27:10.088 INFO:tasks.workunit.client.0.smithi084.stdout:4/822: rmdir d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4 39 2024-02-15T18:27:10.092 INFO:tasks.workunit.client.1.smithi133.stdout:0/511: symlink d9/d10/d22/d2f/lb4 0 2024-02-15T18:27:10.092 INFO:tasks.workunit.client.1.smithi133.stdout:5/384: creat d17/f7a x:0 0 0 2024-02-15T18:27:10.093 INFO:tasks.workunit.client.0.smithi084.stdout:4/823: creat d2/d64/d74/d8f/dc1/ff0 x:0 0 0 2024-02-15T18:27:10.096 INFO:tasks.workunit.client.1.smithi133.stdout:0/512: link d9/d10/d19/d29/d67/d68/c93 d9/d10/d19/d29/d67/d68/cb5 0 2024-02-15T18:27:10.096 INFO:tasks.workunit.client.1.smithi133.stdout:5/385: mkdir d17/d26/d7b 0 2024-02-15T18:27:10.096 INFO:tasks.workunit.client.1.smithi133.stdout:5/386: chown d17/d20/d4f/d5f/f60 26877801 1 2024-02-15T18:27:10.099 INFO:tasks.workunit.client.1.smithi133.stdout:5/387: read d17/d2a/f42 [4100930,24171] 0 2024-02-15T18:27:10.103 INFO:tasks.workunit.client.0.smithi084.stdout:2/733: dwrite d3/fad [0,4194304] 0 2024-02-15T18:27:10.107 INFO:tasks.workunit.client.0.smithi084.stdout:2/734: getdents d3/d5/d1a/d2d 0 2024-02-15T18:27:10.110 INFO:tasks.workunit.client.1.smithi133.stdout:6/652: sync 2024-02-15T18:27:10.111 INFO:tasks.workunit.client.0.smithi084.stdout:2/735: dread d3/d5/d53/dca/d91/fb4 [0,4194304] 0 2024-02-15T18:27:10.111 INFO:tasks.workunit.client.0.smithi084.stdout:2/736: chown d3/d5/d53/fdc 2108 1 2024-02-15T18:27:10.113 INFO:tasks.workunit.client.0.smithi084.stdout:2/737: mknod d3/d5/d1a/d1e/d30/d82/cef 0 2024-02-15T18:27:10.116 INFO:tasks.workunit.client.0.smithi084.stdout:2/738: link d3/d5/d53/dca/f2e d3/d5/dbd/ff0 0 2024-02-15T18:27:10.116 INFO:tasks.workunit.client.0.smithi084.stdout:2/739: dread - d3/dc6/db5/fcd zero size 2024-02-15T18:27:10.118 INFO:tasks.workunit.client.1.smithi133.stdout:6/653: dread d0/db/d29/d34/d8c/d98/f96 [0,4194304] 0 2024-02-15T18:27:10.119 INFO:tasks.workunit.client.1.smithi133.stdout:6/654: symlink d0/db/d29/d34/d48/da1/ld6 0 2024-02-15T18:27:10.120 INFO:tasks.workunit.client.1.smithi133.stdout:6/655: creat d0/fd7 x:0 0 0 2024-02-15T18:27:10.120 INFO:tasks.workunit.client.1.smithi133.stdout:6/656: getdents d0/d3b/d9d/db3/dd3 0 2024-02-15T18:27:10.147 INFO:tasks.workunit.client.0.smithi084.stdout:7/763: sync 2024-02-15T18:27:10.148 INFO:tasks.workunit.client.0.smithi084.stdout:9/807: sync 2024-02-15T18:27:10.148 INFO:tasks.workunit.client.0.smithi084.stdout:5/859: sync 2024-02-15T18:27:10.148 INFO:tasks.workunit.client.0.smithi084.stdout:7/764: stat df/d1d/d1a/f81 0 2024-02-15T18:27:10.148 INFO:tasks.workunit.client.1.smithi133.stdout:6/657: dwrite d0/d3b/d78/d7f/fa7 [0,4194304] 0 2024-02-15T18:27:10.149 INFO:tasks.workunit.client.0.smithi084.stdout:9/808: truncate d4/d2b/d3c/d24/dca/f1c 3629485 0 2024-02-15T18:27:10.149 INFO:tasks.workunit.client.0.smithi084.stdout:7/765: mknod df/cfa 0 2024-02-15T18:27:10.150 INFO:tasks.workunit.client.1.smithi133.stdout:6/658: symlink d0/db/ld8 0 2024-02-15T18:27:10.151 INFO:tasks.workunit.client.1.smithi133.stdout:6/659: unlink d0/d3b/d52/l5a 0 2024-02-15T18:27:10.151 INFO:tasks.workunit.client.0.smithi084.stdout:5/860: creat d9/d5f/d68/d9a/d8d/de5/f121 x:0 0 0 2024-02-15T18:27:10.151 INFO:tasks.workunit.client.0.smithi084.stdout:5/861: chown d9/da/d3d/d44/d55/d70/dfa/f11d 80411948 1 2024-02-15T18:27:10.152 INFO:tasks.workunit.client.1.smithi133.stdout:6/660: mknod d0/d3b/db1/cd9 0 2024-02-15T18:27:10.152 INFO:tasks.workunit.client.0.smithi084.stdout:9/809: truncate d4/d2b/d3c/d24/dca/d15/f17 1672567 0 2024-02-15T18:27:10.154 INFO:tasks.workunit.client.0.smithi084.stdout:5/862: rmdir d9/d5f/d68/d9a 39 2024-02-15T18:27:10.154 INFO:tasks.workunit.client.0.smithi084.stdout:5/863: write d9/d5f/dcc/f117 [761815,36170] 0 2024-02-15T18:27:10.155 INFO:tasks.workunit.client.0.smithi084.stdout:5/864: write d9/d5f/dcc/f117 [1326289,73457] 0 2024-02-15T18:27:10.156 INFO:tasks.workunit.client.1.smithi133.stdout:6/661: mkdir d0/db/d29/d34/d5d/dda 0 2024-02-15T18:27:10.158 INFO:tasks.workunit.client.1.smithi133.stdout:0/513: dwrite d9/d10/d19/d29/d67/fa8 [0,4194304] 0 2024-02-15T18:27:10.158 INFO:tasks.workunit.client.1.smithi133.stdout:0/514: write d9/d10/d47/f87 [824430,101429] 0 2024-02-15T18:27:10.158 INFO:tasks.workunit.client.1.smithi133.stdout:6/662: mkdir d0/d3b/d78/d7f/ddb 0 2024-02-15T18:27:10.158 INFO:tasks.workunit.client.0.smithi084.stdout:1/725: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 [0,4194304] 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:1/726: read - d9/d54/d1b/da7/fbe zero size 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:4/824: dwrite d2/f39 [0,4194304] 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:8/781: dwrite db/dd/d4d/f7c [4194304,4194304] 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:0/751: dwrite d0/d2f/d4b/dc6/fca [0,4194304] 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:3/715: dwrite d8/d1f/dbf/f54 [0,4194304] 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:5/865: dread d9/da/d3d/d44/d55/dfe/f47 [0,4194304] 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:5/866: fsync d9/da/d3d/d44/d55/dfe/f47 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:5/867: readlink d9/d5f/d68/d9a/l5e 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:2/740: dwrite d3/d5/d1a/d1e/f58 [4194304,4194304] 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:9/810: rename d4/d2b/d3c/l98 to d4/dc2/def/l102 0 2024-02-15T18:27:10.159 INFO:tasks.workunit.client.0.smithi084.stdout:9/811: fdatasync d4/dc2/fdb 0 2024-02-15T18:27:10.160 INFO:tasks.workunit.client.0.smithi084.stdout:9/812: stat d4/d2b/d3c/d24/dca/dc6/cda 0 2024-02-15T18:27:10.160 INFO:tasks.workunit.client.0.smithi084.stdout:5/868: read d9/d5b/d7e/d92/fb0 [3422511,66944] 0 2024-02-15T18:27:10.160 INFO:tasks.workunit.client.0.smithi084.stdout:5/869: write d9/da/d3d/d44/d55/dfe/dac/fda [1251002,45063] 0 2024-02-15T18:27:10.161 INFO:tasks.workunit.client.0.smithi084.stdout:1/727: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ddc/le9 0 2024-02-15T18:27:10.161 INFO:tasks.workunit.client.0.smithi084.stdout:1/728: chown d9/d54/d1b/d2c/d35/l8e 0 1 2024-02-15T18:27:10.162 INFO:tasks.workunit.client.0.smithi084.stdout:4/825: dread d2/d64/d74/f7f [0,4194304] 0 2024-02-15T18:27:10.168 INFO:tasks.workunit.client.0.smithi084.stdout:0/752: rmdir d0/d2f/d4b/dc6 39 2024-02-15T18:27:10.170 INFO:tasks.workunit.client.0.smithi084.stdout:8/782: creat db/d1a/d2b/d7b/fff x:0 0 0 2024-02-15T18:27:10.171 INFO:tasks.workunit.client.0.smithi084.stdout:7/766: dwrite df/d1d/d1a/d4b/fb8 [0,4194304] 0 2024-02-15T18:27:10.172 INFO:tasks.workunit.client.1.smithi133.stdout:0/515: creat d9/d28/fb6 x:0 0 0 2024-02-15T18:27:10.172 INFO:tasks.workunit.client.1.smithi133.stdout:0/516: chown d9/d10/d19/l43 0 1 2024-02-15T18:27:10.174 INFO:tasks.workunit.client.0.smithi084.stdout:2/741: mkdir d3/d5/d1a/d1e/d30/d8d/df1 0 2024-02-15T18:27:10.177 INFO:tasks.workunit.client.0.smithi084.stdout:9/813: rename d4/lcf to d4/d2b/d3c/d20/l103 0 2024-02-15T18:27:10.177 INFO:tasks.workunit.client.0.smithi084.stdout:7/767: rename df to df/d1d/d44/dfb 22 2024-02-15T18:27:10.179 INFO:tasks.workunit.client.1.smithi133.stdout:6/663: dwrite d0/db/fc5 [0,4194304] 0 2024-02-15T18:27:10.179 INFO:tasks.workunit.client.0.smithi084.stdout:5/870: creat d9/d5b/d79/db7/f122 x:0 0 0 2024-02-15T18:27:10.180 INFO:tasks.workunit.client.0.smithi084.stdout:5/871: read d9/f1d [507006,107243] 0 2024-02-15T18:27:10.180 INFO:tasks.workunit.client.0.smithi084.stdout:5/872: write d9/d35/d65/fd5 [1582225,47427] 0 2024-02-15T18:27:10.181 INFO:tasks.workunit.client.1.smithi133.stdout:6/664: symlink d0/db/d29/d34/d5d/dda/ldc 0 2024-02-15T18:27:10.181 INFO:tasks.workunit.client.0.smithi084.stdout:1/729: truncate d9/d54/f6e 371440 0 2024-02-15T18:27:10.182 INFO:tasks.workunit.client.1.smithi133.stdout:6/665: mknod d0/db/d29/d34/d8c/da5/cdd 0 2024-02-15T18:27:10.182 INFO:tasks.workunit.client.1.smithi133.stdout:6/666: chown d0/db/d29/d34/d48/da1/fb5 1608 1 2024-02-15T18:27:10.182 INFO:tasks.workunit.client.1.smithi133.stdout:6/667: stat d0/d3b/d85/d8e 0 2024-02-15T18:27:10.183 INFO:tasks.workunit.client.1.smithi133.stdout:6/668: write d0/d62/fb4 [313126,23382] 0 2024-02-15T18:27:10.183 INFO:tasks.workunit.client.0.smithi084.stdout:6/738: sync 2024-02-15T18:27:10.185 INFO:tasks.workunit.client.0.smithi084.stdout:4/826: unlink d2/d64/d74/d8f/dc1/ld1 0 2024-02-15T18:27:10.187 INFO:tasks.workunit.client.0.smithi084.stdout:0/753: link d0/d4/d3a/c8d d0/d2f/d3f/d4f/d59/ce4 0 2024-02-15T18:27:10.187 INFO:tasks.workunit.client.0.smithi084.stdout:0/754: write d0/d4/d3a/f74 [8479063,32596] 0 2024-02-15T18:27:10.189 INFO:tasks.workunit.client.0.smithi084.stdout:3/716: truncate d8/d40/d43/f8b 4795065 0 2024-02-15T18:27:10.190 INFO:tasks.workunit.client.0.smithi084.stdout:0/755: write d0/f99 [3809282,86877] 0 2024-02-15T18:27:10.191 INFO:tasks.workunit.client.1.smithi133.stdout:0/517: dwrite d9/d10/d19/f98 [0,4194304] 0 2024-02-15T18:27:10.192 INFO:tasks.workunit.client.0.smithi084.stdout:7/768: unlink df/d1d/d44/fbf 0 2024-02-15T18:27:10.192 INFO:tasks.workunit.client.0.smithi084.stdout:7/769: readlink df/d1d/d1a/d4b/l9e 0 2024-02-15T18:27:10.192 INFO:tasks.workunit.client.0.smithi084.stdout:5/873: truncate d9/d35/d65/d7f/dd6/deb/df0/d118/f11f 3651414 0 2024-02-15T18:27:10.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/518: mknod d9/d10/d22/d2f/cb7 0 2024-02-15T18:27:10.194 INFO:tasks.workunit.client.1.smithi133.stdout:0/519: fsync d9/d2b/f45 0 2024-02-15T18:27:10.194 INFO:tasks.workunit.client.1.smithi133.stdout:6/669: dread d0/d3b/d9d/db3/f56 [0,4194304] 0 2024-02-15T18:27:10.194 INFO:tasks.workunit.client.1.smithi133.stdout:6/670: write d0/db/d21/f75 [534518,65143] 0 2024-02-15T18:27:10.194 INFO:tasks.workunit.client.1.smithi133.stdout:6/671: write d0/d3b/d67/d9a/fc8 [936818,110738] 0 2024-02-15T18:27:10.194 INFO:tasks.workunit.client.0.smithi084.stdout:1/730: truncate d9/d54/f82 2581175 0 2024-02-15T18:27:10.195 INFO:tasks.workunit.client.1.smithi133.stdout:0/520: getdents d9/d10/d47/d5e 0 2024-02-15T18:27:10.195 INFO:tasks.workunit.client.1.smithi133.stdout:0/521: read d9/d10/d19/d29/d67/d68/d96/d44/f4f [3835431,50886] 0 2024-02-15T18:27:10.195 INFO:tasks.workunit.client.1.smithi133.stdout:0/522: chown d9/d10/d2c/c3c 736495 1 2024-02-15T18:27:10.195 INFO:tasks.workunit.client.1.smithi133.stdout:0/523: fdatasync d9/d28/f4a 0 2024-02-15T18:27:10.196 INFO:tasks.workunit.client.0.smithi084.stdout:6/739: mkdir d14/d22/d25/d2f/d31/d30/d4f/df1 0 2024-02-15T18:27:10.197 INFO:tasks.workunit.client.0.smithi084.stdout:5/874: dread d9/f1d [0,4194304] 0 2024-02-15T18:27:10.197 INFO:tasks.workunit.client.0.smithi084.stdout:5/875: fsync d9/da/f99 0 2024-02-15T18:27:10.198 INFO:tasks.workunit.client.0.smithi084.stdout:6/740: write d14/d22/f64 [1960048,53251] 0 2024-02-15T18:27:10.198 INFO:tasks.workunit.client.1.smithi133.stdout:0/524: unlink d9/d10/l7b 0 2024-02-15T18:27:10.198 INFO:tasks.workunit.client.1.smithi133.stdout:0/525: truncate d9/d10/d2c/f5d 387305 0 2024-02-15T18:27:10.198 INFO:tasks.workunit.client.1.smithi133.stdout:0/526: dread - d9/d10/d19/d1a/f66 zero size 2024-02-15T18:27:10.201 INFO:tasks.workunit.client.0.smithi084.stdout:4/827: getdents d2/d4/d28/d3d/d5c/d65 0 2024-02-15T18:27:10.201 INFO:tasks.workunit.client.1.smithi133.stdout:6/672: dread d0/db/d29/d34/d48/da1/fcf [0,4194304] 0 2024-02-15T18:27:10.202 INFO:tasks.workunit.client.0.smithi084.stdout:3/717: creat d8/d1f/ff1 x:0 0 0 2024-02-15T18:27:10.209 INFO:tasks.workunit.client.0.smithi084.stdout:2/742: rename d3/d5/d1a/d1e/d4b/f59 to d3/ff2 0 2024-02-15T18:27:10.209 INFO:tasks.workunit.client.0.smithi084.stdout:0/756: mkdir d0/d39/d45/de5 0 2024-02-15T18:27:10.210 INFO:tasks.workunit.client.0.smithi084.stdout:7/770: mknod df/d1d/d1a/d4d/d55/cfc 0 2024-02-15T18:27:10.210 INFO:tasks.workunit.client.0.smithi084.stdout:7/771: dread - df/d1d/d1a/d6a/d8b/d48/dca/fdd zero size 2024-02-15T18:27:10.211 INFO:tasks.workunit.client.0.smithi084.stdout:1/731: getdents d9/d54/d1b/d38/d4d 0 2024-02-15T18:27:10.211 INFO:tasks.workunit.client.0.smithi084.stdout:1/732: chown d9/d54/d76/caa 949305 1 2024-02-15T18:27:10.215 INFO:tasks.workunit.client.0.smithi084.stdout:6/741: creat d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/ddc/dea/ff2 x:0 0 0 2024-02-15T18:27:10.215 INFO:tasks.workunit.client.0.smithi084.stdout:4/828: getdents d2/d64/da5 0 2024-02-15T18:27:10.215 INFO:tasks.workunit.client.0.smithi084.stdout:3/718: creat d8/d40/d58/d80/d6b/ff2 x:0 0 0 2024-02-15T18:27:10.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.221+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f12e810f810 con 0x7f12e80f5ef0 2024-02-15T18:27:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.221+0000 7f12df7fe700 1 -- 172.21.15.84:0/927140881 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1643 (secure 0 0 0) 0x7f12d0050050 con 0x7f12e80f5ef0 2024-02-15T18:27:10.217 INFO:teuthology.orchestra.run.smithi084.stdout:e15 2024-02-15T18:27:10.217 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:27:10.217 INFO:teuthology.orchestra.run.smithi084.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:27:10.217 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:27:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:27:10.217 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 15 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:26:32.713494+0000 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:27:10.218 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261]] 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091]] 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:27:10.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:27:10.220 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:27:10.220 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:27:10.220 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317]] 2024-02-15T18:27:10.220 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334]] 2024-02-15T18:27:10.220 INFO:tasks.workunit.client.0.smithi084.stdout:5/876: rename d9/da/d3d/d44/d55/d70/d84/da1/f81 to d9/da/d3d/d44/d55/d70/d84/f123 0 2024-02-15T18:27:10.220 INFO:tasks.workunit.client.0.smithi084.stdout:5/877: dread - d9/d5f/fad zero size 2024-02-15T18:27:10.221 INFO:tasks.workunit.client.0.smithi084.stdout:2/743: unlink d3/c15 0 2024-02-15T18:27:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f12d4060fb0 msgr2=0x7f12d4063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f12d4060fb0 0x7f12d4063470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f12d8009f50 tx=0x7f12d8009b30).stop 2024-02-15T18:27:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f5ef0 msgr2=0x7f12e80f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f5ef0 0x7f12e80f7c60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f12d000b410 tx=0x7f12d0006ef0).stop 2024-02-15T18:27:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 shutdown_connections 2024-02-15T18:27:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f12d4060fb0 0x7f12d4063470 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e80f55e0 0x7f12e80f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 --2- 172.21.15.84:0/927140881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12e80f5ef0 0x7f12e80f7c60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 >> 172.21.15.84:0/927140881 conn(0x7f12e80f0de0 msgr2=0x7f12e805ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 shutdown_connections 2024-02-15T18:27:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.223+0000 7f12ed4d7700 1 -- 172.21.15.84:0/927140881 wait complete. 2024-02-15T18:27:10.222 INFO:tasks.workunit.client.0.smithi084.stdout:0/757: mkdir d0/d2f/d3f/d4f/d61/de6 0 2024-02-15T18:27:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-02-15T18:27:10.223 INFO:tasks.workunit.client.0.smithi084.stdout:1/733: dread d9/f14 [0,4194304] 0 2024-02-15T18:27:10.223 INFO:tasks.workunit.client.0.smithi084.stdout:2/744: write d3/d5/d1a/d1e/f58 [4825610,50027] 0 2024-02-15T18:27:10.223 INFO:tasks.workunit.client.0.smithi084.stdout:4/829: creat d2/d2b/d47/ff1 x:0 0 0 2024-02-15T18:27:10.224 INFO:tasks.workunit.client.0.smithi084.stdout:0/758: dread d0/d4/d1b/f40 [0,4194304] 0 2024-02-15T18:27:10.224 INFO:tasks.workunit.client.0.smithi084.stdout:0/759: read - d0/d2f/d3f/d4f/d59/da7/fd3 zero size 2024-02-15T18:27:10.224 INFO:tasks.workunit.client.0.smithi084.stdout:1/734: getdents d9/d54/d1b/d2c/d4b/d4c/d79 0 2024-02-15T18:27:10.225 INFO:tasks.workunit.client.0.smithi084.stdout:4/830: read d2/d2b/d47/f3b [1070464,81739] 0 2024-02-15T18:27:10.225 INFO:tasks.workunit.client.0.smithi084.stdout:0/760: getdents d0/d4/d3a/d5c/de2/d43/d6d/d71/d73 0 2024-02-15T18:27:10.225 INFO:tasks.workunit.client.0.smithi084.stdout:0/761: fdatasync d0/d2f/d3f/d4c/d9a/fa3 0 2024-02-15T18:27:10.226 INFO:tasks.workunit.client.0.smithi084.stdout:1/735: read d9/d54/d1b/d2c/d4b/d4c/d79/f2f [664421,71554] 0 2024-02-15T18:27:10.226 INFO:tasks.workunit.client.0.smithi084.stdout:1/736: fdatasync d9/d54/d7f/db7/fc8 0 2024-02-15T18:27:10.228 INFO:tasks.workunit.client.0.smithi084.stdout:3/719: dread d8/d40/d58/d80/d6b/f6c [0,4194304] 0 2024-02-15T18:27:10.230 INFO:tasks.workunit.client.0.smithi084.stdout:6/742: dread d14/d22/d25/d2f/da9/fa8 [0,4194304] 0 2024-02-15T18:27:10.231 INFO:tasks.workunit.client.0.smithi084.stdout:5/878: dread d9/d35/f58 [0,4194304] 0 2024-02-15T18:27:10.233 INFO:tasks.workunit.client.1.smithi133.stdout:9/417: sync 2024-02-15T18:27:10.233 INFO:tasks.workunit.client.1.smithi133.stdout:7/341: sync 2024-02-15T18:27:10.233 INFO:tasks.workunit.client.1.smithi133.stdout:7/342: dread - d9/db/d55/f72 zero size 2024-02-15T18:27:10.234 INFO:tasks.workunit.client.1.smithi133.stdout:6/673: dwrite d0/d3b/d53/f65 [0,4194304] 0 2024-02-15T18:27:10.235 INFO:tasks.workunit.client.0.smithi084.stdout:3/720: write d8/d40/d43/f4d [4031054,65807] 0 2024-02-15T18:27:10.235 INFO:tasks.workunit.client.0.smithi084.stdout:3/721: stat d8/d1f/d25/f7f 0 2024-02-15T18:27:10.245 INFO:tasks.workunit.client.0.smithi084.stdout:0/762: dread d0/d4/d3a/d5c/de2/f2d [0,4194304] 0 2024-02-15T18:27:10.245 INFO:tasks.workunit.client.0.smithi084.stdout:0/763: fsync d0/d1e/f9f 0 2024-02-15T18:27:10.246 INFO:tasks.workunit.client.0.smithi084.stdout:0/764: write d0/d2f/d3f/d8a/fc1 [948000,95977] 0 2024-02-15T18:27:10.247 INFO:tasks.workunit.client.0.smithi084.stdout:1/737: read d9/f27 [1660376,55361] 0 2024-02-15T18:27:10.247 INFO:tasks.workunit.client.0.smithi084.stdout:0/765: link d0/d4/d3a/d5c/de2/d43/d6d/d71/l9d d0/d39/d45/le7 0 2024-02-15T18:27:10.248 INFO:tasks.workunit.client.0.smithi084.stdout:1/738: mknod d9/d54/d1b/da7/cea 0 2024-02-15T18:27:10.249 INFO:tasks.workunit.client.0.smithi084.stdout:0/766: rmdir d0/d4/d3a/d5c/de2/d43/d6d/d71/d73 39 2024-02-15T18:27:10.253 INFO:tasks.workunit.client.0.smithi084.stdout:1/739: truncate d9/d54/d32/d5b/f90 2497262 0 2024-02-15T18:27:10.254 INFO:tasks.workunit.client.0.smithi084.stdout:1/740: fsync d9/d54/d1b/f53 0 2024-02-15T18:27:10.254 INFO:tasks.workunit.client.0.smithi084.stdout:0/767: creat d0/d4/d3a/d82/fe8 x:0 0 0 2024-02-15T18:27:10.254 INFO:tasks.workunit.client.0.smithi084.stdout:1/741: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db6/ceb 0 2024-02-15T18:27:10.257 INFO:tasks.workunit.client.0.smithi084.stdout:0/768: creat d0/d2f/d3f/fe9 x:0 0 0 2024-02-15T18:27:10.258 INFO:tasks.workunit.client.0.smithi084.stdout:0/769: getdents d0/d2f/d3f/da4 0 2024-02-15T18:27:10.261 INFO:tasks.workunit.client.0.smithi084.stdout:0/770: creat d0/d2f/d3f/da4/fea x:0 0 0 2024-02-15T18:27:10.262 INFO:tasks.workunit.client.0.smithi084.stdout:0/771: chown d0/d4/d1b/d7a/c9c 239836 1 2024-02-15T18:27:10.272 INFO:tasks.workunit.client.0.smithi084.stdout:6/743: dwrite f10 [0,4194304] 0 2024-02-15T18:27:10.275 INFO:tasks.workunit.client.0.smithi084.stdout:6/744: unlink d14/d22/d25/d2f/d31/d30/d45/d52/d8a/db8/lc6 0 2024-02-15T18:27:10.276 INFO:tasks.workunit.client.0.smithi084.stdout:6/745: write d14/d22/d25/d28/f77 [772178,65220] 0 2024-02-15T18:27:10.276 INFO:tasks.workunit.client.0.smithi084.stdout:6/746: write d14/d22/d25/d2f/d31/d30/d45/fa2 [1047933,58073] 0 2024-02-15T18:27:10.278 INFO:tasks.workunit.client.0.smithi084.stdout:6/747: creat d14/d22/d25/d2f/da9/d9b/dac/ff3 x:0 0 0 2024-02-15T18:27:10.280 INFO:tasks.workunit.client.0.smithi084.stdout:6/748: dread d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/fce [0,4194304] 0 2024-02-15T18:27:10.280 INFO:tasks.workunit.client.0.smithi084.stdout:6/749: stat d14/d22/d25/d2f/f66 0 2024-02-15T18:27:10.281 INFO:tasks.workunit.client.0.smithi084.stdout:6/750: unlink d14/l18 0 2024-02-15T18:27:10.282 INFO:tasks.workunit.client.0.smithi084.stdout:6/751: getdents d14/d22/d25/d2f/d31/d30 0 2024-02-15T18:27:10.283 INFO:tasks.workunit.client.0.smithi084.stdout:6/752: symlink d14/d22/d25/lf4 0 2024-02-15T18:27:10.284 INFO:tasks.workunit.client.0.smithi084.stdout:6/753: creat d14/ff5 x:0 0 0 2024-02-15T18:27:10.288 INFO:tasks.workunit.client.0.smithi084.stdout:6/754: write d14/d22/d25/d2f/d31/d30/d45/d52/fa4 [2878273,113807] 0 2024-02-15T18:27:10.289 INFO:tasks.workunit.client.0.smithi084.stdout:6/755: mkdir d14/d22/d25/d2f/d31/d30/d4f/d7f/dc7/df6 0 2024-02-15T18:27:10.290 INFO:tasks.workunit.client.1.smithi133.stdout:7/343: dwrite d9/da/f3b [0,4194304] 0 2024-02-15T18:27:10.290 INFO:tasks.workunit.client.1.smithi133.stdout:7/344: fsync d9/db/f3c 0 2024-02-15T18:27:10.291 INFO:tasks.workunit.client.0.smithi084.stdout:6/756: rename d14/d22/d25/l5e to d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/lf7 0 2024-02-15T18:27:10.292 INFO:tasks.workunit.client.1.smithi133.stdout:7/345: link d9/db/d16/l21 d9/db/d16/d5d/d68/l76 0 2024-02-15T18:27:10.292 INFO:tasks.workunit.client.1.smithi133.stdout:7/346: chown d9/db/ce 222 1 2024-02-15T18:27:10.293 INFO:tasks.workunit.client.0.smithi084.stdout:6/757: mknod d14/d22/d25/d2f/d31/d30/d4f/cf8 0 2024-02-15T18:27:10.293 INFO:tasks.workunit.client.0.smithi084.stdout:6/758: write d14/d22/d25/d2f/d31/d30/d4f/d7f/f8b [503793,86386] 0 2024-02-15T18:27:10.293 INFO:tasks.workunit.client.0.smithi084.stdout:6/759: chown d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/fda 6747178 1 2024-02-15T18:27:10.293 INFO:tasks.workunit.client.1.smithi133.stdout:7/347: rmdir d9/d36/d31 39 2024-02-15T18:27:10.294 INFO:tasks.workunit.client.0.smithi084.stdout:6/760: creat d14/d22/d25/d2f/d31/d30/d4f/d7f/de7/ff9 x:0 0 0 2024-02-15T18:27:10.295 INFO:tasks.workunit.client.0.smithi084.stdout:6/761: creat d14/d22/d25/de8/ffa x:0 0 0 2024-02-15T18:27:10.298 INFO:tasks.workunit.client.0.smithi084.stdout:6/762: getdents d14/d22/d25/d2f/d31/d30/d45 0 2024-02-15T18:27:10.298 INFO:tasks.workunit.client.0.smithi084.stdout:5/879: dwrite d9/d5f/d68/d9a/d8d/de5/f11c [0,4194304] 0 2024-02-15T18:27:10.298 INFO:tasks.workunit.client.0.smithi084.stdout:5/880: dread - d9/d5b/f114 zero size 2024-02-15T18:27:10.298 INFO:tasks.workunit.client.0.smithi084.stdout:1/742: dwrite d9/d54/d7f/db7/dd9/f67 [0,4194304] 0 2024-02-15T18:27:10.299 INFO:tasks.workunit.client.0.smithi084.stdout:1/743: fsync d9/d54/f6e 0 2024-02-15T18:27:10.299 INFO:tasks.workunit.client.0.smithi084.stdout:1/744: write d9/d54/d1b/d2c/d35/f73 [5231990,115713] 0 2024-02-15T18:27:10.299 INFO:tasks.workunit.client.0.smithi084.stdout:5/881: read d9/d5b/d7e/db5/fbd [275993,38658] 0 2024-02-15T18:27:10.299 INFO:tasks.workunit.client.0.smithi084.stdout:2/745: dwrite d3/d5/dbd/ff0 [4194304,4194304] 0 2024-02-15T18:27:10.300 INFO:tasks.workunit.client.0.smithi084.stdout:6/763: link d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/fce d14/d22/d25/d2f/da9/d9b/dac/ffb 0 2024-02-15T18:27:10.300 INFO:tasks.workunit.client.0.smithi084.stdout:4/831: dwrite d2/d2b/d47/ff1 [0,4194304] 0 2024-02-15T18:27:10.301 INFO:tasks.workunit.client.0.smithi084.stdout:3/722: dwrite d8/d1f/d25/f7f [0,4194304] 0 2024-02-15T18:27:10.306 INFO:tasks.workunit.client.0.smithi084.stdout:0/772: dwrite d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/f9b [0,4194304] 0 2024-02-15T18:27:10.307 INFO:tasks.workunit.client.0.smithi084.stdout:5/882: mkdir d9/d35/d65/d7f/dd6/d124 0 2024-02-15T18:27:10.307 INFO:tasks.workunit.client.0.smithi084.stdout:5/883: readlink d9/da/d3d/d44/le7 0 2024-02-15T18:27:10.307 INFO:tasks.workunit.client.0.smithi084.stdout:0/773: chown d0/d39/d90/db1/ccf 1277 1 2024-02-15T18:27:10.307 INFO:tasks.workunit.client.0.smithi084.stdout:1/745: rename d9/d54/d32/d5b/f8d to d9/d54/d7f/db7/fec 0 2024-02-15T18:27:10.308 INFO:tasks.workunit.client.0.smithi084.stdout:3/723: rmdir d8/d1f/dbf 39 2024-02-15T18:27:10.311 INFO:tasks.workunit.client.1.smithi133.stdout:6/674: dwrite d0/db/d29/d34/fb7 [0,4194304] 0 2024-02-15T18:27:10.318 INFO:tasks.workunit.client.1.smithi133.stdout:7/348: dwrite d9/d36/f32 [0,4194304] 0 2024-02-15T18:27:10.323 INFO:tasks.workunit.client.1.smithi133.stdout:7/349: read d9/db/f2d [4436060,51027] 0 2024-02-15T18:27:10.326 INFO:tasks.workunit.client.1.smithi133.stdout:7/350: link d9/db/d16/d5d/d68/l69 d9/da/d48/l77 0 2024-02-15T18:27:10.327 INFO:tasks.workunit.client.0.smithi084.stdout:2/746: dwrite d3/ff [0,4194304] 0 2024-02-15T18:27:10.328 INFO:tasks.workunit.client.1.smithi133.stdout:7/351: getdents d9/da 0 2024-02-15T18:27:10.330 INFO:tasks.workunit.client.1.smithi133.stdout:7/352: rename d9/db/f57 to d9/da/f78 0 2024-02-15T18:27:10.331 INFO:tasks.workunit.client.0.smithi084.stdout:3/724: creat d8/d40/d43/d71/dd9/ff3 x:0 0 0 2024-02-15T18:27:10.332 INFO:tasks.workunit.client.1.smithi133.stdout:7/353: symlink d9/d36/d31/l79 0 2024-02-15T18:27:10.332 INFO:tasks.workunit.client.1.smithi133.stdout:7/354: fsync d9/db/d55/f72 0 2024-02-15T18:27:10.332 INFO:tasks.workunit.client.0.smithi084.stdout:1/746: mkdir d9/d54/d7f/db7/dd9/d81/ded 0 2024-02-15T18:27:10.333 INFO:tasks.workunit.client.0.smithi084.stdout:3/725: truncate d8/d40/f70 8704 0 2024-02-15T18:27:10.334 INFO:tasks.workunit.client.0.smithi084.stdout:1/747: mkdir d9/d54/d7f/db7/dd9/d81/ded/dee 0 2024-02-15T18:27:10.334 INFO:tasks.workunit.client.0.smithi084.stdout:1/748: creat d9/d54/d1b/da7/fef x:0 0 0 2024-02-15T18:27:10.335 INFO:tasks.workunit.client.0.smithi084.stdout:1/749: truncate d9/d54/d1b/d2c/f43 189235 0 2024-02-15T18:27:10.337 INFO:tasks.workunit.client.0.smithi084.stdout:3/726: write d8/d40/d43/d71/fb5 [729587,74734] 0 2024-02-15T18:27:10.337 INFO:tasks.workunit.client.0.smithi084.stdout:3/727: write d8/fac [5190003,20972] 0 2024-02-15T18:27:10.338 INFO:tasks.workunit.client.0.smithi084.stdout:3/728: write d8/d1f/d2d/f3d [3123979,199] 0 2024-02-15T18:27:10.338 INFO:tasks.workunit.client.0.smithi084.stdout:3/729: stat d8/d1f/d25/c76 0 2024-02-15T18:27:10.339 INFO:tasks.workunit.client.0.smithi084.stdout:3/730: mknod d8/d73/d93/cf4 0 2024-02-15T18:27:10.341 INFO:tasks.workunit.client.0.smithi084.stdout:3/731: chown d8/d1f/dbf/l55 92507805 1 2024-02-15T18:27:10.344 INFO:tasks.workunit.client.0.smithi084.stdout:1/750: write d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 [3134117,65828] 0 2024-02-15T18:27:10.344 INFO:tasks.workunit.client.0.smithi084.stdout:2/747: dread d3/d5/d1a/d1e/f58 [4194304,4194304] 0 2024-02-15T18:27:10.344 INFO:tasks.workunit.client.0.smithi084.stdout:2/748: chown d3/d5/d1a/d1e/d4b/da6/d5c/dd3 62917519 1 2024-02-15T18:27:10.344 INFO:tasks.workunit.client.0.smithi084.stdout:3/732: rename d8/d40/dda to d8/d40/d43/d71/d8c/d94/da3/dba/df5 0 2024-02-15T18:27:10.346 INFO:tasks.workunit.client.0.smithi084.stdout:4/832: dwrite d2/d2b/d47/f7a [0,4194304] 0 2024-02-15T18:27:10.346 INFO:tasks.workunit.client.0.smithi084.stdout:4/833: dread - d2/d64/d74/fe0 zero size 2024-02-15T18:27:10.346 INFO:tasks.workunit.client.0.smithi084.stdout:4/834: write d2/d64/da5/dae/fd0 [401203,17554] 0 2024-02-15T18:27:10.346 INFO:tasks.workunit.client.0.smithi084.stdout:0/774: dwrite d0/d4/d3a/d5c/de2/f7c [0,4194304] 0 2024-02-15T18:27:10.346 INFO:tasks.workunit.client.0.smithi084.stdout:0/775: stat d0/d4/d3a/d82/fe8 0 2024-02-15T18:27:10.346 INFO:tasks.workunit.client.0.smithi084.stdout:1/751: creat d9/d54/d1b/d2c/d4b/ddf/ff0 x:0 0 0 2024-02-15T18:27:10.347 INFO:tasks.workunit.client.0.smithi084.stdout:2/749: truncate d3/d19/f5b 533649 0 2024-02-15T18:27:10.347 INFO:tasks.workunit.client.0.smithi084.stdout:3/733: symlink d8/d40/lf6 0 2024-02-15T18:27:10.348 INFO:tasks.workunit.client.0.smithi084.stdout:1/752: write d9/f27 [3076541,40940] 0 2024-02-15T18:27:10.351 INFO:tasks.workunit.client.0.smithi084.stdout:4/835: truncate d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/fb1 326004 0 2024-02-15T18:27:10.351 INFO:tasks.workunit.client.0.smithi084.stdout:5/884: dwrite d9/d35/d65/fd5 [0,4194304] 0 2024-02-15T18:27:10.352 INFO:tasks.workunit.client.0.smithi084.stdout:0/776: mkdir d0/d2f/d4b/dae/db0/deb 0 2024-02-15T18:27:10.352 INFO:tasks.workunit.client.0.smithi084.stdout:0/777: write d0/d4/d3a/d5c/de2/d43/d6d/fb5 [591568,83767] 0 2024-02-15T18:27:10.353 INFO:tasks.workunit.client.0.smithi084.stdout:2/750: creat d3/d9e/ff3 x:0 0 0 2024-02-15T18:27:10.353 INFO:tasks.workunit.client.0.smithi084.stdout:2/751: fdatasync d3/ff 0 2024-02-15T18:27:10.355 INFO:tasks.workunit.client.0.smithi084.stdout:1/753: dread d9/d54/d1b/d2c/d4b/d4c/d79/d39/f23 [0,4194304] 0 2024-02-15T18:27:10.355 INFO:tasks.workunit.client.0.smithi084.stdout:1/754: fsync d9/d54/d1b/d2c/d4b/d4c/d79/f9c 0 2024-02-15T18:27:10.355 INFO:tasks.workunit.client.1.smithi133.stdout:7/355: dwrite d9/d36/f23 [0,4194304] 0 2024-02-15T18:27:10.359 INFO:tasks.workunit.client.0.smithi084.stdout:3/734: link d8/d1f/d2d/fb2 d8/d1f/dbf/db6/ff7 0 2024-02-15T18:27:10.359 INFO:tasks.workunit.client.0.smithi084.stdout:8/783: sync 2024-02-15T18:27:10.359 INFO:tasks.workunit.client.0.smithi084.stdout:9/814: sync 2024-02-15T18:27:10.359 INFO:tasks.workunit.client.0.smithi084.stdout:7/772: sync 2024-02-15T18:27:10.368 INFO:tasks.workunit.client.1.smithi133.stdout:2/456: sync 2024-02-15T18:27:10.368 INFO:tasks.workunit.client.1.smithi133.stdout:1/642: sync 2024-02-15T18:27:10.368 INFO:tasks.workunit.client.1.smithi133.stdout:4/362: sync 2024-02-15T18:27:10.368 INFO:tasks.workunit.client.1.smithi133.stdout:4/363: write d2/d48/d5c/f62 [353954,120559] 0 2024-02-15T18:27:10.368 INFO:tasks.workunit.client.0.smithi084.stdout:4/836: getdents d2/d4/d28/d3d/d5c/dbc/d88/db0 0 2024-02-15T18:27:10.369 INFO:tasks.workunit.client.1.smithi133.stdout:1/643: mknod d6/d1e/d3a/d97/cee 0 2024-02-15T18:27:10.370 INFO:tasks.workunit.client.0.smithi084.stdout:9/815: dread d4/d2b/d3c/d24/dca/d15/f37 [0,4194304] 0 2024-02-15T18:27:10.371 INFO:tasks.workunit.client.0.smithi084.stdout:9/816: dread - d4/d2b/d3c/d20/d75/d87/de2/dea/ffe zero size 2024-02-15T18:27:10.371 INFO:tasks.workunit.client.0.smithi084.stdout:9/817: readlink d4/l9a 0 2024-02-15T18:27:10.374 INFO:tasks.workunit.client.0.smithi084.stdout:1/755: link d9/d54/d1b/d2c/d4b/d4c/d79/d36/c65 d9/d54/d1b/da7/cf1 0 2024-02-15T18:27:10.374 INFO:tasks.workunit.client.0.smithi084.stdout:9/818: read d4/d2b/d3c/d24/dca/f64 [767844,105707] 0 2024-02-15T18:27:10.376 INFO:tasks.workunit.client.0.smithi084.stdout:8/784: symlink db/daf/db6/l100 0 2024-02-15T18:27:10.380 INFO:tasks.workunit.client.0.smithi084.stdout:4/837: mkdir d2/d4/d28/df2 0 2024-02-15T18:27:10.381 INFO:tasks.workunit.client.1.smithi133.stdout:1/644: rename d6/d1e/d41/dcc/ce6 to d6/d2a/d59/cef 0 2024-02-15T18:27:10.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.385+0000 7f435d24c700 1 -- 172.21.15.84:0/3150123494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 msgr2=0x7f43580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:10.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.385+0000 7f435d24c700 1 --2- 172.21.15.84:0/3150123494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 0x7f43580f6cc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f434c004660 tx=0x7f434c009b30).stop 2024-02-15T18:27:10.382 INFO:tasks.workunit.client.0.smithi084.stdout:1/756: creat d9/d54/d1b/d2c/d4b/d4c/d79/ff2 x:0 0 0 2024-02-15T18:27:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.385+0000 7f435d24c700 1 -- 172.21.15.84:0/3150123494 shutdown_connections 2024-02-15T18:27:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.385+0000 7f435d24c700 1 --2- 172.21.15.84:0/3150123494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 0x7f43580f6cc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.385+0000 7f435d24c700 1 --2- 172.21.15.84:0/3150123494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43580f55c0 0x7f43580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.385+0000 7f435d24c700 1 -- 172.21.15.84:0/3150123494 >> 172.21.15.84:0/3150123494 conn(0x7f43580f0d40 msgr2=0x7f43580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.386+0000 7f435d24c700 1 -- 172.21.15.84:0/3150123494 shutdown_connections 2024-02-15T18:27:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.386+0000 7f435d24c700 1 -- 172.21.15.84:0/3150123494 wait complete. 2024-02-15T18:27:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.386+0000 7f435d24c700 1 Processor -- start 2024-02-15T18:27:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.386+0000 7f435d24c700 1 -- start start 2024-02-15T18:27:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435d24c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43580f55c0 0x7f4358105f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435d24c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 0x7f4358106470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435d24c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358106ab0 con 0x7f43580f6860 2024-02-15T18:27:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435d24c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358107360 con 0x7f43580f55c0 2024-02-15T18:27:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 0x7f4358106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 0x7f4358106470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42222/0 (socket says 172.21.15.84:42222) 2024-02-15T18:27:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435659c700 1 -- 172.21.15.84:0/2275343345 learned_addr learned my addr 172.21.15.84:0/2275343345 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:10.384 INFO:tasks.workunit.client.0.smithi084.stdout:9/819: creat d4/d3d/da5/f104 x:0 0 0 2024-02-15T18:27:10.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f4356d9d700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43580f55c0 0x7f4358105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435659c700 1 -- 172.21.15.84:0/2275343345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43580f55c0 msgr2=0x7f4358105f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435659c700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43580f55c0 0x7f4358105f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435659c700 1 -- 172.21.15.84:0/2275343345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c005040 con 0x7f43580f6860 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.387+0000 7f435659c700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 0x7f4358106470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f434c013fb0 tx=0x7f434c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.388+0000 7f433f7fe700 1 -- 172.21.15.84:0/2275343345 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434c018070 con 0x7f43580f6860 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.388+0000 7f433f7fe700 1 -- 172.21.15.84:0/2275343345 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f434c009780 con 0x7f43580f6860 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.388+0000 7f435d24c700 1 -- 172.21.15.84:0/2275343345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43581075e0 con 0x7f43580f6860 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.388+0000 7f433f7fe700 1 -- 172.21.15.84:0/2275343345 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434c01c6f0 con 0x7f43580f6860 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.388+0000 7f435d24c700 1 -- 172.21.15.84:0/2275343345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4358107ac0 con 0x7f43580f6860 2024-02-15T18:27:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.389+0000 7f433d7fa700 1 -- 172.21.15.84:0/2275343345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4330004fa0 con 0x7f43580f6860 2024-02-15T18:27:10.387 INFO:tasks.workunit.client.0.smithi084.stdout:8/785: creat db/dd/d13/f101 x:0 0 0 2024-02-15T18:27:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.390+0000 7f433f7fe700 1 -- 172.21.15.84:0/2275343345 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 28) v1 ==== 77194+0+0 (secure 0 0 0) 0x7f434c01c850 con 0x7f43580f6860 2024-02-15T18:27:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.391+0000 7f433f7fe700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4340060fb0 0x7f4340063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.391+0000 7f433f7fe700 1 -- 172.21.15.84:0/2275343345 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f434c07e4c0 con 0x7f43580f6860 2024-02-15T18:27:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.391+0000 7f4356d9d700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4340060fb0 0x7f4340063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.391+0000 7f4356d9d700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4340060fb0 0x7f4340063470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4348006fd0 tx=0x7f4348008040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:10.388 INFO:tasks.workunit.client.0.smithi084.stdout:1/757: rename d9/f15 to d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ff3 0 2024-02-15T18:27:10.388 INFO:tasks.workunit.client.0.smithi084.stdout:9/820: mknod d4/da3/db0/c105 0 2024-02-15T18:27:10.388 INFO:tasks.workunit.client.0.smithi084.stdout:9/821: chown d4/f19 2526685 1 2024-02-15T18:27:10.389 INFO:tasks.workunit.client.0.smithi084.stdout:1/758: mkdir d9/d54/d7f/db7/dd9/df4 0 2024-02-15T18:27:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.401+0000 7f433f7fe700 1 -- 172.21.15.84:0/2275343345 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f434c052300 con 0x7f43580f6860 2024-02-15T18:27:10.398 INFO:tasks.workunit.client.0.smithi084.stdout:1/759: write d9/d54/d32/d5b/f75 [1801230,81590] 0 2024-02-15T18:27:10.398 INFO:tasks.workunit.client.0.smithi084.stdout:1/760: write d9/d54/d7f/db7/dd9/d81/d94/db9/fe4 [418735,27365] 0 2024-02-15T18:27:10.400 INFO:tasks.workunit.client.0.smithi084.stdout:4/838: dread d2/d4/d28/f96 [0,4194304] 0 2024-02-15T18:27:10.402 INFO:tasks.workunit.client.0.smithi084.stdout:5/885: dwrite d9/f2c [0,4194304] 0 2024-02-15T18:27:10.403 INFO:tasks.workunit.client.0.smithi084.stdout:3/735: dwrite d8/d1f/ff1 [0,4194304] 0 2024-02-15T18:27:10.405 INFO:tasks.workunit.client.0.smithi084.stdout:1/761: mkdir d9/d54/d32/df5 0 2024-02-15T18:27:10.405 INFO:tasks.workunit.client.1.smithi133.stdout:2/457: dwrite d7/d2c/d5a/d66/f7c [0,4194304] 0 2024-02-15T18:27:10.406 INFO:tasks.workunit.client.0.smithi084.stdout:7/773: dwrite df/fa8 [0,4194304] 0 2024-02-15T18:27:10.408 INFO:tasks.workunit.client.0.smithi084.stdout:4/839: mknod d2/d4/d28/d3d/d5c/dbc/d88/db0/cf3 0 2024-02-15T18:27:10.409 INFO:tasks.workunit.client.0.smithi084.stdout:4/840: dread d2/d4/d28/d3d/d5c/dbc/d88/db0/fc5 [0,4194304] 0 2024-02-15T18:27:10.409 INFO:tasks.workunit.client.0.smithi084.stdout:4/841: fdatasync d2/d4/f4f 0 2024-02-15T18:27:10.412 INFO:tasks.workunit.client.1.smithi133.stdout:2/458: symlink d7/db/d35/l94 0 2024-02-15T18:27:10.412 INFO:tasks.workunit.client.1.smithi133.stdout:2/459: write d7/d2c/d31/f88 [218604,12630] 0 2024-02-15T18:27:10.413 INFO:tasks.workunit.client.1.smithi133.stdout:2/460: rmdir d7 39 2024-02-15T18:27:10.413 INFO:tasks.workunit.client.0.smithi084.stdout:5/886: dread d9/d35/d65/d7f/f80 [0,4194304] 0 2024-02-15T18:27:10.414 INFO:tasks.workunit.client.1.smithi133.stdout:2/461: symlink d7/d2c/d5a/d66/l95 0 2024-02-15T18:27:10.414 INFO:tasks.workunit.client.1.smithi133.stdout:2/462: stat d7/d2c 0 2024-02-15T18:27:10.415 INFO:tasks.workunit.client.0.smithi084.stdout:1/762: getdents d9/d54/d1b/d2c/d35 0 2024-02-15T18:27:10.416 INFO:tasks.workunit.client.1.smithi133.stdout:2/463: rename d7/d2c/d5a/f60 to d7/d18/d32/d65/d58/f96 0 2024-02-15T18:27:10.417 INFO:tasks.workunit.client.1.smithi133.stdout:2/464: creat d7/db/d67/d7b/f97 x:0 0 0 2024-02-15T18:27:10.418 INFO:tasks.workunit.client.1.smithi133.stdout:2/465: link d7/d2c/d5a/l82 d7/d18/l98 0 2024-02-15T18:27:10.418 INFO:tasks.workunit.client.1.smithi133.stdout:2/466: read - d7/d18/d32/d65/f56 zero size 2024-02-15T18:27:10.419 INFO:tasks.workunit.client.1.smithi133.stdout:2/467: unlink d7/d2c/d3b/d48/d6d/f8c 0 2024-02-15T18:27:10.421 INFO:tasks.workunit.client.0.smithi084.stdout:8/786: dwrite db/d6a/fb4 [0,4194304] 0 2024-02-15T18:27:10.423 INFO:tasks.workunit.client.0.smithi084.stdout:9/822: dwrite d4/d3d/da5/fde [0,4194304] 0 2024-02-15T18:27:10.423 INFO:tasks.workunit.client.1.smithi133.stdout:1/645: dwrite d6/d17/f68 [0,4194304] 0 2024-02-15T18:27:10.423 INFO:tasks.workunit.client.0.smithi084.stdout:3/736: dwrite d8/d40/d43/d71/d8c/d94/da3/de5/fef [0,4194304] 0 2024-02-15T18:27:10.424 INFO:tasks.workunit.client.1.smithi133.stdout:1/646: rename d6/d17/f1c to d6/d1e/d3a/d82/d85/d67/da6/ff0 0 2024-02-15T18:27:10.425 INFO:tasks.workunit.client.0.smithi084.stdout:7/774: creat df/d1d/d1a/d6a/d8b/da5/db6/ffd x:0 0 0 2024-02-15T18:27:10.425 INFO:tasks.workunit.client.0.smithi084.stdout:5/887: creat d9/da/d3d/d44/d55/dfe/f125 x:0 0 0 2024-02-15T18:27:10.425 INFO:tasks.workunit.client.0.smithi084.stdout:1/763: unlink d9/d54/d1b/d38/d4d/ce0 0 2024-02-15T18:27:10.425 INFO:tasks.workunit.client.0.smithi084.stdout:4/842: write d2/d2b/f5f [849171,83625] 0 2024-02-15T18:27:10.425 INFO:tasks.workunit.client.0.smithi084.stdout:5/888: write d9/fe [3329235,120881] 0 2024-02-15T18:27:10.426 INFO:tasks.workunit.client.1.smithi133.stdout:2/468: write f1 [8089613,101296] 0 2024-02-15T18:27:10.428 INFO:tasks.workunit.client.1.smithi133.stdout:1/647: dread d6/d1e/f21 [0,4194304] 0 2024-02-15T18:27:10.429 INFO:tasks.workunit.client.1.smithi133.stdout:2/469: mkdir d7/d18/d32/d65/d99 0 2024-02-15T18:27:10.429 INFO:tasks.workunit.client.1.smithi133.stdout:2/470: stat d7/d2c/d3b/d48/d59/l75 0 2024-02-15T18:27:10.430 INFO:tasks.workunit.client.0.smithi084.stdout:8/787: mknod db/d3f/d59/dcd/c102 0 2024-02-15T18:27:10.430 INFO:tasks.workunit.client.1.smithi133.stdout:1/648: mkdir d6/d2a/df1 0 2024-02-15T18:27:10.432 INFO:tasks.workunit.client.1.smithi133.stdout:1/649: truncate d6/fa5 2217217 0 2024-02-15T18:27:10.433 INFO:tasks.workunit.client.0.smithi084.stdout:9/823: mkdir d4/d2b/d3c/d24/dca/d15/d33/de9/d106 0 2024-02-15T18:27:10.435 INFO:tasks.workunit.client.1.smithi133.stdout:1/650: rename d6/c49 to d6/d1e/d41/d7c/d7e/d7f/db6/ded/cf2 0 2024-02-15T18:27:10.436 INFO:tasks.workunit.client.1.smithi133.stdout:1/651: truncate d6/d1e/d3a/d75/fb0 1094763 0 2024-02-15T18:27:10.437 INFO:tasks.workunit.client.0.smithi084.stdout:3/737: creat d8/d1f/d2d/dc5/ff8 x:0 0 0 2024-02-15T18:27:10.437 INFO:tasks.workunit.client.0.smithi084.stdout:7/775: dread f4 [0,4194304] 0 2024-02-15T18:27:10.439 INFO:tasks.workunit.client.0.smithi084.stdout:1/764: rename d9/d54/d7f/db7/dd9/d81/fa2 to d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db6/ff6 0 2024-02-15T18:27:10.439 INFO:tasks.workunit.client.0.smithi084.stdout:1/765: truncate d9/d54/d1b/da7/fef 825331 0 2024-02-15T18:27:10.439 INFO:tasks.workunit.client.0.smithi084.stdout:1/766: dread - d9/d54/d76/f80 zero size 2024-02-15T18:27:10.439 INFO:tasks.workunit.client.0.smithi084.stdout:1/767: dread - d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/fb8 zero size 2024-02-15T18:27:10.440 INFO:tasks.workunit.client.0.smithi084.stdout:8/788: symlink db/l103 0 2024-02-15T18:27:10.440 INFO:tasks.workunit.client.0.smithi084.stdout:8/789: chown db/c1b 60 1 2024-02-15T18:27:10.441 INFO:tasks.workunit.client.0.smithi084.stdout:1/768: dread d9/d54/d1b/da7/fef [0,4194304] 0 2024-02-15T18:27:10.441 INFO:tasks.workunit.client.0.smithi084.stdout:6/764: sync 2024-02-15T18:27:10.442 INFO:tasks.workunit.client.0.smithi084.stdout:6/765: chown d14/c3d 67525550 1 2024-02-15T18:27:10.442 INFO:tasks.workunit.client.0.smithi084.stdout:6/766: dread - d14/d22/d25/d2f/d31/d3f/d4a/fa0 zero size 2024-02-15T18:27:10.442 INFO:tasks.workunit.client.0.smithi084.stdout:3/738: creat d8/d40/d58/ff9 x:0 0 0 2024-02-15T18:27:10.444 INFO:tasks.workunit.client.0.smithi084.stdout:7/776: mkdir df/d70/d9c/dfe 0 2024-02-15T18:27:10.446 INFO:tasks.workunit.client.0.smithi084.stdout:4/843: rename d2/d4/d28/d2e/fb6 to d2/d4/d28/d3d/d5c/dbc/d88/ff4 0 2024-02-15T18:27:10.447 INFO:tasks.workunit.client.0.smithi084.stdout:8/790: link db/d1a/d2b/c57 db/d3f/d59/d69/c104 0 2024-02-15T18:27:10.447 INFO:tasks.workunit.client.0.smithi084.stdout:3/739: symlink d8/d40/d43/d71/d8c/d94/lfa 0 2024-02-15T18:27:10.448 INFO:tasks.workunit.client.0.smithi084.stdout:7/777: mkdir df/d1d/d1a/d6a/d8b/da5/db6/df4/dff 0 2024-02-15T18:27:10.451 INFO:tasks.workunit.client.0.smithi084.stdout:4/844: mknod d2/d4/d25/cf5 0 2024-02-15T18:27:10.452 INFO:tasks.workunit.client.1.smithi133.stdout:1/652: rmdir d6/d1e/d41/d7c/d7e/d7f/db6 39 2024-02-15T18:27:10.452 INFO:tasks.workunit.client.1.smithi133.stdout:1/653: chown d6/d17/f60 1991977 1 2024-02-15T18:27:10.452 INFO:tasks.workunit.client.1.smithi133.stdout:1/654: chown d6/d1e/d41/d7c/lcf 49 1 2024-02-15T18:27:10.454 INFO:tasks.workunit.client.1.smithi133.stdout:1/655: read d6/d1e/d3a/d79/faf [2625554,117265] 0 2024-02-15T18:27:10.456 INFO:tasks.workunit.client.0.smithi084.stdout:8/791: mknod db/d3f/d59/c105 0 2024-02-15T18:27:10.456 INFO:tasks.workunit.client.0.smithi084.stdout:6/767: dread f10 [0,4194304] 0 2024-02-15T18:27:10.456 INFO:tasks.workunit.client.0.smithi084.stdout:3/740: truncate d8/d40/d58/d80/f2b 4628431 0 2024-02-15T18:27:10.457 INFO:tasks.workunit.client.1.smithi133.stdout:1/656: symlink d6/d1e/lf3 0 2024-02-15T18:27:10.458 INFO:tasks.workunit.client.1.smithi133.stdout:1/657: write d6/d17/f68 [3187807,49194] 0 2024-02-15T18:27:10.459 INFO:tasks.workunit.client.0.smithi084.stdout:1/769: dread d9/d54/d1b/d38/f4a [0,4194304] 0 2024-02-15T18:27:10.459 INFO:tasks.workunit.client.0.smithi084.stdout:1/770: fsync d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/fd0 0 2024-02-15T18:27:10.461 INFO:tasks.workunit.client.1.smithi133.stdout:2/471: dwrite d7/d2c/d3b/d48/d59/d74/f7a [0,4194304] 0 2024-02-15T18:27:10.461 INFO:tasks.workunit.client.1.smithi133.stdout:2/472: write d7/d18/f8a [370680,3848] 0 2024-02-15T18:27:10.461 INFO:tasks.workunit.client.1.smithi133.stdout:2/473: read - d7/d18/d32/d65/d58/f5d zero size 2024-02-15T18:27:10.462 INFO:tasks.workunit.client.0.smithi084.stdout:8/792: read db/d3f/d59/f3b [771801,10372] 0 2024-02-15T18:27:10.463 INFO:tasks.workunit.client.0.smithi084.stdout:1/771: rename d9/d54/d1b/d2c/d4b/d7a to d9/d54/d7f/db7/dd9/df7 0 2024-02-15T18:27:10.466 INFO:tasks.workunit.client.0.smithi084.stdout:5/889: dwrite d9/d5b/d79/db7/f122 [0,4194304] 0 2024-02-15T18:27:10.466 INFO:tasks.workunit.client.0.smithi084.stdout:5/890: chown d9/d35/f42 57499 1 2024-02-15T18:27:10.468 INFO:tasks.workunit.client.0.smithi084.stdout:5/891: stat d9/da/d3d/d44/d55/dfe/dac/cc2 0 2024-02-15T18:27:10.468 INFO:tasks.workunit.client.0.smithi084.stdout:5/892: stat d9/da/d3d/d44/d55/dfe/l2e 0 2024-02-15T18:27:10.469 INFO:tasks.workunit.client.0.smithi084.stdout:6/768: dread d14/d22/d25/d2f/d31/d30/d45/d52/fb3 [0,4194304] 0 2024-02-15T18:27:10.470 INFO:tasks.workunit.client.0.smithi084.stdout:5/893: symlink d9/d35/l126 0 2024-02-15T18:27:10.472 INFO:tasks.workunit.client.0.smithi084.stdout:5/894: mknod d9/da/d3d/d44/d55/c127 0 2024-02-15T18:27:10.472 INFO:tasks.workunit.client.0.smithi084.stdout:5/895: chown d9/da/d3d/d44/d55/d70/d84/da1 358 1 2024-02-15T18:27:10.475 INFO:tasks.workunit.client.0.smithi084.stdout:5/896: truncate d9/da/d3d/d44/d55/d70/dfa/f11d 3997220 0 2024-02-15T18:27:10.475 INFO:tasks.workunit.client.0.smithi084.stdout:5/897: chown d9/d5b/d79/fbb 905 1 2024-02-15T18:27:10.478 INFO:tasks.workunit.client.0.smithi084.stdout:0/778: sync 2024-02-15T18:27:10.478 INFO:tasks.workunit.client.0.smithi084.stdout:2/752: sync 2024-02-15T18:27:10.478 INFO:tasks.workunit.client.0.smithi084.stdout:2/753: read - d3/fde zero size 2024-02-15T18:27:10.482 INFO:tasks.workunit.client.0.smithi084.stdout:6/769: write d14/d22/d25/d2f/d31/d30/d45/d52/d8a/fb6 [2094692,22488] 0 2024-02-15T18:27:10.482 INFO:tasks.workunit.client.0.smithi084.stdout:3/741: dread d8/d1f/d25/f75 [0,4194304] 0 2024-02-15T18:27:10.488 INFO:tasks.workunit.client.0.smithi084.stdout:0/779: unlink d0/cb9 0 2024-02-15T18:27:10.488 INFO:tasks.workunit.client.0.smithi084.stdout:3/742: rmdir d8/d73/d93 39 2024-02-15T18:27:10.492 INFO:tasks.workunit.client.0.smithi084.stdout:7/778: dwrite df/d1d/d44/d8d/fea [0,4194304] 0 2024-02-15T18:27:10.494 INFO:tasks.workunit.client.0.smithi084.stdout:4/845: dwrite d2/d64/d74/feb [0,4194304] 0 2024-02-15T18:27:10.497 INFO:tasks.workunit.client.0.smithi084.stdout:7/779: dread df/d1d/fae [0,4194304] 0 2024-02-15T18:27:10.497 INFO:tasks.workunit.client.0.smithi084.stdout:7/780: stat df/d1d/d1a/d6a/d8b/d48/dca 0 2024-02-15T18:27:10.498 INFO:tasks.workunit.client.0.smithi084.stdout:4/846: chown d2/d2b/d47/d31/c9b 476978 1 2024-02-15T18:27:10.498 INFO:tasks.workunit.client.0.smithi084.stdout:4/847: dread - d2/d4/fb2 zero size 2024-02-15T18:27:10.499 INFO:tasks.workunit.client.0.smithi084.stdout:7/781: mkdir df/d1d/d44/d96/d100 0 2024-02-15T18:27:10.499 INFO:tasks.workunit.client.0.smithi084.stdout:7/782: truncate df/d1d/d1a/d6a/d8b/da5/db6/fe4 712563 0 2024-02-15T18:27:10.500 INFO:tasks.workunit.client.0.smithi084.stdout:7/783: mkdir df/d1d/d1a/d6a/d8b/da5/db6/de5/d101 0 2024-02-15T18:27:10.500 INFO:tasks.workunit.client.0.smithi084.stdout:7/784: read - df/d70/fb0 zero size 2024-02-15T18:27:10.502 INFO:tasks.workunit.client.0.smithi084.stdout:4/848: link d2/d2b/f54 d2/d2b/d47/ff6 0 2024-02-15T18:27:10.505 INFO:tasks.workunit.client.0.smithi084.stdout:4/849: getdents d2/d4/d28/d71 0 2024-02-15T18:27:10.510 INFO:tasks.workunit.client.0.smithi084.stdout:1/772: dwrite d9/d54/d7f/db7/dd9/df7/d89/f98 [0,4194304] 0 2024-02-15T18:27:10.510 INFO:tasks.workunit.client.0.smithi084.stdout:6/770: dwrite d14/d22/d25/d2f/d31/dcf/fe0 [0,4194304] 0 2024-02-15T18:27:10.510 INFO:tasks.workunit.client.0.smithi084.stdout:1/773: chown d9/d54/d1b/f53 41173832 1 2024-02-15T18:27:10.511 INFO:tasks.workunit.client.0.smithi084.stdout:6/771: truncate d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/f69 1376674 0 2024-02-15T18:27:10.511 INFO:tasks.workunit.client.0.smithi084.stdout:8/793: dwrite db/d1a/d2b/d7b/fff [0,4194304] 0 2024-02-15T18:27:10.513 INFO:tasks.workunit.client.0.smithi084.stdout:4/850: dread d2/d4/d28/d3d/f90 [0,4194304] 0 2024-02-15T18:27:10.513 INFO:tasks.workunit.client.0.smithi084.stdout:2/754: dwrite d3/d5/f21 [4194304,4194304] 0 2024-02-15T18:27:10.513 INFO:tasks.workunit.client.0.smithi084.stdout:6/772: write d14/d22/d25/d2f/d31/d30/d4f/d7f/f8b [50877,93527] 0 2024-02-15T18:27:10.513 INFO:tasks.workunit.client.0.smithi084.stdout:1/774: dread d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f84 [0,4194304] 0 2024-02-15T18:27:10.515 INFO:tasks.workunit.client.1.smithi133.stdout:2/474: creat d7/d2c/d3b/f9a x:0 0 0 2024-02-15T18:27:10.518 INFO:tasks.workunit.client.0.smithi084.stdout:2/755: mknod d3/d5/d1a/d1e/cf4 0 2024-02-15T18:27:10.519 INFO:tasks.workunit.client.0.smithi084.stdout:6/773: mkdir d14/d22/d25/de8/dfc 0 2024-02-15T18:27:10.520 INFO:tasks.workunit.client.0.smithi084.stdout:1/775: mknod d9/d54/d7f/db7/dd9/cf8 0 2024-02-15T18:27:10.520 INFO:tasks.workunit.client.0.smithi084.stdout:2/756: mknod d3/d5/d1a/d74/cf5 0 2024-02-15T18:27:10.521 INFO:tasks.workunit.client.0.smithi084.stdout:2/757: truncate d3/d5/d53/dca/d91/fd2 29246 0 2024-02-15T18:27:10.521 INFO:tasks.workunit.client.0.smithi084.stdout:2/758: chown d3/d19/l1c 7798135 1 2024-02-15T18:27:10.523 INFO:tasks.workunit.client.0.smithi084.stdout:6/774: symlink d14/d22/d25/d2f/d31/d3f/dec/lfd 0 2024-02-15T18:27:10.523 INFO:tasks.workunit.client.0.smithi084.stdout:1/776: getdents d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db6 0 2024-02-15T18:27:10.523 INFO:tasks.workunit.client.0.smithi084.stdout:6/775: dread - d14/d22/d25/d2f/d31/d3f/fdf zero size 2024-02-15T18:27:10.523 INFO:tasks.workunit.client.0.smithi084.stdout:6/776: truncate d14/d22/d25/d2f/d31/d30/d45/d52/d8a/fb6 5191932 0 2024-02-15T18:27:10.523 INFO:tasks.workunit.client.0.smithi084.stdout:4/851: dread d2/f21 [0,4194304] 0 2024-02-15T18:27:10.527 INFO:tasks.workunit.client.0.smithi084.stdout:1/777: unlink d9/d54/d1b/l44 0 2024-02-15T18:27:10.529 INFO:tasks.workunit.client.0.smithi084.stdout:4/852: rmdir d2/d4/d28/d3d/d5c/d65/de6 0 2024-02-15T18:27:10.529 INFO:tasks.workunit.client.0.smithi084.stdout:4/853: dread - d2/d4/fb2 zero size 2024-02-15T18:27:10.530 INFO:tasks.workunit.client.0.smithi084.stdout:0/780: dwrite d0/d98/fc0 [0,4194304] 0 2024-02-15T18:27:10.536 INFO:tasks.workunit.client.0.smithi084.stdout:1/778: write d9/d54/f99 [1973955,41498] 0 2024-02-15T18:27:10.536 INFO:tasks.workunit.client.0.smithi084.stdout:7/785: dwrite df/d1d/d1a/f28 [0,4194304] 0 2024-02-15T18:27:10.538 INFO:tasks.workunit.client.0.smithi084.stdout:0/781: getdents d0/d4/d1b/d7a 0 2024-02-15T18:27:10.539 INFO:tasks.workunit.client.0.smithi084.stdout:7/786: mknod df/d1d/d1a/d6a/d8e/c102 0 2024-02-15T18:27:10.539 INFO:tasks.workunit.client.0.smithi084.stdout:7/787: write f5 [5021904,92567] 0 2024-02-15T18:27:10.546 INFO:tasks.workunit.client.1.smithi133.stdout:2/475: dread f1 [4194304,4194304] 0 2024-02-15T18:27:10.546 INFO:tasks.workunit.client.0.smithi084.stdout:1/779: write d9/d54/f82 [2143392,39845] 0 2024-02-15T18:27:10.547 INFO:tasks.workunit.client.0.smithi084.stdout:0/782: truncate d0/d4/d3a/d5c/de2/f84 54439 0 2024-02-15T18:27:10.547 INFO:tasks.workunit.client.0.smithi084.stdout:7/788: getdents df/d1d/d44/dbb/df8 0 2024-02-15T18:27:10.547 INFO:tasks.workunit.client.0.smithi084.stdout:0/783: write d0/d4/d3a/d5c/f81 [4524970,19234] 0 2024-02-15T18:27:10.550 INFO:tasks.workunit.client.1.smithi133.stdout:2/476: write d7/d18/d32/d65/d58/f96 [4174340,95201] 0 2024-02-15T18:27:10.551 INFO:tasks.workunit.client.0.smithi084.stdout:0/784: write d0/d4/d3a/d5c/f52 [1722448,209] 0 2024-02-15T18:27:10.552 INFO:tasks.workunit.client.1.smithi133.stdout:2/477: mknod d7/d2c/d3b/d48/d59/c9b 0 2024-02-15T18:27:10.554 INFO:tasks.workunit.client.0.smithi084.stdout:1/780: creat d9/d54/d32/df5/ff9 x:0 0 0 2024-02-15T18:27:10.554 INFO:tasks.workunit.client.1.smithi133.stdout:2/478: symlink d7/d18/d32/d65/l9c 0 2024-02-15T18:27:10.555 INFO:tasks.workunit.client.1.smithi133.stdout:2/479: dread - d7/d2c/d31/f8f zero size 2024-02-15T18:27:10.556 INFO:tasks.workunit.client.0.smithi084.stdout:7/789: rmdir df/d1d/d1a/d6a/d8b/da5/db6 39 2024-02-15T18:27:10.557 INFO:tasks.workunit.client.0.smithi084.stdout:1/781: getdents d9/d54/d32/d5b/d69/dc7 0 2024-02-15T18:27:10.559 INFO:tasks.workunit.client.0.smithi084.stdout:2/759: dwrite d3/d5/d53/fdc [0,4194304] 0 2024-02-15T18:27:10.559 INFO:tasks.workunit.client.0.smithi084.stdout:2/760: chown d3/d5/d1a/d1e/d30/d8d/df1 86460 1 2024-02-15T18:27:10.560 INFO:tasks.workunit.client.0.smithi084.stdout:6/777: dwrite d14/d22/d25/d2f/fd7 [4194304,4194304] 0 2024-02-15T18:27:10.562 INFO:tasks.workunit.client.0.smithi084.stdout:4/854: dwrite d2/d64/d74/f7f [0,4194304] 0 2024-02-15T18:27:10.563 INFO:tasks.workunit.client.0.smithi084.stdout:4/855: truncate d2/d2b/d47/d31/fce 364331 0 2024-02-15T18:27:10.564 INFO:tasks.workunit.client.0.smithi084.stdout:2/761: unlink d3/d5/d53/dca/d91/lb6 0 2024-02-15T18:27:10.564 INFO:tasks.workunit.client.0.smithi084.stdout:2/762: fdatasync d3/d5/d1a/d74/d8e/d96/fa9 0 2024-02-15T18:27:10.564 INFO:tasks.workunit.client.0.smithi084.stdout:2/763: fdatasync d3/d5/d1a/d74/fac 0 2024-02-15T18:27:10.570 INFO:tasks.workunit.client.0.smithi084.stdout:7/790: truncate df/d1d/d1a/f28 1981120 0 2024-02-15T18:27:10.570 INFO:tasks.workunit.client.0.smithi084.stdout:7/791: chown df/d1d/d1a/d4d/d55/f7b 0 1 2024-02-15T18:27:10.572 INFO:tasks.workunit.client.1.smithi133.stdout:3/513: sync 2024-02-15T18:27:10.572 INFO:tasks.workunit.client.1.smithi133.stdout:0/527: sync 2024-02-15T18:27:10.572 INFO:tasks.workunit.client.1.smithi133.stdout:8/465: sync 2024-02-15T18:27:10.572 INFO:tasks.workunit.client.1.smithi133.stdout:0/528: readlink d9/d10/d19/l43 0 2024-02-15T18:27:10.573 INFO:tasks.workunit.client.1.smithi133.stdout:5/388: sync 2024-02-15T18:27:10.573 INFO:tasks.workunit.client.1.smithi133.stdout:2/480: creat d7/d18/f9d x:0 0 0 2024-02-15T18:27:10.573 INFO:tasks.workunit.client.1.smithi133.stdout:2/481: stat d7/d18/d32/f79 0 2024-02-15T18:27:10.573 INFO:tasks.workunit.client.1.smithi133.stdout:0/529: read d9/d10/d2c/f5d [85278,121838] 0 2024-02-15T18:27:10.575 INFO:tasks.workunit.client.0.smithi084.stdout:6/778: link d14/d22/d25/f84 d14/d22/d25/d2f/d31/d30/d45/d54/ffe 0 2024-02-15T18:27:10.575 INFO:tasks.workunit.client.0.smithi084.stdout:6/779: truncate d14/f78 1313978 0 2024-02-15T18:27:10.577 INFO:tasks.workunit.client.1.smithi133.stdout:3/514: mkdir d0/d15/d2f/d9b/d39/d3f/d3e/da3 0 2024-02-15T18:27:10.577 INFO:tasks.workunit.client.1.smithi133.stdout:5/389: creat d17/d20/d32/d38/d70/f7c x:0 0 0 2024-02-15T18:27:10.577 INFO:tasks.workunit.client.1.smithi133.stdout:3/515: write d0/d15/d37/f88 [782066,43518] 0 2024-02-15T18:27:10.577 INFO:tasks.workunit.client.1.smithi133.stdout:8/466: creat d3/d1c/d2f/d87/d73/d84/f98 x:0 0 0 2024-02-15T18:27:10.577 INFO:tasks.workunit.client.1.smithi133.stdout:8/467: chown d3/d1c/l7c 0 1 2024-02-15T18:27:10.578 INFO:tasks.workunit.client.0.smithi084.stdout:2/764: creat d3/d5/d1a/d1e/ff6 x:0 0 0 2024-02-15T18:27:10.578 INFO:tasks.workunit.client.0.smithi084.stdout:4/856: creat d2/d4/ff7 x:0 0 0 2024-02-15T18:27:10.578 INFO:tasks.workunit.client.0.smithi084.stdout:4/857: chown d2/d4/d28/f4b 1098921 1 2024-02-15T18:27:10.579 INFO:tasks.workunit.client.1.smithi133.stdout:0/530: stat l3 0 2024-02-15T18:27:10.580 INFO:tasks.workunit.client.0.smithi084.stdout:7/792: rename df/d1d/d1a/d6a/d8b/d7f to df/d1d/d1a/d4d/d103 0 2024-02-15T18:27:10.581 INFO:tasks.workunit.client.1.smithi133.stdout:5/390: mkdir d17/d20/d32/d7d 0 2024-02-15T18:27:10.581 INFO:tasks.workunit.client.1.smithi133.stdout:3/516: mknod d0/d15/d2f/d9b/d9d/ca4 0 2024-02-15T18:27:10.581 INFO:tasks.workunit.client.1.smithi133.stdout:0/531: rmdir d9/d10/d47/d5e 39 2024-02-15T18:27:10.582 INFO:tasks.workunit.client.0.smithi084.stdout:4/858: rmdir d2/d2b/d47 39 2024-02-15T18:27:10.582 INFO:tasks.workunit.client.0.smithi084.stdout:4/859: write d2/d4/d25/d66/fd4 [647640,24356] 0 2024-02-15T18:27:10.582 INFO:tasks.workunit.client.0.smithi084.stdout:7/793: dread df/d1d/d1a/d4d/d103/fb1 [0,4194304] 0 2024-02-15T18:27:10.582 INFO:tasks.workunit.client.0.smithi084.stdout:4/860: write d2/d4/d28/d3d/d5c/dbc/d88/db0/fc5 [772686,83573] 0 2024-02-15T18:27:10.583 INFO:tasks.workunit.client.0.smithi084.stdout:7/794: truncate df/f35 2501903 0 2024-02-15T18:27:10.583 INFO:tasks.workunit.client.0.smithi084.stdout:1/782: dwrite d9/d54/f99 [0,4194304] 0 2024-02-15T18:27:10.583 INFO:tasks.workunit.client.1.smithi133.stdout:5/391: mkdir d17/d20/d32/d7d/d7e 0 2024-02-15T18:27:10.585 INFO:tasks.workunit.client.1.smithi133.stdout:3/517: rename d0/d15/d2f/d9b/d62/d74/d78/d83 to d0/d15/d54/da5 0 2024-02-15T18:27:10.586 INFO:tasks.workunit.client.1.smithi133.stdout:3/518: write d0/d15/d2f/d9b/d62/f71 [4659823,105122] 0 2024-02-15T18:27:10.586 INFO:tasks.workunit.client.1.smithi133.stdout:3/519: fsync d0/d15/d2f/d9b/f5c 0 2024-02-15T18:27:10.587 INFO:tasks.workunit.client.0.smithi084.stdout:4/861: link d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/la9 d2/d64/d74/de9/lf8 0 2024-02-15T18:27:10.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/795: getdents df/d1d/d1a/d6a/d8b/da5 0 2024-02-15T18:27:10.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/796: readlink df/d1d/d1a/d4d/d55/l68 0 2024-02-15T18:27:10.587 INFO:tasks.workunit.client.0.smithi084.stdout:7/797: write df/d1d/d1a/f64 [611013,62927] 0 2024-02-15T18:27:10.589 INFO:tasks.workunit.client.1.smithi133.stdout:5/392: link d17/f33 d17/d20/d5e/f7f 0 2024-02-15T18:27:10.589 INFO:tasks.workunit.client.0.smithi084.stdout:1/783: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/lfa 0 2024-02-15T18:27:10.589 INFO:tasks.workunit.client.0.smithi084.stdout:1/784: chown d9/d54/d32/df5/ff9 7400299 1 2024-02-15T18:27:10.590 INFO:tasks.workunit.client.0.smithi084.stdout:4/862: getdents d2/d2b 0 2024-02-15T18:27:10.591 INFO:tasks.workunit.client.0.smithi084.stdout:7/798: mknod df/d1d/d1a/d6a/c104 0 2024-02-15T18:27:10.592 INFO:tasks.workunit.client.0.smithi084.stdout:7/799: chown c1 163 1 2024-02-15T18:27:10.592 INFO:tasks.workunit.client.0.smithi084.stdout:7/800: chown df/d1d/d44/dbb/df8/l90 352 1 2024-02-15T18:27:10.592 INFO:tasks.workunit.client.0.smithi084.stdout:1/785: creat d9/d54/d7f/db7/dd9/df7/ffb x:0 0 0 2024-02-15T18:27:10.594 INFO:tasks.workunit.client.0.smithi084.stdout:4/863: mknod d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/cf9 0 2024-02-15T18:27:10.594 INFO:tasks.workunit.client.0.smithi084.stdout:4/864: write d2/f11 [722079,16878] 0 2024-02-15T18:27:10.595 INFO:tasks.workunit.client.0.smithi084.stdout:7/801: creat df/d1d/d44/dbb/df8/d98/f105 x:0 0 0 2024-02-15T18:27:10.603 INFO:tasks.workunit.client.0.smithi084.stdout:1/786: getdents d9 0 2024-02-15T18:27:10.603 INFO:tasks.workunit.client.0.smithi084.stdout:4/865: rename d2/d4/c87 to d2/d64/d74/de9/cfa 0 2024-02-15T18:27:10.603 INFO:tasks.workunit.client.0.smithi084.stdout:4/866: stat d2/d4/d28/df2 0 2024-02-15T18:27:10.606 INFO:tasks.workunit.client.0.smithi084.stdout:4/867: truncate d2/d2b/d47/f3c 87890 0 2024-02-15T18:27:10.606 INFO:tasks.workunit.client.0.smithi084.stdout:4/868: stat d2/d4/f5a 0 2024-02-15T18:27:10.609 INFO:tasks.workunit.client.0.smithi084.stdout:4/869: symlink d2/d64/lfb 0 2024-02-15T18:27:10.635 INFO:tasks.workunit.client.0.smithi084.stdout:6/780: dwrite d14/d22/d25/d2f/d31/d3f/f42 [0,4194304] 0 2024-02-15T18:27:10.635 INFO:tasks.workunit.client.0.smithi084.stdout:6/781: chown d14/f17 173 1 2024-02-15T18:27:10.638 INFO:tasks.workunit.client.1.smithi133.stdout:3/520: dwrite d0/d15/d54/f5b [0,4194304] 0 2024-02-15T18:27:10.638 INFO:tasks.workunit.client.1.smithi133.stdout:0/532: dwrite d9/d10/d47/f5a [4194304,4194304] 0 2024-02-15T18:27:10.638 INFO:tasks.workunit.client.1.smithi133.stdout:0/533: read d9/d10/d19/d29/d67/d68/d9c/d95/f99 [4417188,67087] 0 2024-02-15T18:27:10.638 INFO:tasks.workunit.client.0.smithi084.stdout:7/802: dwrite df/d1d/d1a/d6a/d8e/f83 [0,4194304] 0 2024-02-15T18:27:10.639 INFO:tasks.workunit.client.1.smithi133.stdout:5/393: dwrite d17/d2a/f3b [0,4194304] 0 2024-02-15T18:27:10.643 INFO:tasks.workunit.client.1.smithi133.stdout:3/521: rename d0/d15/d2f/d9b/d39/f55 to d0/d15/d37/d4a/fa6 0 2024-02-15T18:27:10.643 INFO:tasks.workunit.client.1.smithi133.stdout:0/534: symlink d9/d10/d85/lb8 0 2024-02-15T18:27:10.646 INFO:tasks.workunit.client.1.smithi133.stdout:5/394: link d17/d20/d32/l5a d17/d20/d32/d7d/d7e/l80 0 2024-02-15T18:27:10.646 INFO:tasks.workunit.client.1.smithi133.stdout:5/395: truncate d17/d20/d32/d38/f48 9069095 0 2024-02-15T18:27:10.647 INFO:tasks.workunit.client.1.smithi133.stdout:0/535: creat d9/d10/d19/d8c/fb9 x:0 0 0 2024-02-15T18:27:10.647 INFO:tasks.workunit.client.1.smithi133.stdout:0/536: fsync d9/f14 0 2024-02-15T18:27:10.648 INFO:tasks.workunit.client.1.smithi133.stdout:5/396: mknod d17/d20/c81 0 2024-02-15T18:27:10.649 INFO:tasks.workunit.client.1.smithi133.stdout:0/537: mknod d9/d10/d22/d2f/d9f/cba 0 2024-02-15T18:27:10.650 INFO:tasks.workunit.client.0.smithi084.stdout:4/870: rmdir d2/d4/d28 39 2024-02-15T18:27:10.650 INFO:tasks.workunit.client.0.smithi084.stdout:4/871: stat d2/d4/d25/d66/fa3 0 2024-02-15T18:27:10.650 INFO:tasks.workunit.client.1.smithi133.stdout:5/397: symlink d17/d20/d4f/d5f/l82 0 2024-02-15T18:27:10.651 INFO:tasks.workunit.client.1.smithi133.stdout:0/538: rmdir d9/d10/d85 39 2024-02-15T18:27:10.651 INFO:tasks.workunit.client.1.smithi133.stdout:5/398: symlink d17/d20/d5e/l83 0 2024-02-15T18:27:10.652 INFO:tasks.workunit.client.1.smithi133.stdout:5/399: read - d17/d20/d32/d38/d70/f7c zero size 2024-02-15T18:27:10.652 INFO:tasks.workunit.client.1.smithi133.stdout:5/400: rmdir d17/d20/d32/d38 39 2024-02-15T18:27:10.653 INFO:tasks.workunit.client.0.smithi084.stdout:4/872: write d2/d4/d25/f51 [3176526,66982] 0 2024-02-15T18:27:10.653 INFO:tasks.workunit.client.0.smithi084.stdout:4/873: readlink d2/d4/d28/d3d/d5c/d65/d9f/lda 0 2024-02-15T18:27:10.653 INFO:tasks.workunit.client.1.smithi133.stdout:0/539: write d9/f75 [2455638,89604] 0 2024-02-15T18:27:10.653 INFO:tasks.workunit.client.1.smithi133.stdout:5/401: creat d17/d20/d32/d7d/d7e/f84 x:0 0 0 2024-02-15T18:27:10.656 INFO:tasks.workunit.client.1.smithi133.stdout:0/540: symlink d9/d10/d19/d29/d67/d68/d9c/da7/lbb 0 2024-02-15T18:27:10.656 INFO:tasks.workunit.client.1.smithi133.stdout:0/541: getdents d9/d10/d47/d5e 0 2024-02-15T18:27:10.656 INFO:tasks.workunit.client.0.smithi084.stdout:4/874: dread d2/d4/d28/f96 [0,4194304] 0 2024-02-15T18:27:10.657 INFO:tasks.workunit.client.1.smithi133.stdout:0/542: write d9/d10/d47/f62 [2871,38726] 0 2024-02-15T18:27:10.658 INFO:tasks.workunit.client.1.smithi133.stdout:0/543: mknod d9/d10/d19/d29/d67/cbc 0 2024-02-15T18:27:10.658 INFO:tasks.workunit.client.1.smithi133.stdout:0/544: read - d9/d10/faa zero size 2024-02-15T18:27:10.658 INFO:tasks.workunit.client.1.smithi133.stdout:0/545: stat d9/d10/d19/d29/d67/f6f 0 2024-02-15T18:27:10.660 INFO:tasks.workunit.client.0.smithi084.stdout:7/803: creat df/d70/f106 x:0 0 0 2024-02-15T18:27:10.660 INFO:tasks.workunit.client.0.smithi084.stdout:7/804: chown df/f3b 107405703 1 2024-02-15T18:27:10.660 INFO:tasks.workunit.client.0.smithi084.stdout:7/805: dread - df/d1d/d44/dbb/df8/d98/ff2 zero size 2024-02-15T18:27:10.660 INFO:tasks.workunit.client.1.smithi133.stdout:0/546: symlink d9/d10/d19/d8c/lbd 0 2024-02-15T18:27:10.661 INFO:tasks.workunit.client.1.smithi133.stdout:0/547: stat d9/d10/d2c/f65 0 2024-02-15T18:27:10.661 INFO:tasks.workunit.client.0.smithi084.stdout:4/875: mknod d2/d64/d74/d8f/dc1/cfc 0 2024-02-15T18:27:10.662 INFO:tasks.workunit.client.0.smithi084.stdout:6/782: symlink d14/d22/d25/d2f/d31/lff 0 2024-02-15T18:27:10.662 INFO:tasks.workunit.client.1.smithi133.stdout:3/522: dwrite d0/d15/d2f/f30 [0,4194304] 0 2024-02-15T18:27:10.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/806: mknod df/d70/c107 0 2024-02-15T18:27:10.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/807: read - df/d1d/d1a/d6a/fe6 zero size 2024-02-15T18:27:10.663 INFO:tasks.workunit.client.1.smithi133.stdout:0/548: rename d9/d10/d19/d29/d67/cbc to d9/d10/d19/d29/d67/d68/d9c/d95/cbe 0 2024-02-15T18:27:10.664 INFO:tasks.workunit.client.0.smithi084.stdout:4/876: symlink d2/d4/d25/lfd 0 2024-02-15T18:27:10.665 INFO:tasks.workunit.client.0.smithi084.stdout:7/808: symlink df/d1d/d1a/d6a/d8b/da5/db6/df5/l108 0 2024-02-15T18:27:10.665 INFO:tasks.workunit.client.0.smithi084.stdout:7/809: chown df/d1d/d1a/d6a/d8b/da5/db6/fcc 11223572 1 2024-02-15T18:27:10.667 INFO:tasks.workunit.client.1.smithi133.stdout:3/523: creat d0/d15/d2f/d9b/d62/d74/fa7 x:0 0 0 2024-02-15T18:27:10.667 INFO:tasks.workunit.client.0.smithi084.stdout:4/877: write d2/f34 [1993524,115581] 0 2024-02-15T18:27:10.667 INFO:tasks.workunit.client.0.smithi084.stdout:7/810: creat df/d1d/d1a/d6a/d8b/da5/db6/df5/f109 x:0 0 0 2024-02-15T18:27:10.667 INFO:tasks.workunit.client.0.smithi084.stdout:7/811: readlink df/d1d/d44/dbb/ld8 0 2024-02-15T18:27:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.673+0000 7f433d7fa700 1 -- 172.21.15.84:0/2275343345 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4330000b90 con 0x7f4340060fb0 2024-02-15T18:27:10.670 INFO:tasks.workunit.client.0.smithi084.stdout:7/812: read df/f63 [2726787,75905] 0 2024-02-15T18:27:10.670 INFO:tasks.workunit.client.0.smithi084.stdout:7/813: fsync df/d1d/d1a/d4d/d55/fa0 0 2024-02-15T18:27:10.670 INFO:tasks.workunit.client.0.smithi084.stdout:7/814: fsync df/d1d/d1a/f28 0 2024-02-15T18:27:10.671 INFO:tasks.workunit.client.1.smithi133.stdout:6/675: sync 2024-02-15T18:27:10.671 INFO:tasks.workunit.client.1.smithi133.stdout:9/418: sync 2024-02-15T18:27:10.671 INFO:tasks.workunit.client.1.smithi133.stdout:6/676: chown d0/d62 8155279 1 2024-02-15T18:27:10.671 INFO:tasks.workunit.client.1.smithi133.stdout:9/419: stat d0/d8/d9/d12/d7f 0 2024-02-15T18:27:10.671 INFO:tasks.workunit.client.1.smithi133.stdout:5/402: dwrite d17/d20/f22 [0,4194304] 0 2024-02-15T18:27:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.676+0000 7f433f7fe700 1 -- 172.21.15.84:0/2275343345 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f4330000b90 con 0x7f4340060fb0 2024-02-15T18:27:10.673 INFO:tasks.workunit.client.1.smithi133.stdout:3/524: rename d0/d15/d2f/l2e to d0/d15/d2f/d9b/d72/la8 0 2024-02-15T18:27:10.673 INFO:tasks.workunit.client.1.smithi133.stdout:5/403: dread d17/f4a [0,4194304] 0 2024-02-15T18:27:10.673 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:27:10.673 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:27:10.673 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:27:10.673 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:27:10.673 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:27:10.673 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:27:10.674 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:27:10.674 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "2/21 daemons upgraded", 2024-02-15T18:27:10.674 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mgr daemons", 2024-02-15T18:27:10.674 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:27:10.674 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:27:10.674 INFO:tasks.workunit.client.0.smithi084.stdout:7/815: rename df/d1d/d1a/d6a/d8b/da5/db6/df4/dff to df/d1d/d44/d8d/d10a 0 2024-02-15T18:27:10.674 INFO:tasks.workunit.client.0.smithi084.stdout:7/816: chown df/d1d/d44/dbb/df8/cba 13626 1 2024-02-15T18:27:10.675 INFO:tasks.workunit.client.1.smithi133.stdout:9/420: rmdir d0/d8/d9/d3c/d6b 0 2024-02-15T18:27:10.675 INFO:tasks.workunit.client.1.smithi133.stdout:9/421: chown d0/d8/d9/d12/f3f 73894 1 2024-02-15T18:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.679+0000 7f433d7fa700 1 -- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4340060fb0 msgr2=0x7f4340063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.679+0000 7f433d7fa700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4340060fb0 0x7f4340063470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4348006fd0 tx=0x7f4348008040).stop 2024-02-15T18:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.679+0000 7f433d7fa700 1 -- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 msgr2=0x7f4358106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.679+0000 7f433d7fa700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 0x7f4358106470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f434c013fb0 tx=0x7f434c009b30).stop 2024-02-15T18:27:10.676 INFO:tasks.workunit.client.0.smithi084.stdout:9/824: sync 2024-02-15T18:27:10.678 INFO:tasks.workunit.client.1.smithi133.stdout:5/404: dread d17/d2a/f31 [0,4194304] 0 2024-02-15T18:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.683+0000 7f433d7fa700 1 -- 172.21.15.84:0/2275343345 shutdown_connections 2024-02-15T18:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.683+0000 7f433d7fa700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4340060fb0 0x7f4340063470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.683+0000 7f433d7fa700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43580f55c0 0x7f4358105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:10.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.683+0000 7f433d7fa700 1 --2- 172.21.15.84:0/2275343345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43580f6860 0x7f4358106470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.683+0000 7f433d7fa700 1 -- 172.21.15.84:0/2275343345 >> 172.21.15.84:0/2275343345 conn(0x7f43580f0d40 msgr2=0x7f43580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.683+0000 7f433d7fa700 1 -- 172.21.15.84:0/2275343345 shutdown_connections 2024-02-15T18:27:10.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:10.683+0000 7f433d7fa700 1 -- 172.21.15.84:0/2275343345 wait complete. 2024-02-15T18:27:10.680 INFO:tasks.workunit.client.0.smithi084.stdout:7/817: unlink df/d1d/d1a/d4b/cde 0 2024-02-15T18:27:10.680 INFO:tasks.workunit.client.0.smithi084.stdout:9/825: rmdir d4/da3 39 2024-02-15T18:27:10.681 INFO:tasks.workunit.client.1.smithi133.stdout:6/677: rename d0/d3b to d0/db/d29/d34/d5d/d40/dde 0 2024-02-15T18:27:10.681 INFO:tasks.workunit.client.1.smithi133.stdout:6/678: chown d0/db/d29/d34/d48/f90 16119786 1 2024-02-15T18:27:10.681 INFO:tasks.workunit.client.1.smithi133.stdout:3/525: rmdir d0/d15/d37 39 2024-02-15T18:27:10.681 INFO:tasks.workunit.client.0.smithi084.stdout:7/818: mknod df/d1d/d44/d8d/c10b 0 2024-02-15T18:27:10.681 INFO:tasks.workunit.client.0.smithi084.stdout:7/819: fdatasync df/d1d/fae 0 2024-02-15T18:27:10.681 INFO:tasks.workunit.client.0.smithi084.stdout:7/820: chown df/d1d/d1a/d4d/d103/lc6 3 1 2024-02-15T18:27:10.682 INFO:tasks.workunit.client.1.smithi133.stdout:6/679: creat d0/db/d29/d34/d5d/d40/dde/fdf x:0 0 0 2024-02-15T18:27:10.683 INFO:tasks.workunit.client.0.smithi084.stdout:7/821: mkdir df/d1d/d1a/d4d/d10c 0 2024-02-15T18:27:10.683 INFO:tasks.workunit.client.1.smithi133.stdout:3/526: mknod d0/d15/d37/ca9 0 2024-02-15T18:27:10.686 INFO:tasks.workunit.client.1.smithi133.stdout:6/680: creat d0/db/d29/d34/d8c/da5/fe0 x:0 0 0 2024-02-15T18:27:10.686 INFO:tasks.workunit.client.1.smithi133.stdout:6/681: truncate d0/db/f82 1195923 0 2024-02-15T18:27:10.687 INFO:tasks.workunit.client.0.smithi084.stdout:7/822: rename df/d1d/d1a/d6a/d8e/f83 to df/d1d/d1a/d6a/d8b/da5/f10d 0 2024-02-15T18:27:10.687 INFO:tasks.workunit.client.0.smithi084.stdout:7/823: write df/d1d/d1a/d4d/d55/fa3 [175764,85268] 0 2024-02-15T18:27:10.687 INFO:tasks.workunit.client.0.smithi084.stdout:7/824: write df/d70/fb0 [967925,94977] 0 2024-02-15T18:27:10.687 INFO:tasks.workunit.client.0.smithi084.stdout:7/825: stat df/d1d/d1a/d4d/d55/l5e 0 2024-02-15T18:27:10.694 INFO:tasks.workunit.client.0.smithi084.stdout:7/826: symlink df/d70/l10e 0 2024-02-15T18:27:10.694 INFO:tasks.workunit.client.0.smithi084.stdout:7/827: stat df/d1d/d44/d8d/f8f 0 2024-02-15T18:27:10.694 INFO:tasks.workunit.client.0.smithi084.stdout:7/828: creat df/d1d/d1a/d6a/d8b/f10f x:0 0 0 2024-02-15T18:27:10.696 INFO:tasks.workunit.client.0.smithi084.stdout:7/829: rmdir df/d1d/d1a/d4d/d55 39 2024-02-15T18:27:10.696 INFO:tasks.workunit.client.0.smithi084.stdout:7/830: fdatasync df/d1d/d1a/d4b/f57 0 2024-02-15T18:27:10.696 INFO:tasks.workunit.client.0.smithi084.stdout:7/831: read - df/d1d/d44/dbb/fc2 zero size 2024-02-15T18:27:10.698 INFO:tasks.workunit.client.1.smithi133.stdout:3/527: truncate d0/d15/d2f/d5e/f76 385520 0 2024-02-15T18:27:10.699 INFO:tasks.workunit.client.0.smithi084.stdout:6/783: dwrite d14/d22/d25/d2f/fc1 [0,4194304] 0 2024-02-15T18:27:10.699 INFO:tasks.workunit.client.1.smithi133.stdout:6/682: mkdir d0/db/d29/d34/d5d/d40/dde/d78/de1 0 2024-02-15T18:27:10.700 INFO:tasks.workunit.client.1.smithi133.stdout:3/528: mknod d0/d15/d37/d4a/caa 0 2024-02-15T18:27:10.701 INFO:tasks.workunit.client.1.smithi133.stdout:6/683: mkdir d0/d5/de2 0 2024-02-15T18:27:10.704 INFO:tasks.workunit.client.1.smithi133.stdout:3/529: write d0/d15/d2f/d9b/d39/f75 [368337,92074] 0 2024-02-15T18:27:10.704 INFO:tasks.workunit.client.1.smithi133.stdout:3/530: chown d0/d15/d2f/d9b/d62/d74 14702114 1 2024-02-15T18:27:10.706 INFO:tasks.workunit.client.1.smithi133.stdout:3/531: creat d0/d15/d2f/d9b/d39/da2/fab x:0 0 0 2024-02-15T18:27:10.706 INFO:tasks.workunit.client.1.smithi133.stdout:3/532: fsync d0/d15/f3b 0 2024-02-15T18:27:10.707 INFO:tasks.workunit.client.1.smithi133.stdout:3/533: mknod d0/d15/d2f/d9b/d39/d3f/d3e/da3/cac 0 2024-02-15T18:27:10.707 INFO:tasks.workunit.client.1.smithi133.stdout:3/534: fdatasync d0/d15/d2f/d5e/f76 0 2024-02-15T18:27:10.709 INFO:tasks.workunit.client.1.smithi133.stdout:0/549: dwrite d9/d10/d22/d32/d7f/fa1 [0,4194304] 0 2024-02-15T18:27:10.710 INFO:tasks.workunit.client.1.smithi133.stdout:3/535: mkdir d0/d15/d2f/dad 0 2024-02-15T18:27:10.710 INFO:tasks.workunit.client.1.smithi133.stdout:3/536: readlink d0/d15/d2f/d9b/d39/d3f/d3e/l42 0 2024-02-15T18:27:10.711 INFO:tasks.workunit.client.1.smithi133.stdout:0/550: creat d9/d10/d19/d29/d67/d68/d9c/da7/fbf x:0 0 0 2024-02-15T18:27:10.711 INFO:tasks.workunit.client.1.smithi133.stdout:0/551: fdatasync d9/ff 0 2024-02-15T18:27:10.712 INFO:tasks.workunit.client.0.smithi084.stdout:7/832: dread df/d1d/d1a/f81 [0,4194304] 0 2024-02-15T18:27:10.712 INFO:tasks.workunit.client.0.smithi084.stdout:7/833: readlink df/d1d/d1a/d4b/l9e 0 2024-02-15T18:27:10.712 INFO:tasks.workunit.client.0.smithi084.stdout:7/834: readlink df/d1d/d1a/d6a/d8e/l89 0 2024-02-15T18:27:10.714 INFO:tasks.workunit.client.0.smithi084.stdout:7/835: dread df/d1d/d44/dbb/df8/ff7 [0,4194304] 0 2024-02-15T18:27:10.714 INFO:tasks.workunit.client.1.smithi133.stdout:3/537: symlink d0/d15/d2f/d9b/d39/d3f/lae 0 2024-02-15T18:27:10.715 INFO:tasks.workunit.client.1.smithi133.stdout:6/684: dread d0/db/d29/d34/d5d/d40/dde/f99 [0,4194304] 0 2024-02-15T18:27:10.715 INFO:tasks.workunit.client.1.smithi133.stdout:6/685: fsync d0/f24 0 2024-02-15T18:27:10.716 INFO:tasks.workunit.client.1.smithi133.stdout:3/538: creat d0/d15/d2f/d9b/d62/faf x:0 0 0 2024-02-15T18:27:10.716 INFO:tasks.workunit.client.0.smithi084.stdout:7/836: rename df/d1d/d1a/d6a/d8b/da5/db6/fcc to df/f110 0 2024-02-15T18:27:10.717 INFO:tasks.workunit.client.1.smithi133.stdout:6/686: link d0/db/d29/d34/fb7 d0/db/d29/d34/d5d/d40/dde/d78/fe3 0 2024-02-15T18:27:10.717 INFO:tasks.workunit.client.1.smithi133.stdout:6/687: readlink d0/db/d29/d34/d8c/lab 0 2024-02-15T18:27:10.719 INFO:tasks.workunit.client.1.smithi133.stdout:3/539: rename d0/d15/d2f/d9b/d39/d3f/c28 to d0/d15/d2f/d9b/d39/d3f/d3e/d89/cb0 0 2024-02-15T18:27:10.719 INFO:tasks.workunit.client.1.smithi133.stdout:3/540: dread - d0/d15/d2f/d9b/f4d zero size 2024-02-15T18:27:10.720 INFO:tasks.workunit.client.1.smithi133.stdout:6/688: mkdir d0/db/d29/d34/d8c/d98/de4 0 2024-02-15T18:27:10.725 INFO:tasks.workunit.client.1.smithi133.stdout:6/689: rename d0/d62/d66/c4e to d0/db/d29/d34/d8c/d98/ce5 0 2024-02-15T18:27:10.725 INFO:tasks.workunit.client.1.smithi133.stdout:6/690: write d0/f24 [5695527,107270] 0 2024-02-15T18:27:10.727 INFO:tasks.workunit.client.1.smithi133.stdout:6/691: getdents d0/db/db6 0 2024-02-15T18:27:10.727 INFO:tasks.workunit.client.1.smithi133.stdout:6/692: read d0/db/d29/d34/d5d/d40/dde/d52/fc6 [40886,93547] 0 2024-02-15T18:27:10.728 INFO:tasks.workunit.client.1.smithi133.stdout:6/693: symlink d0/db/d29/d34/d5d/d40/dde/d52/le6 0 2024-02-15T18:27:10.731 INFO:tasks.workunit.client.0.smithi084.stdout:4/878: dwrite d2/d2b/fd6 [0,4194304] 0 2024-02-15T18:27:10.731 INFO:tasks.workunit.client.0.smithi084.stdout:4/879: stat d2/d64/d74/d8f/dc1/dec 0 2024-02-15T18:27:10.732 INFO:tasks.workunit.client.1.smithi133.stdout:5/405: dwrite d17/d20/d32/f37 [0,4194304] 0 2024-02-15T18:27:10.732 INFO:tasks.workunit.client.1.smithi133.stdout:5/406: chown d17/d20/c5b 170 1 2024-02-15T18:27:10.733 INFO:tasks.workunit.client.0.smithi084.stdout:9/826: dwrite d4/d3d/da5/dc1/ff8 [0,4194304] 0 2024-02-15T18:27:10.734 INFO:tasks.workunit.client.1.smithi133.stdout:5/407: dread ff [0,4194304] 0 2024-02-15T18:27:10.735 INFO:tasks.workunit.client.0.smithi084.stdout:4/880: mknod d2/d4/d25/cfe 0 2024-02-15T18:27:10.735 INFO:tasks.workunit.client.0.smithi084.stdout:4/881: fsync d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/fb1 0 2024-02-15T18:27:10.736 INFO:tasks.workunit.client.0.smithi084.stdout:4/882: rmdir d2/d4/d28/d3d/d5c/dbc 39 2024-02-15T18:27:10.736 INFO:tasks.workunit.client.0.smithi084.stdout:9/827: creat d4/da3/f107 x:0 0 0 2024-02-15T18:27:10.736 INFO:tasks.workunit.client.1.smithi133.stdout:5/408: rename d17/d26/f63 to d17/f85 0 2024-02-15T18:27:10.737 INFO:tasks.workunit.client.0.smithi084.stdout:9/828: creat d4/d2b/d3c/d24/dca/d15/d33/f108 x:0 0 0 2024-02-15T18:27:10.738 INFO:tasks.workunit.client.0.smithi084.stdout:9/829: getdents d4/d2b/d3c/d24/dca/dc6 0 2024-02-15T18:27:10.739 INFO:tasks.workunit.client.1.smithi133.stdout:5/409: mkdir d17/d20/d32/d38/d86 0 2024-02-15T18:27:10.739 INFO:tasks.workunit.client.1.smithi133.stdout:5/410: truncate d17/d20/d32/d7d/d7e/f84 656254 0 2024-02-15T18:27:10.739 INFO:tasks.workunit.client.0.smithi084.stdout:9/830: creat d4/d36/d6f/f109 x:0 0 0 2024-02-15T18:27:10.739 INFO:tasks.workunit.client.0.smithi084.stdout:9/831: dread - d4/d81/fb3 zero size 2024-02-15T18:27:10.741 INFO:tasks.workunit.client.1.smithi133.stdout:5/411: unlink d17/d20/d4f/d5f/c69 0 2024-02-15T18:27:10.741 INFO:tasks.workunit.client.1.smithi133.stdout:5/412: fdatasync f10 0 2024-02-15T18:27:10.741 INFO:tasks.workunit.client.1.smithi133.stdout:9/422: dwrite d0/d8/d10/f11 [0,4194304] 0 2024-02-15T18:27:10.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/832: creat d4/d2b/d3c/d20/f10a x:0 0 0 2024-02-15T18:27:10.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/833: readlink d4/da3/dc3/lfb 0 2024-02-15T18:27:10.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/834: chown d4/d2b/d3c/d24/dca/d15/d4f/c93 3967537 1 2024-02-15T18:27:10.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/835: chown d4/da3/dc3 3530948 1 2024-02-15T18:27:10.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/836: fdatasync d4/d3d/da5/fe4 0 2024-02-15T18:27:10.742 INFO:tasks.workunit.client.0.smithi084.stdout:9/837: mknod d4/da3/db0/c10b 0 2024-02-15T18:27:10.743 INFO:tasks.workunit.client.1.smithi133.stdout:5/413: mkdir d17/d26/d7b/d87 0 2024-02-15T18:27:10.743 INFO:tasks.workunit.client.1.smithi133.stdout:9/423: rename d0/f16 to d0/d8/d9/d12/d4f/f88 0 2024-02-15T18:27:10.743 INFO:tasks.workunit.client.1.smithi133.stdout:9/424: readlink d0/d8/d9/l50 0 2024-02-15T18:27:10.744 INFO:tasks.workunit.client.1.smithi133.stdout:5/414: symlink d17/d20/d32/d7d/l88 0 2024-02-15T18:27:10.745 INFO:tasks.workunit.client.1.smithi133.stdout:9/425: unlink d0/d8/d9/d3c/f5d 0 2024-02-15T18:27:10.745 INFO:tasks.workunit.client.1.smithi133.stdout:9/426: readlink d0/d8/d9/d12/d4f/l60 0 2024-02-15T18:27:10.746 INFO:tasks.workunit.client.1.smithi133.stdout:5/415: creat d17/d26/d7b/f89 x:0 0 0 2024-02-15T18:27:10.746 INFO:tasks.workunit.client.1.smithi133.stdout:5/416: truncate d17/d26/f5d 1579051 0 2024-02-15T18:27:10.746 INFO:tasks.workunit.client.1.smithi133.stdout:9/427: mkdir d0/d8/d9/d12/d82/d89 0 2024-02-15T18:27:10.748 INFO:tasks.workunit.client.1.smithi133.stdout:5/417: creat d17/d2a/f8a x:0 0 0 2024-02-15T18:27:10.748 INFO:tasks.workunit.client.0.smithi084.stdout:6/784: dwrite d14/d22/d25/d28/f77 [0,4194304] 0 2024-02-15T18:27:10.748 INFO:tasks.workunit.client.1.smithi133.stdout:9/428: creat d0/d8/d9/d12/f8a x:0 0 0 2024-02-15T18:27:10.749 INFO:tasks.workunit.client.1.smithi133.stdout:9/429: write d0/d8/d9/f31 [2873908,70429] 0 2024-02-15T18:27:10.750 INFO:tasks.workunit.client.1.smithi133.stdout:5/418: creat d17/d20/d32/d38/f8b x:0 0 0 2024-02-15T18:27:10.750 INFO:tasks.workunit.client.1.smithi133.stdout:5/419: fdatasync d17/d20/d4f/f76 0 2024-02-15T18:27:10.750 INFO:tasks.workunit.client.1.smithi133.stdout:0/552: dwrite d9/d10/d19/d1a/f9d [0,4194304] 0 2024-02-15T18:27:10.750 INFO:tasks.workunit.client.1.smithi133.stdout:3/541: dwrite d0/d15/d37/f90 [0,4194304] 0 2024-02-15T18:27:10.751 INFO:tasks.workunit.client.1.smithi133.stdout:6/694: dwrite d0/db/f25 [0,4194304] 0 2024-02-15T18:27:10.751 INFO:tasks.workunit.client.1.smithi133.stdout:3/542: readlink d0/d15/d2f/l21 0 2024-02-15T18:27:10.751 INFO:tasks.workunit.client.1.smithi133.stdout:3/543: chown d0/d15/d2f/d9b/d62 1029776397 1 2024-02-15T18:27:10.751 INFO:tasks.workunit.client.1.smithi133.stdout:3/544: fsync d0/d15/d37/d4a/f4c 0 2024-02-15T18:27:10.751 INFO:tasks.workunit.client.0.smithi084.stdout:9/838: dread d4/d2b/fe7 [0,4194304] 0 2024-02-15T18:27:10.756 INFO:tasks.workunit.client.1.smithi133.stdout:6/695: dread d0/db/d21/f75 [0,4194304] 0 2024-02-15T18:27:10.762 INFO:tasks.workunit.client.0.smithi084.stdout:7/837: truncate df/d1d/d1a/d4d/d55/fa3 84080 0 2024-02-15T18:27:10.764 INFO:tasks.workunit.client.0.smithi084.stdout:9/839: mknod d4/dc2/def/c10c 0 2024-02-15T18:27:10.765 INFO:tasks.workunit.client.0.smithi084.stdout:7/838: mkdir df/d1d/d1a/dd1/d111 0 2024-02-15T18:27:10.765 INFO:tasks.workunit.client.0.smithi084.stdout:7/839: truncate df/d1d/d1a/fad 423707 0 2024-02-15T18:27:10.765 INFO:tasks.workunit.client.0.smithi084.stdout:7/840: write df/d1d/d1a/d6a/d8e/fd7 [836257,2042] 0 2024-02-15T18:27:10.765 INFO:tasks.workunit.client.1.smithi133.stdout:9/430: dread d0/d8/d9/f41 [0,4194304] 0 2024-02-15T18:27:10.765 INFO:tasks.workunit.client.1.smithi133.stdout:9/431: chown d0/c4e 23 1 2024-02-15T18:27:10.766 INFO:tasks.workunit.client.0.smithi084.stdout:9/840: mkdir d4/da3/d10d 0 2024-02-15T18:27:10.766 INFO:tasks.workunit.client.0.smithi084.stdout:7/841: symlink df/d1d/d1a/d6a/d8b/da5/l112 0 2024-02-15T18:27:10.768 INFO:tasks.workunit.client.0.smithi084.stdout:9/841: write d4/d2b/d3c/d20/d75/fb5 [715243,61101] 0 2024-02-15T18:27:10.768 INFO:tasks.workunit.client.1.smithi133.stdout:0/553: creat d9/d10/d19/d29/d67/d68/d9c/d95/fc0 x:0 0 0 2024-02-15T18:27:10.769 INFO:tasks.workunit.client.1.smithi133.stdout:0/554: dread d9/d10/d19/f63 [0,4194304] 0 2024-02-15T18:27:10.769 INFO:tasks.workunit.client.1.smithi133.stdout:3/545: creat d0/d15/d2f/d9b/d39/d3f/d3e/da3/fb1 x:0 0 0 2024-02-15T18:27:10.769 INFO:tasks.workunit.client.0.smithi084.stdout:7/842: link df/d1d/d1a/fad df/d1d/d1a/d6a/d8e/d79/f113 0 2024-02-15T18:27:10.770 INFO:tasks.workunit.client.1.smithi133.stdout:0/555: symlink d9/d10/d19/d29/d67/d68/d9c/da7/lc1 0 2024-02-15T18:27:10.770 INFO:tasks.workunit.client.1.smithi133.stdout:0/556: chown d9/d10/d22/d2f/d9f/cba 261267 1 2024-02-15T18:27:10.771 INFO:tasks.workunit.client.1.smithi133.stdout:3/546: symlink d0/d15/d2f/d9b/d62/lb2 0 2024-02-15T18:27:10.771 INFO:tasks.workunit.client.1.smithi133.stdout:3/547: truncate d0/d15/d2f/d9b/f45 834279 0 2024-02-15T18:27:10.771 INFO:tasks.workunit.client.1.smithi133.stdout:5/420: dwrite f15 [0,4194304] 0 2024-02-15T18:27:10.772 INFO:tasks.workunit.client.0.smithi084.stdout:7/843: creat df/d1d/d1a/dd1/f114 x:0 0 0 2024-02-15T18:27:10.772 INFO:tasks.workunit.client.1.smithi133.stdout:5/421: mkdir d17/d26/d7b/d87/d8c 0 2024-02-15T18:27:10.774 INFO:tasks.workunit.client.1.smithi133.stdout:0/557: write d9/d10/d47/f5a [6658231,62059] 0 2024-02-15T18:27:10.777 INFO:tasks.workunit.client.0.smithi084.stdout:2/765: sync 2024-02-15T18:27:10.777 INFO:tasks.workunit.client.0.smithi084.stdout:0/785: sync 2024-02-15T18:27:10.777 INFO:tasks.workunit.client.0.smithi084.stdout:3/743: sync 2024-02-15T18:27:10.777 INFO:tasks.workunit.client.0.smithi084.stdout:5/898: sync 2024-02-15T18:27:10.777 INFO:tasks.workunit.client.0.smithi084.stdout:8/794: sync 2024-02-15T18:27:10.777 INFO:tasks.workunit.client.0.smithi084.stdout:2/766: fsync d3/d5/feb 0 2024-02-15T18:27:10.778 INFO:tasks.workunit.client.0.smithi084.stdout:1/787: sync 2024-02-15T18:27:10.779 INFO:tasks.workunit.client.0.smithi084.stdout:5/899: rename d9/d35/d65/l5a to d9/da/d3d/d44/d55/dfe/dac/l128 0 2024-02-15T18:27:10.779 INFO:tasks.workunit.client.0.smithi084.stdout:0/786: dread d0/d2f/faa [0,4194304] 0 2024-02-15T18:27:10.780 INFO:tasks.workunit.client.0.smithi084.stdout:2/767: mkdir d3/d9e/df7 0 2024-02-15T18:27:10.780 INFO:tasks.workunit.client.0.smithi084.stdout:2/768: readlink d3/d5/d53/dca/d91/lc2 0 2024-02-15T18:27:10.780 INFO:tasks.workunit.client.0.smithi084.stdout:1/788: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/dfc 0 2024-02-15T18:27:10.780 INFO:tasks.workunit.client.1.smithi133.stdout:6/696: dwrite d0/db/d21/f3c [0,4194304] 0 2024-02-15T18:27:10.784 INFO:tasks.workunit.client.0.smithi084.stdout:5/900: creat d9/d35/d65/d7f/dd6/d124/f129 x:0 0 0 2024-02-15T18:27:10.784 INFO:tasks.workunit.client.0.smithi084.stdout:2/769: mknod d3/d5e/cf8 0 2024-02-15T18:27:10.784 INFO:tasks.workunit.client.0.smithi084.stdout:2/770: stat d3/d28 0 2024-02-15T18:27:10.784 INFO:tasks.workunit.client.0.smithi084.stdout:2/771: chown d3/d19/c52 191629580 1 2024-02-15T18:27:10.784 INFO:tasks.workunit.client.0.smithi084.stdout:2/772: fdatasync d3/d5/d1a/d1e/d4b/da6/f8c 0 2024-02-15T18:27:10.784 INFO:tasks.workunit.client.0.smithi084.stdout:2/773: chown d3/d28/l8b 1198809 1 2024-02-15T18:27:10.784 INFO:tasks.workunit.client.0.smithi084.stdout:1/789: creat d9/d54/d1b/d2c/d4b/d4c/da9/ffd x:0 0 0 2024-02-15T18:27:10.785 INFO:tasks.workunit.client.1.smithi133.stdout:5/422: dread d17/d20/d32/d38/f48 [4194304,4194304] 0 2024-02-15T18:27:10.787 INFO:tasks.workunit.client.0.smithi084.stdout:9/842: dread d4/d2b/d3c/f22 [0,4194304] 0 2024-02-15T18:27:10.791 INFO:tasks.workunit.client.1.smithi133.stdout:3/548: write d0/d15/d54/f8a [4057981,116357] 0 2024-02-15T18:27:10.791 INFO:tasks.workunit.client.1.smithi133.stdout:3/549: write d0/d15/d2f/d9b/f44 [1368801,61648] 0 2024-02-15T18:27:10.791 INFO:tasks.workunit.client.1.smithi133.stdout:3/550: fdatasync d0/d15/f6d 0 2024-02-15T18:27:10.793 INFO:tasks.workunit.client.1.smithi133.stdout:6/697: mknod d0/db/d29/d34/d5d/d40/dde/d78/ce7 0 2024-02-15T18:27:10.795 INFO:tasks.workunit.client.0.smithi084.stdout:9/843: symlink d4/d2b/d3c/d20/d75/d87/l10e 0 2024-02-15T18:27:10.795 INFO:tasks.workunit.client.0.smithi084.stdout:9/844: chown d4/d2b/d67/cc9 2180277 1 2024-02-15T18:27:10.795 INFO:tasks.workunit.client.0.smithi084.stdout:9/845: fsync d4/da3/f107 0 2024-02-15T18:27:10.795 INFO:tasks.workunit.client.0.smithi084.stdout:2/774: dread d3/d5/d53/fdc [0,4194304] 0 2024-02-15T18:27:10.796 INFO:tasks.workunit.client.0.smithi084.stdout:9/846: fdatasync d4/d2b/d3c/d24/dca/d15/f28 0 2024-02-15T18:27:10.797 INFO:tasks.workunit.client.1.smithi133.stdout:5/423: rename d17/f6e to d17/d20/f8d 0 2024-02-15T18:27:10.798 INFO:tasks.workunit.client.1.smithi133.stdout:3/551: mkdir d0/d15/d2f/d5e/db3 0 2024-02-15T18:27:10.798 INFO:tasks.workunit.client.1.smithi133.stdout:3/552: chown d0/d15/d37/f88 2 1 2024-02-15T18:27:10.798 INFO:tasks.workunit.client.1.smithi133.stdout:3/553: fdatasync d0/d15/d2f/d9b/f58 0 2024-02-15T18:27:10.800 INFO:tasks.workunit.client.0.smithi084.stdout:2/775: mknod d3/d5/d53/dca/d7b/db0/cf9 0 2024-02-15T18:27:10.800 INFO:tasks.workunit.client.0.smithi084.stdout:9/847: getdents d4/d3d 0 2024-02-15T18:27:10.804 INFO:tasks.workunit.client.1.smithi133.stdout:6/698: unlink d0/db/d29/d34/d5d/d40/dde/d67/cb0 0 2024-02-15T18:27:10.804 INFO:tasks.workunit.client.1.smithi133.stdout:6/699: fsync d0/db/d29/d34/d5d/d40/dde/d67/f81 0 2024-02-15T18:27:10.805 INFO:tasks.workunit.client.1.smithi133.stdout:5/424: link d17/d20/d4f/d5f/l82 d17/l8e 0 2024-02-15T18:27:10.807 INFO:tasks.workunit.client.0.smithi084.stdout:2/776: creat d3/d5/ffa x:0 0 0 2024-02-15T18:27:10.808 INFO:tasks.workunit.client.1.smithi133.stdout:6/700: creat d0/db/d29/d34/d5d/d40/dde/d67/d9a/fe8 x:0 0 0 2024-02-15T18:27:10.810 INFO:tasks.workunit.client.1.smithi133.stdout:6/701: read d0/db/d29/d34/d5d/d40/dde/f45 [8132377,6424] 0 2024-02-15T18:27:10.810 INFO:tasks.workunit.client.1.smithi133.stdout:6/702: stat d0/db/f82 0 2024-02-15T18:27:10.814 INFO:tasks.workunit.client.0.smithi084.stdout:9/848: dread d4/d2b/d3c/d20/f52 [0,4194304] 0 2024-02-15T18:27:10.817 INFO:tasks.workunit.client.1.smithi133.stdout:3/554: dread d0/d15/d2f/d9b/d39/f75 [0,4194304] 0 2024-02-15T18:27:10.820 INFO:tasks.workunit.client.1.smithi133.stdout:3/555: truncate d0/d15/d54/f5b 528909 0 2024-02-15T18:27:10.826 INFO:tasks.workunit.client.1.smithi133.stdout:3/556: rename d0/d15/d2f/d9b/d39/d3f/d3e to d0/d15/d2f/db4 0 2024-02-15T18:27:10.828 INFO:tasks.workunit.client.1.smithi133.stdout:3/557: getdents d0/d15/d2f/db4/da3 0 2024-02-15T18:27:10.831 INFO:tasks.workunit.client.1.smithi133.stdout:3/558: rename d0/d15/d2f/d9b/d72/la8 to d0/d15/d2f/d9b/d62/d74/d78/lb5 0 2024-02-15T18:27:10.832 INFO:tasks.workunit.client.1.smithi133.stdout:3/559: mknod d0/d15/d37/d4a/cb6 0 2024-02-15T18:27:10.832 INFO:tasks.workunit.client.1.smithi133.stdout:3/560: fdatasync d0/d15/d2f/d9b/f5c 0 2024-02-15T18:27:10.834 INFO:tasks.workunit.client.1.smithi133.stdout:3/561: creat d0/d15/d37/fb7 x:0 0 0 2024-02-15T18:27:10.839 INFO:tasks.workunit.client.1.smithi133.stdout:3/562: mknod d0/d15/d37/d7b/cb8 0 2024-02-15T18:27:10.839 INFO:tasks.workunit.client.1.smithi133.stdout:3/563: readlink d0/d15/d2f/l21 0 2024-02-15T18:27:10.840 INFO:tasks.workunit.client.1.smithi133.stdout:3/564: readlink d0/d15/d2f/d9b/d62/l91 0 2024-02-15T18:27:10.840 INFO:tasks.workunit.client.1.smithi133.stdout:3/565: chown d0/d15/d2f/db4/da3/fb1 5996213 1 2024-02-15T18:27:10.850 INFO:tasks.workunit.client.0.smithi084.stdout:8/795: dwrite db/dd/d1f/fc4 [0,4194304] 0 2024-02-15T18:27:10.850 INFO:tasks.workunit.client.0.smithi084.stdout:8/796: chown l7 122554 1 2024-02-15T18:27:10.850 INFO:tasks.workunit.client.0.smithi084.stdout:8/797: chown db/d1a/d5e/fa9 1710985 1 2024-02-15T18:27:10.852 INFO:tasks.workunit.client.1.smithi133.stdout:0/558: dwrite d9/d2b/f79 [0,4194304] 0 2024-02-15T18:27:10.852 INFO:tasks.workunit.client.1.smithi133.stdout:0/559: dread - d9/d2b/f60 zero size 2024-02-15T18:27:10.852 INFO:tasks.workunit.client.1.smithi133.stdout:0/560: chown d9/d10/d19/d29/d67/d68/d96 196050477 1 2024-02-15T18:27:10.852 INFO:tasks.workunit.client.1.smithi133.stdout:0/561: write d9/f3e [2141998,106176] 0 2024-02-15T18:27:10.853 INFO:tasks.workunit.client.0.smithi084.stdout:8/798: rename db/d1a/da5/cdb to db/dd/d1f/d7a/da8/dd0/c106 0 2024-02-15T18:27:10.853 INFO:tasks.workunit.client.0.smithi084.stdout:8/799: chown db/daf/db6/fdd 23610 1 2024-02-15T18:27:10.853 INFO:tasks.workunit.client.0.smithi084.stdout:8/800: read - db/d3f/d59/ffd zero size 2024-02-15T18:27:10.853 INFO:tasks.workunit.client.0.smithi084.stdout:8/801: symlink db/dd/d4d/d7e/l107 0 2024-02-15T18:27:10.853 INFO:tasks.workunit.client.0.smithi084.stdout:8/802: chown db/dd/d4d/c52 61031949 1 2024-02-15T18:27:10.854 INFO:tasks.workunit.client.1.smithi133.stdout:0/562: creat d9/d10/d19/d29/d67/d68/fc2 x:0 0 0 2024-02-15T18:27:10.858 INFO:tasks.workunit.client.1.smithi133.stdout:4/364: sync 2024-02-15T18:27:10.858 INFO:tasks.workunit.client.1.smithi133.stdout:1/658: sync 2024-02-15T18:27:10.858 INFO:tasks.workunit.client.1.smithi133.stdout:7/356: sync 2024-02-15T18:27:10.859 INFO:tasks.workunit.client.1.smithi133.stdout:4/365: truncate d2/d5/d2b/d21/d2d/d4f/f53 654768 0 2024-02-15T18:27:10.859 INFO:tasks.workunit.client.1.smithi133.stdout:4/366: chown d2/f23 16143883 1 2024-02-15T18:27:10.859 INFO:tasks.workunit.client.1.smithi133.stdout:1/659: mknod d6/d17/cf4 0 2024-02-15T18:27:10.860 INFO:tasks.workunit.client.1.smithi133.stdout:3/566: dread d0/d15/d2f/d9b/f44 [0,4194304] 0 2024-02-15T18:27:10.860 INFO:tasks.workunit.client.1.smithi133.stdout:7/357: creat d9/db/d55/f7a x:0 0 0 2024-02-15T18:27:10.860 INFO:tasks.workunit.client.1.smithi133.stdout:4/367: truncate d2/d5/d2b/d21/d2d/f56 2643255 0 2024-02-15T18:27:10.861 INFO:tasks.workunit.client.1.smithi133.stdout:1/660: creat d6/d1e/d3a/d75/ff5 x:0 0 0 2024-02-15T18:27:10.863 INFO:tasks.workunit.client.1.smithi133.stdout:3/567: unlink d0/d15/d2f/d9b/d72/f81 0 2024-02-15T18:27:10.863 INFO:tasks.workunit.client.1.smithi133.stdout:3/568: read d0/d15/d37/d4a/fa6 [655970,77277] 0 2024-02-15T18:27:10.863 INFO:tasks.workunit.client.1.smithi133.stdout:1/661: mknod d6/d1e/d41/cf6 0 2024-02-15T18:27:10.865 INFO:tasks.workunit.client.1.smithi133.stdout:3/569: rename d0/d15/d2f/d9b/d62/l91 to d0/d15/d2f/d9b/d62/lb9 0 2024-02-15T18:27:10.865 INFO:tasks.workunit.client.1.smithi133.stdout:3/570: write d0/d15/d37/f88 [1006906,39048] 0 2024-02-15T18:27:10.866 INFO:tasks.workunit.client.1.smithi133.stdout:3/571: chown d0/d15/d2f 0 1 2024-02-15T18:27:10.866 INFO:tasks.workunit.client.1.smithi133.stdout:1/662: truncate d6/fc 401085 0 2024-02-15T18:27:10.866 INFO:tasks.workunit.client.1.smithi133.stdout:3/572: write d0/d15/d2f/d9b/f43 [69216,71788] 0 2024-02-15T18:27:10.866 INFO:tasks.workunit.client.1.smithi133.stdout:3/573: stat d0/lb 0 2024-02-15T18:27:10.866 INFO:tasks.workunit.client.1.smithi133.stdout:3/574: fdatasync d0/fa 0 2024-02-15T18:27:10.866 INFO:tasks.workunit.client.1.smithi133.stdout:3/575: chown d0/d15/d2f/d9b/d62/c84 197840 1 2024-02-15T18:27:10.866 INFO:tasks.workunit.client.1.smithi133.stdout:3/576: dread - d0/d15/d2f/d9b/d62/d74/d78/f7c zero size 2024-02-15T18:27:10.867 INFO:tasks.workunit.client.1.smithi133.stdout:1/663: rename d6/d2a/d59/fad to d6/d1e/d3a/d82/d85/dc7/ff7 0 2024-02-15T18:27:10.867 INFO:tasks.workunit.client.1.smithi133.stdout:1/664: read - d6/d1e/d3a/d75/f84 zero size 2024-02-15T18:27:10.867 INFO:tasks.workunit.client.1.smithi133.stdout:1/665: readlink d6/d1e/d41/d7c/d7e/d7f/db6/lc0 0 2024-02-15T18:27:10.868 INFO:tasks.workunit.client.1.smithi133.stdout:1/666: creat d6/d1e/d3a/d82/ff8 x:0 0 0 2024-02-15T18:27:10.869 INFO:tasks.workunit.client.1.smithi133.stdout:1/667: symlink d6/d1e/d3a/d79/dbd/dbe/lf9 0 2024-02-15T18:27:10.873 INFO:tasks.workunit.client.1.smithi133.stdout:0/563: dread d9/d10/d19/d29/d67/d68/d9c/d95/f99 [0,4194304] 0 2024-02-15T18:27:10.873 INFO:tasks.workunit.client.1.smithi133.stdout:0/564: fdatasync d9/fb 0 2024-02-15T18:27:10.874 INFO:tasks.workunit.client.1.smithi133.stdout:0/565: creat d9/d10/d22/d32/fc3 x:0 0 0 2024-02-15T18:27:10.885 INFO:tasks.workunit.client.0.smithi084.stdout:5/901: dwrite d9/d5b/d7e/db5/fbd [0,4194304] 0 2024-02-15T18:27:10.885 INFO:tasks.workunit.client.0.smithi084.stdout:0/787: dwrite d0/d4/d1b/f42 [0,4194304] 0 2024-02-15T18:27:10.888 INFO:tasks.workunit.client.0.smithi084.stdout:5/902: mkdir d9/da/d12a 0 2024-02-15T18:27:10.891 INFO:tasks.workunit.client.0.smithi084.stdout:0/788: dread d0/d1e/f9f [0,4194304] 0 2024-02-15T18:27:10.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:08.686537+0000 mgr.smithi084.hjmnez (mgr.14596) 24 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 159 MiB/s rd, 331 MiB/s wr, 495 op/s 2024-02-15T18:27:10.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:09.114537+0000 mgr.smithi084.hjmnez (mgr.14596) 25 : audit [DBG] from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:10.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:09.696364+0000 mon.smithi084 (mon.0) 695 : audit [DBG] from='client.? 172.21.15.84:0/272657030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:27:10.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:10.222025+0000 mon.smithi084 (mon.0) 696 : audit [DBG] from='client.? 172.21.15.84:0/927140881' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:27:10.901 INFO:tasks.workunit.client.1.smithi133.stdout:7/358: dwrite d9/d36/d31/f59 [0,4194304] 0 2024-02-15T18:27:10.906 INFO:tasks.workunit.client.0.smithi084.stdout:0/789: dread d0/d2f/d3f/da4/fab [0,4194304] 0 2024-02-15T18:27:10.906 INFO:tasks.workunit.client.0.smithi084.stdout:0/790: chown d0/d25/f67 1 1 2024-02-15T18:27:10.906 INFO:tasks.workunit.client.0.smithi084.stdout:0/791: write d0/d39/fdf [1493472,97658] 0 2024-02-15T18:27:10.908 INFO:tasks.workunit.client.0.smithi084.stdout:0/792: creat d0/d4/d3a/d5c/fec x:0 0 0 2024-02-15T18:27:10.908 INFO:tasks.workunit.client.0.smithi084.stdout:0/793: creat d0/d4/d3a/d82/fed x:0 0 0 2024-02-15T18:27:10.913 INFO:tasks.workunit.client.0.smithi084.stdout:3/744: dwrite d8/f15 [0,4194304] 0 2024-02-15T18:27:10.913 INFO:tasks.workunit.client.1.smithi133.stdout:6/703: dwrite d0/db/f70 [0,4194304] 0 2024-02-15T18:27:10.913 INFO:tasks.workunit.client.1.smithi133.stdout:5/425: dwrite d17/d20/d4f/f76 [0,4194304] 0 2024-02-15T18:27:10.914 INFO:tasks.workunit.client.0.smithi084.stdout:2/777: dwrite d3/d5/d1a/d74/d8e/d96/fa9 [0,4194304] 0 2024-02-15T18:27:10.914 INFO:tasks.workunit.client.0.smithi084.stdout:9/849: dwrite d4/f4d [4194304,4194304] 0 2024-02-15T18:27:10.914 INFO:tasks.workunit.client.0.smithi084.stdout:1/790: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/fc5 [0,4194304] 0 2024-02-15T18:27:10.915 INFO:tasks.workunit.client.0.smithi084.stdout:3/745: symlink d8/d1f/d2d/lfb 0 2024-02-15T18:27:10.915 INFO:tasks.workunit.client.0.smithi084.stdout:3/746: chown d8/d1f/d2d/l66 845 1 2024-02-15T18:27:10.915 INFO:tasks.workunit.client.1.smithi133.stdout:3/577: dwrite d0/d15/d37/f53 [0,4194304] 0 2024-02-15T18:27:10.916 INFO:tasks.workunit.client.1.smithi133.stdout:0/566: dwrite d9/d10/d19/d29/d67/d68/d9c/d95/fc0 [0,4194304] 0 2024-02-15T18:27:10.916 INFO:tasks.workunit.client.0.smithi084.stdout:2/778: truncate d3/d5/d1a/d1e/f58 1337601 0 2024-02-15T18:27:10.917 INFO:tasks.workunit.client.0.smithi084.stdout:9/850: symlink d4/d3d/da5/l10f 0 2024-02-15T18:27:10.920 INFO:tasks.workunit.client.0.smithi084.stdout:1/791: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/cfe 0 2024-02-15T18:27:10.921 INFO:tasks.workunit.client.0.smithi084.stdout:2/779: truncate d3/d5/d53/fb1 2831482 0 2024-02-15T18:27:10.921 INFO:tasks.workunit.client.0.smithi084.stdout:9/851: write d4/f29 [371017,51242] 0 2024-02-15T18:27:10.921 INFO:tasks.workunit.client.0.smithi084.stdout:9/852: read d4/fd6 [736804,101791] 0 2024-02-15T18:27:10.922 INFO:tasks.workunit.client.0.smithi084.stdout:3/747: dread d8/fc [4194304,4194304] 0 2024-02-15T18:27:10.923 INFO:tasks.workunit.client.0.smithi084.stdout:1/792: rename d9/d54/d1b/da7/fef to d9/d54/d1b/d2c/d4b/d4c/d79/d39/fff 0 2024-02-15T18:27:10.927 INFO:tasks.workunit.client.0.smithi084.stdout:5/903: dwrite d9/da/f1b [0,4194304] 0 2024-02-15T18:27:10.928 INFO:tasks.workunit.client.0.smithi084.stdout:3/748: link d8/d73/db9/dca/fe4 d8/d40/d58/d80/d6b/ffc 0 2024-02-15T18:27:10.928 INFO:tasks.workunit.client.0.smithi084.stdout:3/749: readlink d8/d40/d58/d80/d6b/ld0 0 2024-02-15T18:27:10.928 INFO:tasks.workunit.client.0.smithi084.stdout:2/780: symlink d3/lfb 0 2024-02-15T18:27:10.928 INFO:tasks.workunit.client.1.smithi133.stdout:6/704: dread d0/db/f70 [0,4194304] 0 2024-02-15T18:27:10.929 INFO:tasks.workunit.client.0.smithi084.stdout:1/793: mknod d9/d54/d1b/d38/c100 0 2024-02-15T18:27:10.932 INFO:tasks.workunit.client.0.smithi084.stdout:5/904: rename d9/d5b/l66 to d9/d5f/d68/l12b 0 2024-02-15T18:27:10.933 INFO:tasks.workunit.client.1.smithi133.stdout:1/668: rename d6/d1e/d3a/d79/dbd/dbe to d6/d1e/d3a/d79/dfa 0 2024-02-15T18:27:10.935 INFO:tasks.workunit.client.1.smithi133.stdout:3/578: symlink d0/d15/d2f/lba 0 2024-02-15T18:27:10.937 INFO:tasks.workunit.client.0.smithi084.stdout:0/794: truncate d0/d25/f34 406214 0 2024-02-15T18:27:10.939 INFO:tasks.workunit.client.1.smithi133.stdout:3/579: write d0/d15/d2f/d9b/f5c [431972,11328] 0 2024-02-15T18:27:10.940 INFO:tasks.workunit.client.1.smithi133.stdout:6/705: creat d0/db/d29/d34/d5d/dc9/fe9 x:0 0 0 2024-02-15T18:27:10.941 INFO:tasks.workunit.client.0.smithi084.stdout:3/750: creat d8/d73/db9/ffd x:0 0 0 2024-02-15T18:27:10.941 INFO:tasks.workunit.client.0.smithi084.stdout:3/751: chown d8/lf 176954 1 2024-02-15T18:27:10.942 INFO:tasks.workunit.client.0.smithi084.stdout:2/781: creat d3/d5/d53/de9/ffc x:0 0 0 2024-02-15T18:27:10.943 INFO:tasks.workunit.client.0.smithi084.stdout:1/794: creat d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ddc/f101 x:0 0 0 2024-02-15T18:27:10.944 INFO:tasks.workunit.client.1.smithi133.stdout:7/359: rename d9/f46 to d9/da/d48/d5a/f7b 0 2024-02-15T18:27:10.949 INFO:tasks.workunit.client.1.smithi133.stdout:6/706: mkdir d0/db/d29/d34/d5d/d40/dde/d67/d9a/dea 0 2024-02-15T18:27:10.952 INFO:tasks.workunit.client.1.smithi133.stdout:5/426: rename d17/d20/c5b to d17/d20/d32/c8f 0 2024-02-15T18:27:10.953 INFO:tasks.workunit.client.1.smithi133.stdout:4/368: truncate d2/d5/d2b/d21/d2d/f56 2063304 0 2024-02-15T18:27:10.953 INFO:tasks.workunit.client.1.smithi133.stdout:4/369: truncate d2/d5/d2b/fe 796246 0 2024-02-15T18:27:10.953 INFO:tasks.workunit.client.1.smithi133.stdout:7/360: dread d9/da/d48/d5a/f7b [0,4194304] 0 2024-02-15T18:27:10.953 INFO:tasks.workunit.client.1.smithi133.stdout:7/361: fsync d9/db/dc/f28 0 2024-02-15T18:27:10.954 INFO:tasks.workunit.client.0.smithi084.stdout:5/905: creat d9/da/d3d/d44/d55/d70/d84/da1/f12c x:0 0 0 2024-02-15T18:27:10.954 INFO:tasks.workunit.client.0.smithi084.stdout:5/906: write d9/dc6/ff2 [4889533,98892] 0 2024-02-15T18:27:10.954 INFO:tasks.workunit.client.1.smithi133.stdout:6/707: rmdir d0/db/d29/d34/d5d/dda 39 2024-02-15T18:27:10.955 INFO:tasks.workunit.client.1.smithi133.stdout:4/370: write d2/f2a [1130195,79892] 0 2024-02-15T18:27:10.955 INFO:tasks.workunit.client.0.smithi084.stdout:0/795: rmdir d0/d39/dce 0 2024-02-15T18:27:10.955 INFO:tasks.workunit.client.0.smithi084.stdout:0/796: chown d0/d4/d3a/d5c/de2/l24 50 1 2024-02-15T18:27:10.955 INFO:tasks.workunit.client.0.smithi084.stdout:3/752: stat d8/d1f/dbf/c50 0 2024-02-15T18:27:10.955 INFO:tasks.workunit.client.0.smithi084.stdout:3/753: write d8/d40/d43/d71/dd9/ff3 [407163,15259] 0 2024-02-15T18:27:10.956 INFO:tasks.workunit.client.0.smithi084.stdout:3/754: chown d8/d1f/d2d 77993017 1 2024-02-15T18:27:10.956 INFO:tasks.workunit.client.1.smithi133.stdout:4/371: write d2/f2a [909103,43879] 0 2024-02-15T18:27:10.956 INFO:tasks.workunit.client.1.smithi133.stdout:0/567: rename d9/d10/d19/d29/d67/d68/d96/d44/l8b to d9/d10/d47/d5e/lc4 0 2024-02-15T18:27:10.957 INFO:tasks.workunit.client.1.smithi133.stdout:0/568: fdatasync d9/d10/d22/d32/d7f/fa1 0 2024-02-15T18:27:10.957 INFO:tasks.workunit.client.1.smithi133.stdout:0/569: truncate d9/d10/d19/d29/f8f 1440011 0 2024-02-15T18:27:10.957 INFO:tasks.workunit.client.1.smithi133.stdout:0/570: fsync d9/d10/d2c/f7c 0 2024-02-15T18:27:10.957 INFO:tasks.workunit.client.1.smithi133.stdout:5/427: mkdir d17/d20/d4f/d90 0 2024-02-15T18:27:10.957 INFO:tasks.workunit.client.0.smithi084.stdout:2/782: rename d3/d5/feb to d3/d5/d1a/d1e/d4b/da6/d5c/ffd 0 2024-02-15T18:27:10.957 INFO:tasks.workunit.client.0.smithi084.stdout:2/783: truncate d3/d28/f85 4454569 0 2024-02-15T18:27:10.958 INFO:tasks.workunit.client.1.smithi133.stdout:1/669: dwrite d6/d1e/d3a/d82/d85/d67/f87 [0,4194304] 0 2024-02-15T18:27:10.958 INFO:tasks.workunit.client.1.smithi133.stdout:7/362: symlink d9/db/d55/d63/l7c 0 2024-02-15T18:27:10.958 INFO:tasks.workunit.client.1.smithi133.stdout:6/708: rmdir d0/d62/d66 39 2024-02-15T18:27:10.959 INFO:tasks.workunit.client.0.smithi084.stdout:5/907: rmdir d9/da/d3d/d44/d55/d70/dfa 39 2024-02-15T18:27:10.960 INFO:tasks.workunit.client.1.smithi133.stdout:3/580: dread d0/d15/d2f/d9b/f7a [0,4194304] 0 2024-02-15T18:27:10.961 INFO:tasks.workunit.client.0.smithi084.stdout:0/797: mkdir d0/d2f/d4b/dee 0 2024-02-15T18:27:10.961 INFO:tasks.workunit.client.0.smithi084.stdout:3/755: symlink d8/lfe 0 2024-02-15T18:27:10.964 INFO:tasks.workunit.client.1.smithi133.stdout:5/428: link d17/d20/d32/d38/d70/f7c d17/d20/d32/d38/d70/f91 0 2024-02-15T18:27:10.967 INFO:tasks.workunit.client.1.smithi133.stdout:1/670: mkdir d6/d1e/d41/d7c/d7e/d7f/db6/dfb 0 2024-02-15T18:27:10.967 INFO:tasks.workunit.client.1.smithi133.stdout:7/363: creat d9/db/d55/f7d x:0 0 0 2024-02-15T18:27:10.968 INFO:tasks.workunit.client.0.smithi084.stdout:1/795: rename d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f84 to d9/d54/d1b/d2c/d4b/d4c/d79/f102 0 2024-02-15T18:27:10.969 INFO:tasks.workunit.client.0.smithi084.stdout:2/784: truncate d3/d5/dbd/ff0 2612151 0 2024-02-15T18:27:10.971 INFO:tasks.workunit.client.1.smithi133.stdout:2/482: sync 2024-02-15T18:27:10.971 INFO:tasks.workunit.client.1.smithi133.stdout:2/483: truncate d7/db/d67/d7b/f97 880950 0 2024-02-15T18:27:10.971 INFO:tasks.workunit.client.1.smithi133.stdout:6/709: link d0/db/d29/d34/d8c/d98/la8 d0/db/d29/d34/d5d/dc9/leb 0 2024-02-15T18:27:10.971 INFO:tasks.workunit.client.1.smithi133.stdout:3/581: dread d0/d15/d37/f90 [0,4194304] 0 2024-02-15T18:27:10.971 INFO:tasks.workunit.client.1.smithi133.stdout:3/582: readlink d0/d15/d37/d4a/l99 0 2024-02-15T18:27:10.971 INFO:tasks.workunit.client.1.smithi133.stdout:3/583: fsync d0/d15/d2f/db4/f7e 0 2024-02-15T18:27:10.971 INFO:tasks.workunit.client.1.smithi133.stdout:3/584: chown d0/d15/d2f/f30 149 1 2024-02-15T18:27:10.972 INFO:tasks.workunit.client.1.smithi133.stdout:3/585: chown d0/d15/d54/c77 2392 1 2024-02-15T18:27:10.972 INFO:tasks.workunit.client.0.smithi084.stdout:1/796: getdents d9/d54/d1b/da7 0 2024-02-15T18:27:10.973 INFO:tasks.workunit.client.0.smithi084.stdout:2/785: creat d3/d5/ffe x:0 0 0 2024-02-15T18:27:10.973 INFO:tasks.workunit.client.0.smithi084.stdout:2/786: readlink d3/d28/l8b 0 2024-02-15T18:27:10.973 INFO:tasks.workunit.client.1.smithi133.stdout:4/372: rename d2/d5/d2b/d21/l26 to d2/d5/d2b/d21/d2d/d44/d51/d55/d5e/d76/l7f 0 2024-02-15T18:27:10.974 INFO:tasks.workunit.client.0.smithi084.stdout:1/797: write d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ff3 [3362080,98671] 0 2024-02-15T18:27:10.975 INFO:tasks.workunit.client.0.smithi084.stdout:3/756: rename d8/d1f/dbf/l69 to d8/d40/d58/d80/lff 0 2024-02-15T18:27:10.975 INFO:tasks.workunit.client.1.smithi133.stdout:1/671: mknod d6/d1e/d41/d7c/d7e/d7f/db6/cfc 0 2024-02-15T18:27:10.976 INFO:tasks.workunit.client.0.smithi084.stdout:2/787: mknod d3/d5/cff 0 2024-02-15T18:27:10.976 INFO:tasks.workunit.client.0.smithi084.stdout:2/788: chown d3/d5/d1a/d1e/d30/d82/cef 34172711 1 2024-02-15T18:27:10.976 INFO:tasks.workunit.client.1.smithi133.stdout:7/364: creat d9/da/d48/f7e x:0 0 0 2024-02-15T18:27:10.979 INFO:tasks.workunit.client.1.smithi133.stdout:6/710: link d0/db/f82 d0/db/d29/d34/d5d/d40/dde/d85/d8e/fec 0 2024-02-15T18:27:10.979 INFO:tasks.workunit.client.0.smithi084.stdout:2/789: mkdir d3/d5/d53/dca/d89/dec/d100 0 2024-02-15T18:27:10.980 INFO:tasks.workunit.client.1.smithi133.stdout:7/365: write d9/db/f27 [573848,2877] 0 2024-02-15T18:27:10.982 INFO:tasks.workunit.client.1.smithi133.stdout:3/586: mknod d0/d15/d2f/d9b/d72/cbb 0 2024-02-15T18:27:10.982 INFO:tasks.workunit.client.1.smithi133.stdout:3/587: write d0/d15/d37/d4a/f4c [886118,40080] 0 2024-02-15T18:27:10.982 INFO:tasks.workunit.client.0.smithi084.stdout:2/790: read d3/d5/d1a/d1e/d47/f56 [2348264,29454] 0 2024-02-15T18:27:10.983 INFO:tasks.workunit.client.1.smithi133.stdout:4/373: rename d2/d5/d2b/d21/d3b/d49/f4a to d2/d48/d5c/f80 0 2024-02-15T18:27:10.985 INFO:tasks.workunit.client.1.smithi133.stdout:5/429: symlink d17/d20/d32/d38/l92 0 2024-02-15T18:27:10.986 INFO:tasks.workunit.client.1.smithi133.stdout:0/571: dwrite d9/d10/d19/d29/f8f [0,4194304] 0 2024-02-15T18:27:10.987 INFO:tasks.workunit.client.1.smithi133.stdout:1/672: unlink d6/d1e/d3a/d82/d85/d67/ddb/feb 0 2024-02-15T18:27:10.987 INFO:tasks.workunit.client.0.smithi084.stdout:2/791: dread d3/d19/f5b [0,4194304] 0 2024-02-15T18:27:10.989 INFO:tasks.workunit.client.1.smithi133.stdout:3/588: symlink d0/d15/d37/lbc 0 2024-02-15T18:27:10.989 INFO:tasks.workunit.client.1.smithi133.stdout:1/673: read d6/d2a/f48 [2042938,70934] 0 2024-02-15T18:27:10.989 INFO:tasks.workunit.client.1.smithi133.stdout:5/430: mkdir d17/d20/d4f/d5f/d93 0 2024-02-15T18:27:10.990 INFO:tasks.workunit.client.0.smithi084.stdout:2/792: truncate d3/ff 3793357 0 2024-02-15T18:27:10.990 INFO:tasks.workunit.client.0.smithi084.stdout:3/757: dread d8/d1f/d2d/f92 [0,4194304] 0 2024-02-15T18:27:10.990 INFO:tasks.workunit.client.1.smithi133.stdout:4/374: read d2/d5/d2b/d21/d2d/f71 [2994430,26223] 0 2024-02-15T18:27:10.990 INFO:tasks.workunit.client.1.smithi133.stdout:7/366: dread f7 [0,4194304] 0 2024-02-15T18:27:10.991 INFO:tasks.workunit.client.1.smithi133.stdout:0/572: symlink d9/d28/lc5 0 2024-02-15T18:27:10.991 INFO:tasks.workunit.client.0.smithi084.stdout:2/793: unlink d3/d5/d1a/d1e/c46 0 2024-02-15T18:27:10.992 INFO:tasks.workunit.client.1.smithi133.stdout:5/431: creat d17/d2a/f94 x:0 0 0 2024-02-15T18:27:10.992 INFO:tasks.workunit.client.1.smithi133.stdout:4/375: mknod d2/d5/d2b/d21/d2d/c81 0 2024-02-15T18:27:10.993 INFO:tasks.workunit.client.0.smithi084.stdout:4/883: sync 2024-02-15T18:27:10.994 INFO:tasks.workunit.client.1.smithi133.stdout:1/674: write d6/d1e/d3a/d79/dfa/fbf [1934193,110003] 0 2024-02-15T18:27:10.995 INFO:tasks.workunit.client.1.smithi133.stdout:7/367: rename d9/db/d16/l6f to d9/d36/l7f 0 2024-02-15T18:27:10.995 INFO:tasks.workunit.client.1.smithi133.stdout:0/573: mknod d9/d10/d19/d29/d67/d68/d9c/d95/cc6 0 2024-02-15T18:27:10.995 INFO:tasks.workunit.client.1.smithi133.stdout:5/432: link d17/l8e d17/d20/d32/d7d/l95 0 2024-02-15T18:27:10.996 INFO:tasks.workunit.client.1.smithi133.stdout:4/376: symlink d2/d5/d2b/d21/d2d/d44/d51/l82 0 2024-02-15T18:27:10.998 INFO:tasks.workunit.client.1.smithi133.stdout:7/368: symlink d9/db/d55/l80 0 2024-02-15T18:27:10.999 INFO:tasks.workunit.client.1.smithi133.stdout:0/574: symlink d9/d10/d19/d29/d67/d68/d9c/da7/lc7 0 2024-02-15T18:27:11.003 INFO:tasks.workunit.client.0.smithi084.stdout:0/798: dwrite d0/d4/d1b/f40 [0,4194304] 0 2024-02-15T18:27:11.003 INFO:tasks.workunit.client.0.smithi084.stdout:1/798: dwrite d9/d54/d32/df5/ff9 [0,4194304] 0 2024-02-15T18:27:11.003 INFO:tasks.workunit.client.1.smithi133.stdout:5/433: write d17/d2a/f41 [4435237,108352] 0 2024-02-15T18:27:11.003 INFO:tasks.workunit.client.1.smithi133.stdout:5/434: getdents d17/d20/d4f/d5f/d93 0 2024-02-15T18:27:11.003 INFO:tasks.workunit.client.1.smithi133.stdout:2/484: dwrite d7/d18/d32/d65/d54/f83 [0,4194304] 0 2024-02-15T18:27:11.003 INFO:tasks.workunit.client.1.smithi133.stdout:1/675: unlink d6/d2a/d59/cb5 0 2024-02-15T18:27:11.004 INFO:tasks.workunit.client.0.smithi084.stdout:1/799: write d9/d54/d7f/db7/dd9/df7/d89/f96 [1062302,419] 0 2024-02-15T18:27:11.004 INFO:tasks.workunit.client.0.smithi084.stdout:0/799: write d0/d4/d3a/f74 [4439364,28125] 0 2024-02-15T18:27:11.004 INFO:tasks.workunit.client.1.smithi133.stdout:5/435: dread d17/d20/d4f/d5f/f60 [0,4194304] 0 2024-02-15T18:27:11.005 INFO:tasks.workunit.client.1.smithi133.stdout:0/575: unlink d9/d10/d47/d5e/f86 0 2024-02-15T18:27:11.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:08.686537+0000 mgr.smithi084.hjmnez (mgr.14596) 24 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 159 MiB/s rd, 331 MiB/s wr, 495 op/s 2024-02-15T18:27:11.012 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:09.114537+0000 mgr.smithi084.hjmnez (mgr.14596) 25 : audit [DBG] from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:11.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:09.696364+0000 mon.smithi084 (mon.0) 695 : audit [DBG] from='client.? 172.21.15.84:0/272657030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:27:11.013 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:10.222025+0000 mon.smithi084 (mon.0) 696 : audit [DBG] from='client.? 172.21.15.84:0/927140881' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:27:11.014 INFO:tasks.workunit.client.1.smithi133.stdout:2/485: creat d7/d18/d32/d65/d58/f9e x:0 0 0 2024-02-15T18:27:11.014 INFO:tasks.workunit.client.1.smithi133.stdout:2/486: write d7/d2c/d3b/d48/d6d/f78 [740456,107690] 0 2024-02-15T18:27:11.017 INFO:tasks.workunit.client.1.smithi133.stdout:1/676: symlink d6/d89/lfd 0 2024-02-15T18:27:11.017 INFO:tasks.workunit.client.1.smithi133.stdout:5/436: creat d17/d20/d32/d38/f96 x:0 0 0 2024-02-15T18:27:11.020 INFO:tasks.workunit.client.1.smithi133.stdout:2/487: getdents d7/d2c/d3b/d48/d6d 0 2024-02-15T18:27:11.020 INFO:tasks.workunit.client.1.smithi133.stdout:5/437: creat d17/d20/d4f/f97 x:0 0 0 2024-02-15T18:27:11.023 INFO:tasks.workunit.client.1.smithi133.stdout:2/488: rmdir d7/d2c/d46 39 2024-02-15T18:27:11.030 INFO:tasks.workunit.client.1.smithi133.stdout:8/468: sync 2024-02-15T18:27:11.030 INFO:tasks.workunit.client.1.smithi133.stdout:9/432: sync 2024-02-15T18:27:11.030 INFO:tasks.workunit.client.1.smithi133.stdout:8/469: chown d3/d1c/d2f/d87/d73/d84/c8e 3244935 1 2024-02-15T18:27:11.030 INFO:tasks.workunit.client.1.smithi133.stdout:9/433: write d0/d8/d9/f3b [1394106,10932] 0 2024-02-15T18:27:11.031 INFO:tasks.workunit.client.1.smithi133.stdout:5/438: creat d17/d20/d32/d38/d86/f98 x:0 0 0 2024-02-15T18:27:11.032 INFO:tasks.workunit.client.1.smithi133.stdout:1/677: dread d6/d17/f68 [0,4194304] 0 2024-02-15T18:27:11.034 INFO:tasks.workunit.client.1.smithi133.stdout:4/377: rmdir d2/d5/d2b/d21/d2d 39 2024-02-15T18:27:11.034 INFO:tasks.workunit.client.1.smithi133.stdout:4/378: write d2/d5/d2b/d21/d3b/d49/f57 [724423,54359] 0 2024-02-15T18:27:11.038 INFO:tasks.workunit.client.1.smithi133.stdout:8/470: mknod d3/d1c/d2f/c99 0 2024-02-15T18:27:11.038 INFO:tasks.workunit.client.1.smithi133.stdout:8/471: chown d3/d1c/d2f/l7f 2002 1 2024-02-15T18:27:11.038 INFO:tasks.workunit.client.1.smithi133.stdout:5/439: symlink d17/d2a/l99 0 2024-02-15T18:27:11.042 INFO:tasks.workunit.client.1.smithi133.stdout:4/379: creat d2/d5/d2b/d21/d2d/d44/d51/d60/f83 x:0 0 0 2024-02-15T18:27:11.042 INFO:tasks.workunit.client.1.smithi133.stdout:9/434: link d0/l2b d0/d8/d9/d12/d82/l8b 0 2024-02-15T18:27:11.042 INFO:tasks.workunit.client.1.smithi133.stdout:9/435: readlink d0/d8/d10/l67 0 2024-02-15T18:27:11.042 INFO:tasks.workunit.client.1.smithi133.stdout:9/436: stat d0/d8/d9/d12/d4f/c73 0 2024-02-15T18:27:11.043 INFO:tasks.workunit.client.0.smithi084.stdout:2/794: mknod d3/dc6/db5/c101 0 2024-02-15T18:27:11.043 INFO:tasks.workunit.client.0.smithi084.stdout:2/795: readlink d3/l4d 0 2024-02-15T18:27:11.044 INFO:tasks.workunit.client.1.smithi133.stdout:4/380: truncate d2/d5/d2b/d21/f1b 2272030 0 2024-02-15T18:27:11.044 INFO:tasks.workunit.client.1.smithi133.stdout:4/381: write d2/d5/d2b/d21/d2d/f5d [392351,61276] 0 2024-02-15T18:27:11.045 INFO:tasks.workunit.client.0.smithi084.stdout:4/884: creat d2/d4/d28/d3d/dc3/fff x:0 0 0 2024-02-15T18:27:11.045 INFO:tasks.workunit.client.0.smithi084.stdout:4/885: write d2/d64/fee [836682,74653] 0 2024-02-15T18:27:11.045 INFO:tasks.workunit.client.0.smithi084.stdout:4/886: write d2/d64/fee [1245120,53385] 0 2024-02-15T18:27:11.045 INFO:tasks.workunit.client.0.smithi084.stdout:4/887: fsync d2/d4/d25/d66/fd4 0 2024-02-15T18:27:11.045 INFO:tasks.workunit.client.1.smithi133.stdout:4/382: symlink d2/d5/d2b/d21/d2d/l84 0 2024-02-15T18:27:11.048 INFO:tasks.workunit.client.0.smithi084.stdout:1/800: dwrite d9/d54/d32/d5b/d69/fa3 [0,4194304] 0 2024-02-15T18:27:11.050 INFO:tasks.workunit.client.0.smithi084.stdout:3/758: rmdir d8/d40 39 2024-02-15T18:27:11.051 INFO:tasks.workunit.client.1.smithi133.stdout:8/472: dread d3/d1c/f51 [0,4194304] 0 2024-02-15T18:27:11.054 INFO:tasks.workunit.client.0.smithi084.stdout:2/796: read d3/d5/d1a/d74/d8e/d96/fa9 [549418,110701] 0 2024-02-15T18:27:11.055 INFO:tasks.workunit.client.1.smithi133.stdout:8/473: creat d3/de/f9a x:0 0 0 2024-02-15T18:27:11.055 INFO:tasks.workunit.client.1.smithi133.stdout:8/474: read d3/d1c/d2f/d76/f7e [627423,130447] 0 2024-02-15T18:27:11.056 INFO:tasks.workunit.client.0.smithi084.stdout:4/888: creat d2/d64/d74/d8f/dc1/dec/f100 x:0 0 0 2024-02-15T18:27:11.057 INFO:tasks.workunit.client.1.smithi133.stdout:8/475: mkdir d3/d1c/d2f/d87/d9b 0 2024-02-15T18:27:11.057 INFO:tasks.workunit.client.1.smithi133.stdout:8/476: chown d3/d7/d40/l45 3638 1 2024-02-15T18:27:11.057 INFO:tasks.workunit.client.1.smithi133.stdout:8/477: dread - d3/d7/d52/f83 zero size 2024-02-15T18:27:11.057 INFO:tasks.workunit.client.1.smithi133.stdout:8/478: stat d3/d7/f26 0 2024-02-15T18:27:11.058 INFO:tasks.workunit.client.0.smithi084.stdout:1/801: link d9/d54/d7f/db7/dd9/df7/d89/f98 d9/d54/d1b/d2c/d35/f103 0 2024-02-15T18:27:11.058 INFO:tasks.workunit.client.0.smithi084.stdout:1/802: fdatasync d9/d54/d1b/f70 0 2024-02-15T18:27:11.059 INFO:tasks.workunit.client.1.smithi133.stdout:7/369: dwrite d9/f2a [0,4194304] 0 2024-02-15T18:27:11.059 INFO:tasks.workunit.client.1.smithi133.stdout:7/370: chown d9/db/dc/f56 1436046 1 2024-02-15T18:27:11.059 INFO:tasks.workunit.client.1.smithi133.stdout:5/440: dread d17/d2a/f42 [0,4194304] 0 2024-02-15T18:27:11.059 INFO:tasks.workunit.client.1.smithi133.stdout:5/441: getdents d17/d20/d4f/d90 0 2024-02-15T18:27:11.059 INFO:tasks.workunit.client.1.smithi133.stdout:3/589: dwrite d0/d15/d2f/d9b/d39/d3f/f22 [0,4194304] 0 2024-02-15T18:27:11.060 INFO:tasks.workunit.client.0.smithi084.stdout:3/759: creat d8/d40/d43/f100 x:0 0 0 2024-02-15T18:27:11.060 INFO:tasks.workunit.client.0.smithi084.stdout:2/797: mknod d3/dc6/db5/c102 0 2024-02-15T18:27:11.061 INFO:tasks.workunit.client.1.smithi133.stdout:8/479: read d3/d1f/d3f/f74 [1572741,7245] 0 2024-02-15T18:27:11.061 INFO:tasks.workunit.client.1.smithi133.stdout:8/480: write d3/d92/f8d [13593,40612] 0 2024-02-15T18:27:11.061 INFO:tasks.workunit.client.0.smithi084.stdout:4/889: creat d2/d4/d28/d3d/dc3/f101 x:0 0 0 2024-02-15T18:27:11.064 INFO:tasks.workunit.client.0.smithi084.stdout:2/798: link d3/d5/d1a/d1e/d30/l7d d3/d5/d1a/d2d/l103 0 2024-02-15T18:27:11.064 INFO:tasks.workunit.client.0.smithi084.stdout:0/800: dwrite d0/d39/d45/fb7 [0,4194304] 0 2024-02-15T18:27:11.064 INFO:tasks.workunit.client.0.smithi084.stdout:0/801: chown d0/d4/d3a/f74 2600 1 2024-02-15T18:27:11.065 INFO:tasks.workunit.client.1.smithi133.stdout:5/442: write d17/d20/d32/d38/f54 [3403326,61253] 0 2024-02-15T18:27:11.066 INFO:tasks.workunit.client.1.smithi133.stdout:3/590: getdents d0/d15 0 2024-02-15T18:27:11.067 INFO:tasks.workunit.client.1.smithi133.stdout:3/591: fsync d0/d15/d37/f88 0 2024-02-15T18:27:11.067 INFO:tasks.workunit.client.0.smithi084.stdout:3/760: dread d8/d40/d58/d80/f7c [0,4194304] 0 2024-02-15T18:27:11.067 INFO:tasks.workunit.client.0.smithi084.stdout:3/761: readlink d8/d40/lf6 0 2024-02-15T18:27:11.068 INFO:tasks.workunit.client.1.smithi133.stdout:5/443: symlink d17/d26/d7b/d87/l9a 0 2024-02-15T18:27:11.068 INFO:tasks.workunit.client.1.smithi133.stdout:1/678: dwrite d6/fd [0,4194304] 0 2024-02-15T18:27:11.068 INFO:tasks.workunit.client.1.smithi133.stdout:1/679: getdents d6/d1e/d3a/d82/d85/de7 0 2024-02-15T18:27:11.068 INFO:tasks.workunit.client.1.smithi133.stdout:2/489: fdatasync d7/d2c/d3b/d48/d6d/f78 0 2024-02-15T18:27:11.068 INFO:tasks.workunit.client.1.smithi133.stdout:2/490: readlink d7/d2c/d3b/d48/d59/l75 0 2024-02-15T18:27:11.068 INFO:tasks.workunit.client.1.smithi133.stdout:2/491: write d7/d2c/d31/f88 [224974,41885] 0 2024-02-15T18:27:11.068 INFO:tasks.workunit.client.1.smithi133.stdout:1/680: read d6/d1e/d41/d7c/f9c [26080,19283] 0 2024-02-15T18:27:11.070 INFO:tasks.workunit.client.0.smithi084.stdout:2/799: creat d3/d5/d1a/d1e/f104 x:0 0 0 2024-02-15T18:27:11.071 INFO:tasks.workunit.client.0.smithi084.stdout:2/800: chown d3/d5/cff 57155352 1 2024-02-15T18:27:11.071 INFO:tasks.workunit.client.0.smithi084.stdout:2/801: read d3/d5/d53/dca/d91/fb4 [293593,64347] 0 2024-02-15T18:27:11.071 INFO:tasks.workunit.client.0.smithi084.stdout:3/762: truncate d8/d1f/dbf/f54 1350123 0 2024-02-15T18:27:11.073 INFO:tasks.workunit.client.1.smithi133.stdout:5/444: write d17/d20/d32/d38/f48 [6556951,12981] 0 2024-02-15T18:27:11.073 INFO:tasks.workunit.client.1.smithi133.stdout:5/445: fdatasync d17/d26/d7b/f89 0 2024-02-15T18:27:11.075 INFO:tasks.workunit.client.0.smithi084.stdout:2/802: truncate d3/d5/d1a/d1e/d4b/da6/fa3 3536214 0 2024-02-15T18:27:11.075 INFO:tasks.workunit.client.0.smithi084.stdout:0/802: write d0/d4/f54 [3796372,59163] 0 2024-02-15T18:27:11.076 INFO:tasks.workunit.client.1.smithi133.stdout:0/576: dwrite d9/d10/d19/d29/d67/d68/d9c/d95/fc0 [0,4194304] 0 2024-02-15T18:27:11.076 INFO:tasks.workunit.client.1.smithi133.stdout:0/577: chown d9/d10/d2c/l8d 792206261 1 2024-02-15T18:27:11.078 INFO:tasks.workunit.client.0.smithi084.stdout:4/890: dread d2/d4/f5a [0,4194304] 0 2024-02-15T18:27:11.078 INFO:tasks.workunit.client.0.smithi084.stdout:4/891: fsync d2/d4/d28/d3d/da4/fc2 0 2024-02-15T18:27:11.078 INFO:tasks.workunit.client.0.smithi084.stdout:2/803: unlink d3/d5/d1a/d2d/fd8 0 2024-02-15T18:27:11.080 INFO:tasks.workunit.client.0.smithi084.stdout:4/892: mkdir d2/d64/d102 0 2024-02-15T18:27:11.081 INFO:tasks.workunit.client.1.smithi133.stdout:0/578: creat d9/d10/d2c/fc8 x:0 0 0 2024-02-15T18:27:11.084 INFO:tasks.workunit.client.1.smithi133.stdout:0/579: mkdir d9/d10/d85/dc9 0 2024-02-15T18:27:11.091 INFO:tasks.workunit.client.1.smithi133.stdout:8/481: dread d3/d7/d40/d61/f65 [0,4194304] 0 2024-02-15T18:27:11.091 INFO:tasks.workunit.client.1.smithi133.stdout:7/371: write d9/db/d16/f3a [414544,130322] 0 2024-02-15T18:27:11.092 INFO:tasks.workunit.client.1.smithi133.stdout:7/372: write d9/db/d55/f7d [260924,92589] 0 2024-02-15T18:27:11.092 INFO:tasks.workunit.client.1.smithi133.stdout:7/373: dread - d9/d36/f37 zero size 2024-02-15T18:27:11.095 INFO:tasks.workunit.client.1.smithi133.stdout:8/482: symlink d3/l9c 0 2024-02-15T18:27:11.095 INFO:tasks.workunit.client.1.smithi133.stdout:8/483: write d3/d1f/d3f/f85 [524508,59217] 0 2024-02-15T18:27:11.095 INFO:tasks.workunit.client.1.smithi133.stdout:8/484: read d3/d92/f8d [32986,36583] 0 2024-02-15T18:27:11.105 INFO:tasks.workunit.client.1.smithi133.stdout:9/437: dwrite d0/d8/d9/d12/f1b [0,4194304] 0 2024-02-15T18:27:11.106 INFO:tasks.workunit.client.1.smithi133.stdout:9/438: stat d0/d8/l18 0 2024-02-15T18:27:11.106 INFO:tasks.workunit.client.0.smithi084.stdout:5/908: dwrite d9/d5b/d7e/f10c [0,4194304] 0 2024-02-15T18:27:11.106 INFO:tasks.workunit.client.0.smithi084.stdout:5/909: chown d9/d5f/d68/f83 5280 1 2024-02-15T18:27:11.107 INFO:tasks.workunit.client.1.smithi133.stdout:9/439: rmdir d0/d8/d10 39 2024-02-15T18:27:11.109 INFO:tasks.workunit.client.1.smithi133.stdout:9/440: truncate d0/d8/d10/f29 5168313 0 2024-02-15T18:27:11.109 INFO:tasks.workunit.client.1.smithi133.stdout:9/441: write d0/d8/d9/d12/d82/f40 [176965,75636] 0 2024-02-15T18:27:11.109 INFO:tasks.workunit.client.1.smithi133.stdout:9/442: stat d0/d8/d9/d12/f1b 0 2024-02-15T18:27:11.111 INFO:tasks.workunit.client.0.smithi084.stdout:5/910: mkdir d9/d35/d65/d12d 0 2024-02-15T18:27:11.115 INFO:tasks.workunit.client.0.smithi084.stdout:5/911: rmdir d9/d35/d65 39 2024-02-15T18:27:11.116 INFO:tasks.workunit.client.0.smithi084.stdout:5/912: dread d9/d5f/d68/d9a/f9d [0,4194304] 0 2024-02-15T18:27:11.117 INFO:tasks.workunit.client.0.smithi084.stdout:5/913: truncate d9/da/d3d/d44/d55/dfe/f2a 301746 0 2024-02-15T18:27:11.118 INFO:tasks.workunit.client.0.smithi084.stdout:5/914: fsync d9/d35/d65/f56 0 2024-02-15T18:27:11.118 INFO:tasks.workunit.client.0.smithi084.stdout:5/915: dread - d9/d35/f6e zero size 2024-02-15T18:27:11.128 INFO:tasks.workunit.client.1.smithi133.stdout:4/383: dwrite d2/d5/d2b/d21/d2d/f2e [0,4194304] 0 2024-02-15T18:27:11.128 INFO:tasks.workunit.client.1.smithi133.stdout:4/384: chown d2/d5/d2b/d21/d2d/d44/l4e 336 1 2024-02-15T18:27:11.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/385: getdents d2/d5/d2b/d21/d2d/d4f 0 2024-02-15T18:27:11.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/386: fdatasync d2/d5/d2b/d21/d2d/d4f/f53 0 2024-02-15T18:27:11.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/387: fsync d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 0 2024-02-15T18:27:11.133 INFO:tasks.workunit.client.1.smithi133.stdout:4/388: write d2/d5/d2b/f5b [2311098,9588] 0 2024-02-15T18:27:11.137 INFO:tasks.workunit.client.0.smithi084.stdout:6/785: sync 2024-02-15T18:27:11.137 INFO:tasks.workunit.client.0.smithi084.stdout:9/853: sync 2024-02-15T18:27:11.138 INFO:tasks.workunit.client.0.smithi084.stdout:7/844: sync 2024-02-15T18:27:11.138 INFO:tasks.workunit.client.0.smithi084.stdout:8/803: sync 2024-02-15T18:27:11.138 INFO:tasks.workunit.client.0.smithi084.stdout:8/804: write db/d6a/d76/f8e [44425,36414] 0 2024-02-15T18:27:11.138 INFO:tasks.workunit.client.1.smithi133.stdout:3/592: dwrite d0/d15/d2f/f7f [0,4194304] 0 2024-02-15T18:27:11.139 INFO:tasks.workunit.client.0.smithi084.stdout:7/845: mkdir df/d1d/d1a/d4d/d115 0 2024-02-15T18:27:11.139 INFO:tasks.workunit.client.0.smithi084.stdout:9/854: dread d4/d2b/d3c/d24/f68 [0,4194304] 0 2024-02-15T18:27:11.140 INFO:tasks.workunit.client.0.smithi084.stdout:8/805: symlink db/l108 0 2024-02-15T18:27:11.141 INFO:tasks.workunit.client.0.smithi084.stdout:7/846: creat df/d1d/d44/d96/d100/f116 x:0 0 0 2024-02-15T18:27:11.142 INFO:tasks.workunit.client.0.smithi084.stdout:7/847: chown df/d1d/d1a/d6a/d8b/le8 257125 1 2024-02-15T18:27:11.144 INFO:tasks.workunit.client.0.smithi084.stdout:8/806: mkdir db/d1a/d109 0 2024-02-15T18:27:11.144 INFO:tasks.workunit.client.0.smithi084.stdout:6/786: dread d14/d22/d25/d2f/d31/d30/d4f/d7f/f8b [0,4194304] 0 2024-02-15T18:27:11.147 INFO:tasks.workunit.client.0.smithi084.stdout:2/804: rename d3/d5/d1a to d3/d5/d53/dca/d7b/d105 0 2024-02-15T18:27:11.147 INFO:tasks.workunit.client.0.smithi084.stdout:2/805: chown d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/f55 5787 1 2024-02-15T18:27:11.147 INFO:tasks.workunit.client.0.smithi084.stdout:2/806: dread - d3/dc6/fa7 zero size 2024-02-15T18:27:11.147 INFO:tasks.workunit.client.1.smithi133.stdout:4/389: write d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 [1388912,56876] 0 2024-02-15T18:27:11.153 INFO:tasks.workunit.client.0.smithi084.stdout:9/855: dread d4/d2b/d3c/d24/f2a [0,4194304] 0 2024-02-15T18:27:11.153 INFO:tasks.workunit.client.0.smithi084.stdout:9/856: readlink d4/da3/dc3/le3 0 2024-02-15T18:27:11.153 INFO:tasks.workunit.client.0.smithi084.stdout:3/763: dwrite d8/d40/d58/d80/d6b/f85 [0,4194304] 0 2024-02-15T18:27:11.153 INFO:tasks.workunit.client.0.smithi084.stdout:3/764: getdents d8/d40/d43/d71/d8c/d94/da3/dba/de3 0 2024-02-15T18:27:11.153 INFO:tasks.workunit.client.0.smithi084.stdout:8/807: mkdir db/d1a/da5/d10a 0 2024-02-15T18:27:11.154 INFO:tasks.workunit.client.1.smithi133.stdout:4/390: mknod d2/d5/d2b/d21/d3b/d49/d65/c85 0 2024-02-15T18:27:11.156 INFO:tasks.workunit.client.0.smithi084.stdout:4/893: rename d2/d4/d28/d3d/ccb to d2/d64/d74/d8f/c103 0 2024-02-15T18:27:11.156 INFO:tasks.workunit.client.1.smithi133.stdout:1/681: dwrite d6/fd [4194304,4194304] 0 2024-02-15T18:27:11.156 INFO:tasks.workunit.client.1.smithi133.stdout:0/580: dwrite d9/d28/fb6 [0,4194304] 0 2024-02-15T18:27:11.156 INFO:tasks.workunit.client.1.smithi133.stdout:0/581: dread - d9/d10/d19/fad zero size 2024-02-15T18:27:11.157 INFO:tasks.workunit.client.0.smithi084.stdout:4/894: write d2/d64/fee [829080,109177] 0 2024-02-15T18:27:11.157 INFO:tasks.workunit.client.0.smithi084.stdout:2/807: creat d3/d19/dc5/f106 x:0 0 0 2024-02-15T18:27:11.162 INFO:tasks.workunit.client.0.smithi084.stdout:9/857: truncate d4/f6 5793276 0 2024-02-15T18:27:11.163 INFO:tasks.workunit.client.0.smithi084.stdout:8/808: mknod db/dd/d13/d42/d90/c10b 0 2024-02-15T18:27:11.163 INFO:tasks.workunit.client.0.smithi084.stdout:9/858: readlink d4/d36/l7d 0 2024-02-15T18:27:11.163 INFO:tasks.workunit.client.0.smithi084.stdout:3/765: rename d8/fc to d8/d40/d58/d80/dce/f101 0 2024-02-15T18:27:11.163 INFO:tasks.workunit.client.0.smithi084.stdout:3/766: fsync d8/d1f/d25/f7f 0 2024-02-15T18:27:11.163 INFO:tasks.workunit.client.0.smithi084.stdout:2/808: mknod d3/d5/d53/dca/d7b/d105/d2d/c107 0 2024-02-15T18:27:11.163 INFO:tasks.workunit.client.0.smithi084.stdout:2/809: stat d3/d5/d53/dca/d7b/d105/d2d/lb3 0 2024-02-15T18:27:11.163 INFO:tasks.workunit.client.0.smithi084.stdout:2/810: readlink d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/l66 0 2024-02-15T18:27:11.163 INFO:tasks.workunit.client.0.smithi084.stdout:4/895: write d2/d4/d28/d3d/f53 [4705595,41687] 0 2024-02-15T18:27:11.164 INFO:tasks.workunit.client.0.smithi084.stdout:8/809: creat db/dd/d13/db9/dea/f10c x:0 0 0 2024-02-15T18:27:11.165 INFO:tasks.workunit.client.0.smithi084.stdout:8/810: readlink db/daf/db6/l100 0 2024-02-15T18:27:11.165 INFO:tasks.workunit.client.0.smithi084.stdout:5/916: dwrite d9/d35/d65/f56 [4194304,4194304] 0 2024-02-15T18:27:11.167 INFO:tasks.workunit.client.0.smithi084.stdout:2/811: truncate d3/d5/d53/dca/d7b/d105/d1e/d47/f56 2268799 0 2024-02-15T18:27:11.169 INFO:tasks.workunit.client.1.smithi133.stdout:0/582: write d9/d2b/f45 [2863034,73092] 0 2024-02-15T18:27:11.170 INFO:tasks.workunit.client.1.smithi133.stdout:1/682: dread d6/d2a/f2f [0,4194304] 0 2024-02-15T18:27:11.170 INFO:tasks.workunit.client.1.smithi133.stdout:0/583: chown d9/ff 697876790 1 2024-02-15T18:27:11.170 INFO:tasks.workunit.client.0.smithi084.stdout:4/896: creat d2/d4/d28/d3d/f104 x:0 0 0 2024-02-15T18:27:11.171 INFO:tasks.workunit.client.1.smithi133.stdout:1/683: read d6/d1e/d3a/d75/fb0 [548601,38235] 0 2024-02-15T18:27:11.171 INFO:tasks.workunit.client.1.smithi133.stdout:1/684: dread - d6/d1e/d3a/d82/d85/d67/fc4 zero size 2024-02-15T18:27:11.172 INFO:tasks.workunit.client.0.smithi084.stdout:5/917: symlink d9/d5f/d68/d9a/l12e 0 2024-02-15T18:27:11.173 INFO:tasks.workunit.client.0.smithi084.stdout:5/918: fsync d9/d35/d65/f69 0 2024-02-15T18:27:11.173 INFO:tasks.workunit.client.1.smithi133.stdout:0/584: getdents d9/d10/d19/d29/d67/d68/d9c/d95 0 2024-02-15T18:27:11.174 INFO:tasks.workunit.client.0.smithi084.stdout:1/803: dwrite d9/d54/d7f/db7/dd9/df7/d89/f96 [0,4194304] 0 2024-02-15T18:27:11.176 INFO:tasks.workunit.client.0.smithi084.stdout:4/897: creat d2/d4/d25/d66/f105 x:0 0 0 2024-02-15T18:27:11.178 INFO:tasks.workunit.client.1.smithi133.stdout:7/374: dwrite d9/db/dc/f56 [0,4194304] 0 2024-02-15T18:27:11.178 INFO:tasks.workunit.client.1.smithi133.stdout:7/375: dread - d9/db/d55/f7a zero size 2024-02-15T18:27:11.178 INFO:tasks.workunit.client.0.smithi084.stdout:0/803: dwrite d0/d2f/d3f/d4f/d59/f60 [0,4194304] 0 2024-02-15T18:27:11.179 INFO:tasks.workunit.client.0.smithi084.stdout:5/919: creat d9/dc6/de2/df1/f12f x:0 0 0 2024-02-15T18:27:11.179 INFO:tasks.workunit.client.0.smithi084.stdout:5/920: chown d9/da/f1b 137 1 2024-02-15T18:27:11.179 INFO:tasks.workunit.client.0.smithi084.stdout:5/921: dread - d9/d35/d65/d7f/dd6/d124/f129 zero size 2024-02-15T18:27:11.179 INFO:tasks.workunit.client.1.smithi133.stdout:5/446: dwrite d17/d2a/f42 [0,4194304] 0 2024-02-15T18:27:11.181 INFO:tasks.workunit.client.1.smithi133.stdout:7/376: getdents d9/d36/d39 0 2024-02-15T18:27:11.182 INFO:tasks.workunit.client.1.smithi133.stdout:5/447: creat d17/f9b x:0 0 0 2024-02-15T18:27:11.182 INFO:tasks.workunit.client.1.smithi133.stdout:5/448: readlink d17/d20/d32/l78 0 2024-02-15T18:27:11.183 INFO:tasks.workunit.client.0.smithi084.stdout:1/804: rename d9/d54/d1b/d2c/d4b/d4c/d79/ff2 to d9/d54/d1b/d2c/d4b/d4c/d79/db2/f104 0 2024-02-15T18:27:11.183 INFO:tasks.workunit.client.0.smithi084.stdout:4/898: creat d2/d4/d28/d3d/d5c/d5d/f106 x:0 0 0 2024-02-15T18:27:11.184 INFO:tasks.workunit.client.1.smithi133.stdout:7/377: creat d9/da/d48/f81 x:0 0 0 2024-02-15T18:27:11.184 INFO:tasks.workunit.client.1.smithi133.stdout:7/378: chown d9/da/d48/f81 5082670 1 2024-02-15T18:27:11.184 INFO:tasks.workunit.client.1.smithi133.stdout:4/391: write d2/d5/d2b/d21/f1b [1048993,56608] 0 2024-02-15T18:27:11.184 INFO:tasks.workunit.client.1.smithi133.stdout:4/392: read - d2/f72 zero size 2024-02-15T18:27:11.185 INFO:tasks.workunit.client.0.smithi084.stdout:0/804: mknod d0/d39/d45/cef 0 2024-02-15T18:27:11.186 INFO:tasks.workunit.client.0.smithi084.stdout:0/805: unlink d0/d25/f67 0 2024-02-15T18:27:11.186 INFO:tasks.workunit.client.0.smithi084.stdout:0/806: fdatasync d0/d4/d1b/f42 0 2024-02-15T18:27:11.186 INFO:tasks.workunit.client.0.smithi084.stdout:0/807: write d0/d2f/f56 [5019957,89779] 0 2024-02-15T18:27:11.186 INFO:tasks.workunit.client.0.smithi084.stdout:0/808: fsync d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/f9b 0 2024-02-15T18:27:11.187 INFO:tasks.workunit.client.1.smithi133.stdout:0/585: getdents d9/d10/d85 0 2024-02-15T18:27:11.187 INFO:tasks.workunit.client.0.smithi084.stdout:5/922: read d9/da/d3d/d44/d55/d70/fbc [18185,98576] 0 2024-02-15T18:27:11.187 INFO:tasks.workunit.client.0.smithi084.stdout:5/923: chown d9/da/d3d/d44/c4e 1575 1 2024-02-15T18:27:11.187 INFO:tasks.workunit.client.0.smithi084.stdout:5/924: readlink d9/da/d3d/d44/d55/dfe/l39 0 2024-02-15T18:27:11.187 INFO:tasks.workunit.client.0.smithi084.stdout:1/805: dread d9/d54/d1b/d2c/d4b/d4c/d79/f2f [4194304,4194304] 0 2024-02-15T18:27:11.188 INFO:tasks.workunit.client.0.smithi084.stdout:0/809: creat d0/d4/d3a/d5c/de2/d43/d7e/ff0 x:0 0 0 2024-02-15T18:27:11.188 INFO:tasks.workunit.client.1.smithi133.stdout:0/586: write d9/d10/d19/f3d [3749967,71090] 0 2024-02-15T18:27:11.189 INFO:tasks.workunit.client.0.smithi084.stdout:1/806: creat d9/d54/d7f/db7/dd9/df7/f105 x:0 0 0 2024-02-15T18:27:11.189 INFO:tasks.workunit.client.1.smithi133.stdout:5/449: creat d17/d2a/f9c x:0 0 0 2024-02-15T18:27:11.190 INFO:tasks.workunit.client.1.smithi133.stdout:5/450: chown d17/d20/d32/d38/d86 173562 1 2024-02-15T18:27:11.191 INFO:tasks.workunit.client.0.smithi084.stdout:0/810: symlink d0/d4/da8/dc9/lf1 0 2024-02-15T18:27:11.191 INFO:tasks.workunit.client.0.smithi084.stdout:0/811: truncate d0/d4/d3a/d5c/de2/d43/d6d/fb5 1461532 0 2024-02-15T18:27:11.192 INFO:tasks.workunit.client.1.smithi133.stdout:9/443: dwrite d0/d8/d10/f11 [0,4194304] 0 2024-02-15T18:27:11.192 INFO:tasks.workunit.client.1.smithi133.stdout:9/444: chown d0/d8/d9/d12/d82/d42/d79 37928232 1 2024-02-15T18:27:11.192 INFO:tasks.workunit.client.1.smithi133.stdout:9/445: chown d0/d8/d9/d12/d82/l5c 15761978 1 2024-02-15T18:27:11.192 INFO:tasks.workunit.client.1.smithi133.stdout:7/379: rmdir d9/db/d55 39 2024-02-15T18:27:11.192 INFO:tasks.workunit.client.0.smithi084.stdout:0/812: creat d0/d4/da8/ff2 x:0 0 0 2024-02-15T18:27:11.193 INFO:tasks.workunit.client.1.smithi133.stdout:3/593: dwrite d0/d15/f6d [0,4194304] 0 2024-02-15T18:27:11.195 INFO:tasks.workunit.client.0.smithi084.stdout:7/848: dwrite df/d1d/d1a/d6a/d8b/d48/f43 [0,4194304] 0 2024-02-15T18:27:11.197 INFO:tasks.workunit.client.0.smithi084.stdout:0/813: write d0/d2f/d3f/d4f/d61/f70 [2764729,103030] 0 2024-02-15T18:27:11.197 INFO:tasks.workunit.client.0.smithi084.stdout:0/814: chown d0/d4/d3a/d5c/de2/d43/d6d/d71 2675 1 2024-02-15T18:27:11.197 INFO:tasks.workunit.client.0.smithi084.stdout:4/899: dread d2/d4/f55 [0,4194304] 0 2024-02-15T18:27:11.197 INFO:tasks.workunit.client.0.smithi084.stdout:7/849: mknod df/d1d/d1a/dd1/c117 0 2024-02-15T18:27:11.199 INFO:tasks.workunit.client.0.smithi084.stdout:0/815: rename d0/d2f/d3f/f17 to d0/d2f/d3f/d4c/de1/ff3 0 2024-02-15T18:27:11.200 INFO:tasks.workunit.client.0.smithi084.stdout:7/850: symlink df/d1d/d1a/d4b/l118 0 2024-02-15T18:27:11.200 INFO:tasks.workunit.client.0.smithi084.stdout:7/851: fsync f4 0 2024-02-15T18:27:11.201 INFO:tasks.workunit.client.0.smithi084.stdout:6/787: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/fb3 [0,4194304] 0 2024-02-15T18:27:11.203 INFO:tasks.workunit.client.0.smithi084.stdout:0/816: unlink d0/d2f/d3f/d4f/d61/l64 0 2024-02-15T18:27:11.204 INFO:tasks.workunit.client.1.smithi133.stdout:9/446: creat d0/d8/d9/f8c x:0 0 0 2024-02-15T18:27:11.206 INFO:tasks.workunit.client.0.smithi084.stdout:5/925: dread d9/fc8 [0,4194304] 0 2024-02-15T18:27:11.206 INFO:tasks.workunit.client.1.smithi133.stdout:7/380: truncate d9/db/dc/f35 2882282 0 2024-02-15T18:27:11.207 INFO:tasks.workunit.client.0.smithi084.stdout:6/788: symlink d14/d22/d25/d2f/d31/d30/d4f/df1/l100 0 2024-02-15T18:27:11.208 INFO:tasks.workunit.client.1.smithi133.stdout:3/594: symlink d0/d15/d2f/d9b/d72/lbd 0 2024-02-15T18:27:11.208 INFO:tasks.workunit.client.1.smithi133.stdout:3/595: readlink d0/d15/d2f/l32 0 2024-02-15T18:27:11.209 INFO:tasks.workunit.client.0.smithi084.stdout:5/926: creat d9/dc6/f130 x:0 0 0 2024-02-15T18:27:11.212 INFO:tasks.workunit.client.0.smithi084.stdout:6/789: rename d14/d22/d25/d2f/d31/d30/d4f/c58 to d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d94/c101 0 2024-02-15T18:27:11.215 INFO:tasks.workunit.client.0.smithi084.stdout:6/790: creat d14/d22/d25/d2f/d31/d30/d4f/df1/f102 x:0 0 0 2024-02-15T18:27:11.215 INFO:tasks.workunit.client.0.smithi084.stdout:6/791: chown d14/d22/d25/d2f/d31/d3f/d4a/fc5 77919599 1 2024-02-15T18:27:11.216 INFO:tasks.workunit.client.0.smithi084.stdout:6/792: creat d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/f103 x:0 0 0 2024-02-15T18:27:11.217 INFO:tasks.workunit.client.0.smithi084.stdout:9/859: dwrite d4/da3/dc3/de1/f51 [0,4194304] 0 2024-02-15T18:27:11.218 INFO:tasks.workunit.client.0.smithi084.stdout:1/807: write d9/d54/d1b/d2c/d4b/d4c/d79/d39/f23 [533131,53155] 0 2024-02-15T18:27:11.219 INFO:tasks.workunit.client.0.smithi084.stdout:1/808: chown d9/d54/d32/d5b/cb4 10 1 2024-02-15T18:27:11.223 INFO:tasks.workunit.client.0.smithi084.stdout:4/900: dread d2/f39 [0,4194304] 0 2024-02-15T18:27:11.225 INFO:tasks.workunit.client.0.smithi084.stdout:7/852: rmdir df/d1d/d44/d96/d100 39 2024-02-15T18:27:11.225 INFO:tasks.workunit.client.0.smithi084.stdout:7/853: write df/d1d/d44/dbb/df8/d98/f105 [822582,47639] 0 2024-02-15T18:27:11.225 INFO:tasks.workunit.client.0.smithi084.stdout:7/854: fsync df/d1d/d1a/d4d/d103/fd4 0 2024-02-15T18:27:11.225 INFO:tasks.workunit.client.0.smithi084.stdout:6/793: write d14/d22/d25/d2f/da9/f9e [1392649,14085] 0 2024-02-15T18:27:11.225 INFO:tasks.workunit.client.0.smithi084.stdout:6/794: dread - d14/d22/d25/d2f/d31/d30/d4f/fdb zero size 2024-02-15T18:27:11.226 INFO:tasks.workunit.client.1.smithi133.stdout:3/596: write d0/d15/d54/f8a [2164273,123958] 0 2024-02-15T18:27:11.226 INFO:tasks.workunit.client.1.smithi133.stdout:8/485: dwrite d3/d92/f8d [0,4194304] 0 2024-02-15T18:27:11.226 INFO:tasks.workunit.client.1.smithi133.stdout:3/597: fsync d0/d15/d2f/d5e/f76 0 2024-02-15T18:27:11.226 INFO:tasks.workunit.client.1.smithi133.stdout:3/598: chown d0/d15/f3b 0 1 2024-02-15T18:27:11.227 INFO:tasks.workunit.client.0.smithi084.stdout:6/795: creat d14/d22/d25/d2f/d31/d3f/f104 x:0 0 0 2024-02-15T18:27:11.227 INFO:tasks.workunit.client.0.smithi084.stdout:6/796: read - d14/d22/d25/d2f/d31/d3f/fdf zero size 2024-02-15T18:27:11.227 INFO:tasks.workunit.client.0.smithi084.stdout:4/901: dread d2/d4/d28/f96 [0,4194304] 0 2024-02-15T18:27:11.227 INFO:tasks.workunit.client.1.smithi133.stdout:7/381: dread d9/d36/f2e [0,4194304] 0 2024-02-15T18:27:11.229 INFO:tasks.workunit.client.0.smithi084.stdout:4/902: truncate d2/d4/f4f 4389752 0 2024-02-15T18:27:11.231 INFO:tasks.workunit.client.1.smithi133.stdout:3/599: creat d0/d15/d2f/d9b/d39/d3f/fbe x:0 0 0 2024-02-15T18:27:11.231 INFO:tasks.workunit.client.0.smithi084.stdout:4/903: getdents d2/d4/d28/d3d/dc3 0 2024-02-15T18:27:11.233 INFO:tasks.workunit.client.0.smithi084.stdout:4/904: mknod d2/d64/d74/c107 0 2024-02-15T18:27:11.234 INFO:tasks.workunit.client.0.smithi084.stdout:1/809: dread d9/d54/d7f/db7/dd9/d81/f6c [0,4194304] 0 2024-02-15T18:27:11.235 INFO:tasks.workunit.client.0.smithi084.stdout:9/860: dread d4/d2b/d3c/d24/dca/f1c [0,4194304] 0 2024-02-15T18:27:11.236 INFO:tasks.workunit.client.0.smithi084.stdout:1/810: creat d9/d54/d7f/db7/dd9/d81/d94/db9/f106 x:0 0 0 2024-02-15T18:27:11.237 INFO:tasks.workunit.client.1.smithi133.stdout:7/382: write d9/db/f11 [3200649,44635] 0 2024-02-15T18:27:11.240 INFO:tasks.workunit.client.1.smithi133.stdout:8/486: dread d3/f14 [0,4194304] 0 2024-02-15T18:27:11.240 INFO:tasks.workunit.client.1.smithi133.stdout:8/487: dread - d3/d1c/d2f/d87/d73/d84/f98 zero size 2024-02-15T18:27:11.241 INFO:tasks.workunit.client.0.smithi084.stdout:2/812: dwrite d3/d5/d53/dca/d7b/d105/f4e [0,4194304] 0 2024-02-15T18:27:11.241 INFO:tasks.workunit.client.0.smithi084.stdout:7/855: dread df/d1d/d1a/d6a/d8b/d48/f5c [0,4194304] 0 2024-02-15T18:27:11.243 INFO:tasks.workunit.client.1.smithi133.stdout:7/383: dread f7 [0,4194304] 0 2024-02-15T18:27:11.245 INFO:tasks.workunit.client.1.smithi133.stdout:0/587: dwrite d9/d10/d19/f63 [0,4194304] 0 2024-02-15T18:27:11.245 INFO:tasks.workunit.client.1.smithi133.stdout:8/488: mknod d3/d1c/d2f/d87/c9d 0 2024-02-15T18:27:11.245 INFO:tasks.workunit.client.1.smithi133.stdout:8/489: chown d3/d1c/d2f/d87/d73/d84/f98 5456546 1 2024-02-15T18:27:11.245 INFO:tasks.workunit.client.1.smithi133.stdout:8/490: stat d3/d1f/d3f/f8f 0 2024-02-15T18:27:11.251 INFO:tasks.workunit.client.0.smithi084.stdout:1/811: dread d9/d54/d1b/f56 [0,4194304] 0 2024-02-15T18:27:11.251 INFO:tasks.workunit.client.0.smithi084.stdout:8/811: dwrite db/d3f/f54 [0,4194304] 0 2024-02-15T18:27:11.251 INFO:tasks.workunit.client.1.smithi133.stdout:1/685: dwrite d6/f2d [0,4194304] 0 2024-02-15T18:27:11.254 INFO:tasks.workunit.client.1.smithi133.stdout:0/588: unlink d9/c55 0 2024-02-15T18:27:11.254 INFO:tasks.workunit.client.1.smithi133.stdout:8/491: getdents d3/d1c/d2f/d87/d73/d84 0 2024-02-15T18:27:11.255 INFO:tasks.workunit.client.1.smithi133.stdout:9/447: dwrite d0/d8/f48 [0,4194304] 0 2024-02-15T18:27:11.257 INFO:tasks.workunit.client.1.smithi133.stdout:3/600: truncate d0/d15/d2f/d9b/f5c 1804616 0 2024-02-15T18:27:11.258 INFO:tasks.workunit.client.1.smithi133.stdout:7/384: dread d9/db/d16/f49 [0,4194304] 0 2024-02-15T18:27:11.262 INFO:tasks.workunit.client.1.smithi133.stdout:9/448: creat d0/d8/d9/d12/d82/f8d x:0 0 0 2024-02-15T18:27:11.262 INFO:tasks.workunit.client.1.smithi133.stdout:3/601: getdents d0/d15/d2f/d9b/d62/d74 0 2024-02-15T18:27:11.262 INFO:tasks.workunit.client.1.smithi133.stdout:7/385: symlink d9/d36/d39/l82 0 2024-02-15T18:27:11.262 INFO:tasks.workunit.client.1.smithi133.stdout:3/602: chown d0/d15/d2f/d9b/d62/f6f 44783 1 2024-02-15T18:27:11.262 INFO:tasks.workunit.client.1.smithi133.stdout:3/603: stat d0/d15/d2f/d9b/d39/c3d 0 2024-02-15T18:27:11.263 INFO:tasks.workunit.client.1.smithi133.stdout:9/449: write d0/d8/d9/d12/d82/f7c [529348,105756] 0 2024-02-15T18:27:11.266 INFO:tasks.workunit.client.1.smithi133.stdout:9/450: creat d0/d8/d9/d49/f8e x:0 0 0 2024-02-15T18:27:11.268 INFO:tasks.workunit.client.1.smithi133.stdout:7/386: creat d9/db/f83 x:0 0 0 2024-02-15T18:27:11.268 INFO:tasks.workunit.client.0.smithi084.stdout:3/767: dwrite d8/d1f/dbf/fd3 [0,4194304] 0 2024-02-15T18:27:11.269 INFO:tasks.workunit.client.1.smithi133.stdout:3/604: dread d0/f3a [0,4194304] 0 2024-02-15T18:27:11.273 INFO:tasks.workunit.client.1.smithi133.stdout:9/451: write d0/d8/f48 [2775931,11930] 0 2024-02-15T18:27:11.274 INFO:tasks.workunit.client.0.smithi084.stdout:8/812: mknod db/dd/d4d/df1/c10d 0 2024-02-15T18:27:11.278 INFO:tasks.workunit.client.1.smithi133.stdout:9/452: mkdir d0/d8/d9/d12/d7f/d8f 0 2024-02-15T18:27:11.280 INFO:tasks.workunit.client.1.smithi133.stdout:3/605: mkdir d0/d15/d2f/d9b/d72/dbf 0 2024-02-15T18:27:11.280 INFO:tasks.workunit.client.1.smithi133.stdout:3/606: write d0/d15/d37/d95/f9e [36163,10303] 0 2024-02-15T18:27:11.281 INFO:tasks.workunit.client.1.smithi133.stdout:0/589: dread d9/d28/f36 [0,4194304] 0 2024-02-15T18:27:11.281 INFO:tasks.workunit.client.1.smithi133.stdout:9/453: mkdir d0/d8/d9/d12/d82/d42/d79/d90 0 2024-02-15T18:27:11.282 INFO:tasks.workunit.client.0.smithi084.stdout:1/812: creat d9/d54/d7f/db7/dd9/d81/d94/db9/f107 x:0 0 0 2024-02-15T18:27:11.282 INFO:tasks.workunit.client.0.smithi084.stdout:3/768: creat d8/d40/d43/d71/d8c/d94/da3/dba/de3/f102 x:0 0 0 2024-02-15T18:27:11.282 INFO:tasks.workunit.client.0.smithi084.stdout:3/769: fsync d8/d1f/dbf/fe9 0 2024-02-15T18:27:11.283 INFO:tasks.workunit.client.0.smithi084.stdout:8/813: link db/dd/d13/d42/d90/c95 db/dd/d1f/d3e/c10e 0 2024-02-15T18:27:11.283 INFO:tasks.workunit.client.1.smithi133.stdout:0/590: write d9/d28/f36 [1470101,72327] 0 2024-02-15T18:27:11.284 INFO:tasks.workunit.client.1.smithi133.stdout:3/607: unlink d0/d15/d37/d4a/f70 0 2024-02-15T18:27:11.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/454: symlink d0/d8/l91 0 2024-02-15T18:27:11.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/455: write d0/d8/d9/d12/d82/f8d [216266,67834] 0 2024-02-15T18:27:11.286 INFO:tasks.workunit.client.1.smithi133.stdout:0/591: creat d9/d10/d19/d29/d67/d68/d9c/da7/fca x:0 0 0 2024-02-15T18:27:11.287 INFO:tasks.workunit.client.1.smithi133.stdout:9/456: mkdir d0/d8/d10/d4d/d92 0 2024-02-15T18:27:11.287 INFO:tasks.workunit.client.0.smithi084.stdout:8/814: getdents db/d3f/d59/d69 0 2024-02-15T18:27:11.288 INFO:tasks.workunit.client.1.smithi133.stdout:0/592: rename d9/d10/d85/dc9 to d9/d10/dcb 0 2024-02-15T18:27:11.289 INFO:tasks.workunit.client.0.smithi084.stdout:8/815: symlink db/dd/d13/db9/dea/l10f 0 2024-02-15T18:27:11.290 INFO:tasks.workunit.client.0.smithi084.stdout:8/816: mkdir db/dd/d4d/d97/d110 0 2024-02-15T18:27:11.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/457: rename d0/d8/d9/d3c/l5f to d0/d8/d6c/l93 0 2024-02-15T18:27:11.290 INFO:tasks.workunit.client.1.smithi133.stdout:0/593: creat d9/d10/d85/fcc x:0 0 0 2024-02-15T18:27:11.291 INFO:tasks.workunit.client.1.smithi133.stdout:0/594: chown d9/d10/dcb 54719104 1 2024-02-15T18:27:11.291 INFO:tasks.workunit.client.0.smithi084.stdout:8/817: creat db/dd/d1f/d7a/da8/f111 x:0 0 0 2024-02-15T18:27:11.291 INFO:tasks.workunit.client.1.smithi133.stdout:9/458: getdents d0 0 2024-02-15T18:27:11.292 INFO:tasks.workunit.client.1.smithi133.stdout:9/459: symlink d0/d8/d9/d12/d82/d42/d79/l94 0 2024-02-15T18:27:11.292 INFO:tasks.workunit.client.1.smithi133.stdout:9/460: stat d0/d8/d9/d12/d82/d42/l70 0 2024-02-15T18:27:11.293 INFO:tasks.workunit.client.0.smithi084.stdout:8/818: link db/dd/c72 db/dd/d1f/d66/da2/c112 0 2024-02-15T18:27:11.294 INFO:tasks.workunit.client.1.smithi133.stdout:9/461: creat d0/d8/d9/d12/d82/d42/d79/d90/f95 x:0 0 0 2024-02-15T18:27:11.296 INFO:tasks.workunit.client.0.smithi084.stdout:8/819: dread db/d6a/d76/f8e [0,4194304] 0 2024-02-15T18:27:11.296 INFO:tasks.workunit.client.0.smithi084.stdout:8/820: fdatasync db/dd/d13/f101 0 2024-02-15T18:27:11.297 INFO:tasks.workunit.client.1.smithi133.stdout:9/462: unlink d0/d8/d9/d49/d4c/f58 0 2024-02-15T18:27:11.297 INFO:tasks.workunit.client.1.smithi133.stdout:0/595: read d9/fc [7148204,107742] 0 2024-02-15T18:27:11.297 INFO:tasks.workunit.client.0.smithi084.stdout:0/817: dread d0/d2f/f56 [0,4194304] 0 2024-02-15T18:27:11.297 INFO:tasks.workunit.client.0.smithi084.stdout:3/770: write d8/d40/d43/f8b [690184,107962] 0 2024-02-15T18:27:11.298 INFO:tasks.workunit.client.0.smithi084.stdout:3/771: write d8/d40/d43/d71/d8c/d94/da3/de5/fe6 [982947,36280] 0 2024-02-15T18:27:11.298 INFO:tasks.workunit.client.0.smithi084.stdout:5/927: dwrite d9/f28 [4194304,4194304] 0 2024-02-15T18:27:11.301 INFO:tasks.workunit.client.0.smithi084.stdout:0/818: dread d0/d25/f34 [0,4194304] 0 2024-02-15T18:27:11.303 INFO:tasks.workunit.client.0.smithi084.stdout:8/821: write db/d1a/f5f [3463363,88532] 0 2024-02-15T18:27:11.304 INFO:tasks.workunit.client.0.smithi084.stdout:0/819: mkdir d0/d39/d45/df4 0 2024-02-15T18:27:11.304 INFO:tasks.workunit.client.1.smithi133.stdout:0/596: rename d9/d1c/f1d to d9/d10/d19/d29/d67/d68/d96/d44/fcd 0 2024-02-15T18:27:11.304 INFO:tasks.workunit.client.1.smithi133.stdout:0/597: dread - d9/d10/d2c/f91 zero size 2024-02-15T18:27:11.305 INFO:tasks.workunit.client.1.smithi133.stdout:0/598: write d9/d10/d19/d29/d67/d68/d96/d44/f6a [219349,71928] 0 2024-02-15T18:27:11.305 INFO:tasks.workunit.client.1.smithi133.stdout:0/599: chown d9/d10/d22/d32/cb3 893069297 1 2024-02-15T18:27:11.305 INFO:tasks.workunit.client.1.smithi133.stdout:3/608: dread d0/d15/d2f/d9b/d39/f8f [0,4194304] 0 2024-02-15T18:27:11.305 INFO:tasks.workunit.client.1.smithi133.stdout:3/609: stat d0/d15/d37/f88 0 2024-02-15T18:27:11.305 INFO:tasks.workunit.client.1.smithi133.stdout:3/610: fsync d0/d15/f6d 0 2024-02-15T18:27:11.306 INFO:tasks.workunit.client.0.smithi084.stdout:9/861: dwrite d4/d2b/d3c/d24/dca/d15/d33/d7b/fd2 [0,4194304] 0 2024-02-15T18:27:11.306 INFO:tasks.workunit.client.0.smithi084.stdout:9/862: readlink d4/d2b/d3c/d24/dca/l1b 0 2024-02-15T18:27:11.306 INFO:tasks.workunit.client.0.smithi084.stdout:9/863: readlink d4/d2b/d3c/d24/dca/d15/d33/l65 0 2024-02-15T18:27:11.306 INFO:tasks.workunit.client.0.smithi084.stdout:7/856: dwrite df/d1d/d1a/d6a/d8e/f71 [0,4194304] 0 2024-02-15T18:27:11.310 INFO:tasks.workunit.client.0.smithi084.stdout:0/820: symlink d0/d2f/d3f/d4f/d61/de6/lf5 0 2024-02-15T18:27:11.310 INFO:tasks.workunit.client.0.smithi084.stdout:0/821: readlink d0/d2f/d3f/l89 0 2024-02-15T18:27:11.310 INFO:tasks.workunit.client.0.smithi084.stdout:0/822: fdatasync d0/d4/d3a/d5c/de2/d43/d6d/fb5 0 2024-02-15T18:27:11.311 INFO:tasks.workunit.client.0.smithi084.stdout:9/864: read d4/d3d/da5/dc1/ff8 [423208,109733] 0 2024-02-15T18:27:11.311 INFO:tasks.workunit.client.0.smithi084.stdout:9/865: read - d4/d36/d6f/fab zero size 2024-02-15T18:27:11.314 INFO:tasks.workunit.client.0.smithi084.stdout:7/857: rename df/d70/d9c to df/d1d/d1a/d6a/d8e/d79/d119 0 2024-02-15T18:27:11.314 INFO:tasks.workunit.client.0.smithi084.stdout:7/858: fsync df/d1d/d1a/d6a/d8e/fd7 0 2024-02-15T18:27:11.314 INFO:tasks.workunit.client.1.smithi133.stdout:3/611: creat d0/d15/d2f/db4/da3/fc0 x:0 0 0 2024-02-15T18:27:11.315 INFO:tasks.workunit.client.0.smithi084.stdout:9/866: mknod d4/dc2/def/df6/c110 0 2024-02-15T18:27:11.315 INFO:tasks.workunit.client.0.smithi084.stdout:8/822: dread db/f25 [0,4194304] 0 2024-02-15T18:27:11.315 INFO:tasks.workunit.client.1.smithi133.stdout:3/612: read d0/d15/d37/d4a/f4e [673563,4978] 0 2024-02-15T18:27:11.315 INFO:tasks.workunit.client.1.smithi133.stdout:8/492: dwrite d3/f44 [4194304,4194304] 0 2024-02-15T18:27:11.317 INFO:tasks.workunit.client.0.smithi084.stdout:7/859: read f4 [3148772,32414] 0 2024-02-15T18:27:11.318 INFO:tasks.workunit.client.1.smithi133.stdout:1/686: dwrite d6/d17/f1d [0,4194304] 0 2024-02-15T18:27:11.318 INFO:tasks.workunit.client.1.smithi133.stdout:7/387: dwrite d9/db/f83 [0,4194304] 0 2024-02-15T18:27:11.318 INFO:tasks.workunit.client.0.smithi084.stdout:4/905: dwrite d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/faa [4194304,4194304] 0 2024-02-15T18:27:11.318 INFO:tasks.workunit.client.0.smithi084.stdout:2/813: dwrite d3/d5/d53/dca/d91/fe1 [0,4194304] 0 2024-02-15T18:27:11.319 INFO:tasks.workunit.client.0.smithi084.stdout:4/906: write d2/d2b/f54 [846048,31721] 0 2024-02-15T18:27:11.319 INFO:tasks.workunit.client.0.smithi084.stdout:1/813: dwrite d9/d54/d7f/db7/dd9/df7/f105 [0,4194304] 0 2024-02-15T18:27:11.319 INFO:tasks.workunit.client.0.smithi084.stdout:1/814: dread - d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ddc/f101 zero size 2024-02-15T18:27:11.319 INFO:tasks.workunit.client.1.smithi133.stdout:3/613: rename d0/d15/d2f/d9b/d62/d74 to d0/d15/d2f/d9b/d39/d3f/dc1 0 2024-02-15T18:27:11.319 INFO:tasks.workunit.client.1.smithi133.stdout:8/493: mknod d3/de/c9e 0 2024-02-15T18:27:11.320 INFO:tasks.workunit.client.1.smithi133.stdout:8/494: dread - d3/de/f66 zero size 2024-02-15T18:27:11.323 INFO:tasks.workunit.client.1.smithi133.stdout:1/687: creat d6/d1e/d3a/d82/d85/d67/da6/ffe x:0 0 0 2024-02-15T18:27:11.323 INFO:tasks.workunit.client.1.smithi133.stdout:7/388: mkdir d9/db/dc/d84 0 2024-02-15T18:27:11.323 INFO:tasks.workunit.client.1.smithi133.stdout:7/389: dread - d9/db/d16/d5d/d68/f70 zero size 2024-02-15T18:27:11.324 INFO:tasks.workunit.client.0.smithi084.stdout:9/867: rename d4/d2b/d3c/c85 to d4/d2b/d3c/d20/d75/c111 0 2024-02-15T18:27:11.324 INFO:tasks.workunit.client.0.smithi084.stdout:9/868: stat d4/da3/d10d 0 2024-02-15T18:27:11.324 INFO:tasks.workunit.client.0.smithi084.stdout:2/814: write d3/d5/d53/dca/d91/fe1 [3135549,15364] 0 2024-02-15T18:27:11.327 INFO:tasks.workunit.client.0.smithi084.stdout:8/823: unlink db/dd/d4d/df1/cf8 0 2024-02-15T18:27:11.327 INFO:tasks.workunit.client.0.smithi084.stdout:8/824: stat db/dd/d13/d42/c8f 0 2024-02-15T18:27:11.327 INFO:tasks.workunit.client.0.smithi084.stdout:8/825: write db/dd/d1f/d56/f86 [1014504,124120] 0 2024-02-15T18:27:11.334 INFO:tasks.workunit.client.1.smithi133.stdout:8/495: creat d3/d1f/d3f/f9f x:0 0 0 2024-02-15T18:27:11.334 INFO:tasks.workunit.client.1.smithi133.stdout:1/688: mkdir d6/d1e/d3a/d97/dda/dff 0 2024-02-15T18:27:11.338 INFO:tasks.workunit.client.0.smithi084.stdout:1/815: creat d9/d54/d1b/d2c/d4b/ddf/f108 x:0 0 0 2024-02-15T18:27:11.338 INFO:tasks.workunit.client.0.smithi084.stdout:1/816: chown d9/d54/d1b/d2c/d4b/d4c/da9/ffd 143078 1 2024-02-15T18:27:11.341 INFO:tasks.workunit.client.0.smithi084.stdout:2/815: rename d3/d5/d53/dca/d7b/d105/d1e/d47 to d3/d19/d108 0 2024-02-15T18:27:11.341 INFO:tasks.workunit.client.1.smithi133.stdout:7/390: getdents d9/db 0 2024-02-15T18:27:11.342 INFO:tasks.workunit.client.0.smithi084.stdout:8/826: creat db/dd/d13/db9/f113 x:0 0 0 2024-02-15T18:27:11.343 INFO:tasks.workunit.client.1.smithi133.stdout:8/496: mknod d3/d1c/d2f/d87/d73/ca0 0 2024-02-15T18:27:11.343 INFO:tasks.workunit.client.1.smithi133.stdout:8/497: readlink d3/d7/l3d 0 2024-02-15T18:27:11.343 INFO:tasks.workunit.client.0.smithi084.stdout:1/817: symlink d9/d54/d32/d5b/d69/dc7/l109 0 2024-02-15T18:27:11.344 INFO:tasks.workunit.client.1.smithi133.stdout:3/614: dread d0/f2d [0,4194304] 0 2024-02-15T18:27:11.344 INFO:tasks.workunit.client.1.smithi133.stdout:8/498: write d3/f14 [2647648,111749] 0 2024-02-15T18:27:11.344 INFO:tasks.workunit.client.0.smithi084.stdout:2/816: symlink d3/d5/d53/dca/d89/l109 0 2024-02-15T18:27:11.345 INFO:tasks.workunit.client.0.smithi084.stdout:8/827: mkdir db/dd/d13/de0/d114 0 2024-02-15T18:27:11.346 INFO:tasks.workunit.client.0.smithi084.stdout:8/828: mknod db/dd/d4d/c115 0 2024-02-15T18:27:11.346 INFO:tasks.workunit.client.1.smithi133.stdout:1/689: link d6/d17/f18 d6/d89/f100 0 2024-02-15T18:27:11.346 INFO:tasks.workunit.client.1.smithi133.stdout:1/690: dread - d6/d2a/d59/d5a/f6f zero size 2024-02-15T18:27:11.346 INFO:tasks.workunit.client.1.smithi133.stdout:1/691: write d6/d17/fbb [787243,98538] 0 2024-02-15T18:27:11.348 INFO:tasks.workunit.client.1.smithi133.stdout:8/499: mknod d3/d1f/d4f/ca1 0 2024-02-15T18:27:11.348 INFO:tasks.workunit.client.1.smithi133.stdout:8/500: fdatasync d3/d1f/d3f/f85 0 2024-02-15T18:27:11.348 INFO:tasks.workunit.client.1.smithi133.stdout:8/501: dread - d3/d7/d52/f83 zero size 2024-02-15T18:27:11.348 INFO:tasks.workunit.client.1.smithi133.stdout:8/502: chown d3/d1c/l30 35 1 2024-02-15T18:27:11.350 INFO:tasks.workunit.client.0.smithi084.stdout:5/928: dwrite d9/da/f1b [0,4194304] 0 2024-02-15T18:27:11.350 INFO:tasks.workunit.client.1.smithi133.stdout:3/615: dread d0/d15/d2f/d9b/d39/fa1 [0,4194304] 0 2024-02-15T18:27:11.351 INFO:tasks.workunit.client.1.smithi133.stdout:0/600: dwrite d9/d10/d19/d29/d67/fa8 [0,4194304] 0 2024-02-15T18:27:11.351 INFO:tasks.workunit.client.1.smithi133.stdout:1/692: truncate d6/f90 3363940 0 2024-02-15T18:27:11.351 INFO:tasks.workunit.client.1.smithi133.stdout:1/693: chown d6/d1e/d3a/d82/d85/d67/ddb 31282674 1 2024-02-15T18:27:11.352 INFO:tasks.workunit.client.1.smithi133.stdout:1/694: write d6/d1e/d3a/d82/d85/dc7/fca [806839,106897] 0 2024-02-15T18:27:11.352 INFO:tasks.workunit.client.1.smithi133.stdout:1/695: write d6/d1e/d41/d7c/d7e/f94 [4428787,109564] 0 2024-02-15T18:27:11.353 INFO:tasks.workunit.client.1.smithi133.stdout:8/503: rename d3/d7/l2b to d3/de/d3e/d82/d8b/la2 0 2024-02-15T18:27:11.353 INFO:tasks.workunit.client.1.smithi133.stdout:9/463: dwrite d0/d8/d6c/f78 [0,4194304] 0 2024-02-15T18:27:11.355 INFO:tasks.workunit.client.1.smithi133.stdout:3/616: mkdir d0/d15/d37/d95/dc2 0 2024-02-15T18:27:11.357 INFO:tasks.workunit.client.1.smithi133.stdout:7/391: dread d9/db/dc/f56 [0,4194304] 0 2024-02-15T18:27:11.357 INFO:tasks.workunit.client.0.smithi084.stdout:4/907: dwrite d2/f21 [0,4194304] 0 2024-02-15T18:27:11.358 INFO:tasks.workunit.client.0.smithi084.stdout:9/869: dwrite d4/d2b/d3c/d24/dca/d15/d33/d7b/fd2 [4194304,4194304] 0 2024-02-15T18:27:11.368 INFO:tasks.workunit.client.1.smithi133.stdout:1/696: rename d6/d1e/d3a/d82/d85/f39 to d6/d1e/d41/d7c/d7e/f101 0 2024-02-15T18:27:11.368 INFO:tasks.workunit.client.1.smithi133.stdout:1/697: truncate d6/d1e/d3a/d75/f84 60960 0 2024-02-15T18:27:11.369 INFO:tasks.workunit.client.1.smithi133.stdout:1/698: write d6/d89/f100 [1675720,54768] 0 2024-02-15T18:27:11.373 INFO:tasks.workunit.client.1.smithi133.stdout:8/504: mkdir d3/d1f/d4f/da3 0 2024-02-15T18:27:11.373 INFO:tasks.workunit.client.1.smithi133.stdout:8/505: dread - d3/d7/d52/f83 zero size 2024-02-15T18:27:11.373 INFO:tasks.workunit.client.1.smithi133.stdout:3/617: unlink d0/d15/d37/d7b/cb8 0 2024-02-15T18:27:11.373 INFO:tasks.workunit.client.1.smithi133.stdout:1/699: dread d6/d2a/d59/d5a/f71 [0,4194304] 0 2024-02-15T18:27:11.374 INFO:tasks.workunit.client.0.smithi084.stdout:4/908: creat d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4/f108 x:0 0 0 2024-02-15T18:27:11.375 INFO:tasks.workunit.client.0.smithi084.stdout:9/870: creat d4/dc2/f112 x:0 0 0 2024-02-15T18:27:11.377 INFO:tasks.workunit.client.0.smithi084.stdout:4/909: creat d2/d64/da5/f109 x:0 0 0 2024-02-15T18:27:11.378 INFO:tasks.workunit.client.0.smithi084.stdout:4/910: chown d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/ce7 1481808857 1 2024-02-15T18:27:11.378 INFO:tasks.workunit.client.1.smithi133.stdout:8/506: rmdir d3/de/d3e 39 2024-02-15T18:27:11.379 INFO:tasks.workunit.client.0.smithi084.stdout:4/911: mkdir d2/d4/d28/d3d/d5c/d10a 0 2024-02-15T18:27:11.379 INFO:tasks.workunit.client.0.smithi084.stdout:4/912: readlink d2/d64/da5/dae/lbf 0 2024-02-15T18:27:11.380 INFO:tasks.workunit.client.1.smithi133.stdout:3/618: creat d0/d15/d2f/db4/d89/fc3 x:0 0 0 2024-02-15T18:27:11.380 INFO:tasks.workunit.client.1.smithi133.stdout:1/700: rmdir d6/d1e/d41/d7c/d7e/d7f/db6/dfb 0 2024-02-15T18:27:11.380 INFO:tasks.workunit.client.1.smithi133.stdout:1/701: chown d6/l12 315615531 1 2024-02-15T18:27:11.381 INFO:tasks.workunit.client.1.smithi133.stdout:1/702: write d6/d2a/d59/f77 [965765,70426] 0 2024-02-15T18:27:11.381 INFO:tasks.workunit.client.1.smithi133.stdout:1/703: write d6/d2a/d59/f77 [2070501,98815] 0 2024-02-15T18:27:11.381 INFO:tasks.workunit.client.1.smithi133.stdout:1/704: readlink d6/d1e/d3a/d82/d85/d67/da6/lea 0 2024-02-15T18:27:11.381 INFO:tasks.workunit.client.0.smithi084.stdout:4/913: mknod d2/d64/d74/de9/c10b 0 2024-02-15T18:27:11.383 INFO:tasks.workunit.client.0.smithi084.stdout:4/914: write d2/d4/f8 [634792,80544] 0 2024-02-15T18:27:11.383 INFO:tasks.workunit.client.0.smithi084.stdout:4/915: chown d2/d2b/d47/f3c 11712 1 2024-02-15T18:27:11.383 INFO:tasks.workunit.client.0.smithi084.stdout:4/916: fsync d2/d4/d28/f4b 0 2024-02-15T18:27:11.385 INFO:tasks.workunit.client.1.smithi133.stdout:1/705: mkdir d6/d1e/d3a/d82/d85/d102 0 2024-02-15T18:27:11.385 INFO:tasks.workunit.client.1.smithi133.stdout:1/706: write d6/d1e/d3a/d75/fae [5030,126501] 0 2024-02-15T18:27:11.385 INFO:tasks.workunit.client.0.smithi084.stdout:4/917: creat d2/d2b/d47/f10c x:0 0 0 2024-02-15T18:27:11.387 INFO:tasks.workunit.client.1.smithi133.stdout:1/707: creat d6/d1e/d3a/d97/dda/f103 x:0 0 0 2024-02-15T18:27:11.388 INFO:tasks.workunit.client.1.smithi133.stdout:1/708: symlink d6/d1e/d3a/d82/d85/d67/da6/l104 0 2024-02-15T18:27:11.388 INFO:tasks.workunit.client.0.smithi084.stdout:4/918: rename d2/d2b/fac to d2/d64/da5/f10d 0 2024-02-15T18:27:11.389 INFO:tasks.workunit.client.0.smithi084.stdout:4/919: write d2/d4/d28/d3d/d5c/d65/fbd [367555,46581] 0 2024-02-15T18:27:11.389 INFO:tasks.workunit.client.1.smithi133.stdout:1/709: write d6/d17/f1a [1502977,75371] 0 2024-02-15T18:27:11.390 INFO:tasks.workunit.client.1.smithi133.stdout:1/710: write d6/d2a/d59/d5a/f71 [686972,129621] 0 2024-02-15T18:27:11.391 INFO:tasks.workunit.client.1.smithi133.stdout:1/711: read - d6/d1e/d3a/d75/fce zero size 2024-02-15T18:27:11.391 INFO:tasks.workunit.client.0.smithi084.stdout:4/920: unlink d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4/f108 0 2024-02-15T18:27:11.391 INFO:tasks.workunit.client.0.smithi084.stdout:4/921: truncate d2/d2b/d47/d31/fce 998902 0 2024-02-15T18:27:11.392 INFO:tasks.workunit.client.1.smithi133.stdout:1/712: mkdir d6/d1e/d41/d7c/d7e/d7f/db6/ded/d105 0 2024-02-15T18:27:11.392 INFO:tasks.workunit.client.0.smithi084.stdout:4/922: creat d2/d4/d28/d3d/d5c/d5d/f10e x:0 0 0 2024-02-15T18:27:11.392 INFO:tasks.workunit.client.0.smithi084.stdout:4/923: write d2/d4/d28/f38 [4484768,3634] 0 2024-02-15T18:27:11.393 INFO:tasks.workunit.client.0.smithi084.stdout:4/924: chown d2/d4/d28/d3d/da4 12 1 2024-02-15T18:27:11.393 INFO:tasks.workunit.client.1.smithi133.stdout:1/713: creat d6/d1e/d3a/d97/dda/f106 x:0 0 0 2024-02-15T18:27:11.393 INFO:tasks.workunit.client.0.smithi084.stdout:4/925: creat d2/d2b/d47/f10f x:0 0 0 2024-02-15T18:27:11.394 INFO:tasks.workunit.client.1.smithi133.stdout:1/714: link d6/l3d d6/d1e/d3a/d79/d8e/l107 0 2024-02-15T18:27:11.396 INFO:tasks.workunit.client.0.smithi084.stdout:4/926: write d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/faa [7586678,83309] 0 2024-02-15T18:27:11.396 INFO:tasks.workunit.client.0.smithi084.stdout:4/927: write d2/d4/d25/f51 [4776831,86012] 0 2024-02-15T18:27:11.398 INFO:tasks.workunit.client.0.smithi084.stdout:4/928: symlink d2/d64/da5/dae/de1/ded/l110 0 2024-02-15T18:27:11.398 INFO:tasks.workunit.client.0.smithi084.stdout:4/929: dread - d2/d4/d28/d3d/d5c/d5d/f10e zero size 2024-02-15T18:27:11.400 INFO:tasks.workunit.client.1.smithi133.stdout:1/715: write d6/d17/f6e [1030284,43533] 0 2024-02-15T18:27:11.400 INFO:tasks.workunit.client.1.smithi133.stdout:1/716: fdatasync d6/f29 0 2024-02-15T18:27:11.400 INFO:tasks.workunit.client.1.smithi133.stdout:3/619: dread d0/d15/d37/f4b [0,4194304] 0 2024-02-15T18:27:11.401 INFO:tasks.workunit.client.0.smithi084.stdout:4/930: unlink d2/d4/d28/d2e/c36 0 2024-02-15T18:27:11.402 INFO:tasks.workunit.client.1.smithi133.stdout:1/717: mkdir d6/d1e/d41/d7c/d108 0 2024-02-15T18:27:11.402 INFO:tasks.workunit.client.1.smithi133.stdout:1/718: fsync d6/d1e/d3a/d97/fe4 0 2024-02-15T18:27:11.402 INFO:tasks.workunit.client.1.smithi133.stdout:1/719: readlink d6/d1e/l70 0 2024-02-15T18:27:11.402 INFO:tasks.workunit.client.1.smithi133.stdout:1/720: chown d6/d1e/d3a/d82/d85/dc7/fd2 586642 1 2024-02-15T18:27:11.402 INFO:tasks.workunit.client.1.smithi133.stdout:1/721: truncate d6/d2a/d59/d5a/f6f 602494 0 2024-02-15T18:27:11.402 INFO:tasks.workunit.client.1.smithi133.stdout:3/620: mkdir d0/d15/d37/d4a/dc4 0 2024-02-15T18:27:11.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/931: truncate d2/d2b/d47/d31/fa6 842664 0 2024-02-15T18:27:11.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/932: truncate d2/d4/d28/fe5 187478 0 2024-02-15T18:27:11.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/933: fsync d2/d4/d28/d3d/f53 0 2024-02-15T18:27:11.403 INFO:tasks.workunit.client.0.smithi084.stdout:4/934: mknod d2/d64/da5/dae/de1/c111 0 2024-02-15T18:27:11.404 INFO:tasks.workunit.client.0.smithi084.stdout:4/935: write d2/d4/d28/d3d/f90 [3608853,6981] 0 2024-02-15T18:27:11.404 INFO:tasks.workunit.client.1.smithi133.stdout:1/722: link d6/d1e/d3a/d75/fce d6/d1e/d3a/d82/d85/de7/f109 0 2024-02-15T18:27:11.404 INFO:tasks.workunit.client.1.smithi133.stdout:1/723: write d6/d1e/d3a/d82/d85/d67/da6/ff0 [732258,14512] 0 2024-02-15T18:27:11.404 INFO:tasks.workunit.client.1.smithi133.stdout:3/621: mkdir d0/d15/d2f/d9b/dc5 0 2024-02-15T18:27:11.405 INFO:tasks.workunit.client.0.smithi084.stdout:2/817: dwrite d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/f70 [0,4194304] 0 2024-02-15T18:27:11.410 INFO:tasks.workunit.client.1.smithi133.stdout:1/724: write d6/fd [3175992,53268] 0 2024-02-15T18:27:11.413 INFO:tasks.workunit.client.1.smithi133.stdout:1/725: mknod d6/d1e/d3a/d75/c10a 0 2024-02-15T18:27:11.415 INFO:tasks.workunit.client.1.smithi133.stdout:1/726: mkdir d6/d2a/d59/d10b 0 2024-02-15T18:27:11.415 INFO:tasks.workunit.client.0.smithi084.stdout:1/818: dwrite d9/d54/d76/f80 [0,4194304] 0 2024-02-15T18:27:11.417 INFO:tasks.workunit.client.1.smithi133.stdout:1/727: creat d6/d1e/d41/dcc/f10c x:0 0 0 2024-02-15T18:27:11.418 INFO:tasks.workunit.client.0.smithi084.stdout:1/819: creat d9/d54/d7f/db7/dc0/f10a x:0 0 0 2024-02-15T18:27:11.419 INFO:tasks.workunit.client.0.smithi084.stdout:1/820: getdents d9/d54/d7f/db7 0 2024-02-15T18:27:11.419 INFO:tasks.workunit.client.0.smithi084.stdout:1/821: chown d9/d54/d7f/db7/dc0/c85 274375550 1 2024-02-15T18:27:11.425 INFO:tasks.workunit.client.0.smithi084.stdout:8/829: dwrite db/dd/d1f/d56/f86 [0,4194304] 0 2024-02-15T18:27:11.434 INFO:tasks.workunit.client.1.smithi133.stdout:0/601: dwrite d9/d2b/f7a [0,4194304] 0 2024-02-15T18:27:11.434 INFO:tasks.workunit.client.1.smithi133.stdout:8/507: dwrite d3/d1c/d2f/d87/d73/d84/f98 [0,4194304] 0 2024-02-15T18:27:11.434 INFO:tasks.workunit.client.1.smithi133.stdout:8/508: stat d3/d1f/d4f/ca1 0 2024-02-15T18:27:11.434 INFO:tasks.workunit.client.1.smithi133.stdout:0/602: readlink d9/d2b/l5f 0 2024-02-15T18:27:11.434 INFO:tasks.workunit.client.1.smithi133.stdout:8/509: truncate d3/d1c/f97 666000 0 2024-02-15T18:27:11.437 INFO:tasks.workunit.client.1.smithi133.stdout:0/603: creat d9/d10/d22/d32/d7f/fce x:0 0 0 2024-02-15T18:27:11.437 INFO:tasks.workunit.client.1.smithi133.stdout:0/604: fdatasync d9/f75 0 2024-02-15T18:27:11.437 INFO:tasks.workunit.client.1.smithi133.stdout:0/605: write d9/d10/d47/d5e/f89 [816664,26648] 0 2024-02-15T18:27:11.437 INFO:tasks.workunit.client.1.smithi133.stdout:0/606: chown d9/d10/d85/cb0 124 1 2024-02-15T18:27:11.437 INFO:tasks.workunit.client.1.smithi133.stdout:0/607: write d9/d10/d22/d32/d7f/fa1 [5228388,86374] 0 2024-02-15T18:27:11.438 INFO:tasks.workunit.client.1.smithi133.stdout:0/608: read d9/d10/d19/f73 [1440978,115226] 0 2024-02-15T18:27:11.438 INFO:tasks.workunit.client.1.smithi133.stdout:0/609: stat d9/d10/d47/f87 0 2024-02-15T18:27:11.438 INFO:tasks.workunit.client.0.smithi084.stdout:4/936: dwrite d2/d4/d28/d3d/d5c/d5d/f106 [0,4194304] 0 2024-02-15T18:27:11.439 INFO:tasks.workunit.client.1.smithi133.stdout:0/610: unlink d9/l1f 0 2024-02-15T18:27:11.441 INFO:tasks.workunit.client.0.smithi084.stdout:4/937: link d2/d4/d28/d3d/d5c/d5d/f7e d2/d64/d74/d8f/dc1/dec/f112 0 2024-02-15T18:27:11.441 INFO:tasks.workunit.client.0.smithi084.stdout:4/938: creat d2/d64/d74/d8f/f113 x:0 0 0 2024-02-15T18:27:11.443 INFO:tasks.workunit.client.0.smithi084.stdout:4/939: unlink d2/d64/da5/dae/de1/ded/l110 0 2024-02-15T18:27:11.443 INFO:tasks.workunit.client.0.smithi084.stdout:7/860: dwrite df/f35 [0,4194304] 0 2024-02-15T18:27:11.444 INFO:tasks.workunit.client.0.smithi084.stdout:7/861: fdatasync df/d1d/d44/db9/fd3 0 2024-02-15T18:27:11.444 INFO:tasks.workunit.client.0.smithi084.stdout:4/940: symlink d2/d4/d28/d3d/d5c/dbc/d88/db0/l114 0 2024-02-15T18:27:11.444 INFO:tasks.workunit.client.0.smithi084.stdout:5/929: dwrite d9/d35/d65/d7f/dd6/d124/f129 [0,4194304] 0 2024-02-15T18:27:11.445 INFO:tasks.workunit.client.0.smithi084.stdout:9/871: dwrite d4/d6b/fb7 [0,4194304] 0 2024-02-15T18:27:11.446 INFO:tasks.workunit.client.1.smithi133.stdout:3/622: dwrite d0/d15/d2f/d9b/d39/f75 [0,4194304] 0 2024-02-15T18:27:11.446 INFO:tasks.workunit.client.1.smithi133.stdout:9/464: dwrite d0/d8/d9/d12/d82/f40 [0,4194304] 0 2024-02-15T18:27:11.446 INFO:tasks.workunit.client.1.smithi133.stdout:1/728: dwrite d6/d1e/f88 [0,4194304] 0 2024-02-15T18:27:11.447 INFO:tasks.workunit.client.1.smithi133.stdout:7/392: dwrite d9/db/d16/f25 [0,4194304] 0 2024-02-15T18:27:11.447 INFO:tasks.workunit.client.1.smithi133.stdout:8/510: dread d3/d1f/f2c [0,4194304] 0 2024-02-15T18:27:11.449 INFO:tasks.workunit.client.1.smithi133.stdout:3/623: symlink d0/d15/d2f/d9b/d62/lc6 0 2024-02-15T18:27:11.449 INFO:tasks.workunit.client.1.smithi133.stdout:3/624: chown d0/d15/f6b 29070993 1 2024-02-15T18:27:11.449 INFO:tasks.workunit.client.1.smithi133.stdout:3/625: chown d0/d15/d2f/d5e/f8b 17461 1 2024-02-15T18:27:11.449 INFO:tasks.workunit.client.0.smithi084.stdout:9/872: write d4/d3d/f7e [1127958,9838] 0 2024-02-15T18:27:11.449 INFO:tasks.workunit.client.0.smithi084.stdout:9/873: dread - d4/d2b/d3c/d24/dca/d15/fff zero size 2024-02-15T18:27:11.450 INFO:tasks.workunit.client.1.smithi133.stdout:9/465: unlink d0/d8/d10/f29 0 2024-02-15T18:27:11.454 INFO:tasks.workunit.client.1.smithi133.stdout:0/611: dread d9/f75 [0,4194304] 0 2024-02-15T18:27:11.455 INFO:tasks.workunit.client.1.smithi133.stdout:1/729: link d6/d1e/d3a/d75/fce d6/d1e/d3a/d82/d85/dc7/f10d 0 2024-02-15T18:27:11.455 INFO:tasks.workunit.client.1.smithi133.stdout:1/730: chown d6/d1e/d41/d7c/d7e/d7f 34592654 1 2024-02-15T18:27:11.462 INFO:tasks.workunit.client.0.smithi084.stdout:7/862: rename df/d1d/d1a/d6a/d8b/ce1 to df/d1d/d1a/d6a/d8e/d79/ddc/df0/c11a 0 2024-02-15T18:27:11.463 INFO:tasks.workunit.client.0.smithi084.stdout:7/863: readlink l8 0 2024-02-15T18:27:11.465 INFO:tasks.workunit.client.0.smithi084.stdout:4/941: getdents d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4 0 2024-02-15T18:27:11.466 INFO:tasks.workunit.client.0.smithi084.stdout:7/864: dread df/d1d/d1a/d6a/d8b/da5/db6/fe4 [0,4194304] 0 2024-02-15T18:27:11.469 INFO:tasks.workunit.client.0.smithi084.stdout:5/930: mkdir d9/dc6/de2/df1/d131 0 2024-02-15T18:27:11.474 INFO:tasks.workunit.client.1.smithi133.stdout:7/393: mknod d9/db/d16/d5d/d68/d73/c85 0 2024-02-15T18:27:11.474 INFO:tasks.workunit.client.1.smithi133.stdout:7/394: stat d9/d5b/f66 0 2024-02-15T18:27:11.475 INFO:tasks.workunit.client.1.smithi133.stdout:8/511: link d3/cd d3/d1c/d2f/d87/d73/d84/ca4 0 2024-02-15T18:27:11.476 INFO:tasks.workunit.client.1.smithi133.stdout:9/466: getdents d0/d8/d9/d12/d7f 0 2024-02-15T18:27:11.480 INFO:tasks.workunit.client.0.smithi084.stdout:9/874: rmdir d4 39 2024-02-15T18:27:11.480 INFO:tasks.workunit.client.0.smithi084.stdout:9/875: readlink d4/d2b/d3c/d20/lce 0 2024-02-15T18:27:11.481 INFO:tasks.workunit.client.0.smithi084.stdout:4/942: rmdir d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94 39 2024-02-15T18:27:11.481 INFO:tasks.workunit.client.0.smithi084.stdout:9/876: write d4/d2b/d3c/d24/dca/d15/f44 [3791301,52219] 0 2024-02-15T18:27:11.481 INFO:tasks.workunit.client.0.smithi084.stdout:9/877: chown d4/d2b/f90 0 1 2024-02-15T18:27:11.482 INFO:tasks.workunit.client.1.smithi133.stdout:0/612: rmdir d9/d10/d2c/da9 0 2024-02-15T18:27:11.483 INFO:tasks.workunit.client.1.smithi133.stdout:1/731: creat d6/d1e/d3a/d79/d8e/f10e x:0 0 0 2024-02-15T18:27:11.483 INFO:tasks.workunit.client.0.smithi084.stdout:7/865: link df/f3b df/d1d/d1a/d6a/d8e/d79/f11b 0 2024-02-15T18:27:11.483 INFO:tasks.workunit.client.1.smithi133.stdout:7/395: rmdir d9/d36 39 2024-02-15T18:27:11.484 INFO:tasks.workunit.client.1.smithi133.stdout:8/512: getdents d3/d7 0 2024-02-15T18:27:11.485 INFO:tasks.workunit.client.1.smithi133.stdout:0/613: stat d9/d2b/l5f 0 2024-02-15T18:27:11.487 INFO:tasks.workunit.client.1.smithi133.stdout:7/396: mkdir d9/db/d16/d5d/d86 0 2024-02-15T18:27:11.488 INFO:tasks.workunit.client.0.smithi084.stdout:5/931: link d9/d5b/d79/db7/f9c d9/d5b/f132 0 2024-02-15T18:27:11.489 INFO:tasks.workunit.client.0.smithi084.stdout:7/866: symlink df/d1d/d44/dbb/df8/d98/dd0/l11c 0 2024-02-15T18:27:11.490 INFO:tasks.workunit.client.1.smithi133.stdout:8/513: creat d3/d1f/d4f/fa5 x:0 0 0 2024-02-15T18:27:11.491 INFO:tasks.workunit.client.0.smithi084.stdout:5/932: mkdir d9/da/d3d/d44/d55/d70/dfa/d133 0 2024-02-15T18:27:11.495 INFO:tasks.workunit.client.0.smithi084.stdout:7/867: creat df/d1d/d44/dbb/df8/f11d x:0 0 0 2024-02-15T18:27:11.495 INFO:tasks.workunit.client.0.smithi084.stdout:7/868: write df/d1d/d1a/d6a/d8e/fce [553476,6781] 0 2024-02-15T18:27:11.497 INFO:tasks.workunit.client.0.smithi084.stdout:5/933: rmdir d9/dc6/de2/df1 39 2024-02-15T18:27:11.497 INFO:tasks.workunit.client.0.smithi084.stdout:5/934: fsync d9/d5b/d79/f87 0 2024-02-15T18:27:11.499 INFO:tasks.workunit.client.0.smithi084.stdout:7/869: link df/f14 df/d1d/d1a/f11e 0 2024-02-15T18:27:11.499 INFO:tasks.workunit.client.0.smithi084.stdout:7/870: truncate df/d1d/d1a/dd1/f114 774761 0 2024-02-15T18:27:11.499 INFO:tasks.workunit.client.0.smithi084.stdout:7/871: truncate df/d1d/d1a/d4d/d103/f94 4509680 0 2024-02-15T18:27:11.501 INFO:tasks.workunit.client.0.smithi084.stdout:5/935: unlink d9/d5b/d7e/d92/lb2 0 2024-02-15T18:27:11.501 INFO:tasks.workunit.client.0.smithi084.stdout:5/936: fsync d9/d5b/f114 0 2024-02-15T18:27:11.503 INFO:tasks.workunit.client.0.smithi084.stdout:7/872: mknod df/d1d/d1a/d4b/c11f 0 2024-02-15T18:27:11.504 INFO:tasks.workunit.client.0.smithi084.stdout:7/873: symlink df/d1d/d1a/d6a/d8b/l120 0 2024-02-15T18:27:11.504 INFO:tasks.workunit.client.0.smithi084.stdout:7/874: dread - df/d1d/d44/dbb/df8/d98/ff2 zero size 2024-02-15T18:27:11.504 INFO:tasks.workunit.client.0.smithi084.stdout:7/875: chown df/d1d/d1a/d4b/l9e 12 1 2024-02-15T18:27:11.505 INFO:tasks.workunit.client.0.smithi084.stdout:0/823: sync 2024-02-15T18:27:11.505 INFO:tasks.workunit.client.0.smithi084.stdout:6/797: sync 2024-02-15T18:27:11.505 INFO:tasks.workunit.client.0.smithi084.stdout:3/772: sync 2024-02-15T18:27:11.506 INFO:tasks.workunit.client.0.smithi084.stdout:7/876: mknod df/d1d/d1a/d6a/d8e/d79/ddc/df0/c121 0 2024-02-15T18:27:11.506 INFO:tasks.workunit.client.0.smithi084.stdout:6/798: chown d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/d99/fc2 113682438 1 2024-02-15T18:27:11.506 INFO:tasks.workunit.client.1.smithi133.stdout:8/514: write d3/d1f/f2a [1807317,84393] 0 2024-02-15T18:27:11.507 INFO:tasks.workunit.client.0.smithi084.stdout:3/773: creat d8/d40/d43/d71/d8c/f103 x:0 0 0 2024-02-15T18:27:11.507 INFO:tasks.workunit.client.0.smithi084.stdout:3/774: dread - d8/d40/faa zero size 2024-02-15T18:27:11.507 INFO:tasks.workunit.client.1.smithi133.stdout:9/467: dwrite d0/d8/d9/d12/d82/f7c [0,4194304] 0 2024-02-15T18:27:11.508 INFO:tasks.workunit.client.0.smithi084.stdout:0/824: creat d0/d4/d3a/d5c/de2/d43/d6d/d71/ff6 x:0 0 0 2024-02-15T18:27:11.509 INFO:tasks.workunit.client.1.smithi133.stdout:8/515: symlink d3/de/d3e/d94/la6 0 2024-02-15T18:27:11.512 INFO:tasks.workunit.client.0.smithi084.stdout:7/877: rename df/f14 to df/d1d/d1a/d6a/d8e/d79/ddc/f122 0 2024-02-15T18:27:11.513 INFO:tasks.workunit.client.1.smithi133.stdout:9/468: rename d0/d8/d9/d12/d4f/l60 to d0/d8/d9/d12/l96 0 2024-02-15T18:27:11.513 INFO:tasks.workunit.client.1.smithi133.stdout:9/469: fsync d0/d8/d10/f14 0 2024-02-15T18:27:11.513 INFO:tasks.workunit.client.1.smithi133.stdout:9/470: chown d0/d8/d9/d12/f64 136788 1 2024-02-15T18:27:11.514 INFO:tasks.workunit.client.0.smithi084.stdout:6/799: symlink d14/d22/d25/d2f/d31/d30/d45/d52/dd5/l105 0 2024-02-15T18:27:11.514 INFO:tasks.workunit.client.0.smithi084.stdout:6/800: fsync d14/d22/d25/d2f/d31/d30/d45/fa2 0 2024-02-15T18:27:11.514 INFO:tasks.workunit.client.0.smithi084.stdout:5/937: dread d9/d5f/da7/fca [0,4194304] 0 2024-02-15T18:27:11.514 INFO:tasks.workunit.client.0.smithi084.stdout:9/878: dwrite d4/d2b/d3c/d24/dca/d15/f37 [0,4194304] 0 2024-02-15T18:27:11.514 INFO:tasks.workunit.client.0.smithi084.stdout:9/879: read - d4/ffa zero size 2024-02-15T18:27:11.515 INFO:tasks.workunit.client.1.smithi133.stdout:9/471: creat d0/d8/d9/d12/f97 x:0 0 0 2024-02-15T18:27:11.515 INFO:tasks.workunit.client.0.smithi084.stdout:7/878: creat df/d1d/d44/d8d/d10a/f123 x:0 0 0 2024-02-15T18:27:11.516 INFO:tasks.workunit.client.0.smithi084.stdout:6/801: truncate d14/d22/d25/d2f/d31/dcf/fe0 2031346 0 2024-02-15T18:27:11.516 INFO:tasks.workunit.client.0.smithi084.stdout:9/880: fsync d4/d2b/d3c/d24/dca/d15/f40 0 2024-02-15T18:27:11.518 INFO:tasks.workunit.client.0.smithi084.stdout:6/802: symlink d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d94/l106 0 2024-02-15T18:27:11.519 INFO:tasks.workunit.client.1.smithi133.stdout:0/614: dwrite d9/d2b/f72 [0,4194304] 0 2024-02-15T18:27:11.520 INFO:tasks.workunit.client.0.smithi084.stdout:9/881: unlink d4/d2b/d3c/l3e 0 2024-02-15T18:27:11.521 INFO:tasks.workunit.client.0.smithi084.stdout:3/775: dread d8/d1f/d2d/f96 [0,4194304] 0 2024-02-15T18:27:11.523 INFO:tasks.workunit.client.1.smithi133.stdout:7/397: dwrite d9/d36/f23 [0,4194304] 0 2024-02-15T18:27:11.523 INFO:tasks.workunit.client.1.smithi133.stdout:7/398: chown d9/d36/f32 6 1 2024-02-15T18:27:11.523 INFO:tasks.workunit.client.1.smithi133.stdout:0/615: symlink d9/d10/d2c/lcf 0 2024-02-15T18:27:11.525 INFO:tasks.workunit.client.1.smithi133.stdout:6/711: sync 2024-02-15T18:27:11.525 INFO:tasks.workunit.client.1.smithi133.stdout:6/712: fsync d0/db/f4f 0 2024-02-15T18:27:11.526 INFO:tasks.workunit.client.0.smithi084.stdout:6/803: unlink d14/d22/d25/d2f/f66 0 2024-02-15T18:27:11.526 INFO:tasks.workunit.client.0.smithi084.stdout:6/804: fsync d14/d22/d25/d2f/d31/d30/d45/d52/d8a/fcc 0 2024-02-15T18:27:11.526 INFO:tasks.workunit.client.0.smithi084.stdout:9/882: rmdir d4/d2b/d3c/d24/dca/d15/d33/de9 39 2024-02-15T18:27:11.526 INFO:tasks.workunit.client.0.smithi084.stdout:9/883: dread - d4/d2b/d3c/d20/f10a zero size 2024-02-15T18:27:11.526 INFO:tasks.workunit.client.0.smithi084.stdout:6/805: write d14/d22/d25/d28/f48 [5043673,85047] 0 2024-02-15T18:27:11.526 INFO:tasks.workunit.client.0.smithi084.stdout:6/806: readlink d14/d22/d25/d2f/d31/dcf/dd8/le9 0 2024-02-15T18:27:11.527 INFO:tasks.workunit.client.1.smithi133.stdout:2/492: sync 2024-02-15T18:27:11.527 INFO:tasks.workunit.client.1.smithi133.stdout:4/393: sync 2024-02-15T18:27:11.527 INFO:tasks.workunit.client.1.smithi133.stdout:4/394: fsync d2/d5/d2b/d21/d2d/f56 0 2024-02-15T18:27:11.527 INFO:tasks.workunit.client.1.smithi133.stdout:2/493: dread - d7/d18/d32/d65/d58/f64 zero size 2024-02-15T18:27:11.527 INFO:tasks.workunit.client.1.smithi133.stdout:5/451: sync 2024-02-15T18:27:11.527 INFO:tasks.workunit.client.1.smithi133.stdout:5/452: stat d17/d20/d32/d38/d70/f91 0 2024-02-15T18:27:11.527 INFO:tasks.workunit.client.1.smithi133.stdout:7/399: rename d9/d36/d39/l82 to d9/d36/d39/l87 0 2024-02-15T18:27:11.527 INFO:tasks.workunit.client.1.smithi133.stdout:7/400: readlink d9/da/d48/l77 0 2024-02-15T18:27:11.528 INFO:tasks.workunit.client.1.smithi133.stdout:0/616: link d9/d10/d22/d32/f48 d9/d28/fd0 0 2024-02-15T18:27:11.528 INFO:tasks.workunit.client.1.smithi133.stdout:6/713: mknod d0/db/d29/d34/d5d/dda/ced 0 2024-02-15T18:27:11.529 INFO:tasks.workunit.client.1.smithi133.stdout:4/395: symlink d2/d5/d2b/d21/d2d/d44/d51/d55/d5e/l86 0 2024-02-15T18:27:11.529 INFO:tasks.workunit.client.1.smithi133.stdout:4/396: write d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 [4478004,18282] 0 2024-02-15T18:27:11.530 INFO:tasks.workunit.client.1.smithi133.stdout:5/453: truncate d17/f85 1779325 0 2024-02-15T18:27:11.532 INFO:tasks.workunit.client.1.smithi133.stdout:7/401: getdents d9/db/d55 0 2024-02-15T18:27:11.532 INFO:tasks.workunit.client.1.smithi133.stdout:0/617: link d9/d10/d19/d29/d67/d68/d96/d44/f6a d9/d10/d22/fd1 0 2024-02-15T18:27:11.533 INFO:tasks.workunit.client.0.smithi084.stdout:3/776: symlink d8/d40/d58/l104 0 2024-02-15T18:27:11.533 INFO:tasks.workunit.client.1.smithi133.stdout:0/618: truncate d9/d10/d85/fcc 740516 0 2024-02-15T18:27:11.533 INFO:tasks.workunit.client.1.smithi133.stdout:0/619: fsync d9/d10/d2c/f91 0 2024-02-15T18:27:11.534 INFO:tasks.workunit.client.1.smithi133.stdout:6/714: symlink d0/db/d29/d34/d5d/d40/dde/lee 0 2024-02-15T18:27:11.534 INFO:tasks.workunit.client.0.smithi084.stdout:9/884: mknod d4/d2b/d3c/d20/c113 0 2024-02-15T18:27:11.534 INFO:tasks.workunit.client.1.smithi133.stdout:4/397: mkdir d2/d5/d2b/d21/d2d/d4f/d87 0 2024-02-15T18:27:11.535 INFO:tasks.workunit.client.0.smithi084.stdout:6/807: rmdir d14/d22/d25/d2f/d31/d30/d4f/d7f/de7 39 2024-02-15T18:27:11.535 INFO:tasks.workunit.client.1.smithi133.stdout:5/454: truncate d17/d20/f2f 293762 0 2024-02-15T18:27:11.536 INFO:tasks.workunit.client.1.smithi133.stdout:5/455: chown d17/d2a/f41 375469 1 2024-02-15T18:27:11.536 INFO:tasks.workunit.client.1.smithi133.stdout:5/456: write ff [1050984,18962] 0 2024-02-15T18:27:11.536 INFO:tasks.workunit.client.1.smithi133.stdout:7/402: symlink d9/db/dc/l88 0 2024-02-15T18:27:11.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/398: write d2/d5/d2b/d21/d2d/d44/f47 [369770,121173] 0 2024-02-15T18:27:11.538 INFO:tasks.workunit.client.1.smithi133.stdout:0/620: mkdir d9/d2b/dd2 0 2024-02-15T18:27:11.539 INFO:tasks.workunit.client.0.smithi084.stdout:3/777: unlink d8/d1f/d2d/fb2 0 2024-02-15T18:27:11.539 INFO:tasks.workunit.client.0.smithi084.stdout:9/885: mknod d4/c114 0 2024-02-15T18:27:11.539 INFO:tasks.workunit.client.0.smithi084.stdout:9/886: chown d4/dc2/def/df6 408351 1 2024-02-15T18:27:11.540 INFO:tasks.workunit.client.1.smithi133.stdout:6/715: creat d0/fef x:0 0 0 2024-02-15T18:27:11.540 INFO:tasks.workunit.client.0.smithi084.stdout:6/808: mknod d14/d22/d25/d2f/d31/deb/c107 0 2024-02-15T18:27:11.540 INFO:tasks.workunit.client.0.smithi084.stdout:6/809: dread - d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/f103 zero size 2024-02-15T18:27:11.541 INFO:tasks.workunit.client.0.smithi084.stdout:3/778: creat d8/d1f/dbf/db6/f105 x:0 0 0 2024-02-15T18:27:11.543 INFO:tasks.workunit.client.0.smithi084.stdout:9/887: symlink d4/d2b/d3c/d20/d75/d87/l115 0 2024-02-15T18:27:11.543 INFO:tasks.workunit.client.0.smithi084.stdout:9/888: readlink d4/d2b/d3c/d24/dca/lb6 0 2024-02-15T18:27:11.543 INFO:tasks.workunit.client.0.smithi084.stdout:9/889: chown d4/da3/db0/c105 1 1 2024-02-15T18:27:11.544 INFO:tasks.workunit.client.0.smithi084.stdout:3/779: write d8/d40/d43/d71/dd9/ff3 [192684,44930] 0 2024-02-15T18:27:11.544 INFO:tasks.workunit.client.0.smithi084.stdout:3/780: chown d8/d40/d43/d71/d8c/d94/da3/dba/de3 42095931 1 2024-02-15T18:27:11.545 INFO:tasks.workunit.client.1.smithi133.stdout:4/399: dread d2/d5/d2b/f1d [0,4194304] 0 2024-02-15T18:27:11.545 INFO:tasks.workunit.client.1.smithi133.stdout:4/400: getdents d2/d5/d2b/d21/d2d/d44/d6b 0 2024-02-15T18:27:11.545 INFO:tasks.workunit.client.0.smithi084.stdout:0/825: dwrite d0/d4/f54 [0,4194304] 0 2024-02-15T18:27:11.548 INFO:tasks.workunit.client.0.smithi084.stdout:0/826: mkdir d0/d4/da8/df7 0 2024-02-15T18:27:11.553 INFO:tasks.workunit.client.1.smithi133.stdout:5/457: mkdir d17/d20/d32/d9d 0 2024-02-15T18:27:11.553 INFO:tasks.workunit.client.1.smithi133.stdout:7/403: rmdir d9/db 39 2024-02-15T18:27:11.553 INFO:tasks.workunit.client.1.smithi133.stdout:6/716: mknod d0/db/d29/d34/d5d/d40/dde/d53/cf0 0 2024-02-15T18:27:11.554 INFO:tasks.workunit.client.0.smithi084.stdout:5/938: dwrite d9/d5f/d68/d9a/d8d/de5/f121 [0,4194304] 0 2024-02-15T18:27:11.554 INFO:tasks.workunit.client.0.smithi084.stdout:5/939: chown d9/da/d12a 0 1 2024-02-15T18:27:11.557 INFO:tasks.workunit.client.1.smithi133.stdout:7/404: truncate d9/db/f3e 1448535 0 2024-02-15T18:27:11.557 INFO:tasks.workunit.client.1.smithi133.stdout:7/405: write d9/f47 [4411189,100522] 0 2024-02-15T18:27:11.558 INFO:tasks.workunit.client.1.smithi133.stdout:6/717: rename d0/db/d29/d34/d8c/d98 to d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1 0 2024-02-15T18:27:11.558 INFO:tasks.workunit.client.1.smithi133.stdout:6/718: truncate d0/f24 6708114 0 2024-02-15T18:27:11.560 INFO:tasks.workunit.client.1.smithi133.stdout:4/401: link d2/d5/d2b/d21/l3a d2/d5/d2b/l88 0 2024-02-15T18:27:11.575 INFO:tasks.workunit.client.1.smithi133.stdout:7/406: creat d9/db/d16/d5d/f89 x:0 0 0 2024-02-15T18:27:11.575 INFO:tasks.workunit.client.1.smithi133.stdout:4/402: symlink d2/d5/d2b/d21/d2d/d44/l89 0 2024-02-15T18:27:11.575 INFO:tasks.workunit.client.1.smithi133.stdout:6/719: creat d0/db/d29/d34/d5d/d40/dde/d9d/ff2 x:0 0 0 2024-02-15T18:27:11.575 INFO:tasks.workunit.client.1.smithi133.stdout:6/720: write d0/db/d29/f84 [1439564,31310] 0 2024-02-15T18:27:11.577 INFO:tasks.workunit.client.1.smithi133.stdout:6/721: mkdir d0/db/d29/d34/d5d/d40/dde/d9d/db3/dd3/df3 0 2024-02-15T18:27:11.577 INFO:tasks.workunit.client.1.smithi133.stdout:7/407: dread d9/db/d55/f7d [0,4194304] 0 2024-02-15T18:27:11.578 INFO:tasks.workunit.client.1.smithi133.stdout:6/722: creat d0/db/d29/d34/d8c/ff4 x:0 0 0 2024-02-15T18:27:11.579 INFO:tasks.workunit.client.0.smithi084.stdout:7/879: dwrite df/d1d/d1a/d4d/fbe [0,4194304] 0 2024-02-15T18:27:11.582 INFO:tasks.workunit.client.0.smithi084.stdout:7/880: rename df/d70/f6d to df/d1d/d44/d96/d100/f124 0 2024-02-15T18:27:11.585 INFO:tasks.workunit.client.1.smithi133.stdout:7/408: write f7 [4725704,44814] 0 2024-02-15T18:27:11.586 INFO:tasks.workunit.client.1.smithi133.stdout:7/409: stat d9/d19/l1a 0 2024-02-15T18:27:11.592 INFO:tasks.workunit.client.1.smithi133.stdout:7/410: write d9/da/f3b [3763152,117223] 0 2024-02-15T18:27:11.592 INFO:tasks.workunit.client.1.smithi133.stdout:7/411: stat d9/db/d16/d5d/d86 0 2024-02-15T18:27:11.607 INFO:tasks.workunit.client.1.smithi133.stdout:7/412: dread d9/db/d16/f25 [0,4194304] 0 2024-02-15T18:27:11.608 INFO:tasks.workunit.client.1.smithi133.stdout:7/413: dread - d9/db/f4a zero size 2024-02-15T18:27:11.608 INFO:tasks.workunit.client.1.smithi133.stdout:7/414: chown d9/d19/c5f 19797 1 2024-02-15T18:27:11.608 INFO:tasks.workunit.client.1.smithi133.stdout:7/415: mkdir d9/db/d16/d5d/d68/d8a 0 2024-02-15T18:27:11.608 INFO:tasks.workunit.client.1.smithi133.stdout:7/416: write d9/d36/d39/f5c [984097,99029] 0 2024-02-15T18:27:11.609 INFO:tasks.workunit.client.1.smithi133.stdout:2/494: dwrite d7/f15 [0,4194304] 0 2024-02-15T18:27:11.609 INFO:tasks.workunit.client.1.smithi133.stdout:7/417: symlink d9/db/d16/d5d/d68/d8a/l8b 0 2024-02-15T18:27:11.610 INFO:tasks.workunit.client.0.smithi084.stdout:9/890: dwrite d4/d2b/d3c/d24/dca/d15/d33/f108 [0,4194304] 0 2024-02-15T18:27:11.610 INFO:tasks.workunit.client.0.smithi084.stdout:6/810: dwrite d14/d22/d25/d2f/d31/d30/d45/fa2 [0,4194304] 0 2024-02-15T18:27:11.610 INFO:tasks.workunit.client.0.smithi084.stdout:6/811: fsync d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/f69 0 2024-02-15T18:27:11.612 INFO:tasks.workunit.client.1.smithi133.stdout:2/495: creat d7/d2c/d3b/d48/f9f x:0 0 0 2024-02-15T18:27:11.612 INFO:tasks.workunit.client.1.smithi133.stdout:2/496: write d7/d18/f9d [522414,74685] 0 2024-02-15T18:27:11.613 INFO:tasks.workunit.client.0.smithi084.stdout:5/940: dwrite d9/d35/d65/d7f/dd6/d124/f129 [0,4194304] 0 2024-02-15T18:27:11.613 INFO:tasks.workunit.client.0.smithi084.stdout:5/941: chown d9/da/d3d/d44/d55/d70/d84/da1/lee 1288 1 2024-02-15T18:27:11.613 INFO:tasks.workunit.client.0.smithi084.stdout:5/942: fsync d9/da/d3d/f50 0 2024-02-15T18:27:11.613 INFO:tasks.workunit.client.0.smithi084.stdout:5/943: fsync d9/d5b/d79/db7/fd9 0 2024-02-15T18:27:11.613 INFO:tasks.workunit.client.0.smithi084.stdout:9/891: creat d4/dc2/def/df6/f116 x:0 0 0 2024-02-15T18:27:11.614 INFO:tasks.workunit.client.1.smithi133.stdout:5/458: dwrite d17/d20/d32/d38/f48 [8388608,4194304] 0 2024-02-15T18:27:11.614 INFO:tasks.workunit.client.1.smithi133.stdout:7/418: creat d9/db/f8c x:0 0 0 2024-02-15T18:27:11.614 INFO:tasks.workunit.client.1.smithi133.stdout:7/419: symlink d9/db/dc/l8d 0 2024-02-15T18:27:11.615 INFO:tasks.workunit.client.1.smithi133.stdout:7/420: write d9/da/d48/d5a/f7b [902302,116655] 0 2024-02-15T18:27:11.615 INFO:tasks.workunit.client.0.smithi084.stdout:6/812: rename d14/d22/d25/d2f/d31/dcf/dd8/le9 to d14/d22/dd2/l108 0 2024-02-15T18:27:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:5/944: creat d9/d5f/dcc/d115/f134 x:0 0 0 2024-02-15T18:27:11.625 INFO:tasks.workunit.client.0.smithi084.stdout:5/945: fsync d9/d5b/d7e/db5/fbd 0 2024-02-15T18:27:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:9/892: mkdir d4/dc2/def/df6/d117 0 2024-02-15T18:27:11.626 INFO:tasks.workunit.client.0.smithi084.stdout:9/893: chown d4/dc2/fdb 185 1 2024-02-15T18:27:11.628 INFO:tasks.workunit.client.0.smithi084.stdout:5/946: unlink d9/da/d3d/d44/d55/d70/d84/f98 0 2024-02-15T18:27:11.629 INFO:tasks.workunit.client.0.smithi084.stdout:5/947: write d9/da/f99 [9083259,61098] 0 2024-02-15T18:27:11.629 INFO:tasks.workunit.client.0.smithi084.stdout:5/948: getdents d9/da/d3d/d44/d55/d96/d108 0 2024-02-15T18:27:11.629 INFO:tasks.workunit.client.0.smithi084.stdout:9/894: mknod d4/d81/c118 0 2024-02-15T18:27:11.630 INFO:tasks.workunit.client.0.smithi084.stdout:0/827: dwrite d0/d4/d3a/d82/fe8 [0,4194304] 0 2024-02-15T18:27:11.630 INFO:tasks.workunit.client.0.smithi084.stdout:0/828: stat d0/d98 0 2024-02-15T18:27:11.630 INFO:tasks.workunit.client.0.smithi084.stdout:5/949: creat d9/d35/d65/d7f/dd6/d124/f135 x:0 0 0 2024-02-15T18:27:11.634 INFO:tasks.workunit.client.0.smithi084.stdout:0/829: rename d0/d4/d1b/d7a/fd5 to d0/d4/d3a/db3/ff8 0 2024-02-15T18:27:11.635 INFO:tasks.workunit.client.0.smithi084.stdout:5/950: mkdir d9/d5b/d7e/d92/d136 0 2024-02-15T18:27:11.635 INFO:tasks.workunit.client.0.smithi084.stdout:9/895: dread d4/d2b/d3c/d20/ff3 [0,4194304] 0 2024-02-15T18:27:11.636 INFO:tasks.workunit.client.0.smithi084.stdout:5/951: mkdir d9/da/d3d/d137 0 2024-02-15T18:27:11.637 INFO:tasks.workunit.client.0.smithi084.stdout:5/952: mknod d9/da/d3d/d44/d55/d96/d108/c138 0 2024-02-15T18:27:11.649 INFO:tasks.workunit.client.0.smithi084.stdout:0/830: dread d0/f37 [0,4194304] 0 2024-02-15T18:27:11.650 INFO:tasks.workunit.client.0.smithi084.stdout:0/831: getdents d0/d2f/d3f/d8a 0 2024-02-15T18:27:11.656 INFO:tasks.workunit.client.0.smithi084.stdout:3/781: dwrite d8/d1f/dbf/f54 [0,4194304] 0 2024-02-15T18:27:11.656 INFO:tasks.workunit.client.0.smithi084.stdout:7/881: dwrite df/d1d/d1a/d4b/f7e [0,4194304] 0 2024-02-15T18:27:11.656 INFO:tasks.workunit.client.0.smithi084.stdout:7/882: fdatasync df/f4c 0 2024-02-15T18:27:11.657 INFO:tasks.workunit.client.1.smithi133.stdout:0/621: dwrite d9/d10/d19/d29/d67/d68/d96/d44/f4c [0,4194304] 0 2024-02-15T18:27:11.657 INFO:tasks.workunit.client.1.smithi133.stdout:6/723: dwrite d0/db/d29/d34/d5d/d40/dde/d67/f81 [0,4194304] 0 2024-02-15T18:27:11.657 INFO:tasks.workunit.client.1.smithi133.stdout:6/724: write d0/db/d29/f47 [795034,47179] 0 2024-02-15T18:27:11.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/622: creat d9/d10/d19/d29/fd3 x:0 0 0 2024-02-15T18:27:11.661 INFO:tasks.workunit.client.1.smithi133.stdout:5/459: dwrite d17/d20/d32/d38/d70/f91 [0,4194304] 0 2024-02-15T18:27:11.661 INFO:tasks.workunit.client.1.smithi133.stdout:5/460: write d17/d20/d32/f37 [4535801,35344] 0 2024-02-15T18:27:11.662 INFO:tasks.workunit.client.1.smithi133.stdout:5/461: fsync d17/d2a/f3b 0 2024-02-15T18:27:11.662 INFO:tasks.workunit.client.1.smithi133.stdout:5/462: fsync d17/f59 0 2024-02-15T18:27:11.662 INFO:tasks.workunit.client.1.smithi133.stdout:7/421: dwrite d9/d19/f54 [0,4194304] 0 2024-02-15T18:27:11.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/883: truncate df/d1d/f3e 1683851 0 2024-02-15T18:27:11.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/884: fdatasync df/d1d/d1a/f11e 0 2024-02-15T18:27:11.663 INFO:tasks.workunit.client.0.smithi084.stdout:0/832: dread d0/d4/d3a/d5c/f52 [0,4194304] 0 2024-02-15T18:27:11.663 INFO:tasks.workunit.client.1.smithi133.stdout:5/463: dread d17/f4a [0,4194304] 0 2024-02-15T18:27:11.664 INFO:tasks.workunit.client.1.smithi133.stdout:7/422: truncate f6 5806379 0 2024-02-15T18:27:11.666 INFO:tasks.workunit.client.1.smithi133.stdout:2/497: dwrite d7/d2c/d5a/d66/f7c [0,4194304] 0 2024-02-15T18:27:11.666 INFO:tasks.workunit.client.1.smithi133.stdout:2/498: fdatasync d7/d2c/d3b/d48/d6d/f78 0 2024-02-15T18:27:11.666 INFO:tasks.workunit.client.1.smithi133.stdout:5/464: stat d17/d20/d32/c40 0 2024-02-15T18:27:11.666 INFO:tasks.workunit.client.1.smithi133.stdout:5/465: chown d17/f27 47120581 1 2024-02-15T18:27:11.667 INFO:tasks.workunit.client.0.smithi084.stdout:0/833: unlink d0/d2f/d3f/f49 0 2024-02-15T18:27:11.668 INFO:tasks.workunit.client.0.smithi084.stdout:6/813: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/f103 [0,4194304] 0 2024-02-15T18:27:11.668 INFO:tasks.workunit.client.0.smithi084.stdout:6/814: chown d14/d22/d25/d2f/d31/dcf/dd8/cef 690 1 2024-02-15T18:27:11.668 INFO:tasks.workunit.client.0.smithi084.stdout:9/896: dwrite d4/da3/dc3/de1/fbe [0,4194304] 0 2024-02-15T18:27:11.668 INFO:tasks.workunit.client.0.smithi084.stdout:9/897: truncate d4/da3/db0/dc5/fd1 381824 0 2024-02-15T18:27:11.668 INFO:tasks.workunit.client.1.smithi133.stdout:2/499: dread d7/d2c/f68 [0,4194304] 0 2024-02-15T18:27:11.670 INFO:tasks.workunit.client.1.smithi133.stdout:2/500: write d7/f20 [1582501,36714] 0 2024-02-15T18:27:11.670 INFO:tasks.workunit.client.1.smithi133.stdout:7/423: getdents d9/d36/d3d/d4c 0 2024-02-15T18:27:11.671 INFO:tasks.workunit.client.1.smithi133.stdout:2/501: read d7/d2c/d46/f6e [2328,15746] 0 2024-02-15T18:27:11.672 INFO:tasks.workunit.client.0.smithi084.stdout:0/834: link d0/d4/d3a/f74 d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/ff9 0 2024-02-15T18:27:11.672 INFO:tasks.workunit.client.0.smithi084.stdout:3/782: write d8/f15 [5963168,127090] 0 2024-02-15T18:27:11.674 INFO:tasks.workunit.client.1.smithi133.stdout:5/466: rename d17/d26/l49 to d17/d20/d32/d9d/l9e 0 2024-02-15T18:27:11.675 INFO:tasks.workunit.client.0.smithi084.stdout:6/815: mknod d14/d22/d25/d2f/d31/d30/d4f/d7f/c109 0 2024-02-15T18:27:11.675 INFO:tasks.workunit.client.0.smithi084.stdout:6/816: stat d14/d22/d25/d2f/f60 0 2024-02-15T18:27:11.676 INFO:tasks.workunit.client.0.smithi084.stdout:7/885: write df/d1d/d1a/d6a/d8b/da5/f10d [901787,80613] 0 2024-02-15T18:27:11.676 INFO:tasks.workunit.client.0.smithi084.stdout:7/886: write df/d1d/d1a/d4d/d55/fa3 [514395,107953] 0 2024-02-15T18:27:11.676 INFO:tasks.workunit.client.0.smithi084.stdout:7/887: readlink df/d1d/d1a/d6a/d8b/da5/l112 0 2024-02-15T18:27:11.677 INFO:tasks.workunit.client.1.smithi133.stdout:2/502: creat d7/d18/d32/d65/fa0 x:0 0 0 2024-02-15T18:27:11.677 INFO:tasks.workunit.client.1.smithi133.stdout:2/503: fsync d7/db/d67/f80 0 2024-02-15T18:27:11.678 INFO:tasks.workunit.client.0.smithi084.stdout:9/898: creat d4/d2b/d3c/d24/dca/d15/d33/de9/d106/f119 x:0 0 0 2024-02-15T18:27:11.679 INFO:tasks.workunit.client.0.smithi084.stdout:0/835: creat d0/d2f/d3f/d4f/d59/da7/ffa x:0 0 0 2024-02-15T18:27:11.680 INFO:tasks.workunit.client.1.smithi133.stdout:7/424: rename d9/db/d55/d63/l7c to d9/db/dc/d84/l8e 0 2024-02-15T18:27:11.680 INFO:tasks.workunit.client.0.smithi084.stdout:6/817: mkdir d14/d22/d25/d2f/d31/d30/d45/d52/dd3/d10a 0 2024-02-15T18:27:11.682 INFO:tasks.workunit.client.1.smithi133.stdout:2/504: creat d7/db/fa1 x:0 0 0 2024-02-15T18:27:11.682 INFO:tasks.workunit.client.1.smithi133.stdout:2/505: fdatasync d7/f15 0 2024-02-15T18:27:11.683 INFO:tasks.workunit.client.0.smithi084.stdout:7/888: rename df/d1d/d44/dbb/df8/d98/dd0 to df/d1d/d1a/d6a/d8b/da5/db6/df5/d125 0 2024-02-15T18:27:11.685 INFO:tasks.workunit.client.0.smithi084.stdout:9/899: creat d4/da3/f11a x:0 0 0 2024-02-15T18:27:11.685 INFO:tasks.workunit.client.0.smithi084.stdout:9/900: write d4/d2b/d3c/d24/dca/d15/fd5 [387857,39642] 0 2024-02-15T18:27:11.685 INFO:tasks.workunit.client.1.smithi133.stdout:2/506: symlink d7/d18/d32/d65/d99/la2 0 2024-02-15T18:27:11.685 INFO:tasks.workunit.client.1.smithi133.stdout:2/507: read - d7/d2c/d3b/d48/d59/f61 zero size 2024-02-15T18:27:11.687 INFO:tasks.workunit.client.0.smithi084.stdout:0/836: creat d0/d2f/ffb x:0 0 0 2024-02-15T18:27:11.687 INFO:tasks.workunit.client.1.smithi133.stdout:2/508: mknod d7/db/d67/ca3 0 2024-02-15T18:27:11.688 INFO:tasks.workunit.client.0.smithi084.stdout:3/783: mkdir d8/d40/d58/d80/d106 0 2024-02-15T18:27:11.689 INFO:tasks.workunit.client.0.smithi084.stdout:9/901: rename d4/da3/db0/c10b to d4/d3d/da5/c11b 0 2024-02-15T18:27:11.690 INFO:tasks.workunit.client.0.smithi084.stdout:9/902: read d4/d2b/d3c/d24/f71 [312491,33706] 0 2024-02-15T18:27:11.690 INFO:tasks.workunit.client.0.smithi084.stdout:9/903: chown d4/d2b/d67/lcc 863701 1 2024-02-15T18:27:11.690 INFO:tasks.workunit.client.0.smithi084.stdout:9/904: fsync d4/d2b/d3c/d24/dca/f14 0 2024-02-15T18:27:11.690 INFO:tasks.workunit.client.0.smithi084.stdout:0/837: mknod d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/cfc 0 2024-02-15T18:27:11.691 INFO:tasks.workunit.client.0.smithi084.stdout:0/838: chown d0/d2f/d3f/da4 1 1 2024-02-15T18:27:11.692 INFO:tasks.workunit.client.0.smithi084.stdout:9/905: creat d4/d2b/d3c/d24/dca/d15/d33/d7b/f11c x:0 0 0 2024-02-15T18:27:11.692 INFO:tasks.workunit.client.0.smithi084.stdout:9/906: chown d4/d2b/d3c/d20/d75/d87 180633 1 2024-02-15T18:27:11.694 INFO:tasks.workunit.client.1.smithi133.stdout:2/509: write d7/d2c/d46/f72 [2771526,115706] 0 2024-02-15T18:27:11.696 INFO:tasks.workunit.client.0.smithi084.stdout:0/839: creat d0/d4/d1b/d46/ffd x:0 0 0 2024-02-15T18:27:11.696 INFO:tasks.workunit.client.0.smithi084.stdout:0/840: rename d0/d4/d3a/d5c/de2/d43 to d0/d4/d3a/d5c/de2/d43/da0/dfe 22 2024-02-15T18:27:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:0/841: chown d0/d4/da8/dc5 70092102 1 2024-02-15T18:27:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:0/842: write d0/d4/d3a/d5c/de2/f84 [349962,44790] 0 2024-02-15T18:27:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:0/843: fsync d0/d2f/d4b/dc6/fca 0 2024-02-15T18:27:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:0/844: chown d0/d39/d90/db1/lcc 31 1 2024-02-15T18:27:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:8/830: sync 2024-02-15T18:27:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:2/818: sync 2024-02-15T18:27:11.697 INFO:tasks.workunit.client.0.smithi084.stdout:1/822: sync 2024-02-15T18:27:11.699 INFO:tasks.workunit.client.0.smithi084.stdout:9/907: write d4/f19 [527339,119762] 0 2024-02-15T18:27:11.699 INFO:tasks.workunit.client.0.smithi084.stdout:8/831: symlink db/d1a/d2b/l116 0 2024-02-15T18:27:11.699 INFO:tasks.workunit.client.0.smithi084.stdout:9/908: read - d4/d2b/d3c/d24/dca/d15/d33/de9/d106/f119 zero size 2024-02-15T18:27:11.701 INFO:tasks.workunit.client.0.smithi084.stdout:1/823: mknod d9/d54/d1b/d38/d4d/c10b 0 2024-02-15T18:27:11.701 INFO:tasks.workunit.client.0.smithi084.stdout:1/824: stat d9/d54 0 2024-02-15T18:27:11.703 INFO:tasks.workunit.client.0.smithi084.stdout:9/909: rename d4/d3d/da5/fe4 to d4/d6b/f11d 0 2024-02-15T18:27:11.704 INFO:tasks.workunit.client.0.smithi084.stdout:3/784: dread d8/d40/d58/d80/d6b/f85 [0,4194304] 0 2024-02-15T18:27:11.706 INFO:tasks.workunit.client.0.smithi084.stdout:1/825: rename d9/d54/d1b/d2c/d4b/d4c/d79/d36/l71 to d9/d54/d7f/l10c 0 2024-02-15T18:27:11.707 INFO:tasks.workunit.client.0.smithi084.stdout:9/910: mkdir d4/d2b/d3c/d20/d75/d87/de2/d11e 0 2024-02-15T18:27:11.708 INFO:tasks.workunit.client.0.smithi084.stdout:3/785: fsync d8/d1f/dbf/db6/f105 0 2024-02-15T18:27:11.708 INFO:tasks.workunit.client.0.smithi084.stdout:3/786: write d8/d40/d43/d71/d8c/f103 [838376,119088] 0 2024-02-15T18:27:11.708 INFO:tasks.workunit.client.0.smithi084.stdout:3/787: fdatasync d8/d1f/d25/f9a 0 2024-02-15T18:27:11.709 INFO:tasks.workunit.client.0.smithi084.stdout:1/826: mkdir d9/d54/d32/d5b/d10d 0 2024-02-15T18:27:11.712 INFO:tasks.workunit.client.0.smithi084.stdout:1/827: write d9/d54/d1b/d2c/d4b/d4c/d79/f9c [822326,26104] 0 2024-02-15T18:27:11.713 INFO:tasks.workunit.client.0.smithi084.stdout:3/788: unlink d8/d73/db9/ccb 0 2024-02-15T18:27:11.714 INFO:tasks.workunit.client.0.smithi084.stdout:9/911: symlink d4/d2b/d3c/d24/dca/d15/d5d/l11f 0 2024-02-15T18:27:11.714 INFO:tasks.workunit.client.0.smithi084.stdout:1/828: creat d9/d54/d1b/d2c/d4b/d4c/da9/f10e x:0 0 0 2024-02-15T18:27:11.715 INFO:tasks.workunit.client.1.smithi133.stdout:0/623: dwrite f5 [4194304,4194304] 0 2024-02-15T18:27:11.719 INFO:tasks.workunit.client.1.smithi133.stdout:6/725: dwrite d0/db/f82 [0,4194304] 0 2024-02-15T18:27:11.720 INFO:tasks.workunit.client.0.smithi084.stdout:9/912: write d4/d3d/f61 [438756,12571] 0 2024-02-15T18:27:11.720 INFO:tasks.workunit.client.0.smithi084.stdout:4/943: sync 2024-02-15T18:27:11.720 INFO:tasks.workunit.client.0.smithi084.stdout:1/829: write d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ff3 [4093697,119615] 0 2024-02-15T18:27:11.720 INFO:tasks.workunit.client.0.smithi084.stdout:9/913: truncate d4/f6 3980339 0 2024-02-15T18:27:11.722 INFO:tasks.workunit.client.0.smithi084.stdout:1/830: creat d9/d54/d7f/db7/dd9/d81/ded/f10f x:0 0 0 2024-02-15T18:27:11.723 INFO:tasks.workunit.client.1.smithi133.stdout:6/726: mkdir d0/db/df5 0 2024-02-15T18:27:11.724 INFO:tasks.workunit.client.0.smithi084.stdout:9/914: unlink d4/da3/fe8 0 2024-02-15T18:27:11.724 INFO:tasks.workunit.client.0.smithi084.stdout:9/915: chown d4/da3/db0/dc5/fd1 758770629 1 2024-02-15T18:27:11.725 INFO:tasks.workunit.client.1.smithi133.stdout:6/727: creat d0/d5/ff6 x:0 0 0 2024-02-15T18:27:11.726 INFO:tasks.workunit.client.0.smithi084.stdout:1/831: creat d9/d54/d1b/d2c/d4b/f110 x:0 0 0 2024-02-15T18:27:11.726 INFO:tasks.workunit.client.0.smithi084.stdout:1/832: chown d9/d54/d1b/d2c/d4b/d4c/f61 272279279 1 2024-02-15T18:27:11.726 INFO:tasks.workunit.client.0.smithi084.stdout:6/818: dwrite d14/d22/d25/d2f/d31/d3f/fdf [0,4194304] 0 2024-02-15T18:27:11.727 INFO:tasks.workunit.client.1.smithi133.stdout:6/728: mkdir d0/db/d29/d34/d5d/dc9/df7 0 2024-02-15T18:27:11.727 INFO:tasks.workunit.client.1.smithi133.stdout:5/467: dwrite d17/f27 [0,4194304] 0 2024-02-15T18:27:11.727 INFO:tasks.workunit.client.1.smithi133.stdout:5/468: truncate d17/f33 4811807 0 2024-02-15T18:27:11.728 INFO:tasks.workunit.client.0.smithi084.stdout:1/833: dread d9/d54/d7f/db7/dd9/d81/d94/db9/fe4 [0,4194304] 0 2024-02-15T18:27:11.728 INFO:tasks.workunit.client.1.smithi133.stdout:6/729: creat d0/db/d29/d34/d5d/d40/dde/db1/ff8 x:0 0 0 2024-02-15T18:27:11.729 INFO:tasks.workunit.client.0.smithi084.stdout:6/819: write d14/d22/d25/d2f/d31/d3f/d4a/f98 [353420,46477] 0 2024-02-15T18:27:11.730 INFO:tasks.workunit.client.0.smithi084.stdout:0/845: dwrite d0/d4/d3a/d5c/de2/d43/f9e [4194304,4194304] 0 2024-02-15T18:27:11.730 INFO:tasks.workunit.client.0.smithi084.stdout:0/846: write d0/d2f/f56 [5996700,44363] 0 2024-02-15T18:27:11.730 INFO:tasks.workunit.client.0.smithi084.stdout:1/834: unlink d9/d54/d1b/d2c/d4b/d4c/d79/f9c 0 2024-02-15T18:27:11.732 INFO:tasks.workunit.client.0.smithi084.stdout:6/820: rename d14/d22/d25/d2f/da9/fa8 to d14/d22/d25/d2f/d31/d30/d45/d52/dd3/f10b 0 2024-02-15T18:27:11.733 INFO:tasks.workunit.client.0.smithi084.stdout:6/821: chown d14/l21 44412 1 2024-02-15T18:27:11.733 INFO:tasks.workunit.client.0.smithi084.stdout:6/822: write d14/d22/d25/d2f/d31/d30/d4f/fa3 [647659,115928] 0 2024-02-15T18:27:11.733 INFO:tasks.workunit.client.0.smithi084.stdout:6/823: dread - d14/d22/d25/d2f/d31/d30/d4f/df1/f102 zero size 2024-02-15T18:27:11.733 INFO:tasks.workunit.client.1.smithi133.stdout:5/469: unlink d17/f59 0 2024-02-15T18:27:11.733 INFO:tasks.workunit.client.1.smithi133.stdout:6/730: truncate d0/f12 1926886 0 2024-02-15T18:27:11.735 INFO:tasks.workunit.client.1.smithi133.stdout:5/470: creat d17/d20/d4f/d90/f9f x:0 0 0 2024-02-15T18:27:11.736 INFO:tasks.workunit.client.0.smithi084.stdout:0/847: link d0/d39/d45/f5e d0/d2f/d3f/d4c/fff 0 2024-02-15T18:27:11.736 INFO:tasks.workunit.client.1.smithi133.stdout:7/425: dwrite d9/db/f3c [0,4194304] 0 2024-02-15T18:27:11.737 INFO:tasks.workunit.client.1.smithi133.stdout:5/471: link f10 d17/d20/d4f/d5f/fa0 0 2024-02-15T18:27:11.737 INFO:tasks.workunit.client.1.smithi133.stdout:5/472: chown l1 4663639 1 2024-02-15T18:27:11.738 INFO:tasks.workunit.client.1.smithi133.stdout:5/473: read d17/d26/f52 [108765,10429] 0 2024-02-15T18:27:11.741 INFO:tasks.workunit.client.1.smithi133.stdout:5/474: rmdir d17/d20/d5e 39 2024-02-15T18:27:11.741 INFO:tasks.workunit.client.1.smithi133.stdout:7/426: mknod d9/db/dc/c8f 0 2024-02-15T18:27:11.741 INFO:tasks.workunit.client.0.smithi084.stdout:2/819: dwrite d3/d28/f45 [0,4194304] 0 2024-02-15T18:27:11.741 INFO:tasks.workunit.client.1.smithi133.stdout:5/475: stat d17/d20/d32/c8f 0 2024-02-15T18:27:11.743 INFO:tasks.workunit.client.0.smithi084.stdout:7/889: dwrite df/f110 [0,4194304] 0 2024-02-15T18:27:11.744 INFO:tasks.workunit.client.1.smithi133.stdout:7/427: rename d9/db/d16/c51 to d9/db/d55/c90 0 2024-02-15T18:27:11.745 INFO:tasks.workunit.client.1.smithi133.stdout:7/428: getdents d9/d36/d39 0 2024-02-15T18:27:11.745 INFO:tasks.workunit.client.0.smithi084.stdout:2/820: mkdir d3/d5/d53/dca/d7b/d105/d74/d10a 0 2024-02-15T18:27:11.745 INFO:tasks.workunit.client.0.smithi084.stdout:2/821: readlink d3/d28/l8b 0 2024-02-15T18:27:11.745 INFO:tasks.workunit.client.0.smithi084.stdout:2/822: stat d3/d5/d53/dca/d7b/d105/d74/fac 0 2024-02-15T18:27:11.749 INFO:tasks.workunit.client.1.smithi133.stdout:7/429: link d9/db/d16/c74 d9/db/d55/c91 0 2024-02-15T18:27:11.750 INFO:tasks.workunit.client.0.smithi084.stdout:4/944: dwrite d2/d4/d28/fe5 [0,4194304] 0 2024-02-15T18:27:11.751 INFO:tasks.workunit.client.0.smithi084.stdout:6/824: dread d14/d22/d25/f32 [0,4194304] 0 2024-02-15T18:27:11.753 INFO:tasks.workunit.client.1.smithi133.stdout:7/430: mknod d9/da/d48/d62/d64/c92 0 2024-02-15T18:27:11.753 INFO:tasks.workunit.client.1.smithi133.stdout:5/476: dread d17/f33 [0,4194304] 0 2024-02-15T18:27:11.753 INFO:tasks.workunit.client.1.smithi133.stdout:2/510: dread d7/d2c/d46/f72 [0,4194304] 0 2024-02-15T18:27:11.758 INFO:tasks.workunit.client.1.smithi133.stdout:7/431: mknod d9/d36/d3d/d4c/c93 0 2024-02-15T18:27:11.759 INFO:tasks.workunit.client.1.smithi133.stdout:2/511: creat d7/d2c/fa4 x:0 0 0 2024-02-15T18:27:11.760 INFO:tasks.workunit.client.1.smithi133.stdout:2/512: fdatasync d7/d2c/d3b/d48/d59/f61 0 2024-02-15T18:27:11.760 INFO:tasks.workunit.client.1.smithi133.stdout:2/513: dread - d7/d2c/fa4 zero size 2024-02-15T18:27:11.760 INFO:tasks.workunit.client.1.smithi133.stdout:2/514: mkdir d7/d2c/d5a/d66/da5 0 2024-02-15T18:27:11.762 INFO:tasks.workunit.client.1.smithi133.stdout:2/515: creat d7/d18/fa6 x:0 0 0 2024-02-15T18:27:11.764 INFO:tasks.workunit.client.1.smithi133.stdout:2/516: mkdir d7/db/d67/da7 0 2024-02-15T18:27:11.764 INFO:tasks.workunit.client.1.smithi133.stdout:2/517: write d7/d18/d32/d65/d58/f84 [984779,1977] 0 2024-02-15T18:27:11.766 INFO:tasks.workunit.client.1.smithi133.stdout:2/518: mkdir d7/d2c/d5a/d66/d70/da8 0 2024-02-15T18:27:11.766 INFO:tasks.workunit.client.1.smithi133.stdout:2/519: write d7/d2c/d46/f6e [1044597,19393] 0 2024-02-15T18:27:11.767 INFO:tasks.workunit.client.0.smithi084.stdout:7/890: mknod df/d1d/d1a/c126 0 2024-02-15T18:27:11.768 INFO:tasks.workunit.client.1.smithi133.stdout:2/520: rmdir d7/d2c/d5a 39 2024-02-15T18:27:11.772 INFO:tasks.workunit.client.0.smithi084.stdout:0/848: truncate d0/d2f/f56 307261 0 2024-02-15T18:27:11.772 INFO:tasks.workunit.client.0.smithi084.stdout:0/849: truncate d0/f37 4223096 0 2024-02-15T18:27:11.773 INFO:tasks.workunit.client.1.smithi133.stdout:6/731: dwrite d0/db/db6/fcb [0,4194304] 0 2024-02-15T18:27:11.774 INFO:tasks.workunit.client.1.smithi133.stdout:6/732: getdents d0/db/d29/d34/d5d/d40/dde/d9d/db3/dd3/df3 0 2024-02-15T18:27:11.774 INFO:tasks.workunit.client.1.smithi133.stdout:6/733: write d0/f32 [4995,20720] 0 2024-02-15T18:27:11.775 INFO:tasks.workunit.client.0.smithi084.stdout:9/916: getdents d4/da3 0 2024-02-15T18:27:11.777 INFO:tasks.workunit.client.1.smithi133.stdout:2/521: dread d7/d2c/d3b/f50 [0,4194304] 0 2024-02-15T18:27:11.777 INFO:tasks.workunit.client.1.smithi133.stdout:6/734: write d0/db/d29/d34/d5d/d40/dde/d67/f81 [977933,85035] 0 2024-02-15T18:27:11.778 INFO:tasks.workunit.client.1.smithi133.stdout:6/735: creat d0/d62/ff9 x:0 0 0 2024-02-15T18:27:11.782 INFO:tasks.workunit.client.1.smithi133.stdout:7/432: dwrite d9/db/f83 [0,4194304] 0 2024-02-15T18:27:11.782 INFO:tasks.workunit.client.1.smithi133.stdout:7/433: stat d9/d36/d31/f59 0 2024-02-15T18:27:11.785 INFO:tasks.workunit.client.1.smithi133.stdout:6/736: unlink d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/ce5 0 2024-02-15T18:27:11.787 INFO:tasks.workunit.client.1.smithi133.stdout:7/434: rename d9/db/d16/c40 to d9/db/d16/d5d/c94 0 2024-02-15T18:27:11.788 INFO:tasks.workunit.client.1.smithi133.stdout:6/737: creat d0/db/d29/d34/d5d/dda/ffa x:0 0 0 2024-02-15T18:27:11.790 INFO:tasks.workunit.client.1.smithi133.stdout:7/435: unlink d9/db/f83 0 2024-02-15T18:27:11.791 INFO:tasks.workunit.client.1.smithi133.stdout:7/436: symlink d9/da/l95 0 2024-02-15T18:27:11.793 INFO:tasks.workunit.client.0.smithi084.stdout:7/891: dwrite df/d1d/d1a/d6a/d8e/fd7 [0,4194304] 0 2024-02-15T18:27:11.805 INFO:tasks.workunit.client.0.smithi084.stdout:9/917: dwrite d4/dc2/f112 [0,4194304] 0 2024-02-15T18:27:11.806 INFO:tasks.workunit.client.1.smithi133.stdout:6/738: truncate d0/db/d29/d34/d5d/d40/dde/d67/f81 332578 0 2024-02-15T18:27:11.806 INFO:tasks.workunit.client.1.smithi133.stdout:6/739: write d0/db/d29/d34/d5d/fa6 [1406919,35119] 0 2024-02-15T18:27:11.808 INFO:tasks.workunit.client.1.smithi133.stdout:6/740: mkdir d0/dfb 0 2024-02-15T18:27:11.808 INFO:tasks.workunit.client.1.smithi133.stdout:6/741: chown d0/db 1916047 1 2024-02-15T18:27:11.809 INFO:tasks.workunit.client.1.smithi133.stdout:6/742: readlink d0/db/d29/d34/d5d/d40/dde/d52/l88 0 2024-02-15T18:27:11.809 INFO:tasks.workunit.client.1.smithi133.stdout:2/522: dwrite d7/d18/d32/d65/f52 [0,4194304] 0 2024-02-15T18:27:11.812 INFO:tasks.workunit.client.1.smithi133.stdout:6/743: link d0/db/d29/d34/d5d/d40/dde/ca9 d0/db/d29/d34/d5d/dda/cfc 0 2024-02-15T18:27:11.812 INFO:tasks.workunit.client.1.smithi133.stdout:6/744: creat d0/db/d29/d34/d5d/d40/dde/db1/ffd x:0 0 0 2024-02-15T18:27:11.817 INFO:tasks.workunit.client.0.smithi084.stdout:7/892: dwrite df/d1d/d1a/d6a/d8e/faa [0,4194304] 0 2024-02-15T18:27:11.817 INFO:tasks.workunit.client.0.smithi084.stdout:7/893: readlink df/d1d/d1a/d4d/d55/l82 0 2024-02-15T18:27:11.817 INFO:tasks.workunit.client.0.smithi084.stdout:7/894: truncate df/d1d/d1a/fc0 754980 0 2024-02-15T18:27:11.820 INFO:tasks.workunit.client.0.smithi084.stdout:2/823: link d3/l4d d3/d5/d53/dca/d7b/d105/d74/d8e/l10b 0 2024-02-15T18:27:11.823 INFO:tasks.workunit.client.1.smithi133.stdout:2/523: dread d7/f3c [0,4194304] 0 2024-02-15T18:27:11.823 INFO:tasks.workunit.client.1.smithi133.stdout:2/524: read d7/d2c/d46/f6e [79195,14290] 0 2024-02-15T18:27:11.824 INFO:tasks.workunit.client.1.smithi133.stdout:2/525: mknod d7/d2c/d5a/d66/da5/ca9 0 2024-02-15T18:27:11.826 INFO:tasks.workunit.client.1.smithi133.stdout:2/526: link d7/d2c/d31/c51 d7/db/d67/caa 0 2024-02-15T18:27:11.827 INFO:tasks.workunit.client.1.smithi133.stdout:2/527: rmdir d7/d2c/d3b/d48/d6d 39 2024-02-15T18:27:11.827 INFO:tasks.workunit.client.1.smithi133.stdout:2/528: fsync d7/d2c/f44 0 2024-02-15T18:27:11.827 INFO:tasks.workunit.client.1.smithi133.stdout:2/529: getdents d7/db/d67/da7 0 2024-02-15T18:27:11.828 INFO:tasks.workunit.client.0.smithi084.stdout:4/945: creat d2/d64/d74/d8f/dc1/dec/f115 x:0 0 0 2024-02-15T18:27:11.829 INFO:tasks.workunit.client.1.smithi133.stdout:2/530: mknod d7/db/d67/cab 0 2024-02-15T18:27:11.829 INFO:tasks.workunit.client.1.smithi133.stdout:2/531: getdents d7/db/d67/da7 0 2024-02-15T18:27:11.829 INFO:tasks.workunit.client.1.smithi133.stdout:6/745: dwrite d0/db/d29/d34/d5d/f6b [0,4194304] 0 2024-02-15T18:27:11.829 INFO:tasks.workunit.client.1.smithi133.stdout:6/746: dread - d0/d62/d66/fcd zero size 2024-02-15T18:27:11.829 INFO:tasks.workunit.client.1.smithi133.stdout:6/747: chown d0/db/d29/d34/d48 18361861 1 2024-02-15T18:27:11.829 INFO:tasks.workunit.client.1.smithi133.stdout:2/532: write d7/d2c/d31/f88 [199382,67901] 0 2024-02-15T18:27:11.829 INFO:tasks.workunit.client.0.smithi084.stdout:6/825: mknod d14/d22/d25/d2f/d31/d30/d45/d54/c10c 0 2024-02-15T18:27:11.833 INFO:tasks.workunit.client.0.smithi084.stdout:9/918: mknod d4/d2b/d3c/d24/dca/d15/d5d/c120 0 2024-02-15T18:27:11.834 INFO:tasks.workunit.client.1.smithi133.stdout:6/748: rmdir d0/db/d29/d34/d5d/d40/dde/d78/d7f/ddb 0 2024-02-15T18:27:11.834 INFO:tasks.workunit.client.1.smithi133.stdout:6/749: chown d0/db/d29/d34/d5d/d40/dde/d78/fe3 3 1 2024-02-15T18:27:11.835 INFO:tasks.workunit.client.1.smithi133.stdout:6/750: write d0/db/f82 [78218,16192] 0 2024-02-15T18:27:11.839 INFO:tasks.workunit.client.1.smithi133.stdout:6/751: symlink d0/d62/d66/lfe 0 2024-02-15T18:27:11.840 INFO:tasks.workunit.client.0.smithi084.stdout:7/895: symlink df/d1d/d1a/d6a/d8e/d79/l127 0 2024-02-15T18:27:11.840 INFO:tasks.workunit.client.0.smithi084.stdout:7/896: fdatasync df/d1d/d1a/fc1 0 2024-02-15T18:27:11.841 INFO:tasks.workunit.client.0.smithi084.stdout:2/824: unlink d3/d5/d53/dca/d7b/d105/f81 0 2024-02-15T18:27:11.843 INFO:tasks.workunit.client.1.smithi133.stdout:6/752: mkdir d0/db/d29/d34/d5d/d40/dde/d85/d8e/dff 0 2024-02-15T18:27:11.843 INFO:tasks.workunit.client.1.smithi133.stdout:6/753: chown d0/db/d29/d34/d5d/d40/dde/f6d 980027 1 2024-02-15T18:27:11.843 INFO:tasks.workunit.client.0.smithi084.stdout:4/946: mkdir d2/d4/d28/d3d/d5c/dbc/d88/db0/d116 0 2024-02-15T18:27:11.844 INFO:tasks.workunit.client.0.smithi084.stdout:4/947: write d2/d64/d74/d8f/dc1/dec/f115 [218636,28552] 0 2024-02-15T18:27:11.844 INFO:tasks.workunit.client.0.smithi084.stdout:4/948: chown d2/d4/d28/d71/cdd 14464898 1 2024-02-15T18:27:11.844 INFO:tasks.workunit.client.0.smithi084.stdout:4/949: stat d2/d4/d28/d2e/cef 0 2024-02-15T18:27:11.844 INFO:tasks.workunit.client.0.smithi084.stdout:9/919: rmdir d4/d36 39 2024-02-15T18:27:11.844 INFO:tasks.workunit.client.0.smithi084.stdout:2/825: creat d3/d19/d108/de7/f10c x:0 0 0 2024-02-15T18:27:11.845 INFO:tasks.workunit.client.0.smithi084.stdout:2/826: chown d3/d5/d53/dca/f2e 3507053 1 2024-02-15T18:27:11.845 INFO:tasks.workunit.client.0.smithi084.stdout:2/827: getdents d3/d9e/df7 0 2024-02-15T18:27:11.845 INFO:tasks.workunit.client.0.smithi084.stdout:9/920: mkdir d4/d36/d121 0 2024-02-15T18:27:11.846 INFO:tasks.workunit.client.1.smithi133.stdout:6/754: write d0/db/d29/d34/d5d/d40/dde/d85/fa3 [3693369,123583] 0 2024-02-15T18:27:11.848 INFO:tasks.workunit.client.1.smithi133.stdout:6/755: symlink d0/db/d29/d34/d5d/d40/dde/d85/d8e/l100 0 2024-02-15T18:27:11.848 INFO:tasks.workunit.client.1.smithi133.stdout:6/756: chown d0/db/d29/d34/d5d/d40/dde/d85/d8e/dff 104 1 2024-02-15T18:27:11.848 INFO:tasks.workunit.client.1.smithi133.stdout:6/757: write d0/db/d29/d34/d5d/d40/dde/d52/f58 [2529931,82917] 0 2024-02-15T18:27:11.849 INFO:tasks.workunit.client.0.smithi084.stdout:2/828: mknod d3/d5/d53/dca/d91/c10d 0 2024-02-15T18:27:11.849 INFO:tasks.workunit.client.0.smithi084.stdout:9/921: mknod d4/dc2/def/c122 0 2024-02-15T18:27:11.849 INFO:tasks.workunit.client.0.smithi084.stdout:9/922: chown d4/d3d/lc0 123804418 1 2024-02-15T18:27:11.849 INFO:tasks.workunit.client.0.smithi084.stdout:9/923: stat d4/d36/d6f/lec 0 2024-02-15T18:27:11.850 INFO:tasks.workunit.client.1.smithi133.stdout:2/533: dwrite d7/d2c/d3b/f50 [0,4194304] 0 2024-02-15T18:27:11.850 INFO:tasks.workunit.client.1.smithi133.stdout:2/534: chown d7/d18/d32/d65/d54/f83 28541712 1 2024-02-15T18:27:11.850 INFO:tasks.workunit.client.0.smithi084.stdout:2/829: unlink d3/dc6/c9f 0 2024-02-15T18:27:11.850 INFO:tasks.workunit.client.1.smithi133.stdout:6/758: truncate d0/db/d29/d34/d5d/d40/dde/d9d/db3/f56 756253 0 2024-02-15T18:27:11.852 INFO:tasks.workunit.client.0.smithi084.stdout:9/924: mkdir d4/da3/dc3/de1/dcb/d123 0 2024-02-15T18:27:11.852 INFO:tasks.workunit.client.0.smithi084.stdout:2/830: getdents d3/d5/d53/dca/d7b/d105/d2d 0 2024-02-15T18:27:11.852 INFO:tasks.workunit.client.1.smithi133.stdout:2/535: mknod d7/d2c/d3b/d48/d59/d74/cac 0 2024-02-15T18:27:11.854 INFO:tasks.workunit.client.0.smithi084.stdout:2/831: creat d3/d5/d53/dca/d7b/d105/d74/db9/de8/f10e x:0 0 0 2024-02-15T18:27:11.855 INFO:tasks.workunit.client.1.smithi133.stdout:6/759: symlink d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/de4/l101 0 2024-02-15T18:27:11.856 INFO:tasks.workunit.client.1.smithi133.stdout:6/760: fsync d0/f24 0 2024-02-15T18:27:11.856 INFO:tasks.workunit.client.1.smithi133.stdout:6/761: truncate d0/d62/fd0 934414 0 2024-02-15T18:27:11.856 INFO:tasks.workunit.client.1.smithi133.stdout:6/762: truncate d0/db/d29/d34/d5d/d40/dde/d9d/fba 511807 0 2024-02-15T18:27:11.856 INFO:tasks.workunit.client.1.smithi133.stdout:6/763: readlink d0/db/d29/d34/d5d/d40/dde/d9d/db3/l69 0 2024-02-15T18:27:11.856 INFO:tasks.workunit.client.1.smithi133.stdout:2/536: rmdir d7/d2c/d5a/d66 39 2024-02-15T18:27:11.856 INFO:tasks.workunit.client.1.smithi133.stdout:2/537: chown d7/d18/d32/d65/d58/f64 1327 1 2024-02-15T18:27:11.856 INFO:tasks.workunit.client.1.smithi133.stdout:2/538: chown d7/d18/d32/d65/d58/f9e 6084461 1 2024-02-15T18:27:11.857 INFO:tasks.workunit.client.1.smithi133.stdout:2/539: write d7/f30 [2363878,81313] 0 2024-02-15T18:27:11.858 INFO:tasks.workunit.client.0.smithi084.stdout:2/832: dread d3/f94 [0,4194304] 0 2024-02-15T18:27:11.859 INFO:tasks.workunit.client.1.smithi133.stdout:6/764: creat d0/db/d29/d34/d5d/d40/f102 x:0 0 0 2024-02-15T18:27:11.863 INFO:tasks.workunit.client.0.smithi084.stdout:9/925: dread d4/dc2/f112 [0,4194304] 0 2024-02-15T18:27:11.863 INFO:tasks.workunit.client.0.smithi084.stdout:2/833: creat d3/d9e/f10f x:0 0 0 2024-02-15T18:27:11.868 INFO:tasks.workunit.client.1.smithi133.stdout:6/765: unlink d0/db/d29/d34/d48/da1/lce 0 2024-02-15T18:27:11.869 INFO:tasks.workunit.client.0.smithi084.stdout:7/897: dwrite df/d1d/d1a/f53 [0,4194304] 0 2024-02-15T18:27:11.869 INFO:tasks.workunit.client.0.smithi084.stdout:4/950: dwrite d2/d2b/d47/d31/fa6 [0,4194304] 0 2024-02-15T18:27:11.874 INFO:tasks.workunit.client.0.smithi084.stdout:7/898: write df/f32 [282716,68888] 0 2024-02-15T18:27:11.877 INFO:tasks.workunit.client.0.smithi084.stdout:4/951: mkdir d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/d117 0 2024-02-15T18:27:11.878 INFO:tasks.workunit.client.0.smithi084.stdout:7/899: link df/d1d/d1a/d6a/d8b/da5/db6/df5/d125/l11c df/d1d/d44/dbb/df8/l128 0 2024-02-15T18:27:11.881 INFO:tasks.workunit.client.0.smithi084.stdout:4/952: rename d2/d4/d28/c7c to d2/d4/d28/d3d/d5c/d5d/c118 0 2024-02-15T18:27:11.885 INFO:tasks.workunit.client.0.smithi084.stdout:4/953: write d2/d4/d28/d3d/da4/fc2 [243783,19408] 0 2024-02-15T18:27:11.889 INFO:tasks.workunit.client.0.smithi084.stdout:4/954: dread d2/f39 [0,4194304] 0 2024-02-15T18:27:11.889 INFO:tasks.workunit.client.1.smithi133.stdout:2/540: dwrite d7/d2c/f44 [0,4194304] 0 2024-02-15T18:27:11.890 INFO:tasks.workunit.client.1.smithi133.stdout:2/541: truncate d7/d2c/d3b/d48/f9f 489574 0 2024-02-15T18:27:11.890 INFO:tasks.workunit.client.1.smithi133.stdout:2/542: readlink d7/d2c/d31/l37 0 2024-02-15T18:27:11.890 INFO:tasks.workunit.client.1.smithi133.stdout:2/543: write d7/d2c/d31/f88 [296876,121293] 0 2024-02-15T18:27:11.890 INFO:tasks.workunit.client.1.smithi133.stdout:2/544: stat d7/d18/d32/l76 0 2024-02-15T18:27:11.897 INFO:tasks.workunit.client.1.smithi133.stdout:2/545: symlink d7/d2c/lad 0 2024-02-15T18:27:11.899 INFO:tasks.workunit.client.1.smithi133.stdout:2/546: dread d7/d18/d32/d65/d58/f84 [0,4194304] 0 2024-02-15T18:27:11.901 INFO:tasks.workunit.client.0.smithi084.stdout:2/834: dwrite d3/d19/d108/f56 [0,4194304] 0 2024-02-15T18:27:11.901 INFO:tasks.workunit.client.0.smithi084.stdout:2/835: fdatasync d3/d5/d53/de9/ffc 0 2024-02-15T18:27:11.902 INFO:tasks.workunit.client.0.smithi084.stdout:7/900: dwrite df/d1d/d1a/d4b/fee [0,4194304] 0 2024-02-15T18:27:11.903 INFO:tasks.workunit.client.0.smithi084.stdout:2/836: dread d3/fc [0,4194304] 0 2024-02-15T18:27:11.903 INFO:tasks.workunit.client.0.smithi084.stdout:2/837: chown d3/d5/d53/dca/f32 6952 1 2024-02-15T18:27:11.903 INFO:tasks.workunit.client.0.smithi084.stdout:2/838: write d3/d5/d53/dca/d7b/d105/d1e/f58 [1595282,62309] 0 2024-02-15T18:27:11.904 INFO:tasks.workunit.client.0.smithi084.stdout:7/901: creat df/d1d/d44/db9/f129 x:0 0 0 2024-02-15T18:27:11.904 INFO:tasks.workunit.client.0.smithi084.stdout:7/902: truncate df/d1d/d1a/d6a/fe6 1022080 0 2024-02-15T18:27:11.905 INFO:tasks.workunit.client.0.smithi084.stdout:7/903: symlink df/d1d/d1a/dd1/l12a 0 2024-02-15T18:27:11.905 INFO:tasks.workunit.client.0.smithi084.stdout:7/904: truncate df/d1d/d1a/d6a/d8b/da5/f10d 1965968 0 2024-02-15T18:27:11.908 INFO:tasks.workunit.client.0.smithi084.stdout:7/905: rmdir df/d1d/d1a/d6a/d8b/da5/db6/de5/d101 0 2024-02-15T18:27:11.908 INFO:tasks.workunit.client.0.smithi084.stdout:9/926: dwrite d4/d2b/d3c/d24/f2a [0,4194304] 0 2024-02-15T18:27:11.909 INFO:tasks.workunit.client.0.smithi084.stdout:7/906: dread df/d1d/d1a/dd1/f114 [0,4194304] 0 2024-02-15T18:27:11.909 INFO:tasks.workunit.client.0.smithi084.stdout:2/839: dread d3/faf [0,4194304] 0 2024-02-15T18:27:11.909 INFO:tasks.workunit.client.0.smithi084.stdout:2/840: chown d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/f8f 1912 1 2024-02-15T18:27:11.910 INFO:tasks.workunit.client.0.smithi084.stdout:9/927: mknod d4/d2b/d3c/d20/d75/d87/de2/dea/c124 0 2024-02-15T18:27:11.911 INFO:tasks.workunit.client.0.smithi084.stdout:2/841: mknod d3/dc6/c110 0 2024-02-15T18:27:11.911 INFO:tasks.workunit.client.0.smithi084.stdout:4/955: dwrite d2/d64/d74/feb [0,4194304] 0 2024-02-15T18:27:11.911 INFO:tasks.workunit.client.0.smithi084.stdout:7/907: dread df/d1d/d44/dbb/df8/ff7 [0,4194304] 0 2024-02-15T18:27:11.912 INFO:tasks.workunit.client.0.smithi084.stdout:7/908: write df/d1d/d1a/d6a/d8e/d79/fc3 [316062,116072] 0 2024-02-15T18:27:11.913 INFO:tasks.workunit.client.1.smithi133.stdout:2/547: dread d7/d2c/d31/f4b [0,4194304] 0 2024-02-15T18:27:11.913 INFO:tasks.workunit.client.1.smithi133.stdout:2/548: chown d7/d2c/d31/l37 0 1 2024-02-15T18:27:11.913 INFO:tasks.workunit.client.0.smithi084.stdout:9/928: mknod d4/da3/dc3/de1/c125 0 2024-02-15T18:27:11.913 INFO:tasks.workunit.client.0.smithi084.stdout:9/929: dread - d4/d81/ffd zero size 2024-02-15T18:27:11.913 INFO:tasks.workunit.client.0.smithi084.stdout:9/930: write d4/d36/d6f/f109 [93596,123508] 0 2024-02-15T18:27:11.913 INFO:tasks.workunit.client.0.smithi084.stdout:9/931: dread - d4/d81/ffd zero size 2024-02-15T18:27:11.913 INFO:tasks.workunit.client.0.smithi084.stdout:9/932: getdents d4/d3d 0 2024-02-15T18:27:11.914 INFO:tasks.workunit.client.1.smithi133.stdout:2/549: mknod d7/cae 0 2024-02-15T18:27:11.917 INFO:tasks.workunit.client.1.smithi133.stdout:2/550: unlink d7/d2c/d3b/c89 0 2024-02-15T18:27:11.918 INFO:tasks.workunit.client.0.smithi084.stdout:2/842: creat d3/d5/d53/dca/d7b/d105/d74/f111 x:0 0 0 2024-02-15T18:27:11.918 INFO:tasks.workunit.client.0.smithi084.stdout:4/956: getdents d2/d4/d28/d3d/d5c/d65/d9f 0 2024-02-15T18:27:11.918 INFO:tasks.workunit.client.1.smithi133.stdout:2/551: creat d7/d2c/d3b/d48/faf x:0 0 0 2024-02-15T18:27:11.919 INFO:tasks.workunit.client.1.smithi133.stdout:2/552: chown d7/d2c/c62 56882662 1 2024-02-15T18:27:11.920 INFO:tasks.workunit.client.0.smithi084.stdout:9/933: stat d4/d2b/d3c/c57 0 2024-02-15T18:27:11.920 INFO:tasks.workunit.client.0.smithi084.stdout:2/843: mkdir d3/d5/d53/dca/d89/dec/d100/d112 0 2024-02-15T18:27:11.922 INFO:tasks.workunit.client.0.smithi084.stdout:4/957: unlink d2/f17 0 2024-02-15T18:27:11.924 INFO:tasks.workunit.client.0.smithi084.stdout:9/934: creat d4/da3/dc3/de1/dcb/f126 x:0 0 0 2024-02-15T18:27:11.925 INFO:tasks.workunit.client.0.smithi084.stdout:2/844: truncate d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/f5f 1280022 0 2024-02-15T18:27:11.927 INFO:tasks.workunit.client.0.smithi084.stdout:2/845: creat d3/d5/d53/dca/d7b/d105/d74/f113 x:0 0 0 2024-02-15T18:27:11.928 INFO:tasks.workunit.client.0.smithi084.stdout:2/846: creat d3/d5/d53/dca/d7b/d105/d74/f114 x:0 0 0 2024-02-15T18:27:11.928 INFO:tasks.workunit.client.0.smithi084.stdout:2/847: getdents d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3 0 2024-02-15T18:27:11.928 INFO:tasks.workunit.client.0.smithi084.stdout:2/848: truncate d3/d19/d108/de7/f10c 225108 0 2024-02-15T18:27:11.930 INFO:tasks.workunit.client.0.smithi084.stdout:2/849: unlink d3/d5/d53/dca/db8/ced 0 2024-02-15T18:27:11.930 INFO:tasks.workunit.client.0.smithi084.stdout:2/850: write d3/d5/d53/dca/d7b/d105/d1e/f104 [995105,59048] 0 2024-02-15T18:27:11.933 INFO:tasks.workunit.client.0.smithi084.stdout:2/851: unlink d3/d5/d53/dca/d7b/d105/d74/fac 0 2024-02-15T18:27:11.936 INFO:tasks.workunit.client.0.smithi084.stdout:2/852: rename d3/d28/f85 to d3/d5/d53/dca/d7b/d105/d1e/d30/f115 0 2024-02-15T18:27:11.937 INFO:tasks.workunit.client.0.smithi084.stdout:2/853: write d3/d19/d75/fd5 [144474,2765] 0 2024-02-15T18:27:11.937 INFO:tasks.workunit.client.0.smithi084.stdout:2/854: write d3/d5/d53/dca/d7b/d105/d74/f77 [1471693,62496] 0 2024-02-15T18:27:11.937 INFO:tasks.workunit.client.0.smithi084.stdout:2/855: getdents d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c 0 2024-02-15T18:27:11.939 INFO:tasks.workunit.client.0.smithi084.stdout:2/856: creat d3/d28/f116 x:0 0 0 2024-02-15T18:27:11.958 INFO:tasks.workunit.client.0.smithi084.stdout:7/909: dwrite df/d1d/d1a/dd1/f114 [0,4194304] 0 2024-02-15T18:27:11.958 INFO:tasks.workunit.client.0.smithi084.stdout:7/910: truncate df/d1d/d1a/d4d/d103/fd4 895409 0 2024-02-15T18:27:11.962 INFO:tasks.workunit.client.1.smithi133.stdout:2/553: dwrite d7/db/f1d [4194304,4194304] 0 2024-02-15T18:27:11.963 INFO:tasks.workunit.client.1.smithi133.stdout:2/554: readlink d7/l17 0 2024-02-15T18:27:11.963 INFO:tasks.workunit.client.1.smithi133.stdout:2/555: readlink d7/d2c/d46/l4f 0 2024-02-15T18:27:11.963 INFO:tasks.workunit.client.0.smithi084.stdout:2/857: dread d3/d19/d75/fd5 [0,4194304] 0 2024-02-15T18:27:11.964 INFO:tasks.workunit.client.1.smithi133.stdout:2/556: symlink d7/d18/d32/d65/lb0 0 2024-02-15T18:27:11.964 INFO:tasks.workunit.client.1.smithi133.stdout:2/557: rmdir d7/d2c/d5a/d66/d70 39 2024-02-15T18:27:11.966 INFO:tasks.workunit.client.0.smithi084.stdout:4/958: dwrite d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/f97 [0,4194304] 0 2024-02-15T18:27:11.966 INFO:tasks.workunit.client.0.smithi084.stdout:9/935: dwrite d4/da3/dc3/de1/dcb/f126 [0,4194304] 0 2024-02-15T18:27:11.966 INFO:tasks.workunit.client.0.smithi084.stdout:9/936: write d4/d81/fd7 [827920,2609] 0 2024-02-15T18:27:11.966 INFO:tasks.workunit.client.0.smithi084.stdout:4/959: read d2/d4/d28/d3d/d5c/d5d/f106 [996902,29449] 0 2024-02-15T18:27:11.970 INFO:tasks.workunit.client.0.smithi084.stdout:4/960: dread d2/d4/f82 [0,4194304] 0 2024-02-15T18:27:11.970 INFO:tasks.workunit.client.0.smithi084.stdout:7/911: mkdir df/d1d/d1a/d12b 0 2024-02-15T18:27:11.973 INFO:tasks.workunit.client.0.smithi084.stdout:2/858: rename d3/d5/d53/dca/d7b/d105/d74 to d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3/d117 0 2024-02-15T18:27:11.975 INFO:tasks.workunit.client.1.smithi133.stdout:2/558: dread d7/db/f43 [0,4194304] 0 2024-02-15T18:27:11.975 INFO:tasks.workunit.client.1.smithi133.stdout:2/559: chown d7/d18/d32/d65/f56 113005590 1 2024-02-15T18:27:11.977 INFO:tasks.workunit.client.1.smithi133.stdout:2/560: creat d7/db/d35/fb1 x:0 0 0 2024-02-15T18:27:11.977 INFO:tasks.workunit.client.0.smithi084.stdout:4/961: dread d2/f21 [0,4194304] 0 2024-02-15T18:27:11.980 INFO:tasks.workunit.client.1.smithi133.stdout:2/561: unlink d7/le 0 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:4/403: sync 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:8/516: sync 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:3/626: sync 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:4/404: chown d2/d5/l16 58014499 1 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:3/627: write d0/d15/d54/f8a [4646589,31899] 0 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:1/732: sync 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:9/472: sync 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:7/437: sync 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:7/438: chown d9/db/dc/l8d 1 1 2024-02-15T18:27:11.982 INFO:tasks.workunit.client.1.smithi133.stdout:0/624: sync 2024-02-15T18:27:11.983 INFO:tasks.workunit.client.1.smithi133.stdout:7/439: fdatasync d9/d36/d39/f52 0 2024-02-15T18:27:11.984 INFO:tasks.workunit.client.1.smithi133.stdout:0/625: truncate d9/d10/d19/d29/d67/d68/d9c/da7/fbf 352474 0 2024-02-15T18:27:11.984 INFO:tasks.workunit.client.1.smithi133.stdout:5/477: sync 2024-02-15T18:27:11.984 INFO:tasks.workunit.client.1.smithi133.stdout:8/517: read d3/de/f25 [496814,102547] 0 2024-02-15T18:27:11.984 INFO:tasks.workunit.client.1.smithi133.stdout:6/766: sync 2024-02-15T18:27:11.984 INFO:tasks.workunit.client.1.smithi133.stdout:6/767: fdatasync d0/f12 0 2024-02-15T18:27:11.985 INFO:tasks.workunit.client.1.smithi133.stdout:2/562: rename d7/db/d35/l94 to d7/d18/d32/d65/lb2 0 2024-02-15T18:27:11.985 INFO:tasks.workunit.client.1.smithi133.stdout:9/473: mknod d0/d37/c98 0 2024-02-15T18:27:11.985 INFO:tasks.workunit.client.0.smithi084.stdout:9/937: creat d4/da3/d10d/f127 x:0 0 0 2024-02-15T18:27:11.986 INFO:tasks.workunit.client.0.smithi084.stdout:7/912: symlink df/d1d/d1a/d4b/l12c 0 2024-02-15T18:27:11.986 INFO:tasks.workunit.client.0.smithi084.stdout:4/962: creat d2/d64/d74/de9/f119 x:0 0 0 2024-02-15T18:27:11.986 INFO:tasks.workunit.client.0.smithi084.stdout:9/938: write d4/d81/fb3 [108502,101741] 0 2024-02-15T18:27:11.986 INFO:tasks.workunit.client.1.smithi133.stdout:2/563: creat d7/d2c/d3b/d48/fb3 x:0 0 0 2024-02-15T18:27:11.990 INFO:tasks.workunit.client.1.smithi133.stdout:2/564: getdents d7/d2c/d5a/d66/d70 0 2024-02-15T18:27:11.991 INFO:tasks.workunit.client.1.smithi133.stdout:7/440: rename d9/db/dc/f30 to d9/db/d55/d63/f96 0 2024-02-15T18:27:11.991 INFO:tasks.workunit.client.1.smithi133.stdout:4/405: dread d2/d5/d2b/d21/f1b [0,4194304] 0 2024-02-15T18:27:11.991 INFO:tasks.workunit.client.1.smithi133.stdout:7/441: write d9/db/d16/d5d/d68/f70 [480057,1242] 0 2024-02-15T18:27:11.993 INFO:tasks.workunit.client.1.smithi133.stdout:2/565: symlink d7/d2c/d5a/d66/d70/lb4 0 2024-02-15T18:27:11.993 INFO:tasks.workunit.client.0.smithi084.stdout:7/913: getdents df/d1d/d44/d96 0 2024-02-15T18:27:11.995 INFO:tasks.workunit.client.0.smithi084.stdout:4/963: getdents d2/d4/d28 0 2024-02-15T18:27:11.996 INFO:tasks.workunit.client.1.smithi133.stdout:6/768: dread d0/f9 [0,4194304] 0 2024-02-15T18:27:11.996 INFO:tasks.workunit.client.1.smithi133.stdout:6/769: write d0/db/d29/d34/d5d/d40/dde/d78/fae [1116494,49510] 0 2024-02-15T18:27:11.996 INFO:tasks.workunit.client.1.smithi133.stdout:4/406: getdents d2/d5/d2b/d21/d3b/d49/d65 0 2024-02-15T18:27:11.997 INFO:tasks.workunit.client.1.smithi133.stdout:8/518: rename d3/d1c/d2f/d87/f79 to d3/d1f/fa7 0 2024-02-15T18:27:11.997 INFO:tasks.workunit.client.0.smithi084.stdout:7/914: rename df/d1d/f18 to df/d1d/d1a/d6a/d8b/da5/db6/df5/d125/f12d 0 2024-02-15T18:27:12.001 INFO:tasks.workunit.client.0.smithi084.stdout:7/915: mkdir df/d1d/d1a/dd1/d111/d12e 0 2024-02-15T18:27:12.001 INFO:tasks.workunit.client.1.smithi133.stdout:4/407: unlink d2/d5/d2b/d21/f1b 0 2024-02-15T18:27:12.001 INFO:tasks.workunit.client.1.smithi133.stdout:4/408: fdatasync d2/d5/d2b/d21/d2d/d44/d51/f52 0 2024-02-15T18:27:12.003 INFO:tasks.workunit.client.1.smithi133.stdout:8/519: write d3/d1c/d2f/d76/f77 [3951841,126788] 0 2024-02-15T18:27:12.005 INFO:tasks.workunit.client.1.smithi133.stdout:9/474: rename d0/d8/d9/d12/d82/d42/f59 to d0/d8/d9/d12/d82/d89/f99 0 2024-02-15T18:27:12.005 INFO:tasks.workunit.client.1.smithi133.stdout:9/475: chown d0/d8/l91 13579602 1 2024-02-15T18:27:12.006 INFO:tasks.workunit.client.1.smithi133.stdout:4/409: symlink d2/d48/d5c/l8a 0 2024-02-15T18:27:12.006 INFO:tasks.workunit.client.1.smithi133.stdout:4/410: dread - d2/f72 zero size 2024-02-15T18:27:12.008 INFO:tasks.workunit.client.1.smithi133.stdout:8/520: rmdir d3/d1c/d2f/d87/d73/d84 39 2024-02-15T18:27:12.008 INFO:tasks.workunit.client.0.smithi084.stdout:7/916: dread df/d1d/d1a/d6a/d8e/fce [0,4194304] 0 2024-02-15T18:27:12.009 INFO:tasks.workunit.client.1.smithi133.stdout:9/476: mknod d0/d8/d9/d12/d82/d89/c9a 0 2024-02-15T18:27:12.010 INFO:tasks.workunit.client.1.smithi133.stdout:9/477: fsync d0/d8/d9/f8c 0 2024-02-15T18:27:12.010 INFO:tasks.workunit.client.1.smithi133.stdout:9/478: rename d0/d8 to d0/d8/d9/d12/d82/d42/d9b 22 2024-02-15T18:27:12.013 INFO:tasks.workunit.client.0.smithi084.stdout:4/964: dread d2/f3 [0,4194304] 0 2024-02-15T18:27:12.015 INFO:tasks.workunit.client.1.smithi133.stdout:0/626: dread d9/d10/d19/f3d [4194304,4194304] 0 2024-02-15T18:27:12.015 INFO:tasks.workunit.client.1.smithi133.stdout:0/627: chown d9/d10/d19/d29/d67/d68/cb5 65328 1 2024-02-15T18:27:12.015 INFO:tasks.workunit.client.1.smithi133.stdout:0/628: fdatasync d9/fb 0 2024-02-15T18:27:12.016 INFO:tasks.workunit.client.1.smithi133.stdout:2/566: write d7/d2c/d3b/f50 [2851836,129375] 0 2024-02-15T18:27:12.018 INFO:tasks.workunit.client.1.smithi133.stdout:8/521: dread d3/d7/f4d [0,4194304] 0 2024-02-15T18:27:12.019 INFO:tasks.workunit.client.1.smithi133.stdout:0/629: link d9/d10/d2c/f65 d9/d10/d47/d5e/fd4 0 2024-02-15T18:27:12.019 INFO:tasks.workunit.client.0.smithi084.stdout:2/859: dwrite d3/d5/d53/dca/d7b/d105/d1e/f104 [0,4194304] 0 2024-02-15T18:27:12.020 INFO:tasks.workunit.client.1.smithi133.stdout:1/733: dwrite d6/d1e/d3a/d97/dda/f103 [0,4194304] 0 2024-02-15T18:27:12.020 INFO:tasks.workunit.client.0.smithi084.stdout:5/953: sync 2024-02-15T18:27:12.021 INFO:tasks.workunit.client.0.smithi084.stdout:3/789: sync 2024-02-15T18:27:12.021 INFO:tasks.workunit.client.0.smithi084.stdout:8/832: sync 2024-02-15T18:27:12.021 INFO:tasks.workunit.client.0.smithi084.stdout:6/826: sync 2024-02-15T18:27:12.021 INFO:tasks.workunit.client.0.smithi084.stdout:0/850: sync 2024-02-15T18:27:12.021 INFO:tasks.workunit.client.0.smithi084.stdout:1/835: sync 2024-02-15T18:27:12.022 INFO:tasks.workunit.client.0.smithi084.stdout:4/965: dread d2/d4/d28/d2e/f77 [0,4194304] 0 2024-02-15T18:27:12.022 INFO:tasks.workunit.client.0.smithi084.stdout:4/966: dread - d2/d2b/d47/d31/d61/fa0 zero size 2024-02-15T18:27:12.023 INFO:tasks.workunit.client.1.smithi133.stdout:3/628: dread d0/d15/f3b [0,4194304] 0 2024-02-15T18:27:12.024 INFO:tasks.workunit.client.1.smithi133.stdout:8/522: mkdir d3/d1f/d3f/d58/da8 0 2024-02-15T18:27:12.024 INFO:tasks.workunit.client.1.smithi133.stdout:6/770: dread d0/db/d29/d34/d5d/d40/dde/d85/fa3 [0,4194304] 0 2024-02-15T18:27:12.024 INFO:tasks.workunit.client.1.smithi133.stdout:0/630: creat d9/d10/d19/d29/d67/d68/d96/d44/fd5 x:0 0 0 2024-02-15T18:27:12.027 INFO:tasks.workunit.client.0.smithi084.stdout:3/790: mkdir d8/d73/db9/dca/d107 0 2024-02-15T18:27:12.027 INFO:tasks.workunit.client.0.smithi084.stdout:3/791: chown d8/d40/d43/l47 15871271 1 2024-02-15T18:27:12.028 INFO:tasks.workunit.client.0.smithi084.stdout:8/833: mkdir db/dd/d13/de0/d117 0 2024-02-15T18:27:12.029 INFO:tasks.workunit.client.1.smithi133.stdout:5/478: dwrite d17/d20/f23 [0,4194304] 0 2024-02-15T18:27:12.030 INFO:tasks.workunit.client.1.smithi133.stdout:1/734: creat d6/d1e/f10f x:0 0 0 2024-02-15T18:27:12.031 INFO:tasks.workunit.client.0.smithi084.stdout:0/851: creat d0/d4/da8/dd8/f100 x:0 0 0 2024-02-15T18:27:12.031 INFO:tasks.workunit.client.0.smithi084.stdout:1/836: creat d9/d54/d1b/d2c/d4b/d4c/da9/f111 x:0 0 0 2024-02-15T18:27:12.032 INFO:tasks.workunit.client.1.smithi133.stdout:2/567: write d7/db/d67/d7b/f97 [483808,34963] 0 2024-02-15T18:27:12.033 INFO:tasks.workunit.client.1.smithi133.stdout:3/629: link d0/d15/f67 d0/d15/d2f/d9b/d39/fc7 0 2024-02-15T18:27:12.035 INFO:tasks.workunit.client.0.smithi084.stdout:4/967: unlink d2/d2b/d47/d31/fce 0 2024-02-15T18:27:12.036 INFO:tasks.workunit.client.0.smithi084.stdout:3/792: truncate d8/d73/f86 2691476 0 2024-02-15T18:27:12.036 INFO:tasks.workunit.client.0.smithi084.stdout:8/834: mknod db/daf/db6/c118 0 2024-02-15T18:27:12.036 INFO:tasks.workunit.client.0.smithi084.stdout:8/835: chown db/dd/d1f/ccb 0 1 2024-02-15T18:27:12.036 INFO:tasks.workunit.client.1.smithi133.stdout:8/523: creat d3/d1c/fa9 x:0 0 0 2024-02-15T18:27:12.036 INFO:tasks.workunit.client.1.smithi133.stdout:2/568: read d7/d2c/d3b/d48/d59/d74/f7a [1147522,33575] 0 2024-02-15T18:27:12.037 INFO:tasks.workunit.client.1.smithi133.stdout:6/771: symlink d0/d62/l103 0 2024-02-15T18:27:12.037 INFO:tasks.workunit.client.0.smithi084.stdout:3/793: creat d8/d40/d43/f108 x:0 0 0 2024-02-15T18:27:12.038 INFO:tasks.workunit.client.1.smithi133.stdout:1/735: creat d6/d2a/d59/d5a/f110 x:0 0 0 2024-02-15T18:27:12.040 INFO:tasks.workunit.client.1.smithi133.stdout:3/630: link d0/d15/d2f/d9b/d62/lb2 d0/d15/d2f/d9b/lc8 0 2024-02-15T18:27:12.040 INFO:tasks.workunit.client.1.smithi133.stdout:5/479: write d17/d20/f57 [3581642,95226] 0 2024-02-15T18:27:12.041 INFO:tasks.workunit.client.1.smithi133.stdout:5/480: truncate d17/d20/d32/d38/f8b 436599 0 2024-02-15T18:27:12.041 INFO:tasks.workunit.client.1.smithi133.stdout:7/442: dwrite f6 [0,4194304] 0 2024-02-15T18:27:12.041 INFO:tasks.workunit.client.1.smithi133.stdout:0/631: dread d9/ff [0,4194304] 0 2024-02-15T18:27:12.045 INFO:tasks.workunit.client.1.smithi133.stdout:3/631: creat d0/d15/d2f/d9b/d72/dbf/fc9 x:0 0 0 2024-02-15T18:27:12.045 INFO:tasks.workunit.client.1.smithi133.stdout:5/481: rename d17/d20/d4f/f76 to d17/d20/d4f/d5f/fa1 0 2024-02-15T18:27:12.045 INFO:tasks.workunit.client.1.smithi133.stdout:5/482: readlink d17/d20/d32/d38/l6f 0 2024-02-15T18:27:12.047 INFO:tasks.workunit.client.0.smithi084.stdout:1/837: dread d9/d54/d7f/db7/dd9/f67 [0,4194304] 0 2024-02-15T18:27:12.048 INFO:tasks.workunit.client.1.smithi133.stdout:0/632: mkdir d9/d28/dd6 0 2024-02-15T18:27:12.048 INFO:tasks.workunit.client.1.smithi133.stdout:0/633: dread - d9/d28/fd0 zero size 2024-02-15T18:27:12.049 INFO:tasks.workunit.client.1.smithi133.stdout:7/443: mkdir d9/d36/d3d/d4c/d97 0 2024-02-15T18:27:12.049 INFO:tasks.workunit.client.1.smithi133.stdout:0/634: write d9/d10/d22/d32/f74 [1549969,60879] 0 2024-02-15T18:27:12.049 INFO:tasks.workunit.client.1.smithi133.stdout:0/635: getdents d9/d2b/dd2 0 2024-02-15T18:27:12.049 INFO:tasks.workunit.client.1.smithi133.stdout:6/772: read d0/db/d21/f75 [423122,8696] 0 2024-02-15T18:27:12.050 INFO:tasks.workunit.client.0.smithi084.stdout:0/852: dread d0/d2f/d4b/dc6/fca [0,4194304] 0 2024-02-15T18:27:12.051 INFO:tasks.workunit.client.1.smithi133.stdout:3/632: rename d0/d15/d2f/d9b/d62/f6f to d0/d15/d2f/d9b/d39/d3f/dc1/d78/fca 0 2024-02-15T18:27:12.051 INFO:tasks.workunit.client.1.smithi133.stdout:3/633: fdatasync d0/d15/d2f/d9b/d39/d3f/fbe 0 2024-02-15T18:27:12.058 INFO:tasks.workunit.client.1.smithi133.stdout:4/411: dwrite d2/d5/d2b/d21/d2d/d44/d51/d55/f27 [0,4194304] 0 2024-02-15T18:27:12.062 INFO:tasks.workunit.client.0.smithi084.stdout:9/939: dwrite d4/d3d/f61 [0,4194304] 0 2024-02-15T18:27:12.063 INFO:tasks.workunit.client.0.smithi084.stdout:1/838: rename d9/d54/f99 to d9/d54/d7f/f112 0 2024-02-15T18:27:12.064 INFO:tasks.workunit.client.0.smithi084.stdout:0/853: creat d0/d2f/d3f/d4f/f101 x:0 0 0 2024-02-15T18:27:12.064 INFO:tasks.workunit.client.0.smithi084.stdout:1/839: chown d9/d54/d1b/d2c/d4b/f110 193 1 2024-02-15T18:27:12.064 INFO:tasks.workunit.client.0.smithi084.stdout:1/840: chown d9/d54/d32/d5b/d69/fa3 925712166 1 2024-02-15T18:27:12.065 INFO:tasks.workunit.client.1.smithi133.stdout:2/569: dread d7/db/f1d [4194304,4194304] 0 2024-02-15T18:27:12.067 INFO:tasks.workunit.client.0.smithi084.stdout:0/854: getdents d0/d4/d1b/d46 0 2024-02-15T18:27:12.067 INFO:tasks.workunit.client.1.smithi133.stdout:7/444: write d9/db/d16/f4b [1677246,69974] 0 2024-02-15T18:27:12.069 INFO:tasks.workunit.client.1.smithi133.stdout:9/479: dwrite d0/d8/d10/d4d/f5e [0,4194304] 0 2024-02-15T18:27:12.071 INFO:tasks.workunit.client.1.smithi133.stdout:7/445: mkdir d9/d36/d39/d98 0 2024-02-15T18:27:12.071 INFO:tasks.workunit.client.1.smithi133.stdout:7/446: dread - d9/db/f4a zero size 2024-02-15T18:27:12.072 INFO:tasks.workunit.client.1.smithi133.stdout:8/524: dread d3/d1c/f1e [0,4194304] 0 2024-02-15T18:27:12.072 INFO:tasks.workunit.client.1.smithi133.stdout:8/525: truncate d3/f14 5111067 0 2024-02-15T18:27:12.073 INFO:tasks.workunit.client.0.smithi084.stdout:3/794: read d8/d40/d43/d71/fb5 [2460151,61268] 0 2024-02-15T18:27:12.073 INFO:tasks.workunit.client.0.smithi084.stdout:0/855: mknod d0/d2f/d3f/d4c/d9a/c102 0 2024-02-15T18:27:12.076 INFO:tasks.workunit.client.1.smithi133.stdout:7/447: creat d9/d36/d39/f99 x:0 0 0 2024-02-15T18:27:12.076 INFO:tasks.workunit.client.1.smithi133.stdout:8/526: mknod d3/de/d3e/caa 0 2024-02-15T18:27:12.077 INFO:tasks.workunit.client.0.smithi084.stdout:6/827: dwrite d14/d22/d25/d2f/fc1 [0,4194304] 0 2024-02-15T18:27:12.080 INFO:tasks.workunit.client.1.smithi133.stdout:8/527: mkdir d3/d1f/d4f/dab 0 2024-02-15T18:27:12.081 INFO:tasks.workunit.client.1.smithi133.stdout:7/448: truncate d9/d36/d39/f5c 620546 0 2024-02-15T18:27:12.081 INFO:tasks.workunit.client.1.smithi133.stdout:9/480: read d0/f5 [2986206,80197] 0 2024-02-15T18:27:12.083 INFO:tasks.workunit.client.1.smithi133.stdout:7/449: creat d9/da/d48/d62/d64/f9a x:0 0 0 2024-02-15T18:27:12.083 INFO:tasks.workunit.client.0.smithi084.stdout:6/828: mknod d14/c10d 0 2024-02-15T18:27:12.085 INFO:tasks.workunit.client.0.smithi084.stdout:2/860: dwrite d3/d5/f18 [0,4194304] 0 2024-02-15T18:27:12.086 INFO:tasks.workunit.client.1.smithi133.stdout:9/481: rename d0/d8/d10/c76 to d0/d8/d9/d12/d82/d89/c9c 0 2024-02-15T18:27:12.088 INFO:tasks.workunit.client.1.smithi133.stdout:1/736: dwrite d6/d1e/d41/d7c/f98 [0,4194304] 0 2024-02-15T18:27:12.088 INFO:tasks.workunit.client.0.smithi084.stdout:2/861: read d3/d19/d108/f56 [2925996,101819] 0 2024-02-15T18:27:12.091 INFO:tasks.workunit.client.0.smithi084.stdout:6/829: dread d14/d22/d25/f32 [0,4194304] 0 2024-02-15T18:27:12.093 INFO:tasks.workunit.client.1.smithi133.stdout:7/450: mkdir d9/db/d16/d5d/d68/d73/d9b 0 2024-02-15T18:27:12.093 INFO:tasks.workunit.client.0.smithi084.stdout:2/862: rename d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/ffd to d3/d5/d53/dca/dc3/f118 0 2024-02-15T18:27:12.094 INFO:tasks.workunit.client.1.smithi133.stdout:9/482: link d0/d7b/c7e d0/d8/d9/d12/d82/d89/c9d 0 2024-02-15T18:27:12.094 INFO:tasks.workunit.client.1.smithi133.stdout:9/483: truncate d0/d8/d10/d4d/f66 788157 0 2024-02-15T18:27:12.094 INFO:tasks.workunit.client.0.smithi084.stdout:6/830: creat d14/d22/dd2/f10e x:0 0 0 2024-02-15T18:27:12.098 INFO:tasks.workunit.client.0.smithi084.stdout:2/863: write d3/d5/d53/dca/dc3/f118 [2773248,16550] 0 2024-02-15T18:27:12.098 INFO:tasks.workunit.client.0.smithi084.stdout:2/864: write d3/d5e/f7e [754883,129117] 0 2024-02-15T18:27:12.098 INFO:tasks.workunit.client.0.smithi084.stdout:2/865: write d3/d28/f116 [325016,125587] 0 2024-02-15T18:27:12.098 INFO:tasks.workunit.client.1.smithi133.stdout:3/634: dwrite d0/d15/d2f/d9b/d39/d3f/dc1/d78/fca [0,4194304] 0 2024-02-15T18:27:12.101 INFO:tasks.workunit.client.0.smithi084.stdout:0/856: dread d0/d39/d45/fb7 [0,4194304] 0 2024-02-15T18:27:12.104 INFO:tasks.workunit.client.0.smithi084.stdout:6/831: creat d14/d22/d25/d2f/d31/d30/d45/d52/dd5/f10f x:0 0 0 2024-02-15T18:27:12.104 INFO:tasks.workunit.client.1.smithi133.stdout:1/737: creat d6/d1e/d41/d7c/d7e/d7f/db6/f111 x:0 0 0 2024-02-15T18:27:12.105 INFO:tasks.workunit.client.1.smithi133.stdout:7/451: mkdir d9/db/d16/d5d/d68/d73/d9c 0 2024-02-15T18:27:12.106 INFO:tasks.workunit.client.0.smithi084.stdout:2/866: creat d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/f119 x:0 0 0 2024-02-15T18:27:12.108 INFO:tasks.workunit.client.0.smithi084.stdout:6/832: rename d14/d22/d25/d2f/d31/d3f/dba to d14/d22/d25/d28/d110 0 2024-02-15T18:27:12.109 INFO:tasks.workunit.client.0.smithi084.stdout:2/867: mknod d3/d5/d53/dca/d89/dec/c11a 0 2024-02-15T18:27:12.110 INFO:tasks.workunit.client.1.smithi133.stdout:3/635: creat d0/d15/d2f/d9b/d9d/fcb x:0 0 0 2024-02-15T18:27:12.111 INFO:tasks.workunit.client.1.smithi133.stdout:1/738: mknod d6/d89/c112 0 2024-02-15T18:27:12.111 INFO:tasks.workunit.client.1.smithi133.stdout:7/452: mknod d9/db/d16/d5d/d68/d73/d9b/c9d 0 2024-02-15T18:27:12.115 INFO:tasks.workunit.client.1.smithi133.stdout:1/739: rename d6/d1e/f10f to d6/d1e/d3a/d79/dbd/f113 0 2024-02-15T18:27:12.115 INFO:tasks.workunit.client.1.smithi133.stdout:7/453: symlink d9/d36/d3d/l9e 0 2024-02-15T18:27:12.116 INFO:tasks.workunit.client.1.smithi133.stdout:1/740: stat d6/d1e/d3a/d9e/cb8 0 2024-02-15T18:27:12.116 INFO:tasks.workunit.client.1.smithi133.stdout:1/741: rename d6 to d6/d1e/d3a/d82/d114 22 2024-02-15T18:27:12.117 INFO:tasks.workunit.client.0.smithi084.stdout:2/868: rename d3/d28 to d3/d5/d53/dca/d11b 0 2024-02-15T18:27:12.117 INFO:tasks.workunit.client.0.smithi084.stdout:2/869: chown d3/d5/d53/dca/d11b 54267 1 2024-02-15T18:27:12.117 INFO:tasks.workunit.client.1.smithi133.stdout:2/570: dread d7/d2c/d5a/f85 [0,4194304] 0 2024-02-15T18:27:12.117 INFO:tasks.workunit.client.1.smithi133.stdout:2/571: write d7/f14 [1405705,93090] 0 2024-02-15T18:27:12.120 INFO:tasks.workunit.client.0.smithi084.stdout:2/870: unlink d3/d5/d53/dca/d11b/f78 0 2024-02-15T18:27:12.120 INFO:tasks.workunit.client.0.smithi084.stdout:2/871: write d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3/d117/db9/de8/f10e [687355,121208] 0 2024-02-15T18:27:12.121 INFO:tasks.workunit.client.1.smithi133.stdout:1/742: creat d6/d1e/d41/f115 x:0 0 0 2024-02-15T18:27:12.128 INFO:tasks.workunit.client.1.smithi133.stdout:8/528: read d3/d1c/d2f/d76/f77 [2643497,121906] 0 2024-02-15T18:27:12.129 INFO:tasks.workunit.client.0.smithi084.stdout:4/968: dwrite d2/d2b/d47/ff1 [0,4194304] 0 2024-02-15T18:27:12.129 INFO:tasks.workunit.client.0.smithi084.stdout:6/833: dread d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/f7d [0,4194304] 0 2024-02-15T18:27:12.129 INFO:tasks.workunit.client.0.smithi084.stdout:6/834: fsync d14/d22/d25/f35 0 2024-02-15T18:27:12.129 INFO:tasks.workunit.client.1.smithi133.stdout:8/529: dread d3/de/f53 [0,4194304] 0 2024-02-15T18:27:12.133 INFO:tasks.workunit.client.1.smithi133.stdout:0/636: dwrite d9/d2b/f6c [0,4194304] 0 2024-02-15T18:27:12.133 INFO:tasks.workunit.client.1.smithi133.stdout:0/637: stat d9/d10/d2c/f8a 0 2024-02-15T18:27:12.133 INFO:tasks.workunit.client.1.smithi133.stdout:0/638: fdatasync d9/d10/d22/d32/fc3 0 2024-02-15T18:27:12.133 INFO:tasks.workunit.client.1.smithi133.stdout:4/412: dwrite d2/d5/f10 [0,4194304] 0 2024-02-15T18:27:12.133 INFO:tasks.workunit.client.1.smithi133.stdout:4/413: truncate d2/d5/d2b/f1d 774783 0 2024-02-15T18:27:12.133 INFO:tasks.workunit.client.1.smithi133.stdout:4/414: readlink d2/l45 0 2024-02-15T18:27:12.133 INFO:tasks.workunit.client.1.smithi133.stdout:4/415: chown d2/d5/d2b/l41 32798 1 2024-02-15T18:27:12.133 INFO:tasks.workunit.client.1.smithi133.stdout:8/530: rename d3/f42 to d3/d1c/d2f/d87/fac 0 2024-02-15T18:27:12.134 INFO:tasks.workunit.client.0.smithi084.stdout:1/841: dwrite d9/d54/d7f/db7/dd9/df7/d89/f98 [0,4194304] 0 2024-02-15T18:27:12.134 INFO:tasks.workunit.client.0.smithi084.stdout:4/969: link d2/d4/ff7 d2/f11a 0 2024-02-15T18:27:12.135 INFO:tasks.workunit.client.0.smithi084.stdout:4/970: fdatasync d2/d4/d28/f96 0 2024-02-15T18:27:12.135 INFO:tasks.workunit.client.0.smithi084.stdout:4/971: fsync d2/d4/f1c 0 2024-02-15T18:27:12.135 INFO:tasks.workunit.client.0.smithi084.stdout:4/972: dread - d2/d2b/d47/d31/d61/fa0 zero size 2024-02-15T18:27:12.137 INFO:tasks.workunit.client.1.smithi133.stdout:0/639: getdents d9/d10/d19/d29/d67 0 2024-02-15T18:27:12.138 INFO:tasks.workunit.client.0.smithi084.stdout:8/836: dwrite db/dd/d1f/d56/fe9 [0,4194304] 0 2024-02-15T18:27:12.138 INFO:tasks.workunit.client.0.smithi084.stdout:4/973: creat d2/d64/da5/dae/f11b x:0 0 0 2024-02-15T18:27:12.138 INFO:tasks.workunit.client.1.smithi133.stdout:4/416: rmdir d2/d5/d2b/d21/d2d 39 2024-02-15T18:27:12.138 INFO:tasks.workunit.client.1.smithi133.stdout:8/531: symlink d3/de/d3e/d94/lad 0 2024-02-15T18:27:12.139 INFO:tasks.workunit.client.0.smithi084.stdout:9/940: dwrite d4/d2b/d3c/d24/dca/f14 [0,4194304] 0 2024-02-15T18:27:12.140 INFO:tasks.workunit.client.0.smithi084.stdout:9/941: chown d4/d2b/d3c/d24/dca/d15/fff 28052 1 2024-02-15T18:27:12.141 INFO:tasks.workunit.client.0.smithi084.stdout:8/837: mknod db/dd/d1f/d7a/da8/c119 0 2024-02-15T18:27:12.141 INFO:tasks.workunit.client.1.smithi133.stdout:4/417: mknod d2/d5/d2b/d21/d3b/d49/c8b 0 2024-02-15T18:27:12.142 INFO:tasks.workunit.client.1.smithi133.stdout:4/418: chown d2/d5/l17 425809 1 2024-02-15T18:27:12.143 INFO:tasks.workunit.client.0.smithi084.stdout:3/795: dwrite d8/d40/faa [0,4194304] 0 2024-02-15T18:27:12.144 INFO:tasks.workunit.client.0.smithi084.stdout:9/942: mknod d4/d2b/daf/c128 0 2024-02-15T18:27:12.146 INFO:tasks.workunit.client.1.smithi133.stdout:4/419: link d2/d5/l17 d2/d5/d2b/d21/d2d/l8c 0 2024-02-15T18:27:12.146 INFO:tasks.workunit.client.1.smithi133.stdout:8/532: write d3/d1c/d37/f7b [2784679,96588] 0 2024-02-15T18:27:12.146 INFO:tasks.workunit.client.1.smithi133.stdout:1/743: dread d6/d17/f6e [0,4194304] 0 2024-02-15T18:27:12.146 INFO:tasks.workunit.client.1.smithi133.stdout:1/744: write d6/d1e/d3a/d75/ff5 [714258,14198] 0 2024-02-15T18:27:12.147 INFO:tasks.workunit.client.0.smithi084.stdout:0/857: dwrite d0/d4/da8/dd8/f100 [0,4194304] 0 2024-02-15T18:27:12.147 INFO:tasks.workunit.client.0.smithi084.stdout:0/858: fsync d0/d39/d45/fb7 0 2024-02-15T18:27:12.148 INFO:tasks.workunit.client.0.smithi084.stdout:0/859: write d0/d4/d3a/d5c/f52 [5433435,1805] 0 2024-02-15T18:27:12.149 INFO:tasks.workunit.client.0.smithi084.stdout:8/838: rename db/dd/d13/c6e to db/dd/d4d/df1/c11a 0 2024-02-15T18:27:12.150 INFO:tasks.workunit.client.1.smithi133.stdout:0/640: dread d9/f1e [0,4194304] 0 2024-02-15T18:27:12.150 INFO:tasks.workunit.client.1.smithi133.stdout:9/484: dwrite d0/d8/d9/d12/d82/d42/d44/f7a [0,4194304] 0 2024-02-15T18:27:12.150 INFO:tasks.workunit.client.1.smithi133.stdout:2/572: dwrite d7/d2c/f44 [0,4194304] 0 2024-02-15T18:27:12.150 INFO:tasks.workunit.client.1.smithi133.stdout:2/573: write d7/d18/d32/d65/d58/f64 [94747,23633] 0 2024-02-15T18:27:12.150 INFO:tasks.workunit.client.1.smithi133.stdout:2/574: fsync d7/d2c/d3b/f50 0 2024-02-15T18:27:12.150 INFO:tasks.workunit.client.0.smithi084.stdout:3/796: rmdir d8/d1f/dbf/db6 39 2024-02-15T18:27:12.152 INFO:tasks.workunit.client.0.smithi084.stdout:9/943: creat d4/da3/dc3/de1/dcb/f129 x:0 0 0 2024-02-15T18:27:12.152 INFO:tasks.workunit.client.0.smithi084.stdout:9/944: chown d4/d2b/d67/c77 181325262 1 2024-02-15T18:27:12.155 INFO:tasks.workunit.client.1.smithi133.stdout:0/641: unlink d9/d10/d19/d29/d67/d68/d9c/d95/f99 0 2024-02-15T18:27:12.155 INFO:tasks.workunit.client.1.smithi133.stdout:8/533: rmdir d3/d7/d40/d91 0 2024-02-15T18:27:12.156 INFO:tasks.workunit.client.1.smithi133.stdout:0/642: dread d9/d10/d85/fcc [0,4194304] 0 2024-02-15T18:27:12.157 INFO:tasks.workunit.client.1.smithi133.stdout:8/534: read d3/de/f53 [23476,12582] 0 2024-02-15T18:27:12.160 INFO:tasks.workunit.client.0.smithi084.stdout:8/839: dread db/d1a/f1d [0,4194304] 0 2024-02-15T18:27:12.161 INFO:tasks.workunit.client.1.smithi133.stdout:3/636: dwrite d0/d15/d2f/d9b/f58 [0,4194304] 0 2024-02-15T18:27:12.163 INFO:tasks.workunit.client.0.smithi084.stdout:0/860: getdents d0/d4/d3a/db3 0 2024-02-15T18:27:12.163 INFO:tasks.workunit.client.0.smithi084.stdout:0/861: chown d0/d2f/l38 304 1 2024-02-15T18:27:12.163 INFO:tasks.workunit.client.0.smithi084.stdout:3/797: creat d8/d40/db1/f109 x:0 0 0 2024-02-15T18:27:12.164 INFO:tasks.workunit.client.0.smithi084.stdout:0/862: dread d0/d2f/faa [0,4194304] 0 2024-02-15T18:27:12.166 INFO:tasks.workunit.client.0.smithi084.stdout:2/872: dread d3/d5/d53/dca/dc3/f118 [0,4194304] 0 2024-02-15T18:27:12.171 INFO:tasks.workunit.client.0.smithi084.stdout:4/974: rmdir d2/d64 39 2024-02-15T18:27:12.173 INFO:tasks.workunit.client.0.smithi084.stdout:0/863: write d0/d4/d66/f6c [5117087,19364] 0 2024-02-15T18:27:12.173 INFO:tasks.workunit.client.0.smithi084.stdout:0/864: fsync d0/d4/d3a/fbf 0 2024-02-15T18:27:12.173 INFO:tasks.workunit.client.0.smithi084.stdout:9/945: dread d4/d2b/d3c/d24/dca/d15/f40 [0,4194304] 0 2024-02-15T18:27:12.173 INFO:tasks.workunit.client.0.smithi084.stdout:9/946: chown d4/d2b/d3c/d24/dca/d15/f28 51 1 2024-02-15T18:27:12.173 INFO:tasks.workunit.client.0.smithi084.stdout:0/865: write d0/d2f/d4b/dc6/fdc [5010315,121025] 0 2024-02-15T18:27:12.173 INFO:tasks.workunit.client.0.smithi084.stdout:3/798: symlink d8/d73/db9/dca/d107/l10a 0 2024-02-15T18:27:12.173 INFO:tasks.workunit.client.0.smithi084.stdout:2/873: creat d3/d19/d108/de7/f11c x:0 0 0 2024-02-15T18:27:12.174 INFO:tasks.workunit.client.1.smithi133.stdout:9/485: symlink d0/d8/d9/l9e 0 2024-02-15T18:27:12.174 INFO:tasks.workunit.client.1.smithi133.stdout:9/486: fdatasync d0/f55 0 2024-02-15T18:27:12.174 INFO:tasks.workunit.client.1.smithi133.stdout:0/643: creat d9/d10/d19/d29/fd7 x:0 0 0 2024-02-15T18:27:12.175 INFO:tasks.workunit.client.1.smithi133.stdout:2/575: mknod d7/db/d67/cb5 0 2024-02-15T18:27:12.175 INFO:tasks.workunit.client.1.smithi133.stdout:8/535: mkdir d3/d1f/d4f/dae 0 2024-02-15T18:27:12.175 INFO:tasks.workunit.client.0.smithi084.stdout:4/975: mkdir d2/d64/d74/d8f/dc1/d11c 0 2024-02-15T18:27:12.175 INFO:tasks.workunit.client.1.smithi133.stdout:8/536: write d3/d1c/f51 [4573653,119552] 0 2024-02-15T18:27:12.176 INFO:tasks.workunit.client.0.smithi084.stdout:9/947: write d4/d2b/f50 [1772565,56869] 0 2024-02-15T18:27:12.176 INFO:tasks.workunit.client.0.smithi084.stdout:0/866: rename d0/d4/d3a/fbf to d0/d4/d1b/d7a/f103 0 2024-02-15T18:27:12.177 INFO:tasks.workunit.client.0.smithi084.stdout:0/867: read d0/d39/d45/fb7 [1588236,69206] 0 2024-02-15T18:27:12.178 INFO:tasks.workunit.client.1.smithi133.stdout:3/637: creat d0/d15/d2f/d9b/d39/d3f/dc1/d78/fcc x:0 0 0 2024-02-15T18:27:12.178 INFO:tasks.workunit.client.1.smithi133.stdout:3/638: truncate d0/d15/f6b 8811115 0 2024-02-15T18:27:12.178 INFO:tasks.workunit.client.1.smithi133.stdout:2/576: read d7/d2c/d3b/f4d [4157832,73955] 0 2024-02-15T18:27:12.178 INFO:tasks.workunit.client.1.smithi133.stdout:0/644: link d9/d10/d19/d29/d67/d68/d9c/da7/lc1 d9/d10/d19/d29/d67/d68/d96/ld8 0 2024-02-15T18:27:12.178 INFO:tasks.workunit.client.1.smithi133.stdout:9/487: mknod d0/d8/d9/d3c/c9f 0 2024-02-15T18:27:12.178 INFO:tasks.workunit.client.1.smithi133.stdout:9/488: chown d0/d8/l34 101 1 2024-02-15T18:27:12.178 INFO:tasks.workunit.client.1.smithi133.stdout:9/489: chown d0/d8/d10/f2f 191794490 1 2024-02-15T18:27:12.179 INFO:tasks.workunit.client.1.smithi133.stdout:3/639: mkdir d0/d15/d2f/d9b/d39/dcd 0 2024-02-15T18:27:12.180 INFO:tasks.workunit.client.0.smithi084.stdout:2/874: unlink d3/d19/d108/lba 0 2024-02-15T18:27:12.180 INFO:tasks.workunit.client.0.smithi084.stdout:2/875: chown d3/d5/d53/dca/d7b/d105/d2d/f38 17633852 1 2024-02-15T18:27:12.180 INFO:tasks.workunit.client.0.smithi084.stdout:2/876: write d3/d19/f33 [1415219,87632] 0 2024-02-15T18:27:12.180 INFO:tasks.workunit.client.0.smithi084.stdout:4/976: symlink d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/l11d 0 2024-02-15T18:27:12.180 INFO:tasks.workunit.client.1.smithi133.stdout:3/640: write d0/d15/d37/d4a/f4c [825507,76759] 0 2024-02-15T18:27:12.180 INFO:tasks.workunit.client.1.smithi133.stdout:3/641: write d0/d15/d37/fb7 [605231,42655] 0 2024-02-15T18:27:12.181 INFO:tasks.workunit.client.1.smithi133.stdout:2/577: mknod d7/db/d67/da7/cb6 0 2024-02-15T18:27:12.181 INFO:tasks.workunit.client.1.smithi133.stdout:2/578: fdatasync d7/d18/f6f 0 2024-02-15T18:27:12.181 INFO:tasks.workunit.client.1.smithi133.stdout:0/645: symlink d9/d10/d22/ld9 0 2024-02-15T18:27:12.181 INFO:tasks.workunit.client.0.smithi084.stdout:1/842: dwrite d9/d54/d32/d5b/d69/fb1 [0,4194304] 0 2024-02-15T18:27:12.182 INFO:tasks.workunit.client.1.smithi133.stdout:3/642: mkdir d0/d15/d2f/d9b/d39/d3f/dc1/d78/dce 0 2024-02-15T18:27:12.183 INFO:tasks.workunit.client.1.smithi133.stdout:2/579: link d7/db/d67/ca3 d7/d2c/d3b/d48/d59/d74/cb7 0 2024-02-15T18:27:12.183 INFO:tasks.workunit.client.0.smithi084.stdout:6/835: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/f53 [0,4194304] 0 2024-02-15T18:27:12.185 INFO:tasks.workunit.client.0.smithi084.stdout:9/948: mknod d4/d36/d6f/c12a 0 2024-02-15T18:27:12.185 INFO:tasks.workunit.client.0.smithi084.stdout:9/949: chown d4/d2b/d3c/d20/ff3 196966515 1 2024-02-15T18:27:12.185 INFO:tasks.workunit.client.0.smithi084.stdout:9/950: chown d4/d2b/d3c/d24/dca/f99 24136813 1 2024-02-15T18:27:12.185 INFO:tasks.workunit.client.0.smithi084.stdout:9/951: fsync d4/d36/d6f/f109 0 2024-02-15T18:27:12.185 INFO:tasks.workunit.client.0.smithi084.stdout:0/868: mknod d0/d4/d3a/d82/dcb/c104 0 2024-02-15T18:27:12.185 INFO:tasks.workunit.client.0.smithi084.stdout:0/869: readlink d0/d4/d3a/d5c/de2/d43/d6d/d71/le0 0 2024-02-15T18:27:12.185 INFO:tasks.workunit.client.0.smithi084.stdout:0/870: readlink d0/d25/l31 0 2024-02-15T18:27:12.185 INFO:tasks.workunit.client.0.smithi084.stdout:3/799: mknod d8/d40/d58/d80/c10b 0 2024-02-15T18:27:12.185 INFO:tasks.workunit.client.1.smithi133.stdout:0/646: creat d9/d10/d19/d29/d67/d68/d9c/da7/fda x:0 0 0 2024-02-15T18:27:12.186 INFO:tasks.workunit.client.1.smithi133.stdout:1/745: dwrite d6/d1e/d3a/d82/d85/f45 [0,4194304] 0 2024-02-15T18:27:12.186 INFO:tasks.workunit.client.1.smithi133.stdout:0/647: chown d9/d10/d2c/c3c 45547256 1 2024-02-15T18:27:12.186 INFO:tasks.workunit.client.1.smithi133.stdout:0/648: truncate d9/d2b/f72 4335497 0 2024-02-15T18:27:12.186 INFO:tasks.workunit.client.0.smithi084.stdout:8/840: dwrite db/dd/d13/db9/dea/f10c [0,4194304] 0 2024-02-15T18:27:12.187 INFO:tasks.workunit.client.0.smithi084.stdout:2/877: unlink d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/f8c 0 2024-02-15T18:27:12.189 INFO:tasks.workunit.client.1.smithi133.stdout:3/643: rename d0/d15/c66 to d0/d15/d2f/d5e/db3/ccf 0 2024-02-15T18:27:12.190 INFO:tasks.workunit.client.1.smithi133.stdout:0/649: mknod d9/d10/d47/d5e/cdb 0 2024-02-15T18:27:12.192 INFO:tasks.workunit.client.1.smithi133.stdout:0/650: write d9/d10/d19/d29/f8f [342796,40823] 0 2024-02-15T18:27:12.195 INFO:tasks.workunit.client.1.smithi133.stdout:8/537: dread d3/d1c/d37/d5c/f89 [0,4194304] 0 2024-02-15T18:27:12.196 INFO:tasks.workunit.client.1.smithi133.stdout:3/644: dread d0/d15/d37/f59 [0,4194304] 0 2024-02-15T18:27:12.197 INFO:tasks.workunit.client.1.smithi133.stdout:9/490: dread d0/d8/d10/f30 [0,4194304] 0 2024-02-15T18:27:12.198 INFO:tasks.workunit.client.1.smithi133.stdout:1/746: rmdir d6/d1e/d41/d7c/d7e/d7f/db6 39 2024-02-15T18:27:12.198 INFO:tasks.workunit.client.0.smithi084.stdout:1/843: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/c113 0 2024-02-15T18:27:12.200 INFO:tasks.workunit.client.1.smithi133.stdout:0/651: rename d9/d10/d19/d29/d67/d68/d96/d44/f4f to d9/d10/d2c/fdc 0 2024-02-15T18:27:12.200 INFO:tasks.workunit.client.1.smithi133.stdout:3/645: mknod d0/d15/d2f/dad/cd0 0 2024-02-15T18:27:12.201 INFO:tasks.workunit.client.0.smithi084.stdout:0/871: write d0/f95 [3649989,28142] 0 2024-02-15T18:27:12.202 INFO:tasks.workunit.client.1.smithi133.stdout:9/491: creat d0/d37/fa0 x:0 0 0 2024-02-15T18:27:12.204 INFO:tasks.workunit.client.1.smithi133.stdout:8/538: dread d3/d7/d52/f56 [0,4194304] 0 2024-02-15T18:27:12.205 INFO:tasks.workunit.client.1.smithi133.stdout:9/492: mkdir d0/d8/d10/da1 0 2024-02-15T18:27:12.205 INFO:tasks.workunit.client.1.smithi133.stdout:9/493: truncate d0/d8/d9/ff 3884151 0 2024-02-15T18:27:12.206 INFO:tasks.workunit.client.0.smithi084.stdout:8/841: creat db/d3f/f11b x:0 0 0 2024-02-15T18:27:12.207 INFO:tasks.workunit.client.0.smithi084.stdout:3/800: mkdir d8/d1f/dbf/db6/d10c 0 2024-02-15T18:27:12.208 INFO:tasks.workunit.client.1.smithi133.stdout:9/494: link d0/d8/d9/f8c d0/d8/d9/d12/d82/d42/d44/fa2 0 2024-02-15T18:27:12.209 INFO:tasks.workunit.client.0.smithi084.stdout:5/954: sync 2024-02-15T18:27:12.209 INFO:tasks.workunit.client.0.smithi084.stdout:5/955: chown d9/d35/d65/d7f/dd6 4966 1 2024-02-15T18:27:12.209 INFO:tasks.workunit.client.0.smithi084.stdout:7/917: sync 2024-02-15T18:27:12.209 INFO:tasks.workunit.client.0.smithi084.stdout:1/844: link d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/ld7 d9/d54/d1b/d2c/d4b/d4c/d79/d36/l114 0 2024-02-15T18:27:12.213 INFO:tasks.workunit.client.0.smithi084.stdout:0/872: rmdir d0/d39/d45/de5 0 2024-02-15T18:27:12.213 INFO:tasks.workunit.client.0.smithi084.stdout:0/873: fsync d0/d2f/faa 0 2024-02-15T18:27:12.214 INFO:tasks.workunit.client.0.smithi084.stdout:5/956: mkdir d9/da/d3d/d44/d55/dfe/dac/d139 0 2024-02-15T18:27:12.214 INFO:tasks.workunit.client.0.smithi084.stdout:0/874: chown d0/d2f/d3f/d4f/d61/f70 27791929 1 2024-02-15T18:27:12.218 INFO:tasks.workunit.client.0.smithi084.stdout:7/918: mknod df/d1d/d44/d96/c12f 0 2024-02-15T18:27:12.218 INFO:tasks.workunit.client.0.smithi084.stdout:1/845: rename d9/d54/d7f/db7/dc0/c6d to d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/dc6/c115 0 2024-02-15T18:27:12.218 INFO:tasks.workunit.client.0.smithi084.stdout:0/875: creat d0/d2f/d3f/d4c/d9a/f105 x:0 0 0 2024-02-15T18:27:12.218 INFO:tasks.workunit.client.0.smithi084.stdout:0/876: chown d0/d2f/d3f/d4f/f101 28 1 2024-02-15T18:27:12.219 INFO:tasks.workunit.client.0.smithi084.stdout:0/877: dread - d0/d2f/d3f/fe9 zero size 2024-02-15T18:27:12.219 INFO:tasks.workunit.client.0.smithi084.stdout:0/878: fdatasync d0/d4/d3a/d5c/de2/d43/d6d/fb5 0 2024-02-15T18:27:12.220 INFO:tasks.workunit.client.0.smithi084.stdout:1/846: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/l116 0 2024-02-15T18:27:12.223 INFO:tasks.workunit.client.0.smithi084.stdout:1/847: rename d9/d54/d1b/d2c/d35/l55 to d9/d54/d32/d5b/d69/l117 0 2024-02-15T18:27:12.223 INFO:tasks.workunit.client.0.smithi084.stdout:1/848: readlink d9/d54/d1b/d38/d4d/la4 0 2024-02-15T18:27:12.223 INFO:tasks.workunit.client.0.smithi084.stdout:1/849: write d9/f14 [8835150,6609] 0 2024-02-15T18:27:12.225 INFO:tasks.workunit.client.0.smithi084.stdout:0/879: getdents d0/d4/d3a/d5c/de2/d43/da0 0 2024-02-15T18:27:12.227 INFO:tasks.workunit.client.0.smithi084.stdout:6/836: dwrite d14/d22/f64 [0,4194304] 0 2024-02-15T18:27:12.227 INFO:tasks.workunit.client.0.smithi084.stdout:6/837: write d14/d22/d25/f84 [853775,65360] 0 2024-02-15T18:27:12.227 INFO:tasks.workunit.client.0.smithi084.stdout:6/838: chown d14/d22/d25/d2f/da9/d9b/dac/ce4 247073 1 2024-02-15T18:27:12.227 INFO:tasks.workunit.client.0.smithi084.stdout:6/839: fdatasync d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/fda 0 2024-02-15T18:27:12.227 INFO:tasks.workunit.client.0.smithi084.stdout:6/840: fdatasync f3 0 2024-02-15T18:27:12.227 INFO:tasks.workunit.client.0.smithi084.stdout:1/850: unlink d9/d54/d1b/d2c/d35/l8e 0 2024-02-15T18:27:12.229 INFO:tasks.workunit.client.0.smithi084.stdout:6/841: mkdir d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/ddc/dea/d111 0 2024-02-15T18:27:12.234 INFO:tasks.workunit.client.0.smithi084.stdout:8/842: dread db/dd/d4d/f5b [0,4194304] 0 2024-02-15T18:27:12.241 INFO:tasks.workunit.client.0.smithi084.stdout:0/880: write d0/d4/d1b/f55 [1641352,20137] 0 2024-02-15T18:27:12.244 INFO:tasks.workunit.client.0.smithi084.stdout:6/842: creat d14/d22/d25/de8/f112 x:0 0 0 2024-02-15T18:27:12.246 INFO:tasks.workunit.client.1.smithi133.stdout:0/652: dread d9/d10/d47/d5e/fd4 [0,4194304] 0 2024-02-15T18:27:12.246 INFO:tasks.workunit.client.1.smithi133.stdout:0/653: chown l1 48 1 2024-02-15T18:27:12.248 INFO:tasks.workunit.client.0.smithi084.stdout:8/843: mkdir db/dd/d1f/d11c 0 2024-02-15T18:27:12.249 INFO:tasks.workunit.client.0.smithi084.stdout:8/844: read db/dd/d4d/f63 [410699,88095] 0 2024-02-15T18:27:12.249 INFO:tasks.workunit.client.0.smithi084.stdout:8/845: readlink db/dd/d1f/d66/lc9 0 2024-02-15T18:27:12.250 INFO:tasks.workunit.client.1.smithi133.stdout:0/654: creat d9/d10/fdd x:0 0 0 2024-02-15T18:27:12.250 INFO:tasks.workunit.client.1.smithi133.stdout:0/655: write d9/d10/d22/d32/d7f/fce [625719,96481] 0 2024-02-15T18:27:12.252 INFO:tasks.workunit.client.0.smithi084.stdout:8/846: link db/d3f/d59/l46 db/dd/d1f/d11c/l11d 0 2024-02-15T18:27:12.252 INFO:tasks.workunit.client.1.smithi133.stdout:0/656: creat d9/d10/d22/fde x:0 0 0 2024-02-15T18:27:12.253 INFO:tasks.workunit.client.0.smithi084.stdout:8/847: write db/dd/d1f/f38 [939536,30688] 0 2024-02-15T18:27:12.254 INFO:tasks.workunit.client.1.smithi133.stdout:0/657: mknod d9/d10/d19/d8c/cdf 0 2024-02-15T18:27:12.255 INFO:tasks.workunit.client.1.smithi133.stdout:0/658: symlink d9/d2b/le0 0 2024-02-15T18:27:12.255 INFO:tasks.workunit.client.1.smithi133.stdout:0/659: fsync d9/d10/d19/d29/d67/d68/d9c/d95/f97 0 2024-02-15T18:27:12.255 INFO:tasks.workunit.client.0.smithi084.stdout:0/881: dread d0/d2f/f56 [0,4194304] 0 2024-02-15T18:27:12.256 INFO:tasks.workunit.client.0.smithi084.stdout:8/848: rename db/d3f/d59/d69/l9d to db/dd/d4d/df1/l11e 0 2024-02-15T18:27:12.258 INFO:tasks.workunit.client.1.smithi133.stdout:9/495: dread d0/d8/d9/d12/d82/f40 [0,4194304] 0 2024-02-15T18:27:12.258 INFO:tasks.workunit.client.1.smithi133.stdout:2/580: dwrite d7/d18/d32/d65/d58/f96 [0,4194304] 0 2024-02-15T18:27:12.258 INFO:tasks.workunit.client.1.smithi133.stdout:2/581: chown d7/db/d67/caa 33940353 1 2024-02-15T18:27:12.258 INFO:tasks.workunit.client.1.smithi133.stdout:0/660: rename d9/d10/d47/d5e/f89 to d9/d10/d19/d29/d67/d68/d9c/da7/fe1 0 2024-02-15T18:27:12.258 INFO:tasks.workunit.client.1.smithi133.stdout:0/661: chown d9/d10/d19/d29/d67/d68/c93 2 1 2024-02-15T18:27:12.258 INFO:tasks.workunit.client.1.smithi133.stdout:0/662: fdatasync d9/d10/d22/d32/f40 0 2024-02-15T18:27:12.259 INFO:tasks.workunit.client.0.smithi084.stdout:8/849: creat db/dd/d13/d42/d90/f11f x:0 0 0 2024-02-15T18:27:12.259 INFO:tasks.workunit.client.0.smithi084.stdout:8/850: chown db/d1a/da5/lbb 121509347 1 2024-02-15T18:27:12.260 INFO:tasks.workunit.client.1.smithi133.stdout:9/496: truncate d0/d8/d9/d12/d82/f7c 3421411 0 2024-02-15T18:27:12.260 INFO:tasks.workunit.client.0.smithi084.stdout:8/851: symlink db/d1a/d2b/d7b/l120 0 2024-02-15T18:27:12.261 INFO:tasks.workunit.client.1.smithi133.stdout:2/582: rmdir d7/d2c/d3b/d48/d59 39 2024-02-15T18:27:12.263 INFO:tasks.workunit.client.1.smithi133.stdout:9/497: symlink d0/d8/d9/d3c/la3 0 2024-02-15T18:27:12.263 INFO:tasks.workunit.client.1.smithi133.stdout:2/583: symlink d7/d2c/d31/lb8 0 2024-02-15T18:27:12.264 INFO:tasks.workunit.client.0.smithi084.stdout:0/882: dread d0/d2f/d4b/dc6/fca [0,4194304] 0 2024-02-15T18:27:12.264 INFO:tasks.workunit.client.1.smithi133.stdout:0/663: read d9/d10/d19/f63 [3975474,97324] 0 2024-02-15T18:27:12.265 INFO:tasks.workunit.client.1.smithi133.stdout:9/498: rename d0/d8/d9/d49/c63 to d0/d8/d9/ca4 0 2024-02-15T18:27:12.265 INFO:tasks.workunit.client.1.smithi133.stdout:9/499: truncate d0/d8/d9/d12/d4f/f85 360922 0 2024-02-15T18:27:12.265 INFO:tasks.workunit.client.1.smithi133.stdout:9/500: dread - d0/d8/d9/d12/d82/d42/d44/f84 zero size 2024-02-15T18:27:12.266 INFO:tasks.workunit.client.1.smithi133.stdout:2/584: mknod d7/d2c/d5a/d66/d70/da8/cb9 0 2024-02-15T18:27:12.266 INFO:tasks.workunit.client.0.smithi084.stdout:0/883: mknod d0/d4/d66/c106 0 2024-02-15T18:27:12.266 INFO:tasks.workunit.client.0.smithi084.stdout:0/884: write d0/d1e/da2/fb2 [305924,68136] 0 2024-02-15T18:27:12.266 INFO:tasks.workunit.client.1.smithi133.stdout:0/664: mknod d9/d10/d19/ce2 0 2024-02-15T18:27:12.266 INFO:tasks.workunit.client.1.smithi133.stdout:0/665: read - d9/d10/fdd zero size 2024-02-15T18:27:12.267 INFO:tasks.workunit.client.0.smithi084.stdout:0/885: mknod d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/c107 0 2024-02-15T18:27:12.267 INFO:tasks.workunit.client.1.smithi133.stdout:9/501: mknod d0/d8/d10/ca5 0 2024-02-15T18:27:12.267 INFO:tasks.workunit.client.0.smithi084.stdout:0/886: mkdir d0/d2f/d3f/d4c/de1/d108 0 2024-02-15T18:27:12.269 INFO:tasks.workunit.client.0.smithi084.stdout:0/887: creat d0/d2f/d3f/f109 x:0 0 0 2024-02-15T18:27:12.270 INFO:tasks.workunit.client.0.smithi084.stdout:0/888: write d0/d4/f4e [1075406,55565] 0 2024-02-15T18:27:12.270 INFO:tasks.workunit.client.1.smithi133.stdout:0/666: write d9/d28/f36 [778522,67631] 0 2024-02-15T18:27:12.270 INFO:tasks.workunit.client.1.smithi133.stdout:0/667: truncate d9/d2b/f79 2487739 0 2024-02-15T18:27:12.271 INFO:tasks.workunit.client.0.smithi084.stdout:0/889: creat d0/d2f/d4b/f10a x:0 0 0 2024-02-15T18:27:12.272 INFO:tasks.workunit.client.1.smithi133.stdout:0/668: rename l3 to d9/d10/d19/d1a/le3 0 2024-02-15T18:27:12.273 INFO:tasks.workunit.client.0.smithi084.stdout:0/890: mkdir d0/d4/d3a/d10b 0 2024-02-15T18:27:12.273 INFO:tasks.workunit.client.1.smithi133.stdout:0/669: mkdir d9/d10/d19/d29/d67/d68/d96/de4 0 2024-02-15T18:27:12.274 INFO:tasks.workunit.client.0.smithi084.stdout:0/891: write d0/d98/fc0 [1826612,3368] 0 2024-02-15T18:27:12.274 INFO:tasks.workunit.client.0.smithi084.stdout:0/892: chown d0/d2f/d3f/d4f/d59/da7 35335 1 2024-02-15T18:27:12.275 INFO:tasks.workunit.client.1.smithi133.stdout:0/670: rename f6 to d9/d10/d22/d32/fe5 0 2024-02-15T18:27:12.275 INFO:tasks.workunit.client.0.smithi084.stdout:0/893: creat d0/d2f/f10c x:0 0 0 2024-02-15T18:27:12.277 INFO:tasks.workunit.client.0.smithi084.stdout:0/894: mknod d0/d4/d3a/d5c/de2/d43/d7e/c10d 0 2024-02-15T18:27:12.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/852: dread db/dd/d13/d42/d79/ff7 [0,4194304] 0 2024-02-15T18:27:12.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/853: truncate db/dd/d1f/d7a/da8/f111 7004 0 2024-02-15T18:27:12.286 INFO:tasks.workunit.client.0.smithi084.stdout:8/854: chown db/c1b 66240905 1 2024-02-15T18:27:12.287 INFO:tasks.workunit.client.1.smithi133.stdout:0/671: rmdir d9/d10/d22/d32/d7f 39 2024-02-15T18:27:12.289 INFO:tasks.workunit.client.0.smithi084.stdout:0/895: dread d0/d39/f78 [0,4194304] 0 2024-02-15T18:27:12.292 INFO:tasks.workunit.client.0.smithi084.stdout:3/801: dwrite d8/d40/d43/d71/d8c/d94/da3/de5/fef [0,4194304] 0 2024-02-15T18:27:12.293 INFO:tasks.workunit.client.0.smithi084.stdout:7/919: dwrite df/d1d/d1a/d4b/f50 [4194304,4194304] 0 2024-02-15T18:27:12.293 INFO:tasks.workunit.client.0.smithi084.stdout:6/843: dwrite d14/d22/d25/d2f/d31/dcf/fe0 [0,4194304] 0 2024-02-15T18:27:12.293 INFO:tasks.workunit.client.0.smithi084.stdout:6/844: fsync d14/f17 0 2024-02-15T18:27:12.295 INFO:tasks.workunit.client.0.smithi084.stdout:9/952: dwrite d4/d2b/d67/f8c [0,4194304] 0 2024-02-15T18:27:12.295 INFO:tasks.workunit.client.0.smithi084.stdout:8/855: write db/dd/d1f/fc4 [1848839,68039] 0 2024-02-15T18:27:12.295 INFO:tasks.workunit.client.0.smithi084.stdout:8/856: fsync db/d3f/d59/f48 0 2024-02-15T18:27:12.295 INFO:tasks.workunit.client.0.smithi084.stdout:5/957: dwrite d9/d5b/f114 [0,4194304] 0 2024-02-15T18:27:12.295 INFO:tasks.workunit.client.0.smithi084.stdout:5/958: readlink d9/da/d3d/d44/d55/dfe/dac/lb1 0 2024-02-15T18:27:12.295 INFO:tasks.workunit.client.0.smithi084.stdout:5/959: chown d9/da/d3d/d44/d55/d96/ca8 39040465 1 2024-02-15T18:27:12.296 INFO:tasks.workunit.client.1.smithi133.stdout:3/646: dwrite d0/fc [0,4194304] 0 2024-02-15T18:27:12.296 INFO:tasks.workunit.client.1.smithi133.stdout:9/502: dread d0/d8/d10/f11 [0,4194304] 0 2024-02-15T18:27:12.296 INFO:tasks.workunit.client.1.smithi133.stdout:0/672: dread d9/d10/d19/d29/d67/d68/d9c/da7/fbf [0,4194304] 0 2024-02-15T18:27:12.297 INFO:tasks.workunit.client.0.smithi084.stdout:1/851: dwrite d9/d54/fe3 [0,4194304] 0 2024-02-15T18:27:12.297 INFO:tasks.workunit.client.0.smithi084.stdout:2/878: dwrite d3/d5/d53/fb1 [0,4194304] 0 2024-02-15T18:27:12.297 INFO:tasks.workunit.client.0.smithi084.stdout:2/879: read - d3/d19/d75/fe5 zero size 2024-02-15T18:27:12.297 INFO:tasks.workunit.client.1.smithi133.stdout:3/647: creat d0/d15/d2f/d9b/d72/fd1 x:0 0 0 2024-02-15T18:27:12.297 INFO:tasks.workunit.client.1.smithi133.stdout:9/503: stat d0/d8/d9/d12/d82/d89/c9d 0 2024-02-15T18:27:12.298 INFO:tasks.workunit.client.1.smithi133.stdout:0/673: mkdir d9/d10/d47/d5e/de6 0 2024-02-15T18:27:12.300 INFO:tasks.workunit.client.1.smithi133.stdout:9/504: mkdir d0/d8/d9/d12/d82/da6 0 2024-02-15T18:27:12.301 INFO:tasks.workunit.client.0.smithi084.stdout:0/896: symlink d0/d2f/d4b/dee/l10e 0 2024-02-15T18:27:12.301 INFO:tasks.workunit.client.0.smithi084.stdout:3/802: symlink d8/d40/d58/d80/d106/l10d 0 2024-02-15T18:27:12.301 INFO:tasks.workunit.client.0.smithi084.stdout:7/920: symlink df/d1d/d1a/d6a/d8b/da5/db6/l130 0 2024-02-15T18:27:12.302 INFO:tasks.workunit.client.0.smithi084.stdout:0/897: fdatasync d0/d4/d3a/d5c/f52 0 2024-02-15T18:27:12.302 INFO:tasks.workunit.client.0.smithi084.stdout:0/898: chown d0/d2f/d4b/dc6/fca 23 1 2024-02-15T18:27:12.302 INFO:tasks.workunit.client.0.smithi084.stdout:9/953: getdents d4/d2b/d3c/d24/dca 0 2024-02-15T18:27:12.304 INFO:tasks.workunit.client.1.smithi133.stdout:3/648: dread d0/d15/d2f/d5e/f76 [0,4194304] 0 2024-02-15T18:27:12.305 INFO:tasks.workunit.client.1.smithi133.stdout:3/649: chown d0/d15/d54/c77 1742727 1 2024-02-15T18:27:12.306 INFO:tasks.workunit.client.0.smithi084.stdout:6/845: dread d14/d22/d25/d28/f2a [0,4194304] 0 2024-02-15T18:27:12.311 INFO:tasks.workunit.client.1.smithi133.stdout:2/585: dread d7/d18/d32/d65/d58/f96 [0,4194304] 0 2024-02-15T18:27:12.311 INFO:tasks.workunit.client.1.smithi133.stdout:8/539: dwrite d3/d92/f8d [0,4194304] 0 2024-02-15T18:27:12.312 INFO:tasks.workunit.client.1.smithi133.stdout:9/505: write d0/d8/fd [4016879,119724] 0 2024-02-15T18:27:12.312 INFO:tasks.workunit.client.0.smithi084.stdout:9/954: dread d4/d2b/d3c/d24/dca/f14 [0,4194304] 0 2024-02-15T18:27:12.313 INFO:tasks.workunit.client.1.smithi133.stdout:3/650: creat d0/d15/d2f/dad/fd2 x:0 0 0 2024-02-15T18:27:12.313 INFO:tasks.workunit.client.1.smithi133.stdout:3/651: dread - d0/d15/d2f/d9b/f4d zero size 2024-02-15T18:27:12.315 INFO:tasks.workunit.client.0.smithi084.stdout:8/857: mknod db/d1a/db7/c121 0 2024-02-15T18:27:12.318 INFO:tasks.workunit.client.0.smithi084.stdout:5/960: rename d9/da/d3d/d44/d55/dfe/l2b to d9/d5f/d68/d9a/d8d/de5/l13a 0 2024-02-15T18:27:12.319 INFO:tasks.workunit.client.1.smithi133.stdout:8/540: rmdir d3/d1c 39 2024-02-15T18:27:12.322 INFO:tasks.workunit.client.1.smithi133.stdout:8/541: dread d3/d7/f72 [0,4194304] 0 2024-02-15T18:27:12.324 INFO:tasks.workunit.client.0.smithi084.stdout:2/880: write d3/d5/d53/dca/d7b/d105/d1e/d30/d8d/fdf [884570,40860] 0 2024-02-15T18:27:12.325 INFO:tasks.workunit.client.0.smithi084.stdout:3/803: truncate d8/d40/d43/d71/f9b 3189690 0 2024-02-15T18:27:12.325 INFO:tasks.workunit.client.0.smithi084.stdout:3/804: chown d8/d40/faa 13 1 2024-02-15T18:27:12.325 INFO:tasks.workunit.client.0.smithi084.stdout:7/921: rmdir df/d1d/d1a/d6a/d8e/d79/ddc/df0 39 2024-02-15T18:27:12.326 INFO:tasks.workunit.client.0.smithi084.stdout:0/899: mknod d0/d2f/d3f/d4f/c10f 0 2024-02-15T18:27:12.326 INFO:tasks.workunit.client.0.smithi084.stdout:0/900: chown d0/d2f/d3f/d4f/d59/da7/ffa 325851 1 2024-02-15T18:27:12.327 INFO:tasks.workunit.client.1.smithi133.stdout:0/674: dwrite d9/d10/f54 [0,4194304] 0 2024-02-15T18:27:12.327 INFO:tasks.workunit.client.1.smithi133.stdout:0/675: chown d9/d10/d19/d29/d67/d68/d9c/d95/cc6 0 1 2024-02-15T18:27:12.327 INFO:tasks.workunit.client.0.smithi084.stdout:9/955: symlink d4/d3d/l12b 0 2024-02-15T18:27:12.328 INFO:tasks.workunit.client.0.smithi084.stdout:5/961: truncate d9/d5f/d68/d9a/d8d/f8f 1742787 0 2024-02-15T18:27:12.330 INFO:tasks.workunit.client.1.smithi133.stdout:3/652: creat d0/d15/d37/fd3 x:0 0 0 2024-02-15T18:27:12.332 INFO:tasks.workunit.client.0.smithi084.stdout:3/805: mknod d8/d40/d58/c10e 0 2024-02-15T18:27:12.332 INFO:tasks.workunit.client.0.smithi084.stdout:3/806: readlink d8/d40/d43/d71/d8c/d94/da3/lbe 0 2024-02-15T18:27:12.333 INFO:tasks.workunit.client.0.smithi084.stdout:7/922: mkdir df/d1d/d1a/d4d/d10c/d131 0 2024-02-15T18:27:12.333 INFO:tasks.workunit.client.1.smithi133.stdout:9/506: getdents d0/d8/d6c 0 2024-02-15T18:27:12.335 INFO:tasks.workunit.client.0.smithi084.stdout:0/901: mkdir d0/d4/d3a/d82/dcb/d110 0 2024-02-15T18:27:12.335 INFO:tasks.workunit.client.0.smithi084.stdout:1/852: dwrite d9/d54/d7f/db7/dd9/d81/d94/db9/f107 [0,4194304] 0 2024-02-15T18:27:12.335 INFO:tasks.workunit.client.0.smithi084.stdout:1/853: fdatasync d9/d54/d1b/d2c/d35/f72 0 2024-02-15T18:27:12.336 INFO:tasks.workunit.client.0.smithi084.stdout:9/956: creat d4/d2b/d3c/d24/dca/d15/d5d/f12c x:0 0 0 2024-02-15T18:27:12.338 INFO:tasks.workunit.client.1.smithi133.stdout:8/542: mknod d3/de/d3e/d82/d8b/caf 0 2024-02-15T18:27:12.339 INFO:tasks.workunit.client.1.smithi133.stdout:0/676: truncate d9/d10/d19/f98 587074 0 2024-02-15T18:27:12.339 INFO:tasks.workunit.client.1.smithi133.stdout:0/677: fsync d9/d10/d22/d2f/d9f/fb2 0 2024-02-15T18:27:12.340 INFO:tasks.workunit.client.0.smithi084.stdout:5/962: symlink d9/da/d3d/d137/l13b 0 2024-02-15T18:27:12.341 INFO:tasks.workunit.client.1.smithi133.stdout:0/678: write d9/d10/d22/d32/f74 [1117646,62783] 0 2024-02-15T18:27:12.341 INFO:tasks.workunit.client.1.smithi133.stdout:7/454: sync 2024-02-15T18:27:12.341 INFO:tasks.workunit.client.1.smithi133.stdout:5/483: sync 2024-02-15T18:27:12.341 INFO:tasks.workunit.client.1.smithi133.stdout:4/420: sync 2024-02-15T18:27:12.341 INFO:tasks.workunit.client.1.smithi133.stdout:1/747: sync 2024-02-15T18:27:12.342 INFO:tasks.workunit.client.1.smithi133.stdout:8/543: read d3/d92/f8d [730726,85767] 0 2024-02-15T18:27:12.342 INFO:tasks.workunit.client.0.smithi084.stdout:3/807: creat d8/d1f/d25/f10f x:0 0 0 2024-02-15T18:27:12.347 INFO:tasks.workunit.client.0.smithi084.stdout:1/854: dread d9/d54/d1b/f56 [0,4194304] 0 2024-02-15T18:27:12.348 INFO:tasks.workunit.client.0.smithi084.stdout:7/923: creat df/d1d/d1a/dd1/d111/d12e/f132 x:0 0 0 2024-02-15T18:27:12.349 INFO:tasks.workunit.client.1.smithi133.stdout:3/653: getdents d0/d15/d2f/db4 0 2024-02-15T18:27:12.349 INFO:tasks.workunit.client.1.smithi133.stdout:9/507: truncate d0/d8/d10/f11 2806822 0 2024-02-15T18:27:12.351 INFO:tasks.workunit.client.0.smithi084.stdout:0/902: link d0/d2f/d3f/lac d0/d4/d1b/d46/l111 0 2024-02-15T18:27:12.351 INFO:tasks.workunit.client.0.smithi084.stdout:0/903: stat d0/d2f/d3f 0 2024-02-15T18:27:12.351 INFO:tasks.workunit.client.0.smithi084.stdout:0/904: fsync d0/d4/d66/fa6 0 2024-02-15T18:27:12.353 INFO:tasks.workunit.client.0.smithi084.stdout:7/924: dread df/d1d/d1a/f64 [0,4194304] 0 2024-02-15T18:27:12.353 INFO:tasks.workunit.client.0.smithi084.stdout:7/925: chown df/f32 3068 1 2024-02-15T18:27:12.354 INFO:tasks.workunit.client.0.smithi084.stdout:9/957: creat d4/d2b/f12d x:0 0 0 2024-02-15T18:27:12.354 INFO:tasks.workunit.client.0.smithi084.stdout:9/958: truncate d4/d2b/f90 492074 0 2024-02-15T18:27:12.354 INFO:tasks.workunit.client.0.smithi084.stdout:9/959: fsync d4/d2b/d67/f8c 0 2024-02-15T18:27:12.354 INFO:tasks.workunit.client.1.smithi133.stdout:0/679: rmdir d9/d10/d22/d2f/d9f 39 2024-02-15T18:27:12.355 INFO:tasks.workunit.client.1.smithi133.stdout:5/484: unlink d17/d20/d32/d38/f3d 0 2024-02-15T18:27:12.355 INFO:tasks.workunit.client.1.smithi133.stdout:4/421: mkdir d2/d5/d2b/d21/d3b/d49/d65/d8d 0 2024-02-15T18:27:12.355 INFO:tasks.workunit.client.1.smithi133.stdout:1/748: creat d6/d1e/d41/d7c/d7e/d7f/db6/ded/d105/f116 x:0 0 0 2024-02-15T18:27:12.356 INFO:tasks.workunit.client.1.smithi133.stdout:8/544: mknod d3/d1f/d4f/dab/cb0 0 2024-02-15T18:27:12.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/654: truncate d0/d15/d2f/d5e/f97 1395584 0 2024-02-15T18:27:12.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/655: truncate d0/d15/d2f/d9b/d39/d3f/dc1/d78/f7c 1008590 0 2024-02-15T18:27:12.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/656: readlink d0/d15/l35 0 2024-02-15T18:27:12.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/657: write d0/d15/d2f/d9b/d39/d3f/dc1/d78/fcc [991166,74220] 0 2024-02-15T18:27:12.358 INFO:tasks.workunit.client.1.smithi133.stdout:9/508: mknod d0/d8/d9/d12/d82/d42/d44/ca7 0 2024-02-15T18:27:12.358 INFO:tasks.workunit.client.1.smithi133.stdout:9/509: chown d0/d8/d9/ff 1445660 1 2024-02-15T18:27:12.359 INFO:tasks.workunit.client.1.smithi133.stdout:1/749: rmdir d6/d1e/d3a/d79/d8e 39 2024-02-15T18:27:12.360 INFO:tasks.workunit.client.1.smithi133.stdout:8/545: link d3/d1f/l4c d3/d1c/d2f/d87/d73/lb1 0 2024-02-15T18:27:12.364 INFO:tasks.workunit.client.1.smithi133.stdout:3/658: symlink d0/d15/d37/ld4 0 2024-02-15T18:27:12.364 INFO:tasks.workunit.client.0.smithi084.stdout:4/977: sync 2024-02-15T18:27:12.365 INFO:tasks.workunit.client.1.smithi133.stdout:9/510: link d0/d8/d9/d12/d82/f7c d0/d8/d9/d12/d7f/d8f/fa8 0 2024-02-15T18:27:12.365 INFO:tasks.workunit.client.1.smithi133.stdout:2/586: dwrite d7/d2c/d31/f38 [0,4194304] 0 2024-02-15T18:27:12.366 INFO:tasks.workunit.client.1.smithi133.stdout:2/587: chown d7/d18/d32/d65/d58/f84 67 1 2024-02-15T18:27:12.366 INFO:tasks.workunit.client.1.smithi133.stdout:8/546: link d3/c9 d3/cb2 0 2024-02-15T18:27:12.366 INFO:tasks.workunit.client.1.smithi133.stdout:8/547: fdatasync d3/f46 0 2024-02-15T18:27:12.368 INFO:tasks.workunit.client.1.smithi133.stdout:9/511: symlink d0/d7b/la9 0 2024-02-15T18:27:12.368 INFO:tasks.workunit.client.1.smithi133.stdout:9/512: readlink d0/d8/d9/l1d 0 2024-02-15T18:27:12.368 INFO:tasks.workunit.client.1.smithi133.stdout:2/588: creat d7/d2c/d5a/d66/d70/fba x:0 0 0 2024-02-15T18:27:12.369 INFO:tasks.workunit.client.0.smithi084.stdout:1/855: getdents d9/d54/d1b 0 2024-02-15T18:27:12.369 INFO:tasks.workunit.client.1.smithi133.stdout:8/548: link d3/d7/f72 d3/d1f/d3f/d58/fb3 0 2024-02-15T18:27:12.370 INFO:tasks.workunit.client.1.smithi133.stdout:9/513: truncate d0/f7 2647068 0 2024-02-15T18:27:12.370 INFO:tasks.workunit.client.1.smithi133.stdout:9/514: truncate d0/d8/f22 3658261 0 2024-02-15T18:27:12.370 INFO:tasks.workunit.client.1.smithi133.stdout:9/515: chown d0/d8/d9/d12/d82/d42 16124230 1 2024-02-15T18:27:12.371 INFO:tasks.workunit.client.0.smithi084.stdout:0/905: mkdir d0/d4/d66/d112 0 2024-02-15T18:27:12.371 INFO:tasks.workunit.client.1.smithi133.stdout:8/549: mkdir d3/d92/db4 0 2024-02-15T18:27:12.373 INFO:tasks.workunit.client.1.smithi133.stdout:0/680: dread d9/d10/d19/d29/d67/d68/d96/d44/fcd [4194304,4194304] 0 2024-02-15T18:27:12.373 INFO:tasks.workunit.client.1.smithi133.stdout:3/659: dread d0/d15/d2f/d9b/d39/f8f [4194304,4194304] 0 2024-02-15T18:27:12.373 INFO:tasks.workunit.client.1.smithi133.stdout:3/660: fdatasync d0/d15/d37/fb7 0 2024-02-15T18:27:12.376 INFO:tasks.workunit.client.0.smithi084.stdout:8/858: dwrite db/d1a/d2b/f4b [0,4194304] 0 2024-02-15T18:27:12.377 INFO:tasks.workunit.client.0.smithi084.stdout:7/926: rename df/f4c to df/d1d/d44/d8d/f133 0 2024-02-15T18:27:12.382 INFO:tasks.workunit.client.1.smithi133.stdout:1/750: dread d6/fd [0,4194304] 0 2024-02-15T18:27:12.382 INFO:tasks.workunit.client.1.smithi133.stdout:1/751: dread - d6/d1e/d3a/d97/fe4 zero size 2024-02-15T18:27:12.384 INFO:tasks.workunit.client.1.smithi133.stdout:3/661: write d0/d15/d2f/f7f [611907,96008] 0 2024-02-15T18:27:12.384 INFO:tasks.workunit.client.0.smithi084.stdout:3/808: dwrite d8/d40/d43/d71/d8c/d94/da3/dba/fe8 [4194304,4194304] 0 2024-02-15T18:27:12.385 INFO:tasks.workunit.client.0.smithi084.stdout:8/859: mknod db/dd/d13/de0/d114/c122 0 2024-02-15T18:27:12.385 INFO:tasks.workunit.client.0.smithi084.stdout:0/906: rename d0/d2f/d3f/d8a/f8b to d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/f113 0 2024-02-15T18:27:12.386 INFO:tasks.workunit.client.1.smithi133.stdout:3/662: mknod d0/cd5 0 2024-02-15T18:27:12.386 INFO:tasks.workunit.client.1.smithi133.stdout:3/663: chown d0/d15/d2f/d5e/f8b 1426062 1 2024-02-15T18:27:12.386 INFO:tasks.workunit.client.1.smithi133.stdout:3/664: chown d0/d15/d37/d4a 3825860 1 2024-02-15T18:27:12.390 INFO:tasks.workunit.client.0.smithi084.stdout:5/963: dread d9/f1e [0,4194304] 0 2024-02-15T18:27:12.390 INFO:tasks.workunit.client.0.smithi084.stdout:5/964: stat d9/da/f1b 0 2024-02-15T18:27:12.391 INFO:tasks.workunit.client.0.smithi084.stdout:3/809: mknod d8/d1f/d2d/dc5/c110 0 2024-02-15T18:27:12.391 INFO:tasks.workunit.client.0.smithi084.stdout:8/860: creat db/dd/d1f/d56/f123 x:0 0 0 2024-02-15T18:27:12.393 INFO:tasks.workunit.client.0.smithi084.stdout:8/861: getdents db/daf/db6 0 2024-02-15T18:27:12.394 INFO:tasks.workunit.client.0.smithi084.stdout:2/881: dwrite d3/dc6/fc0 [0,4194304] 0 2024-02-15T18:27:12.394 INFO:tasks.workunit.client.0.smithi084.stdout:1/856: dread d9/d54/d1b/d2c/d35/f72 [0,4194304] 0 2024-02-15T18:27:12.396 INFO:tasks.workunit.client.0.smithi084.stdout:3/810: creat d8/d40/d43/d71/dd9/f111 x:0 0 0 2024-02-15T18:27:12.397 INFO:tasks.workunit.client.1.smithi133.stdout:3/665: creat d0/d15/d2f/d9b/d39/fd6 x:0 0 0 2024-02-15T18:27:12.397 INFO:tasks.workunit.client.1.smithi133.stdout:3/666: fdatasync d0/f3a 0 2024-02-15T18:27:12.398 INFO:tasks.workunit.client.0.smithi084.stdout:0/907: write d0/d39/f78 [1756865,34190] 0 2024-02-15T18:27:12.398 INFO:tasks.workunit.client.0.smithi084.stdout:0/908: write d0/d4/d3a/d82/dcb/fdd [1168653,115238] 0 2024-02-15T18:27:12.399 INFO:tasks.workunit.client.0.smithi084.stdout:8/862: read db/dd/d1f/f38 [1026852,18845] 0 2024-02-15T18:27:12.399 INFO:tasks.workunit.client.0.smithi084.stdout:8/863: write db/dd/d1f/d66/da2/fe5 [85861,64243] 0 2024-02-15T18:27:12.400 INFO:tasks.workunit.client.1.smithi133.stdout:3/667: write d0/d15/d2f/d9b/f44 [367564,37067] 0 2024-02-15T18:27:12.400 INFO:tasks.workunit.client.1.smithi133.stdout:3/668: readlink d0/d15/d2f/d9b/lc8 0 2024-02-15T18:27:12.401 INFO:tasks.workunit.client.1.smithi133.stdout:2/589: dread d7/d18/d32/d65/d54/f83 [0,4194304] 0 2024-02-15T18:27:12.401 INFO:tasks.workunit.client.0.smithi084.stdout:1/857: unlink d9/d54/d1b/c9b 0 2024-02-15T18:27:12.402 INFO:tasks.workunit.client.0.smithi084.stdout:2/882: creat d3/d5/d53/dca/d89/dec/f11d x:0 0 0 2024-02-15T18:27:12.403 INFO:tasks.workunit.client.0.smithi084.stdout:0/909: creat d0/d39/f114 x:0 0 0 2024-02-15T18:27:12.405 INFO:tasks.workunit.client.0.smithi084.stdout:1/858: creat d9/d54/d32/d5b/f118 x:0 0 0 2024-02-15T18:27:12.408 INFO:tasks.workunit.client.0.smithi084.stdout:0/910: rename d0/d2f/d4b/dae/db0/deb to d0/d4/da8/dd8/d115 0 2024-02-15T18:27:12.408 INFO:tasks.workunit.client.0.smithi084.stdout:0/911: fsync d0/d4/f54 0 2024-02-15T18:27:12.408 INFO:tasks.workunit.client.0.smithi084.stdout:0/912: fsync d0/d2f/d3f/d4c/de1/ff3 0 2024-02-15T18:27:12.409 INFO:tasks.workunit.client.0.smithi084.stdout:1/859: mkdir d9/d54/d1b/d2c/d4b/d4c/da9/d119 0 2024-02-15T18:27:12.412 INFO:tasks.workunit.client.0.smithi084.stdout:4/978: write d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/f98 [5036081,125421] 0 2024-02-15T18:27:12.412 INFO:tasks.workunit.client.0.smithi084.stdout:5/965: dread d9/d35/f58 [0,4194304] 0 2024-02-15T18:27:12.412 INFO:tasks.workunit.client.0.smithi084.stdout:4/979: chown d2/d4/d28/d3d/da4 947643 1 2024-02-15T18:27:12.413 INFO:tasks.workunit.client.0.smithi084.stdout:5/966: dread - d9/da/d3d/d44/d55/dfe/f125 zero size 2024-02-15T18:27:12.413 INFO:tasks.workunit.client.1.smithi133.stdout:6/773: sync 2024-02-15T18:27:12.417 INFO:tasks.workunit.client.0.smithi084.stdout:1/860: mkdir d9/d54/d1b/d2c/d11a 0 2024-02-15T18:27:12.417 INFO:tasks.workunit.client.0.smithi084.stdout:2/883: dread d3/d5/d53/dca/d89/f40 [0,4194304] 0 2024-02-15T18:27:12.417 INFO:tasks.workunit.client.0.smithi084.stdout:2/884: fsync d3/d5/d53/dca/d7b/d105/d2d/f38 0 2024-02-15T18:27:12.419 INFO:tasks.workunit.client.0.smithi084.stdout:5/967: unlink d9/d35/c49 0 2024-02-15T18:27:12.420 INFO:tasks.workunit.client.0.smithi084.stdout:4/980: symlink d2/d4/d28/df2/l11e 0 2024-02-15T18:27:12.421 INFO:tasks.workunit.client.0.smithi084.stdout:2/885: mkdir d3/d5/d53/dca/d7b/d105/d1e/d30/d8d/df1/d11e 0 2024-02-15T18:27:12.421 INFO:tasks.workunit.client.0.smithi084.stdout:2/886: readlink d3/d5/d53/dca/lc1 0 2024-02-15T18:27:12.426 INFO:tasks.workunit.client.0.smithi084.stdout:9/960: dwrite d4/d3d/f94 [0,4194304] 0 2024-02-15T18:27:12.426 INFO:tasks.workunit.client.1.smithi133.stdout:4/422: dwrite d2/d5/d2b/d21/d3b/d49/f69 [0,4194304] 0 2024-02-15T18:27:12.427 INFO:tasks.workunit.client.1.smithi133.stdout:5/485: dwrite d17/f6d [0,4194304] 0 2024-02-15T18:27:12.427 INFO:tasks.workunit.client.1.smithi133.stdout:5/486: stat d17/d26/f52 0 2024-02-15T18:27:12.428 INFO:tasks.workunit.client.0.smithi084.stdout:5/968: mknod d9/d5f/dcc/c13c 0 2024-02-15T18:27:12.428 INFO:tasks.workunit.client.0.smithi084.stdout:4/981: getdents d2 0 2024-02-15T18:27:12.428 INFO:tasks.workunit.client.0.smithi084.stdout:4/982: write d2/d4/d28/d3d/d5c/d5d/f10e [54935,36324] 0 2024-02-15T18:27:12.428 INFO:tasks.workunit.client.0.smithi084.stdout:0/913: write d0/d4/d3a/d5c/de2/f2e [6448645,117700] 0 2024-02-15T18:27:12.430 INFO:tasks.workunit.client.0.smithi084.stdout:5/969: symlink d9/da/d3d/d44/d55/dfe/dac/l13d 0 2024-02-15T18:27:12.430 INFO:tasks.workunit.client.0.smithi084.stdout:5/970: fdatasync d9/da/d3d/d44/d55/d70/fdd 0 2024-02-15T18:27:12.431 INFO:tasks.workunit.client.0.smithi084.stdout:0/914: rename d0/d4/d3a/d5c/de2/d43/cb8 to d0/d2f/d4b/dee/c116 0 2024-02-15T18:27:12.432 INFO:tasks.workunit.client.0.smithi084.stdout:0/915: write d0/d2f/d3f/d4f/f101 [591629,61917] 0 2024-02-15T18:27:12.433 INFO:tasks.workunit.client.0.smithi084.stdout:5/971: truncate d9/da/d3d/d44/d55/d70/dfa/f11d 3152480 0 2024-02-15T18:27:12.433 INFO:tasks.workunit.client.0.smithi084.stdout:5/972: chown d9/da/d3d/d44/d55/dfe/f47 1 1 2024-02-15T18:27:12.433 INFO:tasks.workunit.client.0.smithi084.stdout:5/973: stat d9/da/cd 0 2024-02-15T18:27:12.434 INFO:tasks.workunit.client.0.smithi084.stdout:5/974: chown d9/da/d3d/d44/d55/c63 29 1 2024-02-15T18:27:12.434 INFO:tasks.workunit.client.0.smithi084.stdout:5/975: fsync d9/d5b/d7e/db5/f111 0 2024-02-15T18:27:12.435 INFO:tasks.workunit.client.0.smithi084.stdout:0/916: rename d0/d2f/d3f/c14 to d0/d2f/d3f/d4c/d9a/c117 0 2024-02-15T18:27:12.436 INFO:tasks.workunit.client.0.smithi084.stdout:0/917: readlink d0/l9 0 2024-02-15T18:27:12.437 INFO:tasks.workunit.client.0.smithi084.stdout:5/976: rename d9/da/d3d/d44/d55/fc0 to d9/da/d3d/d44/d55/d70/dfa/d133/f13e 0 2024-02-15T18:27:12.440 INFO:tasks.workunit.client.0.smithi084.stdout:0/918: mknod d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/c118 0 2024-02-15T18:27:12.440 INFO:tasks.workunit.client.0.smithi084.stdout:5/977: mkdir d9/da/d3d/d13f 0 2024-02-15T18:27:12.440 INFO:tasks.workunit.client.0.smithi084.stdout:0/919: chown d0/d4/d3a/d5c/de2/f2e 0 1 2024-02-15T18:27:12.444 INFO:tasks.workunit.client.0.smithi084.stdout:5/978: rename d9/d5f/d68/l103 to d9/dc6/l140 0 2024-02-15T18:27:12.444 INFO:tasks.workunit.client.0.smithi084.stdout:0/920: symlink d0/d4/d3a/d5c/de2/d43/d6d/l119 0 2024-02-15T18:27:12.444 INFO:tasks.workunit.client.1.smithi133.stdout:5/487: rmdir d17/d26/d7b/d87/d8c 0 2024-02-15T18:27:12.446 INFO:tasks.workunit.client.1.smithi133.stdout:8/550: dwrite d3/de/f25 [0,4194304] 0 2024-02-15T18:27:12.446 INFO:tasks.workunit.client.1.smithi133.stdout:8/551: symlink d3/d1c/d2f/d87/lb5 0 2024-02-15T18:27:12.448 INFO:tasks.workunit.client.0.smithi084.stdout:0/921: creat d0/d4/da8/dd8/d115/f11a x:0 0 0 2024-02-15T18:27:12.448 INFO:tasks.workunit.client.0.smithi084.stdout:0/922: chown d0/d2f/d3f/d4c/d9a/fd6 35792208 1 2024-02-15T18:27:12.449 INFO:tasks.workunit.client.1.smithi133.stdout:8/552: creat d3/d1f/d3f/d8c/fb6 x:0 0 0 2024-02-15T18:27:12.453 INFO:tasks.workunit.client.0.smithi084.stdout:5/979: write d9/da/f1b [2444055,105025] 0 2024-02-15T18:27:12.453 INFO:tasks.workunit.client.0.smithi084.stdout:5/980: truncate d9/da/d3d/d44/d55/d70/fdd 1724960 0 2024-02-15T18:27:12.453 INFO:tasks.workunit.client.0.smithi084.stdout:5/981: chown d9/da/d3d/d44/d55/dfe/f47 3338 1 2024-02-15T18:27:12.453 INFO:tasks.workunit.client.1.smithi133.stdout:4/423: dread d2/d5/d2b/f5b [0,4194304] 0 2024-02-15T18:27:12.456 INFO:tasks.workunit.client.0.smithi084.stdout:5/982: mknod d9/d35/d65/d7f/dd6/deb/df0/c141 0 2024-02-15T18:27:12.456 INFO:tasks.workunit.client.0.smithi084.stdout:5/983: readlink d9/d5b/d7e/lc5 0 2024-02-15T18:27:12.457 INFO:tasks.workunit.client.1.smithi133.stdout:8/553: rename d3/de/d3e/l60 to d3/d1c/d37/d5c/lb7 0 2024-02-15T18:27:12.457 INFO:tasks.workunit.client.1.smithi133.stdout:8/554: fdatasync d3/d1f/d3f/d58/fb3 0 2024-02-15T18:27:12.457 INFO:tasks.workunit.client.1.smithi133.stdout:8/555: chown d3/d7/l10 1171 1 2024-02-15T18:27:12.472 INFO:tasks.workunit.client.0.smithi084.stdout:7/927: dwrite df/d1d/d1a/fc0 [0,4194304] 0 2024-02-15T18:27:12.473 INFO:tasks.workunit.client.1.smithi133.stdout:4/424: dread d2/d5/d2b/d21/d2d/f2e [0,4194304] 0 2024-02-15T18:27:12.477 INFO:tasks.workunit.client.1.smithi133.stdout:0/681: dwrite d9/d10/d19/d29/d67/d68/d96/d44/fcd [0,4194304] 0 2024-02-15T18:27:12.477 INFO:tasks.workunit.client.1.smithi133.stdout:1/752: dwrite d6/d1e/f27 [8388608,4194304] 0 2024-02-15T18:27:12.480 INFO:tasks.workunit.client.1.smithi133.stdout:8/556: dread d3/d7/d40/d61/f65 [0,4194304] 0 2024-02-15T18:27:12.481 INFO:tasks.workunit.client.0.smithi084.stdout:3/811: dwrite d8/d1f/d25/f10f [0,4194304] 0 2024-02-15T18:27:12.482 INFO:tasks.workunit.client.0.smithi084.stdout:7/928: write df/d1d/d1a/d4d/fbe [1735351,83977] 0 2024-02-15T18:27:12.482 INFO:tasks.workunit.client.1.smithi133.stdout:2/590: dwrite d7/db/f1d [4194304,4194304] 0 2024-02-15T18:27:12.484 INFO:tasks.workunit.client.1.smithi133.stdout:0/682: write d9/d10/d19/f73 [983221,89566] 0 2024-02-15T18:27:12.484 INFO:tasks.workunit.client.1.smithi133.stdout:0/683: chown d9/d10/d47/d5e/c81 88850206 1 2024-02-15T18:27:12.488 INFO:tasks.workunit.client.1.smithi133.stdout:1/753: rmdir d6/d2a/d59/d10b 0 2024-02-15T18:27:12.490 INFO:tasks.workunit.client.1.smithi133.stdout:2/591: unlink d7/l93 0 2024-02-15T18:27:12.493 INFO:tasks.workunit.client.0.smithi084.stdout:7/929: dread df/d1d/d1a/d6a/d8e/f71 [0,4194304] 0 2024-02-15T18:27:12.493 INFO:tasks.workunit.client.0.smithi084.stdout:8/864: dwrite db/daf/db6/fef [0,4194304] 0 2024-02-15T18:27:12.493 INFO:tasks.workunit.client.0.smithi084.stdout:7/930: stat df/d1d/d1a/d4d/d103/cc5 0 2024-02-15T18:27:12.493 INFO:tasks.workunit.client.0.smithi084.stdout:7/931: write df/d1d/d1a/d6a/d8b/da5/db6/fe3 [652270,128894] 0 2024-02-15T18:27:12.493 INFO:tasks.workunit.client.0.smithi084.stdout:2/887: dwrite d3/d5/d53/dca/d7b/d105/d1e/d30/d8d/fdf [0,4194304] 0 2024-02-15T18:27:12.497 INFO:tasks.workunit.client.1.smithi133.stdout:0/684: unlink d9/d10/d19/d29/fd3 0 2024-02-15T18:27:12.498 INFO:tasks.workunit.client.1.smithi133.stdout:1/754: creat d6/d1e/d41/d7c/d7e/d7f/db6/f117 x:0 0 0 2024-02-15T18:27:12.498 INFO:tasks.workunit.client.1.smithi133.stdout:0/685: write d9/d10/d22/d2f/f51 [1006633,8341] 0 2024-02-15T18:27:12.498 INFO:tasks.workunit.client.1.smithi133.stdout:1/755: chown d6/d2a/d59/d5a/da4/daa 6800385 1 2024-02-15T18:27:12.498 INFO:tasks.workunit.client.1.smithi133.stdout:2/592: creat d7/d2c/d5a/d66/d70/fbb x:0 0 0 2024-02-15T18:27:12.498 INFO:tasks.workunit.client.1.smithi133.stdout:2/593: fsync d7/ff 0 2024-02-15T18:27:12.500 INFO:tasks.workunit.client.0.smithi084.stdout:7/932: rename df/d1d/d1a/d6a/fd2 to df/d1d/d44/d8d/d10a/f134 0 2024-02-15T18:27:12.500 INFO:tasks.workunit.client.0.smithi084.stdout:1/861: dwrite d9/d54/d7f/db7/dd9/d81/ded/f10f [0,4194304] 0 2024-02-15T18:27:12.501 INFO:tasks.workunit.client.1.smithi133.stdout:6/774: dwrite d0/d62/ff9 [0,4194304] 0 2024-02-15T18:27:12.501 INFO:tasks.workunit.client.1.smithi133.stdout:6/775: chown d0/db/d29/d34/d5d/dc9/fe9 13450 1 2024-02-15T18:27:12.501 INFO:tasks.workunit.client.1.smithi133.stdout:6/776: readlink d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/la8 0 2024-02-15T18:27:12.502 INFO:tasks.workunit.client.0.smithi084.stdout:7/933: symlink df/d1d/d1a/d6a/d8b/da5/db6/l135 0 2024-02-15T18:27:12.502 INFO:tasks.workunit.client.0.smithi084.stdout:7/934: fsync df/d1d/d1a/d6a/d8b/da5/db6/ffd 0 2024-02-15T18:27:12.502 INFO:tasks.workunit.client.1.smithi133.stdout:2/594: rmdir d7/d2c/d46 39 2024-02-15T18:27:12.502 INFO:tasks.workunit.client.0.smithi084.stdout:9/961: dwrite d4/d2b/d3c/d24/dca/f99 [0,4194304] 0 2024-02-15T18:27:12.505 INFO:tasks.workunit.client.0.smithi084.stdout:2/888: mkdir d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3/d117/db9/de8/d11f 0 2024-02-15T18:27:12.506 INFO:tasks.workunit.client.0.smithi084.stdout:2/889: chown d3/d5/d53/dca/d7b/d105/d2d/f38 18590119 1 2024-02-15T18:27:12.506 INFO:tasks.workunit.client.0.smithi084.stdout:9/962: write d4/d2b/d3c/d20/f52 [318996,49599] 0 2024-02-15T18:27:12.508 INFO:tasks.workunit.client.1.smithi133.stdout:2/595: mknod d7/d2c/cbc 0 2024-02-15T18:27:12.511 INFO:tasks.workunit.client.0.smithi084.stdout:9/963: read d4/fd6 [244789,104278] 0 2024-02-15T18:27:12.513 INFO:tasks.workunit.client.1.smithi133.stdout:6/777: creat d0/db/d29/d34/d5d/d40/dde/d52/f104 x:0 0 0 2024-02-15T18:27:12.513 INFO:tasks.workunit.client.1.smithi133.stdout:0/686: dread d9/f3e [0,4194304] 0 2024-02-15T18:27:12.513 INFO:tasks.workunit.client.1.smithi133.stdout:0/687: chown d9/d10/d19/d29/d67/d68/d9c 73754045 1 2024-02-15T18:27:12.513 INFO:tasks.workunit.client.1.smithi133.stdout:2/596: write d7/d2c/f49 [2655926,101493] 0 2024-02-15T18:27:12.514 INFO:tasks.workunit.client.1.smithi133.stdout:2/597: write d7/d2c/f68 [1287251,23640] 0 2024-02-15T18:27:12.514 INFO:tasks.workunit.client.0.smithi084.stdout:3/812: dwrite d8/fac [0,4194304] 0 2024-02-15T18:27:12.515 INFO:tasks.workunit.client.1.smithi133.stdout:6/778: creat d0/db/d29/d34/d5d/d40/dde/d67/f105 x:0 0 0 2024-02-15T18:27:12.515 INFO:tasks.workunit.client.0.smithi084.stdout:4/983: dwrite d2/d2b/d47/f56 [0,4194304] 0 2024-02-15T18:27:12.516 INFO:tasks.workunit.client.0.smithi084.stdout:0/923: dwrite d0/d4/d3a/db3/ff8 [0,4194304] 0 2024-02-15T18:27:12.517 INFO:tasks.workunit.client.1.smithi133.stdout:6/779: getdents d0/db/d29/d34/d5d/d40/dde/db1 0 2024-02-15T18:27:12.517 INFO:tasks.workunit.client.1.smithi133.stdout:6/780: chown d0/db/f70 13173882 1 2024-02-15T18:27:12.518 INFO:tasks.workunit.client.1.smithi133.stdout:6/781: truncate d0/db/d29/d34/d5d/d40/dde/d78/fe3 103550 0 2024-02-15T18:27:12.522 INFO:tasks.workunit.client.1.smithi133.stdout:6/782: dread d0/db/d29/d34/d48/f49 [0,4194304] 0 2024-02-15T18:27:12.522 INFO:tasks.workunit.client.1.smithi133.stdout:6/783: readlink d0/db/d29/d34/d48/l5f 0 2024-02-15T18:27:12.524 INFO:tasks.workunit.client.1.smithi133.stdout:5/488: dwrite d17/d2a/f2d [0,4194304] 0 2024-02-15T18:27:12.524 INFO:tasks.workunit.client.1.smithi133.stdout:5/489: fdatasync d17/d2a/f9c 0 2024-02-15T18:27:12.525 INFO:tasks.workunit.client.0.smithi084.stdout:5/984: dwrite d9/d5f/d68/f83 [0,4194304] 0 2024-02-15T18:27:12.525 INFO:tasks.workunit.client.1.smithi133.stdout:6/784: truncate d0/db/d29/d34/fb7 753270 0 2024-02-15T18:27:12.525 INFO:tasks.workunit.client.1.smithi133.stdout:2/598: write d7/f15 [251923,23816] 0 2024-02-15T18:27:12.528 INFO:tasks.workunit.client.1.smithi133.stdout:6/785: rename d0/db/d29/d34/d5d/d40/dde/d85 to d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106 0 2024-02-15T18:27:12.528 INFO:tasks.workunit.client.1.smithi133.stdout:5/490: write d17/d26/f58 [2696881,115261] 0 2024-02-15T18:27:12.528 INFO:tasks.workunit.client.1.smithi133.stdout:5/491: chown d17/d20/d32/c40 155 1 2024-02-15T18:27:12.530 INFO:tasks.workunit.client.1.smithi133.stdout:5/492: truncate d17/d20/f2f 49816 0 2024-02-15T18:27:12.530 INFO:tasks.workunit.client.1.smithi133.stdout:5/493: chown d17/d20/d5e/c67 8996710 1 2024-02-15T18:27:12.532 INFO:tasks.workunit.client.1.smithi133.stdout:5/494: creat d17/d20/d32/d7d/d7e/fa2 x:0 0 0 2024-02-15T18:27:12.544 INFO:tasks.workunit.client.0.smithi084.stdout:4/984: dwrite d2/f34 [0,4194304] 0 2024-02-15T18:27:12.546 INFO:tasks.workunit.client.1.smithi133.stdout:5/495: dread d17/d20/d32/d38/d70/f7c [0,4194304] 0 2024-02-15T18:27:12.547 INFO:tasks.workunit.client.1.smithi133.stdout:5/496: write d17/d20/d32/d38/d70/f7c [2695202,64821] 0 2024-02-15T18:27:12.560 INFO:tasks.workunit.client.0.smithi084.stdout:1/862: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/d39/f23 [0,4194304] 0 2024-02-15T18:27:12.560 INFO:tasks.workunit.client.0.smithi084.stdout:1/863: chown d9/d54/d1b/d38/d4d 2 1 2024-02-15T18:27:12.561 INFO:tasks.workunit.client.1.smithi133.stdout:5/497: dread f15 [0,4194304] 0 2024-02-15T18:27:12.562 INFO:tasks.workunit.client.1.smithi133.stdout:5/498: symlink d17/d20/d4f/d5f/d93/la3 0 2024-02-15T18:27:12.562 INFO:tasks.workunit.client.1.smithi133.stdout:5/499: write d17/d20/f53 [987935,121657] 0 2024-02-15T18:27:12.564 INFO:tasks.workunit.client.1.smithi133.stdout:5/500: getdents d17/d20/d32/d7d 0 2024-02-15T18:27:12.565 INFO:tasks.workunit.client.1.smithi133.stdout:5/501: mknod d17/d20/d4f/d5f/d93/ca4 0 2024-02-15T18:27:12.565 INFO:tasks.workunit.client.1.smithi133.stdout:5/502: readlink d17/d20/l29 0 2024-02-15T18:27:12.565 INFO:tasks.workunit.client.1.smithi133.stdout:5/503: chown d17/f33 0 1 2024-02-15T18:27:12.565 INFO:tasks.workunit.client.1.smithi133.stdout:5/504: chown d17/d2a/f8a 56 1 2024-02-15T18:27:12.566 INFO:tasks.workunit.client.1.smithi133.stdout:0/688: dwrite d9/d2b/f45 [0,4194304] 0 2024-02-15T18:27:12.566 INFO:tasks.workunit.client.1.smithi133.stdout:0/689: readlink d9/d10/d19/d1a/le3 0 2024-02-15T18:27:12.566 INFO:tasks.workunit.client.1.smithi133.stdout:1/756: dwrite d6/d1e/d41/dcc/fcd [0,4194304] 0 2024-02-15T18:27:12.566 INFO:tasks.workunit.client.1.smithi133.stdout:1/757: write d6/d2a/f4a [1003599,36292] 0 2024-02-15T18:27:12.567 INFO:tasks.workunit.client.0.smithi084.stdout:5/985: dwrite d9/d5f/dcc/d115/f134 [0,4194304] 0 2024-02-15T18:27:12.567 INFO:tasks.workunit.client.0.smithi084.stdout:8/865: dwrite db/fe [4194304,4194304] 0 2024-02-15T18:27:12.570 INFO:tasks.workunit.client.1.smithi133.stdout:1/758: write f2 [337785,63132] 0 2024-02-15T18:27:12.570 INFO:tasks.workunit.client.1.smithi133.stdout:6/786: truncate d0/d62/ff9 3883757 0 2024-02-15T18:27:12.571 INFO:tasks.workunit.client.1.smithi133.stdout:5/505: write d17/f1c [1674546,128524] 0 2024-02-15T18:27:12.571 INFO:tasks.workunit.client.1.smithi133.stdout:1/759: dread d6/d1e/d3a/d82/d85/dc7/fca [0,4194304] 0 2024-02-15T18:27:12.572 INFO:tasks.workunit.client.1.smithi133.stdout:1/760: stat d6/d1e/d3a/d82/d85 0 2024-02-15T18:27:12.573 INFO:tasks.workunit.client.1.smithi133.stdout:0/690: link d9/d10/d47/d5e/f8e d9/d2b/dd2/fe7 0 2024-02-15T18:27:12.574 INFO:tasks.workunit.client.1.smithi133.stdout:0/691: dread - d9/d10/d19/d29/d67/d68/d9c/da7/fda zero size 2024-02-15T18:27:12.584 INFO:tasks.workunit.client.0.smithi084.stdout:2/890: truncate d3/fc 894952 0 2024-02-15T18:27:12.617 INFO:tasks.workunit.client.0.smithi084.stdout:9/964: mkdir d4/d6b/d12e 0 2024-02-15T18:27:12.617 INFO:tasks.workunit.client.0.smithi084.stdout:3/813: creat d8/d40/d43/f112 x:0 0 0 2024-02-15T18:27:12.617 INFO:tasks.workunit.client.0.smithi084.stdout:0/924: creat d0/d39/f11b x:0 0 0 2024-02-15T18:27:12.617 INFO:tasks.workunit.client.0.smithi084.stdout:4/985: creat d2/d4/d28/f11f x:0 0 0 2024-02-15T18:27:12.618 INFO:tasks.workunit.client.0.smithi084.stdout:6/846: sync 2024-02-15T18:27:12.618 INFO:tasks.workunit.client.0.smithi084.stdout:7/935: rmdir df/d1d 39 2024-02-15T18:27:12.620 INFO:tasks.workunit.client.1.smithi133.stdout:6/787: link d0/db/d29/l42 d0/db/d29/d34/l107 0 2024-02-15T18:27:12.620 INFO:tasks.workunit.client.1.smithi133.stdout:5/506: creat d17/d20/d32/d9d/fa5 x:0 0 0 2024-02-15T18:27:12.620 INFO:tasks.workunit.client.1.smithi133.stdout:1/761: creat d6/d1e/d3a/d82/d85/d67/ddb/f118 x:0 0 0 2024-02-15T18:27:12.620 INFO:tasks.workunit.client.1.smithi133.stdout:1/762: read - d6/d1e/d3a/d79/d8e/fd0 zero size 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:6/788: write d0/d62/fd0 [511927,99227] 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:9/516: truncate d0/f7 582014 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:9/517: write d0/d8/d6c/f72 [187894,68672] 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:5/507: truncate f15 2112129 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:1/763: symlink d6/d1e/d41/d7c/d7e/d7f/l119 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:6/789: creat d0/db/d29/d34/d5d/d40/dde/d67/d9a/f108 x:0 0 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:9/518: dread d0/d8/d6c/f72 [0,4194304] 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:5/508: link d17/d20/d32/d7d/d7e/f84 d17/d20/d32/d38/d86/fa6 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:1/764: symlink d6/d1e/d3a/d79/l11a 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:6/790: creat d0/db/db6/f109 x:0 0 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:5/509: link d17/d20/d32/c4b d17/d20/d32/d7d/ca7 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:1/765: mkdir d6/d1e/d3a/d82/d85/d11b 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:5/510: write fc [4596414,24650] 0 2024-02-15T18:27:12.621 INFO:tasks.workunit.client.1.smithi133.stdout:5/511: chown d17/d26/f52 233757802 1 2024-02-15T18:27:12.622 INFO:tasks.workunit.client.1.smithi133.stdout:9/519: mkdir d0/d8/d10/daa 0 2024-02-15T18:27:12.622 INFO:tasks.workunit.client.1.smithi133.stdout:1/766: write d6/d1e/d3a/d79/faf [1415852,80709] 0 2024-02-15T18:27:12.622 INFO:tasks.workunit.client.1.smithi133.stdout:1/767: rmdir d6/d1e/d3a/d82/d85 39 2024-02-15T18:27:12.622 INFO:tasks.workunit.client.1.smithi133.stdout:1/768: write d6/d1e/d3a/d75/ff5 [1643409,76052] 0 2024-02-15T18:27:12.622 INFO:tasks.workunit.client.1.smithi133.stdout:9/520: write d0/d8/d9/d3c/f62 [2445471,13455] 0 2024-02-15T18:27:12.622 INFO:tasks.workunit.client.1.smithi133.stdout:1/769: mkdir d6/d1e/d3a/d82/d85/d67/ddb/d11c 0 2024-02-15T18:27:12.622 INFO:tasks.workunit.client.1.smithi133.stdout:9/521: creat d0/d8/d9/d12/fab x:0 0 0 2024-02-15T18:27:12.622 INFO:tasks.workunit.client.1.smithi133.stdout:1/770: creat d6/d1e/d3a/d82/f11d x:0 0 0 2024-02-15T18:27:12.622 INFO:tasks.workunit.client.1.smithi133.stdout:1/771: chown d6/d1e/d3a/d97 1 1 2024-02-15T18:27:12.624 INFO:tasks.workunit.client.1.smithi133.stdout:6/791: dwrite d0/f50 [0,4194304] 0 2024-02-15T18:27:12.625 INFO:tasks.workunit.client.0.smithi084.stdout:7/936: dread df/f1c [0,4194304] 0 2024-02-15T18:27:12.625 INFO:tasks.workunit.client.1.smithi133.stdout:1/772: rename d6/f2d to d6/d2a/df1/f11e 0 2024-02-15T18:27:12.625 INFO:tasks.workunit.client.1.smithi133.stdout:9/522: symlink d0/d8/d10/da1/lac 0 2024-02-15T18:27:12.626 INFO:tasks.workunit.client.1.smithi133.stdout:6/792: mkdir d0/d62/d66/d10a 0 2024-02-15T18:27:12.626 INFO:tasks.workunit.client.1.smithi133.stdout:1/773: creat d6/d1e/d3a/d82/d85/dc7/f11f x:0 0 0 2024-02-15T18:27:12.627 INFO:tasks.workunit.client.1.smithi133.stdout:1/774: write d6/d1e/d3a/d82/d85/dc7/f10d [890528,50549] 0 2024-02-15T18:27:12.627 INFO:tasks.workunit.client.1.smithi133.stdout:1/775: read - d6/d1e/d3a/d79/d8e/fd0 zero size 2024-02-15T18:27:12.628 INFO:tasks.workunit.client.1.smithi133.stdout:6/793: creat d0/db/d29/d34/d8c/da5/f10b x:0 0 0 2024-02-15T18:27:12.628 INFO:tasks.workunit.client.1.smithi133.stdout:9/523: creat d0/fad x:0 0 0 2024-02-15T18:27:12.628 INFO:tasks.workunit.client.1.smithi133.stdout:9/524: chown d0/d8/d10/f36 52192 1 2024-02-15T18:27:12.629 INFO:tasks.workunit.client.1.smithi133.stdout:1/776: rename d6/l3d to d6/d1e/d3a/d97/l120 0 2024-02-15T18:27:12.630 INFO:tasks.workunit.client.1.smithi133.stdout:6/794: getdents d0/db/d29/d34/d5d/dc9 0 2024-02-15T18:27:12.631 INFO:tasks.workunit.client.1.smithi133.stdout:9/525: creat d0/d8/d9/d12/d82/d42/fae x:0 0 0 2024-02-15T18:27:12.633 INFO:tasks.workunit.client.1.smithi133.stdout:1/777: rename d6/d1e/c6c to d6/d1e/d3a/d97/dda/dff/c121 0 2024-02-15T18:27:12.634 INFO:tasks.workunit.client.1.smithi133.stdout:6/795: mkdir d0/db/d29/d34/d5d/d40/dde/d67/d10c 0 2024-02-15T18:27:12.634 INFO:tasks.workunit.client.1.smithi133.stdout:9/526: creat d0/faf x:0 0 0 2024-02-15T18:27:12.646 INFO:tasks.workunit.client.1.smithi133.stdout:6/796: mknod d0/db/d29/d34/c10d 0 2024-02-15T18:27:12.646 INFO:tasks.workunit.client.1.smithi133.stdout:6/797: fdatasync d0/f50 0 2024-02-15T18:27:12.646 INFO:tasks.workunit.client.1.smithi133.stdout:9/527: creat d0/d8/d9/d12/d82/d42/d79/fb0 x:0 0 0 2024-02-15T18:27:12.646 INFO:tasks.workunit.client.1.smithi133.stdout:9/528: write d0/d8/d9/d12/d82/d42/fae [1015976,990] 0 2024-02-15T18:27:12.646 INFO:tasks.workunit.client.1.smithi133.stdout:6/798: read d0/db/d29/d34/fb7 [688170,46831] 0 2024-02-15T18:27:12.647 INFO:tasks.workunit.client.1.smithi133.stdout:6/799: stat d0/d62/d66/l95 0 2024-02-15T18:27:12.647 INFO:tasks.workunit.client.1.smithi133.stdout:9/529: read d0/d8/d9/d12/f3f [3261031,77464] 0 2024-02-15T18:27:12.648 INFO:tasks.workunit.client.1.smithi133.stdout:6/800: symlink d0/db/d29/d34/d8c/da5/l10e 0 2024-02-15T18:27:12.652 INFO:tasks.workunit.client.1.smithi133.stdout:6/801: unlink d0/db/d29/d34/d8c/ff4 0 2024-02-15T18:27:12.652 INFO:tasks.workunit.client.1.smithi133.stdout:9/530: symlink d0/d8/d9/d12/d82/lb1 0 2024-02-15T18:27:12.652 INFO:tasks.workunit.client.1.smithi133.stdout:1/778: dwrite d6/d1e/d3a/d79/dfa/fc8 [4194304,4194304] 0 2024-02-15T18:27:12.652 INFO:tasks.workunit.client.1.smithi133.stdout:1/779: fdatasync d6/d17/f1d 0 2024-02-15T18:27:12.652 INFO:tasks.workunit.client.1.smithi133.stdout:1/780: fsync d6/d1e/d41/f46 0 2024-02-15T18:27:12.653 INFO:tasks.workunit.client.0.smithi084.stdout:1/864: creat d9/d54/d1b/d2c/f11b x:0 0 0 2024-02-15T18:27:12.653 INFO:tasks.workunit.client.1.smithi133.stdout:1/781: read d6/d1e/d3a/d75/f7d [2832090,2395] 0 2024-02-15T18:27:12.653 INFO:tasks.workunit.client.1.smithi133.stdout:1/782: dread - d6/d89/fcb zero size 2024-02-15T18:27:12.655 INFO:tasks.workunit.client.0.smithi084.stdout:8/866: rename db/d1a/d2b/d7b/fff to db/dd/d13/db9/f124 0 2024-02-15T18:27:12.655 INFO:tasks.workunit.client.1.smithi133.stdout:6/802: mknod d0/db/d21/c10f 0 2024-02-15T18:27:12.655 INFO:tasks.workunit.client.1.smithi133.stdout:6/803: write d0/db/d29/d34/d5d/d40/dde/fdf [265758,13783] 0 2024-02-15T18:27:12.655 INFO:tasks.workunit.client.1.smithi133.stdout:1/783: dread d6/d1e/d41/d7c/f8c [0,4194304] 0 2024-02-15T18:27:12.656 INFO:tasks.workunit.client.0.smithi084.stdout:2/891: rmdir d3/d5/d53/dca/d7b/d105 39 2024-02-15T18:27:12.656 INFO:tasks.workunit.client.1.smithi133.stdout:9/531: rename d0/d8/d6c to d0/d8/d10/db2 0 2024-02-15T18:27:12.657 INFO:tasks.workunit.client.1.smithi133.stdout:9/532: getdents d0/d8/d9/d12/d7f 0 2024-02-15T18:27:12.657 INFO:tasks.workunit.client.1.smithi133.stdout:6/804: mknod d0/db/df5/c110 0 2024-02-15T18:27:12.657 INFO:tasks.workunit.client.1.smithi133.stdout:6/805: write d0/db/d29/d34/d5d/d40/dde/d52/f104 [789376,17591] 0 2024-02-15T18:27:12.658 INFO:tasks.workunit.client.1.smithi133.stdout:1/784: creat d6/d1e/d41/d7c/d7e/d7f/db6/ded/f122 x:0 0 0 2024-02-15T18:27:12.658 INFO:tasks.workunit.client.1.smithi133.stdout:1/785: chown d6/d1e/d3a/d82/d85/d67/da6/lea 0 1 2024-02-15T18:27:12.661 INFO:tasks.workunit.client.0.smithi084.stdout:3/814: mknod d8/d73/c113 0 2024-02-15T18:27:12.661 INFO:tasks.workunit.client.0.smithi084.stdout:0/925: mkdir d0/dbb/d11c 0 2024-02-15T18:27:12.661 INFO:tasks.workunit.client.0.smithi084.stdout:3/815: fdatasync d8/d40/d58/d80/dc4/fee 0 2024-02-15T18:27:12.661 INFO:tasks.workunit.client.0.smithi084.stdout:0/926: fdatasync d0/d4/d1b/d7a/f103 0 2024-02-15T18:27:12.661 INFO:tasks.workunit.client.0.smithi084.stdout:4/986: creat d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/db4/f120 x:0 0 0 2024-02-15T18:27:12.661 INFO:tasks.workunit.client.0.smithi084.stdout:0/927: stat d0/d2f/f10c 0 2024-02-15T18:27:12.661 INFO:tasks.workunit.client.0.smithi084.stdout:4/987: readlink d2/d64/d74/d8f/dc1/ldb 0 2024-02-15T18:27:12.662 INFO:tasks.workunit.client.0.smithi084.stdout:6/847: creat d14/d22/d25/d2f/da9/d9b/dac/f113 x:0 0 0 2024-02-15T18:27:12.662 INFO:tasks.workunit.client.1.smithi133.stdout:9/533: unlink d0/d7b/la9 0 2024-02-15T18:27:12.662 INFO:tasks.workunit.client.1.smithi133.stdout:6/806: write d0/f10 [1599951,20023] 0 2024-02-15T18:27:12.663 INFO:tasks.workunit.client.0.smithi084.stdout:7/937: creat df/d1d/f136 x:0 0 0 2024-02-15T18:27:12.668 INFO:tasks.workunit.client.1.smithi133.stdout:6/807: unlink d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/c8d 0 2024-02-15T18:27:12.669 INFO:tasks.workunit.client.1.smithi133.stdout:6/808: truncate d0/db/f25 3463468 0 2024-02-15T18:27:12.669 INFO:tasks.workunit.client.1.smithi133.stdout:1/786: dread d6/d1e/f86 [0,4194304] 0 2024-02-15T18:27:12.669 INFO:tasks.workunit.client.1.smithi133.stdout:1/787: write d6/d1e/d3a/d82/d85/d67/fc4 [325341,41436] 0 2024-02-15T18:27:12.669 INFO:tasks.workunit.client.1.smithi133.stdout:1/788: write d6/fb1 [5048102,98425] 0 2024-02-15T18:27:12.670 INFO:tasks.workunit.client.1.smithi133.stdout:6/809: truncate d0/f12 1814364 0 2024-02-15T18:27:12.671 INFO:tasks.workunit.client.1.smithi133.stdout:6/810: unlink d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/fec 0 2024-02-15T18:27:12.672 INFO:tasks.workunit.client.1.smithi133.stdout:6/811: mknod d0/d62/d9c/c111 0 2024-02-15T18:27:12.672 INFO:tasks.workunit.client.1.smithi133.stdout:6/812: chown d0/db/d29/d34/d5d/dc9/df7 473 1 2024-02-15T18:27:12.673 INFO:tasks.workunit.client.1.smithi133.stdout:6/813: write d0/db/d29/d34/fb7 [758499,19659] 0 2024-02-15T18:27:12.674 INFO:tasks.workunit.client.1.smithi133.stdout:9/534: dread d0/d8/d9/d12/d82/f2e [0,4194304] 0 2024-02-15T18:27:12.674 INFO:tasks.workunit.client.1.smithi133.stdout:9/535: stat d0/d8/d10/d4d/c80 0 2024-02-15T18:27:12.674 INFO:tasks.workunit.client.1.smithi133.stdout:9/536: readlink d0/d8/d10/d4d/l86 0 2024-02-15T18:27:12.675 INFO:tasks.workunit.client.1.smithi133.stdout:6/814: mknod d0/db/d29/d34/d5d/d40/dde/d67/d9a/dea/c112 0 2024-02-15T18:27:12.675 INFO:tasks.workunit.client.1.smithi133.stdout:6/815: truncate d0/fef 803804 0 2024-02-15T18:27:12.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/537: creat d0/d8/d9/d12/d82/d42/d79/fb3 x:0 0 0 2024-02-15T18:27:12.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/538: fsync d0/faf 0 2024-02-15T18:27:12.676 INFO:tasks.workunit.client.1.smithi133.stdout:9/539: readlink d0/d8/d9/d12/d82/d42/d79/l94 0 2024-02-15T18:27:12.678 INFO:tasks.workunit.client.1.smithi133.stdout:6/816: dread d0/db/d21/f72 [0,4194304] 0 2024-02-15T18:27:12.682 INFO:tasks.workunit.client.0.smithi084.stdout:8/867: dwrite db/dd/d13/db9/f113 [0,4194304] 0 2024-02-15T18:27:12.688 INFO:tasks.workunit.client.1.smithi133.stdout:1/789: write d6/d1e/d3a/d75/ff5 [1290652,44100] 0 2024-02-15T18:27:12.688 INFO:tasks.workunit.client.1.smithi133.stdout:1/790: chown d6/d1e/f27 1898392 1 2024-02-15T18:27:12.692 INFO:tasks.workunit.client.1.smithi133.stdout:1/791: write d6/d1e/f27 [3861418,55705] 0 2024-02-15T18:27:12.694 INFO:tasks.workunit.client.1.smithi133.stdout:6/817: dread d0/db/d29/d34/d5d/d40/dde/d78/d7f/fa7 [0,4194304] 0 2024-02-15T18:27:12.694 INFO:tasks.workunit.client.0.smithi084.stdout:1/865: truncate d9/d54/d1b/d2c/d4b/d4c/d79/f2f 3947759 0 2024-02-15T18:27:12.694 INFO:tasks.workunit.client.0.smithi084.stdout:2/892: truncate d3/f94 762445 0 2024-02-15T18:27:12.694 INFO:tasks.workunit.client.0.smithi084.stdout:9/965: link d4/f19 d4/d2b/d3c/d24/dca/d15/d33/d7b/f12f 0 2024-02-15T18:27:12.696 INFO:tasks.workunit.client.0.smithi084.stdout:3/816: rename d8/d1f/d2d/f3d to d8/d40/d43/d71/dcc/f114 0 2024-02-15T18:27:12.697 INFO:tasks.workunit.client.0.smithi084.stdout:0/928: mkdir d0/d39/d45/df4/d11d 0 2024-02-15T18:27:12.702 INFO:tasks.workunit.client.1.smithi133.stdout:1/792: rmdir d6/d1e 39 2024-02-15T18:27:12.702 INFO:tasks.workunit.client.0.smithi084.stdout:4/988: creat d2/d64/da5/f121 x:0 0 0 2024-02-15T18:27:12.702 INFO:tasks.workunit.client.0.smithi084.stdout:7/938: symlink df/d1d/d1a/dd1/l137 0 2024-02-15T18:27:12.702 INFO:tasks.workunit.client.0.smithi084.stdout:8/868: rmdir db/d6a/d76/dee 0 2024-02-15T18:27:12.703 INFO:tasks.workunit.client.1.smithi133.stdout:6/818: write d0/db/d21/f3c [252237,46234] 0 2024-02-15T18:27:12.703 INFO:tasks.workunit.client.1.smithi133.stdout:6/819: chown d0/db/d29/d34/d5d/d40/dde 6250686 1 2024-02-15T18:27:12.704 INFO:tasks.workunit.client.0.smithi084.stdout:8/869: write db/dd/d4d/f7c [941679,32526] 0 2024-02-15T18:27:12.704 INFO:tasks.workunit.client.0.smithi084.stdout:2/893: symlink d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3/d117/d8e/l120 0 2024-02-15T18:27:12.706 INFO:tasks.workunit.client.0.smithi084.stdout:0/929: rename d0/d2f/d3f/d4f/d59/da7/ffa to d0/d2f/d4b/dae/f11e 0 2024-02-15T18:27:12.706 INFO:tasks.workunit.client.1.smithi133.stdout:1/793: rename d6/d1e/d3a/d97/dda/f106 to d6/d2a/f123 0 2024-02-15T18:27:12.706 INFO:tasks.workunit.client.1.smithi133.stdout:6/820: creat d0/db/d29/d34/d5d/d40/dde/d53/f113 x:0 0 0 2024-02-15T18:27:12.707 INFO:tasks.workunit.client.0.smithi084.stdout:4/989: unlink d2/d4/d25/cfe 0 2024-02-15T18:27:12.708 INFO:tasks.workunit.client.1.smithi133.stdout:1/794: link d6/d1e/d3a/d97/fe4 d6/d1e/d41/d7c/f124 0 2024-02-15T18:27:12.710 INFO:tasks.workunit.client.0.smithi084.stdout:8/870: getdents db/dd/d1f/d9b 0 2024-02-15T18:27:12.710 INFO:tasks.workunit.client.0.smithi084.stdout:8/871: fdatasync db/d3f/f54 0 2024-02-15T18:27:12.711 INFO:tasks.workunit.client.0.smithi084.stdout:2/894: rename d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3/d117/f77 to d3/d9e/f121 0 2024-02-15T18:27:12.712 INFO:tasks.workunit.client.0.smithi084.stdout:2/895: write d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/fa5 [690506,40046] 0 2024-02-15T18:27:12.712 INFO:tasks.workunit.client.0.smithi084.stdout:0/930: rmdir d0/d98 39 2024-02-15T18:27:12.712 INFO:tasks.workunit.client.1.smithi133.stdout:6/821: rename d0/db/d29/d34/d48/da1/ld6 to d0/db/d29/d34/d5d/d40/dde/d67/d9a/dc1/l114 0 2024-02-15T18:27:12.712 INFO:tasks.workunit.client.0.smithi084.stdout:7/939: dread df/d1d/d1a/d6a/d8b/fcd [0,4194304] 0 2024-02-15T18:27:12.713 INFO:tasks.workunit.client.1.smithi133.stdout:1/795: unlink d6/d1e/d3a/d79/d8e/l107 0 2024-02-15T18:27:12.713 INFO:tasks.workunit.client.1.smithi133.stdout:1/796: chown d6/d89 256804261 1 2024-02-15T18:27:12.713 INFO:tasks.workunit.client.0.smithi084.stdout:8/872: creat db/f125 x:0 0 0 2024-02-15T18:27:12.714 INFO:tasks.workunit.client.0.smithi084.stdout:7/940: mknod df/d1d/d1a/dd1/d111/d12e/c138 0 2024-02-15T18:27:12.714 INFO:tasks.workunit.client.0.smithi084.stdout:1/866: dread d9/d54/d7f/db7/dd9/d81/d94/db9/f107 [0,4194304] 0 2024-02-15T18:27:12.715 INFO:tasks.workunit.client.1.smithi133.stdout:6/822: rename d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/de4/l101 to d0/db/d29/d34/d5d/l115 0 2024-02-15T18:27:12.716 INFO:tasks.workunit.client.1.smithi133.stdout:9/540: dwrite d0/d8/d9/d49/f8e [0,4194304] 0 2024-02-15T18:27:12.716 INFO:tasks.workunit.client.1.smithi133.stdout:1/797: creat d6/d2a/f125 x:0 0 0 2024-02-15T18:27:12.717 INFO:tasks.workunit.client.0.smithi084.stdout:6/848: dwrite d14/d22/d25/d2f/d31/d3f/d4a/fd4 [0,4194304] 0 2024-02-15T18:27:12.717 INFO:tasks.workunit.client.0.smithi084.stdout:6/849: fdatasync d14/d22/d25/d2f/da9/d9b/dac/f113 0 2024-02-15T18:27:12.717 INFO:tasks.workunit.client.0.smithi084.stdout:6/850: fsync d14/d22/d25/d2f/da9/d9b/dac/ffb 0 2024-02-15T18:27:12.717 INFO:tasks.workunit.client.0.smithi084.stdout:8/873: unlink db/f74 0 2024-02-15T18:27:12.717 INFO:tasks.workunit.client.0.smithi084.stdout:8/874: stat c8 0 2024-02-15T18:27:12.717 INFO:tasks.workunit.client.0.smithi084.stdout:8/875: write db/d3f/d59/fe6 [185966,129331] 0 2024-02-15T18:27:12.719 INFO:tasks.workunit.client.0.smithi084.stdout:7/941: getdents df/d1d/d44/dbb 0 2024-02-15T18:27:12.719 INFO:tasks.workunit.client.0.smithi084.stdout:5/986: rmdir d9/da/d3d/d44/d55/d70/dfa 39 2024-02-15T18:27:12.719 INFO:tasks.workunit.client.0.smithi084.stdout:7/942: chown df/d1d/d1a/d6a/d8b/le8 2104 1 2024-02-15T18:27:12.719 INFO:tasks.workunit.client.1.smithi133.stdout:9/541: symlink d0/d8/d9/d12/d82/d42/lb4 0 2024-02-15T18:27:12.723 INFO:tasks.workunit.client.0.smithi084.stdout:1/867: rmdir d9/d54/d1b/d2c/d4b/ddf 39 2024-02-15T18:27:12.725 INFO:tasks.workunit.client.0.smithi084.stdout:8/876: write db/dd/d4d/f7c [6983337,101279] 0 2024-02-15T18:27:12.725 INFO:tasks.workunit.client.1.smithi133.stdout:7/455: sync 2024-02-15T18:27:12.725 INFO:tasks.workunit.client.1.smithi133.stdout:7/456: fdatasync d9/db/d55/f7a 0 2024-02-15T18:27:12.725 INFO:tasks.workunit.client.1.smithi133.stdout:3/669: sync 2024-02-15T18:27:12.730 INFO:tasks.workunit.client.0.smithi084.stdout:9/966: dwrite d4/d2b/d3c/d24/dca/d15/d33/d7b/f11c [0,4194304] 0 2024-02-15T18:27:12.732 INFO:tasks.workunit.client.0.smithi084.stdout:9/967: write d4/d81/f89 [1649702,86416] 0 2024-02-15T18:27:12.732 INFO:tasks.workunit.client.1.smithi133.stdout:1/798: link d6/d2a/d59/d5a/f71 d6/d1e/d3a/d82/d85/f126 0 2024-02-15T18:27:12.733 INFO:tasks.workunit.client.0.smithi084.stdout:6/851: creat d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/d99/f114 x:0 0 0 2024-02-15T18:27:12.734 INFO:tasks.workunit.client.0.smithi084.stdout:6/852: dread - d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/d99/fc8 zero size 2024-02-15T18:27:12.735 INFO:tasks.workunit.client.0.smithi084.stdout:5/987: truncate d9/da/d3d/d44/d55/dfe/fcd 1129722 0 2024-02-15T18:27:12.735 INFO:tasks.workunit.client.1.smithi133.stdout:6/823: dread d0/db/d29/d34/fb7 [0,4194304] 0 2024-02-15T18:27:12.737 INFO:tasks.workunit.client.1.smithi133.stdout:7/457: unlink d9/d36/d3d/d4c/c4e 0 2024-02-15T18:27:12.737 INFO:tasks.workunit.client.1.smithi133.stdout:7/458: chown d9/da 3 1 2024-02-15T18:27:12.737 INFO:tasks.workunit.client.1.smithi133.stdout:3/670: symlink d0/d15/d37/d95/dc2/ld7 0 2024-02-15T18:27:12.738 INFO:tasks.workunit.client.0.smithi084.stdout:1/868: mkdir d9/d54/d7f/d11c 0 2024-02-15T18:27:12.739 INFO:tasks.workunit.client.0.smithi084.stdout:8/877: dread db/dd/d4d/d7e/f85 [0,4194304] 0 2024-02-15T18:27:12.739 INFO:tasks.workunit.client.0.smithi084.stdout:8/878: readlink db/l103 0 2024-02-15T18:27:12.740 INFO:tasks.workunit.client.1.smithi133.stdout:3/671: rename d0/d15/f16 to d0/d15/d2f/d9b/d72/dbf/fd8 0 2024-02-15T18:27:12.741 INFO:tasks.workunit.client.1.smithi133.stdout:3/672: write d0/d15/d2f/dad/fd2 [723707,24863] 0 2024-02-15T18:27:12.743 INFO:tasks.workunit.client.0.smithi084.stdout:2/896: write d3/d5/d53/dca/d7b/d105/f9c [535483,88342] 0 2024-02-15T18:27:12.745 INFO:tasks.workunit.client.0.smithi084.stdout:9/968: getdents d4/d6b 0 2024-02-15T18:27:12.745 INFO:tasks.workunit.client.0.smithi084.stdout:9/969: truncate d4/d2b/d3c/d24/dca/d15/d33/de9/d106/f119 956903 0 2024-02-15T18:27:12.745 INFO:tasks.workunit.client.0.smithi084.stdout:6/853: symlink d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/l115 0 2024-02-15T18:27:12.745 INFO:tasks.workunit.client.0.smithi084.stdout:6/854: truncate d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/fce 809473 0 2024-02-15T18:27:12.745 INFO:tasks.workunit.client.0.smithi084.stdout:1/869: read d9/d54/d32/d5b/d69/fb1 [3459183,85953] 0 2024-02-15T18:27:12.746 INFO:tasks.workunit.client.1.smithi133.stdout:3/673: rmdir d0/d15/d2f/d9b/d39/d3f/dc1/d78 39 2024-02-15T18:27:12.746 INFO:tasks.workunit.client.0.smithi084.stdout:2/897: creat d3/d5/d53/dca/d7b/db0/ddd/f122 x:0 0 0 2024-02-15T18:27:12.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/898: chown d3/d5/d53/dca/d7b/d105/d1e/d4b/da6 1568 1 2024-02-15T18:27:12.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/899: truncate d3/d19/d75/fd5 1024524 0 2024-02-15T18:27:12.747 INFO:tasks.workunit.client.0.smithi084.stdout:2/900: write d3/d9e/f10f [473064,41399] 0 2024-02-15T18:27:12.747 INFO:tasks.workunit.client.0.smithi084.stdout:6/855: getdents d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d94 0 2024-02-15T18:27:12.748 INFO:tasks.workunit.client.0.smithi084.stdout:7/943: dwrite df/d1d/d1a/d6a/d8e/f8a [0,4194304] 0 2024-02-15T18:27:12.750 INFO:tasks.workunit.client.0.smithi084.stdout:1/870: creat d9/d54/d1b/d2c/f11d x:0 0 0 2024-02-15T18:27:12.752 INFO:tasks.workunit.client.1.smithi133.stdout:6/824: dread d0/db/d29/d34/d5d/d40/dde/d67/f86 [0,4194304] 0 2024-02-15T18:27:12.752 INFO:tasks.workunit.client.1.smithi133.stdout:6/825: write d0/db/d29/d34/d5d/d40/f102 [223123,28510] 0 2024-02-15T18:27:12.752 INFO:tasks.workunit.client.1.smithi133.stdout:3/674: mkdir d0/d15/d2f/d9b/d72/dbf/dd9 0 2024-02-15T18:27:12.752 INFO:tasks.workunit.client.1.smithi133.stdout:9/542: dwrite d0/d8/f48 [0,4194304] 0 2024-02-15T18:27:12.752 INFO:tasks.workunit.client.0.smithi084.stdout:6/856: truncate f9 2626477 0 2024-02-15T18:27:12.754 INFO:tasks.workunit.client.0.smithi084.stdout:7/944: dread df/d1d/d1a/d6a/d8b/da5/db6/fe3 [0,4194304] 0 2024-02-15T18:27:12.756 INFO:tasks.workunit.client.0.smithi084.stdout:7/945: dread df/d1d/d1a/fc1 [0,4194304] 0 2024-02-15T18:27:12.757 INFO:tasks.workunit.client.0.smithi084.stdout:5/988: write d9/d5b/d7e/d92/fb0 [1670528,22298] 0 2024-02-15T18:27:12.758 INFO:tasks.workunit.client.1.smithi133.stdout:6/826: rename d0/db/f9f to d0/db/d21/f116 0 2024-02-15T18:27:12.758 INFO:tasks.workunit.client.1.smithi133.stdout:6/827: chown d0/f32 1 1 2024-02-15T18:27:12.758 INFO:tasks.workunit.client.1.smithi133.stdout:3/675: link d0/d15/d2f/f7f d0/d15/d2f/db4/d89/fda 0 2024-02-15T18:27:12.758 INFO:tasks.workunit.client.1.smithi133.stdout:3/676: readlink d0/d15/l46 0 2024-02-15T18:27:12.762 INFO:tasks.workunit.client.0.smithi084.stdout:1/871: unlink d9/d54/d7f/l10c 0 2024-02-15T18:27:12.762 INFO:tasks.workunit.client.0.smithi084.stdout:1/872: stat d9 0 2024-02-15T18:27:12.763 INFO:tasks.workunit.client.1.smithi133.stdout:3/677: write d0/d15/d2f/d9b/d39/d3f/f5f [3679623,121381] 0 2024-02-15T18:27:12.766 INFO:tasks.workunit.client.0.smithi084.stdout:7/946: mkdir df/d1d/d44/dbb/df8/d98/d139 0 2024-02-15T18:27:12.766 INFO:tasks.workunit.client.0.smithi084.stdout:6/857: getdents d14/d22/d25/d2f 0 2024-02-15T18:27:12.768 INFO:tasks.workunit.client.0.smithi084.stdout:5/989: dread d9/d35/d65/d7f/dd6/deb/df0/d118/f11f [0,4194304] 0 2024-02-15T18:27:12.769 INFO:tasks.workunit.client.0.smithi084.stdout:1/873: rename d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db6/ceb to d9/d54/d7f/db7/dd9/d81/ded/dee/c11e 0 2024-02-15T18:27:12.769 INFO:tasks.workunit.client.0.smithi084.stdout:1/874: fsync d9/f27 0 2024-02-15T18:27:12.769 INFO:tasks.workunit.client.0.smithi084.stdout:6/858: creat d14/d22/f116 x:0 0 0 2024-02-15T18:27:12.769 INFO:tasks.workunit.client.0.smithi084.stdout:6/859: fsync d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d94/fc3 0 2024-02-15T18:27:12.769 INFO:tasks.workunit.client.0.smithi084.stdout:6/860: chown d14/d22/d25/d2f/d31/d30/d45/d52/dd5/l105 11877 1 2024-02-15T18:27:12.770 INFO:tasks.workunit.client.1.smithi133.stdout:3/678: dread d0/f8d [0,4194304] 0 2024-02-15T18:27:12.770 INFO:tasks.workunit.client.1.smithi133.stdout:3/679: dread - d0/d15/d2f/f7d zero size 2024-02-15T18:27:12.770 INFO:tasks.workunit.client.1.smithi133.stdout:3/680: dread - d0/d15/d2f/d9b/d39/fc7 zero size 2024-02-15T18:27:12.770 INFO:tasks.workunit.client.0.smithi084.stdout:7/947: symlink df/d1d/d1a/d6a/d8e/d79/l13a 0 2024-02-15T18:27:12.771 INFO:tasks.workunit.client.0.smithi084.stdout:1/875: creat d9/d54/d1b/d2c/d4b/d4c/d79/f11f x:0 0 0 2024-02-15T18:27:12.771 INFO:tasks.workunit.client.0.smithi084.stdout:1/876: stat d9/d54/d1b/d2c/d4b/d4c/d79/fc5 0 2024-02-15T18:27:12.771 INFO:tasks.workunit.client.1.smithi133.stdout:3/681: mkdir d0/d15/d2f/d9b/dc5/ddb 0 2024-02-15T18:27:12.773 INFO:tasks.workunit.client.1.smithi133.stdout:3/682: rename d0/d15/d2f/db4/da3 to d0/d15/d54/ddc 0 2024-02-15T18:27:12.774 INFO:tasks.workunit.client.0.smithi084.stdout:6/861: symlink d14/d22/d25/d28/l117 0 2024-02-15T18:27:12.774 INFO:tasks.workunit.client.0.smithi084.stdout:7/948: link df/d1d/d1a/d4d/d103/l91 df/d1d/l13b 0 2024-02-15T18:27:12.774 INFO:tasks.workunit.client.0.smithi084.stdout:7/949: stat l2 0 2024-02-15T18:27:12.774 INFO:tasks.workunit.client.0.smithi084.stdout:6/862: getdents d14/d22/d25/d2f 0 2024-02-15T18:27:12.775 INFO:tasks.workunit.client.0.smithi084.stdout:7/950: fsync df/d1d/d44/d8d/d10a/f123 0 2024-02-15T18:27:12.775 INFO:tasks.workunit.client.0.smithi084.stdout:6/863: chown d14/l23 13 1 2024-02-15T18:27:12.775 INFO:tasks.workunit.client.0.smithi084.stdout:6/864: write d14/d22/d25/d2f/d31/d30/d45/d54/ffe [1173408,78642] 0 2024-02-15T18:27:12.775 INFO:tasks.workunit.client.0.smithi084.stdout:6/865: chown d14/d22/d25/d2f/d31/deb/fee 2118 1 2024-02-15T18:27:12.781 INFO:tasks.workunit.client.0.smithi084.stdout:5/990: dread d9/fe [0,4194304] 0 2024-02-15T18:27:12.782 INFO:tasks.workunit.client.0.smithi084.stdout:1/877: dread d9/d54/d1b/d2c/d4b/d4c/d79/f2f [0,4194304] 0 2024-02-15T18:27:12.784 INFO:tasks.workunit.client.0.smithi084.stdout:1/878: creat d9/d54/f120 x:0 0 0 2024-02-15T18:27:12.788 INFO:tasks.workunit.client.0.smithi084.stdout:5/991: dread d9/da/d3d/f72 [0,4194304] 0 2024-02-15T18:27:12.788 INFO:tasks.workunit.client.0.smithi084.stdout:5/992: creat d9/da/d3d/d44/d55/daa/f142 x:0 0 0 2024-02-15T18:27:12.789 INFO:tasks.workunit.client.1.smithi133.stdout:7/459: dwrite d9/db/d16/f49 [0,4194304] 0 2024-02-15T18:27:12.791 INFO:tasks.workunit.client.1.smithi133.stdout:1/799: dwrite d6/d2a/f123 [0,4194304] 0 2024-02-15T18:27:12.793 INFO:tasks.workunit.client.1.smithi133.stdout:7/460: creat d9/db/d16/d5d/d68/d73/d9c/f9f x:0 0 0 2024-02-15T18:27:12.793 INFO:tasks.workunit.client.1.smithi133.stdout:7/461: fsync d9/f47 0 2024-02-15T18:27:12.797 INFO:tasks.workunit.client.0.smithi084.stdout:2/901: dwrite d3/d9e/f121 [0,4194304] 0 2024-02-15T18:27:12.797 INFO:tasks.workunit.client.0.smithi084.stdout:2/902: write d3/d5/d53/dca/d89/dec/f11d [396877,13288] 0 2024-02-15T18:27:12.797 INFO:tasks.workunit.client.0.smithi084.stdout:2/903: chown d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3/d117/db9/de8/d11f 15 1 2024-02-15T18:27:12.799 INFO:tasks.workunit.client.0.smithi084.stdout:2/904: truncate d3/d5/d53/dca/d7b/d105/d1e/ff6 258710 0 2024-02-15T18:27:12.799 INFO:tasks.workunit.client.0.smithi084.stdout:2/905: truncate d3/d5/d53/de9/ffc 126520 0 2024-02-15T18:27:12.799 INFO:tasks.workunit.client.0.smithi084.stdout:2/906: fsync d3/d5/d53/fdc 0 2024-02-15T18:27:12.801 INFO:tasks.workunit.client.0.smithi084.stdout:2/907: mknod d3/d5e/c123 0 2024-02-15T18:27:12.801 INFO:tasks.workunit.client.0.smithi084.stdout:2/908: fdatasync d3/d5/d53/dca/d91/fb4 0 2024-02-15T18:27:12.801 INFO:tasks.workunit.client.0.smithi084.stdout:2/909: dread - d3/d5/d53/dca/d7b/db0/ddd/f122 zero size 2024-02-15T18:27:12.801 INFO:tasks.workunit.client.0.smithi084.stdout:2/910: stat d3/d5/dbd/ff0 0 2024-02-15T18:27:12.802 INFO:tasks.workunit.client.1.smithi133.stdout:1/800: write d6/d1e/d41/d7c/d7e/f94 [3235190,117824] 0 2024-02-15T18:27:12.803 INFO:tasks.workunit.client.1.smithi133.stdout:1/801: write d6/d1e/d3a/d75/f84 [889675,111666] 0 2024-02-15T18:27:12.806 INFO:tasks.workunit.client.1.smithi133.stdout:1/802: creat d6/d2a/d59/f127 x:0 0 0 2024-02-15T18:27:12.808 INFO:tasks.workunit.client.0.smithi084.stdout:8/879: dwrite db/dd/d4d/d7e/f85 [0,4194304] 0 2024-02-15T18:27:12.808 INFO:tasks.workunit.client.0.smithi084.stdout:8/880: read - db/dd/d1f/d7a/f81 zero size 2024-02-15T18:27:12.809 INFO:tasks.workunit.client.0.smithi084.stdout:9/970: dwrite d4/d2b/d3c/d24/dca/d15/d33/d7b/f12f [0,4194304] 0 2024-02-15T18:27:12.809 INFO:tasks.workunit.client.0.smithi084.stdout:6/866: dwrite d14/d22/d25/d2f/da9/d9b/dac/ffb [0,4194304] 0 2024-02-15T18:27:12.809 INFO:tasks.workunit.client.1.smithi133.stdout:1/803: symlink d6/d1e/d3a/d97/l128 0 2024-02-15T18:27:12.809 INFO:tasks.workunit.client.1.smithi133.stdout:6/828: dwrite d0/f2d [4194304,4194304] 0 2024-02-15T18:27:12.810 INFO:tasks.workunit.client.0.smithi084.stdout:8/881: creat db/dd/d1f/d7a/da8/f126 x:0 0 0 2024-02-15T18:27:12.812 INFO:tasks.workunit.client.1.smithi133.stdout:6/829: getdents d0/db/df5 0 2024-02-15T18:27:12.819 INFO:tasks.workunit.client.0.smithi084.stdout:9/971: mknod d4/d2b/d3c/d24/dca/d15/c130 0 2024-02-15T18:27:12.819 INFO:tasks.workunit.client.0.smithi084.stdout:9/972: truncate d4/dc2/def/df6/f116 527557 0 2024-02-15T18:27:12.819 INFO:tasks.workunit.client.0.smithi084.stdout:9/973: readlink d4/d2b/d3c/d24/dca/lad 0 2024-02-15T18:27:12.819 INFO:tasks.workunit.client.0.smithi084.stdout:8/882: rename db/d3f/d59/fb3 to db/dd/d13/db9/dea/f127 0 2024-02-15T18:27:12.823 INFO:tasks.workunit.client.1.smithi133.stdout:3/683: dwrite d0/f3a [0,4194304] 0 2024-02-15T18:27:12.825 INFO:tasks.workunit.client.0.smithi084.stdout:9/974: link d4/d3d/cee d4/d2b/daf/c131 0 2024-02-15T18:27:12.829 INFO:tasks.workunit.client.0.smithi084.stdout:1/879: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/f11f [0,4194304] 0 2024-02-15T18:27:12.829 INFO:tasks.workunit.client.0.smithi084.stdout:1/880: stat d9/d54/d1b/d2c/d4b/d4c/d79/f11f 0 2024-02-15T18:27:12.829 INFO:tasks.workunit.client.0.smithi084.stdout:1/881: chown d9/d54/d7f/f112 43586 1 2024-02-15T18:27:12.836 INFO:tasks.workunit.client.0.smithi084.stdout:1/882: unlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/dc6/c115 0 2024-02-15T18:27:12.836 INFO:tasks.workunit.client.0.smithi084.stdout:1/883: dread - d9/d54/f120 zero size 2024-02-15T18:27:12.867 INFO:tasks.workunit.client.1.smithi133.stdout:1/804: dwrite d6/d1e/d3a/d75/f7d [0,4194304] 0 2024-02-15T18:27:12.867 INFO:tasks.workunit.client.1.smithi133.stdout:1/805: chown d6/d17/f3c 10 1 2024-02-15T18:27:12.868 INFO:tasks.workunit.client.1.smithi133.stdout:1/806: rmdir d6/d1e/d41/d7c 39 2024-02-15T18:27:12.874 INFO:tasks.workunit.client.0.smithi084.stdout:5/993: dwrite d9/d35/d65/f56 [0,4194304] 0 2024-02-15T18:27:12.875 INFO:tasks.workunit.client.0.smithi084.stdout:5/994: write d9/da/f38 [651098,78737] 0 2024-02-15T18:27:12.875 INFO:tasks.workunit.client.1.smithi133.stdout:6/830: dwrite d0/db/db6/f109 [0,4194304] 0 2024-02-15T18:27:12.876 INFO:tasks.workunit.client.0.smithi084.stdout:9/975: dwrite d4/d2b/d3c/d24/f2a [4194304,4194304] 0 2024-02-15T18:27:12.876 INFO:tasks.workunit.client.0.smithi084.stdout:9/976: fdatasync d4/d2b/d3c/d24/dca/d15/d5d/f12c 0 2024-02-15T18:27:12.877 INFO:tasks.workunit.client.0.smithi084.stdout:2/911: dwrite d3/d9e/f121 [0,4194304] 0 2024-02-15T18:27:12.878 INFO:tasks.workunit.client.0.smithi084.stdout:2/912: fsync d3/d5/d53/de9/ffc 0 2024-02-15T18:27:12.878 INFO:tasks.workunit.client.1.smithi133.stdout:7/462: dwrite d9/db/d55/f72 [0,4194304] 0 2024-02-15T18:27:12.880 INFO:tasks.workunit.client.0.smithi084.stdout:1/884: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/db2/f104 [0,4194304] 0 2024-02-15T18:27:12.880 INFO:tasks.workunit.client.0.smithi084.stdout:8/883: dwrite db/d1a/d2b/f45 [0,4194304] 0 2024-02-15T18:27:12.880 INFO:tasks.workunit.client.0.smithi084.stdout:8/884: chown db/dd/d4d/f55 12 1 2024-02-15T18:27:12.880 INFO:tasks.workunit.client.1.smithi133.stdout:3/684: dwrite d0/d15/d2f/d9b/d39/d3f/dc1/d78/fcc [0,4194304] 0 2024-02-15T18:27:12.881 INFO:tasks.workunit.client.1.smithi133.stdout:1/807: dread d6/f24 [0,4194304] 0 2024-02-15T18:27:12.881 INFO:tasks.workunit.client.1.smithi133.stdout:1/808: dread - d6/d2a/d59/f127 zero size 2024-02-15T18:27:12.885 INFO:tasks.workunit.client.1.smithi133.stdout:7/463: creat d9/db/d55/fa0 x:0 0 0 2024-02-15T18:27:12.885 INFO:tasks.workunit.client.1.smithi133.stdout:7/464: chown d9/db/d16/f53 30046 1 2024-02-15T18:27:12.888 INFO:tasks.workunit.client.1.smithi133.stdout:7/465: truncate d9/db/dc/f56 1906187 0 2024-02-15T18:27:12.888 INFO:tasks.workunit.client.1.smithi133.stdout:7/466: chown d9/db/f50 167 1 2024-02-15T18:27:12.888 INFO:tasks.workunit.client.1.smithi133.stdout:7/467: dread - d9/db/f8c zero size 2024-02-15T18:27:12.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:10.675370+0000 mgr.smithi084.hjmnez (mgr.14596) 26 : audit [DBG] from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:12.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:10.686920+0000 mgr.smithi084.hjmnez (mgr.14596) 27 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 157 MiB/s rd, 326 MiB/s wr, 475 op/s 2024-02-15T18:27:12.893 INFO:tasks.workunit.client.1.smithi133.stdout:7/468: rename d9/db/d55/d63/f96 to d9/d36/d39/d98/fa1 0 2024-02-15T18:27:12.897 INFO:tasks.workunit.client.0.smithi084.stdout:5/995: mkdir d9/dc6/de2/df1/d131/d143 0 2024-02-15T18:27:12.902 INFO:tasks.workunit.client.0.smithi084.stdout:8/885: rename db/d3f/d59/f48 to db/d1a/d2b/d7b/f128 0 2024-02-15T18:27:12.903 INFO:tasks.workunit.client.0.smithi084.stdout:5/996: mkdir d9/da/d3d/d44/d55/daa/d144 0 2024-02-15T18:27:12.904 INFO:tasks.workunit.client.0.smithi084.stdout:1/885: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d39/l121 0 2024-02-15T18:27:12.904 INFO:tasks.workunit.client.0.smithi084.stdout:1/886: write d9/d54/d7f/db7/dd9/d81/d94/db9/fe4 [599960,2517] 0 2024-02-15T18:27:12.905 INFO:tasks.workunit.client.0.smithi084.stdout:1/887: write d9/d54/f120 [687151,113659] 0 2024-02-15T18:27:12.907 INFO:tasks.workunit.client.0.smithi084.stdout:8/886: write db/d6a/fb4 [199425,58452] 0 2024-02-15T18:27:12.907 INFO:tasks.workunit.client.0.smithi084.stdout:8/887: read - db/dd/d1f/d7a/da8/f126 zero size 2024-02-15T18:27:12.907 INFO:tasks.workunit.client.0.smithi084.stdout:8/888: write db/dd/d4d/fd7 [1046291,68023] 0 2024-02-15T18:27:12.907 INFO:tasks.workunit.client.0.smithi084.stdout:1/888: rename d9/d54/d1b/d38/d4d/lbf to d9/d54/d7f/db7/dd9/d81/d94/db9/l122 0 2024-02-15T18:27:12.909 INFO:tasks.workunit.client.0.smithi084.stdout:8/889: mkdir db/dd/d1f/d9b/d129 0 2024-02-15T18:27:12.910 INFO:tasks.workunit.client.0.smithi084.stdout:1/889: creat d9/d54/d7f/db7/dd9/d81/d94/f123 x:0 0 0 2024-02-15T18:27:12.912 INFO:tasks.workunit.client.0.smithi084.stdout:8/890: creat db/dd/d4d/d7e/f12a x:0 0 0 2024-02-15T18:27:12.913 INFO:tasks.workunit.client.0.smithi084.stdout:1/890: creat d9/d54/d1b/d2c/d4b/d4c/da9/de5/f124 x:0 0 0 2024-02-15T18:27:12.914 INFO:tasks.workunit.client.0.smithi084.stdout:8/891: mkdir db/dd/d1f/d9b/d12b 0 2024-02-15T18:27:12.916 INFO:tasks.workunit.client.0.smithi084.stdout:1/891: symlink d9/d54/d1b/d2c/d4b/d4c/da9/l125 0 2024-02-15T18:27:12.918 INFO:tasks.workunit.client.0.smithi084.stdout:1/892: link d9/d54/d76/f80 d9/d54/d7f/f126 0 2024-02-15T18:27:12.919 INFO:tasks.workunit.client.0.smithi084.stdout:1/893: mknod d9/d54/d1b/d2c/d11a/c127 0 2024-02-15T18:27:12.919 INFO:tasks.workunit.client.0.smithi084.stdout:1/894: creat d9/d54/d7f/db7/dd9/d81/ded/f128 x:0 0 0 2024-02-15T18:27:12.920 INFO:tasks.workunit.client.0.smithi084.stdout:1/895: symlink d9/d54/d76/l129 0 2024-02-15T18:27:12.921 INFO:tasks.workunit.client.0.smithi084.stdout:1/896: symlink d9/l12a 0 2024-02-15T18:27:12.922 INFO:tasks.workunit.client.0.smithi084.stdout:1/897: truncate d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ddc/f101 573013 0 2024-02-15T18:27:12.922 INFO:tasks.workunit.client.0.smithi084.stdout:1/898: chown d9/d54/f6e 211588 1 2024-02-15T18:27:12.926 INFO:tasks.workunit.client.1.smithi133.stdout:6/831: dwrite d0/db/d29/d34/d5d/dc9/fe9 [0,4194304] 0 2024-02-15T18:27:12.933 INFO:tasks.workunit.client.0.smithi084.stdout:2/913: dwrite d3/dc6/db5/fcd [0,4194304] 0 2024-02-15T18:27:12.933 INFO:tasks.workunit.client.0.smithi084.stdout:2/914: write d3/d19/d75/fd5 [1171513,58241] 0 2024-02-15T18:27:12.936 INFO:tasks.workunit.client.1.smithi133.stdout:6/832: dread d0/db/d29/d34/d48/da1/fcf [0,4194304] 0 2024-02-15T18:27:12.936 INFO:tasks.workunit.client.1.smithi133.stdout:6/833: dread - d0/db/d29/d34/d5d/d40/dde/d67/f105 zero size 2024-02-15T18:27:12.938 INFO:tasks.workunit.client.1.smithi133.stdout:6/834: creat d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/f117 x:0 0 0 2024-02-15T18:27:12.940 INFO:tasks.workunit.client.0.smithi084.stdout:2/915: write d3/d5/d53/dca/d7b/d105/d1e/faa [8743202,18386] 0 2024-02-15T18:27:12.941 INFO:tasks.workunit.client.0.smithi084.stdout:5/997: dwrite d9/da/d3d/d44/d55/dfe/f6d [0,4194304] 0 2024-02-15T18:27:12.942 INFO:tasks.workunit.client.0.smithi084.stdout:8/892: dwrite db/daf/db6/fef [0,4194304] 0 2024-02-15T18:27:12.942 INFO:tasks.workunit.client.1.smithi133.stdout:3/685: dwrite d0/d15/d2f/db4/d89/fda [0,4194304] 0 2024-02-15T18:27:12.943 INFO:tasks.workunit.client.0.smithi084.stdout:6/867: dwrite d14/f78 [0,4194304] 0 2024-02-15T18:27:12.943 INFO:tasks.workunit.client.0.smithi084.stdout:2/916: rename d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/l66 to d3/d5/d53/dca/d89/dec/d100/l124 0 2024-02-15T18:27:12.944 INFO:tasks.workunit.client.0.smithi084.stdout:2/917: chown d3/dc6/db5/c101 61 1 2024-02-15T18:27:12.944 INFO:tasks.workunit.client.0.smithi084.stdout:1/899: dwrite d9/d54/d1b/d2c/d4b/d4c/f61 [4194304,4194304] 0 2024-02-15T18:27:12.944 INFO:tasks.workunit.client.0.smithi084.stdout:2/918: chown d3/d5/d53/fb1 223 1 2024-02-15T18:27:12.944 INFO:tasks.workunit.client.1.smithi133.stdout:6/835: dread d0/db/d29/d34/d5d/d40/dde/d53/f65 [0,4194304] 0 2024-02-15T18:27:12.944 INFO:tasks.workunit.client.1.smithi133.stdout:3/686: mknod d0/d15/cdd 0 2024-02-15T18:27:12.944 INFO:tasks.workunit.client.1.smithi133.stdout:6/836: dread d0/db/f18 [0,4194304] 0 2024-02-15T18:27:12.945 INFO:tasks.workunit.client.0.smithi084.stdout:5/998: getdents d9/d5f/d68/d9a/d8d 0 2024-02-15T18:27:12.945 INFO:tasks.workunit.client.1.smithi133.stdout:3/687: symlink d0/d15/d37/d4a/dc4/lde 0 2024-02-15T18:27:12.946 INFO:tasks.workunit.client.1.smithi133.stdout:6/837: creat d0/db/d29/d34/d5d/d40/f118 x:0 0 0 2024-02-15T18:27:12.946 INFO:tasks.workunit.client.1.smithi133.stdout:3/688: truncate d0/fa 3939054 0 2024-02-15T18:27:12.947 INFO:tasks.workunit.client.0.smithi084.stdout:6/868: symlink d14/d22/d25/d28/l118 0 2024-02-15T18:27:12.948 INFO:tasks.workunit.client.1.smithi133.stdout:6/838: mkdir d0/db/d29/d34/d5d/d40/dde/d9d/db3/dd3/d119 0 2024-02-15T18:27:12.948 INFO:tasks.workunit.client.1.smithi133.stdout:6/839: chown d0/d62/d66/c39 7573846 1 2024-02-15T18:27:12.951 INFO:tasks.workunit.client.0.smithi084.stdout:8/893: rename db/dd/d4d/l68 to db/d1a/d109/l12c 0 2024-02-15T18:27:12.951 INFO:tasks.workunit.client.1.smithi133.stdout:6/840: dread d0/db/d29/d34/d5d/d40/dde/d67/f81 [0,4194304] 0 2024-02-15T18:27:12.951 INFO:tasks.workunit.client.0.smithi084.stdout:1/900: mknod d9/d54/d1b/d2c/d4b/c12b 0 2024-02-15T18:27:12.953 INFO:tasks.workunit.client.1.smithi133.stdout:6/841: creat d0/f11a x:0 0 0 2024-02-15T18:27:12.954 INFO:tasks.workunit.client.1.smithi133.stdout:6/842: chown d0/db/d29/d34/d5d/d40/dde/d52 39 1 2024-02-15T18:27:12.960 INFO:tasks.workunit.client.0.smithi084.stdout:5/999: mknod d9/d5b/d7e/db5/d119/c145 0 2024-02-15T18:27:12.968 INFO:tasks.workunit.client.1.smithi133.stdout:4/425: sync 2024-02-15T18:27:12.968 INFO:tasks.workunit.client.1.smithi133.stdout:4/426: write d2/d5/d2b/d21/d2d/d44/d51/f67 [529078,44176] 0 2024-02-15T18:27:12.969 INFO:tasks.workunit.client.1.smithi133.stdout:8/557: sync 2024-02-15T18:27:12.969 INFO:tasks.workunit.client.1.smithi133.stdout:4/427: creat d2/d48/f8e x:0 0 0 2024-02-15T18:27:12.970 INFO:tasks.workunit.client.1.smithi133.stdout:8/558: creat d3/d1f/d3f/d8c/fb8 x:0 0 0 2024-02-15T18:27:12.971 INFO:tasks.workunit.client.0.smithi084.stdout:2/919: rename d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/f50 to d3/d5/d53/dca/d7b/d105/f125 0 2024-02-15T18:27:12.971 INFO:tasks.workunit.client.0.smithi084.stdout:1/901: creat d9/d54/d1b/d2c/d4b/d4c/d79/d92/f12c x:0 0 0 2024-02-15T18:27:12.972 INFO:tasks.workunit.client.0.smithi084.stdout:2/920: symlink d3/d5/d53/dca/l126 0 2024-02-15T18:27:12.973 INFO:tasks.workunit.client.0.smithi084.stdout:2/921: read d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/f68 [2178014,83300] 0 2024-02-15T18:27:12.973 INFO:tasks.workunit.client.0.smithi084.stdout:2/922: dread - d3/d19/d108/de7/f11c zero size 2024-02-15T18:27:12.974 INFO:tasks.workunit.client.0.smithi084.stdout:2/923: chown d3/d5/d53/dca/d7b/d105/f9c 549 1 2024-02-15T18:27:12.974 INFO:tasks.workunit.client.0.smithi084.stdout:1/902: write d9/d54/d1b/d2c/d35/f103 [1552594,109519] 0 2024-02-15T18:27:12.974 INFO:tasks.workunit.client.0.smithi084.stdout:2/924: symlink d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/l127 0 2024-02-15T18:27:12.975 INFO:tasks.workunit.client.0.smithi084.stdout:2/925: creat d3/d19/d108/f128 x:0 0 0 2024-02-15T18:27:12.976 INFO:tasks.workunit.client.0.smithi084.stdout:2/926: fdatasync d3/d5/d53/dca/d7b/d105/d1e/f104 0 2024-02-15T18:27:12.976 INFO:tasks.workunit.client.0.smithi084.stdout:2/927: chown d3/d5/d53/dca/db8 765 1 2024-02-15T18:27:12.977 INFO:tasks.workunit.client.0.smithi084.stdout:2/928: symlink d3/d5/d53/dca/d7b/d105/d1e/l129 0 2024-02-15T18:27:12.977 INFO:tasks.workunit.client.0.smithi084.stdout:2/929: fdatasync d3/ff 0 2024-02-15T18:27:12.977 INFO:tasks.workunit.client.0.smithi084.stdout:2/930: truncate d3/dc6/fc0 4314123 0 2024-02-15T18:27:12.978 INFO:tasks.workunit.client.0.smithi084.stdout:1/903: write d9/f14 [8114169,61072] 0 2024-02-15T18:27:12.978 INFO:tasks.workunit.client.1.smithi133.stdout:3/689: dwrite d0/d15/d2f/d9b/d72/dbf/fd8 [0,4194304] 0 2024-02-15T18:27:12.978 INFO:tasks.workunit.client.0.smithi084.stdout:2/931: mkdir d3/d5/d53/dca/d7b/d105/d1e/d30/d82/d12a 0 2024-02-15T18:27:12.981 INFO:tasks.workunit.client.0.smithi084.stdout:8/894: dwrite db/dd/d13/d42/f80 [0,4194304] 0 2024-02-15T18:27:12.981 INFO:tasks.workunit.client.0.smithi084.stdout:8/895: fsync db/dd/d1f/d66/da2/fac 0 2024-02-15T18:27:12.982 INFO:tasks.workunit.client.0.smithi084.stdout:1/904: link d9/d54/d1b/da7/cd4 d9/d54/d1b/d2c/c12d 0 2024-02-15T18:27:12.982 INFO:tasks.workunit.client.1.smithi133.stdout:3/690: rmdir d0/d15/d2f/d9b/d72 39 2024-02-15T18:27:12.984 INFO:tasks.workunit.client.1.smithi133.stdout:3/691: mknod d0/d15/d2f/d9b/dc5/ddb/cdf 0 2024-02-15T18:27:12.984 INFO:tasks.workunit.client.0.smithi084.stdout:8/896: unlink db/d1a/da5/lbb 0 2024-02-15T18:27:12.984 INFO:tasks.workunit.client.0.smithi084.stdout:8/897: truncate db/dd/d1f/d56/f123 478511 0 2024-02-15T18:27:12.986 INFO:tasks.workunit.client.0.smithi084.stdout:8/898: write db/daf/db6/fdd [685828,70730] 0 2024-02-15T18:27:12.988 INFO:tasks.workunit.client.0.smithi084.stdout:1/905: mkdir d9/d54/d1b/d38/d4d/d12e 0 2024-02-15T18:27:12.988 INFO:tasks.workunit.client.1.smithi133.stdout:3/692: mkdir d0/d15/d2f/d9b/d39/dcd/de0 0 2024-02-15T18:27:12.988 INFO:tasks.workunit.client.1.smithi133.stdout:3/693: dread - d0/d15/d2f/d9b/d62/faf zero size 2024-02-15T18:27:12.989 INFO:tasks.workunit.client.0.smithi084.stdout:8/899: symlink db/d1a/da5/l12d 0 2024-02-15T18:27:12.989 INFO:tasks.workunit.client.1.smithi133.stdout:3/694: read d0/d15/f6d [3195046,5603] 0 2024-02-15T18:27:12.992 INFO:tasks.workunit.client.1.smithi133.stdout:3/695: link d0/d15/d54/c77 d0/d15/d54/da5/ce1 0 2024-02-15T18:27:12.993 INFO:tasks.workunit.client.1.smithi133.stdout:3/696: write d0/d15/d37/d95/f9e [1023657,64235] 0 2024-02-15T18:27:12.996 INFO:tasks.workunit.client.1.smithi133.stdout:8/559: dread d3/f3a [0,4194304] 0 2024-02-15T18:27:12.998 INFO:tasks.workunit.client.0.smithi084.stdout:1/906: dread d9/d54/d7f/db7/dd9/d81/f6c [0,4194304] 0 2024-02-15T18:27:12.999 INFO:tasks.workunit.client.0.smithi084.stdout:1/907: creat d9/d54/d1b/d2c/d4b/d4c/d79/d92/f12f x:0 0 0 2024-02-15T18:27:13.001 INFO:tasks.workunit.client.0.smithi084.stdout:6/869: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/f69 [0,4194304] 0 2024-02-15T18:27:13.001 INFO:tasks.workunit.client.0.smithi084.stdout:6/870: fsync d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/d99/f114 0 2024-02-15T18:27:13.001 INFO:tasks.workunit.client.0.smithi084.stdout:6/871: truncate d14/d22/d25/de8/ffa 102127 0 2024-02-15T18:27:13.001 INFO:tasks.workunit.client.0.smithi084.stdout:6/872: rename d14 to d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/d99/d119 22 2024-02-15T18:27:13.001 INFO:tasks.workunit.client.0.smithi084.stdout:6/873: fdatasync d14/d22/d25/d2f/d31/d30/d45/d52/f53 0 2024-02-15T18:27:13.002 INFO:tasks.workunit.client.1.smithi133.stdout:8/560: unlink d3/d7/d40/l45 0 2024-02-15T18:27:13.002 INFO:tasks.workunit.client.1.smithi133.stdout:6/843: dwrite d0/db/d29/d34/d5d/d40/dde/d52/f104 [0,4194304] 0 2024-02-15T18:27:13.006 INFO:tasks.workunit.client.1.smithi133.stdout:6/844: rename d0/db/d29/d34/d5d/d40/dde/d9d/db3 to d0/d62/d66/d11b 0 2024-02-15T18:27:13.007 INFO:tasks.workunit.client.1.smithi133.stdout:6/845: stat d0/d5/cca 0 2024-02-15T18:27:13.007 INFO:tasks.workunit.client.1.smithi133.stdout:6/846: chown d0/db/d29/d34/d5d/d40/dde/d53/cf0 211114 1 2024-02-15T18:27:13.007 INFO:tasks.workunit.client.1.smithi133.stdout:6/847: fsync d0/d62/ff9 0 2024-02-15T18:27:13.007 INFO:tasks.workunit.client.1.smithi133.stdout:6/848: stat d0/db/d29/d34/d48/lad 0 2024-02-15T18:27:13.008 INFO:tasks.workunit.client.0.smithi084.stdout:2/932: dwrite d3/d19/d75/fd5 [0,4194304] 0 2024-02-15T18:27:13.008 INFO:tasks.workunit.client.0.smithi084.stdout:2/933: truncate d3/d5/d53/dca/d7b/d105/d1e/d30/d8d/fdf 4205733 0 2024-02-15T18:27:13.008 INFO:tasks.workunit.client.1.smithi133.stdout:4/428: dwrite d2/d5/d2b/d21/d2d/d44/f46 [0,4194304] 0 2024-02-15T18:27:13.008 INFO:tasks.workunit.client.1.smithi133.stdout:8/561: write d3/f44 [387620,99725] 0 2024-02-15T18:27:13.008 INFO:tasks.workunit.client.1.smithi133.stdout:8/562: readlink d3/de/d3e/d94/la6 0 2024-02-15T18:27:13.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:10.675370+0000 mgr.smithi084.hjmnez (mgr.14596) 26 : audit [DBG] from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:13.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:10.686920+0000 mgr.smithi084.hjmnez (mgr.14596) 27 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 157 MiB/s rd, 326 MiB/s wr, 475 op/s 2024-02-15T18:27:13.010 INFO:tasks.workunit.client.0.smithi084.stdout:2/934: mknod d3/d9e/c12b 0 2024-02-15T18:27:13.012 INFO:tasks.workunit.client.1.smithi133.stdout:4/429: creat d2/d5/d2b/d21/f8f x:0 0 0 2024-02-15T18:27:13.013 INFO:tasks.workunit.client.0.smithi084.stdout:2/935: truncate d3/d9e/f121 3406190 0 2024-02-15T18:27:13.013 INFO:tasks.workunit.client.0.smithi084.stdout:2/936: readlink d3/dc6/lcb 0 2024-02-15T18:27:13.013 INFO:tasks.workunit.client.1.smithi133.stdout:8/563: creat d3/de/fb9 x:0 0 0 2024-02-15T18:27:13.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/430: link d2/d5/d2b/d21/d3b/d49/f69 d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f90 0 2024-02-15T18:27:13.016 INFO:tasks.workunit.client.0.smithi084.stdout:8/900: dwrite db/f125 [0,4194304] 0 2024-02-15T18:27:13.018 INFO:tasks.workunit.client.1.smithi133.stdout:4/431: creat d2/d5/d2b/d21/d3b/d49/d65/d8d/f91 x:0 0 0 2024-02-15T18:27:13.018 INFO:tasks.workunit.client.1.smithi133.stdout:4/432: write d2/f1f [4787979,22169] 0 2024-02-15T18:27:13.019 INFO:tasks.workunit.client.0.smithi084.stdout:1/908: dread d9/d54/d1b/d2c/d4b/f9e [0,4194304] 0 2024-02-15T18:27:13.026 INFO:tasks.workunit.client.0.smithi084.stdout:6/874: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/f103 [0,4194304] 0 2024-02-15T18:27:13.032 INFO:tasks.workunit.client.0.smithi084.stdout:8/901: creat db/dd/d13/f12e x:0 0 0 2024-02-15T18:27:13.032 INFO:tasks.workunit.client.0.smithi084.stdout:8/902: getdents db/d1a/d2b/d7b/dde 0 2024-02-15T18:27:13.032 INFO:tasks.workunit.client.0.smithi084.stdout:1/909: creat d9/d54/d1b/d2c/d4b/d4c/d79/d92/f130 x:0 0 0 2024-02-15T18:27:13.037 INFO:tasks.workunit.client.0.smithi084.stdout:6/875: getdents d14 0 2024-02-15T18:27:13.037 INFO:tasks.workunit.client.0.smithi084.stdout:8/903: stat db/dd/d1f/ccb 0 2024-02-15T18:27:13.039 INFO:tasks.workunit.client.0.smithi084.stdout:1/910: rename d9/d54/d1b/l22 to d9/d54/d1b/l131 0 2024-02-15T18:27:13.039 INFO:tasks.workunit.client.0.smithi084.stdout:1/911: write d9/d54/d1b/da7/fbe [1005393,46160] 0 2024-02-15T18:27:13.039 INFO:tasks.workunit.client.0.smithi084.stdout:1/912: truncate d9/d54/d1b/f53 774800 0 2024-02-15T18:27:13.040 INFO:tasks.workunit.client.0.smithi084.stdout:6/876: mknod d14/d22/d25/d2f/da9/d9b/dac/c11a 0 2024-02-15T18:27:13.040 INFO:tasks.workunit.client.0.smithi084.stdout:6/877: stat d14/d22/d25/d2f/d31/d3f/fbf 0 2024-02-15T18:27:13.040 INFO:tasks.workunit.client.0.smithi084.stdout:8/904: symlink db/d3f/l12f 0 2024-02-15T18:27:13.040 INFO:tasks.workunit.client.1.smithi133.stdout:4/433: getdents d2/d5/d2b/d21 0 2024-02-15T18:27:13.041 INFO:tasks.workunit.client.0.smithi084.stdout:6/878: rename d14/d22/d25/d2f/d31/d30/d4f/fa3 to d14/d22/d25/d2f/d31/d30/d45/d52/dd3/d10a/f11b 0 2024-02-15T18:27:13.042 INFO:tasks.workunit.client.1.smithi133.stdout:4/434: mkdir d2/d5/d2b/d21/d2d/d4f/d87/d92 0 2024-02-15T18:27:13.042 INFO:tasks.workunit.client.0.smithi084.stdout:1/913: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/d39/d132 0 2024-02-15T18:27:13.043 INFO:tasks.workunit.client.0.smithi084.stdout:8/905: rename db/d3f/l6d to db/d1a/l130 0 2024-02-15T18:27:13.044 INFO:tasks.workunit.client.0.smithi084.stdout:6/879: truncate d14/d22/d25/d2f/d31/d3f/d4a/f98 3520290 0 2024-02-15T18:27:13.045 INFO:tasks.workunit.client.0.smithi084.stdout:1/914: unlink d9/d54/d7f/f126 0 2024-02-15T18:27:13.046 INFO:tasks.workunit.client.0.smithi084.stdout:8/906: mknod db/d1a/da5/c131 0 2024-02-15T18:27:13.046 INFO:tasks.workunit.client.1.smithi133.stdout:4/435: rename d2/d5/d2b/d21/d3b/d49/d65 to d2/d48/d5c/d93 0 2024-02-15T18:27:13.049 INFO:tasks.workunit.client.0.smithi084.stdout:6/880: rename d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/ddc/dea to d14/d22/d25/d28/d11c 0 2024-02-15T18:27:13.051 INFO:tasks.workunit.client.1.smithi133.stdout:8/564: dwrite d3/d7/f95 [0,4194304] 0 2024-02-15T18:27:13.051 INFO:tasks.workunit.client.1.smithi133.stdout:8/565: chown d3/d1f/d3f/d58/f78 3190905 1 2024-02-15T18:27:13.053 INFO:tasks.workunit.client.1.smithi133.stdout:6/849: dwrite d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/fa3 [0,4194304] 0 2024-02-15T18:27:13.056 INFO:tasks.workunit.client.1.smithi133.stdout:6/850: mknod d0/db/d29/d34/d5d/dda/c11c 0 2024-02-15T18:27:13.056 INFO:tasks.workunit.client.0.smithi084.stdout:2/937: dwrite d3/ff [4194304,4194304] 0 2024-02-15T18:27:13.057 INFO:tasks.workunit.client.1.smithi133.stdout:6/851: mkdir d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/d11d 0 2024-02-15T18:27:13.057 INFO:tasks.workunit.client.1.smithi133.stdout:6/852: readlink d0/d62/d66/l93 0 2024-02-15T18:27:13.057 INFO:tasks.workunit.client.1.smithi133.stdout:6/853: fsync d0/db/d29/f84 0 2024-02-15T18:27:13.058 INFO:tasks.workunit.client.1.smithi133.stdout:6/854: fdatasync d0/db/d29/d34/d5d/d40/dde/d52/f87 0 2024-02-15T18:27:13.058 INFO:tasks.workunit.client.0.smithi084.stdout:6/881: link d14/d22/d25/d2f/d31/d3f/fdf d14/d22/d25/d2f/d31/deb/f11d 0 2024-02-15T18:27:13.058 INFO:tasks.workunit.client.0.smithi084.stdout:0/931: sync 2024-02-15T18:27:13.058 INFO:tasks.workunit.client.0.smithi084.stdout:3/817: sync 2024-02-15T18:27:13.058 INFO:tasks.workunit.client.0.smithi084.stdout:7/951: sync 2024-02-15T18:27:13.058 INFO:tasks.workunit.client.0.smithi084.stdout:4/990: sync 2024-02-15T18:27:13.060 INFO:tasks.workunit.client.0.smithi084.stdout:0/932: read d0/d2f/d4b/dc6/fdc [1360816,93363] 0 2024-02-15T18:27:13.060 INFO:tasks.workunit.client.0.smithi084.stdout:2/938: getdents d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3/d117/db9/de8 0 2024-02-15T18:27:13.061 INFO:tasks.workunit.client.0.smithi084.stdout:6/882: write d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/fce [82886,9214] 0 2024-02-15T18:27:13.061 INFO:tasks.workunit.client.0.smithi084.stdout:4/991: truncate d2/d64/d74/d8f/dc1/dec/f112 617040 0 2024-02-15T18:27:13.063 INFO:tasks.workunit.client.0.smithi084.stdout:3/818: mkdir d8/d40/d43/d71/d8c/d94/da3/d115 0 2024-02-15T18:27:13.064 INFO:tasks.workunit.client.0.smithi084.stdout:7/952: creat df/d1d/d1a/d6a/d8b/da5/db6/df5/f13c x:0 0 0 2024-02-15T18:27:13.065 INFO:tasks.workunit.client.0.smithi084.stdout:0/933: mkdir d0/d4/da8/df7/d11f 0 2024-02-15T18:27:13.066 INFO:tasks.workunit.client.0.smithi084.stdout:2/939: creat d3/d19/d75/f12c x:0 0 0 2024-02-15T18:27:13.069 INFO:tasks.workunit.client.0.smithi084.stdout:6/883: rename f3 to d14/d22/d25/d28/f11e 0 2024-02-15T18:27:13.070 INFO:tasks.workunit.client.0.smithi084.stdout:4/992: creat d2/d4/d28/d3d/da4/f122 x:0 0 0 2024-02-15T18:27:13.072 INFO:tasks.workunit.client.0.smithi084.stdout:7/953: symlink df/d1d/d1a/d6a/d8e/d79/ddc/df0/l13d 0 2024-02-15T18:27:13.073 INFO:tasks.workunit.client.0.smithi084.stdout:2/940: creat d3/d19/d75/f12d x:0 0 0 2024-02-15T18:27:13.075 INFO:tasks.workunit.client.0.smithi084.stdout:7/954: creat df/d1d/d1a/d4d/d10c/d131/f13e x:0 0 0 2024-02-15T18:27:13.075 INFO:tasks.workunit.client.0.smithi084.stdout:7/955: write df/d1d/d1a/d4d/f78 [4725014,38875] 0 2024-02-15T18:27:13.075 INFO:tasks.workunit.client.0.smithi084.stdout:7/956: stat df/d1d/d1a/d6a/d8b/da5/db6/df5 0 2024-02-15T18:27:13.075 INFO:tasks.workunit.client.1.smithi133.stdout:6/855: dread d0/db/db6/fcb [0,4194304] 0 2024-02-15T18:27:13.076 INFO:tasks.workunit.client.0.smithi084.stdout:8/907: dwrite db/d1a/d2b/fc5 [0,4194304] 0 2024-02-15T18:27:13.076 INFO:tasks.workunit.client.0.smithi084.stdout:8/908: write db/dd/d4d/d7e/f12a [181174,42914] 0 2024-02-15T18:27:13.076 INFO:tasks.workunit.client.0.smithi084.stdout:7/957: read df/d1d/d1a/d6a/d8e/d79/f11b [1781801,86612] 0 2024-02-15T18:27:13.076 INFO:tasks.workunit.client.0.smithi084.stdout:2/941: truncate d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3/d117/d8e/d96/fa9 2090121 0 2024-02-15T18:27:13.081 INFO:tasks.workunit.client.0.smithi084.stdout:8/909: mknod db/dd/d1f/d7a/c132 0 2024-02-15T18:27:13.083 INFO:tasks.workunit.client.0.smithi084.stdout:1/915: rmdir d9/d54/d1b/d2c/d4b/d4c/d79 39 2024-02-15T18:27:13.084 INFO:tasks.workunit.client.1.smithi133.stdout:4/436: dwrite d2/d5/d2b/f5b [0,4194304] 0 2024-02-15T18:27:13.084 INFO:tasks.workunit.client.1.smithi133.stdout:4/437: fdatasync d2/f2a 0 2024-02-15T18:27:13.086 INFO:tasks.workunit.client.0.smithi084.stdout:0/934: dread d0/d2f/d3f/d4f/d59/f60 [0,4194304] 0 2024-02-15T18:27:13.086 INFO:tasks.workunit.client.0.smithi084.stdout:0/935: dread - d0/d4/d3a/d82/fed zero size 2024-02-15T18:27:13.086 INFO:tasks.workunit.client.0.smithi084.stdout:0/936: dread - d0/d2f/ffb zero size 2024-02-15T18:27:13.086 INFO:tasks.workunit.client.0.smithi084.stdout:0/937: write d0/d2f/d3f/d4c/d9a/f105 [379832,10597] 0 2024-02-15T18:27:13.088 INFO:tasks.workunit.client.1.smithi133.stdout:4/438: mknod d2/d5/d2b/d21/d3b/d49/c94 0 2024-02-15T18:27:13.090 INFO:tasks.workunit.client.0.smithi084.stdout:2/942: getdents d3/d5/d53/dca 0 2024-02-15T18:27:13.091 INFO:tasks.workunit.client.0.smithi084.stdout:9/977: sync 2024-02-15T18:27:13.091 INFO:tasks.workunit.client.0.smithi084.stdout:9/978: truncate d4/f41 197558 0 2024-02-15T18:27:13.092 INFO:tasks.workunit.client.0.smithi084.stdout:0/938: write d0/d25/f34 [181692,36288] 0 2024-02-15T18:27:13.093 INFO:tasks.workunit.client.0.smithi084.stdout:8/910: mkdir db/dd/d13/d42/d79/dfa/d133 0 2024-02-15T18:27:13.093 INFO:tasks.workunit.client.0.smithi084.stdout:9/979: write d4/dc2/fdb [1396570,64144] 0 2024-02-15T18:27:13.095 INFO:tasks.workunit.client.0.smithi084.stdout:1/916: mkdir d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/d133 0 2024-02-15T18:27:13.096 INFO:tasks.workunit.client.0.smithi084.stdout:2/943: rmdir d3/d5/d53/dca/d7b/d105/d1e/d30/d8d 39 2024-02-15T18:27:13.098 INFO:tasks.workunit.client.0.smithi084.stdout:0/939: creat d0/d4/da8/dc5/f120 x:0 0 0 2024-02-15T18:27:13.098 INFO:tasks.workunit.client.0.smithi084.stdout:8/911: creat db/d1a/da5/d10a/f134 x:0 0 0 2024-02-15T18:27:13.100 INFO:tasks.workunit.client.0.smithi084.stdout:1/917: truncate d9/d54/d32/d5b/d69/fa3 3917800 0 2024-02-15T18:27:13.100 INFO:tasks.workunit.client.0.smithi084.stdout:2/944: chown d3/d5/d53/dca/d7b/d105/d1e/c64 42 1 2024-02-15T18:27:13.101 INFO:tasks.workunit.client.0.smithi084.stdout:2/945: chown d3/c48 0 1 2024-02-15T18:27:13.101 INFO:tasks.workunit.client.0.smithi084.stdout:2/946: write d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/f119 [272263,1264] 0 2024-02-15T18:27:13.103 INFO:tasks.workunit.client.0.smithi084.stdout:9/980: rename d4/d2b/d3c/d20/c113 to d4/d2b/d3c/d24/dca/d15/c132 0 2024-02-15T18:27:13.103 INFO:tasks.workunit.client.0.smithi084.stdout:8/912: dread db/f25 [0,4194304] 0 2024-02-15T18:27:13.103 INFO:tasks.workunit.client.0.smithi084.stdout:0/940: mknod d0/d2f/d3f/da4/c121 0 2024-02-15T18:27:13.104 INFO:tasks.workunit.client.0.smithi084.stdout:9/981: link d4/d3d/f80 d4/dc2/def/df6/d117/f133 0 2024-02-15T18:27:13.105 INFO:tasks.workunit.client.0.smithi084.stdout:1/918: read d9/d54/d7f/db7/dd9/df7/d89/f96 [213557,92234] 0 2024-02-15T18:27:13.105 INFO:tasks.workunit.client.0.smithi084.stdout:1/919: truncate d9/d54/d7f/db7/dd9/d81/d94/fde 582023 0 2024-02-15T18:27:13.106 INFO:tasks.workunit.client.0.smithi084.stdout:8/913: write db/dd/d1f/d66/f7f [800260,59042] 0 2024-02-15T18:27:13.108 INFO:tasks.workunit.client.0.smithi084.stdout:8/914: rename db/dd/l71 to db/dd/d1f/d7a/da8/dd0/l135 0 2024-02-15T18:27:13.109 INFO:tasks.workunit.client.0.smithi084.stdout:8/915: write db/d1a/d2b/d7b/fc0 [598804,2022] 0 2024-02-15T18:27:13.110 INFO:tasks.workunit.client.0.smithi084.stdout:0/941: write d0/d4/d3a/d5c/f81 [3664092,84167] 0 2024-02-15T18:27:13.110 INFO:tasks.workunit.client.0.smithi084.stdout:8/916: mkdir db/dd/d4d/d97/d110/d136 0 2024-02-15T18:27:13.112 INFO:tasks.workunit.client.0.smithi084.stdout:8/917: mknod db/dd/c137 0 2024-02-15T18:27:13.112 INFO:tasks.workunit.client.0.smithi084.stdout:8/918: fsync db/dd/d1f/d66/da2/fe5 0 2024-02-15T18:27:13.114 INFO:tasks.workunit.client.0.smithi084.stdout:8/919: link db/dd/d1f/d7a/f81 db/d1a/f138 0 2024-02-15T18:27:13.115 INFO:tasks.workunit.client.0.smithi084.stdout:0/942: dread d0/d4/d3a/d82/dcb/fdd [0,4194304] 0 2024-02-15T18:27:13.116 INFO:tasks.workunit.client.1.smithi133.stdout:6/856: dwrite d0/db/f82 [0,4194304] 0 2024-02-15T18:27:13.116 INFO:tasks.workunit.client.1.smithi133.stdout:6/857: truncate d0/db/d29/d34/d5d/d40/dde/d78/d7f/fa7 4353950 0 2024-02-15T18:27:13.116 INFO:tasks.workunit.client.1.smithi133.stdout:6/858: dread - d0/db/d29/d34/d5d/d40/dde/d67/d9a/fe8 zero size 2024-02-15T18:27:13.116 INFO:tasks.workunit.client.1.smithi133.stdout:6/859: stat d0/fd7 0 2024-02-15T18:27:13.116 INFO:tasks.workunit.client.1.smithi133.stdout:6/860: write d0/db/d29/d34/d5d/d40/dde/d67/d9a/fe8 [144986,8885] 0 2024-02-15T18:27:13.116 INFO:tasks.workunit.client.0.smithi084.stdout:8/920: write db/dd/d1f/d66/da2/fac [332665,60833] 0 2024-02-15T18:27:13.117 INFO:tasks.workunit.client.1.smithi133.stdout:6/861: unlink d0/d62/d66/c39 0 2024-02-15T18:27:13.119 INFO:tasks.workunit.client.0.smithi084.stdout:6/884: dwrite d14/d22/d25/d2f/d31/d30/d4f/d7f/fb5 [0,4194304] 0 2024-02-15T18:27:13.119 INFO:tasks.workunit.client.0.smithi084.stdout:6/885: fsync d14/d22/d25/d2f/d31/d30/d45/d52/dd5/f10f 0 2024-02-15T18:27:13.119 INFO:tasks.workunit.client.0.smithi084.stdout:9/982: dread d4/d2b/f38 [0,4194304] 0 2024-02-15T18:27:13.121 INFO:tasks.workunit.client.0.smithi084.stdout:0/943: getdents d0/d2f/d4b/dc6 0 2024-02-15T18:27:13.122 INFO:tasks.workunit.client.1.smithi133.stdout:6/862: creat d0/db/f11e x:0 0 0 2024-02-15T18:27:13.122 INFO:tasks.workunit.client.1.smithi133.stdout:6/863: write d0/db/f25 [3655275,63703] 0 2024-02-15T18:27:13.123 INFO:tasks.workunit.client.0.smithi084.stdout:4/993: dwrite d2/d4/fd [0,4194304] 0 2024-02-15T18:27:13.123 INFO:tasks.workunit.client.0.smithi084.stdout:0/944: write d0/d25/f2a [1694360,77967] 0 2024-02-15T18:27:13.123 INFO:tasks.workunit.client.0.smithi084.stdout:1/920: dread d9/d54/d7f/db7/dd9/f67 [0,4194304] 0 2024-02-15T18:27:13.128 INFO:tasks.workunit.client.0.smithi084.stdout:1/921: write d9/d54/d32/d5b/d69/fb1 [630741,20248] 0 2024-02-15T18:27:13.134 INFO:tasks.workunit.client.0.smithi084.stdout:6/886: mknod d14/d22/d25/d2f/c11f 0 2024-02-15T18:27:13.135 INFO:tasks.workunit.client.0.smithi084.stdout:9/983: truncate d4/d3d/f94 2264840 0 2024-02-15T18:27:13.135 INFO:tasks.workunit.client.0.smithi084.stdout:9/984: chown d4/d2b/d3c/d20/l103 21686 1 2024-02-15T18:27:13.135 INFO:tasks.workunit.client.0.smithi084.stdout:9/985: stat d4/d6b 0 2024-02-15T18:27:13.137 INFO:tasks.workunit.client.0.smithi084.stdout:0/945: creat d0/d2f/d3f/d4c/de1/d108/f122 x:0 0 0 2024-02-15T18:27:13.137 INFO:tasks.workunit.client.0.smithi084.stdout:0/946: truncate d0/d25/f34 961970 0 2024-02-15T18:27:13.137 INFO:tasks.workunit.client.0.smithi084.stdout:2/947: dwrite d3/d5/d53/dca/d7b/d105/d1e/fce [0,4194304] 0 2024-02-15T18:27:13.140 INFO:tasks.workunit.client.0.smithi084.stdout:1/922: creat d9/d54/d1b/d2c/d4b/d4c/da9/de5/f134 x:0 0 0 2024-02-15T18:27:13.140 INFO:tasks.workunit.client.0.smithi084.stdout:9/986: mkdir d4/da3/dc3/de1/d134 0 2024-02-15T18:27:13.140 INFO:tasks.workunit.client.0.smithi084.stdout:9/987: write d4/d2b/d3c/d20/f52 [4827258,114545] 0 2024-02-15T18:27:13.140 INFO:tasks.workunit.client.0.smithi084.stdout:1/923: write d9/d54/d1b/d2c/d4b/d4c/da9/f111 [408163,113397] 0 2024-02-15T18:27:13.140 INFO:tasks.workunit.client.0.smithi084.stdout:0/947: mkdir d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/d123 0 2024-02-15T18:27:13.141 INFO:tasks.workunit.client.0.smithi084.stdout:2/948: symlink d3/d5/d53/dca/d11b/l12e 0 2024-02-15T18:27:13.141 INFO:tasks.workunit.client.0.smithi084.stdout:2/949: truncate d3/d5/d53/dca/d7b/d105/fd0 99042 0 2024-02-15T18:27:13.143 INFO:tasks.workunit.client.0.smithi084.stdout:1/924: mkdir d9/d54/d1b/d2c/d4b/d4c/d135 0 2024-02-15T18:27:13.143 INFO:tasks.workunit.client.0.smithi084.stdout:9/988: symlink d4/d81/l135 0 2024-02-15T18:27:13.143 INFO:tasks.workunit.client.0.smithi084.stdout:9/989: fdatasync d4/f6 0 2024-02-15T18:27:13.144 INFO:tasks.workunit.client.0.smithi084.stdout:0/948: unlink d0/d2f/f56 0 2024-02-15T18:27:13.144 INFO:tasks.workunit.client.0.smithi084.stdout:0/949: getdents d0/d4/d66/d112 0 2024-02-15T18:27:13.145 INFO:tasks.workunit.client.0.smithi084.stdout:2/950: mknod d3/d5/d53/c12f 0 2024-02-15T18:27:13.148 INFO:tasks.workunit.client.0.smithi084.stdout:0/950: dread d0/d39/d45/fb7 [0,4194304] 0 2024-02-15T18:27:13.148 INFO:tasks.workunit.client.0.smithi084.stdout:0/951: readlink d0/d2f/d4b/dae/lbe 0 2024-02-15T18:27:13.151 INFO:tasks.workunit.client.0.smithi084.stdout:1/925: link d9/d54/d7f/db7/dd9/df7/d89/f98 d9/d54/d1b/d2c/d4b/d4c/d79/d36/f136 0 2024-02-15T18:27:13.153 INFO:tasks.workunit.client.0.smithi084.stdout:0/952: symlink d0/d39/d45/df4/d11d/l124 0 2024-02-15T18:27:13.153 INFO:tasks.workunit.client.0.smithi084.stdout:0/953: write d0/f37 [5102067,78278] 0 2024-02-15T18:27:13.153 INFO:tasks.workunit.client.0.smithi084.stdout:0/954: fdatasync d0/d39/f114 0 2024-02-15T18:27:13.153 INFO:tasks.workunit.client.0.smithi084.stdout:1/926: creat d9/d54/d32/df5/f137 x:0 0 0 2024-02-15T18:27:13.154 INFO:tasks.workunit.client.0.smithi084.stdout:8/921: dwrite db/d1a/d2b/d7b/fbf [0,4194304] 0 2024-02-15T18:27:13.155 INFO:tasks.workunit.client.0.smithi084.stdout:8/922: fdatasync db/f125 0 2024-02-15T18:27:13.156 INFO:tasks.workunit.client.0.smithi084.stdout:1/927: write d9/d54/d7f/db7/dd9/df7/d89/f98 [1375102,14643] 0 2024-02-15T18:27:13.165 INFO:tasks.workunit.client.0.smithi084.stdout:8/923: dread db/daf/db6/fef [0,4194304] 0 2024-02-15T18:27:13.167 INFO:tasks.workunit.client.0.smithi084.stdout:4/994: dwrite d2/d4/f20 [0,4194304] 0 2024-02-15T18:27:13.167 INFO:tasks.workunit.client.1.smithi133.stdout:6/864: dwrite d0/db/d29/d34/d5d/dc9/fe9 [4194304,4194304] 0 2024-02-15T18:27:13.168 INFO:tasks.workunit.client.1.smithi133.stdout:6/865: fdatasync d0/d62/d66/d11b/fa0 0 2024-02-15T18:27:13.168 INFO:tasks.workunit.client.0.smithi084.stdout:9/990: dwrite d4/d3d/f61 [4194304,4194304] 0 2024-02-15T18:27:13.168 INFO:tasks.workunit.client.0.smithi084.stdout:6/887: dwrite d14/d22/d25/d2f/da9/d9b/dac/f113 [0,4194304] 0 2024-02-15T18:27:13.168 INFO:tasks.workunit.client.0.smithi084.stdout:6/888: chown d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/d99/fc2 0 1 2024-02-15T18:27:13.168 INFO:tasks.workunit.client.0.smithi084.stdout:6/889: chown d14/lc4 62096 1 2024-02-15T18:27:13.169 INFO:tasks.workunit.client.1.smithi133.stdout:6/866: mknod d0/db/d29/d34/d8c/da5/c11f 0 2024-02-15T18:27:13.171 INFO:tasks.workunit.client.0.smithi084.stdout:8/924: creat db/dd/d13/d42/d79/dfa/f139 x:0 0 0 2024-02-15T18:27:13.171 INFO:tasks.workunit.client.0.smithi084.stdout:8/925: read - db/dd/d1f/d9b/ff9 zero size 2024-02-15T18:27:13.171 INFO:tasks.workunit.client.0.smithi084.stdout:8/926: dread - db/dd/d4d/f70 zero size 2024-02-15T18:27:13.171 INFO:tasks.workunit.client.0.smithi084.stdout:8/927: chown db/d6a/d76 17934975 1 2024-02-15T18:27:13.174 INFO:tasks.workunit.client.0.smithi084.stdout:4/995: rmdir d2/d4/d28/d3d/d5c/dbc/d88/db0/dc4/d94/d117 0 2024-02-15T18:27:13.174 INFO:tasks.workunit.client.0.smithi084.stdout:4/996: fsync d2/d64/da5/f121 0 2024-02-15T18:27:13.181 INFO:tasks.workunit.client.1.smithi133.stdout:0/692: sync 2024-02-15T18:27:13.181 INFO:tasks.workunit.client.1.smithi133.stdout:2/599: sync 2024-02-15T18:27:13.181 INFO:tasks.workunit.client.1.smithi133.stdout:0/693: write d9/d10/d19/f78 [8738947,15576] 0 2024-02-15T18:27:13.183 INFO:tasks.workunit.client.0.smithi084.stdout:1/928: dread d9/d54/d1b/d2c/d4b/f9e [0,4194304] 0 2024-02-15T18:27:13.184 INFO:tasks.workunit.client.1.smithi133.stdout:2/600: write d7/db/f43 [121496,72683] 0 2024-02-15T18:27:13.184 INFO:tasks.workunit.client.1.smithi133.stdout:0/694: mkdir d9/d10/d19/d29/d67/d68/d96/d44/de8 0 2024-02-15T18:27:13.184 INFO:tasks.workunit.client.1.smithi133.stdout:0/695: dread - d9/d28/fd0 zero size 2024-02-15T18:27:13.188 INFO:tasks.workunit.client.0.smithi084.stdout:6/890: mknod d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/c120 0 2024-02-15T18:27:13.188 INFO:tasks.workunit.client.0.smithi084.stdout:4/997: unlink d2/d64/d74/d8f/dc1/cfc 0 2024-02-15T18:27:13.189 INFO:tasks.workunit.client.0.smithi084.stdout:8/928: rmdir db/dd/d13 39 2024-02-15T18:27:13.189 INFO:tasks.workunit.client.1.smithi133.stdout:0/696: unlink d9/d10/d85/cb0 0 2024-02-15T18:27:13.189 INFO:tasks.workunit.client.1.smithi133.stdout:2/601: mknod d7/d2c/d3b/d48/d59/d74/cbd 0 2024-02-15T18:27:13.198 INFO:tasks.workunit.client.0.smithi084.stdout:4/998: write d2/d64/d74/f7f [3978543,84907] 0 2024-02-15T18:27:13.198 INFO:tasks.workunit.client.0.smithi084.stdout:1/929: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/l138 0 2024-02-15T18:27:13.198 INFO:tasks.workunit.client.0.smithi084.stdout:6/891: rename d14/d22/d25/d2f/d31/d3f/d4a/c67 to d14/d22/d25/d2f/d31/d30/d45/d52/dd3/c121 0 2024-02-15T18:27:13.198 INFO:tasks.workunit.client.0.smithi084.stdout:8/929: unlink db/d1a/da5/c131 0 2024-02-15T18:27:13.199 INFO:tasks.workunit.client.0.smithi084.stdout:4/999: creat d2/d4/d25/f123 x:0 0 0 2024-02-15T18:27:13.202 INFO:tasks.workunit.client.0.smithi084.stdout:8/930: rename db/d1a/d2b/d7b/fc0 to db/daf/db6/f13a 0 2024-02-15T18:27:13.202 INFO:tasks.workunit.client.0.smithi084.stdout:8/931: chown db/f25 18264 1 2024-02-15T18:27:13.202 INFO:tasks.workunit.client.0.smithi084.stdout:6/892: creat d14/d22/d25/d2f/d31/dcf/f122 x:0 0 0 2024-02-15T18:27:13.203 INFO:tasks.workunit.client.0.smithi084.stdout:6/893: write d14/d22/d25/d2f/d31/d30/d4f/d7f/de7/ff9 [63817,96901] 0 2024-02-15T18:27:13.204 INFO:tasks.workunit.client.0.smithi084.stdout:8/932: rename db/dd/d4d/cda to db/d3f/d59/c13b 0 2024-02-15T18:27:13.204 INFO:tasks.workunit.client.0.smithi084.stdout:8/933: chown db/dd/d1f/d7a/da8 5232393 1 2024-02-15T18:27:13.207 INFO:tasks.workunit.client.0.smithi084.stdout:6/894: mknod d14/d22/d25/d2f/d31/d30/d4f/d7f/dc7/df6/c123 0 2024-02-15T18:27:13.207 INFO:tasks.workunit.client.0.smithi084.stdout:8/934: creat db/d1a/da5/d10a/f13c x:0 0 0 2024-02-15T18:27:13.207 INFO:tasks.workunit.client.0.smithi084.stdout:8/935: write db/d3f/d59/f3b [1984904,81823] 0 2024-02-15T18:27:13.208 INFO:tasks.workunit.client.0.smithi084.stdout:8/936: symlink db/d3f/d59/dcd/l13d 0 2024-02-15T18:27:13.210 INFO:tasks.workunit.client.0.smithi084.stdout:6/895: rename l5 to d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/l124 0 2024-02-15T18:27:13.212 INFO:tasks.workunit.client.0.smithi084.stdout:8/937: dread db/dd/d1f/d66/da2/fe5 [0,4194304] 0 2024-02-15T18:27:13.212 INFO:tasks.workunit.client.0.smithi084.stdout:8/938: readlink db/d1a/d5e/l6f 0 2024-02-15T18:27:13.212 INFO:tasks.workunit.client.0.smithi084.stdout:8/939: truncate db/d3f/f11b 315717 0 2024-02-15T18:27:13.212 INFO:tasks.workunit.client.0.smithi084.stdout:6/896: mkdir d14/d22/d25/d2f/d31/d3f/d125 0 2024-02-15T18:27:13.212 INFO:tasks.workunit.client.0.smithi084.stdout:2/951: dwrite d3/d5/d53/dca/d7b/d105/d1e/d30/f115 [0,4194304] 0 2024-02-15T18:27:13.213 INFO:tasks.workunit.client.0.smithi084.stdout:8/940: mknod db/dd/d13/c13e 0 2024-02-15T18:27:13.214 INFO:tasks.workunit.client.0.smithi084.stdout:8/941: rmdir db/d1a/d109 39 2024-02-15T18:27:13.215 INFO:tasks.workunit.client.0.smithi084.stdout:8/942: creat db/dd/d1f/d7a/f13f x:0 0 0 2024-02-15T18:27:13.215 INFO:tasks.workunit.client.0.smithi084.stdout:8/943: chown db/d1a/d5e/l99 181771 1 2024-02-15T18:27:13.217 INFO:tasks.workunit.client.0.smithi084.stdout:8/944: rename db/d1a/f138 to db/d1a/d2b/d7b/dde/f140 0 2024-02-15T18:27:13.217 INFO:tasks.workunit.client.0.smithi084.stdout:8/945: write db/dd/d1f/d7a/da8/f126 [978503,70285] 0 2024-02-15T18:27:13.218 INFO:tasks.workunit.client.0.smithi084.stdout:8/946: link db/d1a/d2b/d7b/ld5 db/dd/d4d/df1/l141 0 2024-02-15T18:27:13.218 INFO:tasks.workunit.client.0.smithi084.stdout:2/952: write d3/d5/f21 [7750116,52788] 0 2024-02-15T18:27:13.219 INFO:tasks.workunit.client.0.smithi084.stdout:8/947: rename db/dd/d4d/d97/d110/d136 to db/dd/d1f/d142 0 2024-02-15T18:27:13.220 INFO:tasks.workunit.client.0.smithi084.stdout:2/953: symlink d3/d5/d53/dca/d7b/d105/d1e/d30/d8d/l130 0 2024-02-15T18:27:13.220 INFO:tasks.workunit.client.0.smithi084.stdout:8/948: mkdir db/d1a/d5e/d143 0 2024-02-15T18:27:13.225 INFO:tasks.workunit.client.0.smithi084.stdout:2/954: creat d3/d9e/f131 x:0 0 0 2024-02-15T18:27:13.226 INFO:tasks.workunit.client.0.smithi084.stdout:2/955: mknod d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/dd3/d117/db9/c132 0 2024-02-15T18:27:13.226 INFO:tasks.workunit.client.0.smithi084.stdout:2/956: mkdir d3/d5/d53/dca/d11b/d133 0 2024-02-15T18:27:13.227 INFO:tasks.workunit.client.0.smithi084.stdout:8/949: write db/dd/d1f/d56/f86 [139276,118002] 0 2024-02-15T18:27:13.228 INFO:tasks.workunit.client.0.smithi084.stdout:8/950: read db/d3f/f11b [257736,82432] 0 2024-02-15T18:27:13.229 INFO:tasks.workunit.client.1.smithi133.stdout:6/867: dwrite d0/db/f25 [0,4194304] 0 2024-02-15T18:27:13.229 INFO:tasks.workunit.client.1.smithi133.stdout:6/868: chown d0/db/d29/d34/d5d/d40/dde/d78/de1 301416910 1 2024-02-15T18:27:13.230 INFO:tasks.workunit.client.1.smithi133.stdout:6/869: mknod d0/db/d29/d34/d5d/d40/dde/d78/de1/c120 0 2024-02-15T18:27:13.230 INFO:tasks.workunit.client.0.smithi084.stdout:8/951: mknod db/dd/d1f/d7a/da8/dd0/c144 0 2024-02-15T18:27:13.231 INFO:tasks.workunit.client.0.smithi084.stdout:8/952: dread db/dd/d1f/d3e/fca [0,4194304] 0 2024-02-15T18:27:13.231 INFO:tasks.workunit.client.0.smithi084.stdout:9/991: dwrite d4/d2b/d3c/d20/d75/fb5 [0,4194304] 0 2024-02-15T18:27:13.232 INFO:tasks.workunit.client.1.smithi133.stdout:6/870: creat d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/d11d/f121 x:0 0 0 2024-02-15T18:27:13.232 INFO:tasks.workunit.client.1.smithi133.stdout:6/871: getdents d0/db/d29/d34/d48/da1/dd1 0 2024-02-15T18:27:13.232 INFO:tasks.workunit.client.1.smithi133.stdout:6/872: dread - d0/db/d29/d34/d5d/d40/dde/db1/ffd zero size 2024-02-15T18:27:13.233 INFO:tasks.workunit.client.0.smithi084.stdout:1/930: dwrite d9/d54/d1b/d38/f4a [0,4194304] 0 2024-02-15T18:27:13.233 INFO:tasks.workunit.client.1.smithi133.stdout:6/873: creat d0/db/d29/d34/d5d/f122 x:0 0 0 2024-02-15T18:27:13.234 INFO:tasks.workunit.client.1.smithi133.stdout:6/874: truncate d0/db/d29/d34/d5d/d40/dde/f99 1299948 0 2024-02-15T18:27:13.234 INFO:tasks.workunit.client.1.smithi133.stdout:6/875: write d0/db/f18 [866136,40753] 0 2024-02-15T18:27:13.234 INFO:tasks.workunit.client.1.smithi133.stdout:6/876: readlink d0/db/d29/d34/l107 0 2024-02-15T18:27:13.237 INFO:tasks.workunit.client.0.smithi084.stdout:9/992: getdents d4/da3/d10d 0 2024-02-15T18:27:13.237 INFO:tasks.workunit.client.0.smithi084.stdout:1/931: truncate d9/d54/d32/d5b/f90 1046758 0 2024-02-15T18:27:13.238 INFO:tasks.workunit.client.0.smithi084.stdout:1/932: readlink d9/d54/d7f/db7/dd9/d81/d94/db9/l122 0 2024-02-15T18:27:13.238 INFO:tasks.workunit.client.0.smithi084.stdout:1/933: getdents d9/d54/d1b/d2c/d4b/d4c/da9 0 2024-02-15T18:27:13.239 INFO:tasks.workunit.client.1.smithi133.stdout:2/602: dwrite d7/d2c/d5a/d66/d70/fba [0,4194304] 0 2024-02-15T18:27:13.242 INFO:tasks.workunit.client.0.smithi084.stdout:0/955: dwrite d0/d2f/d3f/d4c/d9a/f105 [0,4194304] 0 2024-02-15T18:27:13.242 INFO:tasks.workunit.client.0.smithi084.stdout:6/897: dwrite d14/d22/d25/d2f/d31/d30/d45/fa2 [4194304,4194304] 0 2024-02-15T18:27:13.242 INFO:tasks.workunit.client.0.smithi084.stdout:6/898: stat d14/d22/d25/d2f/d31/d30/d45/cb0 0 2024-02-15T18:27:13.246 INFO:tasks.workunit.client.1.smithi133.stdout:2/603: link d7/d18/d32/d65/d54/f83 d7/d18/d32/d65/d99/fbe 0 2024-02-15T18:27:13.246 INFO:tasks.workunit.client.1.smithi133.stdout:0/697: dwrite d9/d10/d19/d1a/f66 [0,4194304] 0 2024-02-15T18:27:13.246 INFO:tasks.workunit.client.1.smithi133.stdout:2/604: dread - d7/d2c/d31/f81 zero size 2024-02-15T18:27:13.246 INFO:tasks.workunit.client.1.smithi133.stdout:2/605: truncate d7/d2c/d5a/d66/d70/fbb 712139 0 2024-02-15T18:27:13.248 INFO:tasks.workunit.client.0.smithi084.stdout:1/934: read d9/d54/d76/f80 [700889,98819] 0 2024-02-15T18:27:13.248 INFO:tasks.workunit.client.0.smithi084.stdout:1/935: dread - d9/d54/d1b/d2c/f11d zero size 2024-02-15T18:27:13.250 INFO:tasks.workunit.client.1.smithi133.stdout:0/698: rename d9/d10/d19/d29/d67/d68/d96/d44/de8 to d9/d2b/de9 0 2024-02-15T18:27:13.254 INFO:tasks.workunit.client.0.smithi084.stdout:8/953: dread db/dd/d13/db9/f113 [0,4194304] 0 2024-02-15T18:27:13.254 INFO:tasks.workunit.client.0.smithi084.stdout:8/954: fdatasync db/dd/d1f/fc4 0 2024-02-15T18:27:13.254 INFO:tasks.workunit.client.0.smithi084.stdout:8/955: fsync db/d3f/d59/d69/f91 0 2024-02-15T18:27:13.254 INFO:tasks.workunit.client.0.smithi084.stdout:8/956: truncate db/d3f/d59/ffd 248665 0 2024-02-15T18:27:13.254 INFO:tasks.workunit.client.0.smithi084.stdout:8/957: chown db/dd/d1f/d3e/lc3 18181 1 2024-02-15T18:27:13.254 INFO:tasks.workunit.client.0.smithi084.stdout:8/958: dread - db/d1a/d2b/d7b/dde/f140 zero size 2024-02-15T18:27:13.263 INFO:tasks.workunit.client.1.smithi133.stdout:0/699: rmdir d9/d10/d19/d29/d67/d68/d9c/da7 39 2024-02-15T18:27:13.263 INFO:tasks.workunit.client.1.smithi133.stdout:2/606: creat d7/d2c/d31/fbf x:0 0 0 2024-02-15T18:27:13.263 INFO:tasks.workunit.client.1.smithi133.stdout:0/700: readlink d9/d10/d85/l9a 0 2024-02-15T18:27:13.263 INFO:tasks.workunit.client.1.smithi133.stdout:0/701: chown d9/d10/d19/d29/d67/d68/d96/d44/fd5 52079248 1 2024-02-15T18:27:13.263 INFO:tasks.workunit.client.1.smithi133.stdout:0/702: chown d9/d10/d47/fa0 1372 1 2024-02-15T18:27:13.263 INFO:tasks.workunit.client.1.smithi133.stdout:2/607: write d7/d2c/d3b/f50 [2922406,23471] 0 2024-02-15T18:27:13.266 INFO:tasks.workunit.client.1.smithi133.stdout:0/703: rename d9/d10/d19/f73 to d9/d10/d19/d8c/fea 0 2024-02-15T18:27:13.266 INFO:tasks.workunit.client.1.smithi133.stdout:0/704: dread - d9/d28/fd0 zero size 2024-02-15T18:27:13.268 INFO:tasks.workunit.client.1.smithi133.stdout:2/608: link d7/d2c/c92 d7/db/d67/d7b/cc0 0 2024-02-15T18:27:13.268 INFO:tasks.workunit.client.1.smithi133.stdout:2/609: fsync d7/f26 0 2024-02-15T18:27:13.268 INFO:tasks.workunit.client.1.smithi133.stdout:2/610: truncate d7/d2c/d46/f6e 1275838 0 2024-02-15T18:27:13.269 INFO:tasks.workunit.client.1.smithi133.stdout:0/705: rename d9/d10/d19/d29/c7d to d9/d10/ceb 0 2024-02-15T18:27:13.270 INFO:tasks.workunit.client.1.smithi133.stdout:0/706: creat d9/d10/d2c/fec x:0 0 0 2024-02-15T18:27:13.271 INFO:tasks.workunit.client.1.smithi133.stdout:0/707: creat d9/d10/d19/d1a/fed x:0 0 0 2024-02-15T18:27:13.281 INFO:tasks.workunit.client.0.smithi084.stdout:1/936: rmdir d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/ddc 39 2024-02-15T18:27:13.281 INFO:tasks.workunit.client.0.smithi084.stdout:6/899: rmdir d14/d22/d25/d2f/d31/dcf/dd8 39 2024-02-15T18:27:13.281 INFO:tasks.workunit.client.0.smithi084.stdout:6/900: fsync d14/d22/d25/d2f/d31/d30/f6b 0 2024-02-15T18:27:13.281 INFO:tasks.workunit.client.0.smithi084.stdout:6/901: stat d14/d22/d25/d2f/d31/d30/d45/d54/ffe 0 2024-02-15T18:27:13.281 INFO:tasks.workunit.client.0.smithi084.stdout:8/959: rename db/dd/d1f/d7a/c96 to db/dd/d4d/df1/c145 0 2024-02-15T18:27:13.282 INFO:tasks.workunit.client.0.smithi084.stdout:6/902: symlink d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/l126 0 2024-02-15T18:27:13.282 INFO:tasks.workunit.client.0.smithi084.stdout:6/903: getdents d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d94 0 2024-02-15T18:27:13.282 INFO:tasks.workunit.client.1.smithi133.stdout:0/708: dread d9/d10/f54 [0,4194304] 0 2024-02-15T18:27:13.283 INFO:tasks.workunit.client.0.smithi084.stdout:6/904: truncate d14/d22/d25/f44 519779 0 2024-02-15T18:27:13.284 INFO:tasks.workunit.client.0.smithi084.stdout:6/905: truncate d14/d22/d25/d2f/d31/d3f/f74 1929704 0 2024-02-15T18:27:13.285 INFO:tasks.workunit.client.1.smithi133.stdout:0/709: mknod d9/d10/d19/d29/d67/d68/d9c/d95/cee 0 2024-02-15T18:27:13.285 INFO:tasks.workunit.client.1.smithi133.stdout:0/710: write d9/d10/d22/fde [563216,61328] 0 2024-02-15T18:27:13.285 INFO:tasks.workunit.client.1.smithi133.stdout:0/711: fsync d9/d10/d2c/fdc 0 2024-02-15T18:27:13.285 INFO:tasks.workunit.client.1.smithi133.stdout:0/712: readlink d9/d10/d22/d2f/l4e 0 2024-02-15T18:27:13.285 INFO:tasks.workunit.client.1.smithi133.stdout:0/713: write d9/f1e [502652,9772] 0 2024-02-15T18:27:13.285 INFO:tasks.workunit.client.1.smithi133.stdout:0/714: dread - d9/d28/fd0 zero size 2024-02-15T18:27:13.286 INFO:tasks.workunit.client.0.smithi084.stdout:6/906: truncate d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/f7d 616999 0 2024-02-15T18:27:13.288 INFO:tasks.workunit.client.0.smithi084.stdout:6/907: link d14/d22/d25/f35 d14/d22/d25/d2f/d31/deb/f127 0 2024-02-15T18:27:13.291 INFO:tasks.workunit.client.0.smithi084.stdout:9/993: dwrite d4/d2b/d3c/d20/f62 [4194304,4194304] 0 2024-02-15T18:27:13.291 INFO:tasks.workunit.client.0.smithi084.stdout:9/994: chown d4/c1e 6939587 1 2024-02-15T18:27:13.291 INFO:tasks.workunit.client.0.smithi084.stdout:9/995: fdatasync d4/d6b/f11d 0 2024-02-15T18:27:13.292 INFO:tasks.workunit.client.0.smithi084.stdout:0/956: dwrite d0/d2f/d3f/da4/fea [0,4194304] 0 2024-02-15T18:27:13.293 INFO:tasks.workunit.client.0.smithi084.stdout:0/957: write d0/d2f/ffb [565784,118598] 0 2024-02-15T18:27:13.293 INFO:tasks.workunit.client.0.smithi084.stdout:0/958: write d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/ff9 [9518947,61464] 0 2024-02-15T18:27:13.293 INFO:tasks.workunit.client.1.smithi133.stdout:0/715: symlink d9/d10/d19/d1a/lef 0 2024-02-15T18:27:13.293 INFO:tasks.workunit.client.1.smithi133.stdout:6/877: dwrite d0/d5/ff6 [0,4194304] 0 2024-02-15T18:27:13.293 INFO:tasks.workunit.client.1.smithi133.stdout:2/611: fdatasync d7/d2c/d3b/f50 0 2024-02-15T18:27:13.294 INFO:tasks.workunit.client.1.smithi133.stdout:2/612: chown d7/db/d67/ca3 89008 1 2024-02-15T18:27:13.297 INFO:tasks.workunit.client.1.smithi133.stdout:0/716: unlink l1 0 2024-02-15T18:27:13.297 INFO:tasks.workunit.client.1.smithi133.stdout:0/717: read - d9/f21 zero size 2024-02-15T18:27:13.299 INFO:tasks.workunit.client.1.smithi133.stdout:6/878: write d0/d5/f3a [3491823,28665] 0 2024-02-15T18:27:13.299 INFO:tasks.workunit.client.1.smithi133.stdout:6/879: fdatasync d0/db/d29/d34/d5d/d40/dde/d52/f87 0 2024-02-15T18:27:13.299 INFO:tasks.workunit.client.0.smithi084.stdout:2/957: dwrite d3/d5/d53/dca/d7b/d105/d1e/d4b/da6/d5c/f119 [0,4194304] 0 2024-02-15T18:27:13.303 INFO:tasks.workunit.client.0.smithi084.stdout:2/958: unlink d3/d5/d53/dca/f2e 0 2024-02-15T18:27:13.304 INFO:tasks.workunit.client.1.smithi133.stdout:6/880: write d0/db/db6/fcb [2388981,100008] 0 2024-02-15T18:27:13.306 INFO:tasks.workunit.client.1.smithi133.stdout:0/718: rename d9/d10/fdd to d9/d10/d19/d8c/ff0 0 2024-02-15T18:27:13.306 INFO:tasks.workunit.client.0.smithi084.stdout:2/959: rename d3/d5/d53/dca/d7b/d105 to d3/d5/d53/dca/d11b/d134 0 2024-02-15T18:27:13.307 INFO:tasks.workunit.client.0.smithi084.stdout:8/960: dread db/d3f/d59/d69/f91 [0,4194304] 0 2024-02-15T18:27:13.308 INFO:tasks.workunit.client.1.smithi133.stdout:6/881: creat d0/d62/f123 x:0 0 0 2024-02-15T18:27:13.308 INFO:tasks.workunit.client.1.smithi133.stdout:2/613: dread d7/d18/d32/d65/f7d [0,4194304] 0 2024-02-15T18:27:13.311 INFO:tasks.workunit.client.1.smithi133.stdout:2/614: mknod d7/db/d67/cc1 0 2024-02-15T18:27:13.311 INFO:tasks.workunit.client.1.smithi133.stdout:6/882: dread d0/db/d29/d34/d5d/d40/f102 [0,4194304] 0 2024-02-15T18:27:13.312 INFO:tasks.workunit.client.0.smithi084.stdout:1/937: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/d92/f12c [0,4194304] 0 2024-02-15T18:27:13.312 INFO:tasks.workunit.client.0.smithi084.stdout:1/938: dread - d9/d54/d1b/d2c/d4b/d4c/da9/f10e zero size 2024-02-15T18:27:13.317 INFO:tasks.workunit.client.0.smithi084.stdout:2/960: dread d3/d5/d53/dca/f32 [0,4194304] 0 2024-02-15T18:27:13.317 INFO:tasks.workunit.client.0.smithi084.stdout:3/819: sync 2024-02-15T18:27:13.317 INFO:tasks.workunit.client.0.smithi084.stdout:7/958: sync 2024-02-15T18:27:13.319 INFO:tasks.workunit.client.1.smithi133.stdout:6/883: creat d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/f124 x:0 0 0 2024-02-15T18:27:13.319 INFO:tasks.workunit.client.1.smithi133.stdout:6/884: read d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/f96 [192590,63018] 0 2024-02-15T18:27:13.319 INFO:tasks.workunit.client.1.smithi133.stdout:6/885: readlink d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/l8f 0 2024-02-15T18:27:13.321 INFO:tasks.workunit.client.1.smithi133.stdout:2/615: mkdir d7/d18/dc2 0 2024-02-15T18:27:13.321 INFO:tasks.workunit.client.0.smithi084.stdout:8/961: rmdir db/dd/d13/d42 39 2024-02-15T18:27:13.321 INFO:tasks.workunit.client.1.smithi133.stdout:6/886: getdents d0/db 0 2024-02-15T18:27:13.324 INFO:tasks.workunit.client.1.smithi133.stdout:6/887: unlink d0/db/d29/d34/c10d 0 2024-02-15T18:27:13.324 INFO:tasks.workunit.client.0.smithi084.stdout:8/962: read db/d1a/d2b/f37 [423303,54919] 0 2024-02-15T18:27:13.325 INFO:tasks.workunit.client.0.smithi084.stdout:7/959: write df/d1d/d44/dbb/df8/ff7 [460845,31022] 0 2024-02-15T18:27:13.326 INFO:tasks.workunit.client.0.smithi084.stdout:8/963: symlink db/d3f/d59/d69/l146 0 2024-02-15T18:27:13.328 INFO:tasks.workunit.client.0.smithi084.stdout:7/960: creat df/d1d/d1a/dd1/d111/f13f x:0 0 0 2024-02-15T18:27:13.330 INFO:tasks.workunit.client.0.smithi084.stdout:2/961: dread d3/d5/d53/dca/d11b/d134/d1e/d4b/da6/d5c/f68 [0,4194304] 0 2024-02-15T18:27:13.331 INFO:tasks.workunit.client.0.smithi084.stdout:8/964: dread db/f25 [0,4194304] 0 2024-02-15T18:27:13.331 INFO:tasks.workunit.client.0.smithi084.stdout:8/965: chown db/dd/d4d/df1/l11e 99926 1 2024-02-15T18:27:13.332 INFO:tasks.workunit.client.1.smithi133.stdout:6/888: rename d0/db/d29/d34/d5d/dda/cfc to d0/db/d29/d34/d5d/d40/dde/d9d/c125 0 2024-02-15T18:27:13.332 INFO:tasks.workunit.client.0.smithi084.stdout:2/962: symlink d3/d5/d53/dca/d11b/d134/d1e/d4b/da6/d5c/dd3/d117/l135 0 2024-02-15T18:27:13.334 INFO:tasks.workunit.client.1.smithi133.stdout:6/889: mkdir d0/db/d29/d34/d5d/d40/dde/d67/d9a/d126 0 2024-02-15T18:27:13.335 INFO:tasks.workunit.client.1.smithi133.stdout:6/890: stat d0/d62/d66/fcd 0 2024-02-15T18:27:13.335 INFO:tasks.workunit.client.0.smithi084.stdout:2/963: unlink d3/d5/d53/dca/d11b/d134/d1e/fce 0 2024-02-15T18:27:13.337 INFO:tasks.workunit.client.0.smithi084.stdout:8/966: dread db/dd/fd9 [0,4194304] 0 2024-02-15T18:27:13.337 INFO:tasks.workunit.client.0.smithi084.stdout:8/967: write db/dd/d13/db9/dea/f127 [44949,126273] 0 2024-02-15T18:27:13.340 INFO:tasks.workunit.client.0.smithi084.stdout:6/908: dwrite d14/d22/dd2/f10e [0,4194304] 0 2024-02-15T18:27:13.341 INFO:tasks.workunit.client.0.smithi084.stdout:8/968: write db/fe [2589461,69958] 0 2024-02-15T18:27:13.342 INFO:tasks.workunit.client.0.smithi084.stdout:8/969: dread db/dd/d1f/d66/da2/fe5 [0,4194304] 0 2024-02-15T18:27:13.343 INFO:tasks.workunit.client.0.smithi084.stdout:8/970: creat db/d3f/d59/dcd/f147 x:0 0 0 2024-02-15T18:27:13.344 INFO:tasks.workunit.client.0.smithi084.stdout:8/971: dread db/dd/d1f/d56/f123 [0,4194304] 0 2024-02-15T18:27:13.347 INFO:tasks.workunit.client.1.smithi133.stdout:6/891: dread d0/db/d21/f116 [0,4194304] 0 2024-02-15T18:27:13.348 INFO:tasks.workunit.client.1.smithi133.stdout:6/892: creat d0/d5/de2/f127 x:0 0 0 2024-02-15T18:27:13.348 INFO:tasks.workunit.client.1.smithi133.stdout:6/893: fsync d0/db/d29/d34/d48/f7b 0 2024-02-15T18:27:13.349 INFO:tasks.workunit.client.1.smithi133.stdout:6/894: rmdir d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/d11d 39 2024-02-15T18:27:13.351 INFO:tasks.workunit.client.1.smithi133.stdout:6/895: truncate d0/db/d29/d34/d5d/d40/dde/d67/f86 3311299 0 2024-02-15T18:27:13.351 INFO:tasks.workunit.client.1.smithi133.stdout:6/896: fdatasync d0/db/db6/f109 0 2024-02-15T18:27:13.351 INFO:tasks.workunit.client.1.smithi133.stdout:6/897: truncate d0/db/d29/d34/d5d/d40/f102 717409 0 2024-02-15T18:27:13.359 INFO:tasks.workunit.client.0.smithi084.stdout:8/972: dread db/f125 [0,4194304] 0 2024-02-15T18:27:13.360 INFO:tasks.workunit.client.1.smithi133.stdout:0/719: dwrite d9/d10/d2c/fc8 [0,4194304] 0 2024-02-15T18:27:13.363 INFO:tasks.workunit.client.0.smithi084.stdout:8/973: read db/d1a/d2b/d7b/fbf [720068,37891] 0 2024-02-15T18:27:13.363 INFO:tasks.workunit.client.0.smithi084.stdout:8/974: fdatasync db/fb2 0 2024-02-15T18:27:13.364 INFO:tasks.workunit.client.0.smithi084.stdout:1/939: dwrite d9/d54/d7f/db7/dd9/d81/d94/db9/f107 [0,4194304] 0 2024-02-15T18:27:13.364 INFO:tasks.workunit.client.0.smithi084.stdout:1/940: truncate d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db6/ff6 421688 0 2024-02-15T18:27:13.364 INFO:tasks.workunit.client.0.smithi084.stdout:1/941: chown d9/d54 3066442 1 2024-02-15T18:27:13.365 INFO:tasks.workunit.client.1.smithi133.stdout:2/616: dwrite d7/d2c/d3b/d48/d6d/f78 [0,4194304] 0 2024-02-15T18:27:13.365 INFO:tasks.workunit.client.1.smithi133.stdout:0/720: symlink d9/d10/d19/lf1 0 2024-02-15T18:27:13.365 INFO:tasks.workunit.client.1.smithi133.stdout:6/898: dread d0/db/d29/d34/d48/da1/fb5 [0,4194304] 0 2024-02-15T18:27:13.365 INFO:tasks.workunit.client.1.smithi133.stdout:0/721: stat d9/d10/d22/d32/f74 0 2024-02-15T18:27:13.365 INFO:tasks.workunit.client.1.smithi133.stdout:0/722: write d9/d10/d22/f9e [588956,53974] 0 2024-02-15T18:27:13.365 INFO:tasks.workunit.client.1.smithi133.stdout:5/512: sync 2024-02-15T18:27:13.366 INFO:tasks.workunit.client.1.smithi133.stdout:1/809: sync 2024-02-15T18:27:13.366 INFO:tasks.workunit.client.0.smithi084.stdout:9/996: dwrite d4/d2b/d67/f8c [0,4194304] 0 2024-02-15T18:27:13.366 INFO:tasks.workunit.client.0.smithi084.stdout:9/997: chown d4/d3d/l12b 43905 1 2024-02-15T18:27:13.367 INFO:tasks.workunit.client.1.smithi133.stdout:2/617: creat d7/d18/d32/d65/d99/fc3 x:0 0 0 2024-02-15T18:27:13.367 INFO:tasks.workunit.client.1.smithi133.stdout:9/543: sync 2024-02-15T18:27:13.369 INFO:tasks.workunit.client.0.smithi084.stdout:1/942: rename d9/d54/d1b/d2c/d4b/f9e to d9/d54/d7f/db7/dd9/d81/ded/dee/f139 0 2024-02-15T18:27:13.369 INFO:tasks.workunit.client.0.smithi084.stdout:1/943: read - d9/d54/fe7 zero size 2024-02-15T18:27:13.370 INFO:tasks.workunit.client.1.smithi133.stdout:6/899: symlink d0/db/d29/d34/d5d/d40/dde/d67/d9a/d126/l128 0 2024-02-15T18:27:13.371 INFO:tasks.workunit.client.0.smithi084.stdout:6/909: dwrite d14/d22/d25/d2f/d31/d30/d4f/d7f/f8b [0,4194304] 0 2024-02-15T18:27:13.371 INFO:tasks.workunit.client.1.smithi133.stdout:0/723: creat d9/d10/dcb/ff2 x:0 0 0 2024-02-15T18:27:13.371 INFO:tasks.workunit.client.1.smithi133.stdout:6/900: dread d0/db/d29/d34/d5d/d40/f7a [0,4194304] 0 2024-02-15T18:27:13.372 INFO:tasks.workunit.client.1.smithi133.stdout:1/810: rename d6/d1e/f86 to d6/d1e/d3a/d79/d8e/f129 0 2024-02-15T18:27:13.372 INFO:tasks.workunit.client.1.smithi133.stdout:1/811: chown d6/d2a/d59/cef 0 1 2024-02-15T18:27:13.373 INFO:tasks.workunit.client.1.smithi133.stdout:2/618: creat d7/d18/d32/d65/fc4 x:0 0 0 2024-02-15T18:27:13.373 INFO:tasks.workunit.client.1.smithi133.stdout:2/619: truncate d7/d18/d32/d65/fa0 495661 0 2024-02-15T18:27:13.374 INFO:tasks.workunit.client.1.smithi133.stdout:2/620: stat d7/d18/d32/d65/f55 0 2024-02-15T18:27:13.374 INFO:tasks.workunit.client.1.smithi133.stdout:9/544: symlink d0/d8/d9/d12/lb5 0 2024-02-15T18:27:13.374 INFO:tasks.workunit.client.1.smithi133.stdout:9/545: fdatasync d0/d8/d9/d12/d82/d42/d79/fb3 0 2024-02-15T18:27:13.376 INFO:tasks.workunit.client.0.smithi084.stdout:8/975: dread db/dd/d13/de0/fe3 [0,4194304] 0 2024-02-15T18:27:13.384 INFO:tasks.workunit.client.0.smithi084.stdout:1/944: creat d9/d54/d1b/d2c/d4b/d4c/da9/f13a x:0 0 0 2024-02-15T18:27:13.385 INFO:tasks.workunit.client.1.smithi133.stdout:6/901: link d0/db/d29/d34/d5d/d40/f102 d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/de4/f129 0 2024-02-15T18:27:13.385 INFO:tasks.workunit.client.1.smithi133.stdout:6/902: chown d0/db/d29/d34/d5d/d40/dde/d53 48716 1 2024-02-15T18:27:13.386 INFO:tasks.workunit.client.0.smithi084.stdout:6/910: mkdir d14/d22/d25/d28/d11c/d128 0 2024-02-15T18:27:13.388 INFO:tasks.workunit.client.0.smithi084.stdout:8/976: link db/dd/d13/d42/d79/ff7 db/dd/d4d/f148 0 2024-02-15T18:27:13.391 INFO:tasks.workunit.client.0.smithi084.stdout:6/911: mkdir d14/d22/d25/d2f/d31/d3f/dec/d129 0 2024-02-15T18:27:13.391 INFO:tasks.workunit.client.0.smithi084.stdout:6/912: write f9 [3663822,130580] 0 2024-02-15T18:27:13.392 INFO:tasks.workunit.client.1.smithi133.stdout:5/513: dwrite d17/f46 [0,4194304] 0 2024-02-15T18:27:13.394 INFO:tasks.workunit.client.0.smithi084.stdout:8/977: rmdir db/dd/d4d/df1 39 2024-02-15T18:27:13.394 INFO:tasks.workunit.client.1.smithi133.stdout:6/903: getdents d0/db/d29/d34 0 2024-02-15T18:27:13.394 INFO:tasks.workunit.client.1.smithi133.stdout:2/621: symlink d7/db/d35/lc5 0 2024-02-15T18:27:13.395 INFO:tasks.workunit.client.0.smithi084.stdout:6/913: creat d14/d22/d25/d2f/da9/d9b/f12a x:0 0 0 2024-02-15T18:27:13.396 INFO:tasks.workunit.client.1.smithi133.stdout:5/514: symlink d17/d20/la8 0 2024-02-15T18:27:13.396 INFO:tasks.workunit.client.1.smithi133.stdout:5/515: readlink d17/d26/l1f 0 2024-02-15T18:27:13.396 INFO:tasks.workunit.client.1.smithi133.stdout:1/812: dread d6/d1e/d3a/d82/fa3 [0,4194304] 0 2024-02-15T18:27:13.397 INFO:tasks.workunit.client.1.smithi133.stdout:2/622: truncate d7/d2c/d5a/d66/d70/fba 2764496 0 2024-02-15T18:27:13.397 INFO:tasks.workunit.client.1.smithi133.stdout:2/623: chown d7/db/d67 3507861 1 2024-02-15T18:27:13.397 INFO:tasks.workunit.client.1.smithi133.stdout:6/904: mkdir d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/d11d/d12a 0 2024-02-15T18:27:13.397 INFO:tasks.workunit.client.1.smithi133.stdout:6/905: fdatasync d0/f27 0 2024-02-15T18:27:13.398 INFO:tasks.workunit.client.1.smithi133.stdout:1/813: unlink d6/d1e/c5b 0 2024-02-15T18:27:13.399 INFO:tasks.workunit.client.1.smithi133.stdout:2/624: rmdir d7/d2c/d3b/d48 39 2024-02-15T18:27:13.400 INFO:tasks.workunit.client.1.smithi133.stdout:6/906: symlink d0/db/d29/d34/d5d/d40/dde/l12b 0 2024-02-15T18:27:13.401 INFO:tasks.workunit.client.1.smithi133.stdout:1/814: truncate d6/d2a/d59/d5a/f9b 3736654 0 2024-02-15T18:27:13.401 INFO:tasks.workunit.client.0.smithi084.stdout:8/978: unlink db/dd/d13/de0/d114/c122 0 2024-02-15T18:27:13.402 INFO:tasks.workunit.client.1.smithi133.stdout:2/625: creat d7/db/d67/da7/fc6 x:0 0 0 2024-02-15T18:27:13.402 INFO:tasks.workunit.client.1.smithi133.stdout:2/626: dread - d7/d2c/d3b/d48/d6d/f8b zero size 2024-02-15T18:27:13.402 INFO:tasks.workunit.client.1.smithi133.stdout:2/627: readlink d7/l17 0 2024-02-15T18:27:13.403 INFO:tasks.workunit.client.0.smithi084.stdout:6/914: symlink d14/d22/d25/d2f/da9/de2/l12b 0 2024-02-15T18:27:13.404 INFO:tasks.workunit.client.1.smithi133.stdout:1/815: mknod d6/d1e/d3a/d9e/c12a 0 2024-02-15T18:27:13.405 INFO:tasks.workunit.client.1.smithi133.stdout:2/628: creat d7/d2c/d3b/d48/fc7 x:0 0 0 2024-02-15T18:27:13.409 INFO:tasks.workunit.client.1.smithi133.stdout:5/516: dread f10 [0,4194304] 0 2024-02-15T18:27:13.412 INFO:tasks.workunit.client.1.smithi133.stdout:5/517: dread d17/f50 [0,4194304] 0 2024-02-15T18:27:13.412 INFO:tasks.workunit.client.1.smithi133.stdout:5/518: chown d17/d26 7119 1 2024-02-15T18:27:13.412 INFO:tasks.workunit.client.1.smithi133.stdout:5/519: chown d17/f46 429 1 2024-02-15T18:27:13.415 INFO:tasks.workunit.client.1.smithi133.stdout:0/724: dwrite d9/d10/d19/f78 [8388608,4194304] 0 2024-02-15T18:27:13.415 INFO:tasks.workunit.client.1.smithi133.stdout:0/725: getdents d9/d2b/de9 0 2024-02-15T18:27:13.417 INFO:tasks.workunit.client.1.smithi133.stdout:1/816: truncate d6/d1e/d3a/d79/dfa/fbf 73496 0 2024-02-15T18:27:13.418 INFO:tasks.workunit.client.1.smithi133.stdout:9/546: dwrite d0/d8/d9/f8c [0,4194304] 0 2024-02-15T18:27:13.418 INFO:tasks.workunit.client.1.smithi133.stdout:5/520: mkdir d17/d20/d32/d9d/da9 0 2024-02-15T18:27:13.423 INFO:tasks.workunit.client.1.smithi133.stdout:0/726: unlink d9/d10/d19/d29/d67/d68/d9c/d95/cee 0 2024-02-15T18:27:13.423 INFO:tasks.workunit.client.1.smithi133.stdout:0/727: chown d9/d2b/dd2/fe7 30859 1 2024-02-15T18:27:13.423 INFO:tasks.workunit.client.1.smithi133.stdout:2/629: dread d7/d2c/f44 [0,4194304] 0 2024-02-15T18:27:13.423 INFO:tasks.workunit.client.1.smithi133.stdout:2/630: truncate d7/d18/d32/d65/d99/fbe 5039699 0 2024-02-15T18:27:13.423 INFO:tasks.workunit.client.1.smithi133.stdout:2/631: write d7/d2c/d3b/d48/d59/f69 [1875057,113502] 0 2024-02-15T18:27:13.425 INFO:tasks.workunit.client.1.smithi133.stdout:9/547: link d0/d8/d9/d12/d82/f7c d0/d8/d9/d12/d82/d42/d44/fb6 0 2024-02-15T18:27:13.425 INFO:tasks.workunit.client.1.smithi133.stdout:9/548: chown d0/d8/d9/d12/d82/lb1 3062554 1 2024-02-15T18:27:13.425 INFO:tasks.workunit.client.1.smithi133.stdout:5/521: truncate d17/d20/d5e/f7f 3277701 0 2024-02-15T18:27:13.427 INFO:tasks.workunit.client.1.smithi133.stdout:0/728: unlink d9/d28/fb6 0 2024-02-15T18:27:13.429 INFO:tasks.workunit.client.1.smithi133.stdout:2/632: rmdir d7/d2c/d31 39 2024-02-15T18:27:13.429 INFO:tasks.workunit.client.1.smithi133.stdout:1/817: dread d6/d1e/d41/f66 [0,4194304] 0 2024-02-15T18:27:13.430 INFO:tasks.workunit.client.1.smithi133.stdout:9/549: mkdir d0/d7b/db7 0 2024-02-15T18:27:13.432 INFO:tasks.workunit.client.1.smithi133.stdout:5/522: getdents d17 0 2024-02-15T18:27:13.433 INFO:tasks.workunit.client.1.smithi133.stdout:0/729: mkdir d9/d10/d2c/df3 0 2024-02-15T18:27:13.433 INFO:tasks.workunit.client.1.smithi133.stdout:0/730: read - d9/d10/dcb/ff2 zero size 2024-02-15T18:27:13.433 INFO:tasks.workunit.client.1.smithi133.stdout:2/633: write d7/d18/f40 [2453698,14239] 0 2024-02-15T18:27:13.434 INFO:tasks.workunit.client.1.smithi133.stdout:9/550: mkdir d0/d8/d9/d12/db8 0 2024-02-15T18:27:13.434 INFO:tasks.workunit.client.1.smithi133.stdout:9/551: stat d0/d8/d9/d12/d82/d42/d44/fb6 0 2024-02-15T18:27:13.434 INFO:tasks.workunit.client.1.smithi133.stdout:5/523: getdents d17/d20/d32/d38/d70 0 2024-02-15T18:27:13.439 INFO:tasks.workunit.client.1.smithi133.stdout:0/731: mkdir d9/d28/df4 0 2024-02-15T18:27:13.440 INFO:tasks.workunit.client.1.smithi133.stdout:2/634: rename d7/d2c/d31/f5f to d7/d2c/d31/fc8 0 2024-02-15T18:27:13.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/552: creat d0/d37/fb9 x:0 0 0 2024-02-15T18:27:13.443 INFO:tasks.workunit.client.1.smithi133.stdout:5/524: creat d17/d20/d32/d9d/da9/faa x:0 0 0 2024-02-15T18:27:13.443 INFO:tasks.workunit.client.1.smithi133.stdout:5/525: read - d17/f7a zero size 2024-02-15T18:27:13.446 INFO:tasks.workunit.client.1.smithi133.stdout:9/553: mkdir d0/d8/d9/d49/d4c/dba 0 2024-02-15T18:27:13.447 INFO:tasks.workunit.client.1.smithi133.stdout:9/554: symlink d0/d8/d9/d12/d82/lbb 0 2024-02-15T18:27:13.448 INFO:tasks.workunit.client.1.smithi133.stdout:5/526: mkdir d17/d20/d32/d38/dab 0 2024-02-15T18:27:13.451 INFO:tasks.workunit.client.1.smithi133.stdout:5/527: mknod d17/d20/d4f/d5f/cac 0 2024-02-15T18:27:13.451 INFO:tasks.workunit.client.1.smithi133.stdout:5/528: write d17/d20/f57 [4385254,72002] 0 2024-02-15T18:27:13.454 INFO:tasks.workunit.client.1.smithi133.stdout:5/529: unlink d17/d20/d32/d7d/l95 0 2024-02-15T18:27:13.469 INFO:tasks.workunit.client.1.smithi133.stdout:5/530: dread d17/d20/d4f/d5f/fa1 [0,4194304] 0 2024-02-15T18:27:13.470 INFO:tasks.workunit.client.1.smithi133.stdout:5/531: creat d17/d20/d4f/d90/fad x:0 0 0 2024-02-15T18:27:13.470 INFO:tasks.workunit.client.1.smithi133.stdout:5/532: write d17/d2a/f2d [4233633,27007] 0 2024-02-15T18:27:13.471 INFO:tasks.workunit.client.1.smithi133.stdout:5/533: truncate d17/d2a/f3b 211914 0 2024-02-15T18:27:13.473 INFO:tasks.workunit.client.1.smithi133.stdout:5/534: unlink le 0 2024-02-15T18:27:13.474 INFO:tasks.workunit.client.1.smithi133.stdout:5/535: unlink d17/d20/d4f/d5f/c79 0 2024-02-15T18:27:13.474 INFO:tasks.workunit.client.1.smithi133.stdout:5/536: fsync d17/f62 0 2024-02-15T18:27:13.485 INFO:tasks.workunit.client.0.smithi084.stdout:8/979: dwrite db/dd/d13/f12e [0,4194304] 0 2024-02-15T18:27:13.485 INFO:tasks.workunit.client.0.smithi084.stdout:8/980: fdatasync db/dd/d1f/d66/da2/fe5 0 2024-02-15T18:27:13.487 INFO:tasks.workunit.client.0.smithi084.stdout:6/915: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/fa6 [0,4194304] 0 2024-02-15T18:27:13.489 INFO:tasks.workunit.client.1.smithi133.stdout:1/818: dwrite d6/d1e/d3a/d79/f93 [0,4194304] 0 2024-02-15T18:27:13.489 INFO:tasks.workunit.client.1.smithi133.stdout:9/555: dwrite d0/d8/d9/d12/d82/d42/f6a [0,4194304] 0 2024-02-15T18:27:13.490 INFO:tasks.workunit.client.1.smithi133.stdout:2/635: dwrite d7/d2c/d5a/f85 [0,4194304] 0 2024-02-15T18:27:13.490 INFO:tasks.workunit.client.1.smithi133.stdout:2/636: chown d7/d2c/d5a/d66/d70/da8 6955376 1 2024-02-15T18:27:13.490 INFO:tasks.workunit.client.1.smithi133.stdout:0/732: dwrite d9/fb [4194304,4194304] 0 2024-02-15T18:27:13.490 INFO:tasks.workunit.client.1.smithi133.stdout:5/537: dread d17/d20/f22 [0,4194304] 0 2024-02-15T18:27:13.503 INFO:tasks.workunit.client.0.smithi084.stdout:8/981: dread db/fb2 [0,4194304] 0 2024-02-15T18:27:13.504 INFO:tasks.workunit.client.0.smithi084.stdout:8/982: link db/dd/d4d/d7e/f85 db/d1a/d2b/d7b/dde/f149 0 2024-02-15T18:27:13.504 INFO:tasks.workunit.client.0.smithi084.stdout:8/983: chown db/dd/d1f/d3e/lc3 2425291 1 2024-02-15T18:27:13.504 INFO:tasks.workunit.client.0.smithi084.stdout:8/984: fsync db/dd/d4d/f63 0 2024-02-15T18:27:13.505 INFO:tasks.workunit.client.0.smithi084.stdout:8/985: creat db/dd/d13/d42/f14a x:0 0 0 2024-02-15T18:27:13.505 INFO:tasks.workunit.client.0.smithi084.stdout:8/986: chown db/dd/d1f/d3e/lc3 140464102 1 2024-02-15T18:27:13.505 INFO:tasks.workunit.client.0.smithi084.stdout:8/987: write db/dd/d13/de0/fe3 [4348721,75199] 0 2024-02-15T18:27:13.506 INFO:tasks.workunit.client.1.smithi133.stdout:1/819: rename d6/d1e/d3a/d79/faf to d6/d1e/d3a/d82/d85/d102/f12b 0 2024-02-15T18:27:13.509 INFO:tasks.workunit.client.1.smithi133.stdout:2/637: mkdir d7/d18/d32/d65/d54/dc9 0 2024-02-15T18:27:13.510 INFO:tasks.workunit.client.0.smithi084.stdout:6/916: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/dd3/f10b [0,4194304] 0 2024-02-15T18:27:13.511 INFO:tasks.workunit.client.0.smithi084.stdout:8/988: unlink db/dd/d13/d42/d90/c10b 0 2024-02-15T18:27:13.513 INFO:tasks.workunit.client.1.smithi133.stdout:5/538: link d17/d20/d32/d9d/l9e d17/lae 0 2024-02-15T18:27:13.514 INFO:tasks.workunit.client.0.smithi084.stdout:6/917: mkdir d14/d22/d25/d12c 0 2024-02-15T18:27:13.514 INFO:tasks.workunit.client.1.smithi133.stdout:1/820: mknod d6/d1e/d3a/d9e/c12c 0 2024-02-15T18:27:13.515 INFO:tasks.workunit.client.0.smithi084.stdout:8/989: mknod db/d1a/d5e/d143/c14b 0 2024-02-15T18:27:13.515 INFO:tasks.workunit.client.0.smithi084.stdout:8/990: read - db/dd/d1f/d7a/f81 zero size 2024-02-15T18:27:13.517 INFO:tasks.workunit.client.1.smithi133.stdout:9/556: rename d0/d8/d9/d12/d82/d42/d44/f84 to d0/d7b/fbc 0 2024-02-15T18:27:13.518 INFO:tasks.workunit.client.1.smithi133.stdout:2/638: link d7/d18/d32/d65/d54/f83 d7/d18/dc2/fca 0 2024-02-15T18:27:13.521 INFO:tasks.workunit.client.0.smithi084.stdout:8/991: creat db/d3f/d59/d69/f14c x:0 0 0 2024-02-15T18:27:13.521 INFO:tasks.workunit.client.1.smithi133.stdout:2/639: creat d7/db/d67/da7/fcb x:0 0 0 2024-02-15T18:27:13.521 INFO:tasks.workunit.client.1.smithi133.stdout:1/821: creat d6/d89/f12d x:0 0 0 2024-02-15T18:27:13.522 INFO:tasks.workunit.client.0.smithi084.stdout:8/992: write db/dd/d1f/d7a/da8/fab [177987,28796] 0 2024-02-15T18:27:13.523 INFO:tasks.workunit.client.0.smithi084.stdout:8/993: creat db/dd/d1f/d7a/da8/f14d x:0 0 0 2024-02-15T18:27:13.523 INFO:tasks.workunit.client.1.smithi133.stdout:9/557: write d0/d8/d9/d12/f21 [3373349,108026] 0 2024-02-15T18:27:13.523 INFO:tasks.workunit.client.1.smithi133.stdout:9/558: chown d0/d8/d9/d12/f1b 1820 1 2024-02-15T18:27:13.524 INFO:tasks.workunit.client.0.smithi084.stdout:0/959: sync 2024-02-15T18:27:13.524 INFO:tasks.workunit.client.0.smithi084.stdout:0/960: dread - d0/d2f/d4b/dae/f11e zero size 2024-02-15T18:27:13.525 INFO:tasks.workunit.client.1.smithi133.stdout:7/469: sync 2024-02-15T18:27:13.526 INFO:tasks.workunit.client.0.smithi084.stdout:0/961: mkdir d0/d4/d3a/d5c/de2/d43/d6d/d125 0 2024-02-15T18:27:13.526 INFO:tasks.workunit.client.1.smithi133.stdout:1/822: link d6/d2a/d59/d5a/f71 d6/d1e/d3a/f12e 0 2024-02-15T18:27:13.526 INFO:tasks.workunit.client.1.smithi133.stdout:1/823: truncate d6/d1e/d3a/d79/dfa/fbf 1029108 0 2024-02-15T18:27:13.527 INFO:tasks.workunit.client.0.smithi084.stdout:0/962: mkdir d0/d25/d126 0 2024-02-15T18:27:13.528 INFO:tasks.workunit.client.1.smithi133.stdout:2/640: rename d7/d2c/cbc to d7/d18/d32/d65/d54/ccc 0 2024-02-15T18:27:13.528 INFO:tasks.workunit.client.1.smithi133.stdout:2/641: fdatasync d7/d2c/d3b/f9a 0 2024-02-15T18:27:13.528 INFO:tasks.workunit.client.0.smithi084.stdout:0/963: mknod d0/d2f/c127 0 2024-02-15T18:27:13.529 INFO:tasks.workunit.client.0.smithi084.stdout:0/964: creat d0/d2f/d3f/d4c/d9a/f128 x:0 0 0 2024-02-15T18:27:13.529 INFO:tasks.workunit.client.0.smithi084.stdout:0/965: readlink d0/d4/d3a/d5c/de2/d43/l80 0 2024-02-15T18:27:13.530 INFO:tasks.workunit.client.1.smithi133.stdout:2/642: write d7/d18/dc2/fca [916703,121470] 0 2024-02-15T18:27:13.530 INFO:tasks.workunit.client.1.smithi133.stdout:9/559: mknod d0/d8/d10/daa/cbd 0 2024-02-15T18:27:13.531 INFO:tasks.workunit.client.0.smithi084.stdout:0/966: truncate d0/d2f/d3f/d4c/de1/ff3 572996 0 2024-02-15T18:27:13.531 INFO:tasks.workunit.client.0.smithi084.stdout:0/967: readlink d0/d2f/l38 0 2024-02-15T18:27:13.531 INFO:tasks.workunit.client.0.smithi084.stdout:0/968: readlink d0/d2f/d4b/dae/lbe 0 2024-02-15T18:27:13.531 INFO:tasks.workunit.client.0.smithi084.stdout:0/969: readlink d0/d2f/d3f/d4c/le3 0 2024-02-15T18:27:13.532 INFO:tasks.workunit.client.1.smithi133.stdout:2/643: symlink d7/d2c/d3b/d48/d59/lcd 0 2024-02-15T18:27:13.532 INFO:tasks.workunit.client.1.smithi133.stdout:2/644: fsync d7/d2c/d3b/f4d 0 2024-02-15T18:27:13.532 INFO:tasks.workunit.client.1.smithi133.stdout:2/645: chown d7/d2c/d3b/d48/c5c 16140 1 2024-02-15T18:27:13.534 INFO:tasks.workunit.client.1.smithi133.stdout:9/560: creat d0/d7b/fbe x:0 0 0 2024-02-15T18:27:13.534 INFO:tasks.workunit.client.1.smithi133.stdout:9/561: dread - d0/d8/d9/d12/d82/d42/d79/fb3 zero size 2024-02-15T18:27:13.534 INFO:tasks.workunit.client.0.smithi084.stdout:0/970: rename d0/d98/fc0 to d0/d4/d3a/d82/dcb/f129 0 2024-02-15T18:27:13.535 INFO:tasks.workunit.client.1.smithi133.stdout:9/562: write d0/d8/f48 [2784989,120911] 0 2024-02-15T18:27:13.537 INFO:tasks.workunit.client.1.smithi133.stdout:9/563: mknod d0/d8/d10/db2/cbf 0 2024-02-15T18:27:13.537 INFO:tasks.workunit.client.1.smithi133.stdout:9/564: chown d0/f5 217 1 2024-02-15T18:27:13.538 INFO:tasks.workunit.client.1.smithi133.stdout:2/646: dread d7/db/d67/d7b/f97 [0,4194304] 0 2024-02-15T18:27:13.547 INFO:tasks.workunit.client.0.smithi084.stdout:0/971: write d0/d4/d3a/d82/dcb/f129 [978606,10515] 0 2024-02-15T18:27:13.549 INFO:tasks.workunit.client.0.smithi084.stdout:0/972: mkdir d0/d2f/d4b/dae/d12a 0 2024-02-15T18:27:13.549 INFO:tasks.workunit.client.0.smithi084.stdout:0/973: fsync d0/d39/fdf 0 2024-02-15T18:27:13.550 INFO:tasks.workunit.client.0.smithi084.stdout:0/974: unlink d0/d4/d3a/d5c/de2/d43/d6d/d71/l9d 0 2024-02-15T18:27:13.550 INFO:tasks.workunit.client.0.smithi084.stdout:0/975: write d0/d2f/d3f/f5a [5861499,104059] 0 2024-02-15T18:27:13.551 INFO:tasks.workunit.client.0.smithi084.stdout:0/976: creat d0/d4/d3a/d10b/f12b x:0 0 0 2024-02-15T18:27:13.555 INFO:tasks.workunit.client.1.smithi133.stdout:0/733: dwrite d9/d10/d19/d1a/f9d [0,4194304] 0 2024-02-15T18:27:13.595 INFO:tasks.workunit.client.1.smithi133.stdout:7/470: dwrite d9/da/d48/d62/d64/f9a [0,4194304] 0 2024-02-15T18:27:13.595 INFO:tasks.workunit.client.0.smithi084.stdout:8/994: dwrite db/dd/d1f/d7a/da8/f14d [0,4194304] 0 2024-02-15T18:27:13.597 INFO:tasks.workunit.client.0.smithi084.stdout:8/995: creat db/dd/d13/d42/f14e x:0 0 0 2024-02-15T18:27:13.610 INFO:tasks.workunit.client.0.smithi084.stdout:8/996: dread db/dd/d13/db9/f124 [0,4194304] 0 2024-02-15T18:27:13.611 INFO:tasks.workunit.client.0.smithi084.stdout:8/997: creat db/dd/d1f/d56/f14f x:0 0 0 2024-02-15T18:27:13.612 INFO:tasks.workunit.client.0.smithi084.stdout:8/998: creat db/d1a/d5e/f150 x:0 0 0 2024-02-15T18:27:13.612 INFO:tasks.workunit.client.0.smithi084.stdout:8/999: fdatasync db/dd/d4d/d7e/f12a 0 2024-02-15T18:27:13.621 INFO:tasks.workunit.client.0.smithi084.stdout:0/977: dwrite d0/d2f/d4b/dae/f11e [0,4194304] 0 2024-02-15T18:27:13.621 INFO:tasks.workunit.client.0.smithi084.stdout:0/978: readlink d0/d39/d90/db1/lda 0 2024-02-15T18:27:13.621 INFO:tasks.workunit.client.0.smithi084.stdout:0/979: stat d0/d4/d66/fa6 0 2024-02-15T18:27:13.621 INFO:tasks.workunit.client.1.smithi133.stdout:2/647: dwrite d7/d2c/d5a/d66/d70/fbb [0,4194304] 0 2024-02-15T18:27:13.622 INFO:tasks.workunit.client.1.smithi133.stdout:0/734: dwrite d9/d2b/f60 [0,4194304] 0 2024-02-15T18:27:13.623 INFO:tasks.workunit.client.1.smithi133.stdout:7/471: dwrite d9/d36/d31/f59 [0,4194304] 0 2024-02-15T18:27:13.623 INFO:tasks.workunit.client.1.smithi133.stdout:7/472: fdatasync d9/d36/f2e 0 2024-02-15T18:27:13.624 INFO:tasks.workunit.client.1.smithi133.stdout:2/648: symlink d7/d2c/d3b/d48/d59/lce 0 2024-02-15T18:27:13.626 INFO:tasks.workunit.client.1.smithi133.stdout:7/473: mkdir d9/db/d16/d5d/d68/da2 0 2024-02-15T18:27:13.627 INFO:tasks.workunit.client.1.smithi133.stdout:2/649: creat d7/d2c/d3b/d48/d59/fcf x:0 0 0 2024-02-15T18:27:13.637 INFO:tasks.workunit.client.0.smithi084.stdout:3/820: sync 2024-02-15T18:27:13.637 INFO:tasks.workunit.client.0.smithi084.stdout:7/961: sync 2024-02-15T18:27:13.637 INFO:tasks.workunit.client.0.smithi084.stdout:2/964: sync 2024-02-15T18:27:13.639 INFO:tasks.workunit.client.1.smithi133.stdout:0/735: dread d9/d2b/f45 [0,4194304] 0 2024-02-15T18:27:13.639 INFO:tasks.workunit.client.1.smithi133.stdout:8/566: sync 2024-02-15T18:27:13.639 INFO:tasks.workunit.client.0.smithi084.stdout:7/962: link df/d1d/d1a/dd1/d111/d12e/c138 df/d1d/d44/d8d/c140 0 2024-02-15T18:27:13.640 INFO:tasks.workunit.client.0.smithi084.stdout:9/998: sync 2024-02-15T18:27:13.640 INFO:tasks.workunit.client.0.smithi084.stdout:1/945: sync 2024-02-15T18:27:13.640 INFO:tasks.workunit.client.0.smithi084.stdout:9/999: fsync d4/d3d/f94 0 2024-02-15T18:27:13.641 INFO:tasks.workunit.client.0.smithi084.stdout:3/821: creat d8/d73/db9/dca/f116 x:0 0 0 2024-02-15T18:27:13.641 INFO:tasks.workunit.client.0.smithi084.stdout:2/965: getdents d3/d5/d53/dca/d11b/d134/d1e/d4b/da6 0 2024-02-15T18:27:13.641 INFO:tasks.workunit.client.0.smithi084.stdout:2/966: dread - d3/dc6/fa7 zero size 2024-02-15T18:27:13.641 INFO:tasks.workunit.client.0.smithi084.stdout:2/967: fsync d3/d5/d53/dca/d91/fe1 0 2024-02-15T18:27:13.642 INFO:tasks.workunit.client.1.smithi133.stdout:0/736: truncate d9/d10/d2c/fc8 1762664 0 2024-02-15T18:27:13.642 INFO:tasks.workunit.client.1.smithi133.stdout:0/737: fdatasync d9/d10/d22/d32/fe5 0 2024-02-15T18:27:13.642 INFO:tasks.workunit.client.1.smithi133.stdout:0/738: creat d9/d28/df4/ff5 x:0 0 0 2024-02-15T18:27:13.642 INFO:tasks.workunit.client.1.smithi133.stdout:7/474: dread d9/db/f1f [0,4194304] 0 2024-02-15T18:27:13.642 INFO:tasks.workunit.client.1.smithi133.stdout:0/739: fsync d9/d10/d22/d2f/f51 0 2024-02-15T18:27:13.643 INFO:tasks.workunit.client.1.smithi133.stdout:0/740: creat d9/ff6 x:0 0 0 2024-02-15T18:27:13.643 INFO:tasks.workunit.client.0.smithi084.stdout:1/946: rename d9/d54/d1b/da7/cf1 to d9/d54/d1b/d38/d4d/d12e/c13b 0 2024-02-15T18:27:13.643 INFO:tasks.workunit.client.0.smithi084.stdout:7/963: write df/f3b [1171129,23998] 0 2024-02-15T18:27:13.643 INFO:tasks.workunit.client.0.smithi084.stdout:3/822: mknod d8/d1f/d25/c117 0 2024-02-15T18:27:13.644 INFO:tasks.workunit.client.0.smithi084.stdout:2/968: mkdir d3/d5/d53/dca/d91/d136 0 2024-02-15T18:27:13.645 INFO:tasks.workunit.client.0.smithi084.stdout:3/823: creat d8/d40/d43/f118 x:0 0 0 2024-02-15T18:27:13.645 INFO:tasks.workunit.client.0.smithi084.stdout:3/824: fdatasync d8/d40/d43/d71/d8c/d94/fbd 0 2024-02-15T18:27:13.646 INFO:tasks.workunit.client.0.smithi084.stdout:1/947: dread d9/d54/d7f/db7/dd9/f67 [0,4194304] 0 2024-02-15T18:27:13.646 INFO:tasks.workunit.client.0.smithi084.stdout:1/948: truncate d9/d54/fd3 619209 0 2024-02-15T18:27:13.646 INFO:tasks.workunit.client.0.smithi084.stdout:1/949: dread - d9/d54/d32/d5b/f118 zero size 2024-02-15T18:27:13.646 INFO:tasks.workunit.client.0.smithi084.stdout:7/964: dread df/d1d/d1a/d6a/fe6 [0,4194304] 0 2024-02-15T18:27:13.646 INFO:tasks.workunit.client.0.smithi084.stdout:7/965: dread - df/d1d/d1a/dd1/d111/f13f zero size 2024-02-15T18:27:13.647 INFO:tasks.workunit.client.0.smithi084.stdout:2/969: rmdir d3/d5/d53/dca/d11b/d133 0 2024-02-15T18:27:13.647 INFO:tasks.workunit.client.0.smithi084.stdout:2/970: read - d3/fde zero size 2024-02-15T18:27:13.647 INFO:tasks.workunit.client.0.smithi084.stdout:2/971: truncate d3/d5/d53/dca/d11b/f9d 696929 0 2024-02-15T18:27:13.647 INFO:tasks.workunit.client.0.smithi084.stdout:3/825: symlink d8/d1f/d2d/dc5/l119 0 2024-02-15T18:27:13.648 INFO:tasks.workunit.client.0.smithi084.stdout:7/966: getdents df/d1d/d1a 0 2024-02-15T18:27:13.648 INFO:tasks.workunit.client.1.smithi133.stdout:7/475: read d9/da/d48/d5a/f7b [1809218,56945] 0 2024-02-15T18:27:13.649 INFO:tasks.workunit.client.0.smithi084.stdout:2/972: mknod d3/d5/d53/dca/d11b/d134/d1e/d4b/da6/d5c/dd3/d117/db9/de8/d11f/c137 0 2024-02-15T18:27:13.649 INFO:tasks.workunit.client.0.smithi084.stdout:2/973: dread - d3/d5/d53/dca/d11b/d134/d1e/d4b/da6/d5c/dd3/d117/f114 zero size 2024-02-15T18:27:13.649 INFO:tasks.workunit.client.0.smithi084.stdout:2/974: truncate d3/d5/d53/dca/d11b/d134/d1e/d30/d8d/fdf 4506194 0 2024-02-15T18:27:13.650 INFO:tasks.workunit.client.1.smithi133.stdout:7/476: creat d9/db/dc/d84/fa3 x:0 0 0 2024-02-15T18:27:13.650 INFO:tasks.workunit.client.1.smithi133.stdout:7/477: chown d9/db/f1f 179698937 1 2024-02-15T18:27:13.651 INFO:tasks.workunit.client.0.smithi084.stdout:7/967: symlink df/d1d/d1a/d6a/d8b/d48/l141 0 2024-02-15T18:27:13.651 INFO:tasks.workunit.client.0.smithi084.stdout:2/975: mknod d3/d5/d53/dca/dc3/c138 0 2024-02-15T18:27:13.653 INFO:tasks.workunit.client.0.smithi084.stdout:2/976: link d3/d5/d53/dca/d11b/d134/d1e/l129 d3/d5/d53/dca/dc3/l139 0 2024-02-15T18:27:13.653 INFO:tasks.workunit.client.0.smithi084.stdout:2/977: chown d3/d5/d53/dca/d11b/d134/d2d 1 1 2024-02-15T18:27:13.654 INFO:tasks.workunit.client.0.smithi084.stdout:2/978: symlink d3/d5/d53/dca/d89/dec/l13a 0 2024-02-15T18:27:13.658 INFO:tasks.workunit.client.1.smithi133.stdout:8/567: dread d3/d1f/d4f/f64 [0,4194304] 0 2024-02-15T18:27:13.662 INFO:tasks.workunit.client.1.smithi133.stdout:7/478: write d9/db/dc/f35 [315505,32858] 0 2024-02-15T18:27:13.663 INFO:tasks.workunit.client.1.smithi133.stdout:2/650: dwrite d7/d18/d32/d65/d54/f6c [0,4194304] 0 2024-02-15T18:27:13.665 INFO:tasks.workunit.client.0.smithi084.stdout:3/826: dread d8/d40/d43/d71/d8c/fb4 [0,4194304] 0 2024-02-15T18:27:13.666 INFO:tasks.workunit.client.0.smithi084.stdout:7/968: dread df/d1d/d44/dbb/df8/ff7 [0,4194304] 0 2024-02-15T18:27:13.668 INFO:tasks.workunit.client.1.smithi133.stdout:2/651: rename d7/d18/dc2/fca to d7/d2c/d5a/d66/d70/da8/fd0 0 2024-02-15T18:27:13.668 INFO:tasks.workunit.client.1.smithi133.stdout:2/652: fsync d7/db/d35/fb1 0 2024-02-15T18:27:13.668 INFO:tasks.workunit.client.0.smithi084.stdout:3/827: rename d8/d40/d43/d71/c7e to d8/d40/d58/d80/c11a 0 2024-02-15T18:27:13.669 INFO:tasks.workunit.client.0.smithi084.stdout:3/828: chown d8/d40/d58/f5e 21 1 2024-02-15T18:27:13.672 INFO:tasks.workunit.client.1.smithi133.stdout:8/568: dread d3/d1c/d37/d5c/f89 [0,4194304] 0 2024-02-15T18:27:13.673 INFO:tasks.workunit.client.0.smithi084.stdout:3/829: read d8/d40/d58/d80/d6b/ffc [6478704,20905] 0 2024-02-15T18:27:13.673 INFO:tasks.workunit.client.0.smithi084.stdout:3/830: chown d8/d73/db9/fd4 94523237 1 2024-02-15T18:27:13.673 INFO:tasks.workunit.client.0.smithi084.stdout:3/831: chown d8/d40/d43/d71/d8c/ld5 12 1 2024-02-15T18:27:13.673 INFO:tasks.workunit.client.0.smithi084.stdout:3/832: write d8/d40/d43/d71/dd9/feb [607784,97390] 0 2024-02-15T18:27:13.675 INFO:tasks.workunit.client.0.smithi084.stdout:3/833: symlink d8/d1f/l11b 0 2024-02-15T18:27:13.675 INFO:tasks.workunit.client.0.smithi084.stdout:3/834: write d8/d40/d43/d71/d8c/fb7 [4295936,76640] 0 2024-02-15T18:27:13.676 INFO:tasks.workunit.client.0.smithi084.stdout:3/835: symlink d8/d40/d43/d71/d8c/d94/l11c 0 2024-02-15T18:27:13.678 INFO:tasks.workunit.client.1.smithi133.stdout:8/569: rmdir d3/d1f/d3f 39 2024-02-15T18:27:13.679 INFO:tasks.workunit.client.0.smithi084.stdout:3/836: getdents d8/d1f/d2d 0 2024-02-15T18:27:13.680 INFO:tasks.workunit.client.1.smithi133.stdout:8/570: symlink d3/d1f/d3f/d8c/lba 0 2024-02-15T18:27:13.681 INFO:tasks.workunit.client.0.smithi084.stdout:3/837: rename d8/d40/d58/d80/dc4/fee to d8/d1f/f11d 0 2024-02-15T18:27:13.683 INFO:tasks.workunit.client.0.smithi084.stdout:3/838: symlink d8/d40/d58/l11e 0 2024-02-15T18:27:13.683 INFO:tasks.workunit.client.0.smithi084.stdout:3/839: write d8/d40/d43/d71/d8c/f103 [1680501,99250] 0 2024-02-15T18:27:13.685 INFO:tasks.workunit.client.1.smithi133.stdout:2/653: dread d7/d18/d32/d65/d99/fbe [0,4194304] 0 2024-02-15T18:27:13.685 INFO:tasks.workunit.client.0.smithi084.stdout:3/840: creat d8/d1f/f11f x:0 0 0 2024-02-15T18:27:13.686 INFO:tasks.workunit.client.0.smithi084.stdout:3/841: mknod d8/d1f/d2d/dc5/c120 0 2024-02-15T18:27:13.688 INFO:tasks.workunit.client.0.smithi084.stdout:3/842: dread d8/d40/d43/d71/fa4 [0,4194304] 0 2024-02-15T18:27:13.688 INFO:tasks.workunit.client.0.smithi084.stdout:3/843: dread - d8/d40/d58/d80/d6b/fd1 zero size 2024-02-15T18:27:13.688 INFO:tasks.workunit.client.1.smithi133.stdout:2/654: creat d7/db/fd1 x:0 0 0 2024-02-15T18:27:13.688 INFO:tasks.workunit.client.1.smithi133.stdout:2/655: chown d7/d2c/d5a/d66/d70 0 1 2024-02-15T18:27:13.689 INFO:tasks.workunit.client.1.smithi133.stdout:2/656: creat d7/d2c/d5a/fd2 x:0 0 0 2024-02-15T18:27:13.689 INFO:tasks.workunit.client.1.smithi133.stdout:2/657: write d7/d2c/d3b/d48/f9f [1059625,11461] 0 2024-02-15T18:27:13.690 INFO:tasks.workunit.client.1.smithi133.stdout:2/658: creat d7/d2c/d3b/d48/d59/fd3 x:0 0 0 2024-02-15T18:27:13.691 INFO:tasks.workunit.client.1.smithi133.stdout:2/659: read d7/d18/d32/d65/d99/fbe [1286683,65942] 0 2024-02-15T18:27:13.691 INFO:tasks.workunit.client.1.smithi133.stdout:2/660: chown d7/d2c/d5a 176935 1 2024-02-15T18:27:13.692 INFO:tasks.workunit.client.1.smithi133.stdout:2/661: symlink d7/d2c/d3b/d48/d59/ld4 0 2024-02-15T18:27:13.692 INFO:tasks.workunit.client.1.smithi133.stdout:2/662: fsync d7/db/d67/d7b/f97 0 2024-02-15T18:27:13.693 INFO:tasks.workunit.client.1.smithi133.stdout:2/663: dread d7/d18/d32/d65/d99/fbe [4194304,4194304] 0 2024-02-15T18:27:13.693 INFO:tasks.workunit.client.1.smithi133.stdout:2/664: write d7/d18/d32/d65/f55 [129476,128539] 0 2024-02-15T18:27:13.693 INFO:tasks.workunit.client.0.smithi084.stdout:3/844: write d8/d40/d43/d71/d8c/fb7 [3338877,76978] 0 2024-02-15T18:27:13.693 INFO:tasks.workunit.client.1.smithi133.stdout:0/741: dwrite d9/d10/d19/d29/d67/d68/fc2 [0,4194304] 0 2024-02-15T18:27:13.695 INFO:tasks.workunit.client.0.smithi084.stdout:1/950: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/d36/f136 [0,4194304] 0 2024-02-15T18:27:13.695 INFO:tasks.workunit.client.0.smithi084.stdout:3/845: mkdir d8/d1f/dbf/db6/d121 0 2024-02-15T18:27:13.696 INFO:tasks.workunit.client.0.smithi084.stdout:3/846: chown d8/d40/d43/l47 537 1 2024-02-15T18:27:13.697 INFO:tasks.workunit.client.0.smithi084.stdout:1/951: creat d9/d54/d7f/db7/dd9/d81/ded/dee/f13c x:0 0 0 2024-02-15T18:27:13.697 INFO:tasks.workunit.client.1.smithi133.stdout:0/742: mkdir d9/d10/d19/d1a/df7 0 2024-02-15T18:27:13.698 INFO:tasks.workunit.client.1.smithi133.stdout:0/743: truncate d9/d10/d22/fde 1201476 0 2024-02-15T18:27:13.699 INFO:tasks.workunit.client.1.smithi133.stdout:8/571: dread d3/d1c/f51 [0,4194304] 0 2024-02-15T18:27:13.699 INFO:tasks.workunit.client.0.smithi084.stdout:3/847: creat d8/d40/d43/d71/f122 x:0 0 0 2024-02-15T18:27:13.699 INFO:tasks.workunit.client.0.smithi084.stdout:1/952: mkdir d9/d54/d7f/db7/dd9/d81/d94/db9/d13d 0 2024-02-15T18:27:13.700 INFO:tasks.workunit.client.0.smithi084.stdout:1/953: read d9/d54/d1b/d38/f83 [51516,39186] 0 2024-02-15T18:27:13.705 INFO:tasks.workunit.client.0.smithi084.stdout:1/954: creat d9/d54/d76/d9f/f13e x:0 0 0 2024-02-15T18:27:13.705 INFO:tasks.workunit.client.0.smithi084.stdout:1/955: truncate d9/fd1 362587 0 2024-02-15T18:27:13.705 INFO:tasks.workunit.client.0.smithi084.stdout:1/956: chown d9/d54/d32/d5b/d10d 25 1 2024-02-15T18:27:13.706 INFO:tasks.workunit.client.0.smithi084.stdout:3/848: symlink d8/d1f/dbf/db6/l123 0 2024-02-15T18:27:13.707 INFO:tasks.workunit.client.0.smithi084.stdout:1/957: symlink d9/d54/d7f/db7/l13f 0 2024-02-15T18:27:13.708 INFO:tasks.workunit.client.1.smithi133.stdout:6/907: sync 2024-02-15T18:27:13.708 INFO:tasks.workunit.client.1.smithi133.stdout:3/697: sync 2024-02-15T18:27:13.708 INFO:tasks.workunit.client.1.smithi133.stdout:4/439: sync 2024-02-15T18:27:13.708 INFO:tasks.workunit.client.1.smithi133.stdout:6/908: mknod d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/de4/c12c 0 2024-02-15T18:27:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:3/849: read d8/d40/d43/d71/d8c/d94/da3/de5/fef [1514364,36068] 0 2024-02-15T18:27:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:3/850: dread - d8/d1f/d25/f68 zero size 2024-02-15T18:27:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:2/979: dwrite d3/d19/f6f [0,4194304] 0 2024-02-15T18:27:13.709 INFO:tasks.workunit.client.0.smithi084.stdout:2/980: stat d3/d19/d75 0 2024-02-15T18:27:13.710 INFO:tasks.workunit.client.1.smithi133.stdout:3/698: mkdir d0/d15/d37/d4a/de2 0 2024-02-15T18:27:13.710 INFO:tasks.workunit.client.1.smithi133.stdout:3/699: chown d0/d15/d2f/db4 11275883 1 2024-02-15T18:27:13.710 INFO:tasks.workunit.client.1.smithi133.stdout:4/440: mkdir d2/d5/d2b/d21/d2d/d44/d51/d95 0 2024-02-15T18:27:13.711 INFO:tasks.workunit.client.1.smithi133.stdout:6/909: truncate d0/f50 504938 0 2024-02-15T18:27:13.713 INFO:tasks.workunit.client.1.smithi133.stdout:3/700: symlink d0/d15/d2f/d9b/d39/d3f/dc1/d78/le3 0 2024-02-15T18:27:13.713 INFO:tasks.workunit.client.1.smithi133.stdout:3/701: fdatasync d0/d15/d37/f53 0 2024-02-15T18:27:13.713 INFO:tasks.workunit.client.1.smithi133.stdout:3/702: readlink d0/d15/l31 0 2024-02-15T18:27:13.713 INFO:tasks.workunit.client.1.smithi133.stdout:3/703: chown d0/d15/d2f/d9b/d39/d3f/dc1/c93 119262874 1 2024-02-15T18:27:13.713 INFO:tasks.workunit.client.1.smithi133.stdout:3/704: fdatasync d0/d15/f3b 0 2024-02-15T18:27:13.713 INFO:tasks.workunit.client.1.smithi133.stdout:3/705: fdatasync d0/d15/d2f/dad/fd2 0 2024-02-15T18:27:13.714 INFO:tasks.workunit.client.0.smithi084.stdout:1/958: dread d9/d54/d1b/d2c/d4b/d4c/da9/f111 [0,4194304] 0 2024-02-15T18:27:13.714 INFO:tasks.workunit.client.1.smithi133.stdout:3/706: getdents d0/d15/d37 0 2024-02-15T18:27:13.715 INFO:tasks.workunit.client.1.smithi133.stdout:3/707: symlink d0/d15/d2f/d5e/db3/le4 0 2024-02-15T18:27:13.717 INFO:tasks.workunit.client.1.smithi133.stdout:6/910: dread d0/f24 [4194304,4194304] 0 2024-02-15T18:27:13.718 INFO:tasks.workunit.client.1.smithi133.stdout:6/911: creat d0/dfb/f12d x:0 0 0 2024-02-15T18:27:13.719 INFO:tasks.workunit.client.1.smithi133.stdout:6/912: dread d0/fef [0,4194304] 0 2024-02-15T18:27:13.719 INFO:tasks.workunit.client.1.smithi133.stdout:6/913: stat d0/db/d29/d34/d5d/d40/dde/db1/cd9 0 2024-02-15T18:27:13.720 INFO:tasks.workunit.client.0.smithi084.stdout:3/851: mkdir d8/d1f/dbf/db6/d10c/d124 0 2024-02-15T18:27:13.721 INFO:tasks.workunit.client.0.smithi084.stdout:1/959: link d9/d54/d7f/f112 d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/d133/f140 0 2024-02-15T18:27:13.721 INFO:tasks.workunit.client.1.smithi133.stdout:6/914: mknod d0/d5/c12e 0 2024-02-15T18:27:13.723 INFO:tasks.workunit.client.1.smithi133.stdout:6/915: mknod d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/de4/c12f 0 2024-02-15T18:27:13.724 INFO:tasks.workunit.client.1.smithi133.stdout:6/916: creat d0/f130 x:0 0 0 2024-02-15T18:27:13.726 INFO:tasks.workunit.client.1.smithi133.stdout:4/441: write d2/d5/d2b/f5b [2728692,97832] 0 2024-02-15T18:27:13.727 INFO:tasks.workunit.client.1.smithi133.stdout:6/917: rename d0/db/fc5 to d0/db/d29/d34/d5d/d40/dde/f131 0 2024-02-15T18:27:13.728 INFO:tasks.workunit.client.1.smithi133.stdout:7/479: dwrite d9/db/f1f [0,4194304] 0 2024-02-15T18:27:13.729 INFO:tasks.workunit.client.1.smithi133.stdout:3/708: dread d0/d15/d2f/db4/d89/fda [0,4194304] 0 2024-02-15T18:27:13.729 INFO:tasks.workunit.client.1.smithi133.stdout:4/442: rmdir d2/d5/d2b/d21/d2d/d44/d51/d55 39 2024-02-15T18:27:13.729 INFO:tasks.workunit.client.0.smithi084.stdout:7/969: dwrite df/d1d/d1a/d4d/d55/f7a [0,4194304] 0 2024-02-15T18:27:13.729 INFO:tasks.workunit.client.0.smithi084.stdout:7/970: write df/d1d/d1a/dd1/d111/d12e/f132 [415730,119920] 0 2024-02-15T18:27:13.729 INFO:tasks.workunit.client.0.smithi084.stdout:7/971: readlink df/d1d/d1a/d4d/d103/lc6 0 2024-02-15T18:27:13.730 INFO:tasks.workunit.client.1.smithi133.stdout:6/918: link d0/db/d29/d34/d5d/d40/dde/d67/l9b d0/db/db6/l132 0 2024-02-15T18:27:13.730 INFO:tasks.workunit.client.1.smithi133.stdout:6/919: dread - d0/db/d29/d34/d5d/d40/dde/d53/f113 zero size 2024-02-15T18:27:13.730 INFO:tasks.workunit.client.1.smithi133.stdout:6/920: readlink d0/db/d29/d34/d5d/d40/dde/d67/d9a/d126/l128 0 2024-02-15T18:27:13.731 INFO:tasks.workunit.client.0.smithi084.stdout:2/981: dread d3/d5/d53/dca/dc3/f118 [0,4194304] 0 2024-02-15T18:27:13.731 INFO:tasks.workunit.client.0.smithi084.stdout:2/982: write d3/d19/d75/f12c [246965,44150] 0 2024-02-15T18:27:13.731 INFO:tasks.workunit.client.1.smithi133.stdout:2/665: dwrite d7/d18/d32/d65/f52 [0,4194304] 0 2024-02-15T18:27:13.732 INFO:tasks.workunit.client.1.smithi133.stdout:7/480: rename d9/d36/d39/l87 to d9/d36/d31/la4 0 2024-02-15T18:27:13.733 INFO:tasks.workunit.client.0.smithi084.stdout:2/983: read d3/d19/d108/f56 [3094209,55298] 0 2024-02-15T18:27:13.733 INFO:tasks.workunit.client.1.smithi133.stdout:0/744: dwrite d9/d10/d19/f98 [0,4194304] 0 2024-02-15T18:27:13.734 INFO:tasks.workunit.client.1.smithi133.stdout:4/443: mkdir d2/d48/d5c/d93/d8d/d96 0 2024-02-15T18:27:13.734 INFO:tasks.workunit.client.1.smithi133.stdout:4/444: readlink d2/d48/d5c/l8a 0 2024-02-15T18:27:13.737 INFO:tasks.workunit.client.1.smithi133.stdout:6/921: mknod d0/db/d29/d34/d5d/d40/dde/d67/d9a/c133 0 2024-02-15T18:27:13.741 INFO:tasks.workunit.client.1.smithi133.stdout:3/709: dread d0/d15/d2f/d9b/d39/d3f/f5f [0,4194304] 0 2024-02-15T18:27:13.743 INFO:tasks.workunit.client.1.smithi133.stdout:6/922: dread d0/f32 [0,4194304] 0 2024-02-15T18:27:13.743 INFO:tasks.workunit.client.1.smithi133.stdout:6/923: fdatasync d0/db/d29/d34/d48/f90 0 2024-02-15T18:27:13.743 INFO:tasks.workunit.client.1.smithi133.stdout:6/924: fdatasync d0/db/db6/fcb 0 2024-02-15T18:27:13.744 INFO:tasks.workunit.client.1.smithi133.stdout:2/666: getdents d7/d2c/d46 0 2024-02-15T18:27:13.747 INFO:tasks.workunit.client.1.smithi133.stdout:7/481: creat d9/fa5 x:0 0 0 2024-02-15T18:27:13.747 INFO:tasks.workunit.client.1.smithi133.stdout:7/482: fdatasync d9/db/d55/f7d 0 2024-02-15T18:27:13.751 INFO:tasks.workunit.client.1.smithi133.stdout:2/667: dread d7/f26 [0,4194304] 0 2024-02-15T18:27:13.753 INFO:tasks.workunit.client.1.smithi133.stdout:0/745: creat d9/d10/d85/ff8 x:0 0 0 2024-02-15T18:27:13.754 INFO:tasks.workunit.client.1.smithi133.stdout:3/710: dread d0/d15/d2f/f30 [0,4194304] 0 2024-02-15T18:27:13.756 INFO:tasks.workunit.client.1.smithi133.stdout:7/483: mkdir d9/db/d16/d5d/d68/d73/d9b/da6 0 2024-02-15T18:27:13.756 INFO:tasks.workunit.client.1.smithi133.stdout:0/746: rename d9/d10/d2c/f65 to d9/d2b/de9/ff9 0 2024-02-15T18:27:13.757 INFO:tasks.workunit.client.1.smithi133.stdout:3/711: creat d0/d15/d2f/d9b/fe5 x:0 0 0 2024-02-15T18:27:13.758 INFO:tasks.workunit.client.1.smithi133.stdout:0/747: creat d9/d10/d19/d29/d67/d68/d96/de4/ffa x:0 0 0 2024-02-15T18:27:13.758 INFO:tasks.workunit.client.0.smithi084.stdout:6/918: sync 2024-02-15T18:27:13.759 INFO:tasks.workunit.client.0.smithi084.stdout:0/980: sync 2024-02-15T18:27:13.759 INFO:tasks.workunit.client.0.smithi084.stdout:0/981: fdatasync d0/d2f/d4b/f10a 0 2024-02-15T18:27:13.759 INFO:tasks.workunit.client.1.smithi133.stdout:3/712: mkdir d0/d15/d2f/d9b/d39/dcd/de6 0 2024-02-15T18:27:13.760 INFO:tasks.workunit.client.1.smithi133.stdout:3/713: symlink d0/d15/d2f/d9b/d39/le7 0 2024-02-15T18:27:13.760 INFO:tasks.workunit.client.1.smithi133.stdout:2/668: write d7/d2c/d5a/d66/f7c [1211741,70091] 0 2024-02-15T18:27:13.760 INFO:tasks.workunit.client.0.smithi084.stdout:6/919: mknod d14/d22/d25/d2f/d31/d3f/dec/c12d 0 2024-02-15T18:27:13.761 INFO:tasks.workunit.client.0.smithi084.stdout:0/982: creat d0/d4/d1b/f12c x:0 0 0 2024-02-15T18:27:13.761 INFO:tasks.workunit.client.0.smithi084.stdout:0/983: dread - d0/d4/da8/ff2 zero size 2024-02-15T18:27:13.761 INFO:tasks.workunit.client.0.smithi084.stdout:6/920: creat d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/d99/f12e x:0 0 0 2024-02-15T18:27:13.762 INFO:tasks.workunit.client.1.smithi133.stdout:3/714: unlink d0/d15/d2f/d5e/c9f 0 2024-02-15T18:27:13.762 INFO:tasks.workunit.client.1.smithi133.stdout:2/669: mkdir d7/d2c/dd5 0 2024-02-15T18:27:13.765 INFO:tasks.workunit.client.1.smithi133.stdout:3/715: mknod d0/d15/d2f/d9b/d72/dbf/ce8 0 2024-02-15T18:27:13.765 INFO:tasks.workunit.client.1.smithi133.stdout:3/716: chown d0/d15/d2f/d9b/d72 1 1 2024-02-15T18:27:13.765 INFO:tasks.workunit.client.0.smithi084.stdout:0/984: truncate d0/d4/d3a/d5c/de2/d43/d6d/d71/d73/f113 123069 0 2024-02-15T18:27:13.765 INFO:tasks.workunit.client.0.smithi084.stdout:6/921: rmdir d14/d22/d25/d2f/d31/d30/d45/d54 39 2024-02-15T18:27:13.765 INFO:tasks.workunit.client.0.smithi084.stdout:6/922: dread - d14/d22/d25/d2f/da9/d9b/dac/ff3 zero size 2024-02-15T18:27:13.766 INFO:tasks.workunit.client.1.smithi133.stdout:2/670: creat d7/d2c/d3b/d48/d6d/fd6 x:0 0 0 2024-02-15T18:27:13.766 INFO:tasks.workunit.client.1.smithi133.stdout:2/671: fsync d7/d18/d32/f79 0 2024-02-15T18:27:13.766 INFO:tasks.workunit.client.1.smithi133.stdout:2/672: mkdir d7/db/d67/dd7 0 2024-02-15T18:27:13.769 INFO:tasks.workunit.client.0.smithi084.stdout:0/985: creat d0/d4/d1b/d7a/f12d x:0 0 0 2024-02-15T18:27:13.769 INFO:tasks.workunit.client.0.smithi084.stdout:6/923: mknod d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/c12f 0 2024-02-15T18:27:13.769 INFO:tasks.workunit.client.0.smithi084.stdout:0/986: read - d0/d4/d1b/d7a/f12d zero size 2024-02-15T18:27:13.771 INFO:tasks.workunit.client.1.smithi133.stdout:0/748: dread d9/d10/d22/d32/f40 [0,4194304] 0 2024-02-15T18:27:13.771 INFO:tasks.workunit.client.1.smithi133.stdout:0/749: chown d9/d10/d19/d29/d67/d68/d9c/da7/fda 142610 1 2024-02-15T18:27:13.771 INFO:tasks.workunit.client.1.smithi133.stdout:0/750: fsync d9/d28/fd0 0 2024-02-15T18:27:13.771 INFO:tasks.workunit.client.1.smithi133.stdout:0/751: dread - d9/d10/d19/d8c/fb9 zero size 2024-02-15T18:27:13.771 INFO:tasks.workunit.client.0.smithi084.stdout:6/924: symlink d14/d22/d25/d2f/da9/l130 0 2024-02-15T18:27:13.772 INFO:tasks.workunit.client.1.smithi133.stdout:0/752: mkdir d9/d10/d19/dfb 0 2024-02-15T18:27:13.781 INFO:tasks.workunit.client.0.smithi084.stdout:7/972: dwrite df/d1d/d1a/d4d/d55/fa3 [0,4194304] 0 2024-02-15T18:27:13.781 INFO:tasks.workunit.client.1.smithi133.stdout:2/673: dread d7/db/f1d [4194304,4194304] 0 2024-02-15T18:27:13.782 INFO:tasks.workunit.client.1.smithi133.stdout:2/674: symlink d7/d2c/d5a/d66/d70/ld8 0 2024-02-15T18:27:13.782 INFO:tasks.workunit.client.1.smithi133.stdout:2/675: chown d7/d2c/d5a/d66/f7c 64552472 1 2024-02-15T18:27:13.783 INFO:tasks.workunit.client.1.smithi133.stdout:7/484: dwrite d9/d19/f54 [0,4194304] 0 2024-02-15T18:27:13.783 INFO:tasks.workunit.client.1.smithi133.stdout:7/485: write d9/d36/d39/d98/fa1 [5826032,25897] 0 2024-02-15T18:27:13.784 INFO:tasks.workunit.client.0.smithi084.stdout:7/973: symlink df/d1d/d1a/d6a/d8b/da5/l142 0 2024-02-15T18:27:13.784 INFO:tasks.workunit.client.1.smithi133.stdout:2/676: mkdir d7/db/d67/dd7/dd9 0 2024-02-15T18:27:13.784 INFO:tasks.workunit.client.1.smithi133.stdout:2/677: truncate d7/db/fa1 321618 0 2024-02-15T18:27:13.786 INFO:tasks.workunit.client.1.smithi133.stdout:2/678: creat d7/d18/d32/d65/d54/dc9/fda x:0 0 0 2024-02-15T18:27:13.786 INFO:tasks.workunit.client.0.smithi084.stdout:7/974: link df/d1d/d1a/d4d/d55/cfc df/d1d/d44/d96/c143 0 2024-02-15T18:27:13.786 INFO:tasks.workunit.client.0.smithi084.stdout:7/975: write df/d1d/d1a/d4d/d10c/d131/f13e [132967,23719] 0 2024-02-15T18:27:13.787 INFO:tasks.workunit.client.1.smithi133.stdout:7/486: write d9/d36/d3d/d4c/f61 [223619,46616] 0 2024-02-15T18:27:13.787 INFO:tasks.workunit.client.1.smithi133.stdout:7/487: chown d9/db/d16/f49 103 1 2024-02-15T18:27:13.788 INFO:tasks.workunit.client.0.smithi084.stdout:7/976: write df/d1d/d1a/f9d [495266,10623] 0 2024-02-15T18:27:13.789 INFO:tasks.workunit.client.1.smithi133.stdout:7/488: read d9/f47 [382892,105272] 0 2024-02-15T18:27:13.789 INFO:tasks.workunit.client.1.smithi133.stdout:7/489: truncate d9/db/d16/f53 1042175 0 2024-02-15T18:27:13.790 INFO:tasks.workunit.client.1.smithi133.stdout:7/490: symlink d9/d36/d39/la7 0 2024-02-15T18:27:13.791 INFO:tasks.workunit.client.1.smithi133.stdout:7/491: creat d9/da/fa8 x:0 0 0 2024-02-15T18:27:13.792 INFO:tasks.workunit.client.1.smithi133.stdout:7/492: mkdir d9/d36/d3d/d4c/d97/da9 0 2024-02-15T18:27:13.793 INFO:tasks.workunit.client.1.smithi133.stdout:7/493: symlink d9/db/d16/d5d/d68/d73/d9c/laa 0 2024-02-15T18:27:13.794 INFO:tasks.workunit.client.1.smithi133.stdout:7/494: unlink d9/da/c6a 0 2024-02-15T18:27:13.794 INFO:tasks.workunit.client.1.smithi133.stdout:7/495: write d9/d36/d39/f5c [352128,101825] 0 2024-02-15T18:27:13.796 INFO:tasks.workunit.client.1.smithi133.stdout:7/496: rename d9/d19/f54 to d9/db/d16/d5d/d68/d73/d9c/fab 0 2024-02-15T18:27:13.796 INFO:tasks.workunit.client.1.smithi133.stdout:7/497: fsync d9/db/d55/fa0 0 2024-02-15T18:27:13.797 INFO:tasks.workunit.client.1.smithi133.stdout:7/498: creat d9/d36/d39/d98/fac x:0 0 0 2024-02-15T18:27:13.798 INFO:tasks.workunit.client.1.smithi133.stdout:7/499: dread d9/db/d16/f53 [0,4194304] 0 2024-02-15T18:27:13.798 INFO:tasks.workunit.client.1.smithi133.stdout:7/500: fsync d9/db/f8c 0 2024-02-15T18:27:13.802 INFO:tasks.workunit.client.0.smithi084.stdout:7/977: dread df/d1d/d1a/d6a/d8e/d79/ddc/f122 [0,4194304] 0 2024-02-15T18:27:13.803 INFO:tasks.workunit.client.0.smithi084.stdout:7/978: symlink df/d1d/d1a/d6a/d8e/d79/l144 0 2024-02-15T18:27:13.819 INFO:tasks.workunit.client.1.smithi133.stdout:2/679: dread d7/d18/d32/d65/d54/f6c [0,4194304] 0 2024-02-15T18:27:13.834 INFO:tasks.workunit.client.1.smithi133.stdout:4/445: dwrite d2/f1f [0,4194304] 0 2024-02-15T18:27:13.834 INFO:tasks.workunit.client.1.smithi133.stdout:4/446: stat d2/d5/d2b/d21/d2d/d44/d51/d55 0 2024-02-15T18:27:13.834 INFO:tasks.workunit.client.1.smithi133.stdout:4/447: chown d2/d5/d2b/d21/d3b/d49/f57 0 1 2024-02-15T18:27:13.834 INFO:tasks.workunit.client.0.smithi084.stdout:2/984: dwrite d3/d5/d53/dca/d11b/d134/d1e/d4b/da6/d5c/dd3/d117/f111 [0,4194304] 0 2024-02-15T18:27:13.836 INFO:tasks.workunit.client.1.smithi133.stdout:0/753: dwrite d9/d28/fd0 [0,4194304] 0 2024-02-15T18:27:13.836 INFO:tasks.workunit.client.0.smithi084.stdout:0/987: dwrite d0/d2f/d3f/d4c/de1/d108/f122 [0,4194304] 0 2024-02-15T18:27:13.836 INFO:tasks.workunit.client.0.smithi084.stdout:6/925: dwrite d14/d22/d25/d2f/d31/dcf/f122 [0,4194304] 0 2024-02-15T18:27:13.837 INFO:tasks.workunit.client.1.smithi133.stdout:3/717: dwrite d0/d15/d2f/d5e/f97 [0,4194304] 0 2024-02-15T18:27:13.837 INFO:tasks.workunit.client.1.smithi133.stdout:3/718: fsync d0/d15/d2f/dad/fd2 0 2024-02-15T18:27:13.840 INFO:tasks.workunit.client.1.smithi133.stdout:7/501: dwrite d9/db/f3c [0,4194304] 0 2024-02-15T18:27:13.840 INFO:tasks.workunit.client.0.smithi084.stdout:2/985: mknod d3/d5/d53/dca/d89/dec/d100/c13b 0 2024-02-15T18:27:13.843 INFO:tasks.workunit.client.1.smithi133.stdout:3/719: dread d0/f8d [0,4194304] 0 2024-02-15T18:27:13.845 INFO:tasks.workunit.client.1.smithi133.stdout:0/754: dread d9/d10/d22/d32/f40 [0,4194304] 0 2024-02-15T18:27:13.849 INFO:tasks.workunit.client.0.smithi084.stdout:2/986: getdents d3/d5/d53/dca/d89/dec 0 2024-02-15T18:27:13.851 INFO:tasks.workunit.client.0.smithi084.stdout:2/987: read d3/ff2 [76332,121765] 0 2024-02-15T18:27:13.855 INFO:tasks.workunit.client.1.smithi133.stdout:1/824: sync 2024-02-15T18:27:13.855 INFO:tasks.workunit.client.1.smithi133.stdout:5/539: sync 2024-02-15T18:27:13.857 INFO:tasks.workunit.client.1.smithi133.stdout:2/680: rmdir d7/d2c/d3b 39 2024-02-15T18:27:13.859 INFO:tasks.workunit.client.0.smithi084.stdout:2/988: read d3/d19/f33 [183827,1280] 0 2024-02-15T18:27:13.862 INFO:tasks.workunit.client.1.smithi133.stdout:7/502: creat d9/db/d16/d5d/d68/d73/d9b/fad x:0 0 0 2024-02-15T18:27:13.862 INFO:tasks.workunit.client.1.smithi133.stdout:1/825: symlink d6/d1e/l12f 0 2024-02-15T18:27:13.862 INFO:tasks.workunit.client.1.smithi133.stdout:5/540: creat d17/d20/d32/d38/d70/faf x:0 0 0 2024-02-15T18:27:13.863 INFO:tasks.workunit.client.0.smithi084.stdout:0/988: dread d0/d4/d3a/d82/fe8 [0,4194304] 0 2024-02-15T18:27:13.864 INFO:tasks.workunit.client.1.smithi133.stdout:7/503: rmdir d9/da/d48 39 2024-02-15T18:27:13.864 INFO:tasks.workunit.client.1.smithi133.stdout:7/504: chown d9/db/ce 113449 1 2024-02-15T18:27:13.864 INFO:tasks.workunit.client.0.smithi084.stdout:0/989: link d0/d4/d3a/f74 d0/d2f/d4b/dee/f12e 0 2024-02-15T18:27:13.865 INFO:tasks.workunit.client.0.smithi084.stdout:0/990: write d0/d4/fd4 [285598,68975] 0 2024-02-15T18:27:13.865 INFO:tasks.workunit.client.0.smithi084.stdout:0/991: fdatasync d0/d2f/d3f/d4f/d59/f60 0 2024-02-15T18:27:13.866 INFO:tasks.workunit.client.0.smithi084.stdout:0/992: dread - d0/d39/f114 zero size 2024-02-15T18:27:13.866 INFO:tasks.workunit.client.1.smithi133.stdout:2/681: link d7/db/c41 d7/d2c/d3b/d48/d6d/cdb 0 2024-02-15T18:27:13.867 INFO:tasks.workunit.client.1.smithi133.stdout:1/826: symlink d6/d1e/d3a/d82/d85/d67/ddb/l130 0 2024-02-15T18:27:13.867 INFO:tasks.workunit.client.1.smithi133.stdout:1/827: chown d6/d1e/d3a/d82/ff8 31 1 2024-02-15T18:27:13.867 INFO:tasks.workunit.client.1.smithi133.stdout:5/541: creat d17/d20/d32/d38/d86/fb0 x:0 0 0 2024-02-15T18:27:13.867 INFO:tasks.workunit.client.0.smithi084.stdout:0/993: unlink d0/d4/d3a/d82/fed 0 2024-02-15T18:27:13.868 INFO:tasks.workunit.client.1.smithi133.stdout:2/682: mkdir d7/d18/d32/ddc 0 2024-02-15T18:27:13.869 INFO:tasks.workunit.client.0.smithi084.stdout:0/994: symlink d0/d4/d3a/d82/l12f 0 2024-02-15T18:27:13.870 INFO:tasks.workunit.client.0.smithi084.stdout:0/995: read d0/d1e/f44 [168579,64109] 0 2024-02-15T18:27:13.871 INFO:tasks.workunit.client.1.smithi133.stdout:1/828: rename d6/d2a/d59/d5a/f6f to d6/d1e/d3a/d75/f131 0 2024-02-15T18:27:13.871 INFO:tasks.workunit.client.0.smithi084.stdout:6/926: dread d14/d22/d25/f35 [0,4194304] 0 2024-02-15T18:27:13.872 INFO:tasks.workunit.client.1.smithi133.stdout:1/829: mkdir d6/d1e/d41/d132 0 2024-02-15T18:27:13.873 INFO:tasks.workunit.client.0.smithi084.stdout:0/996: rename d0/d2f/d3f/f30 to d0/d2f/d3f/da4/f130 0 2024-02-15T18:27:13.874 INFO:tasks.workunit.client.1.smithi133.stdout:1/830: creat d6/d1e/d3a/d82/d85/d11b/f133 x:0 0 0 2024-02-15T18:27:13.876 INFO:tasks.workunit.client.1.smithi133.stdout:1/831: creat d6/d1e/f134 x:0 0 0 2024-02-15T18:27:13.877 INFO:tasks.workunit.client.1.smithi133.stdout:1/832: mkdir d6/d1e/d3a/d97/dda/d135 0 2024-02-15T18:27:13.878 INFO:tasks.workunit.client.1.smithi133.stdout:1/833: creat d6/d1e/d3a/d82/d85/d11b/f136 x:0 0 0 2024-02-15T18:27:13.910 INFO:tasks.workunit.client.1.smithi133.stdout:7/505: dread d9/d36/f32 [0,4194304] 0 2024-02-15T18:27:13.910 INFO:tasks.workunit.client.1.smithi133.stdout:7/506: truncate d9/db/d55/fa0 153070 0 2024-02-15T18:27:13.910 INFO:tasks.workunit.client.1.smithi133.stdout:7/507: chown d9/c60 5244 1 2024-02-15T18:27:13.911 INFO:tasks.workunit.client.1.smithi133.stdout:7/508: write d9/db/dc/d84/fa3 [850446,64210] 0 2024-02-15T18:27:13.911 INFO:tasks.workunit.client.1.smithi133.stdout:7/509: symlink d9/db/d16/d5d/d86/lae 0 2024-02-15T18:27:13.930 INFO:tasks.workunit.client.0.smithi084.stdout:6/927: dread d14/d22/d25/d2f/d31/d30/d45/d52/d8a/fb6 [0,4194304] 0 2024-02-15T18:27:13.944 INFO:tasks.workunit.client.1.smithi133.stdout:0/755: dwrite d9/d10/d22/fde [0,4194304] 0 2024-02-15T18:27:13.944 INFO:tasks.workunit.client.1.smithi133.stdout:0/756: fsync d9/d10/d19/d8c/fb9 0 2024-02-15T18:27:13.944 INFO:tasks.workunit.client.1.smithi133.stdout:4/448: dwrite d2/f72 [0,4194304] 0 2024-02-15T18:27:13.948 INFO:tasks.workunit.client.1.smithi133.stdout:0/757: truncate d9/d10/d19/d1a/f66 3406449 0 2024-02-15T18:27:13.949 INFO:tasks.workunit.client.1.smithi133.stdout:4/449: rmdir d2/d5 39 2024-02-15T18:27:13.950 INFO:tasks.workunit.client.1.smithi133.stdout:0/758: creat d9/d10/d22/ffc x:0 0 0 2024-02-15T18:27:13.950 INFO:tasks.workunit.client.1.smithi133.stdout:0/759: write d9/d10/d22/d32/f74 [1651364,125459] 0 2024-02-15T18:27:13.951 INFO:tasks.workunit.client.1.smithi133.stdout:0/760: chown d9/d1c/f3f 11772 1 2024-02-15T18:27:13.953 INFO:tasks.workunit.client.1.smithi133.stdout:3/720: dwrite d0/d15/d2f/d9b/d39/da2/fab [0,4194304] 0 2024-02-15T18:27:13.953 INFO:tasks.workunit.client.1.smithi133.stdout:1/834: dwrite d6/d1e/d41/f66 [0,4194304] 0 2024-02-15T18:27:13.955 INFO:tasks.workunit.client.1.smithi133.stdout:3/721: truncate d0/d15/d37/d95/f9c 187081 0 2024-02-15T18:27:13.956 INFO:tasks.workunit.client.1.smithi133.stdout:0/761: dread d9/d10/f54 [0,4194304] 0 2024-02-15T18:27:13.957 INFO:tasks.workunit.client.1.smithi133.stdout:3/722: symlink d0/d15/d2f/d9b/d39/dcd/de0/le9 0 2024-02-15T18:27:13.958 INFO:tasks.workunit.client.1.smithi133.stdout:1/835: dread d6/d1e/d3a/d79/dfa/fbf [0,4194304] 0 2024-02-15T18:27:13.958 INFO:tasks.workunit.client.0.smithi084.stdout:0/997: dwrite d0/d2f/d3f/f109 [0,4194304] 0 2024-02-15T18:27:13.960 INFO:tasks.workunit.client.0.smithi084.stdout:7/979: dwrite df/d1d/d1a/f9d [0,4194304] 0 2024-02-15T18:27:13.960 INFO:tasks.workunit.client.0.smithi084.stdout:7/980: stat df/d1d/d1a/d6a/d8b/da5/db6/df5 0 2024-02-15T18:27:13.960 INFO:tasks.workunit.client.0.smithi084.stdout:7/981: readlink df/d70/laf 0 2024-02-15T18:27:13.960 INFO:tasks.workunit.client.0.smithi084.stdout:6/928: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/fb3 [4194304,4194304] 0 2024-02-15T18:27:13.961 INFO:tasks.workunit.client.1.smithi133.stdout:5/542: dwrite d17/d20/f53 [0,4194304] 0 2024-02-15T18:27:13.961 INFO:tasks.workunit.client.1.smithi133.stdout:5/543: truncate d17/d20/d32/d38/f96 71848 0 2024-02-15T18:27:13.961 INFO:tasks.workunit.client.1.smithi133.stdout:5/544: truncate d17/f4a 367206 0 2024-02-15T18:27:13.961 INFO:tasks.workunit.client.1.smithi133.stdout:5/545: write d17/d2a/f42 [5102047,85273] 0 2024-02-15T18:27:13.961 INFO:tasks.workunit.client.0.smithi084.stdout:2/989: dwrite d3/d9e/f131 [0,4194304] 0 2024-02-15T18:27:13.961 INFO:tasks.workunit.client.1.smithi133.stdout:1/836: mkdir d6/d1e/d41/d132/d137 0 2024-02-15T18:27:13.961 INFO:tasks.workunit.client.1.smithi133.stdout:1/837: readlink d6/l1f 0 2024-02-15T18:27:13.963 INFO:tasks.workunit.client.0.smithi084.stdout:7/982: dread df/d1d/d44/d8d/d10a/f134 [0,4194304] 0 2024-02-15T18:27:13.963 INFO:tasks.workunit.client.0.smithi084.stdout:7/983: chown df/d1d/d1a/f81 1886763 1 2024-02-15T18:27:13.963 INFO:tasks.workunit.client.0.smithi084.stdout:7/984: stat df/d1d/d1a/d6a/d8e/faa 0 2024-02-15T18:27:13.963 INFO:tasks.workunit.client.0.smithi084.stdout:0/998: symlink d0/d4/d66/d112/l131 0 2024-02-15T18:27:13.963 INFO:tasks.workunit.client.1.smithi133.stdout:2/683: dwrite d7/d2c/d3b/d48/d6d/fd6 [0,4194304] 0 2024-02-15T18:27:13.963 INFO:tasks.workunit.client.1.smithi133.stdout:2/684: dread - d7/d2c/d3b/d48/d59/fd3 zero size 2024-02-15T18:27:13.963 INFO:tasks.workunit.client.1.smithi133.stdout:2/685: readlink d7/d18/d32/l7e 0 2024-02-15T18:27:13.967 INFO:tasks.workunit.client.0.smithi084.stdout:6/929: mknod d14/d22/d25/d2f/d31/d30/d45/d52/c131 0 2024-02-15T18:27:13.967 INFO:tasks.workunit.client.0.smithi084.stdout:6/930: chown d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/ca5 46700753 1 2024-02-15T18:27:13.969 INFO:tasks.workunit.client.0.smithi084.stdout:2/990: creat d3/d19/d75/f13c x:0 0 0 2024-02-15T18:27:13.970 INFO:tasks.workunit.client.1.smithi133.stdout:9/565: sync 2024-02-15T18:27:13.972 INFO:tasks.workunit.client.0.smithi084.stdout:0/999: creat d0/d2f/d3f/d4f/d61/de6/f132 x:0 0 0 2024-02-15T18:27:13.972 INFO:tasks.workunit.client.0.smithi084.stdout:6/931: mkdir d14/d22/d25/d2f/d31/d3f/d132 0 2024-02-15T18:27:13.973 INFO:tasks.workunit.client.0.smithi084.stdout:6/932: getdents d14/d22/d25/d2f/d31/d3f/d4a 0 2024-02-15T18:27:13.975 INFO:tasks.workunit.client.1.smithi133.stdout:5/546: mkdir d17/d20/d5e/db1 0 2024-02-15T18:27:13.975 INFO:tasks.workunit.client.1.smithi133.stdout:5/547: write d17/d20/d4f/d5f/f60 [1504903,22784] 0 2024-02-15T18:27:13.975 INFO:tasks.workunit.client.1.smithi133.stdout:5/548: chown d17/d20/d5e/f7f 28635401 1 2024-02-15T18:27:13.977 INFO:tasks.workunit.client.1.smithi133.stdout:7/510: dread d9/d36/d39/d98/fa1 [4194304,4194304] 0 2024-02-15T18:27:13.980 INFO:tasks.workunit.client.1.smithi133.stdout:7/511: mkdir d9/daf 0 2024-02-15T18:27:13.984 INFO:tasks.workunit.client.1.smithi133.stdout:7/512: rename d9/d36/d31/la4 to d9/lb0 0 2024-02-15T18:27:13.986 INFO:tasks.workunit.client.1.smithi133.stdout:7/513: truncate f6 2627741 0 2024-02-15T18:27:13.986 INFO:tasks.workunit.client.1.smithi133.stdout:7/514: chown c8 5195636 1 2024-02-15T18:27:13.987 INFO:tasks.workunit.client.0.smithi084.stdout:2/991: dread d3/d5/d53/dca/d11b/d134/d1e/d4b/da6/d5c/f119 [0,4194304] 0 2024-02-15T18:27:13.987 INFO:tasks.workunit.client.0.smithi084.stdout:6/933: dread d14/d22/d25/d2f/da9/d9b/dac/f113 [0,4194304] 0 2024-02-15T18:27:13.987 INFO:tasks.workunit.client.0.smithi084.stdout:6/934: readlink d14/d22/d25/d2f/d31/d30/d4f/d7f/la7 0 2024-02-15T18:27:13.987 INFO:tasks.workunit.client.0.smithi084.stdout:6/935: read - d14/d22/d25/d28/d11c/ff2 zero size 2024-02-15T18:27:13.988 INFO:tasks.workunit.client.1.smithi133.stdout:7/515: symlink d9/db/d16/d5d/d68/d73/d9b/da6/lb1 0 2024-02-15T18:27:13.988 INFO:tasks.workunit.client.1.smithi133.stdout:7/516: chown d9/db/f27 7263361 1 2024-02-15T18:27:13.988 INFO:tasks.workunit.client.1.smithi133.stdout:9/566: dread d0/d8/d10/d4d/f5e [0,4194304] 0 2024-02-15T18:27:13.989 INFO:tasks.workunit.client.1.smithi133.stdout:9/567: chown d0/d8/d9/d12/fab 33 1 2024-02-15T18:27:13.989 INFO:tasks.workunit.client.1.smithi133.stdout:7/517: symlink d9/db/dc/d84/lb2 0 2024-02-15T18:27:13.989 INFO:tasks.workunit.client.0.smithi084.stdout:2/992: truncate d3/d5/f21 2446497 0 2024-02-15T18:27:13.989 INFO:tasks.workunit.client.0.smithi084.stdout:2/993: chown d3/d19/d75/f12d 27137188 1 2024-02-15T18:27:13.990 INFO:tasks.workunit.client.0.smithi084.stdout:2/994: creat d3/dc6/f13d x:0 0 0 2024-02-15T18:27:13.991 INFO:tasks.workunit.client.1.smithi133.stdout:7/518: mknod d9/daf/cb3 0 2024-02-15T18:27:13.993 INFO:tasks.workunit.client.1.smithi133.stdout:7/519: rename d9/d36/f2e to d9/d5b/fb4 0 2024-02-15T18:27:13.995 INFO:tasks.workunit.client.1.smithi133.stdout:7/520: unlink d9/db/d16/d5d/d68/l76 0 2024-02-15T18:27:13.997 INFO:tasks.workunit.client.1.smithi133.stdout:7/521: getdents d9/db/d16 0 2024-02-15T18:27:13.997 INFO:tasks.workunit.client.1.smithi133.stdout:7/522: read - d9/db/d55/f7a zero size 2024-02-15T18:27:13.998 INFO:tasks.workunit.client.1.smithi133.stdout:7/523: truncate d9/da/d48/d62/d64/f9a 2340252 0 2024-02-15T18:27:13.998 INFO:tasks.workunit.client.1.smithi133.stdout:7/524: fdatasync d9/db/d16/d5d/d68/f71 0 2024-02-15T18:27:13.998 INFO:tasks.workunit.client.1.smithi133.stdout:7/525: chown d9/daf 9015764 1 2024-02-15T18:27:14.001 INFO:tasks.workunit.client.0.smithi084.stdout:6/936: dread f9 [0,4194304] 0 2024-02-15T18:27:14.004 INFO:tasks.workunit.client.1.smithi133.stdout:1/838: dwrite d6/d1e/d41/f54 [0,4194304] 0 2024-02-15T18:27:14.004 INFO:tasks.workunit.client.1.smithi133.stdout:4/450: dwrite d2/d5/d2b/f24 [0,4194304] 0 2024-02-15T18:27:14.004 INFO:tasks.workunit.client.1.smithi133.stdout:4/451: fdatasync d2/d5/d2b/d21/d2d/f3c 0 2024-02-15T18:27:14.004 INFO:tasks.workunit.client.1.smithi133.stdout:3/723: dwrite d0/d15/d37/fb7 [0,4194304] 0 2024-02-15T18:27:14.004 INFO:tasks.workunit.client.1.smithi133.stdout:3/724: stat d0/d15/d2f/d9b/d9d 0 2024-02-15T18:27:14.004 INFO:tasks.workunit.client.1.smithi133.stdout:1/839: chown d6/d2a/d59/l95 863105898 1 2024-02-15T18:27:14.005 INFO:tasks.workunit.client.0.smithi084.stdout:6/937: mknod d14/d22/d25/d2f/d31/deb/c133 0 2024-02-15T18:27:14.006 INFO:tasks.workunit.client.0.smithi084.stdout:1/960: sync 2024-02-15T18:27:14.007 INFO:tasks.workunit.client.0.smithi084.stdout:6/938: write d14/d22/d25/d2f/da9/d9b/dac/ffb [1275844,110392] 0 2024-02-15T18:27:14.009 INFO:tasks.workunit.client.0.smithi084.stdout:1/961: mkdir d9/d54/d1b/d2c/d4b/d4c/da9/d119/d141 0 2024-02-15T18:27:14.009 INFO:tasks.workunit.client.0.smithi084.stdout:1/962: readlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/l138 0 2024-02-15T18:27:14.010 INFO:tasks.workunit.client.0.smithi084.stdout:1/963: read - d9/d54/d7f/db7/dd9/df7/ffb zero size 2024-02-15T18:27:14.011 INFO:tasks.workunit.client.1.smithi133.stdout:1/840: write d6/fb1 [2495021,54089] 0 2024-02-15T18:27:14.012 INFO:tasks.workunit.client.0.smithi084.stdout:6/939: symlink d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/d97/l134 0 2024-02-15T18:27:14.012 INFO:tasks.workunit.client.0.smithi084.stdout:6/940: fsync d14/d22/d25/d28/f11e 0 2024-02-15T18:27:14.012 INFO:tasks.workunit.client.0.smithi084.stdout:6/941: stat d14/d22/d25/d2f/d31/d30/d45/d52/c131 0 2024-02-15T18:27:14.012 INFO:tasks.workunit.client.0.smithi084.stdout:6/942: stat d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/f7d 0 2024-02-15T18:27:14.013 INFO:tasks.workunit.client.1.smithi133.stdout:8/572: sync 2024-02-15T18:27:14.013 INFO:tasks.workunit.client.1.smithi133.stdout:6/925: sync 2024-02-15T18:27:14.013 INFO:tasks.workunit.client.1.smithi133.stdout:6/926: truncate d0/db/d29/d34/f97 240655 0 2024-02-15T18:27:14.013 INFO:tasks.workunit.client.1.smithi133.stdout:8/573: fdatasync d3/d1f/d3f/f8f 0 2024-02-15T18:27:14.013 INFO:tasks.workunit.client.0.smithi084.stdout:6/943: symlink d14/d22/d25/d2f/d31/d3f/dec/d129/l135 0 2024-02-15T18:27:14.015 INFO:tasks.workunit.client.1.smithi133.stdout:3/725: symlink d0/d15/d2f/d9b/d39/dcd/lea 0 2024-02-15T18:27:14.016 INFO:tasks.workunit.client.1.smithi133.stdout:1/841: unlink d6/d1e/d3a/d79/dfa/lf9 0 2024-02-15T18:27:14.016 INFO:tasks.workunit.client.1.smithi133.stdout:1/842: truncate d6/d1e/d3a/d75/ff5 2102723 0 2024-02-15T18:27:14.020 INFO:tasks.workunit.client.1.smithi133.stdout:4/452: dread d2/d5/d2b/d21/d3b/f66 [0,4194304] 0 2024-02-15T18:27:14.021 INFO:tasks.workunit.client.1.smithi133.stdout:8/574: link d3/d1f/d3f/f74 d3/d92/db4/fbb 0 2024-02-15T18:27:14.021 INFO:tasks.workunit.client.1.smithi133.stdout:6/927: rename d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/de4/f129 to d0/db/d29/d34/d5d/dc9/f134 0 2024-02-15T18:27:14.021 INFO:tasks.workunit.client.1.smithi133.stdout:3/726: mknod d0/d15/d37/d7b/ceb 0 2024-02-15T18:27:14.023 INFO:tasks.workunit.client.1.smithi133.stdout:1/843: rename d6/l1f to d6/d1e/d41/d132/l138 0 2024-02-15T18:27:14.024 INFO:tasks.workunit.client.1.smithi133.stdout:8/575: read d3/d1f/d3f/f41 [7647489,14469] 0 2024-02-15T18:27:14.024 INFO:tasks.workunit.client.1.smithi133.stdout:6/928: mknod d0/db/c135 0 2024-02-15T18:27:14.024 INFO:tasks.workunit.client.0.smithi084.stdout:7/985: dwrite df/d1d/d1a/dd1/d111/d12e/f132 [0,4194304] 0 2024-02-15T18:27:14.026 INFO:tasks.workunit.client.1.smithi133.stdout:3/727: mkdir d0/d15/d2f/d9b/dec 0 2024-02-15T18:27:14.027 INFO:tasks.workunit.client.1.smithi133.stdout:3/728: write d0/d15/d2f/db4/f7e [4443505,86255] 0 2024-02-15T18:27:14.027 INFO:tasks.workunit.client.1.smithi133.stdout:3/729: getdents d0/d15/d2f/d9b/d39/dcd/de6 0 2024-02-15T18:27:14.027 INFO:tasks.workunit.client.0.smithi084.stdout:7/986: creat df/d1d/d44/f145 x:0 0 0 2024-02-15T18:27:14.029 INFO:tasks.workunit.client.0.smithi084.stdout:7/987: rename df/d1d/d1a/d6a/d8b/d48/l33 to df/d1d/d44/dbb/df8/d98/l146 0 2024-02-15T18:27:14.029 INFO:tasks.workunit.client.1.smithi133.stdout:8/576: symlink d3/d1c/lbc 0 2024-02-15T18:27:14.030 INFO:tasks.workunit.client.1.smithi133.stdout:1/844: dread d6/d1e/d3a/d75/f84 [0,4194304] 0 2024-02-15T18:27:14.030 INFO:tasks.workunit.client.0.smithi084.stdout:7/988: symlink df/d1d/d44/d96/d100/l147 0 2024-02-15T18:27:14.030 INFO:tasks.workunit.client.0.smithi084.stdout:3/852: sync 2024-02-15T18:27:14.031 INFO:tasks.workunit.client.1.smithi133.stdout:6/929: rename d0/db/d21/f116 to d0/db/d29/d34/d5d/dda/f136 0 2024-02-15T18:27:14.031 INFO:tasks.workunit.client.0.smithi084.stdout:3/853: creat d8/d40/d43/d71/d8c/d94/da3/dba/de3/f125 x:0 0 0 2024-02-15T18:27:14.032 INFO:tasks.workunit.client.1.smithi133.stdout:3/730: dread d0/d15/d2f/dad/fd2 [0,4194304] 0 2024-02-15T18:27:14.032 INFO:tasks.workunit.client.1.smithi133.stdout:3/731: write d0/d15/d54/ddc/fc0 [681848,5027] 0 2024-02-15T18:27:14.032 INFO:tasks.workunit.client.0.smithi084.stdout:3/854: symlink d8/d40/d43/d71/d8c/d94/da3/l126 0 2024-02-15T18:27:14.033 INFO:tasks.workunit.client.0.smithi084.stdout:3/855: mknod d8/d40/d58/d80/d106/c127 0 2024-02-15T18:27:14.034 INFO:tasks.workunit.client.0.smithi084.stdout:7/989: write df/d1d/d1a/d6a/d8b/d48/f3d [230207,95382] 0 2024-02-15T18:27:14.034 INFO:tasks.workunit.client.0.smithi084.stdout:7/990: chown df/d1d/d44/dbb/df8/lc7 49 1 2024-02-15T18:27:14.034 INFO:tasks.workunit.client.0.smithi084.stdout:7/991: readlink df/d1d/d44/d96/lbd 0 2024-02-15T18:27:14.035 INFO:tasks.workunit.client.0.smithi084.stdout:2/995: dwrite d3/d5/d53/dca/d11b/d134/d2d/f38 [0,4194304] 0 2024-02-15T18:27:14.035 INFO:tasks.workunit.client.0.smithi084.stdout:2/996: fdatasync d3/d5/d53/dca/d91/fd2 0 2024-02-15T18:27:14.036 INFO:tasks.workunit.client.0.smithi084.stdout:7/992: symlink df/d1d/d1a/d6a/d8e/d79/d119/dfe/l148 0 2024-02-15T18:27:14.036 INFO:tasks.workunit.client.1.smithi133.stdout:4/453: rmdir d2/d5/d2b/d21/d2d/d44/d6b 0 2024-02-15T18:27:14.038 INFO:tasks.workunit.client.0.smithi084.stdout:2/997: mknod d3/d5/d53/dca/d11b/d134/d1e/d4b/da6/d5c/dd3/d117/db9/de8/c13e 0 2024-02-15T18:27:14.039 INFO:tasks.workunit.client.1.smithi133.stdout:8/577: link d3/d92/f8d d3/d92/fbd 0 2024-02-15T18:27:14.039 INFO:tasks.workunit.client.0.smithi084.stdout:7/993: creat df/d1d/d44/d96/f149 x:0 0 0 2024-02-15T18:27:14.040 INFO:tasks.workunit.client.0.smithi084.stdout:2/998: mkdir d3/d9e/df7/d13f 0 2024-02-15T18:27:14.040 INFO:tasks.workunit.client.1.smithi133.stdout:1/845: rename d6/d1e/d41/f46 to d6/f139 0 2024-02-15T18:27:14.041 INFO:tasks.workunit.client.0.smithi084.stdout:7/994: creat df/d1d/d1a/d6a/d8b/d48/dca/f14a x:0 0 0 2024-02-15T18:27:14.042 INFO:tasks.workunit.client.1.smithi133.stdout:6/930: creat d0/db/d29/d34/d5d/d40/dde/d78/d7f/f137 x:0 0 0 2024-02-15T18:27:14.042 INFO:tasks.workunit.client.1.smithi133.stdout:6/931: write d0/fd7 [588356,102578] 0 2024-02-15T18:27:14.042 INFO:tasks.workunit.client.0.smithi084.stdout:7/995: write df/d1d/d1a/d6a/d8e/d79/ddc/f122 [2814793,112757] 0 2024-02-15T18:27:14.042 INFO:tasks.workunit.client.0.smithi084.stdout:2/999: getdents d3/d5/d53/dca/d7b 0 2024-02-15T18:27:14.043 INFO:tasks.workunit.client.1.smithi133.stdout:9/568: dwrite d0/d8/d9/d12/f21 [0,4194304] 0 2024-02-15T18:27:14.043 INFO:tasks.workunit.client.1.smithi133.stdout:9/569: write d0/d8/d9/f3b [1983199,93682] 0 2024-02-15T18:27:14.043 INFO:tasks.workunit.client.0.smithi084.stdout:1/964: dwrite d9/d54/f82 [0,4194304] 0 2024-02-15T18:27:14.044 INFO:tasks.workunit.client.0.smithi084.stdout:1/965: chown d9/d54/d7f/db7/dd9/d81/d94/db9/f107 187 1 2024-02-15T18:27:14.044 INFO:tasks.workunit.client.0.smithi084.stdout:7/996: mkdir df/d1d/d1a/d14b 0 2024-02-15T18:27:14.044 INFO:tasks.workunit.client.1.smithi133.stdout:3/732: mkdir d0/d15/d2f/d9b/d72/ded 0 2024-02-15T18:27:14.044 INFO:tasks.workunit.client.1.smithi133.stdout:7/526: dwrite d9/db/dc/d84/fa3 [0,4194304] 0 2024-02-15T18:27:14.045 INFO:tasks.workunit.client.0.smithi084.stdout:6/944: dwrite d14/d22/f116 [0,4194304] 0 2024-02-15T18:27:14.045 INFO:tasks.workunit.client.0.smithi084.stdout:7/997: read df/d1d/d1a/fc0 [2006999,83469] 0 2024-02-15T18:27:14.045 INFO:tasks.workunit.client.1.smithi133.stdout:8/578: getdents d3/d7/d52 0 2024-02-15T18:27:14.049 INFO:tasks.workunit.client.1.smithi133.stdout:4/454: rename d2/d48/d5c/c7a to d2/d5/d2b/d21/d2d/d44/d51/d55/d5e/c97 0 2024-02-15T18:27:14.049 INFO:tasks.workunit.client.1.smithi133.stdout:4/455: chown d2/d48/d5c/d93/d8d 52021 1 2024-02-15T18:27:14.049 INFO:tasks.workunit.client.1.smithi133.stdout:4/456: fdatasync d2/d5/d2b/d21/d2d/f56 0 2024-02-15T18:27:14.049 INFO:tasks.workunit.client.0.smithi084.stdout:3/856: dread d8/d40/d58/d80/d6b/f6c [0,4194304] 0 2024-02-15T18:27:14.051 INFO:tasks.workunit.client.1.smithi133.stdout:9/570: write d0/d8/d9/d12/d82/d42/d44/f7a [774972,19258] 0 2024-02-15T18:27:14.051 INFO:tasks.workunit.client.1.smithi133.stdout:3/733: creat d0/d15/d2f/d9b/d39/d3f/fee x:0 0 0 2024-02-15T18:27:14.051 INFO:tasks.workunit.client.1.smithi133.stdout:3/734: dread - d0/d15/d2f/d9b/d39/fd6 zero size 2024-02-15T18:27:14.055 INFO:tasks.workunit.client.0.smithi084.stdout:6/945: rmdir d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/d99 39 2024-02-15T18:27:14.056 INFO:tasks.workunit.client.1.smithi133.stdout:7/527: creat d9/db/d55/fb5 x:0 0 0 2024-02-15T18:27:14.056 INFO:tasks.workunit.client.1.smithi133.stdout:1/846: rename d6/d17/f3c to d6/d1e/d41/d7c/d7e/d7f/db6/ded/f13a 0 2024-02-15T18:27:14.057 INFO:tasks.workunit.client.1.smithi133.stdout:7/528: fsync d9/da/fa8 0 2024-02-15T18:27:14.057 INFO:tasks.workunit.client.1.smithi133.stdout:1/847: stat d6/d1e/c51 0 2024-02-15T18:27:14.057 INFO:tasks.workunit.client.1.smithi133.stdout:9/571: write d0/d8/d10/f30 [501256,20671] 0 2024-02-15T18:27:14.057 INFO:tasks.workunit.client.1.smithi133.stdout:1/848: truncate d6/f4b 859040 0 2024-02-15T18:27:14.058 INFO:tasks.workunit.client.1.smithi133.stdout:4/457: mkdir d2/d5/d2b/d21/d3b/d49/d98 0 2024-02-15T18:27:14.059 INFO:tasks.workunit.client.0.smithi084.stdout:6/946: truncate d14/d22/d25/d28/f48 1114690 0 2024-02-15T18:27:14.060 INFO:tasks.workunit.client.1.smithi133.stdout:3/735: creat d0/d15/d2f/d9b/d39/d3f/fef x:0 0 0 2024-02-15T18:27:14.061 INFO:tasks.workunit.client.0.smithi084.stdout:6/947: mknod d14/d22/d25/d2f/d31/d3f/d4a/c136 0 2024-02-15T18:27:14.063 INFO:tasks.workunit.client.0.smithi084.stdout:7/998: dread df/f35 [0,4194304] 0 2024-02-15T18:27:14.063 INFO:tasks.workunit.client.0.smithi084.stdout:7/999: fdatasync df/d1d/d1a/d6a/d8e/d79/f8c 0 2024-02-15T18:27:14.068 INFO:tasks.workunit.client.0.smithi084.stdout:1/966: dwrite d9/d54/d7f/db7/dd9/d81/d94/fde [0,4194304] 0 2024-02-15T18:27:14.071 INFO:tasks.workunit.client.0.smithi084.stdout:1/967: read d9/d54/d1b/d2c/d4b/d4c/d79/f2f [94832,28523] 0 2024-02-15T18:27:14.078 INFO:tasks.workunit.client.1.smithi133.stdout:1/849: getdents d6/d1e/d3a/d79 0 2024-02-15T18:27:14.079 INFO:tasks.workunit.client.1.smithi133.stdout:1/850: chown d6/d1e/d3a/d75/fb0 41831 1 2024-02-15T18:27:14.079 INFO:tasks.workunit.client.1.smithi133.stdout:9/572: creat d0/d8/d9/d12/fc0 x:0 0 0 2024-02-15T18:27:14.080 INFO:tasks.workunit.client.1.smithi133.stdout:7/529: dread d9/d36/d39/d98/fa1 [0,4194304] 0 2024-02-15T18:27:14.081 INFO:tasks.workunit.client.1.smithi133.stdout:6/932: rename d0/db/d29/d34/d5d/d40/l46 to d0/db/d29/d34/d5d/d40/dde/d78/d7f/l138 0 2024-02-15T18:27:14.082 INFO:tasks.workunit.client.1.smithi133.stdout:4/458: creat d2/d5/d2b/d21/f99 x:0 0 0 2024-02-15T18:27:14.085 INFO:tasks.workunit.client.1.smithi133.stdout:3/736: unlink d0/d15/d2f/d5e/db3/le4 0 2024-02-15T18:27:14.086 INFO:tasks.workunit.client.0.smithi084.stdout:1/968: dread d9/d54/d32/d5b/d69/fa3 [0,4194304] 0 2024-02-15T18:27:14.086 INFO:tasks.workunit.client.0.smithi084.stdout:1/969: fdatasync d9/d54/d32/df5/ff9 0 2024-02-15T18:27:14.088 INFO:tasks.workunit.client.1.smithi133.stdout:1/851: unlink d6/d1e/d41/d132/l138 0 2024-02-15T18:27:14.088 INFO:tasks.workunit.client.1.smithi133.stdout:1/852: truncate d6/f4b 1832756 0 2024-02-15T18:27:14.088 INFO:tasks.workunit.client.1.smithi133.stdout:1/853: chown d6/d1e/d3a/d82/d85/dc7/f11f 680677 1 2024-02-15T18:27:14.090 INFO:tasks.workunit.client.1.smithi133.stdout:7/530: symlink d9/db/d16/d4f/lb6 0 2024-02-15T18:27:14.090 INFO:tasks.workunit.client.1.smithi133.stdout:6/933: rmdir d0/db/d29/d34/d5d/d40/dde/d67/d9a/dc1 39 2024-02-15T18:27:14.090 INFO:tasks.workunit.client.1.smithi133.stdout:6/934: chown d0/db/d29/d34/d48/da1/fcf 15 1 2024-02-15T18:27:14.090 INFO:tasks.workunit.client.1.smithi133.stdout:7/531: write d9/db/dc/f28 [497386,55854] 0 2024-02-15T18:27:14.091 INFO:tasks.workunit.client.1.smithi133.stdout:3/737: mknod d0/d15/d2f/d9b/d72/dbf/dd9/cf0 0 2024-02-15T18:27:14.091 INFO:tasks.workunit.client.1.smithi133.stdout:3/738: fsync d0/d15/d2f/d9b/d39/d3f/dc1/fa7 0 2024-02-15T18:27:14.091 INFO:tasks.workunit.client.1.smithi133.stdout:3/739: write d0/d15/d2f/d9b/f43 [1163322,26800] 0 2024-02-15T18:27:14.091 INFO:tasks.workunit.client.1.smithi133.stdout:3/740: fdatasync d0/d15/d2f/d9b/d62/faf 0 2024-02-15T18:27:14.092 INFO:tasks.workunit.client.0.smithi084.stdout:1/970: creat d9/d54/d1b/d2c/d4b/d4c/d79/db2/f142 x:0 0 0 2024-02-15T18:27:14.092 INFO:tasks.workunit.client.0.smithi084.stdout:1/971: dread - d9/d54/fe7 zero size 2024-02-15T18:27:14.092 INFO:tasks.workunit.client.0.smithi084.stdout:6/948: dwrite fb [0,4194304] 0 2024-02-15T18:27:14.092 INFO:tasks.workunit.client.0.smithi084.stdout:6/949: read d14/d22/d25/de8/ffa [69834,15716] 0 2024-02-15T18:27:14.092 INFO:tasks.workunit.client.0.smithi084.stdout:1/972: dread d9/d54/d1b/d38/f83 [0,4194304] 0 2024-02-15T18:27:14.093 INFO:tasks.workunit.client.1.smithi133.stdout:7/532: mknod d9/db/d16/cb7 0 2024-02-15T18:27:14.093 INFO:tasks.workunit.client.1.smithi133.stdout:1/854: symlink d6/d1e/d41/d7c/d108/l13b 0 2024-02-15T18:27:14.094 INFO:tasks.workunit.client.1.smithi133.stdout:6/935: dread d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/f96 [0,4194304] 0 2024-02-15T18:27:14.095 INFO:tasks.workunit.client.0.smithi084.stdout:6/950: symlink d14/d22/d25/d2f/d31/d30/d4f/d7f/dc7/l137 0 2024-02-15T18:27:14.096 INFO:tasks.workunit.client.1.smithi133.stdout:3/741: dread d0/d15/d2f/dad/fd2 [0,4194304] 0 2024-02-15T18:27:14.096 INFO:tasks.workunit.client.1.smithi133.stdout:7/533: creat d9/db/dc/d84/fb8 x:0 0 0 2024-02-15T18:27:14.099 INFO:tasks.workunit.client.1.smithi133.stdout:1/855: creat d6/d1e/d3a/d82/f13c x:0 0 0 2024-02-15T18:27:14.099 INFO:tasks.workunit.client.1.smithi133.stdout:7/534: creat d9/da/d48/d62/d64/fb9 x:0 0 0 2024-02-15T18:27:14.099 INFO:tasks.workunit.client.1.smithi133.stdout:1/856: write d6/d1e/d3a/d82/d85/d67/dd3/fe2 [520981,53027] 0 2024-02-15T18:27:14.099 INFO:tasks.workunit.client.1.smithi133.stdout:7/535: creat d9/da/d48/d62/d64/fba x:0 0 0 2024-02-15T18:27:14.100 INFO:tasks.workunit.client.1.smithi133.stdout:7/536: creat d9/db/d55/fbb x:0 0 0 2024-02-15T18:27:14.100 INFO:tasks.workunit.client.1.smithi133.stdout:7/537: fsync d9/da/f3b 0 2024-02-15T18:27:14.102 INFO:tasks.workunit.client.0.smithi084.stdout:1/973: dread d9/d54/d7f/db7/dd9/f67 [0,4194304] 0 2024-02-15T18:27:14.104 INFO:tasks.workunit.client.0.smithi084.stdout:1/974: symlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/d133/l143 0 2024-02-15T18:27:14.107 INFO:tasks.workunit.client.0.smithi084.stdout:1/975: rename d9/d54/d1b/d2c/d4b/d4c/d79/d36/d4f/f59 to d9/d54/d76/f144 0 2024-02-15T18:27:14.107 INFO:tasks.workunit.client.0.smithi084.stdout:1/976: fsync d9/d54/d1b/f70 0 2024-02-15T18:27:14.108 INFO:tasks.workunit.client.0.smithi084.stdout:1/977: creat d9/d54/d32/d5b/d10d/f145 x:0 0 0 2024-02-15T18:27:14.108 INFO:tasks.workunit.client.0.smithi084.stdout:1/978: write d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/d133/f140 [4560956,20597] 0 2024-02-15T18:27:14.108 INFO:tasks.workunit.client.0.smithi084.stdout:6/951: dread d14/d22/d25/d2f/d31/dcf/fe0 [0,4194304] 0 2024-02-15T18:27:14.109 INFO:tasks.workunit.client.1.smithi133.stdout:7/538: dread d9/db/f3e [0,4194304] 0 2024-02-15T18:27:14.110 INFO:tasks.workunit.client.0.smithi084.stdout:1/979: truncate d9/d54/d32/df5/ff9 4011654 0 2024-02-15T18:27:14.110 INFO:tasks.workunit.client.0.smithi084.stdout:1/980: chown d9/d54/d32/d5b/d69 74259376 1 2024-02-15T18:27:14.112 INFO:tasks.workunit.client.0.smithi084.stdout:1/981: creat d9/d54/d7f/db7/f146 x:0 0 0 2024-02-15T18:27:14.113 INFO:tasks.workunit.client.0.smithi084.stdout:1/982: creat d9/d54/d1b/d38/d4d/d12e/f147 x:0 0 0 2024-02-15T18:27:14.114 INFO:tasks.workunit.client.1.smithi133.stdout:3/742: dread d0/d15/d37/f4b [0,4194304] 0 2024-02-15T18:27:14.114 INFO:tasks.workunit.client.1.smithi133.stdout:3/743: dread - d0/d15/d2f/d9b/d9d/fcb zero size 2024-02-15T18:27:14.114 INFO:tasks.workunit.client.0.smithi084.stdout:1/983: truncate d9/d54/d1b/d2c/d4b/d4c/da9/f111 173616 0 2024-02-15T18:27:14.115 INFO:tasks.workunit.client.1.smithi133.stdout:3/744: getdents d0/d15/d2f/d9b/d39/da2 0 2024-02-15T18:27:14.116 INFO:tasks.workunit.client.1.smithi133.stdout:3/745: getdents d0/d15/d2f/d9b/dc5 0 2024-02-15T18:27:14.117 INFO:tasks.workunit.client.0.smithi084.stdout:1/984: creat d9/d54/d1b/d2c/d4b/d4c/da9/d119/f148 x:0 0 0 2024-02-15T18:27:14.119 INFO:tasks.workunit.client.1.smithi133.stdout:3/746: rename d0/d15/d37/f90 to d0/d15/d37/d4a/de2/ff1 0 2024-02-15T18:27:14.119 INFO:tasks.workunit.client.1.smithi133.stdout:3/747: readlink d0/d15/d2f/d9b/d62/lb9 0 2024-02-15T18:27:14.121 INFO:tasks.workunit.client.0.smithi084.stdout:6/952: dread d14/d22/d25/d2f/d31/d3f/d4a/f4c [4194304,4194304] 0 2024-02-15T18:27:14.122 INFO:tasks.workunit.client.1.smithi133.stdout:3/748: unlink d0/d15/d2f/d9b/d39/d3f/dc1/d78/fca 0 2024-02-15T18:27:14.122 INFO:tasks.workunit.client.1.smithi133.stdout:4/459: dwrite d2/d5/d2b/d21/d2d/f56 [0,4194304] 0 2024-02-15T18:27:14.124 INFO:tasks.workunit.client.0.smithi084.stdout:6/953: write d14/f17 [4023196,79557] 0 2024-02-15T18:27:14.124 INFO:tasks.workunit.client.1.smithi133.stdout:3/749: mkdir d0/d15/d2f/db4/df2 0 2024-02-15T18:27:14.127 INFO:tasks.workunit.client.0.smithi084.stdout:6/954: mkdir d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d95/d138 0 2024-02-15T18:27:14.127 INFO:tasks.workunit.client.1.smithi133.stdout:3/750: symlink d0/d15/d54/da5/lf3 0 2024-02-15T18:27:14.127 INFO:tasks.workunit.client.1.smithi133.stdout:4/460: link d2/d5/d2b/d21/d3b/f66 d2/d48/d6a/f9a 0 2024-02-15T18:27:14.128 INFO:tasks.workunit.client.1.smithi133.stdout:4/461: write d2/d5/d2b/d21/f1c [6519629,63772] 0 2024-02-15T18:27:14.128 INFO:tasks.workunit.client.1.smithi133.stdout:4/462: write d2/d5/d2b/d21/d2d/d44/d51/d55/f27 [4954298,33542] 0 2024-02-15T18:27:14.128 INFO:tasks.workunit.client.1.smithi133.stdout:4/463: chown d2/d5/d2b/d21/d2d/d44/d51/d55 42734870 1 2024-02-15T18:27:14.128 INFO:tasks.workunit.client.1.smithi133.stdout:3/751: symlink d0/d15/d2f/d9b/lf4 0 2024-02-15T18:27:14.128 INFO:tasks.workunit.client.1.smithi133.stdout:3/752: chown d0/d15/d2f/d9b/d39/c87 112692864 1 2024-02-15T18:27:14.128 INFO:tasks.workunit.client.1.smithi133.stdout:9/573: dwrite d0/d8/f48 [0,4194304] 0 2024-02-15T18:27:14.130 INFO:tasks.workunit.client.1.smithi133.stdout:4/464: getdents d2/d5/d2b/d21/d2d/d44 0 2024-02-15T18:27:14.130 INFO:tasks.workunit.client.0.smithi084.stdout:1/985: dread d9/d54/d1b/d2c/f31 [0,4194304] 0 2024-02-15T18:27:14.131 INFO:tasks.workunit.client.1.smithi133.stdout:1/857: dwrite d6/d1e/d3a/d79/d8e/fd0 [0,4194304] 0 2024-02-15T18:27:14.131 INFO:tasks.workunit.client.1.smithi133.stdout:9/574: dread d0/d8/f56 [0,4194304] 0 2024-02-15T18:27:14.132 INFO:tasks.workunit.client.1.smithi133.stdout:6/936: dwrite d0/db/d29/d34/d5d/d40/dde/d78/fae [0,4194304] 0 2024-02-15T18:27:14.132 INFO:tasks.workunit.client.1.smithi133.stdout:1/858: dread d6/d1e/d41/d7c/d7e/f9a [0,4194304] 0 2024-02-15T18:27:14.133 INFO:tasks.workunit.client.1.smithi133.stdout:4/465: mknod d2/d5/d2b/d21/d2d/d4f/d87/c9b 0 2024-02-15T18:27:14.133 INFO:tasks.workunit.client.1.smithi133.stdout:3/753: creat d0/d15/d2f/db4/ff5 x:0 0 0 2024-02-15T18:27:14.133 INFO:tasks.workunit.client.1.smithi133.stdout:3/754: fdatasync d0/d15/d37/f86 0 2024-02-15T18:27:14.134 INFO:tasks.workunit.client.1.smithi133.stdout:7/539: dwrite d9/da/d48/d62/d64/fb9 [0,4194304] 0 2024-02-15T18:27:14.135 INFO:tasks.workunit.client.0.smithi084.stdout:6/955: write d14/d22/d25/d2f/d31/d3f/d4a/f98 [1934874,9147] 0 2024-02-15T18:27:14.135 INFO:tasks.workunit.client.0.smithi084.stdout:6/956: write d14/d22/d25/d2f/da9/d9b/f12a [626968,118457] 0 2024-02-15T18:27:14.137 INFO:tasks.workunit.client.1.smithi133.stdout:9/575: creat d0/fc1 x:0 0 0 2024-02-15T18:27:14.138 INFO:tasks.workunit.client.1.smithi133.stdout:1/859: mkdir d6/d1e/d3a/d97/dda/dff/d13d 0 2024-02-15T18:27:14.138 INFO:tasks.workunit.client.1.smithi133.stdout:9/576: dread - d0/d8/d9/d12/fab zero size 2024-02-15T18:27:14.141 INFO:tasks.workunit.client.1.smithi133.stdout:4/466: creat d2/d5/d2b/d21/d2d/d44/d51/f9c x:0 0 0 2024-02-15T18:27:14.141 INFO:tasks.workunit.client.1.smithi133.stdout:3/755: unlink d0/d15/d54/c6e 0 2024-02-15T18:27:14.142 INFO:tasks.workunit.client.0.smithi084.stdout:6/957: write d14/d22/d25/d2f/d31/d30/d4f/d7f/fb5 [2925624,120167] 0 2024-02-15T18:27:14.142 INFO:tasks.workunit.client.0.smithi084.stdout:6/958: write d14/d22/d25/d2f/d31/d3f/fdf [4987060,61787] 0 2024-02-15T18:27:14.145 INFO:tasks.workunit.client.1.smithi133.stdout:7/540: creat d9/da/d48/d5a/fbc x:0 0 0 2024-02-15T18:27:14.147 INFO:tasks.workunit.client.1.smithi133.stdout:3/756: symlink d0/d15/d2f/d9b/d39/lf6 0 2024-02-15T18:27:14.147 INFO:tasks.workunit.client.1.smithi133.stdout:7/541: creat d9/fbd x:0 0 0 2024-02-15T18:27:14.149 INFO:tasks.workunit.client.1.smithi133.stdout:7/542: creat d9/d5b/fbe x:0 0 0 2024-02-15T18:27:14.152 INFO:tasks.workunit.client.1.smithi133.stdout:7/543: symlink d9/d5b/lbf 0 2024-02-15T18:27:14.153 INFO:tasks.workunit.client.1.smithi133.stdout:7/544: chown d9/db/dc/cd 15600 1 2024-02-15T18:27:14.156 INFO:tasks.workunit.client.0.smithi084.stdout:1/986: write d9/d54/d7f/db7/dd9/d81/ded/dee/f139 [2571271,129655] 0 2024-02-15T18:27:14.156 INFO:tasks.workunit.client.1.smithi133.stdout:7/545: stat d9/db/d55/l65 0 2024-02-15T18:27:14.160 INFO:tasks.workunit.client.1.smithi133.stdout:7/546: mknod d9/db/d16/d5d/d68/cc0 0 2024-02-15T18:27:14.160 INFO:tasks.workunit.client.1.smithi133.stdout:7/547: truncate d9/da/d48/f7e 799011 0 2024-02-15T18:27:14.160 INFO:tasks.workunit.client.1.smithi133.stdout:7/548: chown d9/da/d48/d62/d64 3 1 2024-02-15T18:27:14.162 INFO:tasks.workunit.client.0.smithi084.stdout:6/959: rename d14/l59 to d14/d22/d25/l139 0 2024-02-15T18:27:14.163 INFO:tasks.workunit.client.0.smithi084.stdout:1/987: mknod d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/c149 0 2024-02-15T18:27:14.165 INFO:tasks.workunit.client.0.smithi084.stdout:6/960: unlink d14/d22/d25/d2f/d31/cad 0 2024-02-15T18:27:14.165 INFO:tasks.workunit.client.0.smithi084.stdout:6/961: readlink d14/d22/d25/d2f/d31/lff 0 2024-02-15T18:27:14.165 INFO:tasks.workunit.client.0.smithi084.stdout:6/962: fdatasync d14/d22/d25/d2f/d31/d30/d4f/df1/f102 0 2024-02-15T18:27:14.166 INFO:tasks.workunit.client.0.smithi084.stdout:6/963: creat d14/d22/d25/d2f/d31/d30/d4f/df1/f13a x:0 0 0 2024-02-15T18:27:14.167 INFO:tasks.workunit.client.0.smithi084.stdout:1/988: dread d9/d54/d7f/db7/dd9/d81/f6c [0,4194304] 0 2024-02-15T18:27:14.167 INFO:tasks.workunit.client.0.smithi084.stdout:1/989: chown d9/d54/d7f/db7 199633 1 2024-02-15T18:27:14.173 INFO:tasks.workunit.client.0.smithi084.stdout:1/990: unlink d9/d54/d1b/d2c/d35/f103 0 2024-02-15T18:27:14.173 INFO:tasks.workunit.client.0.smithi084.stdout:1/991: truncate d9/d54/d1b/d2c/d4b/d4c/da9/d119/f148 300886 0 2024-02-15T18:27:14.175 INFO:tasks.workunit.client.0.smithi084.stdout:1/992: mknod d9/d54/d32/d5b/d10d/c14a 0 2024-02-15T18:27:14.180 INFO:tasks.workunit.client.1.smithi133.stdout:6/937: dwrite d0/f50 [0,4194304] 0 2024-02-15T18:27:14.180 INFO:tasks.workunit.client.1.smithi133.stdout:6/938: readlink d0/l1 0 2024-02-15T18:27:14.184 INFO:tasks.workunit.client.0.smithi084.stdout:1/993: dread d9/d54/d1b/d2c/d4b/d4c/d79/d39/f47 [0,4194304] 0 2024-02-15T18:27:14.185 INFO:tasks.workunit.client.0.smithi084.stdout:1/994: truncate d9/d54/d1b/d2c/f11b 364325 0 2024-02-15T18:27:14.185 INFO:tasks.workunit.client.0.smithi084.stdout:1/995: symlink d9/d54/d7f/db7/dd9/l14b 0 2024-02-15T18:27:14.188 INFO:tasks.workunit.client.1.smithi133.stdout:4/467: dwrite d2/d5/d2b/d21/d2d/d44/d51/d60/f83 [0,4194304] 0 2024-02-15T18:27:14.188 INFO:tasks.workunit.client.1.smithi133.stdout:6/939: mkdir d0/db/d29/d34/d8c/da5/d139 0 2024-02-15T18:27:14.188 INFO:tasks.workunit.client.1.smithi133.stdout:1/860: dwrite d6/f4b [0,4194304] 0 2024-02-15T18:27:14.197 INFO:tasks.workunit.client.1.smithi133.stdout:3/757: dwrite d0/d15/d2f/d5e/f97 [0,4194304] 0 2024-02-15T18:27:14.200 INFO:tasks.workunit.client.1.smithi133.stdout:4/468: mknod d2/d5/d2b/c9d 0 2024-02-15T18:27:14.202 INFO:tasks.workunit.client.1.smithi133.stdout:3/758: link d0/d15/d37/d4a/fa6 d0/d15/d37/d4a/ff7 0 2024-02-15T18:27:14.203 INFO:tasks.workunit.client.0.smithi084.stdout:6/964: dwrite d14/d22/d25/d2f/d31/d3f/f74 [0,4194304] 0 2024-02-15T18:27:14.204 INFO:tasks.workunit.client.1.smithi133.stdout:7/549: dwrite d9/db/d16/f3a [0,4194304] 0 2024-02-15T18:27:14.205 INFO:tasks.workunit.client.1.smithi133.stdout:6/940: link d0/db/d21/c3e d0/d62/d66/d10a/c13a 0 2024-02-15T18:27:14.206 INFO:tasks.workunit.client.0.smithi084.stdout:6/965: creat d14/d22/d25/d2f/d31/d3f/d125/f13b x:0 0 0 2024-02-15T18:27:14.213 INFO:tasks.workunit.client.1.smithi133.stdout:6/941: unlink d0/db/f3f 0 2024-02-15T18:27:14.218 INFO:tasks.workunit.client.1.smithi133.stdout:6/942: write d0/db/d29/d34/d5d/d40/dde/f45 [7856071,81185] 0 2024-02-15T18:27:14.218 INFO:tasks.workunit.client.0.smithi084.stdout:1/996: dwrite d9/d54/d7f/db7/dd9/df7/d89/f96 [0,4194304] 0 2024-02-15T18:27:14.219 INFO:tasks.workunit.client.1.smithi133.stdout:6/943: creat d0/d62/f13b x:0 0 0 2024-02-15T18:27:14.220 INFO:tasks.workunit.client.1.smithi133.stdout:1/861: dwrite d6/d1e/f21 [0,4194304] 0 2024-02-15T18:27:14.225 INFO:tasks.workunit.client.1.smithi133.stdout:1/862: getdents d6/d1e/d41/d7c 0 2024-02-15T18:27:14.226 INFO:tasks.workunit.client.0.smithi084.stdout:1/997: unlink d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/fb8 0 2024-02-15T18:27:14.227 INFO:tasks.workunit.client.1.smithi133.stdout:1/863: creat d6/d1e/f13e x:0 0 0 2024-02-15T18:27:14.230 INFO:tasks.workunit.client.1.smithi133.stdout:3/759: dwrite d0/d15/d2f/d9b/d62/f71 [4194304,4194304] 0 2024-02-15T18:27:14.235 INFO:tasks.workunit.client.1.smithi133.stdout:3/760: dread d0/d15/d37/f88 [0,4194304] 0 2024-02-15T18:27:14.235 INFO:tasks.workunit.client.1.smithi133.stdout:4/469: dwrite d2/d5/d2b/d21/d3b/d49/f57 [0,4194304] 0 2024-02-15T18:27:14.256 INFO:tasks.workunit.client.0.smithi084.stdout:3/857: sync 2024-02-15T18:27:14.256 INFO:tasks.workunit.client.0.smithi084.stdout:3/858: fdatasync d8/d40/d43/d71/dcc/f114 0 2024-02-15T18:27:14.257 INFO:tasks.workunit.client.0.smithi084.stdout:3/859: creat d8/d40/d43/d71/d8c/d94/da3/d115/f128 x:0 0 0 2024-02-15T18:27:14.257 INFO:tasks.workunit.client.0.smithi084.stdout:3/860: chown d8/d40/d43/d71/d8c/c99 1565900 1 2024-02-15T18:27:14.268 INFO:tasks.workunit.client.1.smithi133.stdout:7/550: dwrite d9/db/f11 [0,4194304] 0 2024-02-15T18:27:14.269 INFO:tasks.workunit.client.1.smithi133.stdout:7/551: mkdir d9/d36/d31/dc1 0 2024-02-15T18:27:14.270 INFO:tasks.workunit.client.1.smithi133.stdout:1/864: dwrite d6/d1e/d41/d7c/d7e/d7f/fd5 [0,4194304] 0 2024-02-15T18:27:14.305 INFO:tasks.workunit.client.0.smithi084.stdout:1/998: dwrite d9/d54/d1b/d2c/d4b/d4c/d79/d36/da8/db3/db5/fd0 [0,4194304] 0 2024-02-15T18:27:14.307 INFO:tasks.workunit.client.0.smithi084.stdout:1/999: creat d9/d54/d1b/d2c/d35/f14c x:0 0 0 2024-02-15T18:27:14.310 INFO:tasks.workunit.client.0.smithi084.stdout:6/966: dwrite d14/d22/d25/d2f/d31/d3f/f104 [0,4194304] 0 2024-02-15T18:27:14.313 INFO:tasks.workunit.client.0.smithi084.stdout:6/967: rename d14/d22/d25/f84 to d14/d22/d25/d2f/d31/d30/d4f/d7f/de7/f13c 0 2024-02-15T18:27:14.313 INFO:tasks.workunit.client.0.smithi084.stdout:6/968: read - d14/d22/d25/d2f/d31/d30/d4f/fdb zero size 2024-02-15T18:27:14.314 INFO:tasks.workunit.client.1.smithi133.stdout:3/761: dwrite d0/d15/d2f/d9b/d62/faf [0,4194304] 0 2024-02-15T18:27:14.315 INFO:tasks.workunit.client.1.smithi133.stdout:6/944: dwrite d0/f10 [0,4194304] 0 2024-02-15T18:27:14.321 INFO:tasks.workunit.client.0.smithi084.stdout:3/861: dwrite d8/d40/d43/d71/d8c/d94/da3/dba/fdb [0,4194304] 0 2024-02-15T18:27:14.321 INFO:tasks.workunit.client.1.smithi133.stdout:7/552: dwrite d9/db/d55/fa0 [0,4194304] 0 2024-02-15T18:27:14.321 INFO:tasks.workunit.client.1.smithi133.stdout:1/865: dwrite d6/f16 [4194304,4194304] 0 2024-02-15T18:27:14.321 INFO:tasks.workunit.client.1.smithi133.stdout:6/945: creat d0/db/d29/d34/d5d/d40/dde/d67/d9a/d126/f13c x:0 0 0 2024-02-15T18:27:14.325 INFO:tasks.workunit.client.1.smithi133.stdout:1/866: creat d6/d1e/d3a/d82/f13f x:0 0 0 2024-02-15T18:27:14.326 INFO:tasks.workunit.client.0.smithi084.stdout:3/862: mknod d8/d40/d43/d71/c129 0 2024-02-15T18:27:14.327 INFO:tasks.workunit.client.1.smithi133.stdout:1/867: creat d6/d2a/df1/f140 x:0 0 0 2024-02-15T18:27:14.329 INFO:tasks.workunit.client.1.smithi133.stdout:1/868: truncate d6/d1e/d3a/d82/d85/f83 2219168 0 2024-02-15T18:27:14.353 INFO:tasks.workunit.client.0.smithi084.stdout:6/969: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/dd3/f10b [0,4194304] 0 2024-02-15T18:27:14.355 INFO:tasks.workunit.client.0.smithi084.stdout:6/970: mkdir d14/d22/d25/d2f/d31/d30/d45/d52/d13d 0 2024-02-15T18:27:14.355 INFO:tasks.workunit.client.1.smithi133.stdout:3/762: dwrite d0/d15/d2f/d9b/d39/d3f/dc1/fa7 [0,4194304] 0 2024-02-15T18:27:14.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/763: write d0/d15/d54/ddc/fc0 [380278,87124] 0 2024-02-15T18:27:14.359 INFO:tasks.workunit.client.1.smithi133.stdout:6/946: dwrite d0/db/d29/d34/d5d/dc9/fe9 [0,4194304] 0 2024-02-15T18:27:14.359 INFO:tasks.workunit.client.1.smithi133.stdout:6/947: chown d0/db/d29/d34/d5d/d40/dde/d67/l9b 10 1 2024-02-15T18:27:14.359 INFO:tasks.workunit.client.1.smithi133.stdout:3/764: link d0/d15/d2f/d9b/d39/dcd/de0/le9 d0/d15/d2f/d9b/d72/ded/lf8 0 2024-02-15T18:27:14.359 INFO:tasks.workunit.client.1.smithi133.stdout:7/553: dwrite d9/db/d16/d5d/d68/f70 [0,4194304] 0 2024-02-15T18:27:14.359 INFO:tasks.workunit.client.1.smithi133.stdout:7/554: chown d9/db/dc/d84/lb2 26 1 2024-02-15T18:27:14.360 INFO:tasks.workunit.client.0.smithi084.stdout:3/863: dwrite d8/d1f/dbf/f26 [4194304,4194304] 0 2024-02-15T18:27:14.361 INFO:tasks.workunit.client.1.smithi133.stdout:7/555: symlink d9/da/d48/d62/lc2 0 2024-02-15T18:27:14.361 INFO:tasks.workunit.client.1.smithi133.stdout:7/556: chown d9/db/f1f 20 1 2024-02-15T18:27:14.361 INFO:tasks.workunit.client.1.smithi133.stdout:7/557: chown d9/fbd 131131833 1 2024-02-15T18:27:14.362 INFO:tasks.workunit.client.1.smithi133.stdout:3/765: write d0/d15/d2f/f68 [263564,96821] 0 2024-02-15T18:27:14.363 INFO:tasks.workunit.client.0.smithi084.stdout:3/864: write d8/d1f/d25/f9a [2555744,43804] 0 2024-02-15T18:27:14.365 INFO:tasks.workunit.client.0.smithi084.stdout:3/865: symlink d8/d40/d43/d71/d8c/d94/da3/dba/df5/l12a 0 2024-02-15T18:27:14.365 INFO:tasks.workunit.client.0.smithi084.stdout:3/866: fsync d8/f1d 0 2024-02-15T18:27:14.365 INFO:tasks.workunit.client.0.smithi084.stdout:3/867: stat d8/d40/d43/d71/d8c/d94/da3/de5/fef 0 2024-02-15T18:27:14.366 INFO:tasks.workunit.client.1.smithi133.stdout:6/948: dread d0/fd7 [0,4194304] 0 2024-02-15T18:27:14.366 INFO:tasks.workunit.client.1.smithi133.stdout:3/766: creat d0/d15/d2f/db4/d89/ff9 x:0 0 0 2024-02-15T18:27:14.367 INFO:tasks.workunit.client.1.smithi133.stdout:7/558: dread d9/db/f2d [0,4194304] 0 2024-02-15T18:27:14.369 INFO:tasks.workunit.client.1.smithi133.stdout:6/949: rename d0/db/d29/d34/d8c/da5/c11f to d0/d62/d66/d10a/c13d 0 2024-02-15T18:27:14.369 INFO:tasks.workunit.client.1.smithi133.stdout:6/950: readlink d0/db/d29/d34/d5d/d40/dde/d52/lcc 0 2024-02-15T18:27:14.369 INFO:tasks.workunit.client.0.smithi084.stdout:3/868: read d8/d40/d58/d80/d6b/ffc [4442646,69797] 0 2024-02-15T18:27:14.370 INFO:tasks.workunit.client.0.smithi084.stdout:3/869: getdents d8/d40/d58/d80/d6b 0 2024-02-15T18:27:14.371 INFO:tasks.workunit.client.0.smithi084.stdout:3/870: readlink d8/d1f/d25/l65 0 2024-02-15T18:27:14.371 INFO:tasks.workunit.client.0.smithi084.stdout:3/871: chown d8/d40/d43/d71/d8c/d94/da3/d115 4 1 2024-02-15T18:27:14.372 INFO:tasks.workunit.client.0.smithi084.stdout:3/872: mkdir d8/d1f/d25/d12b 0 2024-02-15T18:27:14.372 INFO:tasks.workunit.client.0.smithi084.stdout:3/873: fdatasync d8/d40/d58/f5e 0 2024-02-15T18:27:14.372 INFO:tasks.workunit.client.1.smithi133.stdout:3/767: creat d0/d15/d2f/d9b/d72/dbf/dd9/ffa x:0 0 0 2024-02-15T18:27:14.373 INFO:tasks.workunit.client.1.smithi133.stdout:7/559: symlink d9/db/d16/d5d/d68/d73/lc3 0 2024-02-15T18:27:14.373 INFO:tasks.workunit.client.1.smithi133.stdout:7/560: chown d9/d36/d31/c3f 10478 1 2024-02-15T18:27:14.374 INFO:tasks.workunit.client.0.smithi084.stdout:3/874: creat d8/d1f/dbf/f12c x:0 0 0 2024-02-15T18:27:14.374 INFO:tasks.workunit.client.0.smithi084.stdout:3/875: write d8/d40/d43/d71/d8c/f103 [2164436,84015] 0 2024-02-15T18:27:14.374 INFO:tasks.workunit.client.0.smithi084.stdout:3/876: chown d8/d40/d58/d80/d6b/fc0 102 1 2024-02-15T18:27:14.375 INFO:tasks.workunit.client.1.smithi133.stdout:6/951: creat d0/db/d29/d34/d8c/f13e x:0 0 0 2024-02-15T18:27:14.375 INFO:tasks.workunit.client.1.smithi133.stdout:6/952: readlink d0/db/d29/d34/d5d/d40/dde/d67/d9a/dc1/l114 0 2024-02-15T18:27:14.375 INFO:tasks.workunit.client.1.smithi133.stdout:6/953: truncate d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/f117 996090 0 2024-02-15T18:27:14.375 INFO:tasks.workunit.client.1.smithi133.stdout:3/768: mknod d0/d15/d2f/d5e/cfb 0 2024-02-15T18:27:14.376 INFO:tasks.workunit.client.1.smithi133.stdout:7/561: creat d9/db/d55/d63/fc4 x:0 0 0 2024-02-15T18:27:14.376 INFO:tasks.workunit.client.0.smithi084.stdout:3/877: creat d8/d1f/dbf/db6/d10c/f12d x:0 0 0 2024-02-15T18:27:14.376 INFO:tasks.workunit.client.0.smithi084.stdout:3/878: chown d8/d40/d58/led 44597988 1 2024-02-15T18:27:14.377 INFO:tasks.workunit.client.0.smithi084.stdout:3/879: symlink d8/d40/d43/d71/d8c/d94/da3/l12e 0 2024-02-15T18:27:14.377 INFO:tasks.workunit.client.1.smithi133.stdout:7/562: dread d9/db/d16/f53 [0,4194304] 0 2024-02-15T18:27:14.377 INFO:tasks.workunit.client.0.smithi084.stdout:3/880: mkdir d8/d40/d43/d71/d8c/d94/d12f 0 2024-02-15T18:27:14.377 INFO:tasks.workunit.client.0.smithi084.stdout:6/971: dwrite d14/d22/d25/d2f/d31/d3f/f104 [0,4194304] 0 2024-02-15T18:27:14.378 INFO:tasks.workunit.client.1.smithi133.stdout:6/954: rename d0/db/db6 to d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/d11d/d12a/d13f 0 2024-02-15T18:27:14.378 INFO:tasks.workunit.client.1.smithi133.stdout:6/955: chown d0/db/d29/d34/d5d/d40/dde/d67/d9a/fc8 29113 1 2024-02-15T18:27:14.378 INFO:tasks.workunit.client.1.smithi133.stdout:6/956: chown d0/db/d29/d34/d5d/d40/dde/ca9 30 1 2024-02-15T18:27:14.379 INFO:tasks.workunit.client.0.smithi084.stdout:6/972: creat d14/d22/d25/d2f/d31/d30/d45/d52/dd3/f13e x:0 0 0 2024-02-15T18:27:14.380 INFO:tasks.workunit.client.1.smithi133.stdout:3/769: mknod d0/d15/d2f/d9b/dec/cfc 0 2024-02-15T18:27:14.380 INFO:tasks.workunit.client.1.smithi133.stdout:6/957: rename d0/db/d29/d34/d5d/d40/dde/d52/f104 to d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/f140 0 2024-02-15T18:27:14.380 INFO:tasks.workunit.client.0.smithi084.stdout:3/881: write d8/d1f/d25/f7f [3534236,4257] 0 2024-02-15T18:27:14.380 INFO:tasks.workunit.client.0.smithi084.stdout:3/882: fdatasync d8/d73/d93/fe7 0 2024-02-15T18:27:14.381 INFO:tasks.workunit.client.0.smithi084.stdout:6/973: unlink d14/d22/d25/d2f/d31/d3f/d4a/f8d 0 2024-02-15T18:27:14.381 INFO:tasks.workunit.client.1.smithi133.stdout:3/770: link d0/d15/d2f/d9b/d72/dbf/dd9/cf0 d0/d15/d2f/d9b/d39/dcd/de0/cfd 0 2024-02-15T18:27:14.382 INFO:tasks.workunit.client.0.smithi084.stdout:6/974: creat d14/d22/d25/d28/d11c/d111/f13f x:0 0 0 2024-02-15T18:27:14.383 INFO:tasks.workunit.client.1.smithi133.stdout:6/958: symlink d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/d11d/d12a/d13f/l141 0 2024-02-15T18:27:14.385 INFO:tasks.workunit.client.0.smithi084.stdout:6/975: rename d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/f7d to d14/d22/d25/d2f/d31/d30/d45/d52/f140 0 2024-02-15T18:27:14.385 INFO:tasks.workunit.client.0.smithi084.stdout:6/976: stat d14/d22/d25/d2f/d31/d30/d4f/df1/f13a 0 2024-02-15T18:27:14.385 INFO:tasks.workunit.client.0.smithi084.stdout:6/977: write d14/d22/d25/d2f/da9/d9b/f12a [1108722,26384] 0 2024-02-15T18:27:14.386 INFO:tasks.workunit.client.0.smithi084.stdout:3/883: write d8/d40/d58/d80/f2b [2145947,11461] 0 2024-02-15T18:27:14.386 INFO:tasks.workunit.client.1.smithi133.stdout:3/771: mknod d0/d15/d54/da5/cfe 0 2024-02-15T18:27:14.387 INFO:tasks.workunit.client.0.smithi084.stdout:3/884: read d8/d40/d43/d71/dd9/feb [197736,86683] 0 2024-02-15T18:27:14.389 INFO:tasks.workunit.client.1.smithi133.stdout:6/959: rmdir d0/d5/de2 39 2024-02-15T18:27:14.389 INFO:tasks.workunit.client.1.smithi133.stdout:3/772: getdents d0/d15/d37/d4a/de2 0 2024-02-15T18:27:14.389 INFO:tasks.workunit.client.1.smithi133.stdout:3/773: getdents d0/d15/d2f/d9b/d39/da2 0 2024-02-15T18:27:14.391 INFO:tasks.workunit.client.1.smithi133.stdout:3/774: rename d0/d15/d2f/d5e/db3 to d0/d15/d2f/d5e/dff 0 2024-02-15T18:27:14.391 INFO:tasks.workunit.client.1.smithi133.stdout:3/775: mkdir d0/d15/d37/d95/d100 0 2024-02-15T18:27:14.413 INFO:tasks.workunit.client.0.smithi084.stdout:6/978: truncate d14/d22/d25/d2f/da9/d9b/f12a 99881 0 2024-02-15T18:27:14.413 INFO:tasks.workunit.client.0.smithi084.stdout:6/979: write d14/d22/d25/d28/f48 [2002733,116098] 0 2024-02-15T18:27:14.413 INFO:tasks.workunit.client.0.smithi084.stdout:6/980: fsync d14/d22/d25/d2f/d31/d30/d45/d52/fb3 0 2024-02-15T18:27:14.415 INFO:tasks.workunit.client.1.smithi133.stdout:7/563: dwrite d9/db/d16/d5d/d68/f70 [0,4194304] 0 2024-02-15T18:27:14.415 INFO:tasks.workunit.client.1.smithi133.stdout:7/564: getdents d9/d36/d31/dc1 0 2024-02-15T18:27:14.415 INFO:tasks.workunit.client.1.smithi133.stdout:7/565: chown d9/db/d55/fa0 1025674 1 2024-02-15T18:27:14.415 INFO:tasks.workunit.client.1.smithi133.stdout:7/566: dread - d9/d36/f37 zero size 2024-02-15T18:27:14.417 INFO:tasks.workunit.client.1.smithi133.stdout:7/567: creat d9/db/d55/fc5 x:0 0 0 2024-02-15T18:27:14.417 INFO:tasks.workunit.client.1.smithi133.stdout:7/568: fsync d9/db/d16/f4b 0 2024-02-15T18:27:14.417 INFO:tasks.workunit.client.1.smithi133.stdout:3/776: dwrite d0/d15/d2f/d9b/d39/d3f/fef [0,4194304] 0 2024-02-15T18:27:14.417 INFO:tasks.workunit.client.0.smithi084.stdout:3/885: dwrite d8/d1f/d25/f68 [0,4194304] 0 2024-02-15T18:27:14.421 INFO:tasks.workunit.client.0.smithi084.stdout:3/886: unlink d8/d40/lf6 0 2024-02-15T18:27:14.421 INFO:tasks.workunit.client.0.smithi084.stdout:3/887: fsync d8/d40/d58/d80/d6b/fc0 0 2024-02-15T18:27:14.421 INFO:tasks.workunit.client.0.smithi084.stdout:3/888: mknod d8/d40/d43/d71/d8c/d94/da3/d115/c130 0 2024-02-15T18:27:14.436 INFO:tasks.workunit.client.1.smithi133.stdout:0/762: sync 2024-02-15T18:27:14.437 INFO:tasks.workunit.client.1.smithi133.stdout:2/686: sync 2024-02-15T18:27:14.437 INFO:tasks.workunit.client.1.smithi133.stdout:9/577: sync 2024-02-15T18:27:14.437 INFO:tasks.workunit.client.1.smithi133.stdout:8/579: sync 2024-02-15T18:27:14.437 INFO:tasks.workunit.client.1.smithi133.stdout:9/578: readlink d0/d8/d9/le 0 2024-02-15T18:27:14.437 INFO:tasks.workunit.client.1.smithi133.stdout:5/549: sync 2024-02-15T18:27:14.438 INFO:tasks.workunit.client.1.smithi133.stdout:0/763: creat d9/d10/d47/d5e/de6/ffd x:0 0 0 2024-02-15T18:27:14.439 INFO:tasks.workunit.client.1.smithi133.stdout:2/687: creat d7/d18/d32/d65/d54/fdd x:0 0 0 2024-02-15T18:27:14.439 INFO:tasks.workunit.client.1.smithi133.stdout:2/688: fdatasync d7/d2c/d3b/d48/d59/f61 0 2024-02-15T18:27:14.439 INFO:tasks.workunit.client.1.smithi133.stdout:8/580: truncate d3/f3a 4030770 0 2024-02-15T18:27:14.440 INFO:tasks.workunit.client.1.smithi133.stdout:9/579: creat d0/d8/d10/d4d/fc2 x:0 0 0 2024-02-15T18:27:14.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/580: truncate d0/d8/d9/d12/fab 806711 0 2024-02-15T18:27:14.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/581: fdatasync d0/d8/d9/d12/d82/f40 0 2024-02-15T18:27:14.441 INFO:tasks.workunit.client.1.smithi133.stdout:5/550: dread d17/d20/f22 [0,4194304] 0 2024-02-15T18:27:14.441 INFO:tasks.workunit.client.1.smithi133.stdout:8/581: symlink d3/d1c/d2f/lbe 0 2024-02-15T18:27:14.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/582: mknod d0/d8/d9/d49/d4c/cc3 0 2024-02-15T18:27:14.443 INFO:tasks.workunit.client.1.smithi133.stdout:5/551: creat d17/d2a/fb2 x:0 0 0 2024-02-15T18:27:14.443 INFO:tasks.workunit.client.1.smithi133.stdout:2/689: read d7/d2c/f68 [205043,102609] 0 2024-02-15T18:27:14.443 INFO:tasks.workunit.client.1.smithi133.stdout:0/764: dread d9/d10/d19/d29/d67/d68/d96/d44/fcd [4194304,4194304] 0 2024-02-15T18:27:14.443 INFO:tasks.workunit.client.1.smithi133.stdout:2/690: readlink d7/d18/d32/d65/l4e 0 2024-02-15T18:27:14.445 INFO:tasks.workunit.client.1.smithi133.stdout:5/552: unlink d17/d20/d32/d38/d70/f7c 0 2024-02-15T18:27:14.447 INFO:tasks.workunit.client.1.smithi133.stdout:0/765: truncate d9/d2b/f60 40662 0 2024-02-15T18:27:14.447 INFO:tasks.workunit.client.1.smithi133.stdout:0/766: readlink d9/d10/d19/d8c/lbd 0 2024-02-15T18:27:14.447 INFO:tasks.workunit.client.1.smithi133.stdout:0/767: write d9/d10/d22/d32/f74 [2070409,78249] 0 2024-02-15T18:27:14.448 INFO:tasks.workunit.client.0.smithi084.stdout:6/981: dwrite d14/d22/d25/d28/d11c/ff0 [0,4194304] 0 2024-02-15T18:27:14.448 INFO:tasks.workunit.client.0.smithi084.stdout:6/982: fsync d14/d22/d25/d28/f2a 0 2024-02-15T18:27:14.448 INFO:tasks.workunit.client.0.smithi084.stdout:6/983: write d14/d22/d25/d2f/fd7 [8493523,32886] 0 2024-02-15T18:27:14.448 INFO:tasks.workunit.client.0.smithi084.stdout:3/889: fdatasync d8/d1f/d25/f9a 0 2024-02-15T18:27:14.449 INFO:tasks.workunit.client.1.smithi133.stdout:7/569: dwrite d9/da/d48/f81 [0,4194304] 0 2024-02-15T18:27:14.449 INFO:tasks.workunit.client.1.smithi133.stdout:5/553: symlink d17/d20/d4f/d5f/d93/lb3 0 2024-02-15T18:27:14.449 INFO:tasks.workunit.client.1.smithi133.stdout:5/554: dread - d17/d20/d4f/d90/f9f zero size 2024-02-15T18:27:14.450 INFO:tasks.workunit.client.1.smithi133.stdout:9/583: dread d0/d8/d9/d12/d82/d42/d44/fa2 [0,4194304] 0 2024-02-15T18:27:14.450 INFO:tasks.workunit.client.1.smithi133.stdout:0/768: symlink d9/d28/dd6/lfe 0 2024-02-15T18:27:14.451 INFO:tasks.workunit.client.1.smithi133.stdout:0/769: write d9/d10/d19/d8c/ff0 [593186,66910] 0 2024-02-15T18:27:14.452 INFO:tasks.workunit.client.1.smithi133.stdout:7/570: dread d9/db/f3e [0,4194304] 0 2024-02-15T18:27:14.454 INFO:tasks.workunit.client.0.smithi084.stdout:3/890: unlink d8/d73/db9/dca/d107/l10a 0 2024-02-15T18:27:14.454 INFO:tasks.workunit.client.0.smithi084.stdout:3/891: dread - d8/d40/d58/d80/d6b/ff2 zero size 2024-02-15T18:27:14.455 INFO:tasks.workunit.client.0.smithi084.stdout:6/984: write d14/d22/d25/d28/f2a [8270991,25889] 0 2024-02-15T18:27:14.456 INFO:tasks.workunit.client.0.smithi084.stdout:3/892: symlink d8/d40/l131 0 2024-02-15T18:27:14.456 INFO:tasks.workunit.client.0.smithi084.stdout:3/893: truncate d8/d40/d43/f112 509405 0 2024-02-15T18:27:14.458 INFO:tasks.workunit.client.0.smithi084.stdout:6/985: creat d14/d22/d25/d2f/d31/d3f/d4a/f141 x:0 0 0 2024-02-15T18:27:14.458 INFO:tasks.workunit.client.1.smithi133.stdout:5/555: mknod d17/d20/d32/d7d/d7e/cb4 0 2024-02-15T18:27:14.460 INFO:tasks.workunit.client.1.smithi133.stdout:9/584: rename d0/d8/d9/d3c/c71 to d0/d8/d10/daa/cc4 0 2024-02-15T18:27:14.462 INFO:tasks.workunit.client.1.smithi133.stdout:7/571: mkdir d9/d36/d3d/d4c/d97/da9/dc6 0 2024-02-15T18:27:14.462 INFO:tasks.workunit.client.1.smithi133.stdout:7/572: truncate d9/d36/d3d/d4c/f61 4813241 0 2024-02-15T18:27:14.463 INFO:tasks.workunit.client.1.smithi133.stdout:7/573: creat d9/da/d48/d5a/fc7 x:0 0 0 2024-02-15T18:27:14.463 INFO:tasks.workunit.client.1.smithi133.stdout:7/574: fdatasync d9/db/f2d 0 2024-02-15T18:27:14.466 INFO:tasks.workunit.client.1.smithi133.stdout:7/575: rename c8 to d9/d36/d3d/d4c/d97/da9/dc6/cc8 0 2024-02-15T18:27:14.470 INFO:tasks.workunit.client.1.smithi133.stdout:7/576: creat d9/da/d48/d62/d64/fc9 x:0 0 0 2024-02-15T18:27:14.473 INFO:tasks.workunit.client.1.smithi133.stdout:9/585: write d0/d8/d9/d12/d82/f40 [4092949,6539] 0 2024-02-15T18:27:14.475 INFO:tasks.workunit.client.1.smithi133.stdout:7/577: symlink d9/d5b/lca 0 2024-02-15T18:27:14.475 INFO:tasks.workunit.client.1.smithi133.stdout:7/578: dread - d9/fbd zero size 2024-02-15T18:27:14.476 INFO:tasks.workunit.client.1.smithi133.stdout:7/579: symlink d9/db/lcb 0 2024-02-15T18:27:14.484 INFO:tasks.workunit.client.1.smithi133.stdout:0/770: dwrite d9/d28/fd0 [4194304,4194304] 0 2024-02-15T18:27:14.484 INFO:tasks.workunit.client.1.smithi133.stdout:7/580: dread d9/db/f2d [0,4194304] 0 2024-02-15T18:27:14.486 INFO:tasks.workunit.client.1.smithi133.stdout:0/771: creat d9/d10/d19/d29/d67/d68/fff x:0 0 0 2024-02-15T18:27:14.487 INFO:tasks.workunit.client.1.smithi133.stdout:7/581: mknod d9/db/d16/d5d/ccc 0 2024-02-15T18:27:14.487 INFO:tasks.workunit.client.1.smithi133.stdout:7/582: stat d9/db/dc/cd 0 2024-02-15T18:27:14.488 INFO:tasks.workunit.client.1.smithi133.stdout:0/772: mkdir d9/d100 0 2024-02-15T18:27:14.488 INFO:tasks.workunit.client.1.smithi133.stdout:7/583: mkdir d9/d36/d31/dc1/dcd 0 2024-02-15T18:27:14.489 INFO:tasks.workunit.client.1.smithi133.stdout:7/584: unlink d9/da/d48/d62/d64/l6c 0 2024-02-15T18:27:14.491 INFO:tasks.workunit.client.1.smithi133.stdout:2/691: dwrite d7/d2c/d31/fbf [0,4194304] 0 2024-02-15T18:27:14.492 INFO:tasks.workunit.client.0.smithi084.stdout:6/986: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/dd5/f10f [0,4194304] 0 2024-02-15T18:27:14.496 INFO:tasks.workunit.client.0.smithi084.stdout:6/987: creat d14/d22/d25/d2f/d31/d3f/d125/f142 x:0 0 0 2024-02-15T18:27:14.497 INFO:tasks.workunit.client.1.smithi133.stdout:4/470: sync 2024-02-15T18:27:14.499 INFO:tasks.workunit.client.1.smithi133.stdout:4/471: mkdir d2/d48/d6a/d9e 0 2024-02-15T18:27:14.502 INFO:tasks.workunit.client.0.smithi084.stdout:6/988: rename d14/d22/d25/d2f/d31/c33 to d14/d22/d25/d2f/d31/d3f/d4a/c143 0 2024-02-15T18:27:14.502 INFO:tasks.workunit.client.0.smithi084.stdout:3/894: dwrite d8/d40/d43/d71/fb5 [4194304,4194304] 0 2024-02-15T18:27:14.503 INFO:tasks.workunit.client.0.smithi084.stdout:6/989: creat d14/d22/dde/f144 x:0 0 0 2024-02-15T18:27:14.504 INFO:tasks.workunit.client.0.smithi084.stdout:3/895: truncate d8/d40/d43/d71/d8c/d94/da3/de5/fe6 617188 0 2024-02-15T18:27:14.505 INFO:tasks.workunit.client.0.smithi084.stdout:6/990: dread d14/d22/d25/d2f/d31/d30/d45/d52/f140 [0,4194304] 0 2024-02-15T18:27:14.505 INFO:tasks.workunit.client.0.smithi084.stdout:6/991: chown d14/d22/d25/d2f/da9/l130 213584158 1 2024-02-15T18:27:14.505 INFO:tasks.workunit.client.0.smithi084.stdout:3/896: truncate d8/d40/d58/d80/f3c 2096039 0 2024-02-15T18:27:14.507 INFO:tasks.workunit.client.0.smithi084.stdout:3/897: symlink d8/d1f/dbf/db6/l132 0 2024-02-15T18:27:14.507 INFO:tasks.workunit.client.0.smithi084.stdout:3/898: chown d8/d40/d58/l104 5 1 2024-02-15T18:27:14.508 INFO:tasks.workunit.client.1.smithi133.stdout:2/692: dread d7/d2c/d3b/d48/d6d/fd6 [0,4194304] 0 2024-02-15T18:27:14.509 INFO:tasks.workunit.client.0.smithi084.stdout:3/899: rename d8/d1f/d2d/c41 to d8/d40/c133 0 2024-02-15T18:27:14.510 INFO:tasks.workunit.client.1.smithi133.stdout:2/693: mkdir d7/d18/d32/d65/d54/dde 0 2024-02-15T18:27:14.512 INFO:tasks.workunit.client.0.smithi084.stdout:3/900: creat d8/d40/d58/f134 x:0 0 0 2024-02-15T18:27:14.515 INFO:tasks.workunit.client.0.smithi084.stdout:3/901: truncate d8/d40/d43/d71/d8c/d94/da3/dba/fdb 2830003 0 2024-02-15T18:27:14.515 INFO:tasks.workunit.client.1.smithi133.stdout:4/472: dread d2/d5/d2b/d21/d3b/d49/f69 [0,4194304] 0 2024-02-15T18:27:14.516 INFO:tasks.workunit.client.1.smithi133.stdout:4/473: write d2/f29 [564052,81536] 0 2024-02-15T18:27:14.516 INFO:tasks.workunit.client.1.smithi133.stdout:4/474: chown d2/d5/d2b/d21/d2d/f3c 0 1 2024-02-15T18:27:14.516 INFO:tasks.workunit.client.1.smithi133.stdout:4/475: chown d2/d5/c61 218 1 2024-02-15T18:27:14.518 INFO:tasks.workunit.client.1.smithi133.stdout:5/556: dwrite d17/d26/f52 [0,4194304] 0 2024-02-15T18:27:14.525 INFO:tasks.workunit.client.1.smithi133.stdout:0/773: dwrite d9/d10/d47/f87 [0,4194304] 0 2024-02-15T18:27:14.528 INFO:tasks.workunit.client.1.smithi133.stdout:7/585: dwrite d9/d36/d39/f52 [0,4194304] 0 2024-02-15T18:27:14.529 INFO:tasks.workunit.client.1.smithi133.stdout:0/774: creat d9/d10/d19/d29/d67/d68/d9c/f101 x:0 0 0 2024-02-15T18:27:14.529 INFO:tasks.workunit.client.1.smithi133.stdout:0/775: stat d9/d10/d19/d1a/fed 0 2024-02-15T18:27:14.534 INFO:tasks.workunit.client.1.smithi133.stdout:4/476: dread d2/d5/d2b/f1a [0,4194304] 0 2024-02-15T18:27:14.535 INFO:tasks.workunit.client.1.smithi133.stdout:4/477: mkdir d2/d48/d5c/d9f 0 2024-02-15T18:27:14.535 INFO:tasks.workunit.client.1.smithi133.stdout:4/478: chown d2/d48/d5c/l8a 31309710 1 2024-02-15T18:27:14.537 INFO:tasks.workunit.client.1.smithi133.stdout:4/479: creat d2/d5/fa0 x:0 0 0 2024-02-15T18:27:14.539 INFO:tasks.workunit.client.1.smithi133.stdout:4/480: rename d2/f1f to d2/d5/d2b/d21/fa1 0 2024-02-15T18:27:14.542 INFO:tasks.workunit.client.1.smithi133.stdout:4/481: write d2/d5/d2b/d21/d2d/d44/d51/d55/f27 [1353375,28357] 0 2024-02-15T18:27:14.542 INFO:tasks.workunit.client.1.smithi133.stdout:4/482: dread - d2/d48/f8e zero size 2024-02-15T18:27:14.566 INFO:tasks.workunit.client.1.smithi133.stdout:5/557: dwrite d17/d26/f52 [0,4194304] 0 2024-02-15T18:27:14.566 INFO:tasks.workunit.client.1.smithi133.stdout:2/694: dwrite d7/d2c/d3b/d48/d59/fcf [0,4194304] 0 2024-02-15T18:27:14.567 INFO:tasks.workunit.client.0.smithi084.stdout:3/902: dwrite d8/d73/db9/fd4 [0,4194304] 0 2024-02-15T18:27:14.567 INFO:tasks.workunit.client.0.smithi084.stdout:6/992: dwrite d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/d99/f12e [0,4194304] 0 2024-02-15T18:27:14.567 INFO:tasks.workunit.client.0.smithi084.stdout:6/993: stat d14/d22/d25/d2f/d31/d30/d45/d52/dd3/ddd/d43/ded/fda 0 2024-02-15T18:27:14.571 INFO:tasks.workunit.client.1.smithi133.stdout:2/695: mkdir d7/db/d35/ddf 0 2024-02-15T18:27:14.571 INFO:tasks.workunit.client.1.smithi133.stdout:2/696: chown d7/d2c/d31/f4b 1 1 2024-02-15T18:27:14.571 INFO:tasks.workunit.client.1.smithi133.stdout:2/697: chown d7/d18/d32/d65/d99/fbe 178 1 2024-02-15T18:27:14.573 INFO:tasks.workunit.client.1.smithi133.stdout:7/586: dwrite d9/fa5 [0,4194304] 0 2024-02-15T18:27:14.578 INFO:tasks.workunit.client.1.smithi133.stdout:5/558: dread d17/f1c [0,4194304] 0 2024-02-15T18:27:14.580 INFO:tasks.workunit.client.1.smithi133.stdout:5/559: dread d17/f4a [0,4194304] 0 2024-02-15T18:27:14.580 INFO:tasks.workunit.client.1.smithi133.stdout:5/560: chown d17/d20/d4f/f64 6580705 1 2024-02-15T18:27:14.594 INFO:tasks.workunit.client.1.smithi133.stdout:5/561: dread d17/d20/d32/d38/f48 [8388608,4194304] 0 2024-02-15T18:27:14.598 INFO:tasks.workunit.client.0.smithi084.stdout:3/903: dread d8/d40/d58/d80/f84 [0,4194304] 0 2024-02-15T18:27:14.600 INFO:tasks.workunit.client.0.smithi084.stdout:3/904: unlink c4 0 2024-02-15T18:27:14.600 INFO:tasks.workunit.client.0.smithi084.stdout:3/905: chown d8/d1f/d2d/dc5/c120 7 1 2024-02-15T18:27:14.601 INFO:tasks.workunit.client.0.smithi084.stdout:3/906: rename d8/d1f/f11f to d8/d40/d43/d71/dcc/f135 0 2024-02-15T18:27:14.603 INFO:tasks.workunit.client.0.smithi084.stdout:3/907: link d8/f9d d8/d1f/d2d/dc5/f136 0 2024-02-15T18:27:14.604 INFO:tasks.workunit.client.0.smithi084.stdout:3/908: creat d8/d40/d43/d71/d8c/d94/da3/f137 x:0 0 0 2024-02-15T18:27:14.634 INFO:tasks.workunit.client.1.smithi133.stdout:7/587: dwrite d9/db/f11 [0,4194304] 0 2024-02-15T18:27:14.634 INFO:tasks.workunit.client.1.smithi133.stdout:5/562: dwrite d17/d20/d4f/f97 [0,4194304] 0 2024-02-15T18:27:14.639 INFO:tasks.workunit.client.0.smithi084.stdout:3/909: dwrite d8/d40/d43/d71/fc2 [0,4194304] 0 2024-02-15T18:27:14.640 INFO:tasks.workunit.client.1.smithi133.stdout:2/698: dwrite d7/db/d67/d7b/f97 [0,4194304] 0 2024-02-15T18:27:14.640 INFO:tasks.workunit.client.1.smithi133.stdout:5/563: mknod d17/d20/d32/cb5 0 2024-02-15T18:27:14.640 INFO:tasks.workunit.client.1.smithi133.stdout:2/699: read d7/d2c/d31/f38 [1467753,5160] 0 2024-02-15T18:27:14.642 INFO:tasks.workunit.client.1.smithi133.stdout:2/700: rename d7/d18/d32/d65/lb0 to d7/db/le0 0 2024-02-15T18:27:14.649 INFO:tasks.workunit.client.1.smithi133.stdout:2/701: dread d7/d2c/d31/f88 [0,4194304] 0 2024-02-15T18:27:14.650 INFO:tasks.workunit.client.1.smithi133.stdout:2/702: creat d7/d18/d32/d65/d54/fe1 x:0 0 0 2024-02-15T18:27:14.650 INFO:tasks.workunit.client.1.smithi133.stdout:2/703: fsync d7/d18/d32/d65/d54/dc9/fda 0 2024-02-15T18:27:14.654 INFO:tasks.workunit.client.1.smithi133.stdout:6/960: sync 2024-02-15T18:27:14.655 INFO:tasks.workunit.client.1.smithi133.stdout:1/869: sync 2024-02-15T18:27:14.655 INFO:tasks.workunit.client.1.smithi133.stdout:6/961: stat d0 0 2024-02-15T18:27:14.656 INFO:tasks.workunit.client.1.smithi133.stdout:1/870: getdents d6/d1e/d3a/d82/d85/d11b 0 2024-02-15T18:27:14.657 INFO:tasks.workunit.client.1.smithi133.stdout:1/871: truncate d6/d1e/d41/d7c/d7e/f101 138663 0 2024-02-15T18:27:14.657 INFO:tasks.workunit.client.1.smithi133.stdout:1/872: chown d6/d1e/d41/d7c/d7e/f94 1528 1 2024-02-15T18:27:14.659 INFO:tasks.workunit.client.1.smithi133.stdout:1/873: rename d6/d1e/d3a/d82/d85/dc7/f10d to d6/d2a/d59/d5a/da4/f141 0 2024-02-15T18:27:14.659 INFO:tasks.workunit.client.1.smithi133.stdout:1/874: read - d6/d1e/d41/d7c/d7e/d7f/db6/f117 zero size 2024-02-15T18:27:14.659 INFO:tasks.workunit.client.1.smithi133.stdout:1/875: chown d6/d1e/d41/d7c/d7e/d7f/db6/ded/d105 35597241 1 2024-02-15T18:27:14.667 INFO:tasks.workunit.client.1.smithi133.stdout:6/962: dread d0/db/d21/f77 [4194304,4194304] 0 2024-02-15T18:27:14.668 INFO:tasks.workunit.client.1.smithi133.stdout:1/876: dread d6/d1e/f21 [0,4194304] 0 2024-02-15T18:27:14.668 INFO:tasks.workunit.client.1.smithi133.stdout:1/877: fsync d6/d1e/d3a/d82/fdf 0 2024-02-15T18:27:14.674 INFO:tasks.workunit.client.1.smithi133.stdout:7/588: dwrite d9/db/d16/f49 [0,4194304] 0 2024-02-15T18:27:14.676 INFO:tasks.workunit.client.1.smithi133.stdout:3/777: sync 2024-02-15T18:27:14.678 INFO:tasks.workunit.client.1.smithi133.stdout:5/564: dwrite d17/f46 [0,4194304] 0 2024-02-15T18:27:14.678 INFO:tasks.workunit.client.1.smithi133.stdout:5/565: fdatasync d17/f7a 0 2024-02-15T18:27:14.680 INFO:tasks.workunit.client.1.smithi133.stdout:2/704: getdents d7/d18/d32/d65/d54 0 2024-02-15T18:27:14.681 INFO:tasks.workunit.client.1.smithi133.stdout:2/705: chown d7/d18/d32/d65/d58 1253927931 1 2024-02-15T18:27:14.681 INFO:tasks.workunit.client.1.smithi133.stdout:2/706: fsync d7/d2c/d3b/d48/faf 0 2024-02-15T18:27:14.681 INFO:tasks.workunit.client.1.smithi133.stdout:2/707: chown d7/d18/d32/d65/f7d 40216112 1 2024-02-15T18:27:14.683 INFO:tasks.workunit.client.1.smithi133.stdout:5/566: unlink la 0 2024-02-15T18:27:14.683 INFO:tasks.workunit.client.1.smithi133.stdout:5/567: chown d17/d20/d5e/l83 3931127 1 2024-02-15T18:27:14.685 INFO:tasks.workunit.client.1.smithi133.stdout:2/708: unlink d7/d2c/d5a/d66/d70/ld8 0 2024-02-15T18:27:14.686 INFO:tasks.workunit.client.1.smithi133.stdout:5/568: rmdir d17/d20/d4f/d90 39 2024-02-15T18:27:14.686 INFO:tasks.workunit.client.1.smithi133.stdout:5/569: write d17/d26/f21 [1161571,885] 0 2024-02-15T18:27:14.689 INFO:tasks.workunit.client.1.smithi133.stdout:5/570: rename d17/d20/d4f/d90 to d17/d20/d32/d38/d86/db6 0 2024-02-15T18:27:14.690 INFO:tasks.workunit.client.1.smithi133.stdout:5/571: truncate d17/d20/d32/d38/f8b 636574 0 2024-02-15T18:27:14.711 INFO:tasks.workunit.client.1.smithi133.stdout:2/709: dread d7/db/f1d [0,4194304] 0 2024-02-15T18:27:14.727 INFO:tasks.workunit.client.1.smithi133.stdout:1/878: dwrite d6/d1e/f134 [0,4194304] 0 2024-02-15T18:27:14.729 INFO:tasks.workunit.client.1.smithi133.stdout:7/589: dwrite d9/db/f2d [0,4194304] 0 2024-02-15T18:27:14.729 INFO:tasks.workunit.client.1.smithi133.stdout:6/963: dwrite d0/db/d29/d34/d5d/d40/dde/f6d [0,4194304] 0 2024-02-15T18:27:14.730 INFO:tasks.workunit.client.1.smithi133.stdout:3/778: dwrite d0/d15/d37/f59 [0,4194304] 0 2024-02-15T18:27:14.731 INFO:tasks.workunit.client.1.smithi133.stdout:1/879: link d6/d1e/d41/f66 d6/d1e/d3a/d82/d85/f142 0 2024-02-15T18:27:14.732 INFO:tasks.workunit.client.1.smithi133.stdout:2/710: dwrite d7/f14 [0,4194304] 0 2024-02-15T18:27:14.732 INFO:tasks.workunit.client.1.smithi133.stdout:2/711: write d7/d2c/d3b/f9a [152928,78302] 0 2024-02-15T18:27:14.733 INFO:tasks.workunit.client.1.smithi133.stdout:7/590: symlink d9/d36/d3d/d4c/d97/da9/dc6/lce 0 2024-02-15T18:27:14.733 INFO:tasks.workunit.client.1.smithi133.stdout:7/591: chown d9/db/d55/fbb 16 1 2024-02-15T18:27:14.741 INFO:tasks.workunit.client.1.smithi133.stdout:6/964: getdents d0/db/d29/d34/d5d/d40 0 2024-02-15T18:27:14.741 INFO:tasks.workunit.client.1.smithi133.stdout:6/965: fdatasync d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/f96 0 2024-02-15T18:27:14.741 INFO:tasks.workunit.client.1.smithi133.stdout:6/966: write d0/db/d29/d34/d5d/d40/dde/d67/f81 [909652,29294] 0 2024-02-15T18:27:14.744 INFO:tasks.workunit.client.1.smithi133.stdout:1/880: link d6/fa5 d6/d1e/d41/dcc/f143 0 2024-02-15T18:27:14.745 INFO:tasks.workunit.client.1.smithi133.stdout:1/881: dread - d6/d1e/f13e zero size 2024-02-15T18:27:14.746 INFO:tasks.workunit.client.1.smithi133.stdout:6/967: truncate d0/db/d29/d34/d5d/d40/dde/f99 387501 0 2024-02-15T18:27:14.748 INFO:tasks.workunit.client.1.smithi133.stdout:1/882: creat d6/d1e/d41/d7c/d7e/d7f/db6/ded/d105/f144 x:0 0 0 2024-02-15T18:27:14.748 INFO:tasks.workunit.client.1.smithi133.stdout:1/883: truncate d6/d1e/d41/f58 891721 0 2024-02-15T18:27:14.748 INFO:tasks.workunit.client.1.smithi133.stdout:1/884: dread - d6/d1e/d3a/d82/d85/d11b/f133 zero size 2024-02-15T18:27:14.748 INFO:tasks.workunit.client.1.smithi133.stdout:1/885: chown d6/d1e/l70 183772 1 2024-02-15T18:27:14.749 INFO:tasks.workunit.client.1.smithi133.stdout:1/886: mknod d6/d1e/d3a/d75/c145 0 2024-02-15T18:27:14.749 INFO:tasks.workunit.client.1.smithi133.stdout:1/887: read - d6/d1e/d3a/d82/d85/dc7/fd2 zero size 2024-02-15T18:27:14.749 INFO:tasks.workunit.client.1.smithi133.stdout:1/888: fdatasync d6/d1e/d3a/f12e 0 2024-02-15T18:27:14.750 INFO:tasks.workunit.client.1.smithi133.stdout:1/889: creat d6/d2a/d59/d5a/da4/f146 x:0 0 0 2024-02-15T18:27:14.751 INFO:tasks.workunit.client.1.smithi133.stdout:1/890: symlink d6/d2a/d59/d5a/da4/daa/l147 0 2024-02-15T18:27:14.754 INFO:tasks.workunit.client.1.smithi133.stdout:6/968: dread d0/f12 [0,4194304] 0 2024-02-15T18:27:14.754 INFO:tasks.workunit.client.1.smithi133.stdout:6/969: write d0/db/f4f [722344,14113] 0 2024-02-15T18:27:14.755 INFO:tasks.workunit.client.1.smithi133.stdout:1/891: write d6/d1e/d3a/d82/d85/f45 [1236105,37268] 0 2024-02-15T18:27:14.756 INFO:tasks.workunit.client.1.smithi133.stdout:1/892: creat d6/d1e/d3a/d97/dda/f148 x:0 0 0 2024-02-15T18:27:14.757 INFO:tasks.workunit.client.1.smithi133.stdout:1/893: mkdir d6/d1e/d149 0 2024-02-15T18:27:14.765 INFO:tasks.workunit.client.1.smithi133.stdout:6/970: dread d0/db/d29/d34/d48/da1/fcf [0,4194304] 0 2024-02-15T18:27:14.766 INFO:tasks.workunit.client.1.smithi133.stdout:3/779: dwrite d0/d15/d2f/d9b/d39/d3f/fef [0,4194304] 0 2024-02-15T18:27:14.767 INFO:tasks.workunit.client.1.smithi133.stdout:3/780: chown d0/d15/d2f/d9b/d39/d3f/c29 180663 1 2024-02-15T18:27:14.767 INFO:tasks.workunit.client.1.smithi133.stdout:3/781: write d0/d15/d2f/d9b/d39/fc7 [243372,117930] 0 2024-02-15T18:27:14.767 INFO:tasks.workunit.client.1.smithi133.stdout:3/782: write d0/d15/d2f/d9b/d39/d3f/fee [632175,78389] 0 2024-02-15T18:27:14.768 INFO:tasks.workunit.client.0.smithi084.stdout:6/994: sync 2024-02-15T18:27:14.768 INFO:tasks.workunit.client.0.smithi084.stdout:3/910: sync 2024-02-15T18:27:14.768 INFO:tasks.workunit.client.0.smithi084.stdout:6/995: chown d14/d22/d25/d2f/d31/d30/d4f/df1/f102 97 1 2024-02-15T18:27:14.768 INFO:tasks.workunit.client.0.smithi084.stdout:3/911: write d8/d40/d58/d80/f84 [2572696,48624] 0 2024-02-15T18:27:14.769 INFO:tasks.workunit.client.0.smithi084.stdout:3/912: stat d8/d1f/c3a 0 2024-02-15T18:27:14.769 INFO:tasks.workunit.client.1.smithi133.stdout:3/783: creat d0/d15/d37/d4a/f101 x:0 0 0 2024-02-15T18:27:14.770 INFO:tasks.workunit.client.0.smithi084.stdout:3/913: mkdir d8/d40/d58/d80/dc4/d138 0 2024-02-15T18:27:14.770 INFO:tasks.workunit.client.0.smithi084.stdout:6/996: dread d14/d22/d25/f35 [0,4194304] 0 2024-02-15T18:27:14.771 INFO:tasks.workunit.client.1.smithi133.stdout:2/712: dwrite d7/d18/d32/d65/d58/f84 [0,4194304] 0 2024-02-15T18:27:14.771 INFO:tasks.workunit.client.1.smithi133.stdout:7/592: dwrite d9/db/dc/d84/fa3 [0,4194304] 0 2024-02-15T18:27:14.771 INFO:tasks.workunit.client.1.smithi133.stdout:7/593: fsync d9/db/dc/f35 0 2024-02-15T18:27:14.773 INFO:tasks.workunit.client.0.smithi084.stdout:6/997: getdents d14/d22/d25/d28/d11c/d111 0 2024-02-15T18:27:14.775 INFO:tasks.workunit.client.1.smithi133.stdout:0/776: sync 2024-02-15T18:27:14.776 INFO:tasks.workunit.client.1.smithi133.stdout:8/582: sync 2024-02-15T18:27:14.776 INFO:tasks.workunit.client.1.smithi133.stdout:4/483: sync 2024-02-15T18:27:14.776 INFO:tasks.workunit.client.1.smithi133.stdout:9/586: sync 2024-02-15T18:27:14.776 INFO:tasks.workunit.client.1.smithi133.stdout:9/587: chown d0/d8/d10/d4d/fc2 2292 1 2024-02-15T18:27:14.776 INFO:tasks.workunit.client.1.smithi133.stdout:8/583: write d3/d1f/d3f/d8c/fb6 [127925,73054] 0 2024-02-15T18:27:14.776 INFO:tasks.workunit.client.0.smithi084.stdout:6/998: mknod d14/d22/d25/d2f/d31/d30/d45/d52/dd3/c145 0 2024-02-15T18:27:14.776 INFO:tasks.workunit.client.0.smithi084.stdout:6/999: dread - d14/d22/d25/d2f/da9/d9b/dac/ff3 zero size 2024-02-15T18:27:14.780 INFO:tasks.workunit.client.1.smithi133.stdout:4/484: rename d2/d5/d2b/d21/d2d/d44/d51/d55 to d2/d5/d2b/d21/da2 0 2024-02-15T18:27:14.784 INFO:tasks.workunit.client.1.smithi133.stdout:8/584: creat d3/d1c/d2f/d87/fbf x:0 0 0 2024-02-15T18:27:14.784 INFO:tasks.workunit.client.1.smithi133.stdout:4/485: truncate d2/f72 1056791 0 2024-02-15T18:27:14.787 INFO:tasks.workunit.client.1.smithi133.stdout:8/585: mknod d3/d1f/d3f/cc0 0 2024-02-15T18:27:14.788 INFO:tasks.workunit.client.1.smithi133.stdout:2/713: write d7/d18/d32/d65/d54/f83 [569811,21230] 0 2024-02-15T18:27:14.790 INFO:tasks.workunit.client.1.smithi133.stdout:8/586: mkdir d3/d1f/d4f/da3/dc1 0 2024-02-15T18:27:14.792 INFO:tasks.workunit.client.1.smithi133.stdout:2/714: mknod d7/d18/d32/ddc/ce2 0 2024-02-15T18:27:14.794 INFO:tasks.workunit.client.1.smithi133.stdout:2/715: creat d7/db/d67/da7/fe3 x:0 0 0 2024-02-15T18:27:14.798 INFO:tasks.workunit.client.1.smithi133.stdout:9/588: dread d0/d8/d9/d12/f3f [0,4194304] 0 2024-02-15T18:27:14.800 INFO:tasks.workunit.client.1.smithi133.stdout:9/589: creat d0/d8/d9/d12/d7f/d8f/fc5 x:0 0 0 2024-02-15T18:27:14.800 INFO:tasks.workunit.client.1.smithi133.stdout:9/590: readlink d0/d8/l91 0 2024-02-15T18:27:14.820 INFO:tasks.workunit.client.1.smithi133.stdout:6/971: dwrite d0/db/d29/d34/d48/f90 [0,4194304] 0 2024-02-15T18:27:14.823 INFO:tasks.workunit.client.1.smithi133.stdout:6/972: link d0/db/d29/d34/d5d/fc4 d0/db/d29/d34/d48/f142 0 2024-02-15T18:27:14.825 INFO:tasks.workunit.client.1.smithi133.stdout:6/973: read d0/db/d29/d34/d5d/d40/dde/d52/f58 [3806530,92540] 0 2024-02-15T18:27:14.826 INFO:tasks.workunit.client.1.smithi133.stdout:6/974: link d0/db/d29/d34/d5d/d40/dde/d78/d7f/fa7 d0/db/d29/f143 0 2024-02-15T18:27:14.827 INFO:tasks.workunit.client.1.smithi133.stdout:6/975: getdents d0/db/d29/d34/d5d/dc9 0 2024-02-15T18:27:14.827 INFO:tasks.workunit.client.1.smithi133.stdout:6/976: write d0/db/d29/d34/d5d/d40/dde/d67/d9a/f108 [993721,33078] 0 2024-02-15T18:27:14.827 INFO:tasks.workunit.client.1.smithi133.stdout:6/977: chown d0/db/d29/d34/d5d/d40/dde/f131 21 1 2024-02-15T18:27:14.828 INFO:tasks.workunit.client.1.smithi133.stdout:6/978: truncate d0/db/d21/f77 2107257 0 2024-02-15T18:27:14.828 INFO:tasks.workunit.client.1.smithi133.stdout:6/979: write d0/db/d29/d34/d5d/d40/dde/d78/fae [5130212,124245] 0 2024-02-15T18:27:14.849 INFO:tasks.workunit.client.1.smithi133.stdout:7/594: dwrite d9/db/d55/fa0 [0,4194304] 0 2024-02-15T18:27:14.850 INFO:tasks.workunit.client.1.smithi133.stdout:7/595: creat d9/fcf x:0 0 0 2024-02-15T18:27:14.853 INFO:tasks.workunit.client.1.smithi133.stdout:7/596: rename d9/d5b to d9/d36/d39/dd0 0 2024-02-15T18:27:14.856 INFO:tasks.workunit.client.1.smithi133.stdout:3/784: dwrite d0/d15/d2f/d9b/d39/d3f/f20 [0,4194304] 0 2024-02-15T18:27:14.856 INFO:tasks.workunit.client.1.smithi133.stdout:3/785: write d0/d15/d2f/d9b/d39/fd6 [346612,105120] 0 2024-02-15T18:27:14.857 INFO:tasks.workunit.client.0.smithi084.stdout:3/914: dwrite d8/d40/d43/d71/dd9/f111 [0,4194304] 0 2024-02-15T18:27:14.857 INFO:tasks.workunit.client.0.smithi084.stdout:3/915: read - d8/d1f/dbf/fc9 zero size 2024-02-15T18:27:14.857 INFO:tasks.workunit.client.1.smithi133.stdout:4/486: dwrite d2/d5/d2b/d21/d2d/d44/f47 [0,4194304] 0 2024-02-15T18:27:14.858 INFO:tasks.workunit.client.1.smithi133.stdout:9/591: dwrite d0/d8/d10/f36 [0,4194304] 0 2024-02-15T18:27:14.858 INFO:tasks.workunit.client.1.smithi133.stdout:9/592: chown d0/d8/d9/d12/d82/d42/d79 114411 1 2024-02-15T18:27:14.858 INFO:tasks.workunit.client.1.smithi133.stdout:2/716: dwrite d7/f3c [0,4194304] 0 2024-02-15T18:27:14.862 INFO:tasks.workunit.client.1.smithi133.stdout:7/597: dread d9/db/d16/d5d/d68/f70 [0,4194304] 0 2024-02-15T18:27:14.863 INFO:tasks.workunit.client.1.smithi133.stdout:7/598: chown d9/c60 3956 1 2024-02-15T18:27:14.868 INFO:tasks.workunit.client.0.smithi084.stdout:3/916: dread d8/d40/d43/d71/dcc/f114 [0,4194304] 0 2024-02-15T18:27:14.870 INFO:tasks.workunit.client.0.smithi084.stdout:3/917: mkdir d8/d40/d58/d80/dc4/d139 0 2024-02-15T18:27:14.870 INFO:tasks.workunit.client.0.smithi084.stdout:3/918: readlink d8/d40/d43/d71/la1 0 2024-02-15T18:27:14.871 INFO:tasks.workunit.client.0.smithi084.stdout:3/919: mkdir d8/d40/d58/d80/dc4/d139/d13a 0 2024-02-15T18:27:14.871 INFO:tasks.workunit.client.0.smithi084.stdout:3/920: truncate d8/d1f/f20 5435037 0 2024-02-15T18:27:14.873 INFO:tasks.workunit.client.1.smithi133.stdout:3/786: dwrite d0/d15/d2f/d5e/f8b [0,4194304] 0 2024-02-15T18:27:14.874 INFO:tasks.workunit.client.1.smithi133.stdout:4/487: mknod d2/d48/ca3 0 2024-02-15T18:27:14.877 INFO:tasks.workunit.client.1.smithi133.stdout:2/717: unlink d7/d2c/d3b/d48/d6d/f78 0 2024-02-15T18:27:14.877 INFO:tasks.workunit.client.1.smithi133.stdout:4/488: write d2/f9 [7680867,21670] 0 2024-02-15T18:27:14.878 INFO:tasks.workunit.client.1.smithi133.stdout:7/599: creat d9/da/d48/d62/d64/fd1 x:0 0 0 2024-02-15T18:27:14.879 INFO:tasks.workunit.client.1.smithi133.stdout:3/787: dread d0/d15/d37/d95/f9e [0,4194304] 0 2024-02-15T18:27:14.882 INFO:tasks.workunit.client.1.smithi133.stdout:2/718: mknod d7/d18/d32/d65/ce4 0 2024-02-15T18:27:14.884 INFO:tasks.workunit.client.1.smithi133.stdout:4/489: rmdir d2/d5/d2b/d21/d2d/d44/d51/d60/d63 39 2024-02-15T18:27:14.886 INFO:tasks.workunit.client.0.smithi084.stdout:3/921: dread d8/d40/d58/d80/d6b/fc0 [0,4194304] 0 2024-02-15T18:27:14.886 INFO:tasks.workunit.client.0.smithi084.stdout:3/922: truncate d8/d40/f91 428354 0 2024-02-15T18:27:14.886 INFO:tasks.workunit.client.0.smithi084.stdout:3/923: fsync d8/d40/f70 0 2024-02-15T18:27:14.887 INFO:tasks.workunit.client.1.smithi133.stdout:7/600: creat d9/fd2 x:0 0 0 2024-02-15T18:27:14.887 INFO:tasks.workunit.client.1.smithi133.stdout:3/788: stat d0/d15/d54/c77 0 2024-02-15T18:27:14.889 INFO:tasks.workunit.client.1.smithi133.stdout:2/719: creat d7/d2c/d5a/d66/da5/fe5 x:0 0 0 2024-02-15T18:27:14.889 INFO:tasks.workunit.client.1.smithi133.stdout:4/490: getdents d2/d5/d2b/d21/da2/d5e/d76 0 2024-02-15T18:27:14.890 INFO:tasks.workunit.client.1.smithi133.stdout:2/720: link d7/d2c/d3b/f4d d7/d2c/fe6 0 2024-02-15T18:27:14.890 INFO:tasks.workunit.client.1.smithi133.stdout:2/721: fdatasync d7/db/d67/da7/fc6 0 2024-02-15T18:27:14.891 INFO:tasks.workunit.client.1.smithi133.stdout:4/491: mkdir d2/d5/d2b/d21/d2d/d44/da4 0 2024-02-15T18:27:14.892 INFO:tasks.workunit.client.1.smithi133.stdout:2/722: getdents d7/db/d35 0 2024-02-15T18:27:14.892 INFO:tasks.workunit.client.1.smithi133.stdout:2/723: getdents d7/db/d35/ddf 0 2024-02-15T18:27:14.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:12.687375+0000 mgr.smithi084.hjmnez (mgr.14596) 28 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 157 MiB/s rd, 326 MiB/s wr, 475 op/s 2024-02-15T18:27:14.895 INFO:tasks.workunit.client.1.smithi133.stdout:4/492: mknod d2/d5/d2b/d21/d3b/d49/d98/ca5 0 2024-02-15T18:27:14.895 INFO:tasks.workunit.client.1.smithi133.stdout:4/493: read - d2/d5/fa0 zero size 2024-02-15T18:27:14.895 INFO:tasks.workunit.client.1.smithi133.stdout:2/724: rename d7/db/d67/dd7 to d7/d18/d32/d65/d54/dc9/de7 0 2024-02-15T18:27:14.895 INFO:tasks.workunit.client.1.smithi133.stdout:4/494: truncate d2/d5/d2b/d21/d2d/d44/d51/f67 1176269 0 2024-02-15T18:27:14.897 INFO:tasks.workunit.client.1.smithi133.stdout:4/495: rmdir d2/d48/d5c 39 2024-02-15T18:27:14.897 INFO:tasks.workunit.client.1.smithi133.stdout:7/601: dread d9/fa5 [0,4194304] 0 2024-02-15T18:27:14.897 INFO:tasks.workunit.client.1.smithi133.stdout:7/602: fsync d9/fa5 0 2024-02-15T18:27:14.897 INFO:tasks.workunit.client.1.smithi133.stdout:7/603: chown d9/da/f78 2469 1 2024-02-15T18:27:14.897 INFO:tasks.workunit.client.1.smithi133.stdout:2/725: creat d7/d18/d32/d65/fe8 x:0 0 0 2024-02-15T18:27:14.898 INFO:tasks.workunit.client.1.smithi133.stdout:2/726: stat d7/d2c/d5a/d66/d70/da8/fd0 0 2024-02-15T18:27:14.898 INFO:tasks.workunit.client.1.smithi133.stdout:4/496: creat d2/d5/d2b/d21/d3b/fa6 x:0 0 0 2024-02-15T18:27:14.898 INFO:tasks.workunit.client.1.smithi133.stdout:7/604: mknod d9/db/d16/d5d/d68/d8a/cd3 0 2024-02-15T18:27:14.898 INFO:tasks.workunit.client.1.smithi133.stdout:7/605: readlink d9/db/dc/l88 0 2024-02-15T18:27:14.900 INFO:tasks.workunit.client.1.smithi133.stdout:4/497: truncate d2/f23 3257750 0 2024-02-15T18:27:14.905 INFO:tasks.workunit.client.1.smithi133.stdout:4/498: write d2/d5/d2b/d21/f31 [395349,64872] 0 2024-02-15T18:27:14.908 INFO:tasks.workunit.client.1.smithi133.stdout:4/499: link d2/d5/d2b/d21/d2d/l30 d2/d5/d2b/d21/d2d/d44/d51/d60/d63/la7 0 2024-02-15T18:27:14.911 INFO:tasks.workunit.client.1.smithi133.stdout:2/727: dread d7/d18/f40 [0,4194304] 0 2024-02-15T18:27:14.914 INFO:tasks.workunit.client.1.smithi133.stdout:2/728: dread d7/d2c/d3b/d48/f9f [0,4194304] 0 2024-02-15T18:27:14.922 INFO:tasks.workunit.client.1.smithi133.stdout:3/789: dwrite d0/d15/d2f/d9b/d39/fd6 [0,4194304] 0 2024-02-15T18:27:14.922 INFO:tasks.workunit.client.1.smithi133.stdout:3/790: dread - d0/d15/d37/f86 zero size 2024-02-15T18:27:14.925 INFO:tasks.workunit.client.0.smithi084.stdout:3/924: dwrite d8/d40/d58/d80/fbc [0,4194304] 0 2024-02-15T18:27:14.925 INFO:tasks.workunit.client.1.smithi133.stdout:3/791: mkdir d0/d15/d37/d102 0 2024-02-15T18:27:14.925 INFO:tasks.workunit.client.1.smithi133.stdout:3/792: readlink d0/d15/d2f/db4/l85 0 2024-02-15T18:27:14.926 INFO:tasks.workunit.client.1.smithi133.stdout:3/793: getdents d0/d15/d2f/d9b/d72/dbf 0 2024-02-15T18:27:14.927 INFO:tasks.workunit.client.0.smithi084.stdout:3/925: truncate d8/d1f/d25/f8e 4120234 0 2024-02-15T18:27:14.928 INFO:tasks.workunit.client.0.smithi084.stdout:3/926: creat d8/d40/d43/d71/d8c/d94/d12f/f13b x:0 0 0 2024-02-15T18:27:14.928 INFO:tasks.workunit.client.0.smithi084.stdout:3/927: chown d8/d1f/d2d/l56 18253 1 2024-02-15T18:27:14.929 INFO:tasks.workunit.client.0.smithi084.stdout:3/928: mkdir d8/d40/d43/d71/d8c/d94/da3/d115/d13c 0 2024-02-15T18:27:14.930 INFO:tasks.workunit.client.0.smithi084.stdout:3/929: symlink d8/d40/d58/d80/dc4/d139/l13d 0 2024-02-15T18:27:14.931 INFO:tasks.workunit.client.1.smithi133.stdout:7/606: dwrite d9/db/d55/d63/fc4 [0,4194304] 0 2024-02-15T18:27:14.933 INFO:tasks.workunit.client.1.smithi133.stdout:4/500: dwrite d2/d5/d2b/f1a [0,4194304] 0 2024-02-15T18:27:14.933 INFO:tasks.workunit.client.1.smithi133.stdout:7/607: creat d9/d36/d3d/fd4 x:0 0 0 2024-02-15T18:27:14.933 INFO:tasks.workunit.client.1.smithi133.stdout:7/608: chown d9/db/d16/d5d/d68/d8a/l8b 14784932 1 2024-02-15T18:27:14.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/501: truncate d2/d5/d2b/d21/da2/d5e/f73 3567386 0 2024-02-15T18:27:14.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/502: stat d2/d48/d5c/d93/d8d/d96 0 2024-02-15T18:27:14.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/503: fsync d2/d5/d2b/f24 0 2024-02-15T18:27:14.934 INFO:tasks.workunit.client.1.smithi133.stdout:4/504: chown d2/d5/d2b/d21/l3a 0 1 2024-02-15T18:27:14.935 INFO:tasks.workunit.client.1.smithi133.stdout:7/609: mknod d9/db/d16/d5d/d68/d8a/cd5 0 2024-02-15T18:27:14.935 INFO:tasks.workunit.client.1.smithi133.stdout:7/610: readlink d9/da/l33 0 2024-02-15T18:27:14.935 INFO:tasks.workunit.client.1.smithi133.stdout:2/729: dwrite d7/d18/f40 [0,4194304] 0 2024-02-15T18:27:14.935 INFO:tasks.workunit.client.1.smithi133.stdout:4/505: symlink d2/d5/d2b/d21/d2d/d4f/d87/d92/la8 0 2024-02-15T18:27:14.938 INFO:tasks.workunit.client.1.smithi133.stdout:4/506: write d2/d5/d2b/d21/da2/f27 [1393342,127820] 0 2024-02-15T18:27:14.938 INFO:tasks.workunit.client.1.smithi133.stdout:4/507: write d2/d5/fa0 [1043086,114133] 0 2024-02-15T18:27:14.939 INFO:tasks.workunit.client.1.smithi133.stdout:4/508: write d2/d5/d2b/d21/d3b/d49/f69 [872199,90393] 0 2024-02-15T18:27:14.940 INFO:tasks.workunit.client.1.smithi133.stdout:4/509: chown d2/d5/d2b/f24 20549 1 2024-02-15T18:27:14.940 INFO:tasks.workunit.client.1.smithi133.stdout:4/510: fdatasync d2/d5/d2b/d21/d36/f64 0 2024-02-15T18:27:14.940 INFO:tasks.workunit.client.1.smithi133.stdout:4/511: chown d2/d48/d5c/f62 476738651 1 2024-02-15T18:27:14.940 INFO:tasks.workunit.client.1.smithi133.stdout:4/512: write d2/d5/d2b/d21/d3b/d49/f57 [5060007,84324] 0 2024-02-15T18:27:14.940 INFO:tasks.workunit.client.1.smithi133.stdout:4/513: readlink d2/d48/d6a/l75 0 2024-02-15T18:27:14.940 INFO:tasks.workunit.client.0.smithi084.stdout:3/930: rename d8/d40/d58 to d8/d73/db9/d13e 0 2024-02-15T18:27:14.941 INFO:tasks.workunit.client.1.smithi133.stdout:7/611: unlink d9/da/d48/d5a/fbc 0 2024-02-15T18:27:14.941 INFO:tasks.workunit.client.1.smithi133.stdout:7/612: dread - d9/db/f8c zero size 2024-02-15T18:27:14.941 INFO:tasks.workunit.client.1.smithi133.stdout:7/613: dread - d9/d36/d3d/f43 zero size 2024-02-15T18:27:14.942 INFO:tasks.workunit.client.1.smithi133.stdout:4/514: write d2/d48/d6a/f9a [394350,20848] 0 2024-02-15T18:27:14.944 INFO:tasks.workunit.client.0.smithi084.stdout:3/931: dread d8/d73/db9/d13e/f72 [0,4194304] 0 2024-02-15T18:27:14.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/932: symlink d8/d40/d43/d71/d8c/d94/da3/dea/l13f 0 2024-02-15T18:27:14.945 INFO:tasks.workunit.client.0.smithi084.stdout:3/933: truncate d8/d1f/dbf/fe9 1011165 0 2024-02-15T18:27:14.948 INFO:tasks.workunit.client.1.smithi133.stdout:2/730: unlink d7/db/l2b 0 2024-02-15T18:27:14.956 INFO:tasks.workunit.client.1.smithi133.stdout:6/980: sync 2024-02-15T18:27:14.956 INFO:tasks.workunit.client.1.smithi133.stdout:8/587: sync 2024-02-15T18:27:14.956 INFO:tasks.workunit.client.1.smithi133.stdout:0/777: sync 2024-02-15T18:27:14.956 INFO:tasks.workunit.client.1.smithi133.stdout:9/593: sync 2024-02-15T18:27:14.956 INFO:tasks.workunit.client.1.smithi133.stdout:5/572: sync 2024-02-15T18:27:14.956 INFO:tasks.workunit.client.1.smithi133.stdout:1/894: sync 2024-02-15T18:27:14.959 INFO:tasks.workunit.client.1.smithi133.stdout:6/981: rename d0/f10 to d0/f144 0 2024-02-15T18:27:14.961 INFO:tasks.workunit.client.1.smithi133.stdout:8/588: rename d3/d7/c17 to d3/d1f/cc2 0 2024-02-15T18:27:14.961 INFO:tasks.workunit.client.1.smithi133.stdout:8/589: readlink d3/d7/l3d 0 2024-02-15T18:27:14.962 INFO:tasks.workunit.client.0.smithi084.stdout:3/934: dread d8/d40/d43/d71/f9b [0,4194304] 0 2024-02-15T18:27:14.963 INFO:tasks.workunit.client.1.smithi133.stdout:1/895: dread d6/d17/f18 [0,4194304] 0 2024-02-15T18:27:14.964 INFO:tasks.workunit.client.1.smithi133.stdout:8/590: rename d3/d1c/d2f/d87/d73/lb1 to d3/d1f/d4f/lc3 0 2024-02-15T18:27:14.964 INFO:tasks.workunit.client.1.smithi133.stdout:2/731: dwrite d7/d2c/d3b/f9a [0,4194304] 0 2024-02-15T18:27:14.965 INFO:tasks.workunit.client.0.smithi084.stdout:3/935: mknod d8/d1f/c140 0 2024-02-15T18:27:14.965 INFO:tasks.workunit.client.0.smithi084.stdout:3/936: fdatasync d8/d73/db9/d13e/d80/d6b/f6c 0 2024-02-15T18:27:14.965 INFO:tasks.workunit.client.1.smithi133.stdout:5/573: read d17/d20/d32/d38/f8b [86650,67538] 0 2024-02-15T18:27:14.966 INFO:tasks.workunit.client.1.smithi133.stdout:8/591: mkdir d3/de/d3e/dc4 0 2024-02-15T18:27:14.966 INFO:tasks.workunit.client.1.smithi133.stdout:8/592: fdatasync d3/d92/fbd 0 2024-02-15T18:27:14.967 INFO:tasks.workunit.client.0.smithi084.stdout:3/937: creat d8/d73/f141 x:0 0 0 2024-02-15T18:27:14.974 INFO:tasks.workunit.client.1.smithi133.stdout:2/732: symlink d7/db/d67/d7b/le9 0 2024-02-15T18:27:14.974 INFO:tasks.workunit.client.1.smithi133.stdout:8/593: getdents d3/d1f/d3f/d8c 0 2024-02-15T18:27:14.976 INFO:tasks.workunit.client.1.smithi133.stdout:8/594: write d3/d1c/f51 [4282676,98172] 0 2024-02-15T18:27:14.979 INFO:tasks.workunit.client.1.smithi133.stdout:2/733: write d7/db/f43 [1633833,50162] 0 2024-02-15T18:27:14.981 INFO:tasks.workunit.client.0.smithi084.stdout:3/938: dread d8/d73/db9/d13e/d80/d6b/f6c [0,4194304] 0 2024-02-15T18:27:14.983 INFO:tasks.workunit.client.1.smithi133.stdout:8/595: creat d3/d1c/d37/d5c/fc5 x:0 0 0 2024-02-15T18:27:14.984 INFO:tasks.workunit.client.1.smithi133.stdout:8/596: mknod d3/d1c/d37/d5c/cc6 0 2024-02-15T18:27:14.984 INFO:tasks.workunit.client.1.smithi133.stdout:8/597: chown d3/de/d3e/caa 6 1 2024-02-15T18:27:14.985 INFO:tasks.workunit.client.1.smithi133.stdout:8/598: mknod d3/d1f/d4f/da3/dc1/cc7 0 2024-02-15T18:27:14.986 INFO:tasks.workunit.client.1.smithi133.stdout:8/599: mkdir d3/d7/d40/d61/dc8 0 2024-02-15T18:27:14.987 INFO:tasks.workunit.client.1.smithi133.stdout:8/600: mkdir d3/de/d3e/d94/dc9 0 2024-02-15T18:27:14.987 INFO:tasks.workunit.client.1.smithi133.stdout:8/601: chown d3/d1f/d4f/c93 77620 1 2024-02-15T18:27:14.989 INFO:tasks.workunit.client.1.smithi133.stdout:2/734: dread d7/d2c/d5a/d66/d70/fba [0,4194304] 0 2024-02-15T18:27:14.998 INFO:tasks.workunit.client.1.smithi133.stdout:9/594: dwrite d0/d8/d9/d12/d82/f7c [0,4194304] 0 2024-02-15T18:27:14.998 INFO:tasks.workunit.client.1.smithi133.stdout:9/595: chown d0/d8/d9/d12/f21 390 1 2024-02-15T18:27:14.998 INFO:tasks.workunit.client.1.smithi133.stdout:9/596: write d0/d8/d9/ff [945115,19336] 0 2024-02-15T18:27:15.005 INFO:tasks.workunit.client.1.smithi133.stdout:2/735: dread d7/d2c/d31/f38 [0,4194304] 0 2024-02-15T18:27:15.005 INFO:tasks.workunit.client.1.smithi133.stdout:9/597: dread d0/d8/d10/d4d/f66 [0,4194304] 0 2024-02-15T18:27:15.005 INFO:tasks.workunit.client.1.smithi133.stdout:2/736: symlink d7/d2c/d5a/d66/lea 0 2024-02-15T18:27:15.007 INFO:tasks.workunit.client.1.smithi133.stdout:2/737: link d7/d2c/d3b/d48/d6d/f8b d7/d2c/d46/feb 0 2024-02-15T18:27:15.009 INFO:tasks.workunit.client.1.smithi133.stdout:9/598: write d0/d8/d10/d4d/f5e [3316528,36938] 0 2024-02-15T18:27:15.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:12.687375+0000 mgr.smithi084.hjmnez (mgr.14596) 28 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 2.3 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 157 MiB/s rd, 326 MiB/s wr, 475 op/s 2024-02-15T18:27:15.010 INFO:tasks.workunit.client.1.smithi133.stdout:0/778: dwrite d9/d10/d22/d32/fa2 [4194304,4194304] 0 2024-02-15T18:27:15.012 INFO:tasks.workunit.client.1.smithi133.stdout:6/982: dwrite d0/db/d29/d34/d5d/d40/dde/d78/d7f/f137 [0,4194304] 0 2024-02-15T18:27:15.012 INFO:tasks.workunit.client.1.smithi133.stdout:6/983: chown d0/d62/f123 2768175 1 2024-02-15T18:27:15.013 INFO:tasks.workunit.client.1.smithi133.stdout:1/896: dwrite d6/d1e/d3a/d82/d85/d67/f87 [4194304,4194304] 0 2024-02-15T18:27:15.013 INFO:tasks.workunit.client.1.smithi133.stdout:1/897: write d6/d1e/d41/dcc/fe3 [119528,4896] 0 2024-02-15T18:27:15.014 INFO:tasks.workunit.client.1.smithi133.stdout:5/574: dwrite d17/d20/d32/d38/d86/f98 [0,4194304] 0 2024-02-15T18:27:15.016 INFO:tasks.workunit.client.1.smithi133.stdout:0/779: getdents d9/d10/d22/d32/d7f 0 2024-02-15T18:27:15.019 INFO:tasks.workunit.client.1.smithi133.stdout:0/780: creat d9/d10/d19/d29/d67/d68/d96/f102 x:0 0 0 2024-02-15T18:27:15.022 INFO:tasks.workunit.client.1.smithi133.stdout:0/781: unlink d9/d10/d19/d29/d67/fa4 0 2024-02-15T18:27:15.023 INFO:tasks.workunit.client.1.smithi133.stdout:6/984: dread d0/db/d29/d34/d5d/fa6 [0,4194304] 0 2024-02-15T18:27:15.023 INFO:tasks.workunit.client.1.smithi133.stdout:9/599: dread d0/d8/d9/d12/d82/d89/f99 [0,4194304] 0 2024-02-15T18:27:15.023 INFO:tasks.workunit.client.1.smithi133.stdout:9/600: chown d0/d37/l38 107849 1 2024-02-15T18:27:15.024 INFO:tasks.workunit.client.1.smithi133.stdout:0/782: symlink d9/d10/d22/l103 0 2024-02-15T18:27:15.024 INFO:tasks.workunit.client.1.smithi133.stdout:0/783: truncate d9/d10/d19/d8c/ff0 1683707 0 2024-02-15T18:27:15.027 INFO:tasks.workunit.client.1.smithi133.stdout:8/602: rmdir d3/d7/d40 39 2024-02-15T18:27:15.030 INFO:tasks.workunit.client.1.smithi133.stdout:6/985: symlink d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/d11d/d12a/d13f/l145 0 2024-02-15T18:27:15.034 INFO:tasks.workunit.client.1.smithi133.stdout:0/784: link d9/d10/d19/f78 d9/d10/d47/d5e/f104 0 2024-02-15T18:27:15.045 INFO:tasks.workunit.client.1.smithi133.stdout:2/738: dwrite d7/d18/d32/d65/fa0 [0,4194304] 0 2024-02-15T18:27:15.047 INFO:tasks.workunit.client.1.smithi133.stdout:8/603: dread d3/d7/f95 [0,4194304] 0 2024-02-15T18:27:15.049 INFO:tasks.workunit.client.1.smithi133.stdout:2/739: link d7/db/d67/da7/fc6 d7/d2c/d3b/d48/d59/d74/fec 0 2024-02-15T18:27:15.049 INFO:tasks.workunit.client.1.smithi133.stdout:2/740: fdatasync d7/d2c/d3b/d48/d59/d74/fec 0 2024-02-15T18:27:15.050 INFO:tasks.workunit.client.1.smithi133.stdout:2/741: stat d7/d2c/d31/lb8 0 2024-02-15T18:27:15.050 INFO:tasks.workunit.client.1.smithi133.stdout:2/742: chown d7/d2c/d5a/d66/d70/da8/cb9 29439641 1 2024-02-15T18:27:15.050 INFO:tasks.workunit.client.1.smithi133.stdout:2/743: fsync d7/d18/d32/d65/d99/fbe 0 2024-02-15T18:27:15.050 INFO:tasks.workunit.client.1.smithi133.stdout:2/744: truncate d7/d2c/d3b/d48/d59/fd3 37233 0 2024-02-15T18:27:15.050 INFO:tasks.workunit.client.1.smithi133.stdout:8/604: rename d3/d7/l3d to d3/de/lca 0 2024-02-15T18:27:15.050 INFO:tasks.workunit.client.1.smithi133.stdout:8/605: chown d3/de/f25 1 1 2024-02-15T18:27:15.051 INFO:tasks.workunit.client.1.smithi133.stdout:2/745: link d7/d2c/d3b/d48/d6d/f8b d7/d18/dc2/fed 0 2024-02-15T18:27:15.053 INFO:tasks.workunit.client.1.smithi133.stdout:2/746: dread d7/d2c/d31/f6a [0,4194304] 0 2024-02-15T18:27:15.053 INFO:tasks.workunit.client.1.smithi133.stdout:2/747: readlink d7/d2c/d46/l4f 0 2024-02-15T18:27:15.062 INFO:tasks.workunit.client.1.smithi133.stdout:1/898: dwrite d6/d1e/d3a/d79/dfa/fc3 [0,4194304] 0 2024-02-15T18:27:15.072 INFO:tasks.workunit.client.1.smithi133.stdout:2/748: dread f1 [4194304,4194304] 0 2024-02-15T18:27:15.074 INFO:tasks.workunit.client.1.smithi133.stdout:2/749: mknod d7/db/cee 0 2024-02-15T18:27:15.075 INFO:tasks.workunit.client.1.smithi133.stdout:5/575: dwrite d17/d2a/f42 [0,4194304] 0 2024-02-15T18:27:15.075 INFO:tasks.workunit.client.1.smithi133.stdout:9/601: dwrite d0/d8/d9/f31 [0,4194304] 0 2024-02-15T18:27:15.076 INFO:tasks.workunit.client.1.smithi133.stdout:2/750: link d7/d2c/d31/c8e d7/db/d67/cef 0 2024-02-15T18:27:15.076 INFO:tasks.workunit.client.1.smithi133.stdout:8/606: dwrite d3/d1f/d3f/f85 [0,4194304] 0 2024-02-15T18:27:15.076 INFO:tasks.workunit.client.1.smithi133.stdout:6/986: dwrite d0/f27 [0,4194304] 0 2024-02-15T18:27:15.077 INFO:tasks.workunit.client.1.smithi133.stdout:0/785: dwrite d9/d10/d47/f62 [0,4194304] 0 2024-02-15T18:27:15.079 INFO:tasks.workunit.client.1.smithi133.stdout:9/602: dread d0/d8/d9/d12/d82/d42/fae [0,4194304] 0 2024-02-15T18:27:15.079 INFO:tasks.workunit.client.1.smithi133.stdout:9/603: truncate d0/d8/f56 2500135 0 2024-02-15T18:27:15.085 INFO:tasks.workunit.client.1.smithi133.stdout:2/751: creat d7/db/ff0 x:0 0 0 2024-02-15T18:27:15.085 INFO:tasks.workunit.client.1.smithi133.stdout:2/752: stat d7/l25 0 2024-02-15T18:27:15.088 INFO:tasks.workunit.client.1.smithi133.stdout:8/607: link d3/d7/c15 d3/de/d3e/ccb 0 2024-02-15T18:27:15.091 INFO:tasks.workunit.client.1.smithi133.stdout:5/576: dread d17/d20/d32/d38/f54 [0,4194304] 0 2024-02-15T18:27:15.093 INFO:tasks.workunit.client.1.smithi133.stdout:6/987: rename d0/db/d29/d34/d5d/dda/ffa to d0/db/f146 0 2024-02-15T18:27:15.094 INFO:tasks.workunit.client.1.smithi133.stdout:9/604: mkdir d0/d8/d10/d4d/dc6 0 2024-02-15T18:27:15.094 INFO:tasks.workunit.client.1.smithi133.stdout:2/753: mkdir d7/d18/d32/df1 0 2024-02-15T18:27:15.095 INFO:tasks.workunit.client.1.smithi133.stdout:2/754: dread - d7/d2c/d5a/fd2 zero size 2024-02-15T18:27:15.095 INFO:tasks.workunit.client.1.smithi133.stdout:2/755: chown d7/d2c/d3b/d48/d59/lcd 34364 1 2024-02-15T18:27:15.095 INFO:tasks.workunit.client.1.smithi133.stdout:2/756: dread - d7/d18/d32/d65/f56 zero size 2024-02-15T18:27:15.097 INFO:tasks.workunit.client.1.smithi133.stdout:2/757: mkdir d7/d18/d32/ddc/df2 0 2024-02-15T18:27:15.097 INFO:tasks.workunit.client.1.smithi133.stdout:6/988: mknod d0/db/d29/d34/d5d/d40/dde/d67/d9a/d126/c147 0 2024-02-15T18:27:15.097 INFO:tasks.workunit.client.1.smithi133.stdout:6/989: fdatasync d0/db/d29/d34/d5d/dda/f136 0 2024-02-15T18:27:15.098 INFO:tasks.workunit.client.1.smithi133.stdout:2/758: creat d7/d18/d32/d65/d58/ff3 x:0 0 0 2024-02-15T18:27:15.099 INFO:tasks.workunit.client.1.smithi133.stdout:2/759: symlink d7/d18/d32/d65/d54/dc9/de7/dd9/lf4 0 2024-02-15T18:27:15.102 INFO:tasks.workunit.client.1.smithi133.stdout:2/760: write d7/f30 [2279151,17650] 0 2024-02-15T18:27:15.104 INFO:tasks.workunit.client.1.smithi133.stdout:2/761: link d7/d18/f8a d7/d2c/d3b/d48/d6d/ff5 0 2024-02-15T18:27:15.104 INFO:tasks.workunit.client.1.smithi133.stdout:2/762: readlink d7/d18/d32/d65/l4e 0 2024-02-15T18:27:15.108 INFO:tasks.workunit.client.1.smithi133.stdout:2/763: mkdir d7/db/df6 0 2024-02-15T18:27:15.112 INFO:tasks.workunit.client.1.smithi133.stdout:8/608: dwrite d3/d1c/f97 [0,4194304] 0 2024-02-15T18:27:15.115 INFO:tasks.workunit.client.1.smithi133.stdout:8/609: creat d3/d1f/d3f/fcc x:0 0 0 2024-02-15T18:27:15.116 INFO:tasks.workunit.client.1.smithi133.stdout:8/610: stat d3/d1c/l69 0 2024-02-15T18:27:15.119 INFO:tasks.workunit.client.1.smithi133.stdout:8/611: creat d3/d1c/d2f/d87/d73/d84/fcd x:0 0 0 2024-02-15T18:27:15.121 INFO:tasks.workunit.client.1.smithi133.stdout:8/612: mkdir d3/d7/d40/dce 0 2024-02-15T18:27:15.122 INFO:tasks.workunit.client.1.smithi133.stdout:0/786: dwrite d9/d10/d19/d29/d67/d68/d9c/da7/fbf [0,4194304] 0 2024-02-15T18:27:15.122 INFO:tasks.workunit.client.1.smithi133.stdout:0/787: dread - d9/d10/d19/d29/d67/d68/d96/d44/fd5 zero size 2024-02-15T18:27:15.122 INFO:tasks.workunit.client.1.smithi133.stdout:0/788: fdatasync d9/d10/d2c/f7c 0 2024-02-15T18:27:15.126 INFO:tasks.workunit.client.1.smithi133.stdout:0/789: rmdir d9/d28 39 2024-02-15T18:27:15.126 INFO:tasks.workunit.client.1.smithi133.stdout:0/790: readlink d9/d2b/l88 0 2024-02-15T18:27:15.127 INFO:tasks.workunit.client.1.smithi133.stdout:0/791: write d9/d10/d19/d29/d67/d68/d96/d44/f6a [519735,113480] 0 2024-02-15T18:27:15.141 INFO:tasks.workunit.client.1.smithi133.stdout:8/613: dread d3/d1f/d4f/f64 [8388608,4194304] 0 2024-02-15T18:27:15.141 INFO:tasks.workunit.client.1.smithi133.stdout:2/764: dwrite d7/d18/d32/d65/d54/f83 [4194304,4194304] 0 2024-02-15T18:27:15.142 INFO:tasks.workunit.client.1.smithi133.stdout:8/614: truncate d3/d1c/f51 3379854 0 2024-02-15T18:27:15.143 INFO:tasks.workunit.client.1.smithi133.stdout:2/765: creat d7/db/df6/ff7 x:0 0 0 2024-02-15T18:27:15.148 INFO:tasks.workunit.client.1.smithi133.stdout:6/990: dwrite d0/d62/d66/fcd [0,4194304] 0 2024-02-15T18:27:15.151 INFO:tasks.workunit.client.1.smithi133.stdout:9/605: dwrite d0/d8/d9/f8c [0,4194304] 0 2024-02-15T18:27:15.152 INFO:tasks.workunit.client.1.smithi133.stdout:6/991: symlink d0/db/d29/d34/d5d/d40/dde/d78/d7f/df1/d106/d8e/d11d/l148 0 2024-02-15T18:27:15.152 INFO:tasks.workunit.client.1.smithi133.stdout:6/992: fsync d0/db/f70 0 2024-02-15T18:27:15.154 INFO:tasks.workunit.client.1.smithi133.stdout:9/606: creat d0/d8/d9/d12/d82/d42/d44/fc7 x:0 0 0 2024-02-15T18:27:15.154 INFO:tasks.workunit.client.1.smithi133.stdout:9/607: readlink d0/d8/d9/d12/d82/d42/d44/l53 0 2024-02-15T18:27:15.154 INFO:tasks.workunit.client.1.smithi133.stdout:6/993: mkdir d0/db/d29/d34/d5d/dc9/df7/d149 0 2024-02-15T18:27:15.158 INFO:tasks.workunit.client.1.smithi133.stdout:5/577: dwrite d17/d2a/f2d [0,4194304] 0 2024-02-15T18:27:15.158 INFO:tasks.workunit.client.1.smithi133.stdout:5/578: stat d17/d20/f2f 0 2024-02-15T18:27:15.160 INFO:tasks.workunit.client.1.smithi133.stdout:0/792: truncate d9/d10/d19/d29/d67/d68/d96/d44/f6a 647300 0 2024-02-15T18:27:15.162 INFO:tasks.workunit.client.1.smithi133.stdout:8/615: dread d3/d1f/d3f/f85 [0,4194304] 0 2024-02-15T18:27:15.162 INFO:tasks.workunit.client.1.smithi133.stdout:6/994: creat d0/d62/d66/d11b/f14a x:0 0 0 2024-02-15T18:27:15.164 INFO:tasks.workunit.client.1.smithi133.stdout:0/793: stat d9/d10/d22/d2f/d9f/fb2 0 2024-02-15T18:27:15.165 INFO:tasks.workunit.client.1.smithi133.stdout:8/616: unlink d3/d92/db4/fbb 0 2024-02-15T18:27:15.167 INFO:tasks.workunit.client.1.smithi133.stdout:8/617: mknod d3/d1f/d3f/d58/ccf 0 2024-02-15T18:27:15.167 INFO:tasks.workunit.client.1.smithi133.stdout:8/618: getdents d3/d7/d40/dce 0 2024-02-15T18:27:15.168 INFO:tasks.workunit.client.1.smithi133.stdout:8/619: creat d3/d7/d40/fd0 x:0 0 0 2024-02-15T18:27:15.169 INFO:tasks.workunit.client.1.smithi133.stdout:2/766: dwrite d7/d2c/d31/f81 [0,4194304] 0 2024-02-15T18:27:15.171 INFO:tasks.workunit.client.1.smithi133.stdout:8/620: link d3/de/f66 d3/d7/d40/d61/fd1 0 2024-02-15T18:27:15.171 INFO:tasks.workunit.client.1.smithi133.stdout:5/579: dread ff [0,4194304] 0 2024-02-15T18:27:15.171 INFO:tasks.workunit.client.1.smithi133.stdout:5/580: dread - d17/f9b zero size 2024-02-15T18:27:15.173 INFO:tasks.workunit.client.1.smithi133.stdout:2/767: symlink d7/d2c/d5a/d66/d70/lf8 0 2024-02-15T18:27:15.173 INFO:tasks.workunit.client.1.smithi133.stdout:2/768: fdatasync d7/d2c/fa4 0 2024-02-15T18:27:15.175 INFO:tasks.workunit.client.1.smithi133.stdout:2/769: mknod d7/d2c/d3b/d48/d59/cf9 0 2024-02-15T18:27:15.177 INFO:tasks.workunit.client.1.smithi133.stdout:2/770: creat d7/d2c/d5a/d66/da5/ffa x:0 0 0 2024-02-15T18:27:15.177 INFO:tasks.workunit.client.1.smithi133.stdout:2/771: fsync d7/d18/d32/d65/f55 0 2024-02-15T18:27:15.182 INFO:tasks.workunit.client.1.smithi133.stdout:9/608: dwrite d0/f55 [0,4194304] 0 2024-02-15T18:27:15.184 INFO:tasks.workunit.client.1.smithi133.stdout:2/772: mkdir d7/d18/d32/d65/d99/dfb 0 2024-02-15T18:27:15.184 INFO:tasks.workunit.client.1.smithi133.stdout:8/621: dread d3/d1c/f1e [8388608,4194304] 0 2024-02-15T18:27:15.184 INFO:tasks.workunit.client.0.smithi084.stdout:3/939: sync 2024-02-15T18:27:15.185 INFO:tasks.workunit.client.1.smithi133.stdout:6/995: dwrite d0/db/d29/f47 [0,4194304] 0 2024-02-15T18:27:15.187 INFO:tasks.workunit.client.1.smithi133.stdout:9/609: creat d0/d8/d10/d4d/dc6/fc8 x:0 0 0 2024-02-15T18:27:15.187 INFO:tasks.workunit.client.1.smithi133.stdout:9/610: stat d0/d8/d9/d12/d82/f7c 0 2024-02-15T18:27:15.187 INFO:tasks.workunit.client.1.smithi133.stdout:9/611: readlink d0/d8/d9/d12/d82/lbb 0 2024-02-15T18:27:15.187 INFO:tasks.workunit.client.1.smithi133.stdout:2/773: rmdir d7/d18/d32/d65/d54 39 2024-02-15T18:27:15.188 INFO:tasks.workunit.client.1.smithi133.stdout:8/622: creat d3/de/d3e/d82/d8b/fd2 x:0 0 0 2024-02-15T18:27:15.188 INFO:tasks.workunit.client.1.smithi133.stdout:8/623: fsync d3/d1f/d3f/f85 0 2024-02-15T18:27:15.191 INFO:tasks.workunit.client.1.smithi133.stdout:6/996: rename d0/db/d29/d34/d5d/d40/dde/d9d/c125 to d0/db/d29/d34/d5d/d40/dde/d67/d9a/d126/c14b 0 2024-02-15T18:27:15.191 INFO:tasks.workunit.client.1.smithi133.stdout:9/612: mknod d0/d8/d10/db2/cc9 0 2024-02-15T18:27:15.192 INFO:tasks.workunit.client.1.smithi133.stdout:8/624: mkdir d3/d1c/d2f/d87/d73/d84/dd3 0 2024-02-15T18:27:15.193 INFO:tasks.workunit.client.1.smithi133.stdout:6/997: mkdir d0/db/d14c 0 2024-02-15T18:27:15.199 INFO:tasks.workunit.client.1.smithi133.stdout:2/774: dread d7/db/f21 [0,4194304] 0 2024-02-15T18:27:15.201 INFO:tasks.workunit.client.1.smithi133.stdout:8/625: dread d3/f3a [0,4194304] 0 2024-02-15T18:27:15.210 INFO:tasks.workunit.client.1.smithi133.stdout:5/581: dwrite d17/d20/d32/f37 [0,4194304] 0 2024-02-15T18:27:15.211 INFO:tasks.workunit.client.1.smithi133.stdout:2/775: dread d7/d18/d32/d65/fa0 [0,4194304] 0 2024-02-15T18:27:15.211 INFO:tasks.workunit.client.1.smithi133.stdout:2/776: write d7/d18/d32/d65/d99/fc3 [227472,38843] 0 2024-02-15T18:27:15.211 INFO:tasks.workunit.client.1.smithi133.stdout:2/777: truncate d7/f15 4230477 0 2024-02-15T18:27:15.211 INFO:tasks.workunit.client.1.smithi133.stdout:2/778: chown d7/f16 1 1 2024-02-15T18:27:15.212 INFO:tasks.workunit.client.1.smithi133.stdout:7/614: sync 2024-02-15T18:27:15.213 INFO:tasks.workunit.client.1.smithi133.stdout:5/582: mknod d17/d20/d32/d9d/da9/cb7 0 2024-02-15T18:27:15.213 INFO:tasks.workunit.client.1.smithi133.stdout:5/583: fsync d17/d26/f21 0 2024-02-15T18:27:15.214 INFO:tasks.workunit.client.1.smithi133.stdout:2/779: creat d7/ffc x:0 0 0 2024-02-15T18:27:15.214 INFO:tasks.workunit.client.1.smithi133.stdout:2/780: write d7/d18/d32/d65/f55 [337995,114369] 0 2024-02-15T18:27:15.214 INFO:tasks.workunit.client.1.smithi133.stdout:2/781: stat d7/d18/d32/ddc 0 2024-02-15T18:27:15.215 INFO:tasks.workunit.client.1.smithi133.stdout:2/782: truncate d7/d2c/d5a/d66/da5/fe5 673313 0 2024-02-15T18:27:15.216 INFO:tasks.workunit.client.1.smithi133.stdout:2/783: truncate d7/f13 150317 0 2024-02-15T18:27:15.221 INFO:tasks.workunit.client.1.smithi133.stdout:2/784: rename d7/db/f1d to d7/ffd 0 2024-02-15T18:27:15.222 INFO:tasks.workunit.client.1.smithi133.stdout:2/785: mkdir d7/d2c/d5a/d66/dfe 0 2024-02-15T18:27:15.226 INFO:tasks.workunit.client.1.smithi133.stdout:3/794: sync 2024-02-15T18:27:15.228 INFO:tasks.workunit.client.1.smithi133.stdout:3/795: link d0/d15/d2f/d9b/d62/lb9 d0/d15/d2f/dad/l103 0 2024-02-15T18:27:15.230 INFO:tasks.workunit.client.1.smithi133.stdout:3/796: creat d0/d15/d2f/d9b/d39/da2/f104 x:0 0 0 2024-02-15T18:27:15.230 INFO:tasks.workunit.client.1.smithi133.stdout:0/794: dwrite d9/d10/d47/f5a [0,4194304] 0 2024-02-15T18:27:15.231 INFO:tasks.workunit.client.1.smithi133.stdout:9/613: dwrite d0/d37/fb9 [0,4194304] 0 2024-02-15T18:27:15.232 INFO:tasks.workunit.client.1.smithi133.stdout:6/998: dwrite d0/f27 [0,4194304] 0 2024-02-15T18:27:15.234 INFO:tasks.workunit.client.1.smithi133.stdout:3/797: write d0/d15/d2f/d9b/d39/da2/fab [2544535,128867] 0 2024-02-15T18:27:15.234 INFO:tasks.workunit.client.1.smithi133.stdout:3/798: chown d0/d15/d2f/d5e/dff 211652448 1 2024-02-15T18:27:15.234 INFO:tasks.workunit.client.1.smithi133.stdout:3/799: dread - d0/d15/d2f/d9b/d39/f63 zero size 2024-02-15T18:27:15.235 INFO:tasks.workunit.client.1.smithi133.stdout:0/795: mknod d9/d10/d2c/df3/c105 0 2024-02-15T18:27:15.239 INFO:tasks.workunit.client.1.smithi133.stdout:9/614: mkdir d0/d8/d9/d12/d7f/dca 0 2024-02-15T18:27:15.240 INFO:tasks.workunit.client.1.smithi133.stdout:6/999: creat d0/db/d29/d34/d5d/dc9/f14d x:0 0 0 2024-02-15T18:27:15.242 INFO:tasks.workunit.client.1.smithi133.stdout:3/800: rename d0/d15/d2f/d9b/d39/d3f/l5d to d0/d15/d2f/d9b/d39/d3f/l105 0 2024-02-15T18:27:15.242 INFO:tasks.workunit.client.1.smithi133.stdout:3/801: readlink d0/d15/d54/da5/lf3 0 2024-02-15T18:27:15.242 INFO:tasks.workunit.client.1.smithi133.stdout:3/802: fdatasync d0/d15/d37/f59 0 2024-02-15T18:27:15.243 INFO:tasks.workunit.client.1.smithi133.stdout:9/615: link d0/d8/l3e d0/d8/d9/d49/d4c/dba/lcb 0 2024-02-15T18:27:15.244 INFO:tasks.workunit.client.1.smithi133.stdout:5/584: dwrite d17/d20/d32/d38/d86/db6/fad [0,4194304] 0 2024-02-15T18:27:15.244 INFO:tasks.workunit.client.1.smithi133.stdout:5/585: chown d17/l25 0 1 2024-02-15T18:27:15.244 INFO:tasks.workunit.client.1.smithi133.stdout:5/586: readlink d17/d20/d4f/d5f/d93/lb3 0 2024-02-15T18:27:15.244 INFO:tasks.workunit.client.1.smithi133.stdout:7/615: dwrite d9/da/d48/d62/d64/fd1 [0,4194304] 0 2024-02-15T18:27:15.244 INFO:tasks.workunit.client.1.smithi133.stdout:8/626: dwrite d3/d7/f26 [0,4194304] 0 2024-02-15T18:27:15.245 INFO:tasks.workunit.client.1.smithi133.stdout:3/803: mkdir d0/d15/d2f/db4/d106 0 2024-02-15T18:27:15.251 INFO:tasks.workunit.client.1.smithi133.stdout:9/616: rename d0/d8/d9/f8c to d0/fcc 0 2024-02-15T18:27:15.251 INFO:tasks.workunit.client.1.smithi133.stdout:9/617: chown d0/fc1 553 1 2024-02-15T18:27:15.251 INFO:tasks.workunit.client.1.smithi133.stdout:9/618: write d0/d8/f47 [433832,43488] 0 2024-02-15T18:27:15.251 INFO:tasks.workunit.client.1.smithi133.stdout:9/619: write d0/d8/d9/f3b [3006114,35600] 0 2024-02-15T18:27:15.251 INFO:tasks.workunit.client.1.smithi133.stdout:9/620: read - d0/d8/d9/d12/f8a zero size 2024-02-15T18:27:15.254 INFO:tasks.workunit.client.1.smithi133.stdout:1/899: sync 2024-02-15T18:27:15.254 INFO:tasks.workunit.client.1.smithi133.stdout:4/515: sync 2024-02-15T18:27:15.254 INFO:tasks.workunit.client.1.smithi133.stdout:4/516: chown d2/f9 0 1 2024-02-15T18:27:15.254 INFO:tasks.workunit.client.1.smithi133.stdout:0/796: dwrite d9/d10/d22/d2f/f51 [0,4194304] 0 2024-02-15T18:27:15.255 INFO:tasks.workunit.client.1.smithi133.stdout:7/616: creat d9/db/dc/fd6 x:0 0 0 2024-02-15T18:27:15.259 INFO:tasks.workunit.client.1.smithi133.stdout:8/627: symlink d3/d1c/d2f/d76/ld4 0 2024-02-15T18:27:15.260 INFO:tasks.workunit.client.1.smithi133.stdout:3/804: mkdir d0/d15/d37/d4a/dc4/d107 0 2024-02-15T18:27:15.260 INFO:tasks.workunit.client.1.smithi133.stdout:3/805: write d0/d15/d2f/f7d [713505,4675] 0 2024-02-15T18:27:15.260 INFO:tasks.workunit.client.1.smithi133.stdout:3/806: read - d0/d15/d2f/d9b/d39/d3f/dc1/d78/f96 zero size 2024-02-15T18:27:15.260 INFO:tasks.workunit.client.1.smithi133.stdout:3/807: chown d0/d15/l80 9951328 1 2024-02-15T18:27:15.260 INFO:tasks.workunit.client.1.smithi133.stdout:9/621: creat d0/d8/d9/fcd x:0 0 0 2024-02-15T18:27:15.260 INFO:tasks.workunit.client.1.smithi133.stdout:4/517: mknod d2/d5/ca9 0 2024-02-15T18:27:15.260 INFO:tasks.workunit.client.1.smithi133.stdout:4/518: chown d2/d5/d2b/d21/d2d/f71 870621241 1 2024-02-15T18:27:15.260 INFO:tasks.workunit.client.1.smithi133.stdout:4/519: chown d2/d5/d2b/d21/d3b/d49/c79 4 1 2024-02-15T18:27:15.262 INFO:tasks.workunit.client.1.smithi133.stdout:1/900: creat d6/d2a/d59/d5a/da4/daa/f14a x:0 0 0 2024-02-15T18:27:15.262 INFO:tasks.workunit.client.1.smithi133.stdout:1/901: truncate d6/d1e/d3a/d82/d85/dc7/f11f 362396 0 2024-02-15T18:27:15.263 INFO:tasks.workunit.client.1.smithi133.stdout:9/622: mknod d0/d8/cce 0 2024-02-15T18:27:15.263 INFO:tasks.workunit.client.1.smithi133.stdout:9/623: write d0/d37/fa0 [516069,91668] 0 2024-02-15T18:27:15.265 INFO:tasks.workunit.client.1.smithi133.stdout:9/624: creat d0/d8/fcf x:0 0 0 2024-02-15T18:27:15.269 INFO:tasks.workunit.client.1.smithi133.stdout:4/520: write d2/d5/fa0 [637817,112163] 0 2024-02-15T18:27:15.269 INFO:tasks.workunit.client.1.smithi133.stdout:3/808: dread d0/d15/d2f/d9b/d39/fa1 [0,4194304] 0 2024-02-15T18:27:15.272 INFO:tasks.workunit.client.1.smithi133.stdout:3/809: rename d0/d15/d2f/d9b/d39/lf6 to d0/d15/d2f/d9b/d72/dbf/dd9/l108 0 2024-02-15T18:27:15.272 INFO:tasks.workunit.client.1.smithi133.stdout:2/786: dwrite d7/f13 [0,4194304] 0 2024-02-15T18:27:15.272 INFO:tasks.workunit.client.1.smithi133.stdout:4/521: symlink d2/d5/d2b/d21/d2d/d44/d51/d95/laa 0 2024-02-15T18:27:15.272 INFO:tasks.workunit.client.1.smithi133.stdout:4/522: fdatasync d2/f9 0 2024-02-15T18:27:15.272 INFO:tasks.workunit.client.1.smithi133.stdout:4/523: fsync d2/d5/d2b/d21/fa1 0 2024-02-15T18:27:15.274 INFO:tasks.workunit.client.1.smithi133.stdout:0/797: dwrite d9/d10/d22/fd1 [0,4194304] 0 2024-02-15T18:27:15.274 INFO:tasks.workunit.client.1.smithi133.stdout:1/902: dread d6/d1e/d41/d7c/d7e/f94 [0,4194304] 0 2024-02-15T18:27:15.274 INFO:tasks.workunit.client.1.smithi133.stdout:1/903: write d6/d1e/d3a/d79/d8e/f10e [373323,49454] 0 2024-02-15T18:27:15.277 INFO:tasks.workunit.client.1.smithi133.stdout:8/628: dread d3/d1f/d4f/f64 [4194304,4194304] 0 2024-02-15T18:27:15.282 INFO:tasks.workunit.client.1.smithi133.stdout:9/625: dread d0/d8/f48 [0,4194304] 0 2024-02-15T18:27:15.284 INFO:tasks.workunit.client.1.smithi133.stdout:3/810: creat d0/d15/d2f/d9b/dec/f109 x:0 0 0 2024-02-15T18:27:15.286 INFO:tasks.workunit.client.1.smithi133.stdout:2/787: creat d7/d2c/d5a/d66/da5/fff x:0 0 0 2024-02-15T18:27:15.288 INFO:tasks.workunit.client.1.smithi133.stdout:8/629: rename d3/d1c/c32 to d3/cd5 0 2024-02-15T18:27:15.289 INFO:tasks.workunit.client.1.smithi133.stdout:9/626: creat d0/d7b/fd0 x:0 0 0 2024-02-15T18:27:15.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/627: truncate d0/d8/fcf 20820 0 2024-02-15T18:27:15.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/628: truncate d0/d7b/fbc 262110 0 2024-02-15T18:27:15.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/629: truncate d0/faf 359558 0 2024-02-15T18:27:15.293 INFO:tasks.workunit.client.1.smithi133.stdout:8/630: creat d3/de/fd6 x:0 0 0 2024-02-15T18:27:15.295 INFO:tasks.workunit.client.1.smithi133.stdout:9/630: symlink d0/d8/d9/d12/d82/d42/d79/ld1 0 2024-02-15T18:27:15.296 INFO:tasks.workunit.client.1.smithi133.stdout:2/788: getdents d7/d2c/d3b/d48 0 2024-02-15T18:27:15.296 INFO:tasks.workunit.client.1.smithi133.stdout:2/789: fdatasync d7/db/f43 0 2024-02-15T18:27:15.299 INFO:tasks.workunit.client.1.smithi133.stdout:4/524: dwrite d2/d5/d2b/f1d [0,4194304] 0 2024-02-15T18:27:15.299 INFO:tasks.workunit.client.1.smithi133.stdout:4/525: write d2/d5/d2b/d21/f8f [856127,40754] 0 2024-02-15T18:27:15.299 INFO:tasks.workunit.client.1.smithi133.stdout:8/631: getdents d3/d1f/d3f 0 2024-02-15T18:27:15.300 INFO:tasks.workunit.client.1.smithi133.stdout:2/790: rmdir d7/d18/d32/d65/d54/dc9 39 2024-02-15T18:27:15.300 INFO:tasks.workunit.client.1.smithi133.stdout:2/791: read - d7/d18/fa6 zero size 2024-02-15T18:27:15.301 INFO:tasks.workunit.client.1.smithi133.stdout:4/526: mkdir d2/d5/d2b/d21/d36/dab 0 2024-02-15T18:27:15.301 INFO:tasks.workunit.client.1.smithi133.stdout:8/632: mknod d3/d7/d40/cd7 0 2024-02-15T18:27:15.303 INFO:tasks.workunit.client.1.smithi133.stdout:2/792: rmdir d7/d18/d32 39 2024-02-15T18:27:15.303 INFO:tasks.workunit.client.1.smithi133.stdout:2/793: read d7/d18/f9d [433734,58541] 0 2024-02-15T18:27:15.304 INFO:tasks.workunit.client.1.smithi133.stdout:8/633: link d3/f14 d3/d1f/d4f/dab/fd8 0 2024-02-15T18:27:15.305 INFO:tasks.workunit.client.1.smithi133.stdout:4/527: symlink d2/d5/d2b/d21/d2d/d44/da4/lac 0 2024-02-15T18:27:15.306 INFO:tasks.workunit.client.1.smithi133.stdout:2/794: link d7/d18/c1c d7/db/d35/ddf/c100 0 2024-02-15T18:27:15.307 INFO:tasks.workunit.client.0.smithi084.stdout:3/940: sync 2024-02-15T18:27:15.307 INFO:tasks.workunit.client.1.smithi133.stdout:2/795: creat d7/db/f101 x:0 0 0 2024-02-15T18:27:15.309 INFO:tasks.workunit.client.1.smithi133.stdout:2/796: creat d7/d2c/d5a/d66/dfe/f102 x:0 0 0 2024-02-15T18:27:15.309 INFO:tasks.workunit.client.0.smithi084.stdout:3/941: creat d8/d73/db9/d13e/d80/d106/f142 x:0 0 0 2024-02-15T18:27:15.312 INFO:tasks.workunit.client.1.smithi133.stdout:2/797: truncate d7/d18/d32/d65/f7d 2487516 0 2024-02-15T18:27:15.312 INFO:tasks.workunit.client.1.smithi133.stdout:2/798: fsync d7/d2c/f44 0 2024-02-15T18:27:15.315 INFO:tasks.workunit.client.1.smithi133.stdout:2/799: creat d7/db/d67/da7/f103 x:0 0 0 2024-02-15T18:27:15.317 INFO:tasks.workunit.client.1.smithi133.stdout:1/904: dwrite d6/f29 [0,4194304] 0 2024-02-15T18:27:15.318 INFO:tasks.workunit.client.1.smithi133.stdout:1/905: write d6/d1e/d3a/d82/d85/d67/dd3/fe2 [310155,8371] 0 2024-02-15T18:27:15.319 INFO:tasks.workunit.client.1.smithi133.stdout:1/906: chown d6/d2a/d59/d5a/da4/le0 67 1 2024-02-15T18:27:15.319 INFO:tasks.workunit.client.1.smithi133.stdout:1/907: dread - d6/d89/fcb zero size 2024-02-15T18:27:15.320 INFO:tasks.workunit.client.1.smithi133.stdout:1/908: mkdir d6/d1e/d3a/d79/dbd/d14b 0 2024-02-15T18:27:15.321 INFO:tasks.workunit.client.1.smithi133.stdout:3/811: dwrite d0/d15/d2f/f30 [0,4194304] 0 2024-02-15T18:27:15.321 INFO:tasks.workunit.client.1.smithi133.stdout:3/812: dread - d0/d15/d2f/d9b/d9d/fcb zero size 2024-02-15T18:27:15.322 INFO:tasks.workunit.client.1.smithi133.stdout:0/798: dwrite d9/f75 [0,4194304] 0 2024-02-15T18:27:15.322 INFO:tasks.workunit.client.1.smithi133.stdout:1/909: truncate d6/d2a/f48 2189721 0 2024-02-15T18:27:15.327 INFO:tasks.workunit.client.1.smithi133.stdout:1/910: rename d6/d1e/d41/f58 to d6/d1e/d3a/d82/d85/d67/ddb/f14c 0 2024-02-15T18:27:15.327 INFO:tasks.workunit.client.1.smithi133.stdout:1/911: chown d6/d1e/d3a/d79/dbd 12 1 2024-02-15T18:27:15.328 INFO:tasks.workunit.client.1.smithi133.stdout:8/634: dwrite d3/de/f53 [0,4194304] 0 2024-02-15T18:27:15.333 INFO:tasks.workunit.client.1.smithi133.stdout:3/813: write d0/d15/d2f/d9b/d72/dbf/fd8 [715094,42574] 0 2024-02-15T18:27:15.333 INFO:tasks.workunit.client.1.smithi133.stdout:3/814: stat d0/d15/d54/ddc/fb1 0 2024-02-15T18:27:15.333 INFO:tasks.workunit.client.1.smithi133.stdout:3/815: fsync d0/d15/d2f/d9b/f41 0 2024-02-15T18:27:15.335 INFO:tasks.workunit.client.1.smithi133.stdout:8/635: creat d3/d1f/d3f/d58/fd9 x:0 0 0 2024-02-15T18:27:15.335 INFO:tasks.workunit.client.1.smithi133.stdout:3/816: creat d0/d15/d2f/f10a x:0 0 0 2024-02-15T18:27:15.337 INFO:tasks.workunit.client.1.smithi133.stdout:3/817: unlink d0/d15/d2f/d9b/d39/d3f/lae 0 2024-02-15T18:27:15.349 INFO:tasks.workunit.client.1.smithi133.stdout:3/818: dread d0/d15/d37/f59 [0,4194304] 0 2024-02-15T18:27:15.349 INFO:tasks.workunit.client.1.smithi133.stdout:3/819: truncate d0/d15/d2f/d9b/dec/f109 144883 0 2024-02-15T18:27:15.349 INFO:tasks.workunit.client.1.smithi133.stdout:3/820: stat d0/d15/d2f/d5e/f76 0 2024-02-15T18:27:15.349 INFO:tasks.workunit.client.1.smithi133.stdout:9/631: dwrite d0/d37/fa0 [0,4194304] 0 2024-02-15T18:27:15.350 INFO:tasks.workunit.client.1.smithi133.stdout:3/821: mkdir d0/d15/d2f/d9b/d72/d10b 0 2024-02-15T18:27:15.351 INFO:tasks.workunit.client.1.smithi133.stdout:9/632: dread d0/d7b/fbc [0,4194304] 0 2024-02-15T18:27:15.354 INFO:tasks.workunit.client.1.smithi133.stdout:3/822: mknod d0/d15/d37/d7b/c10c 0 2024-02-15T18:27:15.357 INFO:tasks.workunit.client.1.smithi133.stdout:1/912: dwrite d6/fb4 [0,4194304] 0 2024-02-15T18:27:15.357 INFO:tasks.workunit.client.1.smithi133.stdout:1/913: chown d6/d2a/f4a 2450376 1 2024-02-15T18:27:15.357 INFO:tasks.workunit.client.1.smithi133.stdout:1/914: write d6/d1e/d3a/d82/d85/d67/fc4 [425248,90634] 0 2024-02-15T18:27:15.357 INFO:tasks.workunit.client.1.smithi133.stdout:8/636: dwrite d3/d7/d52/f56 [0,4194304] 0 2024-02-15T18:27:15.357 INFO:tasks.workunit.client.1.smithi133.stdout:3/823: stat d0/d15/d2f/d9b/d39/d3f/dc1/d78/lb5 0 2024-02-15T18:27:15.362 INFO:tasks.workunit.client.1.smithi133.stdout:8/637: mkdir d3/d1c/d2f/d87/d73/d84/dda 0 2024-02-15T18:27:15.366 INFO:tasks.workunit.client.1.smithi133.stdout:3/824: link d0/d15/d2f/d9b/d72/lbd d0/d15/d2f/db4/d106/l10d 0 2024-02-15T18:27:15.367 INFO:tasks.workunit.client.1.smithi133.stdout:9/633: dwrite d0/d8/d9/d12/d82/f2e [0,4194304] 0 2024-02-15T18:27:15.368 INFO:tasks.workunit.client.1.smithi133.stdout:8/638: truncate d3/f3a 1311189 0 2024-02-15T18:27:15.370 INFO:tasks.workunit.client.1.smithi133.stdout:3/825: symlink d0/d15/d2f/d9b/d39/d3f/dc1/l10e 0 2024-02-15T18:27:15.370 INFO:tasks.workunit.client.1.smithi133.stdout:3/826: dread - d0/d15/d2f/d9b/d39/d3f/fbe zero size 2024-02-15T18:27:15.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/634: rmdir d0/d8/d10/d4d/dc6 39 2024-02-15T18:27:15.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/635: stat d0/d8/d10/db2/cc9 0 2024-02-15T18:27:15.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/636: write d0/f7 [1429269,29450] 0 2024-02-15T18:27:15.373 INFO:tasks.workunit.client.1.smithi133.stdout:8/639: rmdir d3/de/d3e/d82 39 2024-02-15T18:27:15.373 INFO:tasks.workunit.client.1.smithi133.stdout:8/640: chown d3/d7/l10 138 1 2024-02-15T18:27:15.375 INFO:tasks.workunit.client.1.smithi133.stdout:3/827: mknod d0/d15/d2f/d9b/dec/c10f 0 2024-02-15T18:27:15.376 INFO:tasks.workunit.client.1.smithi133.stdout:3/828: read d0/d15/d2f/d9b/f43 [713273,19946] 0 2024-02-15T18:27:15.376 INFO:tasks.workunit.client.1.smithi133.stdout:3/829: fsync d0/d15/f67 0 2024-02-15T18:27:15.376 INFO:tasks.workunit.client.1.smithi133.stdout:9/637: symlink d0/d8/ld2 0 2024-02-15T18:27:15.378 INFO:tasks.workunit.client.1.smithi133.stdout:3/830: write d0/d15/d2f/d9b/f41 [2666391,80147] 0 2024-02-15T18:27:15.378 INFO:tasks.workunit.client.1.smithi133.stdout:8/641: dread d3/d7/f95 [0,4194304] 0 2024-02-15T18:27:15.378 INFO:tasks.workunit.client.1.smithi133.stdout:8/642: fdatasync d3/d1c/d37/f5d 0 2024-02-15T18:27:15.379 INFO:tasks.workunit.client.1.smithi133.stdout:8/643: getdents d3/de/d3e/dc4 0 2024-02-15T18:27:15.379 INFO:tasks.workunit.client.1.smithi133.stdout:3/831: creat d0/d15/d2f/d9b/d39/dcd/de6/f110 x:0 0 0 2024-02-15T18:27:15.380 INFO:tasks.workunit.client.1.smithi133.stdout:8/644: symlink d3/de/d3e/d94/ldb 0 2024-02-15T18:27:15.380 INFO:tasks.workunit.client.1.smithi133.stdout:5/587: sync 2024-02-15T18:27:15.381 INFO:tasks.workunit.client.1.smithi133.stdout:8/645: read d3/d1c/d2f/d76/f7e [229701,118176] 0 2024-02-15T18:27:15.382 INFO:tasks.workunit.client.1.smithi133.stdout:5/588: dread d17/d26/f21 [0,4194304] 0 2024-02-15T18:27:15.384 INFO:tasks.workunit.client.1.smithi133.stdout:5/589: symlink d17/d26/lb8 0 2024-02-15T18:27:15.385 INFO:tasks.workunit.client.1.smithi133.stdout:5/590: mknod d17/d2a/cb9 0 2024-02-15T18:27:15.386 INFO:tasks.workunit.client.1.smithi133.stdout:5/591: mknod d17/d20/d4f/d5f/d93/cba 0 2024-02-15T18:27:15.387 INFO:tasks.workunit.client.1.smithi133.stdout:5/592: dread d17/d20/d32/d7d/d7e/f84 [0,4194304] 0 2024-02-15T18:27:15.390 INFO:tasks.workunit.client.1.smithi133.stdout:9/638: dread d0/d8/fd [0,4194304] 0 2024-02-15T18:27:15.391 INFO:tasks.workunit.client.1.smithi133.stdout:3/832: write d0/fc [850330,77353] 0 2024-02-15T18:27:15.392 INFO:tasks.workunit.client.1.smithi133.stdout:9/639: rmdir d0/d8/d9/d12/d82/da6 0 2024-02-15T18:27:15.395 INFO:tasks.workunit.client.1.smithi133.stdout:3/833: getdents d0/d15/d2f/d9b 0 2024-02-15T18:27:15.397 INFO:tasks.workunit.client.1.smithi133.stdout:3/834: rename d0/d15/d37/lbc to d0/d15/d37/d7b/l111 0 2024-02-15T18:27:15.398 INFO:tasks.workunit.client.1.smithi133.stdout:3/835: fsync d0/d15/d2f/d5e/f76 0 2024-02-15T18:27:15.398 INFO:tasks.workunit.client.1.smithi133.stdout:3/836: read - d0/d15/d37/d4a/f101 zero size 2024-02-15T18:27:15.402 INFO:tasks.workunit.client.1.smithi133.stdout:9/640: dread d0/d8/d9/d3c/f62 [0,4194304] 0 2024-02-15T18:27:15.402 INFO:tasks.workunit.client.1.smithi133.stdout:9/641: stat d0/d8/d9/d12/d82/d42/d79/fb3 0 2024-02-15T18:27:15.406 INFO:tasks.workunit.client.1.smithi133.stdout:8/646: dwrite d3/d1f/d3f/d58/fb3 [0,4194304] 0 2024-02-15T18:27:15.411 INFO:tasks.workunit.client.1.smithi133.stdout:8/647: creat d3/d7/d40/d61/fdc x:0 0 0 2024-02-15T18:27:15.418 INFO:tasks.workunit.client.1.smithi133.stdout:3/837: dwrite d0/d15/f6d [0,4194304] 0 2024-02-15T18:27:15.422 INFO:tasks.workunit.client.1.smithi133.stdout:9/642: rmdir d0/d8/d9 39 2024-02-15T18:27:15.423 INFO:tasks.workunit.client.1.smithi133.stdout:3/838: creat d0/d15/d37/d95/f112 x:0 0 0 2024-02-15T18:27:15.425 INFO:tasks.workunit.client.1.smithi133.stdout:9/643: mknod d0/d8/d10/d4d/d92/cd3 0 2024-02-15T18:27:15.426 INFO:tasks.workunit.client.1.smithi133.stdout:9/644: mkdir d0/d8/d9/d49/dd4 0 2024-02-15T18:27:15.430 INFO:tasks.workunit.client.1.smithi133.stdout:9/645: write d0/d8/f56 [815916,77064] 0 2024-02-15T18:27:15.432 INFO:tasks.workunit.client.1.smithi133.stdout:8/648: dwrite d3/d1f/d3f/d58/fb3 [0,4194304] 0 2024-02-15T18:27:15.432 INFO:tasks.workunit.client.1.smithi133.stdout:8/649: write d3/d1f/d3f/fcc [97986,88596] 0 2024-02-15T18:27:15.433 INFO:tasks.workunit.client.1.smithi133.stdout:9/646: creat d0/d8/d9/d12/d82/d42/d44/fd5 x:0 0 0 2024-02-15T18:27:15.435 INFO:tasks.workunit.client.1.smithi133.stdout:3/839: dread d0/d15/d2f/d9b/d39/d3f/dc1/d78/fcc [0,4194304] 0 2024-02-15T18:27:15.437 INFO:tasks.workunit.client.1.smithi133.stdout:8/650: write d3/d1c/d2f/f7d [586013,5355] 0 2024-02-15T18:27:15.437 INFO:tasks.workunit.client.1.smithi133.stdout:8/651: stat d3/d1f/d4f/dab/cb0 0 2024-02-15T18:27:15.437 INFO:tasks.workunit.client.1.smithi133.stdout:8/652: stat d3/de/d3e 0 2024-02-15T18:27:15.437 INFO:tasks.workunit.client.1.smithi133.stdout:3/840: getdents d0/d15/d2f/d9b/d9d 0 2024-02-15T18:27:15.438 INFO:tasks.workunit.client.1.smithi133.stdout:8/653: mknod d3/d7/d40/cdd 0 2024-02-15T18:27:15.440 INFO:tasks.workunit.client.1.smithi133.stdout:3/841: symlink d0/d15/d2f/db4/d89/l113 0 2024-02-15T18:27:15.442 INFO:tasks.workunit.client.1.smithi133.stdout:3/842: rmdir d0/d15/d54 39 2024-02-15T18:27:15.447 INFO:tasks.workunit.client.1.smithi133.stdout:9/647: dread d0/d8/f56 [0,4194304] 0 2024-02-15T18:27:15.452 INFO:tasks.workunit.client.1.smithi133.stdout:9/648: creat d0/d8/d10/fd6 x:0 0 0 2024-02-15T18:27:15.455 INFO:tasks.workunit.client.1.smithi133.stdout:9/649: getdents d0/d8/d9/d49 0 2024-02-15T18:27:15.455 INFO:tasks.workunit.client.1.smithi133.stdout:9/650: symlink d0/d8/d9/d12/d82/d42/d79/d90/ld7 0 2024-02-15T18:27:15.457 INFO:tasks.workunit.client.1.smithi133.stdout:4/528: sync 2024-02-15T18:27:15.457 INFO:tasks.workunit.client.1.smithi133.stdout:7/617: sync 2024-02-15T18:27:15.457 INFO:tasks.workunit.client.1.smithi133.stdout:4/529: write d2/d48/d5c/f80 [8695095,31001] 0 2024-02-15T18:27:15.457 INFO:tasks.workunit.client.1.smithi133.stdout:4/530: chown d2/d48/d5c 11 1 2024-02-15T18:27:15.457 INFO:tasks.workunit.client.1.smithi133.stdout:8/654: dwrite d3/d1c/d2f/d87/d73/d84/f98 [0,4194304] 0 2024-02-15T18:27:15.459 INFO:tasks.workunit.client.1.smithi133.stdout:7/618: link d9/db/d55/fa0 d9/d36/d39/d98/fd7 0 2024-02-15T18:27:15.460 INFO:tasks.workunit.client.1.smithi133.stdout:4/531: rename d2/d5/d2b/f1d to d2/d48/d6a/d9e/fad 0 2024-02-15T18:27:15.460 INFO:tasks.workunit.client.1.smithi133.stdout:4/532: chown d2/d5/d2b/d21/d2d/d44/d51/f9c 106422 1 2024-02-15T18:27:15.462 INFO:tasks.workunit.client.1.smithi133.stdout:8/655: mkdir d3/d1f/dde 0 2024-02-15T18:27:15.462 INFO:tasks.workunit.client.1.smithi133.stdout:8/656: write d3/de/f66 [450782,75018] 0 2024-02-15T18:27:15.464 INFO:tasks.workunit.client.1.smithi133.stdout:8/657: write d3/d1c/f1e [757362,49936] 0 2024-02-15T18:27:15.464 INFO:tasks.workunit.client.1.smithi133.stdout:8/658: readlink d3/d1f/d4f/lc3 0 2024-02-15T18:27:15.464 INFO:tasks.workunit.client.1.smithi133.stdout:8/659: dread - d3/d1f/d3f/d58/f78 zero size 2024-02-15T18:27:15.469 INFO:tasks.workunit.client.1.smithi133.stdout:8/660: write d3/d1c/f97 [36793,12436] 0 2024-02-15T18:27:15.472 INFO:tasks.workunit.client.1.smithi133.stdout:4/533: dread d2/d5/d2b/d21/f1c [0,4194304] 0 2024-02-15T18:27:15.474 INFO:tasks.workunit.client.0.smithi084.stdout:3/942: sync 2024-02-15T18:27:15.475 INFO:tasks.workunit.client.1.smithi133.stdout:9/651: dwrite d0/d37/fb9 [4194304,4194304] 0 2024-02-15T18:27:15.475 INFO:tasks.workunit.client.1.smithi133.stdout:9/652: chown d0/d8/d9/d12/d7f 0 1 2024-02-15T18:27:15.477 INFO:tasks.workunit.client.0.smithi084.stdout:3/943: symlink d8/d40/d43/d71/l143 0 2024-02-15T18:27:15.478 INFO:tasks.workunit.client.0.smithi084.stdout:3/944: read d8/d73/db9/d13e/d80/f84 [941736,33194] 0 2024-02-15T18:27:15.488 INFO:tasks.workunit.client.1.smithi133.stdout:7/619: mkdir d9/db/d16/d5d/d68/da2/dd8 0 2024-02-15T18:27:15.488 INFO:tasks.workunit.client.1.smithi133.stdout:7/620: fdatasync d9/db/dc/f28 0 2024-02-15T18:27:15.488 INFO:tasks.workunit.client.1.smithi133.stdout:7/621: stat d9/db/dc/c8f 0 2024-02-15T18:27:15.488 INFO:tasks.workunit.client.1.smithi133.stdout:7/622: chown d9/db/f50 17724 1 2024-02-15T18:27:15.521 INFO:tasks.workunit.client.0.smithi084.stdout:3/945: dwrite d8/d1f/dbf/db6/d10c/f12d [0,4194304] 0 2024-02-15T18:27:15.526 INFO:tasks.workunit.client.0.smithi084.stdout:3/946: truncate d8/d73/db9/d13e/d80/f7c 845934 0 2024-02-15T18:27:15.526 INFO:tasks.workunit.client.0.smithi084.stdout:3/947: fsync d8/d1f/dbf/f26 0 2024-02-15T18:27:15.527 INFO:tasks.workunit.client.1.smithi133.stdout:7/623: dwrite d9/d36/d39/f5c [0,4194304] 0 2024-02-15T18:27:15.528 INFO:tasks.workunit.client.1.smithi133.stdout:9/653: dwrite d0/d8/d9/f41 [0,4194304] 0 2024-02-15T18:27:15.528 INFO:tasks.workunit.client.1.smithi133.stdout:9/654: readlink d0/d8/l3e 0 2024-02-15T18:27:15.528 INFO:tasks.workunit.client.1.smithi133.stdout:9/655: readlink d0/d8/d10/d4d/l86 0 2024-02-15T18:27:15.531 INFO:tasks.workunit.client.1.smithi133.stdout:8/661: mkdir d3/d1f/d4f/dab/ddf 0 2024-02-15T18:27:15.547 INFO:tasks.workunit.client.1.smithi133.stdout:4/534: link d2/d48/d5c/d93/c85 d2/d5/d2b/d21/d2d/d44/da4/cae 0 2024-02-15T18:27:15.547 INFO:tasks.workunit.client.1.smithi133.stdout:4/535: stat d2/l34 0 2024-02-15T18:27:15.547 INFO:tasks.workunit.client.1.smithi133.stdout:4/536: dread - d2/d48/f8e zero size 2024-02-15T18:27:15.550 INFO:tasks.workunit.client.0.smithi084.stdout:3/948: dwrite d8/f1d [0,4194304] 0 2024-02-15T18:27:15.559 INFO:tasks.workunit.client.0.smithi084.stdout:3/949: dread d8/d40/faa [0,4194304] 0 2024-02-15T18:27:15.560 INFO:tasks.workunit.client.0.smithi084.stdout:3/950: write d8/d1f/d25/f7f [5188654,123312] 0 2024-02-15T18:27:15.560 INFO:tasks.workunit.client.1.smithi133.stdout:7/624: link d9/db/d55/c90 d9/d36/d31/dc1/cd9 0 2024-02-15T18:27:15.560 INFO:tasks.workunit.client.1.smithi133.stdout:7/625: dread - d9/db/d55/f7a zero size 2024-02-15T18:27:15.561 INFO:tasks.workunit.client.0.smithi084.stdout:3/951: creat d8/d1f/d2d/f144 x:0 0 0 2024-02-15T18:27:15.563 INFO:tasks.workunit.client.0.smithi084.stdout:3/952: mkdir d8/d145 0 2024-02-15T18:27:15.563 INFO:tasks.workunit.client.1.smithi133.stdout:9/656: link d0/d8/f81 d0/d37/fd8 0 2024-02-15T18:27:15.563 INFO:tasks.workunit.client.1.smithi133.stdout:9/657: truncate d0/d8/d9/d12/d82/f40 5017436 0 2024-02-15T18:27:15.563 INFO:tasks.workunit.client.1.smithi133.stdout:8/662: mkdir d3/de/d3e/dc4/de0 0 2024-02-15T18:27:15.563 INFO:tasks.workunit.client.1.smithi133.stdout:8/663: chown d3/d1c/d2f/d87/d73 3657 1 2024-02-15T18:27:15.564 INFO:tasks.workunit.client.1.smithi133.stdout:8/664: chown d3/d7/f95 9 1 2024-02-15T18:27:15.565 INFO:tasks.workunit.client.1.smithi133.stdout:4/537: creat d2/d5/d2b/d21/da2/d5e/faf x:0 0 0 2024-02-15T18:27:15.565 INFO:tasks.workunit.client.1.smithi133.stdout:4/538: stat d2/d48 0 2024-02-15T18:27:15.565 INFO:tasks.workunit.client.1.smithi133.stdout:8/665: dread d3/d1f/d3f/fcc [0,4194304] 0 2024-02-15T18:27:15.567 INFO:tasks.workunit.client.1.smithi133.stdout:8/666: rmdir d3/d1f/d4f/dab/ddf 0 2024-02-15T18:27:15.568 INFO:tasks.workunit.client.1.smithi133.stdout:9/658: dread d0/f7 [0,4194304] 0 2024-02-15T18:27:15.568 INFO:tasks.workunit.client.1.smithi133.stdout:9/659: write d0/d8/d9/d12/d82/d89/f99 [2312729,862] 0 2024-02-15T18:27:15.569 INFO:tasks.workunit.client.1.smithi133.stdout:9/660: mknod d0/d8/d9/d12/d82/d42/cd9 0 2024-02-15T18:27:15.570 INFO:tasks.workunit.client.1.smithi133.stdout:7/626: dread d9/d36/f23 [0,4194304] 0 2024-02-15T18:27:15.572 INFO:tasks.workunit.client.1.smithi133.stdout:9/661: getdents d0/d8/d9/d12/d82/d42/d79 0 2024-02-15T18:27:15.573 INFO:tasks.workunit.client.1.smithi133.stdout:9/662: mknod d0/d8/d9/d12/d82/d42/d44/cda 0 2024-02-15T18:27:15.573 INFO:tasks.workunit.client.1.smithi133.stdout:9/663: dread - d0/d8/d9/d12/f64 zero size 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:5/593: sync 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:2/800: sync 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:5/594: chown d17/d20/d32/d38/l92 257997 1 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:2/801: chown d7/db/f43 0 1 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:0/799: sync 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:1/915: sync 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:9/664: getdents d0/d8/d9/d3c 0 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:9/665: dread - d0/d8/d9/d49/d4c/f7d zero size 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:9/666: write d0/d8/d9/d12/d82/d42/f6a [4678010,19452] 0 2024-02-15T18:27:15.576 INFO:tasks.workunit.client.1.smithi133.stdout:7/627: dread d9/da/d48/d62/d64/f9a [0,4194304] 0 2024-02-15T18:27:15.578 INFO:tasks.workunit.client.1.smithi133.stdout:2/802: creat d7/d2c/dd5/f104 x:0 0 0 2024-02-15T18:27:15.578 INFO:tasks.workunit.client.1.smithi133.stdout:2/803: getdents d7/d18/d32/ddc/df2 0 2024-02-15T18:27:15.578 INFO:tasks.workunit.client.1.smithi133.stdout:2/804: write d7/f26 [77394,52811] 0 2024-02-15T18:27:15.578 INFO:tasks.workunit.client.1.smithi133.stdout:2/805: chown d7/d18/d32/l63 4250776 1 2024-02-15T18:27:15.578 INFO:tasks.workunit.client.1.smithi133.stdout:2/806: truncate d7/ffc 336172 0 2024-02-15T18:27:15.578 INFO:tasks.workunit.client.1.smithi133.stdout:4/539: dread d2/d48/d6a/d9e/fad [0,4194304] 0 2024-02-15T18:27:15.579 INFO:tasks.workunit.client.1.smithi133.stdout:1/916: rename d6/d2a/d59/d5a/da4/f141 to d6/d1e/d3a/d82/d85/dc7/f14d 0 2024-02-15T18:27:15.581 INFO:tasks.workunit.client.1.smithi133.stdout:2/807: mkdir d7/db/d67/d105 0 2024-02-15T18:27:15.583 INFO:tasks.workunit.client.1.smithi133.stdout:1/917: link d6/d1e/d3a/d82/d85/c62 d6/d1e/d3a/d97/c14e 0 2024-02-15T18:27:15.583 INFO:tasks.workunit.client.1.smithi133.stdout:8/667: dread d3/d1f/f31 [4194304,4194304] 0 2024-02-15T18:27:15.583 INFO:tasks.workunit.client.1.smithi133.stdout:5/595: dread d17/d20/d32/d38/d86/fa6 [0,4194304] 0 2024-02-15T18:27:15.584 INFO:tasks.workunit.client.1.smithi133.stdout:5/596: chown d17/d26/d7b 554 1 2024-02-15T18:27:15.592 INFO:tasks.workunit.client.1.smithi133.stdout:2/808: creat d7/d18/d32/f106 x:0 0 0 2024-02-15T18:27:15.592 INFO:tasks.workunit.client.1.smithi133.stdout:1/918: read d6/d1e/d3a/d75/f84 [80765,35279] 0 2024-02-15T18:27:15.593 INFO:tasks.workunit.client.1.smithi133.stdout:5/597: symlink d17/d2a/lbb 0 2024-02-15T18:27:15.594 INFO:tasks.workunit.client.1.smithi133.stdout:5/598: dread d17/d20/d32/d7d/d7e/f84 [0,4194304] 0 2024-02-15T18:27:15.594 INFO:tasks.workunit.client.1.smithi133.stdout:2/809: symlink d7/d2c/d5a/d66/d70/da8/l107 0 2024-02-15T18:27:15.595 INFO:tasks.workunit.client.1.smithi133.stdout:2/810: chown d7/cae 111 1 2024-02-15T18:27:15.597 INFO:tasks.workunit.client.1.smithi133.stdout:1/919: write d6/d2a/f2f [3727918,63162] 0 2024-02-15T18:27:15.597 INFO:tasks.workunit.client.1.smithi133.stdout:5/599: link l1 d17/d20/d32/d38/d70/lbc 0 2024-02-15T18:27:15.597 INFO:tasks.workunit.client.1.smithi133.stdout:5/600: fdatasync d17/d20/d32/d9d/fa5 0 2024-02-15T18:27:15.597 INFO:tasks.workunit.client.1.smithi133.stdout:7/628: dread d9/da/d48/d62/d64/fb9 [0,4194304] 0 2024-02-15T18:27:15.598 INFO:tasks.workunit.client.1.smithi133.stdout:1/920: link d6/d1e/d3a/d82/d85/d67/ddb/f118 d6/d1e/d3a/d82/d85/d67/ddb/f14f 0 2024-02-15T18:27:15.607 INFO:tasks.workunit.client.1.smithi133.stdout:5/601: mkdir d17/d20/d32/d38/dbd 0 2024-02-15T18:27:15.607 INFO:tasks.workunit.client.1.smithi133.stdout:1/921: creat d6/d1e/d3a/d79/d8e/f150 x:0 0 0 2024-02-15T18:27:15.607 INFO:tasks.workunit.client.1.smithi133.stdout:1/922: write d6/d2a/df1/f11e [4430821,25054] 0 2024-02-15T18:27:15.607 INFO:tasks.workunit.client.1.smithi133.stdout:1/923: dread - d6/d1e/d41/d7c/d7e/fba zero size 2024-02-15T18:27:15.611 INFO:tasks.workunit.client.1.smithi133.stdout:1/924: mkdir d6/d1e/d3a/d97/dda/dff/d13d/d151 0 2024-02-15T18:27:15.611 INFO:tasks.workunit.client.1.smithi133.stdout:5/602: dread ff [0,4194304] 0 2024-02-15T18:27:15.613 INFO:tasks.workunit.client.1.smithi133.stdout:0/800: dwrite d9/d2b/f6c [0,4194304] 0 2024-02-15T18:27:15.614 INFO:tasks.workunit.client.1.smithi133.stdout:9/667: dwrite d0/d8/d9/d12/d82/d42/f45 [0,4194304] 0 2024-02-15T18:27:15.614 INFO:tasks.workunit.client.1.smithi133.stdout:9/668: stat d0/d8/d9/d12/d82/d89/c9d 0 2024-02-15T18:27:15.619 INFO:tasks.workunit.client.1.smithi133.stdout:5/603: rename d17/f9b to d17/d26/fbe 0 2024-02-15T18:27:15.619 INFO:tasks.workunit.client.1.smithi133.stdout:4/540: dwrite d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 [4194304,4194304] 0 2024-02-15T18:27:15.619 INFO:tasks.workunit.client.1.smithi133.stdout:9/669: read d0/f6 [1846900,127703] 0 2024-02-15T18:27:15.621 INFO:tasks.workunit.client.1.smithi133.stdout:2/811: dwrite d7/db/fd1 [0,4194304] 0 2024-02-15T18:27:15.621 INFO:tasks.workunit.client.1.smithi133.stdout:2/812: readlink d7/d2c/d5a/l82 0 2024-02-15T18:27:15.622 INFO:tasks.workunit.client.1.smithi133.stdout:5/604: dread d17/d20/d32/d38/f96 [0,4194304] 0 2024-02-15T18:27:15.623 INFO:tasks.workunit.client.1.smithi133.stdout:4/541: getdents d2/d5/d2b/d21/d3b 0 2024-02-15T18:27:15.623 INFO:tasks.workunit.client.1.smithi133.stdout:4/542: chown d2/d5/c5a 9 1 2024-02-15T18:27:15.625 INFO:tasks.workunit.client.1.smithi133.stdout:7/629: dwrite d9/db/f27 [4194304,4194304] 0 2024-02-15T18:27:15.625 INFO:tasks.workunit.client.1.smithi133.stdout:7/630: readlink d9/da/d48/l77 0 2024-02-15T18:27:15.634 INFO:tasks.workunit.client.1.smithi133.stdout:0/801: dread d9/d10/d47/d5e/fd4 [0,4194304] 0 2024-02-15T18:27:15.635 INFO:tasks.workunit.client.1.smithi133.stdout:5/605: dread f15 [0,4194304] 0 2024-02-15T18:27:15.635 INFO:tasks.workunit.client.1.smithi133.stdout:5/606: chown d17/f33 4254 1 2024-02-15T18:27:15.644 INFO:tasks.workunit.client.1.smithi133.stdout:5/607: unlink d17/d20/d32/d7d/d7e/fa2 0 2024-02-15T18:27:15.644 INFO:tasks.workunit.client.1.smithi133.stdout:3/843: sync 2024-02-15T18:27:15.644 INFO:tasks.workunit.client.1.smithi133.stdout:9/670: write d0/f20 [767378,60749] 0 2024-02-15T18:27:15.644 INFO:tasks.workunit.client.1.smithi133.stdout:1/925: dwrite d6/d1e/d41/d7c/d7e/d7f/db6/f117 [0,4194304] 0 2024-02-15T18:27:15.649 INFO:tasks.workunit.client.1.smithi133.stdout:0/802: dread d9/d10/fae [0,4194304] 0 2024-02-15T18:27:15.654 INFO:tasks.workunit.client.1.smithi133.stdout:4/543: dwrite d2/d5/d2b/d21/f8f [0,4194304] 0 2024-02-15T18:27:15.655 INFO:tasks.workunit.client.1.smithi133.stdout:9/671: getdents d0/d8/d9 0 2024-02-15T18:27:15.655 INFO:tasks.workunit.client.1.smithi133.stdout:9/672: stat d0/d8/l34 0 2024-02-15T18:27:15.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/803: creat d9/d10/d47/d5e/f106 x:0 0 0 2024-02-15T18:27:15.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/804: readlink d9/d10/d47/d5e/lc4 0 2024-02-15T18:27:15.659 INFO:tasks.workunit.client.1.smithi133.stdout:0/805: dread - d9/d10/d2c/f91 zero size 2024-02-15T18:27:15.659 INFO:tasks.workunit.client.1.smithi133.stdout:4/544: link d2/d5/d2b/d21/f99 d2/d5/d2b/d21/d3b/d49/d98/fb0 0 2024-02-15T18:27:15.659 INFO:tasks.workunit.client.1.smithi133.stdout:4/545: write d2/d48/d6a/f9a [3887176,106749] 0 2024-02-15T18:27:15.662 INFO:tasks.workunit.client.1.smithi133.stdout:7/631: dwrite d9/db/d55/d63/fc4 [0,4194304] 0 2024-02-15T18:27:15.664 INFO:tasks.workunit.client.1.smithi133.stdout:5/608: dwrite d17/d20/f23 [0,4194304] 0 2024-02-15T18:27:15.664 INFO:tasks.workunit.client.1.smithi133.stdout:5/609: write d17/d26/d7b/f89 [195393,36932] 0 2024-02-15T18:27:15.664 INFO:tasks.workunit.client.1.smithi133.stdout:5/610: readlink d17/d20/la8 0 2024-02-15T18:27:15.664 INFO:tasks.workunit.client.1.smithi133.stdout:5/611: write d17/d2a/f3b [407546,60230] 0 2024-02-15T18:27:15.665 INFO:tasks.workunit.client.1.smithi133.stdout:9/673: creat d0/d37/fdb x:0 0 0 2024-02-15T18:27:15.666 INFO:tasks.workunit.client.1.smithi133.stdout:7/632: write f7 [5341091,14909] 0 2024-02-15T18:27:15.666 INFO:tasks.workunit.client.1.smithi133.stdout:7/633: write d9/db/d16/d5d/f89 [552219,112782] 0 2024-02-15T18:27:15.670 INFO:tasks.workunit.client.1.smithi133.stdout:5/612: symlink d17/d20/lbf 0 2024-02-15T18:27:15.670 INFO:tasks.workunit.client.1.smithi133.stdout:5/613: chown d17/d26/c74 104 1 2024-02-15T18:27:15.670 INFO:tasks.workunit.client.1.smithi133.stdout:5/614: chown d17/d20/d32/f75 3596781 1 2024-02-15T18:27:15.672 INFO:tasks.workunit.client.1.smithi133.stdout:9/674: rename d0/l35 to d0/d8/d9/d49/d4c/dba/ldc 0 2024-02-15T18:27:15.672 INFO:tasks.workunit.client.1.smithi133.stdout:9/675: readlink d0/d8/d9/d12/l69 0 2024-02-15T18:27:15.673 INFO:tasks.workunit.client.1.smithi133.stdout:9/676: readlink d0/d8/d9/d49/d4c/dba/ldc 0 2024-02-15T18:27:15.673 INFO:tasks.workunit.client.1.smithi133.stdout:0/806: dread d9/d10/d19/d1a/f4b [0,4194304] 0 2024-02-15T18:27:15.677 INFO:tasks.workunit.client.1.smithi133.stdout:0/807: dread d9/d10/d22/d32/f74 [0,4194304] 0 2024-02-15T18:27:15.678 INFO:tasks.workunit.client.1.smithi133.stdout:0/808: getdents d9/d10/d19/d29/d67/d68/d96/d44 0 2024-02-15T18:27:15.681 INFO:tasks.workunit.client.1.smithi133.stdout:0/809: mknod d9/d10/d19/d29/d67/d68/d9c/da7/c107 0 2024-02-15T18:27:15.681 INFO:tasks.workunit.client.1.smithi133.stdout:0/810: chown d9/d10/d22/fde 0 1 2024-02-15T18:27:15.682 INFO:tasks.workunit.client.1.smithi133.stdout:0/811: mknod d9/d10/dcb/c108 0 2024-02-15T18:27:15.682 INFO:tasks.workunit.client.1.smithi133.stdout:0/812: fdatasync d9/d10/d19/d29/d67/d68/d9c/d95/fc0 0 2024-02-15T18:27:15.687 INFO:tasks.workunit.client.1.smithi133.stdout:9/677: dread d0/d8/fd [0,4194304] 0 2024-02-15T18:27:15.688 INFO:tasks.workunit.client.1.smithi133.stdout:9/678: chown d0/d37/fdb 61649430 1 2024-02-15T18:27:15.693 INFO:tasks.workunit.client.1.smithi133.stdout:9/679: dread d0/d8/f81 [0,4194304] 0 2024-02-15T18:27:15.693 INFO:tasks.workunit.client.1.smithi133.stdout:4/546: dwrite d2/d5/d2b/fe [0,4194304] 0 2024-02-15T18:27:15.694 INFO:tasks.workunit.client.1.smithi133.stdout:7/634: dwrite d9/f2a [0,4194304] 0 2024-02-15T18:27:15.694 INFO:tasks.workunit.client.1.smithi133.stdout:7/635: readlink d9/l26 0 2024-02-15T18:27:15.695 INFO:tasks.workunit.client.1.smithi133.stdout:0/813: dread d9/d28/f4a [0,4194304] 0 2024-02-15T18:27:15.695 INFO:tasks.workunit.client.1.smithi133.stdout:5/615: dwrite d17/d2a/f41 [4194304,4194304] 0 2024-02-15T18:27:15.696 INFO:tasks.workunit.client.1.smithi133.stdout:9/680: rmdir d0/d37 39 2024-02-15T18:27:15.696 INFO:tasks.workunit.client.1.smithi133.stdout:9/681: chown d0/d8/d9/d12/d82/l68 3 1 2024-02-15T18:27:15.697 INFO:tasks.workunit.client.1.smithi133.stdout:4/547: creat d2/d5/d2b/d21/d36/dab/fb1 x:0 0 0 2024-02-15T18:27:15.697 INFO:tasks.workunit.client.1.smithi133.stdout:4/548: truncate d2/d5/d2b/d21/f99 674625 0 2024-02-15T18:27:15.697 INFO:tasks.workunit.client.1.smithi133.stdout:4/549: read d2/d48/d6a/d9e/fad [3996520,15881] 0 2024-02-15T18:27:15.697 INFO:tasks.workunit.client.1.smithi133.stdout:4/550: chown d2/d5/d2b/d21/d2d/d44/d51 282819 1 2024-02-15T18:27:15.700 INFO:tasks.workunit.client.1.smithi133.stdout:7/636: truncate d9/db/d55/d63/fc4 935506 0 2024-02-15T18:27:15.702 INFO:tasks.workunit.client.1.smithi133.stdout:5/616: creat d17/d20/d32/d7d/fc0 x:0 0 0 2024-02-15T18:27:15.702 INFO:tasks.workunit.client.1.smithi133.stdout:5/617: write d17/f4a [515746,26816] 0 2024-02-15T18:27:15.704 INFO:tasks.workunit.client.1.smithi133.stdout:9/682: rename d0/d8/d9/d12/d82/d42/l70 to d0/d8/d10/d4d/d92/ldd 0 2024-02-15T18:27:15.705 INFO:tasks.workunit.client.1.smithi133.stdout:7/637: rmdir d9/db/dc 39 2024-02-15T18:27:15.705 INFO:tasks.workunit.client.1.smithi133.stdout:0/814: rmdir d9 39 2024-02-15T18:27:15.705 INFO:tasks.workunit.client.1.smithi133.stdout:0/815: fsync d9/ff6 0 2024-02-15T18:27:15.709 INFO:tasks.workunit.client.1.smithi133.stdout:5/618: mknod d17/d20/d32/d9d/cc1 0 2024-02-15T18:27:15.709 INFO:tasks.workunit.client.1.smithi133.stdout:5/619: chown d17/f50 4251296 1 2024-02-15T18:27:15.711 INFO:tasks.workunit.client.1.smithi133.stdout:4/551: rename d2/d5/d2b/d21/f1c to d2/d48/d5c/d93/d8d/fb2 0 2024-02-15T18:27:15.712 INFO:tasks.workunit.client.1.smithi133.stdout:4/552: truncate d2/d5/fa0 2188234 0 2024-02-15T18:27:15.712 INFO:tasks.workunit.client.1.smithi133.stdout:4/553: chown d2/d5/d2b/f5b 237879 1 2024-02-15T18:27:15.712 INFO:tasks.workunit.client.1.smithi133.stdout:9/683: mknod d0/d8/d10/daa/cde 0 2024-02-15T18:27:15.712 INFO:tasks.workunit.client.1.smithi133.stdout:9/684: chown d0/d8 10261 1 2024-02-15T18:27:15.712 INFO:tasks.workunit.client.1.smithi133.stdout:9/685: chown d0/d8/d10/db2/f78 0 1 2024-02-15T18:27:15.712 INFO:tasks.workunit.client.1.smithi133.stdout:9/686: fdatasync d0/d8/d9/ff 0 2024-02-15T18:27:15.713 INFO:tasks.workunit.client.1.smithi133.stdout:7/638: unlink d9/d36/d31/f59 0 2024-02-15T18:27:15.714 INFO:tasks.workunit.client.1.smithi133.stdout:0/816: creat d9/d10/d19/d29/d67/d68/d9c/da7/f109 x:0 0 0 2024-02-15T18:27:15.714 INFO:tasks.workunit.client.1.smithi133.stdout:4/554: dread d2/d5/d2b/d21/d2d/d44/d51/f67 [0,4194304] 0 2024-02-15T18:27:15.715 INFO:tasks.workunit.client.1.smithi133.stdout:5/620: symlink d17/d26/d7b/d87/lc2 0 2024-02-15T18:27:15.715 INFO:tasks.workunit.client.1.smithi133.stdout:4/555: write d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f90 [3387445,44963] 0 2024-02-15T18:27:15.716 INFO:tasks.workunit.client.1.smithi133.stdout:9/687: creat d0/d8/d9/d12/d7f/d8f/fdf x:0 0 0 2024-02-15T18:27:15.716 INFO:tasks.workunit.client.1.smithi133.stdout:9/688: chown d0/d8/d10/f36 33486211 1 2024-02-15T18:27:15.716 INFO:tasks.workunit.client.1.smithi133.stdout:4/556: read d2/d5/d2b/d21/f31 [146987,11600] 0 2024-02-15T18:27:15.718 INFO:tasks.workunit.client.1.smithi133.stdout:7/639: creat d9/db/d16/d5d/d68/fda x:0 0 0 2024-02-15T18:27:15.720 INFO:tasks.workunit.client.1.smithi133.stdout:7/640: write d9/db/d16/f53 [334760,4392] 0 2024-02-15T18:27:15.720 INFO:tasks.workunit.client.1.smithi133.stdout:7/641: read - d9/db/d16/d5d/d68/fda zero size 2024-02-15T18:27:15.720 INFO:tasks.workunit.client.1.smithi133.stdout:7/642: fsync d9/d36/f23 0 2024-02-15T18:27:15.720 INFO:tasks.workunit.client.1.smithi133.stdout:4/557: creat d2/d5/d2b/d21/d2d/fb3 x:0 0 0 2024-02-15T18:27:15.720 INFO:tasks.workunit.client.1.smithi133.stdout:5/621: mkdir d17/d20/dc3 0 2024-02-15T18:27:15.721 INFO:tasks.workunit.client.1.smithi133.stdout:7/643: write d9/d36/d39/dd0/fb4 [1164166,95096] 0 2024-02-15T18:27:15.722 INFO:tasks.workunit.client.1.smithi133.stdout:4/558: unlink d2/d5/c5a 0 2024-02-15T18:27:15.722 INFO:tasks.workunit.client.1.smithi133.stdout:4/559: stat d2/d5/d2b/d21/d2d/d44/d51/d95/laa 0 2024-02-15T18:27:15.724 INFO:tasks.workunit.client.1.smithi133.stdout:5/622: dread d17/d20/d4f/d5f/f60 [0,4194304] 0 2024-02-15T18:27:15.724 INFO:tasks.workunit.client.1.smithi133.stdout:7/644: write d9/d36/d3d/d4c/f61 [2722942,2332] 0 2024-02-15T18:27:15.724 INFO:tasks.workunit.client.1.smithi133.stdout:7/645: readlink d9/da/d48/l77 0 2024-02-15T18:27:15.725 INFO:tasks.workunit.client.0.smithi084.stdout:3/953: sync 2024-02-15T18:27:15.727 INFO:tasks.workunit.client.0.smithi084.stdout:3/954: rmdir d8/d1f/d2d/dc5 39 2024-02-15T18:27:15.729 INFO:tasks.workunit.client.0.smithi084.stdout:3/955: unlink d8/d1f/d2d/dc5/cf0 0 2024-02-15T18:27:15.734 INFO:tasks.workunit.client.1.smithi133.stdout:0/817: dread d9/d10/d22/d32/f64 [0,4194304] 0 2024-02-15T18:27:15.736 INFO:tasks.workunit.client.1.smithi133.stdout:4/560: dread d2/d5/d2b/d21/da2/f27 [0,4194304] 0 2024-02-15T18:27:15.736 INFO:tasks.workunit.client.1.smithi133.stdout:9/689: dwrite d0/fc1 [0,4194304] 0 2024-02-15T18:27:15.736 INFO:tasks.workunit.client.0.smithi084.stdout:3/956: dread d8/d1f/dbf/db6/d10c/f12d [0,4194304] 0 2024-02-15T18:27:15.737 INFO:tasks.workunit.client.1.smithi133.stdout:9/690: write d0/d8/f81 [519653,113191] 0 2024-02-15T18:27:15.737 INFO:tasks.workunit.client.1.smithi133.stdout:4/561: mknod d2/d5/d2b/d21/d2d/d44/d51/d60/d63/cb4 0 2024-02-15T18:27:15.740 INFO:tasks.workunit.client.1.smithi133.stdout:9/691: mknod d0/d8/d10/ce0 0 2024-02-15T18:27:15.748 INFO:tasks.workunit.client.0.smithi084.stdout:3/957: dread d8/d40/f59 [0,4194304] 0 2024-02-15T18:27:15.751 INFO:tasks.workunit.client.0.smithi084.stdout:3/958: rmdir d8/d40/d43/d71/dd9 39 2024-02-15T18:27:15.754 INFO:tasks.workunit.client.0.smithi084.stdout:3/959: creat d8/d40/d43/d71/d8c/d94/da3/d115/f146 x:0 0 0 2024-02-15T18:27:15.754 INFO:tasks.workunit.client.0.smithi084.stdout:3/960: write d8/d40/d43/d71/d8c/f103 [2969252,94275] 0 2024-02-15T18:27:15.754 INFO:tasks.workunit.client.0.smithi084.stdout:3/961: chown d8/d73/db9/cdc 2 1 2024-02-15T18:27:15.754 INFO:tasks.workunit.client.0.smithi084.stdout:3/962: fdatasync d8/d1f/d2d/dc5/ff8 0 2024-02-15T18:27:15.754 INFO:tasks.workunit.client.0.smithi084.stdout:3/963: chown d8/d1f/d2d/l66 5368 1 2024-02-15T18:27:15.759 INFO:tasks.workunit.client.1.smithi133.stdout:9/692: write d0/d8/d10/f36 [5831577,51612] 0 2024-02-15T18:27:15.760 INFO:tasks.workunit.client.0.smithi084.stdout:3/964: dread d8/d40/d43/d71/dd9/feb [0,4194304] 0 2024-02-15T18:27:15.761 INFO:tasks.workunit.client.1.smithi133.stdout:9/693: truncate d0/d8/d9/d3c/f62 4028811 0 2024-02-15T18:27:15.773 INFO:tasks.workunit.client.0.smithi084.stdout:3/965: dread d8/d40/d43/d71/d8c/fb7 [4194304,4194304] 0 2024-02-15T18:27:15.773 INFO:tasks.workunit.client.1.smithi133.stdout:7/646: dwrite d9/db/f1f [0,4194304] 0 2024-02-15T18:27:15.773 INFO:tasks.workunit.client.1.smithi133.stdout:7/647: truncate d9/db/d16/d5d/f89 732075 0 2024-02-15T18:27:15.773 INFO:tasks.workunit.client.1.smithi133.stdout:7/648: stat d9/db/d16/d5d/d68/d73/d9b/fad 0 2024-02-15T18:27:15.774 INFO:tasks.workunit.client.0.smithi084.stdout:3/966: creat d8/d73/db9/d13e/d80/d106/f147 x:0 0 0 2024-02-15T18:27:15.775 INFO:tasks.workunit.client.0.smithi084.stdout:3/967: stat d8/d40/f70 0 2024-02-15T18:27:15.777 INFO:tasks.workunit.client.1.smithi133.stdout:5/623: dwrite d17/d20/f43 [0,4194304] 0 2024-02-15T18:27:15.777 INFO:tasks.workunit.client.1.smithi133.stdout:0/818: dwrite d9/d2b/f79 [0,4194304] 0 2024-02-15T18:27:15.777 INFO:tasks.workunit.client.0.smithi084.stdout:3/968: mkdir d8/d40/d43/d148 0 2024-02-15T18:27:15.778 INFO:tasks.workunit.client.0.smithi084.stdout:3/969: mknod d8/d40/d43/d71/dcc/c149 0 2024-02-15T18:27:15.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/649: write d9/d36/d39/d98/fd7 [521483,74289] 0 2024-02-15T18:27:15.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/650: chown d9/db/d16/d5d/d68/d73/d9b/c9d 1866 1 2024-02-15T18:27:15.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/651: fdatasync d9/da/d48/d62/d64/fd1 0 2024-02-15T18:27:15.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/652: truncate d9/fa5 5226761 0 2024-02-15T18:27:15.781 INFO:tasks.workunit.client.1.smithi133.stdout:7/653: fsync d9/db/d16/f25 0 2024-02-15T18:27:15.781 INFO:tasks.workunit.client.1.smithi133.stdout:4/562: dwrite d2/d5/d2b/f5b [4194304,4194304] 0 2024-02-15T18:27:15.781 INFO:tasks.workunit.client.1.smithi133.stdout:5/624: rename d17/d2a/f31 to d17/d26/d7b/fc4 0 2024-02-15T18:27:15.782 INFO:tasks.workunit.client.1.smithi133.stdout:0/819: truncate d9/d10/d19/d29/d67/d68/d9c/da7/fbf 1557983 0 2024-02-15T18:27:15.784 INFO:tasks.workunit.client.1.smithi133.stdout:9/694: truncate d0/d8/d10/f36 2654567 0 2024-02-15T18:27:15.784 INFO:tasks.workunit.client.1.smithi133.stdout:9/695: truncate d0/d7b/fbc 604203 0 2024-02-15T18:27:15.785 INFO:tasks.workunit.client.1.smithi133.stdout:7/654: getdents d9/da/d48 0 2024-02-15T18:27:15.796 INFO:tasks.workunit.client.1.smithi133.stdout:4/563: getdents d2/d5/d2b/d21/d2d/d4f 0 2024-02-15T18:27:15.799 INFO:tasks.workunit.client.0.smithi084.stdout:3/970: getdents d8/d73/db9/d13e/d80/d106 0 2024-02-15T18:27:15.799 INFO:tasks.workunit.client.0.smithi084.stdout:3/971: chown d8/d40/d43/d71/dd9/ff3 35418612 1 2024-02-15T18:27:15.799 INFO:tasks.workunit.client.0.smithi084.stdout:3/972: stat d8/d40/d43/d71/d8c/fb4 0 2024-02-15T18:27:15.800 INFO:tasks.workunit.client.1.smithi133.stdout:5/625: symlink d17/d26/d7b/d87/lc5 0 2024-02-15T18:27:15.800 INFO:tasks.workunit.client.1.smithi133.stdout:0/820: mkdir d9/d10/d19/d29/d10a 0 2024-02-15T18:27:15.800 INFO:tasks.workunit.client.1.smithi133.stdout:0/821: write d9/d10/d85/ff8 [183987,105329] 0 2024-02-15T18:27:15.800 INFO:tasks.workunit.client.1.smithi133.stdout:9/696: mkdir d0/d8/d9/d12/d82/d42/d44/de1 0 2024-02-15T18:27:15.801 INFO:tasks.workunit.client.1.smithi133.stdout:7/655: mkdir d9/da/ddb 0 2024-02-15T18:27:15.801 INFO:tasks.workunit.client.1.smithi133.stdout:4/564: symlink d2/d5/lb5 0 2024-02-15T18:27:15.801 INFO:tasks.workunit.client.1.smithi133.stdout:4/565: truncate d2/d48/d5c/f80 9094459 0 2024-02-15T18:27:15.802 INFO:tasks.workunit.client.1.smithi133.stdout:0/822: read d9/ff [2888810,28039] 0 2024-02-15T18:27:15.802 INFO:tasks.workunit.client.1.smithi133.stdout:0/823: chown d9/d28/fd0 864322163 1 2024-02-15T18:27:15.802 INFO:tasks.workunit.client.1.smithi133.stdout:0/824: fdatasync d9/d10/d22/f9e 0 2024-02-15T18:27:15.803 INFO:tasks.workunit.client.1.smithi133.stdout:5/626: mkdir d17/d20/d32/d9d/da9/dc6 0 2024-02-15T18:27:15.803 INFO:tasks.workunit.client.1.smithi133.stdout:5/627: chown d17/d2a/f8a 235 1 2024-02-15T18:27:15.803 INFO:tasks.workunit.client.1.smithi133.stdout:9/697: dread d0/d8/f81 [0,4194304] 0 2024-02-15T18:27:15.803 INFO:tasks.workunit.client.1.smithi133.stdout:7/656: creat d9/db/d16/d5d/d68/da2/fdc x:0 0 0 2024-02-15T18:27:15.803 INFO:tasks.workunit.client.1.smithi133.stdout:4/566: mkdir d2/d48/d5c/d9f/db6 0 2024-02-15T18:27:15.804 INFO:tasks.workunit.client.0.smithi084.stdout:3/973: creat d8/d73/db9/d13e/d80/f14a x:0 0 0 2024-02-15T18:27:15.806 INFO:tasks.workunit.client.1.smithi133.stdout:5/628: rename d17/d20/d32/d7d/d7e/cb4 to d17/d20/cc7 0 2024-02-15T18:27:15.806 INFO:tasks.workunit.client.1.smithi133.stdout:5/629: chown d17/d20/c2b 13455 1 2024-02-15T18:27:15.806 INFO:tasks.workunit.client.1.smithi133.stdout:5/630: read d17/f47 [647350,123719] 0 2024-02-15T18:27:15.808 INFO:tasks.workunit.client.1.smithi133.stdout:9/698: link d0/d8/d9/d12/d82/f40 d0/d8/d9/d12/d4f/fe2 0 2024-02-15T18:27:15.809 INFO:tasks.workunit.client.0.smithi084.stdout:3/974: rmdir d8/d40/d43/d71/d8c/d94/da3/d115/d13c 0 2024-02-15T18:27:15.809 INFO:tasks.workunit.client.0.smithi084.stdout:3/975: readlink d8/d40/d43/d71/d8c/d94/lfa 0 2024-02-15T18:27:15.813 INFO:tasks.workunit.client.1.smithi133.stdout:7/657: creat d9/db/d16/d5d/d68/da2/fdd x:0 0 0 2024-02-15T18:27:15.813 INFO:tasks.workunit.client.1.smithi133.stdout:7/658: dread - d9/db/d16/d5d/d68/da2/fdd zero size 2024-02-15T18:27:15.813 INFO:tasks.workunit.client.1.smithi133.stdout:7/659: chown d9/db/d55/f72 40180 1 2024-02-15T18:27:15.814 INFO:tasks.workunit.client.1.smithi133.stdout:4/567: rmdir d2/d5/d2b/d21/d3b/d49 39 2024-02-15T18:27:15.814 INFO:tasks.workunit.client.1.smithi133.stdout:7/660: read d9/f2a [2365572,116343] 0 2024-02-15T18:27:15.815 INFO:tasks.workunit.client.1.smithi133.stdout:5/631: symlink d17/d20/d32/d38/dbd/lc8 0 2024-02-15T18:27:15.816 INFO:tasks.workunit.client.1.smithi133.stdout:9/699: mknod d0/d8/d9/d12/d82/d42/d44/ce3 0 2024-02-15T18:27:15.816 INFO:tasks.workunit.client.1.smithi133.stdout:4/568: mkdir d2/d48/d5c/db7 0 2024-02-15T18:27:15.817 INFO:tasks.workunit.client.1.smithi133.stdout:7/661: fsync d9/d36/f32 0 2024-02-15T18:27:15.817 INFO:tasks.workunit.client.1.smithi133.stdout:5/632: rmdir d17/d26 39 2024-02-15T18:27:15.817 INFO:tasks.workunit.client.1.smithi133.stdout:5/633: dread - d17/d2a/f9c zero size 2024-02-15T18:27:15.820 INFO:tasks.workunit.client.1.smithi133.stdout:4/569: dread d2/d48/d5c/f62 [0,4194304] 0 2024-02-15T18:27:15.820 INFO:tasks.workunit.client.0.smithi084.stdout:3/976: write d8/d73/db9/d13e/d80/d6b/f8d [858478,90865] 0 2024-02-15T18:27:15.821 INFO:tasks.workunit.client.1.smithi133.stdout:9/700: write d0/d8/d10/f15 [1475285,126569] 0 2024-02-15T18:27:15.821 INFO:tasks.workunit.client.0.smithi084.stdout:3/977: write d8/d40/d43/d71/d8c/d94/fa6 [663213,70795] 0 2024-02-15T18:27:15.824 INFO:tasks.workunit.client.1.smithi133.stdout:9/701: creat d0/d8/d9/d12/d82/d42/fe4 x:0 0 0 2024-02-15T18:27:15.824 INFO:tasks.workunit.client.1.smithi133.stdout:9/702: chown d0/d8/d9/d12/d82/d42/d79/fb3 1639 1 2024-02-15T18:27:15.824 INFO:tasks.workunit.client.1.smithi133.stdout:0/825: dwrite d9/d2b/f79 [0,4194304] 0 2024-02-15T18:27:15.825 INFO:tasks.workunit.client.1.smithi133.stdout:7/662: dread d9/db/d55/d63/fc4 [0,4194304] 0 2024-02-15T18:27:15.825 INFO:tasks.workunit.client.1.smithi133.stdout:7/663: dread - d9/db/dc/d84/fb8 zero size 2024-02-15T18:27:15.825 INFO:tasks.workunit.client.1.smithi133.stdout:0/826: getdents d9/d10/d19/d29/d67/d68/d9c 0 2024-02-15T18:27:15.826 INFO:tasks.workunit.client.0.smithi084.stdout:3/978: getdents d8/d40/d43/d71/dd9 0 2024-02-15T18:27:15.826 INFO:tasks.workunit.client.0.smithi084.stdout:3/979: truncate d8/d1f/dbf/fc9 448726 0 2024-02-15T18:27:15.826 INFO:tasks.workunit.client.0.smithi084.stdout:3/980: stat d8/d1f/d2d/c2f 0 2024-02-15T18:27:15.831 INFO:tasks.workunit.client.1.smithi133.stdout:7/664: rename d9/db/dc to d9/d36/d31/dc1/dcd/dde 0 2024-02-15T18:27:15.831 INFO:tasks.workunit.client.1.smithi133.stdout:8/668: sync 2024-02-15T18:27:15.831 INFO:tasks.workunit.client.1.smithi133.stdout:8/669: getdents d3/d7/d40/d61/dc8 0 2024-02-15T18:27:15.832 INFO:tasks.workunit.client.1.smithi133.stdout:7/665: creat d9/db/d16/d4f/fdf x:0 0 0 2024-02-15T18:27:15.833 INFO:tasks.workunit.client.1.smithi133.stdout:8/670: rename d3/d7/l67 to d3/d92/le1 0 2024-02-15T18:27:15.834 INFO:tasks.workunit.client.1.smithi133.stdout:8/671: creat d3/d92/db4/fe2 x:0 0 0 2024-02-15T18:27:15.835 INFO:tasks.workunit.client.1.smithi133.stdout:9/703: dread d0/d8/d10/f14 [0,4194304] 0 2024-02-15T18:27:15.835 INFO:tasks.workunit.client.1.smithi133.stdout:8/672: creat d3/d1c/d2f/d87/d73/d84/dda/fe3 x:0 0 0 2024-02-15T18:27:15.836 INFO:tasks.workunit.client.1.smithi133.stdout:5/634: dwrite d17/f50 [0,4194304] 0 2024-02-15T18:27:15.836 INFO:tasks.workunit.client.0.smithi084.stdout:3/981: dread d8/d40/d43/d71/d8c/d94/da3/de5/fef [0,4194304] 0 2024-02-15T18:27:15.836 INFO:tasks.workunit.client.1.smithi133.stdout:9/704: mkdir d0/d37/de5 0 2024-02-15T18:27:15.837 INFO:tasks.workunit.client.0.smithi084.stdout:3/982: symlink d8/d1f/dbf/db6/d10c/l14b 0 2024-02-15T18:27:15.837 INFO:tasks.workunit.client.1.smithi133.stdout:8/673: symlink d3/d1c/d2f/d87/d9b/le4 0 2024-02-15T18:27:15.837 INFO:tasks.workunit.client.1.smithi133.stdout:8/674: fsync d3/d1f/f31 0 2024-02-15T18:27:15.837 INFO:tasks.workunit.client.1.smithi133.stdout:8/675: chown d3/d1c/d2f 312 1 2024-02-15T18:27:15.837 INFO:tasks.workunit.client.1.smithi133.stdout:8/676: fdatasync d3/d1f/f2c 0 2024-02-15T18:27:15.837 INFO:tasks.workunit.client.1.smithi133.stdout:8/677: write d3/d92/fbd [4213315,63643] 0 2024-02-15T18:27:15.839 INFO:tasks.workunit.client.1.smithi133.stdout:5/635: creat d17/d20/d32/d7d/fc9 x:0 0 0 2024-02-15T18:27:15.839 INFO:tasks.workunit.client.1.smithi133.stdout:5/636: stat d17/d20/dc3 0 2024-02-15T18:27:15.840 INFO:tasks.workunit.client.1.smithi133.stdout:8/678: rename d3/cb2 to d3/d1f/ce5 0 2024-02-15T18:27:15.840 INFO:tasks.workunit.client.0.smithi084.stdout:3/983: dread d8/d40/d43/d71/fb5 [4194304,4194304] 0 2024-02-15T18:27:15.841 INFO:tasks.workunit.client.1.smithi133.stdout:5/637: mknod d17/d20/d5e/cca 0 2024-02-15T18:27:15.842 INFO:tasks.workunit.client.1.smithi133.stdout:9/705: dread d0/d8/d9/f3b [0,4194304] 0 2024-02-15T18:27:15.842 INFO:tasks.workunit.client.1.smithi133.stdout:8/679: creat d3/fe6 x:0 0 0 2024-02-15T18:27:15.842 INFO:tasks.workunit.client.1.smithi133.stdout:8/680: dread - d3/de/fb9 zero size 2024-02-15T18:27:15.842 INFO:tasks.workunit.client.0.smithi084.stdout:3/984: unlink d8/d40/d43/d71/d8c/fb7 0 2024-02-15T18:27:15.843 INFO:tasks.workunit.client.0.smithi084.stdout:3/985: mkdir d8/d1f/dbf/db6/d10c/d124/d14c 0 2024-02-15T18:27:15.844 INFO:tasks.workunit.client.0.smithi084.stdout:3/986: creat d8/d40/d43/d71/d8c/f14d x:0 0 0 2024-02-15T18:27:15.845 INFO:tasks.workunit.client.1.smithi133.stdout:9/706: link d0/d8/d9/d12/d82/l68 d0/d8/d10/da1/le6 0 2024-02-15T18:27:15.845 INFO:tasks.workunit.client.1.smithi133.stdout:9/707: rename d0 to d0/d8/d9/d12/d82/d89/de7 22 2024-02-15T18:27:15.846 INFO:tasks.workunit.client.0.smithi084.stdout:3/987: symlink d8/d73/db9/d13e/l14e 0 2024-02-15T18:27:15.846 INFO:tasks.workunit.client.1.smithi133.stdout:8/681: truncate d3/d7/f95 524688 0 2024-02-15T18:27:15.846 INFO:tasks.workunit.client.1.smithi133.stdout:8/682: stat d3/d1c/d2f/d87/lb5 0 2024-02-15T18:27:15.846 INFO:tasks.workunit.client.1.smithi133.stdout:5/638: mknod d17/d20/d32/d38/d70/ccb 0 2024-02-15T18:27:15.846 INFO:tasks.workunit.client.1.smithi133.stdout:9/708: dread d0/d7b/fbc [0,4194304] 0 2024-02-15T18:27:15.848 INFO:tasks.workunit.client.0.smithi084.stdout:3/988: rename d8/d73/db9/d13e/d80/dc4/d139/l13d to d8/d73/db9/d13e/d80/dc4/d139/d13a/l14f 0 2024-02-15T18:27:15.850 INFO:tasks.workunit.client.1.smithi133.stdout:8/683: dread d3/d1c/d37/d5c/f89 [0,4194304] 0 2024-02-15T18:27:15.850 INFO:tasks.workunit.client.1.smithi133.stdout:9/709: mkdir d0/d8/d9/d12/d82/d42/d79/d90/de8 0 2024-02-15T18:27:15.851 INFO:tasks.workunit.client.1.smithi133.stdout:8/684: write d3/d1c/d2f/d87/d73/d84/f98 [3116644,97] 0 2024-02-15T18:27:15.851 INFO:tasks.workunit.client.1.smithi133.stdout:8/685: dread - d3/d1c/fa9 zero size 2024-02-15T18:27:15.854 INFO:tasks.workunit.client.1.smithi133.stdout:9/710: symlink d0/d8/d10/d4d/dc6/le9 0 2024-02-15T18:27:15.855 INFO:tasks.workunit.client.1.smithi133.stdout:8/686: creat d3/d1c/d2f/fe7 x:0 0 0 2024-02-15T18:27:15.855 INFO:tasks.workunit.client.1.smithi133.stdout:8/687: readlink d3/d1f/d4f/lc3 0 2024-02-15T18:27:15.855 INFO:tasks.workunit.client.1.smithi133.stdout:8/688: chown d3/d1c/d2f/d87 3 1 2024-02-15T18:27:15.855 INFO:tasks.workunit.client.1.smithi133.stdout:8/689: write d3/d1f/d3f/f9f [340346,1997] 0 2024-02-15T18:27:15.856 INFO:tasks.workunit.client.1.smithi133.stdout:9/711: creat d0/d8/d10/d4d/fea x:0 0 0 2024-02-15T18:27:15.857 INFO:tasks.workunit.client.1.smithi133.stdout:8/690: symlink d3/d1c/d2f/d87/le8 0 2024-02-15T18:27:15.857 INFO:tasks.workunit.client.1.smithi133.stdout:9/712: dread d0/f5 [4194304,4194304] 0 2024-02-15T18:27:15.858 INFO:tasks.workunit.client.1.smithi133.stdout:8/691: write d3/d1c/d2f/f7d [271764,82021] 0 2024-02-15T18:27:15.859 INFO:tasks.workunit.client.1.smithi133.stdout:9/713: symlink d0/d8/leb 0 2024-02-15T18:27:15.859 INFO:tasks.workunit.client.1.smithi133.stdout:9/714: stat d0/d8/d9/d12/d82/d42/d79/d90 0 2024-02-15T18:27:15.860 INFO:tasks.workunit.client.0.smithi084.stdout:3/989: dread d8/f15 [4194304,4194304] 0 2024-02-15T18:27:15.860 INFO:tasks.workunit.client.0.smithi084.stdout:3/990: fsync d8/d73/db9/dca/fe4 0 2024-02-15T18:27:15.860 INFO:tasks.workunit.client.0.smithi084.stdout:3/991: write d8/d1f/dbf/db6/f105 [545656,6288] 0 2024-02-15T18:27:15.860 INFO:tasks.workunit.client.1.smithi133.stdout:8/692: creat d3/d1c/d2f/d76/fe9 x:0 0 0 2024-02-15T18:27:15.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/715: mknod d0/d8/d9/d12/d7f/cec 0 2024-02-15T18:27:15.863 INFO:tasks.workunit.client.1.smithi133.stdout:8/693: mknod d3/d1f/cea 0 2024-02-15T18:27:15.863 INFO:tasks.workunit.client.1.smithi133.stdout:8/694: fsync d3/f46 0 2024-02-15T18:27:15.863 INFO:tasks.workunit.client.1.smithi133.stdout:8/695: chown d3/de/d3e/ccb 613 1 2024-02-15T18:27:15.863 INFO:tasks.workunit.client.1.smithi133.stdout:8/696: fsync d3/d1f/d3f/d58/f78 0 2024-02-15T18:27:15.864 INFO:tasks.workunit.client.1.smithi133.stdout:8/697: symlink d3/d1c/d2f/d87/d73/d84/dda/leb 0 2024-02-15T18:27:15.901 INFO:tasks.workunit.client.1.smithi133.stdout:9/716: dwrite d0/f55 [4194304,4194304] 0 2024-02-15T18:27:15.901 INFO:tasks.workunit.client.0.smithi084.stdout:3/992: dwrite d8/d40/d43/d71/d8c/d94/d12f/f13b [0,4194304] 0 2024-02-15T18:27:15.901 INFO:tasks.workunit.client.0.smithi084.stdout:3/993: chown d8/l98 2268 1 2024-02-15T18:27:15.902 INFO:tasks.workunit.client.1.smithi133.stdout:8/698: dwrite d3/fe6 [0,4194304] 0 2024-02-15T18:27:15.903 INFO:tasks.workunit.client.1.smithi133.stdout:9/717: creat d0/d8/d9/d12/d82/d89/fed x:0 0 0 2024-02-15T18:27:15.904 INFO:tasks.workunit.client.0.smithi084.stdout:3/994: creat d8/d73/db9/d13e/f150 x:0 0 0 2024-02-15T18:27:15.905 INFO:tasks.workunit.client.0.smithi084.stdout:3/995: creat d8/d73/f151 x:0 0 0 2024-02-15T18:27:15.906 INFO:tasks.workunit.client.0.smithi084.stdout:3/996: dread - d8/d73/f141 zero size 2024-02-15T18:27:15.911 INFO:tasks.workunit.client.1.smithi133.stdout:8/699: mkdir d3/d7/d40/dec 0 2024-02-15T18:27:15.912 INFO:tasks.workunit.client.1.smithi133.stdout:8/700: chown d3/f81 47205276 1 2024-02-15T18:27:15.912 INFO:tasks.workunit.client.1.smithi133.stdout:8/701: write d3/d1c/d37/f7b [5074038,29634] 0 2024-02-15T18:27:15.912 INFO:tasks.workunit.client.1.smithi133.stdout:8/702: truncate d3/d1c/d2f/d87/fac 1734686 0 2024-02-15T18:27:15.916 INFO:tasks.workunit.client.1.smithi133.stdout:8/703: rename d3/d1f/d3f to d3/de/d3e/d94/ded 0 2024-02-15T18:27:15.917 INFO:tasks.workunit.client.1.smithi133.stdout:8/704: write d3/d1c/d2f/d87/fac [700092,82500] 0 2024-02-15T18:27:15.926 INFO:tasks.workunit.client.1.smithi133.stdout:1/926: sync 2024-02-15T18:27:15.926 INFO:tasks.workunit.client.1.smithi133.stdout:2/813: sync 2024-02-15T18:27:15.927 INFO:tasks.workunit.client.1.smithi133.stdout:2/814: getdents d7/d2c/d5a 0 2024-02-15T18:27:15.928 INFO:tasks.workunit.client.1.smithi133.stdout:3/844: sync 2024-02-15T18:27:15.929 INFO:tasks.workunit.client.1.smithi133.stdout:9/718: dwrite d0/d37/fd8 [0,4194304] 0 2024-02-15T18:27:15.929 INFO:tasks.workunit.client.1.smithi133.stdout:3/845: creat d0/d15/d2f/d9b/d39/f114 x:0 0 0 2024-02-15T18:27:15.929 INFO:tasks.workunit.client.0.smithi084.stdout:3/997: dwrite d8/d40/d43/d71/d8c/d94/da3/de5/fe6 [0,4194304] 0 2024-02-15T18:27:15.931 INFO:tasks.workunit.client.0.smithi084.stdout:3/998: dread d8/d1f/dbf/fe9 [0,4194304] 0 2024-02-15T18:27:15.931 INFO:tasks.workunit.client.0.smithi084.stdout:3/999: write d8/d73/db9/d13e/ff9 [891220,18084] 0 2024-02-15T18:27:15.931 INFO:tasks.workunit.client.1.smithi133.stdout:1/927: dread d6/d1e/d3a/d82/d85/dc7/fca [0,4194304] 0 2024-02-15T18:27:15.931 INFO:tasks.workunit.client.1.smithi133.stdout:1/928: stat d6/d1e/d3a/d79 0 2024-02-15T18:27:15.932 INFO:tasks.workunit.client.1.smithi133.stdout:9/719: unlink d0/d8/cce 0 2024-02-15T18:27:15.933 INFO:tasks.workunit.client.1.smithi133.stdout:3/846: symlink d0/d15/d37/d4a/dc4/d107/l115 0 2024-02-15T18:27:15.933 INFO:tasks.workunit.client.1.smithi133.stdout:3/847: readlink d0/d15/d54/da5/lf3 0 2024-02-15T18:27:15.934 INFO:tasks.workunit.client.1.smithi133.stdout:1/929: mknod d6/d1e/d3a/d82/d85/d67/dd3/c152 0 2024-02-15T18:27:15.934 INFO:tasks.workunit.client.1.smithi133.stdout:1/930: creat d6/d2a/d59/d5a/da4/f153 x:0 0 0 2024-02-15T18:27:15.934 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm -rf -- ./tmp.mCFWx7f6z5 2024-02-15T18:27:15.935 INFO:tasks.workunit.client.1.smithi133.stdout:1/931: mkdir d6/d1e/d3a/d82/d85/d102/d154 0 2024-02-15T18:27:15.935 INFO:tasks.workunit.client.1.smithi133.stdout:3/848: write d0/d15/d2f/db4/f7e [2179301,82064] 0 2024-02-15T18:27:15.935 INFO:tasks.workunit.client.1.smithi133.stdout:3/849: chown d0/d15/cdd 1371928662 1 2024-02-15T18:27:15.935 INFO:tasks.workunit.client.1.smithi133.stdout:3/850: readlink d0/d15/d2f/d9b/d39/d3f/dc1/d78/le3 0 2024-02-15T18:27:15.936 INFO:tasks.workunit.client.1.smithi133.stdout:1/932: creat d6/d1e/d3a/d82/d85/f155 x:0 0 0 2024-02-15T18:27:15.938 INFO:tasks.workunit.client.1.smithi133.stdout:3/851: unlink d0/d15/d2f/d5e/cfb 0 2024-02-15T18:27:15.938 INFO:tasks.workunit.client.1.smithi133.stdout:9/720: write d0/f6 [215457,27648] 0 2024-02-15T18:27:15.944 INFO:tasks.workunit.client.1.smithi133.stdout:3/852: rename d0/d15/d2f/d9b/dc5/ddb/cdf to d0/d15/d54/c116 0 2024-02-15T18:27:15.944 INFO:tasks.workunit.client.1.smithi133.stdout:3/853: write d0/d15/d2f/d9b/d39/dcd/de6/f110 [134915,79340] 0 2024-02-15T18:27:15.947 INFO:tasks.workunit.client.1.smithi133.stdout:8/705: dwrite d3/d7/d40/d61/f65 [0,4194304] 0 2024-02-15T18:27:15.968 INFO:tasks.workunit.client.1.smithi133.stdout:1/933: dwrite d6/d1e/d41/d7c/f98 [0,4194304] 0 2024-02-15T18:27:15.972 INFO:tasks.workunit.client.1.smithi133.stdout:1/934: creat d6/d1e/d3a/d97/dda/dff/d13d/d151/f156 x:0 0 0 2024-02-15T18:27:15.974 INFO:tasks.workunit.client.1.smithi133.stdout:3/854: dwrite d0/d15/d2f/f7d [0,4194304] 0 2024-02-15T18:27:15.974 INFO:tasks.workunit.client.1.smithi133.stdout:1/935: getdents d6/d2a 0 2024-02-15T18:27:15.978 INFO:tasks.workunit.client.1.smithi133.stdout:8/706: dwrite d3/de/f66 [0,4194304] 0 2024-02-15T18:27:15.978 INFO:tasks.workunit.client.1.smithi133.stdout:8/707: write d3/d1c/d37/f7b [5479127,37298] 0 2024-02-15T18:27:15.982 INFO:tasks.workunit.client.1.smithi133.stdout:8/708: creat d3/de/d3e/d82/fee x:0 0 0 2024-02-15T18:27:15.989 INFO:tasks.workunit.client.1.smithi133.stdout:8/709: dread d3/f3a [0,4194304] 0 2024-02-15T18:27:15.990 INFO:tasks.workunit.client.1.smithi133.stdout:8/710: symlink d3/de/lef 0 2024-02-15T18:27:15.992 INFO:tasks.workunit.client.1.smithi133.stdout:3/855: dwrite d0/d15/d2f/d9b/d39/d3f/f22 [0,4194304] 0 2024-02-15T18:27:15.992 INFO:tasks.workunit.client.1.smithi133.stdout:8/711: mkdir d3/d1c/d37/df0 0 2024-02-15T18:27:15.994 INFO:tasks.workunit.client.1.smithi133.stdout:8/712: symlink d3/d92/lf1 0 2024-02-15T18:27:15.997 INFO:tasks.workunit.client.1.smithi133.stdout:8/713: symlink d3/de/d3e/d94/ded/lf2 0 2024-02-15T18:27:15.997 INFO:tasks.workunit.client.1.smithi133.stdout:8/714: chown d3/d1c/d37/l6d 272 1 2024-02-15T18:27:15.998 INFO:tasks.workunit.client.1.smithi133.stdout:8/715: truncate d3/de/d3e/d94/ded/f85 3959903 0 2024-02-15T18:27:15.998 INFO:tasks.workunit.client.1.smithi133.stdout:8/716: chown d3/d1c/d2f/d87/d73/d84/dda 3672556 1 2024-02-15T18:27:16.002 INFO:tasks.workunit.client.1.smithi133.stdout:8/717: link d3/de/d3e/d94/ded/d58/f78 d3/d1c/d2f/ff3 0 2024-02-15T18:27:16.005 INFO:tasks.workunit.client.1.smithi133.stdout:8/718: rename d3/d1f/d4f/da3/dc1/cc7 to d3/d92/cf4 0 2024-02-15T18:27:16.007 INFO:tasks.workunit.client.1.smithi133.stdout:3/856: dwrite d0/d15/d2f/d5e/f97 [4194304,4194304] 0 2024-02-15T18:27:16.007 INFO:tasks.workunit.client.1.smithi133.stdout:3/857: write d0/d15/d54/f5b [693991,105987] 0 2024-02-15T18:27:16.007 INFO:tasks.workunit.client.1.smithi133.stdout:8/719: creat d3/d7/d52/ff5 x:0 0 0 2024-02-15T18:27:16.007 INFO:tasks.workunit.client.1.smithi133.stdout:8/720: write d3/d1c/f51 [3503839,108015] 0 2024-02-15T18:27:16.009 INFO:tasks.workunit.client.1.smithi133.stdout:3/858: truncate d0/f2d 2728584 0 2024-02-15T18:27:16.009 INFO:tasks.workunit.client.1.smithi133.stdout:3/859: dread - d0/d15/d2f/d9b/d39/da2/f104 zero size 2024-02-15T18:27:16.011 INFO:tasks.workunit.client.1.smithi133.stdout:8/721: rename d3/d1f/d4f/fa5 to d3/d7/d40/d61/ff6 0 2024-02-15T18:27:16.016 INFO:tasks.workunit.client.1.smithi133.stdout:3/860: getdents d0/d15/d2f/d9b/d72 0 2024-02-15T18:27:16.016 INFO:tasks.workunit.client.1.smithi133.stdout:8/722: getdents d3/d1f/d4f/dab 0 2024-02-15T18:27:16.018 INFO:tasks.workunit.client.1.smithi133.stdout:3/861: symlink d0/d15/d37/d7b/l117 0 2024-02-15T18:27:16.018 INFO:tasks.workunit.client.1.smithi133.stdout:3/862: chown d0/d15/d54/da5/ce1 124191 1 2024-02-15T18:27:16.020 INFO:tasks.workunit.client.1.smithi133.stdout:8/723: mknod d3/d1f/d4f/dab/cf7 0 2024-02-15T18:27:16.020 INFO:tasks.workunit.client.1.smithi133.stdout:8/724: symlink d3/de/d3e/d94/ded/d58/lf8 0 2024-02-15T18:27:16.024 INFO:tasks.workunit.client.1.smithi133.stdout:8/725: read d3/d7/f72 [613049,56845] 0 2024-02-15T18:27:16.026 INFO:tasks.workunit.client.1.smithi133.stdout:8/726: creat d3/d1c/d2f/d87/d73/ff9 x:0 0 0 2024-02-15T18:27:16.028 INFO:tasks.workunit.client.1.smithi133.stdout:8/727: rename d3/d1f/d4f/l7a to d3/de/d3e/d94/ded/d58/da8/lfa 0 2024-02-15T18:27:16.052 INFO:tasks.workunit.client.1.smithi133.stdout:0/827: sync 2024-02-15T18:27:16.052 INFO:tasks.workunit.client.1.smithi133.stdout:5/639: sync 2024-02-15T18:27:16.052 INFO:tasks.workunit.client.1.smithi133.stdout:4/570: sync 2024-02-15T18:27:16.052 INFO:tasks.workunit.client.1.smithi133.stdout:7/666: sync 2024-02-15T18:27:16.052 INFO:tasks.workunit.client.1.smithi133.stdout:7/667: readlink d9/d36/d31/dc1/dcd/dde/l45 0 2024-02-15T18:27:16.053 INFO:tasks.workunit.client.1.smithi133.stdout:5/640: write d17/d2a/fb2 [981732,67329] 0 2024-02-15T18:27:16.053 INFO:tasks.workunit.client.1.smithi133.stdout:4/571: rmdir d2/d5/d2b/d21/d2d/d44/d51/d60/d63 39 2024-02-15T18:27:16.053 INFO:tasks.workunit.client.1.smithi133.stdout:4/572: truncate d2/d5/d2b/fe 4903702 0 2024-02-15T18:27:16.054 INFO:tasks.workunit.client.1.smithi133.stdout:0/828: read d9/ff [2545123,130626] 0 2024-02-15T18:27:16.056 INFO:tasks.workunit.client.1.smithi133.stdout:4/573: rename d2/d5/f10 to d2/d48/d5c/d93/d8d/d96/fb8 0 2024-02-15T18:27:16.058 INFO:tasks.workunit.client.1.smithi133.stdout:4/574: creat d2/d5/d2b/d21/fb9 x:0 0 0 2024-02-15T18:27:16.063 INFO:tasks.workunit.client.1.smithi133.stdout:5/641: dread d17/d20/d32/d38/d70/f91 [0,4194304] 0 2024-02-15T18:27:16.063 INFO:tasks.workunit.client.1.smithi133.stdout:5/642: stat l8 0 2024-02-15T18:27:16.082 INFO:tasks.workunit.client.1.smithi133.stdout:5/643: write d17/d20/f8d [89979,114550] 0 2024-02-15T18:27:16.083 INFO:tasks.workunit.client.1.smithi133.stdout:5/644: readlink d17/d20/la8 0 2024-02-15T18:27:16.083 INFO:tasks.workunit.client.1.smithi133.stdout:5/645: truncate d17/d20/d32/d38/d70/f72 284314 0 2024-02-15T18:27:16.083 INFO:tasks.workunit.client.1.smithi133.stdout:7/668: dwrite d9/fd2 [0,4194304] 0 2024-02-15T18:27:16.083 INFO:tasks.workunit.client.1.smithi133.stdout:7/669: write d9/db/d16/d4f/fdf [148363,13971] 0 2024-02-15T18:27:16.087 INFO:tasks.workunit.client.1.smithi133.stdout:0/829: dwrite d9/d2b/dd2/fe7 [4194304,4194304] 0 2024-02-15T18:27:16.095 INFO:tasks.workunit.client.1.smithi133.stdout:4/575: dwrite d2/d5/d2b/d21/f8f [4194304,4194304] 0 2024-02-15T18:27:16.095 INFO:tasks.workunit.client.1.smithi133.stdout:4/576: chown d2/d5/d2b/d21/d36/c42 60 1 2024-02-15T18:27:16.095 INFO:tasks.workunit.client.1.smithi133.stdout:4/577: stat d2/d48/d5c/f62 0 2024-02-15T18:27:16.109 INFO:tasks.workunit.client.1.smithi133.stdout:4/578: write d2/d5/d2b/d21/d3b/d49/f57 [1592804,123646] 0 2024-02-15T18:27:16.109 INFO:tasks.workunit.client.1.smithi133.stdout:4/579: readlink d2/d5/l28 0 2024-02-15T18:27:16.112 INFO:tasks.workunit.client.1.smithi133.stdout:4/580: rename d2/d5/d2b/d21/d36 to d2/d48/d5c/db7/dba 0 2024-02-15T18:27:16.113 INFO:tasks.workunit.client.1.smithi133.stdout:4/581: mknod d2/d5/d2b/d21/d2d/cbb 0 2024-02-15T18:27:16.113 INFO:tasks.workunit.client.1.smithi133.stdout:4/582: dread - d2/d48/d5c/d93/d8d/f91 zero size 2024-02-15T18:27:16.114 INFO:tasks.workunit.client.1.smithi133.stdout:4/583: rmdir d2/d5/d2b 39 2024-02-15T18:27:16.115 INFO:tasks.workunit.client.1.smithi133.stdout:4/584: mknod d2/d5/d2b/d21/d2d/d44/d51/d60/cbc 0 2024-02-15T18:27:16.120 INFO:tasks.workunit.client.1.smithi133.stdout:5/646: dwrite d17/f46 [0,4194304] 0 2024-02-15T18:27:16.121 INFO:tasks.workunit.client.1.smithi133.stdout:5/647: chown d17/d20/d5e/f7f 0 1 2024-02-15T18:27:16.122 INFO:tasks.workunit.client.1.smithi133.stdout:7/670: dwrite d9/da/d48/d62/d64/fd1 [0,4194304] 0 2024-02-15T18:27:16.122 INFO:tasks.workunit.client.1.smithi133.stdout:0/830: dwrite d9/d10/d47/d5e/f8e [4194304,4194304] 0 2024-02-15T18:27:16.124 INFO:tasks.workunit.client.1.smithi133.stdout:4/585: getdents d2/d48/d5c/db7 0 2024-02-15T18:27:16.124 INFO:tasks.workunit.client.1.smithi133.stdout:4/586: fdatasync d2/d48/d6a/d9e/fad 0 2024-02-15T18:27:16.124 INFO:tasks.workunit.client.1.smithi133.stdout:5/648: write d17/d26/f58 [759262,41358] 0 2024-02-15T18:27:16.126 INFO:tasks.workunit.client.1.smithi133.stdout:7/671: unlink d9/db/d16/d4f/lb6 0 2024-02-15T18:27:16.127 INFO:tasks.workunit.client.1.smithi133.stdout:7/672: chown d9/d36/d39/la7 5545 1 2024-02-15T18:27:16.130 INFO:tasks.workunit.client.1.smithi133.stdout:0/831: rmdir d9/d10/d19/d29/d67 39 2024-02-15T18:27:16.131 INFO:tasks.workunit.client.1.smithi133.stdout:4/587: getdents d2/d48/d5c/db7/dba 0 2024-02-15T18:27:16.131 INFO:tasks.workunit.client.1.smithi133.stdout:4/588: write d2/d5/d2b/d21/d2d/d44/f46 [4385223,101995] 0 2024-02-15T18:27:16.135 INFO:tasks.workunit.client.1.smithi133.stdout:7/673: symlink d9/db/d16/d5d/d68/d73/d9b/da6/le0 0 2024-02-15T18:27:16.136 INFO:tasks.workunit.client.1.smithi133.stdout:0/832: rmdir d9/d10/dcb 39 2024-02-15T18:27:16.138 INFO:tasks.workunit.client.1.smithi133.stdout:4/589: creat d2/d5/d2b/d21/d2d/d44/da4/fbd x:0 0 0 2024-02-15T18:27:16.138 INFO:tasks.workunit.client.1.smithi133.stdout:4/590: read - d2/d5/d2b/d21/da2/d5e/faf zero size 2024-02-15T18:27:16.139 INFO:tasks.workunit.client.1.smithi133.stdout:5/649: truncate d17/f47 118160 0 2024-02-15T18:27:16.139 INFO:tasks.workunit.client.1.smithi133.stdout:7/674: creat d9/db/d55/d63/fe1 x:0 0 0 2024-02-15T18:27:16.140 INFO:tasks.workunit.client.1.smithi133.stdout:5/650: symlink d17/d20/dc3/lcc 0 2024-02-15T18:27:16.142 INFO:tasks.workunit.client.1.smithi133.stdout:5/651: truncate d17/f1c 6786027 0 2024-02-15T18:27:16.142 INFO:tasks.workunit.client.1.smithi133.stdout:5/652: stat d17/d20/d32/d9d/da9/cb7 0 2024-02-15T18:27:16.142 INFO:tasks.workunit.client.1.smithi133.stdout:5/653: fsync d17/d26/fbe 0 2024-02-15T18:27:16.144 INFO:tasks.workunit.client.1.smithi133.stdout:7/675: link d9/d36/d3d/fd4 d9/d36/d31/dc1/dcd/dde/fe2 0 2024-02-15T18:27:16.159 INFO:tasks.workunit.client.1.smithi133.stdout:2/815: sync 2024-02-15T18:27:16.160 INFO:tasks.workunit.client.1.smithi133.stdout:2/816: creat d7/db/d35/f108 x:0 0 0 2024-02-15T18:27:16.161 INFO:tasks.workunit.client.1.smithi133.stdout:0/833: dwrite d9/d2b/dd2/fe7 [4194304,4194304] 0 2024-02-15T18:27:16.161 INFO:tasks.workunit.client.1.smithi133.stdout:0/834: stat d9/d10/d19/d29/d67/d68/d96/d44/l83 0 2024-02-15T18:27:16.162 INFO:tasks.workunit.client.1.smithi133.stdout:0/835: getdents d9/d10 0 2024-02-15T18:27:16.165 INFO:tasks.workunit.client.1.smithi133.stdout:0/836: read d9/d10/d47/f87 [3421243,1515] 0 2024-02-15T18:27:16.167 INFO:tasks.workunit.client.1.smithi133.stdout:0/837: mkdir d9/d10/d19/dfb/d10b 0 2024-02-15T18:27:16.167 INFO:tasks.workunit.client.1.smithi133.stdout:0/838: readlink d9/d10/d22/ld9 0 2024-02-15T18:27:16.167 INFO:tasks.workunit.client.1.smithi133.stdout:0/839: truncate d9/d10/d2c/f8a 122855 0 2024-02-15T18:27:16.168 INFO:tasks.workunit.client.1.smithi133.stdout:0/840: mknod d9/d10/d19/dfb/c10c 0 2024-02-15T18:27:16.171 INFO:tasks.workunit.client.1.smithi133.stdout:0/841: write f5 [1225556,69384] 0 2024-02-15T18:27:16.171 INFO:tasks.workunit.client.1.smithi133.stdout:0/842: chown d9/d10/d22/d2f/f71 9499328 1 2024-02-15T18:27:16.172 INFO:tasks.workunit.client.1.smithi133.stdout:0/843: getdents d9/d28/df4 0 2024-02-15T18:27:16.172 INFO:tasks.workunit.client.1.smithi133.stdout:0/844: write d9/d10/dcb/ff2 [202570,103390] 0 2024-02-15T18:27:16.173 INFO:tasks.workunit.client.1.smithi133.stdout:0/845: dread - d9/d10/d47/d5e/de6/ffd zero size 2024-02-15T18:27:16.173 INFO:tasks.workunit.client.1.smithi133.stdout:0/846: getdents d9/d10/dcb 0 2024-02-15T18:27:16.176 INFO:tasks.workunit.client.1.smithi133.stdout:4/591: dwrite d2/d5/d2b/d21/d3b/d49/f57 [0,4194304] 0 2024-02-15T18:27:16.176 INFO:tasks.workunit.client.1.smithi133.stdout:4/592: stat d2/d5/d2b/d21/d3b 0 2024-02-15T18:27:16.176 INFO:tasks.workunit.client.1.smithi133.stdout:4/593: readlink d2/d5/d2b/d21/da2/d5e/l6e 0 2024-02-15T18:27:16.177 INFO:tasks.workunit.client.1.smithi133.stdout:4/594: rmdir d2/d5/d2b/d21/da2/d5e 39 2024-02-15T18:27:16.178 INFO:tasks.workunit.client.1.smithi133.stdout:5/654: dwrite d17/d26/d7b/f89 [0,4194304] 0 2024-02-15T18:27:16.178 INFO:tasks.workunit.client.1.smithi133.stdout:5/655: dread - d17/d20/d32/d9d/da9/faa zero size 2024-02-15T18:27:16.178 INFO:tasks.workunit.client.1.smithi133.stdout:5/656: stat d17/d20/d32/d38/d86 0 2024-02-15T18:27:16.179 INFO:tasks.workunit.client.1.smithi133.stdout:4/595: creat d2/fbe x:0 0 0 2024-02-15T18:27:16.179 INFO:tasks.workunit.client.1.smithi133.stdout:2/817: dwrite d7/d18/d32/d65/f55 [0,4194304] 0 2024-02-15T18:27:16.180 INFO:tasks.workunit.client.1.smithi133.stdout:4/596: dread d2/d5/d2b/d21/f99 [0,4194304] 0 2024-02-15T18:27:16.182 INFO:tasks.workunit.client.1.smithi133.stdout:5/657: mkdir d17/d20/d32/d7d/dcd 0 2024-02-15T18:27:16.184 INFO:tasks.workunit.client.1.smithi133.stdout:5/658: write d17/f33 [1871771,53571] 0 2024-02-15T18:27:16.184 INFO:tasks.workunit.client.1.smithi133.stdout:0/847: dread d9/d10/d47/f5a [4194304,4194304] 0 2024-02-15T18:27:16.184 INFO:tasks.workunit.client.1.smithi133.stdout:2/818: creat d7/d2c/dd5/f109 x:0 0 0 2024-02-15T18:27:16.186 INFO:tasks.workunit.client.1.smithi133.stdout:4/597: mknod d2/d5/d2b/d21/d2d/d44/d51/d60/d63/cbf 0 2024-02-15T18:27:16.187 INFO:tasks.workunit.client.1.smithi133.stdout:0/848: dread d9/d10/d22/d32/f64 [0,4194304] 0 2024-02-15T18:27:16.188 INFO:tasks.workunit.client.1.smithi133.stdout:0/849: fdatasync d9/d10/f54 0 2024-02-15T18:27:16.188 INFO:tasks.workunit.client.1.smithi133.stdout:0/850: fdatasync d9/d10/d22/d32/f64 0 2024-02-15T18:27:16.188 INFO:tasks.workunit.client.1.smithi133.stdout:0/851: fsync d9/d10/d2c/fdc 0 2024-02-15T18:27:16.188 INFO:tasks.workunit.client.1.smithi133.stdout:5/659: creat d17/d20/d32/d9d/fce x:0 0 0 2024-02-15T18:27:16.189 INFO:tasks.workunit.client.1.smithi133.stdout:5/660: read d17/d20/d4f/d5f/f60 [1051950,5924] 0 2024-02-15T18:27:16.189 INFO:tasks.workunit.client.1.smithi133.stdout:2/819: creat d7/d18/d32/d65/d99/dfb/f10a x:0 0 0 2024-02-15T18:27:16.189 INFO:tasks.workunit.client.1.smithi133.stdout:4/598: symlink d2/d5/d2b/d21/d3b/d49/d98/lc0 0 2024-02-15T18:27:16.190 INFO:tasks.workunit.client.1.smithi133.stdout:0/852: symlink d9/d10/d22/d32/d7f/l10d 0 2024-02-15T18:27:16.191 INFO:tasks.workunit.client.1.smithi133.stdout:5/661: getdents d17/d20/dc3 0 2024-02-15T18:27:16.192 INFO:tasks.workunit.client.1.smithi133.stdout:2/820: creat d7/db/d67/f10b x:0 0 0 2024-02-15T18:27:16.192 INFO:tasks.workunit.client.1.smithi133.stdout:2/821: write d7/d2c/d3b/d48/d6d/ff5 [942251,51291] 0 2024-02-15T18:27:16.192 INFO:tasks.workunit.client.1.smithi133.stdout:2/822: readlink d7/d2c/d5a/d66/l95 0 2024-02-15T18:27:16.193 INFO:tasks.workunit.client.1.smithi133.stdout:0/853: rename d9/d10/d22/d2f/d9f/fb2 to d9/d10/d19/d8c/f10e 0 2024-02-15T18:27:16.194 INFO:tasks.workunit.client.1.smithi133.stdout:5/662: mknod d17/d20/ccf 0 2024-02-15T18:27:16.195 INFO:tasks.workunit.client.1.smithi133.stdout:5/663: mknod d17/d2a/cd0 0 2024-02-15T18:27:16.196 INFO:tasks.workunit.client.1.smithi133.stdout:5/664: getdents d17/d20/d32/d38 0 2024-02-15T18:27:16.196 INFO:tasks.workunit.client.1.smithi133.stdout:5/665: chown l1 173 1 2024-02-15T18:27:16.201 INFO:tasks.workunit.client.1.smithi133.stdout:5/666: creat d17/d20/d32/fd1 x:0 0 0 2024-02-15T18:27:16.203 INFO:tasks.workunit.client.1.smithi133.stdout:5/667: creat d17/d20/d32/d7d/fd2 x:0 0 0 2024-02-15T18:27:16.203 INFO:tasks.workunit.client.1.smithi133.stdout:5/668: fdatasync d17/f50 0 2024-02-15T18:27:16.205 INFO:tasks.workunit.client.1.smithi133.stdout:5/669: rename d17/f36 to d17/d20/d32/d38/d86/db6/fd3 0 2024-02-15T18:27:16.206 INFO:tasks.workunit.client.1.smithi133.stdout:4/599: dread d2/d5/d2b/d21/d2d/d44/f47 [0,4194304] 0 2024-02-15T18:27:16.206 INFO:tasks.workunit.client.1.smithi133.stdout:4/600: fsync d2/d48/d5c/db7/dba/dab/fb1 0 2024-02-15T18:27:16.207 INFO:tasks.workunit.client.1.smithi133.stdout:5/670: unlink d17/d20/d32/d7d/ca7 0 2024-02-15T18:27:16.208 INFO:tasks.workunit.client.1.smithi133.stdout:5/671: creat d17/d20/d32/d7d/dcd/fd4 x:0 0 0 2024-02-15T18:27:16.218 INFO:tasks.workunit.client.1.smithi133.stdout:4/601: dread d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 [4194304,4194304] 0 2024-02-15T18:27:16.219 INFO:tasks.workunit.client.1.smithi133.stdout:4/602: symlink d2/d48/d5c/d9f/lc1 0 2024-02-15T18:27:16.220 INFO:tasks.workunit.client.1.smithi133.stdout:4/603: creat d2/d48/fc2 x:0 0 0 2024-02-15T18:27:16.221 INFO:tasks.workunit.client.1.smithi133.stdout:5/672: dread d17/d20/f57 [0,4194304] 0 2024-02-15T18:27:16.221 INFO:tasks.workunit.client.1.smithi133.stdout:5/673: fdatasync d17/d2a/f9c 0 2024-02-15T18:27:16.221 INFO:tasks.workunit.client.1.smithi133.stdout:5/674: write d17/d20/d32/d9d/fa5 [180426,86256] 0 2024-02-15T18:27:16.221 INFO:tasks.workunit.client.1.smithi133.stdout:4/604: truncate d2/d5/d2b/d21/fa1 750462 0 2024-02-15T18:27:16.222 INFO:tasks.workunit.client.1.smithi133.stdout:5/675: mkdir d17/d20/d32/d9d/da9/dd5 0 2024-02-15T18:27:16.224 INFO:tasks.workunit.client.1.smithi133.stdout:2/823: dwrite d7/d2c/d5a/d66/f7c [0,4194304] 0 2024-02-15T18:27:16.225 INFO:tasks.workunit.client.1.smithi133.stdout:0/854: dwrite d9/d10/d22/d2f/f51 [0,4194304] 0 2024-02-15T18:27:16.225 INFO:tasks.workunit.client.1.smithi133.stdout:2/824: write d7/ffd [5880292,48330] 0 2024-02-15T18:27:16.225 INFO:tasks.workunit.client.1.smithi133.stdout:2/825: chown d7/db/cee 89 1 2024-02-15T18:27:16.226 INFO:tasks.workunit.client.1.smithi133.stdout:2/826: dread - d7/d2c/d3b/d48/faf zero size 2024-02-15T18:27:16.228 INFO:tasks.workunit.client.1.smithi133.stdout:0/855: mknod d9/d10/d19/d29/d67/d68/d96/c10f 0 2024-02-15T18:27:16.229 INFO:tasks.workunit.client.1.smithi133.stdout:2/827: link d7/d18/d32/d65/d99/fc3 d7/d18/d32/df1/f10c 0 2024-02-15T18:27:16.229 INFO:tasks.workunit.client.1.smithi133.stdout:0/856: write f0 [968944,94894] 0 2024-02-15T18:27:16.239 INFO:tasks.workunit.client.1.smithi133.stdout:4/605: dwrite d2/d5/d2b/d21/f99 [0,4194304] 0 2024-02-15T18:27:16.240 INFO:tasks.workunit.client.1.smithi133.stdout:2/828: unlink d7/d2c/lad 0 2024-02-15T18:27:16.241 INFO:tasks.workunit.client.1.smithi133.stdout:0/857: creat d9/d10/d22/d2f/d9f/f110 x:0 0 0 2024-02-15T18:27:16.242 INFO:tasks.workunit.client.1.smithi133.stdout:0/858: read d9/d10/d85/ff8 [81905,37190] 0 2024-02-15T18:27:16.242 INFO:tasks.workunit.client.1.smithi133.stdout:0/859: fdatasync d9/d10/d19/d8c/ff0 0 2024-02-15T18:27:16.250 INFO:tasks.workunit.client.1.smithi133.stdout:0/860: rename d9/d10/d2c/l8d to d9/d28/dd6/l111 0 2024-02-15T18:27:16.251 INFO:tasks.workunit.client.1.smithi133.stdout:2/829: mkdir d7/db/d10d 0 2024-02-15T18:27:16.254 INFO:tasks.workunit.client.1.smithi133.stdout:2/830: creat d7/d2c/dd5/f10e x:0 0 0 2024-02-15T18:27:16.264 INFO:tasks.workunit.client.1.smithi133.stdout:9/721: sync 2024-02-15T18:27:16.264 INFO:tasks.workunit.client.1.smithi133.stdout:2/831: dread d7/d2c/d31/f38 [0,4194304] 0 2024-02-15T18:27:16.272 INFO:tasks.workunit.client.1.smithi133.stdout:5/676: dwrite d17/d20/d32/d38/d70/f72 [0,4194304] 0 2024-02-15T18:27:16.272 INFO:tasks.workunit.client.1.smithi133.stdout:5/677: chown d17/d20/d4f 22148 1 2024-02-15T18:27:16.273 INFO:tasks.workunit.client.1.smithi133.stdout:4/606: dwrite d2/d5/d2b/d21/d2d/d44/d51/f67 [0,4194304] 0 2024-02-15T18:27:16.273 INFO:tasks.workunit.client.1.smithi133.stdout:4/607: chown d2/d48/d5c/f80 7 1 2024-02-15T18:27:16.273 INFO:tasks.workunit.client.1.smithi133.stdout:0/861: dwrite d9/d10/d19/d29/d67/f6f [4194304,4194304] 0 2024-02-15T18:27:16.273 INFO:tasks.workunit.client.1.smithi133.stdout:1/936: sync 2024-02-15T18:27:16.277 INFO:tasks.workunit.client.1.smithi133.stdout:5/678: rmdir d17 39 2024-02-15T18:27:16.277 INFO:tasks.workunit.client.1.smithi133.stdout:5/679: fdatasync d17/d20/d32/d38/f96 0 2024-02-15T18:27:16.278 INFO:tasks.workunit.client.1.smithi133.stdout:5/680: write d17/f1c [2359632,73933] 0 2024-02-15T18:27:16.280 INFO:tasks.workunit.client.1.smithi133.stdout:1/937: rmdir d6/d2a/d59/d5a/da4/daa 39 2024-02-15T18:27:16.283 INFO:tasks.workunit.client.1.smithi133.stdout:5/681: rename d17/d26/l1f to d17/d20/d32/d7d/ld6 0 2024-02-15T18:27:16.285 INFO:tasks.workunit.client.1.smithi133.stdout:5/682: mkdir d17/d20/d32/d38/d86/dd7 0 2024-02-15T18:27:16.286 INFO:tasks.workunit.client.1.smithi133.stdout:5/683: rename d17/d20/d32/d7d/dcd/fd4 to d17/d20/d32/d7d/dcd/fd8 0 2024-02-15T18:27:16.287 INFO:tasks.workunit.client.1.smithi133.stdout:5/684: stat d17/d20/d32/d9d/l9e 0 2024-02-15T18:27:16.287 INFO:tasks.workunit.client.1.smithi133.stdout:1/938: dread d6/d2a/f48 [0,4194304] 0 2024-02-15T18:27:16.300 INFO:tasks.workunit.client.1.smithi133.stdout:4/608: dread d2/d5/d2b/d21/d2d/f2e [0,4194304] 0 2024-02-15T18:27:16.303 INFO:tasks.workunit.client.1.smithi133.stdout:4/609: creat d2/d48/d5c/fc3 x:0 0 0 2024-02-15T18:27:16.304 INFO:tasks.workunit.client.1.smithi133.stdout:4/610: getdents d2/d48/d6a/d9e 0 2024-02-15T18:27:16.305 INFO:tasks.workunit.client.1.smithi133.stdout:4/611: creat d2/d48/d5c/fc4 x:0 0 0 2024-02-15T18:27:16.307 INFO:tasks.workunit.client.1.smithi133.stdout:4/612: rmdir d2/d5/d2b/d21 39 2024-02-15T18:27:16.308 INFO:tasks.workunit.client.1.smithi133.stdout:2/832: dwrite d7/d2c/dd5/f10e [0,4194304] 0 2024-02-15T18:27:16.308 INFO:tasks.workunit.client.1.smithi133.stdout:2/833: write d7/d18/d32/d65/d58/f9e [153620,6647] 0 2024-02-15T18:27:16.310 INFO:tasks.workunit.client.1.smithi133.stdout:9/722: dwrite d0/d8/d9/d12/d7f/d8f/fc5 [0,4194304] 0 2024-02-15T18:27:16.316 INFO:tasks.workunit.client.1.smithi133.stdout:0/862: dwrite d9/d10/d22/ffc [0,4194304] 0 2024-02-15T18:27:16.320 INFO:tasks.workunit.client.1.smithi133.stdout:1/939: dwrite d6/d1e/d3a/d79/d8e/fd0 [0,4194304] 0 2024-02-15T18:27:16.320 INFO:tasks.workunit.client.1.smithi133.stdout:5/685: dwrite d17/f46 [0,4194304] 0 2024-02-15T18:27:16.320 INFO:tasks.workunit.client.1.smithi133.stdout:5/686: readlink d17/d20/d4f/d5f/l82 0 2024-02-15T18:27:16.320 INFO:tasks.workunit.client.1.smithi133.stdout:5/687: stat d17/d26/d7b/d87 0 2024-02-15T18:27:16.320 INFO:tasks.workunit.client.1.smithi133.stdout:1/940: dread d6/d1e/d3a/d75/f131 [0,4194304] 0 2024-02-15T18:27:16.322 INFO:tasks.workunit.client.1.smithi133.stdout:4/613: rmdir d2/d48 39 2024-02-15T18:27:16.326 INFO:tasks.workunit.client.1.smithi133.stdout:5/688: creat d17/d2a/fd9 x:0 0 0 2024-02-15T18:27:16.328 INFO:tasks.workunit.client.1.smithi133.stdout:4/614: mkdir d2/d5/d2b/d21/d3b/d49/dc5 0 2024-02-15T18:27:16.328 INFO:tasks.workunit.client.1.smithi133.stdout:4/615: dread - d2/d5/d2b/d21/fb9 zero size 2024-02-15T18:27:16.329 INFO:tasks.workunit.client.1.smithi133.stdout:4/616: write d2/d48/d5c/db7/dba/dab/fb1 [1018624,85374] 0 2024-02-15T18:27:16.330 INFO:tasks.workunit.client.1.smithi133.stdout:5/689: symlink d17/d20/d32/d9d/da9/dc6/lda 0 2024-02-15T18:27:16.332 INFO:tasks.workunit.client.1.smithi133.stdout:2/834: dwrite d7/d2c/fe6 [0,4194304] 0 2024-02-15T18:27:16.332 INFO:tasks.workunit.client.1.smithi133.stdout:2/835: dread - d7/d18/d32/d65/f56 zero size 2024-02-15T18:27:16.333 INFO:tasks.workunit.client.1.smithi133.stdout:5/690: unlink d17/d20/c2b 0 2024-02-15T18:27:16.335 INFO:tasks.workunit.client.1.smithi133.stdout:5/691: rename d17/d26/f58 to d17/d20/d32/d9d/da9/fdb 0 2024-02-15T18:27:16.335 INFO:tasks.workunit.client.1.smithi133.stdout:5/692: chown d17/l25 1112212148 1 2024-02-15T18:27:16.336 INFO:tasks.workunit.client.1.smithi133.stdout:2/836: write d7/d2c/f44 [1380555,72778] 0 2024-02-15T18:27:16.336 INFO:tasks.workunit.client.1.smithi133.stdout:0/863: dwrite d9/d10/d19/d29/d67/d68/d96/f102 [0,4194304] 0 2024-02-15T18:27:16.336 INFO:tasks.workunit.client.1.smithi133.stdout:2/837: write d7/d2c/d3b/d48/faf [320595,95443] 0 2024-02-15T18:27:16.336 INFO:tasks.workunit.client.1.smithi133.stdout:5/693: creat d17/d20/d32/d7d/fdc x:0 0 0 2024-02-15T18:27:16.339 INFO:tasks.workunit.client.1.smithi133.stdout:0/864: mknod d9/d10/d19/d29/d67/d68/d96/de4/c112 0 2024-02-15T18:27:16.340 INFO:tasks.workunit.client.1.smithi133.stdout:5/694: mknod d17/cdd 0 2024-02-15T18:27:16.340 INFO:tasks.workunit.client.1.smithi133.stdout:0/865: rmdir d9/d10/d22 39 2024-02-15T18:27:16.346 INFO:tasks.workunit.client.1.smithi133.stdout:0/866: rmdir d9/d10/d19/d29/d67/d68/d96/de4 39 2024-02-15T18:27:16.346 INFO:tasks.workunit.client.1.smithi133.stdout:5/695: rename d17/d20/d32/l78 to d17/d20/d4f/d5f/lde 0 2024-02-15T18:27:16.346 INFO:tasks.workunit.client.1.smithi133.stdout:0/867: write d9/d10/d19/d8c/fb9 [828013,70415] 0 2024-02-15T18:27:16.347 INFO:tasks.workunit.client.1.smithi133.stdout:5/696: read d17/d20/d32/d38/d86/f98 [101967,8654] 0 2024-02-15T18:27:16.347 INFO:tasks.workunit.client.1.smithi133.stdout:5/697: dread - d17/d2a/fd9 zero size 2024-02-15T18:27:16.348 INFO:tasks.workunit.client.1.smithi133.stdout:5/698: mkdir d17/d26/d7b/ddf 0 2024-02-15T18:27:16.349 INFO:tasks.workunit.client.1.smithi133.stdout:4/617: dwrite d2/d5/d2b/d21/d2d/f5d [0,4194304] 0 2024-02-15T18:27:16.356 INFO:tasks.workunit.client.1.smithi133.stdout:2/838: dwrite d7/d2c/d3b/f4d [0,4194304] 0 2024-02-15T18:27:16.356 INFO:tasks.workunit.client.1.smithi133.stdout:1/941: write d6/d1e/d3a/d82/d85/d67/ddb/f14c [1366603,37269] 0 2024-02-15T18:27:16.356 INFO:tasks.workunit.client.1.smithi133.stdout:1/942: write d6/d1e/d41/d7c/d7e/fba [652069,130951] 0 2024-02-15T18:27:16.361 INFO:tasks.workunit.client.1.smithi133.stdout:4/618: rename d2/d5/d2b/d21/d2d/d44/l89 to d2/d5/d2b/d21/d2d/d44/d51/lc6 0 2024-02-15T18:27:16.364 INFO:tasks.workunit.client.1.smithi133.stdout:1/943: rename d6/d2a/f40 to d6/d1e/d3a/d82/d85/d102/f157 0 2024-02-15T18:27:16.364 INFO:tasks.workunit.client.1.smithi133.stdout:1/944: write d6/d1e/d3a/d82/d85/f155 [883150,104230] 0 2024-02-15T18:27:16.372 INFO:tasks.workunit.client.1.smithi133.stdout:0/868: dwrite d9/d10/d85/ff8 [0,4194304] 0 2024-02-15T18:27:16.372 INFO:tasks.workunit.client.1.smithi133.stdout:0/869: write d9/d2b/f60 [953785,63305] 0 2024-02-15T18:27:16.372 INFO:tasks.workunit.client.1.smithi133.stdout:1/945: dread d6/d1e/d3a/d82/d85/f83 [0,4194304] 0 2024-02-15T18:27:16.373 INFO:tasks.workunit.client.1.smithi133.stdout:5/699: dwrite d17/f46 [0,4194304] 0 2024-02-15T18:27:16.374 INFO:tasks.workunit.client.1.smithi133.stdout:0/870: creat d9/d10/d19/d1a/f113 x:0 0 0 2024-02-15T18:27:16.376 INFO:tasks.workunit.client.1.smithi133.stdout:1/946: rename d6/f24 to d6/d1e/d3a/d97/dda/f158 0 2024-02-15T18:27:16.383 INFO:tasks.workunit.client.1.smithi133.stdout:5/700: mknod d17/d20/d32/d9d/da9/dc6/ce0 0 2024-02-15T18:27:16.386 INFO:tasks.workunit.client.1.smithi133.stdout:0/871: rename d9/f75 to d9/d10/d47/f114 0 2024-02-15T18:27:16.386 INFO:tasks.workunit.client.1.smithi133.stdout:0/872: stat d9/f14 0 2024-02-15T18:27:16.389 INFO:tasks.workunit.client.1.smithi133.stdout:1/947: unlink d6/d1e/d41/d7c/f124 0 2024-02-15T18:27:16.392 INFO:tasks.workunit.client.1.smithi133.stdout:0/873: creat d9/d10/d19/d1a/f115 x:0 0 0 2024-02-15T18:27:16.392 INFO:tasks.workunit.client.1.smithi133.stdout:0/874: fsync d9/f14 0 2024-02-15T18:27:16.395 INFO:tasks.workunit.client.1.smithi133.stdout:5/701: rename d17/d20/d32/d38/l3e to d17/d20/d32/d38/d70/le1 0 2024-02-15T18:27:16.395 INFO:tasks.workunit.client.1.smithi133.stdout:0/875: mkdir d9/d10/d19/d29/d10a/d116 0 2024-02-15T18:27:16.395 INFO:tasks.workunit.client.1.smithi133.stdout:0/876: chown d9/d10/d19/d1a/fed 290 1 2024-02-15T18:27:16.397 INFO:tasks.workunit.client.1.smithi133.stdout:5/702: mkdir d17/d26/d7b/de2 0 2024-02-15T18:27:16.400 INFO:tasks.workunit.client.1.smithi133.stdout:0/877: mkdir d9/d10/d47/d117 0 2024-02-15T18:27:16.403 INFO:tasks.workunit.client.1.smithi133.stdout:5/703: rename d17/d20/d32/d38/d70/ccb to d17/d20/d5e/ce3 0 2024-02-15T18:27:16.404 INFO:tasks.workunit.client.1.smithi133.stdout:5/704: mkdir d17/d20/d32/d9d/da9/dc6/de4 0 2024-02-15T18:27:16.405 INFO:tasks.workunit.client.1.smithi133.stdout:5/705: link d17/d20/d4f/d5f/fa0 d17/d26/d7b/de2/fe5 0 2024-02-15T18:27:16.406 INFO:tasks.workunit.client.1.smithi133.stdout:5/706: mkdir d17/d20/d32/d9d/da9/de6 0 2024-02-15T18:27:16.406 INFO:tasks.workunit.client.1.smithi133.stdout:5/707: truncate d17/d26/d7b/de2/fe5 2216578 0 2024-02-15T18:27:16.407 INFO:tasks.workunit.client.1.smithi133.stdout:1/948: dwrite d6/d1e/d3a/d79/dfa/fc3 [0,4194304] 0 2024-02-15T18:27:16.408 INFO:tasks.workunit.client.1.smithi133.stdout:5/708: mkdir d17/d20/d32/d7d/de7 0 2024-02-15T18:27:16.408 INFO:tasks.workunit.client.1.smithi133.stdout:5/709: write d17/d20/d32/d9d/fa5 [418185,98705] 0 2024-02-15T18:27:16.410 INFO:tasks.workunit.client.1.smithi133.stdout:5/710: dread ff [0,4194304] 0 2024-02-15T18:27:16.410 INFO:tasks.workunit.client.1.smithi133.stdout:1/949: rmdir d6/d1e/d41/d132 39 2024-02-15T18:27:16.410 INFO:tasks.workunit.client.1.smithi133.stdout:1/950: write d6/d1e/d3a/d75/fae [546135,108804] 0 2024-02-15T18:27:16.412 INFO:tasks.workunit.client.1.smithi133.stdout:5/711: symlink d17/le8 0 2024-02-15T18:27:16.412 INFO:tasks.workunit.client.1.smithi133.stdout:5/712: write d17/d20/d32/d7d/fd2 [96334,164] 0 2024-02-15T18:27:16.413 INFO:tasks.workunit.client.1.smithi133.stdout:5/713: read d17/d20/d5e/f7f [2409416,53781] 0 2024-02-15T18:27:16.413 INFO:tasks.workunit.client.1.smithi133.stdout:0/878: dread d9/d10/d47/d5e/f8e [4194304,4194304] 0 2024-02-15T18:27:16.418 INFO:tasks.workunit.client.1.smithi133.stdout:1/951: rmdir d6/d1e/d41/d7c 39 2024-02-15T18:27:16.418 INFO:tasks.workunit.client.1.smithi133.stdout:1/952: stat d6/d1e/d41/f115 0 2024-02-15T18:27:16.419 INFO:tasks.workunit.client.1.smithi133.stdout:1/953: write d6/d1e/d41/d7c/d7e/d7f/db6/ded/f122 [457972,83361] 0 2024-02-15T18:27:16.419 INFO:tasks.workunit.client.1.smithi133.stdout:0/879: truncate d9/d2b/f79 1637804 0 2024-02-15T18:27:16.420 INFO:tasks.workunit.client.1.smithi133.stdout:1/954: mknod d6/d1e/d3a/d82/d85/d67/c159 0 2024-02-15T18:27:16.421 INFO:tasks.workunit.client.1.smithi133.stdout:0/880: mknod d9/d10/d85/c118 0 2024-02-15T18:27:16.423 INFO:tasks.workunit.client.1.smithi133.stdout:0/881: rename d9/d10/d47 to d9/d10/d22/d2f/d9f/d119 0 2024-02-15T18:27:16.423 INFO:tasks.workunit.client.1.smithi133.stdout:0/882: chown d9/d10/d22/f9e 77803 1 2024-02-15T18:27:16.424 INFO:tasks.workunit.client.1.smithi133.stdout:0/883: mknod d9/d10/d22/d2f/c11a 0 2024-02-15T18:27:16.425 INFO:tasks.workunit.client.1.smithi133.stdout:0/884: getdents d9/d10/d19/d29/d10a 0 2024-02-15T18:27:16.430 INFO:tasks.workunit.client.1.smithi133.stdout:5/714: dwrite d17/d20/d32/f37 [0,4194304] 0 2024-02-15T18:27:16.430 INFO:tasks.workunit.client.1.smithi133.stdout:5/715: chown d17/d26/c6b 23 1 2024-02-15T18:27:16.430 INFO:tasks.workunit.client.1.smithi133.stdout:5/716: fsync d17/d20/d32/fd1 0 2024-02-15T18:27:16.430 INFO:tasks.workunit.client.1.smithi133.stdout:0/885: write d9/d10/d19/d29/f8f [4081414,72708] 0 2024-02-15T18:27:16.430 INFO:tasks.workunit.client.1.smithi133.stdout:0/886: read - d9/d10/d19/d29/d67/d68/d9c/da7/f109 zero size 2024-02-15T18:27:16.430 INFO:tasks.workunit.client.1.smithi133.stdout:1/955: dread d6/f29 [0,4194304] 0 2024-02-15T18:27:16.431 INFO:tasks.workunit.client.1.smithi133.stdout:5/717: creat d17/d20/d32/d9d/fe9 x:0 0 0 2024-02-15T18:27:16.431 INFO:tasks.workunit.client.1.smithi133.stdout:5/718: dread - d17/d2a/f9c zero size 2024-02-15T18:27:16.431 INFO:tasks.workunit.client.1.smithi133.stdout:5/719: fsync d17/f7a 0 2024-02-15T18:27:16.432 INFO:tasks.workunit.client.1.smithi133.stdout:5/720: write d17/d20/f23 [4303215,61295] 0 2024-02-15T18:27:16.432 INFO:tasks.workunit.client.1.smithi133.stdout:1/956: write d6/f90 [401106,119217] 0 2024-02-15T18:27:16.432 INFO:tasks.workunit.client.1.smithi133.stdout:1/957: write d6/f43 [87353,61617] 0 2024-02-15T18:27:16.432 INFO:tasks.workunit.client.1.smithi133.stdout:1/958: readlink d6/d1e/l70 0 2024-02-15T18:27:16.432 INFO:tasks.workunit.client.1.smithi133.stdout:1/959: write d6/d1e/d3a/d75/ff5 [1549053,54155] 0 2024-02-15T18:27:16.433 INFO:tasks.workunit.client.1.smithi133.stdout:0/887: creat d9/d10/d2c/df3/f11b x:0 0 0 2024-02-15T18:27:16.433 INFO:tasks.workunit.client.1.smithi133.stdout:0/888: readlink d9/d10/d19/d29/l9b 0 2024-02-15T18:27:16.435 INFO:tasks.workunit.client.1.smithi133.stdout:1/960: unlink d6/d1e/d41/d7c/d7e/ca0 0 2024-02-15T18:27:16.438 INFO:tasks.workunit.client.1.smithi133.stdout:1/961: creat d6/d1e/d3a/d97/dda/dff/f15a x:0 0 0 2024-02-15T18:27:16.438 INFO:tasks.workunit.client.1.smithi133.stdout:1/962: fdatasync d6/d1e/d3a/d82/fe5 0 2024-02-15T18:27:16.439 INFO:tasks.workunit.client.1.smithi133.stdout:1/963: rename d6/d1e/d3a/d79/lc1 to d6/d1e/d3a/d97/dda/l15b 0 2024-02-15T18:27:16.440 INFO:tasks.workunit.client.1.smithi133.stdout:5/721: dread fc [0,4194304] 0 2024-02-15T18:27:16.440 INFO:tasks.workunit.client.1.smithi133.stdout:1/964: readlink d6/d2a/d59/l5e 0 2024-02-15T18:27:16.442 INFO:tasks.workunit.client.1.smithi133.stdout:5/722: rename d17/d20/d4f/f64 to d17/d20/d32/d38/dab/fea 0 2024-02-15T18:27:16.444 INFO:tasks.workunit.client.1.smithi133.stdout:5/723: unlink d17/d26/d7b/d87/lc5 0 2024-02-15T18:27:16.446 INFO:tasks.workunit.client.1.smithi133.stdout:5/724: dread d17/d20/d32/d38/f8b [0,4194304] 0 2024-02-15T18:27:16.451 INFO:tasks.workunit.client.1.smithi133.stdout:1/965: dread d6/d1e/d3a/d82/d85/f142 [0,4194304] 0 2024-02-15T18:27:16.452 INFO:tasks.workunit.client.1.smithi133.stdout:1/966: write d6/d1e/d3a/d79/dfa/fc8 [5515923,37634] 0 2024-02-15T18:27:16.454 INFO:tasks.workunit.client.1.smithi133.stdout:8/728: sync 2024-02-15T18:27:16.454 INFO:tasks.workunit.client.1.smithi133.stdout:3/863: sync 2024-02-15T18:27:16.454 INFO:tasks.workunit.client.1.smithi133.stdout:1/967: link d6/d1e/d3a/d75/fb0 d6/d17/f15c 0 2024-02-15T18:27:16.457 INFO:tasks.workunit.client.1.smithi133.stdout:8/729: rename d3/de/d3e/d94/ded/d58/da8 to d3/d1f/d4f/dfb 0 2024-02-15T18:27:16.457 INFO:tasks.workunit.client.1.smithi133.stdout:8/730: chown d3/d1c/d2f/d87/d73/ff9 23020871 1 2024-02-15T18:27:16.457 INFO:tasks.workunit.client.1.smithi133.stdout:3/864: rmdir d0/d15/d37/d4a/dc4/d107 39 2024-02-15T18:27:16.459 INFO:tasks.workunit.client.1.smithi133.stdout:8/731: symlink d3/d1c/d2f/d76/lfc 0 2024-02-15T18:27:16.459 INFO:tasks.workunit.client.1.smithi133.stdout:8/732: chown d3/d1c/d37/d5c 88670 1 2024-02-15T18:27:16.459 INFO:tasks.workunit.client.1.smithi133.stdout:8/733: fdatasync d3/de/d3e/d94/ded/d58/f78 0 2024-02-15T18:27:16.462 INFO:tasks.workunit.client.1.smithi133.stdout:8/734: creat d3/ffd x:0 0 0 2024-02-15T18:27:16.467 INFO:tasks.workunit.client.1.smithi133.stdout:0/889: dwrite d9/d10/d19/f63 [4194304,4194304] 0 2024-02-15T18:27:16.475 INFO:tasks.workunit.client.1.smithi133.stdout:0/890: write d9/d2b/f45 [2410006,109855] 0 2024-02-15T18:27:16.475 INFO:tasks.workunit.client.1.smithi133.stdout:0/891: creat d9/d10/d19/dfb/d10b/f11c x:0 0 0 2024-02-15T18:27:16.475 INFO:tasks.workunit.client.1.smithi133.stdout:0/892: write d9/f3e [846518,114032] 0 2024-02-15T18:27:16.475 INFO:tasks.workunit.client.1.smithi133.stdout:0/893: read - d9/d10/d2c/df3/f11b zero size 2024-02-15T18:27:16.476 INFO:tasks.workunit.client.1.smithi133.stdout:0/894: rename d9/d10/f54 to d9/d10/d2c/f11d 0 2024-02-15T18:27:16.477 INFO:tasks.workunit.client.1.smithi133.stdout:0/895: mkdir d9/d10/d19/d29/d67/d68/d9c/da7/d11e 0 2024-02-15T18:27:16.478 INFO:tasks.workunit.client.1.smithi133.stdout:0/896: creat d9/d10/d19/d29/d10a/f11f x:0 0 0 2024-02-15T18:27:16.479 INFO:tasks.workunit.client.1.smithi133.stdout:8/735: dread d3/f4 [0,4194304] 0 2024-02-15T18:27:16.480 INFO:tasks.workunit.client.1.smithi133.stdout:8/736: write d3/f46 [1155418,107107] 0 2024-02-15T18:27:16.480 INFO:tasks.workunit.client.1.smithi133.stdout:8/737: write d3/d1f/f31 [6138422,89751] 0 2024-02-15T18:27:16.491 INFO:tasks.workunit.client.1.smithi133.stdout:3/865: dwrite d0/d15/d2f/f30 [4194304,4194304] 0 2024-02-15T18:27:16.491 INFO:tasks.workunit.client.1.smithi133.stdout:5/725: dwrite d17/d20/d32/d7d/fd2 [0,4194304] 0 2024-02-15T18:27:16.491 INFO:tasks.workunit.client.1.smithi133.stdout:0/897: dread d9/d10/d22/d2f/f51 [0,4194304] 0 2024-02-15T18:27:16.491 INFO:tasks.workunit.client.1.smithi133.stdout:0/898: truncate d9/d10/d2c/f7c 835751 0 2024-02-15T18:27:16.491 INFO:tasks.workunit.client.1.smithi133.stdout:0/899: chown d9/d1c/f3f 141588689 1 2024-02-15T18:27:16.492 INFO:tasks.workunit.client.1.smithi133.stdout:3/866: read d0/d15/d2f/d9b/d39/d3f/fef [627818,110682] 0 2024-02-15T18:27:16.499 INFO:tasks.workunit.client.1.smithi133.stdout:5/726: mkdir d17/d26/d7b/deb 0 2024-02-15T18:27:16.500 INFO:tasks.workunit.client.1.smithi133.stdout:5/727: chown d17/d20/d32/d38/d86/db6/f9f 10111 1 2024-02-15T18:27:16.500 INFO:tasks.workunit.client.1.smithi133.stdout:5/728: fdatasync d17/d20/f8d 0 2024-02-15T18:27:16.501 INFO:tasks.workunit.client.1.smithi133.stdout:0/900: truncate d9/d10/d19/d29/d67/d68/fc2 2274644 0 2024-02-15T18:27:16.501 INFO:tasks.workunit.client.1.smithi133.stdout:0/901: truncate d9/d10/d22/d2f/d9f/d119/d5e/f106 494842 0 2024-02-15T18:27:16.504 INFO:tasks.workunit.client.1.smithi133.stdout:3/867: unlink d0/d15/d2f/d9b/d62/f71 0 2024-02-15T18:27:16.506 INFO:tasks.workunit.client.1.smithi133.stdout:0/902: creat d9/d10/d19/d29/d67/d68/d96/d44/f120 x:0 0 0 2024-02-15T18:27:16.508 INFO:tasks.workunit.client.1.smithi133.stdout:5/729: dread d17/d20/d32/f37 [0,4194304] 0 2024-02-15T18:27:16.508 INFO:tasks.workunit.client.1.smithi133.stdout:5/730: chown d17/d20/d32/d7d/d7e 2853446 1 2024-02-15T18:27:16.509 INFO:tasks.workunit.client.1.smithi133.stdout:3/868: creat d0/d15/d37/d4a/dc4/d107/f118 x:0 0 0 2024-02-15T18:27:16.509 INFO:tasks.workunit.client.1.smithi133.stdout:3/869: truncate d0/d15/d2f/d9b/d39/f114 709280 0 2024-02-15T18:27:16.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:14.687940+0000 mgr.smithi084.hjmnez (mgr.14596) 29 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 3.3 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 245 MiB/s rd, 499 MiB/s wr, 755 op/s 2024-02-15T18:27:16.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:15.248106+0000 mon.smithi084 (mon.0) 697 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:16.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:15.249455+0000 mon.smithi084 (mon.0) 698 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:16.510 INFO:tasks.workunit.client.1.smithi133.stdout:0/903: unlink d9/d10/d19/d1a/lef 0 2024-02-15T18:27:16.514 INFO:tasks.workunit.client.1.smithi133.stdout:5/731: rename d17/d2a to d17/d20/d4f/d5f/d93/dec 0 2024-02-15T18:27:16.516 INFO:tasks.workunit.client.1.smithi133.stdout:3/870: symlink d0/d15/d2f/d9b/d39/dcd/de0/l119 0 2024-02-15T18:27:16.516 INFO:tasks.workunit.client.1.smithi133.stdout:3/871: fsync d0/d15/d2f/d9b/d39/d3f/fee 0 2024-02-15T18:27:16.516 INFO:tasks.workunit.client.1.smithi133.stdout:3/872: chown d0/d15/d2f/d9b/d72/dbf/dd9/l108 28051 1 2024-02-15T18:27:16.516 INFO:tasks.workunit.client.1.smithi133.stdout:3/873: write d0/d15/d37/d4a/f4e [1850737,6666] 0 2024-02-15T18:27:16.516 INFO:tasks.workunit.client.1.smithi133.stdout:3/874: dread - d0/d15/d2f/d9b/fe5 zero size 2024-02-15T18:27:16.521 INFO:tasks.workunit.client.1.smithi133.stdout:3/875: getdents d0 0 2024-02-15T18:27:16.521 INFO:tasks.workunit.client.1.smithi133.stdout:3/876: write d0/d15/d37/d4a/dc4/d107/f118 [440736,111863] 0 2024-02-15T18:27:16.522 INFO:tasks.workunit.client.1.smithi133.stdout:3/877: getdents d0/d15/d37/d102 0 2024-02-15T18:27:16.528 INFO:tasks.workunit.client.1.smithi133.stdout:0/904: dwrite d9/d10/d22/d2f/f51 [0,4194304] 0 2024-02-15T18:27:16.533 INFO:tasks.workunit.client.1.smithi133.stdout:3/878: dread d0/d15/d2f/d9b/f58 [0,4194304] 0 2024-02-15T18:27:16.533 INFO:tasks.workunit.client.1.smithi133.stdout:7/676: sync 2024-02-15T18:27:16.533 INFO:tasks.workunit.client.1.smithi133.stdout:7/677: stat d9/da/fa8 0 2024-02-15T18:27:16.534 INFO:tasks.workunit.client.1.smithi133.stdout:0/905: creat d9/d10/d22/d2f/d9f/d119/d5e/de6/f121 x:0 0 0 2024-02-15T18:27:16.535 INFO:tasks.workunit.client.1.smithi133.stdout:0/906: fdatasync d9/d10/d19/d29/d67/f6f 0 2024-02-15T18:27:16.535 INFO:tasks.workunit.client.1.smithi133.stdout:0/907: stat d9/d10/d19/d29/d67/f6f 0 2024-02-15T18:27:16.535 INFO:tasks.workunit.client.1.smithi133.stdout:0/908: fdatasync d9/d28/f3a 0 2024-02-15T18:27:16.536 INFO:tasks.workunit.client.1.smithi133.stdout:0/909: mkdir d9/d10/d2c/df3/d122 0 2024-02-15T18:27:16.537 INFO:tasks.workunit.client.1.smithi133.stdout:0/910: mknod d9/d10/d2c/c123 0 2024-02-15T18:27:16.538 INFO:tasks.workunit.client.1.smithi133.stdout:0/911: creat d9/d28/f124 x:0 0 0 2024-02-15T18:27:16.538 INFO:tasks.workunit.client.1.smithi133.stdout:0/912: stat d9/d28/fd0 0 2024-02-15T18:27:16.541 INFO:tasks.workunit.client.1.smithi133.stdout:0/913: write d9/d2b/f7a [442176,13339] 0 2024-02-15T18:27:16.541 INFO:tasks.workunit.client.1.smithi133.stdout:0/914: truncate d9/f1e 1537032 0 2024-02-15T18:27:16.553 INFO:tasks.workunit.client.1.smithi133.stdout:3/879: dwrite d0/d15/d2f/d9b/d72/dbf/fc9 [0,4194304] 0 2024-02-15T18:27:16.553 INFO:tasks.workunit.client.1.smithi133.stdout:3/880: write d0/d15/d37/fd3 [873102,118365] 0 2024-02-15T18:27:16.556 INFO:tasks.workunit.client.1.smithi133.stdout:3/881: link d0/d15/d2f/db4/ff5 d0/d15/d37/d4a/dc4/f11a 0 2024-02-15T18:27:16.556 INFO:tasks.workunit.client.1.smithi133.stdout:3/882: chown d0/d15/d54/ddc/fc0 1 1 2024-02-15T18:27:16.556 INFO:tasks.workunit.client.1.smithi133.stdout:3/883: dread d0/d15/d2f/d9b/d39/f114 [0,4194304] 0 2024-02-15T18:27:16.558 INFO:tasks.workunit.client.1.smithi133.stdout:3/884: creat d0/d15/d37/d4a/dc4/d107/f11b x:0 0 0 2024-02-15T18:27:16.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/885: symlink d0/d15/d37/d4a/l11c 0 2024-02-15T18:27:16.559 INFO:tasks.workunit.client.1.smithi133.stdout:3/886: chown d0/d15/d2f/d9b/f44 18654 1 2024-02-15T18:27:16.560 INFO:tasks.workunit.client.1.smithi133.stdout:3/887: mknod d0/d15/d2f/db4/df2/c11d 0 2024-02-15T18:27:16.563 INFO:tasks.workunit.client.1.smithi133.stdout:0/915: dwrite d9/d10/d19/d1a/f113 [0,4194304] 0 2024-02-15T18:27:16.563 INFO:tasks.workunit.client.1.smithi133.stdout:0/916: chown d9/d10/d19/d29/d67/d68/d9c/d95 57 1 2024-02-15T18:27:16.563 INFO:tasks.workunit.client.1.smithi133.stdout:0/917: fsync d9/d10/d22/d32/f74 0 2024-02-15T18:27:16.564 INFO:tasks.workunit.client.1.smithi133.stdout:3/888: dread d0/d15/d37/d4a/f4e [0,4194304] 0 2024-02-15T18:27:16.564 INFO:tasks.workunit.client.1.smithi133.stdout:3/889: chown d0/d15/d54/ddc 3598029 1 2024-02-15T18:27:16.564 INFO:tasks.workunit.client.1.smithi133.stdout:0/918: write d9/d10/d22/fde [1240894,16246] 0 2024-02-15T18:27:16.565 INFO:tasks.workunit.client.1.smithi133.stdout:3/890: write d0/d15/d2f/d9b/d72/dbf/fd8 [3631906,87107] 0 2024-02-15T18:27:16.565 INFO:tasks.workunit.client.1.smithi133.stdout:0/919: rmdir d9/d10/d2c 39 2024-02-15T18:27:16.570 INFO:tasks.workunit.client.1.smithi133.stdout:0/920: mkdir d9/d10/d22/d2f/d125 0 2024-02-15T18:27:16.572 INFO:tasks.workunit.client.1.smithi133.stdout:0/921: symlink d9/d10/d19/dfb/l126 0 2024-02-15T18:27:16.572 INFO:tasks.workunit.client.1.smithi133.stdout:0/922: write d9/d10/d19/d29/f8f [4214563,82926] 0 2024-02-15T18:27:16.574 INFO:tasks.workunit.client.1.smithi133.stdout:0/923: link d9/d2b/l88 d9/d28/dd6/l127 0 2024-02-15T18:27:16.575 INFO:tasks.workunit.client.1.smithi133.stdout:0/924: mknod d9/d10/d22/d2f/d9f/d119/d5e/de6/c128 0 2024-02-15T18:27:16.576 INFO:tasks.workunit.client.1.smithi133.stdout:0/925: mkdir d9/d10/d19/d129 0 2024-02-15T18:27:16.582 INFO:tasks.workunit.client.1.smithi133.stdout:3/891: dwrite d0/d15/d2f/f68 [0,4194304] 0 2024-02-15T18:27:16.583 INFO:tasks.workunit.client.1.smithi133.stdout:0/926: dread d9/d10/d2c/fc8 [0,4194304] 0 2024-02-15T18:27:16.586 INFO:tasks.workunit.client.1.smithi133.stdout:3/892: mknod d0/d15/d2f/d9b/d39/d3f/dc1/d78/c11e 0 2024-02-15T18:27:16.586 INFO:tasks.workunit.client.1.smithi133.stdout:3/893: truncate d0/d15/d54/ddc/fc0 1722695 0 2024-02-15T18:27:16.589 INFO:tasks.workunit.client.1.smithi133.stdout:0/927: dread d9/d10/d22/d2f/d9f/d119/d5e/f8e [4194304,4194304] 0 2024-02-15T18:27:16.594 INFO:tasks.workunit.client.1.smithi133.stdout:0/928: mknod d9/d10/d19/d1a/c12a 0 2024-02-15T18:27:16.594 INFO:tasks.workunit.client.1.smithi133.stdout:0/929: truncate d9/d10/d22/d2f/d9f/f110 1025283 0 2024-02-15T18:27:16.618 INFO:tasks.workunit.client.1.smithi133.stdout:0/930: dwrite d9/d10/d22/d32/d7f/fce [0,4194304] 0 2024-02-15T18:27:16.618 INFO:tasks.workunit.client.1.smithi133.stdout:3/894: dwrite d0/fc [0,4194304] 0 2024-02-15T18:27:16.620 INFO:tasks.workunit.client.1.smithi133.stdout:0/931: creat d9/d10/d2c/df3/f12b x:0 0 0 2024-02-15T18:27:16.621 INFO:tasks.workunit.client.1.smithi133.stdout:3/895: symlink d0/d15/d2f/d9b/d39/d3f/dc1/d78/l11f 0 2024-02-15T18:27:16.623 INFO:tasks.workunit.client.1.smithi133.stdout:3/896: dread d0/d15/d37/d95/f9e [0,4194304] 0 2024-02-15T18:27:16.626 INFO:tasks.workunit.client.1.smithi133.stdout:3/897: rename d0/d15/d37/d7b/l111 to d0/d15/d2f/d9b/dc5/l120 0 2024-02-15T18:27:16.627 INFO:tasks.workunit.client.1.smithi133.stdout:3/898: link d0/d15/d2f/db4/d89/l113 d0/d15/d2f/db4/df2/l121 0 2024-02-15T18:27:16.629 INFO:tasks.workunit.client.1.smithi133.stdout:3/899: rmdir d0/d15/d37/d95 39 2024-02-15T18:27:16.630 INFO:tasks.workunit.client.1.smithi133.stdout:3/900: truncate d0/fa 1789734 0 2024-02-15T18:27:16.639 INFO:tasks.workunit.client.1.smithi133.stdout:3/901: dread d0/d15/f3b [0,4194304] 0 2024-02-15T18:27:16.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:14.687940+0000 mgr.smithi084.hjmnez (mgr.14596) 29 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 3.3 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 245 MiB/s rd, 499 MiB/s wr, 755 op/s 2024-02-15T18:27:16.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:15.248106+0000 mon.smithi084 (mon.0) 697 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:16.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:15.249455+0000 mon.smithi084 (mon.0) 698 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:16.656 INFO:tasks.workunit.client.1.smithi133.stdout:3/902: dwrite d0/d15/d2f/dad/fd2 [0,4194304] 0 2024-02-15T18:27:16.674 INFO:tasks.workunit.client.1.smithi133.stdout:3/903: dwrite d0/d15/f3b [4194304,4194304] 0 2024-02-15T18:27:16.674 INFO:tasks.workunit.client.1.smithi133.stdout:3/904: chown d0/d15/d37/d4a/dc4/lde 173335028 1 2024-02-15T18:27:16.675 INFO:tasks.workunit.client.1.smithi133.stdout:9/723: sync 2024-02-15T18:27:16.676 INFO:tasks.workunit.client.1.smithi133.stdout:3/905: mkdir d0/d15/d2f/d5e/dff/d122 0 2024-02-15T18:27:16.680 INFO:tasks.workunit.client.1.smithi133.stdout:9/724: rename d0/d8/d9/d12/d7f/d8f/fa8 to d0/d8/d9/d12/d7f/d8f/fee 0 2024-02-15T18:27:16.680 INFO:tasks.workunit.client.1.smithi133.stdout:3/906: mknod d0/d15/d2f/d9b/d39/dcd/c123 0 2024-02-15T18:27:16.680 INFO:tasks.workunit.client.1.smithi133.stdout:3/907: chown d0/d15/d2f/d9b 116625 1 2024-02-15T18:27:16.680 INFO:tasks.workunit.client.1.smithi133.stdout:3/908: fsync d0/d15/d2f/d9b/d39/da2/f104 0 2024-02-15T18:27:16.680 INFO:tasks.workunit.client.1.smithi133.stdout:3/909: chown d0/d15/d37/d95/dc2 73 1 2024-02-15T18:27:16.681 INFO:tasks.workunit.client.1.smithi133.stdout:9/725: rename d0/d7b/c7e to d0/d8/d10/cef 0 2024-02-15T18:27:16.683 INFO:tasks.workunit.client.1.smithi133.stdout:9/726: dread d0/d8/f47 [0,4194304] 0 2024-02-15T18:27:16.685 INFO:tasks.workunit.client.1.smithi133.stdout:9/727: creat d0/d8/d9/d12/d82/d42/ff0 x:0 0 0 2024-02-15T18:27:16.685 INFO:tasks.workunit.client.1.smithi133.stdout:9/728: truncate d0/d8/d10/d4d/f66 1303811 0 2024-02-15T18:27:16.685 INFO:tasks.workunit.client.1.smithi133.stdout:9/729: write d0/d8/d10/f2f [1060144,112083] 0 2024-02-15T18:27:16.704 INFO:tasks.workunit.client.1.smithi133.stdout:3/910: dwrite d0/d15/d2f/db4/d89/ff9 [0,4194304] 0 2024-02-15T18:27:16.720 INFO:tasks.workunit.client.1.smithi133.stdout:3/911: dwrite d0/d15/d2f/d9b/f43 [0,4194304] 0 2024-02-15T18:27:16.742 INFO:tasks.workunit.client.1.smithi133.stdout:3/912: dwrite d0/d15/d2f/d9b/d39/d3f/dc1/fa7 [0,4194304] 0 2024-02-15T18:27:16.742 INFO:tasks.workunit.client.1.smithi133.stdout:3/913: write d0/d15/d2f/db4/f7e [4648713,32915] 0 2024-02-15T18:27:16.743 INFO:tasks.workunit.client.1.smithi133.stdout:3/914: mknod d0/d15/d2f/d9b/d72/dbf/dd9/c124 0 2024-02-15T18:27:16.744 INFO:tasks.workunit.client.1.smithi133.stdout:3/915: creat d0/d15/d37/d95/d100/f125 x:0 0 0 2024-02-15T18:27:16.745 INFO:tasks.workunit.client.1.smithi133.stdout:3/916: chown d0/d15/d2f/d9b/d39/d3f/dc1/d78/c11e 4466 1 2024-02-15T18:27:16.746 INFO:tasks.workunit.client.1.smithi133.stdout:3/917: rename d0/d15/d37/d4a/cb6 to d0/d15/d2f/d9b/d39/d3f/c126 0 2024-02-15T18:27:16.746 INFO:tasks.workunit.client.1.smithi133.stdout:3/918: write d0/d15/d2f/f30 [9075988,124107] 0 2024-02-15T18:27:16.747 INFO:tasks.workunit.client.1.smithi133.stdout:3/919: getdents d0/d15/d37/d4a/dc4/d107 0 2024-02-15T18:27:16.773 INFO:tasks.workunit.client.1.smithi133.stdout:3/920: dwrite d0/d15/d2f/db4/d89/ff9 [0,4194304] 0 2024-02-15T18:27:16.773 INFO:tasks.workunit.client.1.smithi133.stdout:3/921: write d0/d15/d2f/d9b/f44 [1976437,50617] 0 2024-02-15T18:27:16.799 INFO:tasks.workunit.client.1.smithi133.stdout:3/922: dwrite d0/d15/d2f/d9b/d39/da2/f104 [0,4194304] 0 2024-02-15T18:27:16.800 INFO:tasks.workunit.client.1.smithi133.stdout:3/923: dread d0/d15/d2f/d9b/d39/f114 [0,4194304] 0 2024-02-15T18:27:16.800 INFO:tasks.workunit.client.1.smithi133.stdout:3/924: chown d0/d15/d2f/d9b/d72/dbf/dd9/ffa 162229602 1 2024-02-15T18:27:16.801 INFO:tasks.workunit.client.1.smithi133.stdout:3/925: unlink d0/d15/d2f/d9b/d62/lb9 0 2024-02-15T18:27:16.802 INFO:tasks.workunit.client.1.smithi133.stdout:3/926: truncate d0/d15/d2f/d9b/f9a 605157 0 2024-02-15T18:27:16.808 INFO:tasks.workunit.client.1.smithi133.stdout:4/619: sync 2024-02-15T18:27:16.808 INFO:tasks.workunit.client.1.smithi133.stdout:2/839: sync 2024-02-15T18:27:16.808 INFO:tasks.workunit.client.1.smithi133.stdout:1/968: sync 2024-02-15T18:27:16.808 INFO:tasks.workunit.client.1.smithi133.stdout:4/620: readlink d2/d5/d2b/l2c 0 2024-02-15T18:27:16.809 INFO:tasks.workunit.client.1.smithi133.stdout:1/969: mkdir d6/d1e/d41/d7c/d15d 0 2024-02-15T18:27:16.809 INFO:tasks.workunit.client.1.smithi133.stdout:2/840: symlink d7/db/d67/da7/l10f 0 2024-02-15T18:27:16.810 INFO:tasks.workunit.client.1.smithi133.stdout:4/621: creat d2/d5/d2b/d21/d3b/d49/d98/fc7 x:0 0 0 2024-02-15T18:27:16.811 INFO:tasks.workunit.client.1.smithi133.stdout:1/970: rmdir d6/d1e/d3a/d82/d85 39 2024-02-15T18:27:16.811 INFO:tasks.workunit.client.1.smithi133.stdout:1/971: write d6/d1e/d3a/d75/f84 [1461600,84650] 0 2024-02-15T18:27:16.811 INFO:tasks.workunit.client.1.smithi133.stdout:1/972: fdatasync d6/d1e/d3a/d97/dda/dff/d13d/d151/f156 0 2024-02-15T18:27:16.813 INFO:tasks.workunit.client.1.smithi133.stdout:4/622: unlink d2/d5/d2b/d21/d2d/f3c 0 2024-02-15T18:27:16.813 INFO:tasks.workunit.client.1.smithi133.stdout:4/623: write d2/d5/d2b/d21/d3b/d49/f57 [5569937,14213] 0 2024-02-15T18:27:16.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/973: mknod d6/d1e/d3a/d82/d85/d67/ddb/c15e 0 2024-02-15T18:27:16.814 INFO:tasks.workunit.client.1.smithi133.stdout:4/624: rmdir d2/d48/d5c/db7 39 2024-02-15T18:27:16.814 INFO:tasks.workunit.client.1.smithi133.stdout:1/974: truncate d6/d2a/f48 2440530 0 2024-02-15T18:27:16.815 INFO:tasks.workunit.client.1.smithi133.stdout:1/975: creat d6/d1e/d3a/d82/d85/d11b/f15f x:0 0 0 2024-02-15T18:27:16.817 INFO:tasks.workunit.client.1.smithi133.stdout:1/976: rmdir d6/d1e/d41/d7c/d7e 39 2024-02-15T18:27:16.817 INFO:tasks.workunit.client.1.smithi133.stdout:2/841: dread d7/f13 [0,4194304] 0 2024-02-15T18:27:16.818 INFO:tasks.workunit.client.1.smithi133.stdout:1/977: write d6/d17/f6e [2209168,13351] 0 2024-02-15T18:27:16.820 INFO:tasks.workunit.client.1.smithi133.stdout:2/842: mknod d7/d18/d32/d65/d54/dde/c110 0 2024-02-15T18:27:16.820 INFO:tasks.workunit.client.1.smithi133.stdout:2/843: chown d7/d2c/d46/f72 4854 1 2024-02-15T18:27:16.821 INFO:tasks.workunit.client.1.smithi133.stdout:4/625: dread d2/d5/d2b/d21/d2d/f2e [0,4194304] 0 2024-02-15T18:27:16.821 INFO:tasks.workunit.client.1.smithi133.stdout:4/626: truncate d2/d48/d5c/fc3 199279 0 2024-02-15T18:27:16.821 INFO:tasks.workunit.client.1.smithi133.stdout:4/627: truncate d2/d5/d2b/d21/d3b/fa6 863361 0 2024-02-15T18:27:16.821 INFO:tasks.workunit.client.1.smithi133.stdout:4/628: write d2/d5/d2b/d21/d2d/d44/d51/f52 [668032,53287] 0 2024-02-15T18:27:16.822 INFO:tasks.workunit.client.1.smithi133.stdout:2/844: write d7/d2c/f44 [1079135,110557] 0 2024-02-15T18:27:16.822 INFO:tasks.workunit.client.1.smithi133.stdout:1/978: mkdir d6/d1e/d3a/d82/d85/de7/d160 0 2024-02-15T18:27:16.825 INFO:tasks.workunit.client.1.smithi133.stdout:4/629: mknod d2/d48/d5c/d9f/db6/cc8 0 2024-02-15T18:27:16.827 INFO:tasks.workunit.client.1.smithi133.stdout:2/845: rename d7/d18/d32/d65/f55 to d7/d2c/d3b/d48/d59/f111 0 2024-02-15T18:27:16.827 INFO:tasks.workunit.client.1.smithi133.stdout:2/846: fsync d7/d18/d32/d65/fe8 0 2024-02-15T18:27:16.827 INFO:tasks.workunit.client.1.smithi133.stdout:1/979: symlink d6/d1e/d3a/d82/d85/d102/d154/l161 0 2024-02-15T18:27:16.827 INFO:tasks.workunit.client.1.smithi133.stdout:1/980: write d6/d1e/d3a/f61 [1666788,67610] 0 2024-02-15T18:27:16.827 INFO:tasks.workunit.client.1.smithi133.stdout:1/981: truncate d6/d1e/f134 4896642 0 2024-02-15T18:27:16.830 INFO:tasks.workunit.client.1.smithi133.stdout:4/630: mkdir d2/d48/d5c/dc9 0 2024-02-15T18:27:16.830 INFO:tasks.workunit.client.1.smithi133.stdout:4/631: truncate d2/d5/d2b/d21/fa1 987234 0 2024-02-15T18:27:16.832 INFO:tasks.workunit.client.1.smithi133.stdout:4/632: creat d2/d5/d2b/d21/d2d/d44/d51/fca x:0 0 0 2024-02-15T18:27:16.833 INFO:tasks.workunit.client.1.smithi133.stdout:4/633: creat d2/d48/d5c/db7/fcb x:0 0 0 2024-02-15T18:27:16.834 INFO:tasks.workunit.client.1.smithi133.stdout:4/634: getdents d2/d5/d2b/d21/d2d/d44/d51/d60 0 2024-02-15T18:27:16.834 INFO:tasks.workunit.client.1.smithi133.stdout:4/635: fsync d2/d48/d6a/d9e/fad 0 2024-02-15T18:27:16.868 INFO:tasks.workunit.client.1.smithi133.stdout:2/847: dwrite d7/db/d67/da7/f103 [0,4194304] 0 2024-02-15T18:27:16.869 INFO:tasks.workunit.client.1.smithi133.stdout:4/636: dwrite d2/d48/fc2 [0,4194304] 0 2024-02-15T18:27:16.869 INFO:tasks.workunit.client.1.smithi133.stdout:2/848: dread - d7/d2c/d5a/d66/da5/ffa zero size 2024-02-15T18:27:16.869 INFO:tasks.workunit.client.1.smithi133.stdout:1/982: dwrite d6/d1e/d41/d7c/f8c [0,4194304] 0 2024-02-15T18:27:16.869 INFO:tasks.workunit.client.1.smithi133.stdout:1/983: chown d6/d1e/d41/dcc/f10c 22617913 1 2024-02-15T18:27:16.872 INFO:tasks.workunit.client.1.smithi133.stdout:2/849: creat d7/d2c/d46/f112 x:0 0 0 2024-02-15T18:27:16.873 INFO:tasks.workunit.client.1.smithi133.stdout:2/850: truncate d7/d2c/d3b/d48/fc7 28337 0 2024-02-15T18:27:16.873 INFO:tasks.workunit.client.1.smithi133.stdout:2/851: write d7/d2c/d31/f6a [1003560,71461] 0 2024-02-15T18:27:16.873 INFO:tasks.workunit.client.1.smithi133.stdout:2/852: stat d7/d18/d32/d65/l9c 0 2024-02-15T18:27:16.875 INFO:tasks.workunit.client.1.smithi133.stdout:2/853: truncate d7/d18/d32/d65/fa0 2971528 0 2024-02-15T18:27:16.905 INFO:tasks.workunit.client.1.smithi133.stdout:8/738: sync 2024-02-15T18:27:16.905 INFO:tasks.workunit.client.1.smithi133.stdout:5/732: sync 2024-02-15T18:27:16.908 INFO:tasks.workunit.client.1.smithi133.stdout:5/733: rename d17/d20/d32/d7d/dcd to d17/d20/dc3/ded 0 2024-02-15T18:27:16.910 INFO:tasks.workunit.client.1.smithi133.stdout:8/739: symlink d3/d1c/d2f/d87/lfe 0 2024-02-15T18:27:16.911 INFO:tasks.workunit.client.1.smithi133.stdout:8/740: mknod d3/de/d3e/d94/ded/cff 0 2024-02-15T18:27:16.911 INFO:tasks.workunit.client.1.smithi133.stdout:8/741: fdatasync d3/d1c/fa9 0 2024-02-15T18:27:16.913 INFO:tasks.workunit.client.1.smithi133.stdout:8/742: creat d3/d1c/d2f/d87/d73/d84/dda/f100 x:0 0 0 2024-02-15T18:27:16.913 INFO:tasks.workunit.client.1.smithi133.stdout:8/743: readlink d3/l6 0 2024-02-15T18:27:16.913 INFO:tasks.workunit.client.1.smithi133.stdout:8/744: truncate d3/d7/d52/ff5 636924 0 2024-02-15T18:27:16.913 INFO:tasks.workunit.client.1.smithi133.stdout:8/745: readlink d3/de/d3e/d94/ded/lf2 0 2024-02-15T18:27:16.913 INFO:tasks.workunit.client.1.smithi133.stdout:8/746: truncate d3/f86 359559 0 2024-02-15T18:27:16.924 INFO:tasks.workunit.client.1.smithi133.stdout:5/734: dwrite d17/d20/d32/d9d/da9/faa [0,4194304] 0 2024-02-15T18:27:16.925 INFO:tasks.workunit.client.1.smithi133.stdout:5/735: chown d17/d20/d32/d38/f96 1392541 1 2024-02-15T18:27:16.926 INFO:tasks.workunit.client.1.smithi133.stdout:5/736: mkdir d17/d20/d32/d38/d86/dee 0 2024-02-15T18:27:16.928 INFO:tasks.workunit.client.1.smithi133.stdout:5/737: link d17/d20/l61 d17/d26/d7b/deb/lef 0 2024-02-15T18:27:16.928 INFO:tasks.workunit.client.1.smithi133.stdout:5/738: fsync d17/d20/d4f/d5f/fa0 0 2024-02-15T18:27:16.929 INFO:tasks.workunit.client.1.smithi133.stdout:5/739: creat d17/d20/d4f/d5f/ff0 x:0 0 0 2024-02-15T18:27:16.929 INFO:tasks.workunit.client.1.smithi133.stdout:5/740: write d17/d20/d4f/d5f/f60 [2054266,8258] 0 2024-02-15T18:27:16.929 INFO:tasks.workunit.client.1.smithi133.stdout:5/741: dread - d17/d20/d32/d38/d70/faf zero size 2024-02-15T18:27:16.931 INFO:tasks.workunit.client.1.smithi133.stdout:5/742: dread d17/d20/d4f/d5f/d93/dec/fb2 [0,4194304] 0 2024-02-15T18:27:16.932 INFO:tasks.workunit.client.1.smithi133.stdout:5/743: symlink d17/d20/d4f/d5f/d93/lf1 0 2024-02-15T18:27:16.934 INFO:tasks.workunit.client.1.smithi133.stdout:5/744: rename d17/d20/d32/d38/dab/fea to d17/d20/d32/d38/ff2 0 2024-02-15T18:27:16.934 INFO:tasks.workunit.client.1.smithi133.stdout:5/745: fsync d17/f33 0 2024-02-15T18:27:16.935 INFO:tasks.workunit.client.1.smithi133.stdout:8/747: dwrite d3/d1c/d37/f7b [0,4194304] 0 2024-02-15T18:27:16.935 INFO:tasks.workunit.client.1.smithi133.stdout:5/746: unlink d17/d20/d32/d38/f96 0 2024-02-15T18:27:16.939 INFO:tasks.workunit.client.1.smithi133.stdout:8/748: creat d3/d92/f101 x:0 0 0 2024-02-15T18:27:16.939 INFO:tasks.workunit.client.1.smithi133.stdout:8/749: chown d3/d1f/f31 0 1 2024-02-15T18:27:16.946 INFO:tasks.workunit.client.1.smithi133.stdout:5/747: rename d17/d20/d32/d38/ff2 to d17/d20/d32/d38/d70/ff3 0 2024-02-15T18:27:16.952 INFO:tasks.workunit.client.1.smithi133.stdout:8/750: dread d3/d1f/d4f/dab/fd8 [0,4194304] 0 2024-02-15T18:27:16.966 INFO:tasks.workunit.client.1.smithi133.stdout:5/748: dwrite d17/d20/d32/d9d/fa5 [0,4194304] 0 2024-02-15T18:27:16.969 INFO:tasks.workunit.client.1.smithi133.stdout:5/749: mkdir d17/d20/dc3/df4 0 2024-02-15T18:27:16.974 INFO:tasks.workunit.client.1.smithi133.stdout:8/751: dwrite d3/d1c/d2f/ff3 [0,4194304] 0 2024-02-15T18:27:16.974 INFO:tasks.workunit.client.1.smithi133.stdout:8/752: chown d3/d1c/d2f/d87/d73/d84/dda/leb 11738 1 2024-02-15T18:27:16.990 INFO:tasks.workunit.client.1.smithi133.stdout:5/750: dwrite d17/d20/d32/d9d/fce [0,4194304] 0 2024-02-15T18:27:16.993 INFO:tasks.workunit.client.1.smithi133.stdout:5/751: symlink d17/d20/d32/d38/dbd/lf5 0 2024-02-15T18:27:16.994 INFO:tasks.workunit.client.1.smithi133.stdout:5/752: rmdir d17/d20/d32/d38/d86/dee 0 2024-02-15T18:27:16.994 INFO:tasks.workunit.client.1.smithi133.stdout:5/753: dread - d17/d20/d32/d38/d70/faf zero size 2024-02-15T18:27:16.996 INFO:tasks.workunit.client.1.smithi133.stdout:5/754: rmdir d17/d20/d32/d7d/d7e 39 2024-02-15T18:27:16.998 INFO:tasks.workunit.client.1.smithi133.stdout:5/755: unlink d17/d20/d5e/c67 0 2024-02-15T18:27:16.998 INFO:tasks.workunit.client.1.smithi133.stdout:5/756: chown d17/d20/d32/cb5 4 1 2024-02-15T18:27:16.998 INFO:tasks.workunit.client.1.smithi133.stdout:5/757: truncate d17/d20/d32/d38/d70/ff3 1088123 0 2024-02-15T18:27:16.999 INFO:tasks.workunit.client.1.smithi133.stdout:5/758: rename d17/d26/l24 to d17/d26/d7b/de2/lf6 0 2024-02-15T18:27:17.001 INFO:tasks.workunit.client.1.smithi133.stdout:5/759: symlink d17/d26/d7b/lf7 0 2024-02-15T18:27:17.047 INFO:tasks.workunit.client.1.smithi133.stdout:7/678: sync 2024-02-15T18:27:17.062 INFO:tasks.workunit.client.1.smithi133.stdout:7/679: dwrite d9/db/d16/d5d/d68/d73/d9b/fad [0,4194304] 0 2024-02-15T18:27:17.085 INFO:tasks.workunit.client.1.smithi133.stdout:7/680: dwrite d9/db/d55/fa0 [0,4194304] 0 2024-02-15T18:27:17.087 INFO:tasks.workunit.client.1.smithi133.stdout:7/681: rmdir d9/db/d16/d5d/d68 39 2024-02-15T18:27:17.089 INFO:tasks.workunit.client.1.smithi133.stdout:7/682: rename d9/db/d16/l21 to d9/d19/le3 0 2024-02-15T18:27:17.111 INFO:tasks.workunit.client.1.smithi133.stdout:7/683: dwrite d9/d36/d39/dd0/fb4 [0,4194304] 0 2024-02-15T18:27:17.111 INFO:tasks.workunit.client.1.smithi133.stdout:7/684: chown d9/d36 129049735 1 2024-02-15T18:27:17.121 INFO:tasks.workunit.client.1.smithi133.stdout:7/685: dread d9/db/f27 [0,4194304] 0 2024-02-15T18:27:17.123 INFO:tasks.workunit.client.1.smithi133.stdout:7/686: unlink d9/da/d48/l77 0 2024-02-15T18:27:17.124 INFO:tasks.workunit.client.1.smithi133.stdout:7/687: write d9/db/f11 [2126278,60667] 0 2024-02-15T18:27:17.126 INFO:tasks.workunit.client.1.smithi133.stdout:7/688: rename d9/db/d55/d63 to d9/d36/d3d/d4c/d97/de4 0 2024-02-15T18:27:17.130 INFO:tasks.workunit.client.1.smithi133.stdout:7/689: rename d9/d36/d39/d98/fd7 to d9/db/d16/fe5 0 2024-02-15T18:27:17.130 INFO:tasks.workunit.client.1.smithi133.stdout:7/690: dread - d9/fbd zero size 2024-02-15T18:27:17.132 INFO:tasks.workunit.client.1.smithi133.stdout:7/691: creat d9/d36/d3d/fe6 x:0 0 0 2024-02-15T18:27:17.135 INFO:tasks.workunit.client.1.smithi133.stdout:7/692: symlink d9/d19/le7 0 2024-02-15T18:27:17.135 INFO:tasks.workunit.client.1.smithi133.stdout:7/693: fsync d9/db/d16/d4f/fdf 0 2024-02-15T18:27:17.137 INFO:tasks.workunit.client.1.smithi133.stdout:7/694: unlink d9/d36/d31/dc1/dcd/dde/d84/l8e 0 2024-02-15T18:27:17.137 INFO:tasks.workunit.client.1.smithi133.stdout:7/695: truncate d9/d36/d31/dc1/dcd/dde/fe2 61151 0 2024-02-15T18:27:17.151 INFO:tasks.workunit.client.1.smithi133.stdout:7/696: dwrite d9/db/d16/d5d/d68/f71 [0,4194304] 0 2024-02-15T18:27:17.154 INFO:tasks.workunit.client.1.smithi133.stdout:7/697: unlink d9/d36/d31/dc1/dcd/dde/f56 0 2024-02-15T18:27:17.155 INFO:tasks.workunit.client.1.smithi133.stdout:7/698: truncate d9/db/d16/f53 1329409 0 2024-02-15T18:27:17.155 INFO:tasks.workunit.client.1.smithi133.stdout:7/699: creat d9/d19/fe8 x:0 0 0 2024-02-15T18:27:17.157 INFO:tasks.workunit.client.1.smithi133.stdout:7/700: write d9/da/d48/f81 [2102391,49628] 0 2024-02-15T18:27:17.157 INFO:tasks.workunit.client.1.smithi133.stdout:7/701: chown d9/db/d16/d5d/d68/da2/fdd 1262 1 2024-02-15T18:27:17.158 INFO:tasks.workunit.client.1.smithi133.stdout:7/702: link d9/db/d55/fa0 d9/d36/d39/dd0/fe9 0 2024-02-15T18:27:17.166 INFO:tasks.workunit.client.1.smithi133.stdout:0/932: sync 2024-02-15T18:27:17.166 INFO:tasks.workunit.client.1.smithi133.stdout:3/927: sync 2024-02-15T18:27:17.166 INFO:tasks.workunit.client.1.smithi133.stdout:9/730: sync 2024-02-15T18:27:17.166 INFO:tasks.workunit.client.1.smithi133.stdout:3/928: truncate d0/d15/d2f/d9b/d72/dbf/fc9 4407349 0 2024-02-15T18:27:17.167 INFO:tasks.workunit.client.1.smithi133.stdout:0/933: getdents d9/d10/d19/d29/d67/d68/d96/de4 0 2024-02-15T18:27:17.168 INFO:tasks.workunit.client.1.smithi133.stdout:3/929: creat d0/d15/d2f/d9b/d39/dcd/f127 x:0 0 0 2024-02-15T18:27:17.180 INFO:tasks.workunit.client.1.smithi133.stdout:7/703: dwrite d9/d36/f23 [0,4194304] 0 2024-02-15T18:27:17.180 INFO:tasks.workunit.client.1.smithi133.stdout:9/731: dread d0/d8/d10/d4d/f5e [0,4194304] 0 2024-02-15T18:27:17.180 INFO:tasks.workunit.client.1.smithi133.stdout:7/704: write d9/d36/d39/d98/fa1 [4841383,117674] 0 2024-02-15T18:27:17.180 INFO:tasks.workunit.client.1.smithi133.stdout:7/705: dread - d9/da/d48/d62/d64/fba zero size 2024-02-15T18:27:17.182 INFO:tasks.workunit.client.1.smithi133.stdout:9/732: creat d0/d7b/db7/ff1 x:0 0 0 2024-02-15T18:27:17.198 INFO:tasks.workunit.client.1.smithi133.stdout:3/930: dwrite d0/d15/d2f/d9b/d39/d3f/f22 [4194304,4194304] 0 2024-02-15T18:27:17.198 INFO:tasks.workunit.client.1.smithi133.stdout:9/733: dwrite d0/d8/d9/d12/d4f/f85 [0,4194304] 0 2024-02-15T18:27:17.201 INFO:tasks.workunit.client.1.smithi133.stdout:3/931: rename d0/d15/d54/ddc/fc0 to d0/d15/d2f/d9b/d9d/f128 0 2024-02-15T18:27:17.202 INFO:tasks.workunit.client.1.smithi133.stdout:3/932: read d0/d15/d37/d4a/f4c [114465,63498] 0 2024-02-15T18:27:17.221 INFO:tasks.workunit.client.1.smithi133.stdout:3/933: dwrite d0/d15/d2f/d9b/f4d [0,4194304] 0 2024-02-15T18:27:17.224 INFO:tasks.workunit.client.1.smithi133.stdout:3/934: mknod d0/d15/d2f/d9b/d39/da2/c129 0 2024-02-15T18:27:17.235 INFO:tasks.workunit.client.1.smithi133.stdout:3/935: dread d0/d15/d2f/d9b/d39/d3f/dc1/fa7 [0,4194304] 0 2024-02-15T18:27:17.236 INFO:tasks.workunit.client.1.smithi133.stdout:3/936: getdents d0/d15/d2f/d9b/dc5 0 2024-02-15T18:27:17.238 INFO:tasks.workunit.client.1.smithi133.stdout:3/937: mknod d0/d15/d2f/d9b/d39/dcd/c12a 0 2024-02-15T18:27:17.238 INFO:tasks.workunit.client.1.smithi133.stdout:3/938: chown d0/d15/d2f/d9b/d39/d3f/dc1/d78/le3 1033324518 1 2024-02-15T18:27:17.293 INFO:tasks.workunit.client.1.smithi133.stdout:1/984: sync 2024-02-15T18:27:17.293 INFO:tasks.workunit.client.1.smithi133.stdout:4/637: sync 2024-02-15T18:27:17.293 INFO:tasks.workunit.client.1.smithi133.stdout:1/985: stat d6/d1e/d41/dcc/ld7 0 2024-02-15T18:27:17.293 INFO:tasks.workunit.client.1.smithi133.stdout:3/939: dwrite d0/d15/d2f/db4/d89/fda [4194304,4194304] 0 2024-02-15T18:27:17.294 INFO:tasks.workunit.client.1.smithi133.stdout:4/638: rmdir d2/d5/d2b/d21/d2d/d4f/d87 39 2024-02-15T18:27:17.297 INFO:tasks.workunit.client.1.smithi133.stdout:1/986: dread d6/d1e/d3a/d82/d85/dc7/f14d [0,4194304] 0 2024-02-15T18:27:17.297 INFO:tasks.workunit.client.1.smithi133.stdout:3/940: creat d0/d15/d2f/d5e/f12b x:0 0 0 2024-02-15T18:27:17.298 INFO:tasks.workunit.client.1.smithi133.stdout:4/639: creat d2/d5/d2b/d21/fcc x:0 0 0 2024-02-15T18:27:17.298 INFO:tasks.workunit.client.1.smithi133.stdout:4/640: fsync d2/d5/d2b/d21/d3b/d49/d98/fb0 0 2024-02-15T18:27:17.298 INFO:tasks.workunit.client.1.smithi133.stdout:4/641: read d2/d48/d5c/d93/d8d/fb2 [178764,93223] 0 2024-02-15T18:27:17.301 INFO:tasks.workunit.client.1.smithi133.stdout:4/642: write d2/d5/d2b/d21/d3b/d49/f57 [958302,88140] 0 2024-02-15T18:27:17.303 INFO:tasks.workunit.client.1.smithi133.stdout:1/987: dread d6/d17/fbb [0,4194304] 0 2024-02-15T18:27:17.305 INFO:tasks.workunit.client.1.smithi133.stdout:1/988: mknod d6/d1e/d3a/d82/d85/c162 0 2024-02-15T18:27:17.307 INFO:tasks.workunit.client.1.smithi133.stdout:1/989: symlink d6/d1e/d3a/d82/d85/d67/dd3/l163 0 2024-02-15T18:27:17.310 INFO:tasks.workunit.client.1.smithi133.stdout:1/990: rename d6/d89/f12d to d6/d2a/d59/d5a/da4/daa/f164 0 2024-02-15T18:27:17.313 INFO:tasks.workunit.client.1.smithi133.stdout:1/991: write d6/d17/f6e [97848,101114] 0 2024-02-15T18:27:17.313 INFO:tasks.workunit.client.1.smithi133.stdout:1/992: write d6/d1e/d3a/d82/d85/d67/ddb/f14c [2256941,20976] 0 2024-02-15T18:27:17.318 INFO:tasks.workunit.client.1.smithi133.stdout:1/993: dread d6/d1e/d41/d7c/d7e/f99 [0,4194304] 0 2024-02-15T18:27:17.318 INFO:tasks.workunit.client.1.smithi133.stdout:1/994: readlink d6/d2a/d59/d5a/da4/le0 0 2024-02-15T18:27:17.324 INFO:tasks.workunit.client.1.smithi133.stdout:3/941: dwrite d0/d15/d54/ddc/fb1 [0,4194304] 0 2024-02-15T18:27:17.326 INFO:tasks.workunit.client.1.smithi133.stdout:3/942: truncate d0/d15/d2f/d9b/d62/faf 814458 0 2024-02-15T18:27:17.327 INFO:tasks.workunit.client.1.smithi133.stdout:3/943: truncate d0/d15/d37/f53 3679626 0 2024-02-15T18:27:17.328 INFO:tasks.workunit.client.1.smithi133.stdout:4/643: dwrite d2/d48/d6a/d9e/fad [4194304,4194304] 0 2024-02-15T18:27:17.328 INFO:tasks.workunit.client.1.smithi133.stdout:4/644: fdatasync d2/d48/d5c/db7/dba/dab/fb1 0 2024-02-15T18:27:17.328 INFO:tasks.workunit.client.1.smithi133.stdout:4/645: write d2/d48/d5c/f62 [364989,23965] 0 2024-02-15T18:27:17.331 INFO:tasks.workunit.client.1.smithi133.stdout:4/646: getdents d2/d5/d2b/d21/d2d/d44/d51/d60/d63 0 2024-02-15T18:27:17.332 INFO:tasks.workunit.client.1.smithi133.stdout:3/944: rmdir d0/d15/d37/d4a/dc4 39 2024-02-15T18:27:17.336 INFO:tasks.workunit.client.1.smithi133.stdout:3/945: mknod d0/d15/d2f/d9b/d39/dcd/c12c 0 2024-02-15T18:27:17.357 INFO:tasks.workunit.client.1.smithi133.stdout:4/647: dwrite d2/d5/d2b/d21/da2/f6c [4194304,4194304] 0 2024-02-15T18:27:17.357 INFO:tasks.workunit.client.1.smithi133.stdout:4/648: write d2/d5/d2b/d21/d2d/d44/da4/fbd [473059,82803] 0 2024-02-15T18:27:17.360 INFO:tasks.workunit.client.1.smithi133.stdout:4/649: symlink d2/d5/d2b/d21/d2d/lcd 0 2024-02-15T18:27:17.363 INFO:tasks.workunit.client.1.smithi133.stdout:4/650: mknod d2/d5/d2b/d21/d2d/d44/d51/cce 0 2024-02-15T18:27:17.365 INFO:tasks.workunit.client.1.smithi133.stdout:4/651: mknod d2/d48/d5c/db7/dba/ccf 0 2024-02-15T18:27:17.372 INFO:tasks.workunit.client.1.smithi133.stdout:4/652: dread d2/d5/d2b/d21/d2d/d44/f47 [0,4194304] 0 2024-02-15T18:27:17.373 INFO:tasks.workunit.client.1.smithi133.stdout:4/653: write d2/d5/d2b/d21/d2d/fb3 [481711,119464] 0 2024-02-15T18:27:17.375 INFO:tasks.workunit.client.1.smithi133.stdout:4/654: rename d2/d5/d2b/d21/l3a to d2/d5/d2b/d21/d2d/d44/d51/ld0 0 2024-02-15T18:27:17.377 INFO:tasks.workunit.client.1.smithi133.stdout:4/655: rmdir d2/d48/d5c/db7/dba 39 2024-02-15T18:27:17.385 INFO:tasks.workunit.client.1.smithi133.stdout:4/656: truncate d2/d5/d2b/d21/da2/f6c 6528475 0 2024-02-15T18:27:17.394 INFO:tasks.workunit.client.1.smithi133.stdout:4/657: dread d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f90 [0,4194304] 0 2024-02-15T18:27:17.396 INFO:tasks.workunit.client.1.smithi133.stdout:4/658: truncate d2/d5/d2b/d21/d2d/d44/f46 818113 0 2024-02-15T18:27:17.398 INFO:tasks.workunit.client.1.smithi133.stdout:4/659: write d2/d5/d2b/d21/d2d/d44/f47 [3535302,22898] 0 2024-02-15T18:27:17.432 INFO:tasks.workunit.client.1.smithi133.stdout:4/660: dwrite d2/d5/d2b/d21/d2d/f5d [0,4194304] 0 2024-02-15T18:27:17.432 INFO:tasks.workunit.client.1.smithi133.stdout:4/661: chown d2/d5/d2b/d21/d3b/l4d 51 1 2024-02-15T18:27:17.455 INFO:tasks.workunit.client.1.smithi133.stdout:4/662: dwrite d2/fbe [0,4194304] 0 2024-02-15T18:27:17.455 INFO:tasks.workunit.client.1.smithi133.stdout:4/663: fdatasync d2/d5/d2b/d21/d2d/d44/d51/d60/f83 0 2024-02-15T18:27:17.479 INFO:tasks.workunit.client.1.smithi133.stdout:4/664: dwrite d2/d5/d2b/d21/d2d/d44/da4/fbd [0,4194304] 0 2024-02-15T18:27:17.483 INFO:tasks.workunit.client.1.smithi133.stdout:4/665: unlink d2/d5/d2b/d21/da2/d5e/c97 0 2024-02-15T18:27:17.500 INFO:tasks.workunit.client.1.smithi133.stdout:4/666: dwrite d2/d48/d5c/d93/d8d/d96/fb8 [0,4194304] 0 2024-02-15T18:27:17.503 INFO:tasks.workunit.client.1.smithi133.stdout:4/667: mkdir d2/d5/d2b/d21/da2/d5e/dd1 0 2024-02-15T18:27:17.506 INFO:tasks.workunit.client.1.smithi133.stdout:4/668: dread d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f90 [0,4194304] 0 2024-02-15T18:27:17.509 INFO:tasks.workunit.client.1.smithi133.stdout:4/669: write d2/d5/d2b/d21/f8f [956132,47307] 0 2024-02-15T18:27:17.509 INFO:tasks.workunit.client.1.smithi133.stdout:4/670: readlink d2/d5/d2b/d21/d2d/d44/d51/lc6 0 2024-02-15T18:27:17.509 INFO:tasks.workunit.client.1.smithi133.stdout:4/671: dread - d2/d5/d2b/d21/d2d/d44/d51/fca zero size 2024-02-15T18:27:17.510 INFO:tasks.workunit.client.1.smithi133.stdout:4/672: mkdir d2/d5/d2b/dd2 0 2024-02-15T18:27:17.512 INFO:tasks.workunit.client.1.smithi133.stdout:4/673: truncate d2/d5/d2b/d21/d2d/f56 2805593 0 2024-02-15T18:27:17.513 INFO:tasks.workunit.client.1.smithi133.stdout:8/753: sync 2024-02-15T18:27:17.513 INFO:tasks.workunit.client.1.smithi133.stdout:8/754: fdatasync d3/f3a 0 2024-02-15T18:27:17.513 INFO:tasks.workunit.client.1.smithi133.stdout:2/854: sync 2024-02-15T18:27:17.513 INFO:tasks.workunit.client.1.smithi133.stdout:5/760: sync 2024-02-15T18:27:17.513 INFO:tasks.workunit.client.1.smithi133.stdout:5/761: write d17/d20/d32/d7d/fc9 [295824,29269] 0 2024-02-15T18:27:17.514 INFO:tasks.workunit.client.1.smithi133.stdout:2/855: write d7/db/d67/d7b/f97 [444265,72324] 0 2024-02-15T18:27:17.515 INFO:tasks.workunit.client.1.smithi133.stdout:4/674: rename d2/d48/c77 to d2/d5/d2b/d21/d2d/cd3 0 2024-02-15T18:27:17.526 INFO:tasks.workunit.client.1.smithi133.stdout:2/856: mknod d7/d2c/d3b/d48/d59/c113 0 2024-02-15T18:27:17.526 INFO:tasks.workunit.client.1.smithi133.stdout:2/857: fdatasync d7/db/d35/fb1 0 2024-02-15T18:27:17.526 INFO:tasks.workunit.client.1.smithi133.stdout:8/755: mkdir d3/d7/d40/d61/dc8/d102 0 2024-02-15T18:27:17.526 INFO:tasks.workunit.client.1.smithi133.stdout:8/756: chown d3/de/f25 7437816 1 2024-02-15T18:27:17.527 INFO:tasks.workunit.client.1.smithi133.stdout:5/762: truncate d17/d20/d32/f37 262377 0 2024-02-15T18:27:17.527 INFO:tasks.workunit.client.1.smithi133.stdout:5/763: dread - d17/d20/d4f/d5f/d93/dec/f9c zero size 2024-02-15T18:27:17.527 INFO:tasks.workunit.client.1.smithi133.stdout:5/764: chown f10 0 1 2024-02-15T18:27:17.527 INFO:tasks.workunit.client.1.smithi133.stdout:5/765: stat d17/d20/d32 0 2024-02-15T18:27:17.527 INFO:tasks.workunit.client.1.smithi133.stdout:5/766: readlink d17/d20/d32/d38/l92 0 2024-02-15T18:27:17.527 INFO:tasks.workunit.client.1.smithi133.stdout:5/767: readlink d17/d20/d32/d38/dbd/lc8 0 2024-02-15T18:27:17.529 INFO:tasks.workunit.client.1.smithi133.stdout:8/757: write d3/d7/f72 [3400329,42161] 0 2024-02-15T18:27:17.531 INFO:tasks.workunit.client.1.smithi133.stdout:2/858: unlink d7/d2c/d31/c51 0 2024-02-15T18:27:17.531 INFO:tasks.workunit.client.1.smithi133.stdout:2/859: dread - d7/d2c/d3b/d48/fb3 zero size 2024-02-15T18:27:17.534 INFO:tasks.workunit.client.1.smithi133.stdout:8/758: unlink d3/de/d3e/d94/ded/f9f 0 2024-02-15T18:27:17.534 INFO:tasks.workunit.client.1.smithi133.stdout:2/860: creat d7/d2c/f114 x:0 0 0 2024-02-15T18:27:17.535 INFO:tasks.workunit.client.1.smithi133.stdout:5/768: mkdir d17/d20/d32/d38/d86/db6/df8 0 2024-02-15T18:27:17.538 INFO:tasks.workunit.client.1.smithi133.stdout:8/759: unlink d3/d92/f101 0 2024-02-15T18:27:17.538 INFO:tasks.workunit.client.1.smithi133.stdout:4/675: dwrite d2/d5/d2b/d21/fa1 [0,4194304] 0 2024-02-15T18:27:17.538 INFO:tasks.workunit.client.1.smithi133.stdout:4/676: stat d2/d5/d2b/d21/d2d 0 2024-02-15T18:27:17.538 INFO:tasks.workunit.client.1.smithi133.stdout:2/861: unlink d7/db/d67/f80 0 2024-02-15T18:27:17.544 INFO:tasks.workunit.client.1.smithi133.stdout:2/862: mkdir d7/d2c/d3b/d48/d115 0 2024-02-15T18:27:17.545 INFO:tasks.workunit.client.1.smithi133.stdout:8/760: write d3/d7/f4d [1132320,89785] 0 2024-02-15T18:27:17.546 INFO:tasks.workunit.client.1.smithi133.stdout:5/769: rmdir d17/d20/d32/d38/dab 0 2024-02-15T18:27:17.549 INFO:tasks.workunit.client.1.smithi133.stdout:5/770: unlink fc 0 2024-02-15T18:27:17.554 INFO:tasks.workunit.client.1.smithi133.stdout:2/863: dread f1 [4194304,4194304] 0 2024-02-15T18:27:17.555 INFO:tasks.workunit.client.1.smithi133.stdout:8/761: dread d3/f14 [0,4194304] 0 2024-02-15T18:27:17.557 INFO:tasks.workunit.client.1.smithi133.stdout:2/864: mknod d7/d2c/d5a/d66/dfe/c116 0 2024-02-15T18:27:17.562 INFO:tasks.workunit.client.1.smithi133.stdout:8/762: truncate d3/d1c/f1e 12134988 0 2024-02-15T18:27:17.571 INFO:tasks.workunit.client.1.smithi133.stdout:4/677: dwrite d2/f29 [0,4194304] 0 2024-02-15T18:27:17.571 INFO:tasks.workunit.client.1.smithi133.stdout:8/763: dread d3/f14 [0,4194304] 0 2024-02-15T18:27:17.577 INFO:tasks.workunit.client.1.smithi133.stdout:4/678: mkdir d2/d48/d5c/db7/dd4 0 2024-02-15T18:27:17.577 INFO:tasks.workunit.client.1.smithi133.stdout:4/679: chown d2/d5/d2b/d21/d2d/c7d 3 1 2024-02-15T18:27:17.577 INFO:tasks.workunit.client.1.smithi133.stdout:4/680: truncate d2/d5/d2b/d21/d3b/d49/d98/fc7 36640 0 2024-02-15T18:27:17.579 INFO:tasks.workunit.client.1.smithi133.stdout:8/764: getdents d3 0 2024-02-15T18:27:17.579 INFO:tasks.workunit.client.1.smithi133.stdout:8/765: chown d3/d1c/d2f/lbe 186758 1 2024-02-15T18:27:17.580 INFO:tasks.workunit.client.1.smithi133.stdout:8/766: creat d3/d1c/d2f/d87/d73/f103 x:0 0 0 2024-02-15T18:27:17.587 INFO:tasks.workunit.client.1.smithi133.stdout:4/681: write d2/d5/d2b/f5b [410216,18520] 0 2024-02-15T18:27:17.587 INFO:tasks.workunit.client.1.smithi133.stdout:4/682: chown d2/d5/d2b/d21/da2/d5e/dd1 2 1 2024-02-15T18:27:17.589 INFO:tasks.workunit.client.1.smithi133.stdout:2/865: dwrite d7/d2c/d31/f38 [0,4194304] 0 2024-02-15T18:27:17.591 INFO:tasks.workunit.client.1.smithi133.stdout:2/866: mknod d7/d18/d32/d65/d99/dfb/c117 0 2024-02-15T18:27:17.593 INFO:tasks.workunit.client.1.smithi133.stdout:2/867: unlink d7/d2c/dd5/f104 0 2024-02-15T18:27:17.602 INFO:tasks.workunit.client.1.smithi133.stdout:2/868: write d7/d2c/f49 [247880,129716] 0 2024-02-15T18:27:17.604 INFO:tasks.workunit.client.1.smithi133.stdout:2/869: rmdir d7/db/d35 39 2024-02-15T18:27:17.604 INFO:tasks.workunit.client.1.smithi133.stdout:2/870: dread - d7/d2c/f114 zero size 2024-02-15T18:27:17.604 INFO:tasks.workunit.client.1.smithi133.stdout:8/767: dwrite d3/d1c/d2f/ff3 [0,4194304] 0 2024-02-15T18:27:17.605 INFO:tasks.workunit.client.1.smithi133.stdout:8/768: dread - d3/d1c/fa9 zero size 2024-02-15T18:27:17.606 INFO:tasks.workunit.client.1.smithi133.stdout:8/769: link d3/d7/c15 d3/d1f/d4f/c104 0 2024-02-15T18:27:17.611 INFO:tasks.workunit.client.1.smithi133.stdout:8/770: dread d3/de/d3e/d94/ded/fcc [0,4194304] 0 2024-02-15T18:27:17.612 INFO:tasks.workunit.client.1.smithi133.stdout:8/771: mkdir d3/de/d3e/d94/dc9/d105 0 2024-02-15T18:27:17.616 INFO:tasks.workunit.client.1.smithi133.stdout:4/683: dwrite d2/d5/d2b/d21/d3b/d49/d98/fb0 [0,4194304] 0 2024-02-15T18:27:17.619 INFO:tasks.workunit.client.1.smithi133.stdout:8/772: creat d3/de/d3e/d94/dc9/f106 x:0 0 0 2024-02-15T18:27:17.619 INFO:tasks.workunit.client.1.smithi133.stdout:7/706: sync 2024-02-15T18:27:17.619 INFO:tasks.workunit.client.1.smithi133.stdout:0/934: sync 2024-02-15T18:27:17.619 INFO:tasks.workunit.client.1.smithi133.stdout:0/935: fsync d9/d10/d19/d1a/f9d 0 2024-02-15T18:27:17.621 INFO:tasks.workunit.client.1.smithi133.stdout:7/707: getdents d9/d36 0 2024-02-15T18:27:17.621 INFO:tasks.workunit.client.1.smithi133.stdout:7/708: write d9/d36/d3d/fe6 [516777,66684] 0 2024-02-15T18:27:17.621 INFO:tasks.workunit.client.1.smithi133.stdout:7/709: readlink d9/d36/d31/dc1/dcd/dde/l45 0 2024-02-15T18:27:17.623 INFO:tasks.workunit.client.1.smithi133.stdout:0/936: dread d9/f3e [0,4194304] 0 2024-02-15T18:27:17.623 INFO:tasks.workunit.client.1.smithi133.stdout:0/937: fdatasync d9/d10/d19/d29/d67/d68/d9c/f101 0 2024-02-15T18:27:17.625 INFO:tasks.workunit.client.1.smithi133.stdout:7/710: write d9/d36/d39/dd0/fe9 [219972,16881] 0 2024-02-15T18:27:17.625 INFO:tasks.workunit.client.1.smithi133.stdout:0/938: mkdir d9/d10/d2c/d12c 0 2024-02-15T18:27:17.625 INFO:tasks.workunit.client.1.smithi133.stdout:7/711: mknod d9/db/d16/cea 0 2024-02-15T18:27:17.626 INFO:tasks.workunit.client.1.smithi133.stdout:7/712: chown d9/d36/d31/dc1/dcd/dde/c8f 3704 1 2024-02-15T18:27:17.626 INFO:tasks.workunit.client.1.smithi133.stdout:7/713: write d9/d36/d31/dc1/dcd/dde/f28 [958560,827] 0 2024-02-15T18:27:17.627 INFO:tasks.workunit.client.1.smithi133.stdout:0/939: symlink d9/d10/d19/d29/d67/d68/l12d 0 2024-02-15T18:27:17.632 INFO:tasks.workunit.client.1.smithi133.stdout:2/871: dread d7/d2c/d31/f38 [0,4194304] 0 2024-02-15T18:27:17.635 INFO:tasks.workunit.client.1.smithi133.stdout:2/872: unlink d7/f20 0 2024-02-15T18:27:17.635 INFO:tasks.workunit.client.1.smithi133.stdout:2/873: fsync d7/f16 0 2024-02-15T18:27:17.638 INFO:tasks.workunit.client.1.smithi133.stdout:2/874: read d7/d18/d32/d65/d54/f57 [1628200,94779] 0 2024-02-15T18:27:17.640 INFO:tasks.workunit.client.1.smithi133.stdout:2/875: mkdir d7/d118 0 2024-02-15T18:27:17.640 INFO:tasks.workunit.client.1.smithi133.stdout:2/876: fsync d7/d2c/d5a/d66/d70/da8/fd0 0 2024-02-15T18:27:17.644 INFO:tasks.workunit.client.1.smithi133.stdout:2/877: creat d7/db/d35/f119 x:0 0 0 2024-02-15T18:27:17.645 INFO:tasks.workunit.client.1.smithi133.stdout:2/878: symlink d7/d2c/d5a/d66/l11a 0 2024-02-15T18:27:17.646 INFO:tasks.workunit.client.1.smithi133.stdout:2/879: write d7/d2c/fa4 [1045335,21803] 0 2024-02-15T18:27:17.646 INFO:tasks.workunit.client.1.smithi133.stdout:2/880: chown d7/d2c/d5a/d66 188 1 2024-02-15T18:27:17.654 INFO:tasks.workunit.client.1.smithi133.stdout:2/881: mknod d7/d2c/d5a/d66/dfe/c11b 0 2024-02-15T18:27:17.655 INFO:tasks.workunit.client.1.smithi133.stdout:2/882: truncate d7/d2c/d5a/d66/f7c 2558562 0 2024-02-15T18:27:17.657 INFO:tasks.workunit.client.1.smithi133.stdout:2/883: unlink d7/d18/l98 0 2024-02-15T18:27:17.657 INFO:tasks.workunit.client.1.smithi133.stdout:2/884: chown d7/d2c/d46/l4f 0 1 2024-02-15T18:27:17.657 INFO:tasks.workunit.client.1.smithi133.stdout:2/885: mknod d7/d2c/d3b/c11c 0 2024-02-15T18:27:17.659 INFO:tasks.workunit.client.1.smithi133.stdout:2/886: getdents d7/d2c/d5a/d66/d70 0 2024-02-15T18:27:17.668 INFO:tasks.workunit.client.1.smithi133.stdout:4/684: dwrite d2/d5/d2b/f24 [0,4194304] 0 2024-02-15T18:27:17.669 INFO:tasks.workunit.client.1.smithi133.stdout:7/714: dwrite d9/db/f8c [0,4194304] 0 2024-02-15T18:27:17.669 INFO:tasks.workunit.client.1.smithi133.stdout:0/940: dwrite d9/d10/d22/d2f/d9f/d119/d5e/de6/f121 [0,4194304] 0 2024-02-15T18:27:17.669 INFO:tasks.workunit.client.1.smithi133.stdout:0/941: chown d9/d10/d22/d2f/d9f/d119/d5e/de6/c128 73 1 2024-02-15T18:27:17.681 INFO:tasks.workunit.client.1.smithi133.stdout:4/685: symlink d2/d5/d2b/d21/d2d/d44/d51/d60/d63/ld5 0 2024-02-15T18:27:17.681 INFO:tasks.workunit.client.1.smithi133.stdout:7/715: rmdir d9/db/d55 39 2024-02-15T18:27:17.681 INFO:tasks.workunit.client.1.smithi133.stdout:0/942: symlink d9/d10/d19/d29/d67/d68/d96/de4/l12e 0 2024-02-15T18:27:17.681 INFO:tasks.workunit.client.1.smithi133.stdout:0/943: chown d9/d10/d22/d2f/d9f/d119/d5e/de6/f121 30 1 2024-02-15T18:27:17.691 INFO:tasks.workunit.client.1.smithi133.stdout:0/944: dread d9/f14 [0,4194304] 0 2024-02-15T18:27:17.694 INFO:tasks.workunit.client.1.smithi133.stdout:7/716: mkdir d9/da/deb 0 2024-02-15T18:27:17.702 INFO:tasks.workunit.client.1.smithi133.stdout:7/717: dread f7 [0,4194304] 0 2024-02-15T18:27:17.702 INFO:tasks.workunit.client.1.smithi133.stdout:7/718: write d9/da/d48/f7e [1830235,10676] 0 2024-02-15T18:27:17.702 INFO:tasks.workunit.client.1.smithi133.stdout:7/719: write d9/db/d55/f7d [351111,49813] 0 2024-02-15T18:27:17.702 INFO:tasks.workunit.client.1.smithi133.stdout:7/720: fdatasync d9/db/d16/f49 0 2024-02-15T18:27:17.703 INFO:tasks.workunit.client.1.smithi133.stdout:7/721: read d9/da/d48/d62/d64/f9a [2307070,69543] 0 2024-02-15T18:27:17.703 INFO:tasks.workunit.client.1.smithi133.stdout:4/686: dwrite d2/d48/d5c/f80 [4194304,4194304] 0 2024-02-15T18:27:17.705 INFO:tasks.workunit.client.1.smithi133.stdout:0/945: creat d9/d10/d22/f12f x:0 0 0 2024-02-15T18:27:17.706 INFO:tasks.workunit.client.1.smithi133.stdout:7/722: dread d9/d36/d31/dc1/dcd/dde/f28 [0,4194304] 0 2024-02-15T18:27:17.706 INFO:tasks.workunit.client.1.smithi133.stdout:4/687: write d2/d48/fc2 [3147042,20731] 0 2024-02-15T18:27:17.717 INFO:tasks.workunit.client.1.smithi133.stdout:7/723: mknod d9/d36/d3d/d4c/d97/da9/cec 0 2024-02-15T18:27:17.725 INFO:tasks.workunit.client.1.smithi133.stdout:0/946: dwrite d9/d10/d19/d29/d67/d68/d9c/f101 [0,4194304] 0 2024-02-15T18:27:17.727 INFO:tasks.workunit.client.1.smithi133.stdout:4/688: mkdir d2/d5/d2b/d21/d2d/d44/da4/dd6 0 2024-02-15T18:27:17.741 INFO:tasks.workunit.client.1.smithi133.stdout:7/724: dwrite d9/f47 [0,4194304] 0 2024-02-15T18:27:17.743 INFO:tasks.workunit.client.1.smithi133.stdout:7/725: read d9/db/d16/f49 [3852385,125457] 0 2024-02-15T18:27:17.744 INFO:tasks.workunit.client.1.smithi133.stdout:7/726: dread d9/fa5 [4194304,4194304] 0 2024-02-15T18:27:17.747 INFO:tasks.workunit.client.1.smithi133.stdout:7/727: mknod d9/d36/d3d/ced 0 2024-02-15T18:27:17.748 INFO:tasks.workunit.client.1.smithi133.stdout:7/728: dread d9/d36/d3d/fd4 [0,4194304] 0 2024-02-15T18:27:17.750 INFO:tasks.workunit.client.1.smithi133.stdout:7/729: rename d9/fbd to d9/d36/d31/dc1/dcd/dde/d84/fee 0 2024-02-15T18:27:17.750 INFO:tasks.workunit.client.1.smithi133.stdout:7/730: dread - d9/d36/d3d/d4c/d97/de4/fe1 zero size 2024-02-15T18:27:17.751 INFO:tasks.workunit.client.1.smithi133.stdout:7/731: fdatasync d9/db/f27 0 2024-02-15T18:27:17.751 INFO:tasks.workunit.client.1.smithi133.stdout:7/732: symlink d9/d36/lef 0 2024-02-15T18:27:17.751 INFO:tasks.workunit.client.1.smithi133.stdout:7/733: fdatasync d9/db/d16/d5d/f89 0 2024-02-15T18:27:17.755 INFO:tasks.workunit.client.1.smithi133.stdout:0/947: dwrite d9/d10/d22/d32/d7f/fa3 [0,4194304] 0 2024-02-15T18:27:17.756 INFO:tasks.workunit.client.1.smithi133.stdout:0/948: write d9/d10/d2c/f91 [304355,23672] 0 2024-02-15T18:27:17.756 INFO:tasks.workunit.client.1.smithi133.stdout:7/734: write d9/f47 [1992177,5433] 0 2024-02-15T18:27:17.756 INFO:tasks.workunit.client.1.smithi133.stdout:4/689: dwrite d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f90 [4194304,4194304] 0 2024-02-15T18:27:17.766 INFO:tasks.workunit.client.1.smithi133.stdout:4/690: creat d2/d5/fd7 x:0 0 0 2024-02-15T18:27:17.767 INFO:tasks.workunit.client.1.smithi133.stdout:4/691: symlink d2/d5/d2b/d21/da2/d5e/dd1/ld8 0 2024-02-15T18:27:17.778 INFO:tasks.workunit.client.1.smithi133.stdout:0/949: dwrite d9/d10/d22/d2f/f71 [0,4194304] 0 2024-02-15T18:27:17.779 INFO:tasks.workunit.client.1.smithi133.stdout:7/735: dwrite d9/db/f50 [0,4194304] 0 2024-02-15T18:27:17.780 INFO:tasks.workunit.client.1.smithi133.stdout:0/950: mknod d9/d28/df4/c130 0 2024-02-15T18:27:17.782 INFO:tasks.workunit.client.1.smithi133.stdout:7/736: creat d9/d36/d31/ff0 x:0 0 0 2024-02-15T18:27:17.783 INFO:tasks.workunit.client.1.smithi133.stdout:7/737: chown d9/d36/d39/dd0 132095650 1 2024-02-15T18:27:17.783 INFO:tasks.workunit.client.1.smithi133.stdout:7/738: write d9/db/d55/f7a [205376,50352] 0 2024-02-15T18:27:17.783 INFO:tasks.workunit.client.1.smithi133.stdout:7/739: chown d9/c2c 299 1 2024-02-15T18:27:17.783 INFO:tasks.workunit.client.1.smithi133.stdout:0/951: rename d9/d10/d22/d32/cb3 to d9/d10/d22/c131 0 2024-02-15T18:27:17.784 INFO:tasks.workunit.client.1.smithi133.stdout:7/740: creat d9/db/d16/d5d/d68/d73/ff1 x:0 0 0 2024-02-15T18:27:17.784 INFO:tasks.workunit.client.1.smithi133.stdout:0/952: creat d9/d10/d22/d2f/d9f/f132 x:0 0 0 2024-02-15T18:27:17.787 INFO:tasks.workunit.client.1.smithi133.stdout:0/953: rename d9/d28/c2a to d9/c133 0 2024-02-15T18:27:17.788 INFO:tasks.workunit.client.1.smithi133.stdout:4/692: dwrite d2/d5/d2b/d21/d2d/d44/d51/f52 [0,4194304] 0 2024-02-15T18:27:17.788 INFO:tasks.workunit.client.1.smithi133.stdout:4/693: fsync d2/d5/d2b/d21/fa1 0 2024-02-15T18:27:17.788 INFO:tasks.workunit.client.1.smithi133.stdout:4/694: write d2/d5/fd7 [19335,113409] 0 2024-02-15T18:27:17.788 INFO:tasks.workunit.client.1.smithi133.stdout:4/695: chown d2/d5/d2b/d21/d3b/d49/d98/fb0 1 1 2024-02-15T18:27:17.790 INFO:tasks.workunit.client.1.smithi133.stdout:4/696: write d2/d48/d5c/d93/d8d/d96/fb8 [1896771,26725] 0 2024-02-15T18:27:17.799 INFO:tasks.workunit.client.1.smithi133.stdout:4/697: mknod d2/d48/d6a/d9e/cd9 0 2024-02-15T18:27:17.801 INFO:tasks.workunit.client.1.smithi133.stdout:0/954: dread d9/d2b/de9/ff9 [0,4194304] 0 2024-02-15T18:27:17.801 INFO:tasks.workunit.client.1.smithi133.stdout:0/955: rmdir d9/d10/d22/d32/d7f 39 2024-02-15T18:27:17.801 INFO:tasks.workunit.client.1.smithi133.stdout:7/741: dwrite d9/d36/d39/f99 [0,4194304] 0 2024-02-15T18:27:17.804 INFO:tasks.workunit.client.1.smithi133.stdout:0/956: creat d9/d10/d19/d29/d67/d68/f134 x:0 0 0 2024-02-15T18:27:17.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/742: link d9/db/d16/d5d/f89 d9/da/ff2 0 2024-02-15T18:27:17.811 INFO:tasks.workunit.client.1.smithi133.stdout:7/743: truncate d9/db/f8c 1180181 0 2024-02-15T18:27:17.811 INFO:tasks.workunit.client.1.smithi133.stdout:7/744: truncate d9/f47 4865727 0 2024-02-15T18:27:17.812 INFO:tasks.workunit.client.1.smithi133.stdout:0/957: unlink d9/d10/d22/d2f/c31 0 2024-02-15T18:27:17.814 INFO:tasks.workunit.client.1.smithi133.stdout:7/745: mkdir d9/db/d16/d4f/df3 0 2024-02-15T18:27:17.815 INFO:tasks.workunit.client.1.smithi133.stdout:0/958: symlink d9/d10/d22/d2f/d9f/d119/d5e/l135 0 2024-02-15T18:27:17.815 INFO:tasks.workunit.client.1.smithi133.stdout:0/959: fdatasync d9/d10/d19/d8c/fb9 0 2024-02-15T18:27:17.816 INFO:tasks.workunit.client.1.smithi133.stdout:0/960: write d9/d10/d22/d32/f64 [3433048,42606] 0 2024-02-15T18:27:17.816 INFO:tasks.workunit.client.1.smithi133.stdout:7/746: creat d9/da/d48/d62/ff4 x:0 0 0 2024-02-15T18:27:17.829 INFO:tasks.workunit.client.1.smithi133.stdout:7/747: dread d9/f47 [0,4194304] 0 2024-02-15T18:27:17.830 INFO:tasks.workunit.client.1.smithi133.stdout:7/748: creat d9/da/d48/d62/ff5 x:0 0 0 2024-02-15T18:27:17.830 INFO:tasks.workunit.client.1.smithi133.stdout:7/749: chown d9/db/d16/d4f 349757587 1 2024-02-15T18:27:17.839 INFO:tasks.workunit.client.1.smithi133.stdout:9/734: sync 2024-02-15T18:27:17.840 INFO:tasks.workunit.client.1.smithi133.stdout:1/995: sync 2024-02-15T18:27:17.840 INFO:tasks.workunit.client.1.smithi133.stdout:4/698: dwrite d2/d48/d6a/d9e/fad [8388608,4194304] 0 2024-02-15T18:27:17.840 INFO:tasks.workunit.client.1.smithi133.stdout:4/699: truncate d2/d5/d2b/d21/da2/d5e/faf 148092 0 2024-02-15T18:27:17.841 INFO:tasks.workunit.client.1.smithi133.stdout:9/735: write d0/f6 [2480753,20116] 0 2024-02-15T18:27:17.843 INFO:tasks.workunit.client.1.smithi133.stdout:1/996: link d6/d1e/d41/l55 d6/d1e/d41/d7c/l165 0 2024-02-15T18:27:17.855 INFO:tasks.workunit.client.1.smithi133.stdout:7/750: dwrite d9/db/d16/f53 [0,4194304] 0 2024-02-15T18:27:17.856 INFO:tasks.workunit.client.1.smithi133.stdout:7/751: fsync d9/db/f27 0 2024-02-15T18:27:17.856 INFO:tasks.workunit.client.1.smithi133.stdout:7/752: stat d9/d36/d3d/d4c 0 2024-02-15T18:27:17.858 INFO:tasks.workunit.client.1.smithi133.stdout:7/753: symlink d9/d36/d31/dc1/dcd/lf6 0 2024-02-15T18:27:17.860 INFO:tasks.workunit.client.1.smithi133.stdout:7/754: read d9/db/d55/fa0 [930496,1626] 0 2024-02-15T18:27:17.863 INFO:tasks.workunit.client.1.smithi133.stdout:7/755: write d9/db/f3e [1448728,55577] 0 2024-02-15T18:27:17.864 INFO:tasks.workunit.client.1.smithi133.stdout:7/756: truncate d9/db/d16/f3a 1006413 0 2024-02-15T18:27:17.864 INFO:tasks.workunit.client.1.smithi133.stdout:7/757: readlink d9/db/d55/l80 0 2024-02-15T18:27:17.864 INFO:tasks.workunit.client.1.smithi133.stdout:7/758: chown d9/d36/d31/dc1/dcd/dde/l8d 241260 1 2024-02-15T18:27:17.866 INFO:tasks.workunit.client.1.smithi133.stdout:9/736: dwrite d0/d8/fd [4194304,4194304] 0 2024-02-15T18:27:17.866 INFO:tasks.workunit.client.1.smithi133.stdout:1/997: dwrite d6/d1e/d3a/d82/d85/f45 [0,4194304] 0 2024-02-15T18:27:17.871 INFO:tasks.workunit.client.1.smithi133.stdout:1/998: mknod d6/d1e/d41/d132/c166 0 2024-02-15T18:27:17.898 INFO:tasks.workunit.client.1.smithi133.stdout:1/999: dwrite d6/d2a/d59/d5a/f9b [4194304,4194304] 0 2024-02-15T18:27:17.900 INFO:tasks.workunit.client.1.smithi133.stdout:7/759: dwrite d9/db/f11 [0,4194304] 0 2024-02-15T18:27:17.903 INFO:tasks.workunit.client.1.smithi133.stdout:7/760: rename d9/db/d16/d5d/d68/d8a/cd5 to d9/da/d48/d62/cf7 0 2024-02-15T18:27:17.903 INFO:tasks.workunit.client.1.smithi133.stdout:7/761: getdents d9/d36/d3d/d4c 0 2024-02-15T18:27:17.904 INFO:tasks.workunit.client.1.smithi133.stdout:7/762: creat d9/db/ff8 x:0 0 0 2024-02-15T18:27:17.904 INFO:tasks.workunit.client.1.smithi133.stdout:7/763: stat d9/d19/c5f 0 2024-02-15T18:27:17.904 INFO:tasks.workunit.client.1.smithi133.stdout:9/737: dwrite d0/d8/fd [0,4194304] 0 2024-02-15T18:27:17.905 INFO:tasks.workunit.client.1.smithi133.stdout:7/764: symlink d9/lf9 0 2024-02-15T18:27:17.905 INFO:tasks.workunit.client.1.smithi133.stdout:7/765: write d9/db/d16/f3a [1201737,17690] 0 2024-02-15T18:27:17.905 INFO:tasks.workunit.client.1.smithi133.stdout:7/766: chown d9/d36/d31/dc1/dcd/dde/l88 102 1 2024-02-15T18:27:17.938 INFO:tasks.workunit.client.1.smithi133.stdout:7/767: dwrite d9/da/d48/d62/d64/fb9 [0,4194304] 0 2024-02-15T18:27:17.938 INFO:tasks.workunit.client.1.smithi133.stdout:7/768: write d9/da/ff2 [1604682,121087] 0 2024-02-15T18:27:17.938 INFO:tasks.workunit.client.1.smithi133.stdout:9/738: dwrite d0/d8/d9/d12/fab [0,4194304] 0 2024-02-15T18:27:17.942 INFO:tasks.workunit.client.1.smithi133.stdout:7/769: dread d9/d36/d39/d98/fa1 [4194304,4194304] 0 2024-02-15T18:27:17.945 INFO:tasks.workunit.client.1.smithi133.stdout:7/770: creat d9/db/d16/d5d/d68/d73/ffa x:0 0 0 2024-02-15T18:27:17.946 INFO:tasks.workunit.client.1.smithi133.stdout:7/771: link d9/d36/c34 d9/db/d16/d5d/d68/d8a/cfb 0 2024-02-15T18:27:17.957 INFO:tasks.workunit.client.1.smithi133.stdout:3/946: sync 2024-02-15T18:27:17.958 INFO:tasks.workunit.client.1.smithi133.stdout:5/771: sync 2024-02-15T18:27:17.960 INFO:tasks.workunit.client.1.smithi133.stdout:3/947: write d0/d15/d2f/f30 [1254012,112614] 0 2024-02-15T18:27:17.960 INFO:tasks.workunit.client.1.smithi133.stdout:9/739: dwrite d0/d8/d9/d49/f6f [0,4194304] 0 2024-02-15T18:27:17.960 INFO:tasks.workunit.client.1.smithi133.stdout:3/948: write d0/d15/d37/d95/f9c [460537,25566] 0 2024-02-15T18:27:17.961 INFO:tasks.workunit.client.1.smithi133.stdout:5/772: write d17/f46 [283732,129716] 0 2024-02-15T18:27:17.961 INFO:tasks.workunit.client.1.smithi133.stdout:7/772: dread d9/da/d48/d62/d64/fd1 [0,4194304] 0 2024-02-15T18:27:17.962 INFO:tasks.workunit.client.1.smithi133.stdout:9/740: rename d0/d8/d9/d49/d4c/cc3 to d0/d8/cf2 0 2024-02-15T18:27:17.970 INFO:tasks.workunit.client.1.smithi133.stdout:5/773: dread f10 [0,4194304] 0 2024-02-15T18:27:17.975 INFO:tasks.workunit.client.1.smithi133.stdout:5/774: symlink d17/d20/d32/d38/lf9 0 2024-02-15T18:27:17.975 INFO:tasks.workunit.client.1.smithi133.stdout:5/775: truncate d17/d20/d32/fd1 523269 0 2024-02-15T18:27:17.979 INFO:tasks.workunit.client.1.smithi133.stdout:0/961: sync 2024-02-15T18:27:17.979 INFO:tasks.workunit.client.1.smithi133.stdout:4/700: sync 2024-02-15T18:27:17.979 INFO:tasks.workunit.client.1.smithi133.stdout:4/701: fsync d2/d5/d2b/d21/f99 0 2024-02-15T18:27:17.982 INFO:tasks.workunit.client.1.smithi133.stdout:8/773: sync 2024-02-15T18:27:17.984 INFO:tasks.workunit.client.1.smithi133.stdout:5/776: write d17/d20/d32/f56 [3227903,84175] 0 2024-02-15T18:27:17.984 INFO:tasks.workunit.client.1.smithi133.stdout:5/777: fdatasync d17/f1c 0 2024-02-15T18:27:17.985 INFO:tasks.workunit.client.1.smithi133.stdout:2/887: sync 2024-02-15T18:27:17.986 INFO:tasks.workunit.client.1.smithi133.stdout:2/888: rename d7/db/f21 to d7/d2c/d46/f11d 0 2024-02-15T18:27:17.987 INFO:tasks.workunit.client.1.smithi133.stdout:9/741: dwrite d0/d8/d9/d12/d82/d42/d44/fa2 [4194304,4194304] 0 2024-02-15T18:27:17.989 INFO:tasks.workunit.client.1.smithi133.stdout:2/889: dread d7/d2c/d3b/d48/f9f [0,4194304] 0 2024-02-15T18:27:17.990 INFO:tasks.workunit.client.1.smithi133.stdout:2/890: dread d7/ffc [0,4194304] 0 2024-02-15T18:27:17.990 INFO:tasks.workunit.client.1.smithi133.stdout:2/891: chown d7/db/d35/f119 1264947 1 2024-02-15T18:27:17.996 INFO:tasks.workunit.client.1.smithi133.stdout:2/892: read d7/d2c/fe6 [2394040,29584] 0 2024-02-15T18:27:17.999 INFO:tasks.workunit.client.1.smithi133.stdout:2/893: mknod d7/d18/d32/d65/d54/dc9/de7/dd9/c11e 0 2024-02-15T18:27:17.999 INFO:tasks.workunit.client.1.smithi133.stdout:5/778: write d17/d20/f43 [1061609,70537] 0 2024-02-15T18:27:18.001 INFO:tasks.workunit.client.1.smithi133.stdout:5/779: mkdir d17/d20/d32/d38/dfa 0 2024-02-15T18:27:18.001 INFO:tasks.workunit.client.1.smithi133.stdout:7/773: dwrite d9/d36/d39/dd0/fe9 [0,4194304] 0 2024-02-15T18:27:18.002 INFO:tasks.workunit.client.1.smithi133.stdout:8/774: dread d3/de/f66 [0,4194304] 0 2024-02-15T18:27:18.005 INFO:tasks.workunit.client.1.smithi133.stdout:5/780: dread d17/d26/f21 [0,4194304] 0 2024-02-15T18:27:18.005 INFO:tasks.workunit.client.1.smithi133.stdout:5/781: truncate d17/d20/d4f/d5f/d93/dec/f94 884191 0 2024-02-15T18:27:18.005 INFO:tasks.workunit.client.1.smithi133.stdout:5/782: readlink d17/d20/d4f/d5f/d93/dec/l99 0 2024-02-15T18:27:18.005 INFO:tasks.workunit.client.1.smithi133.stdout:7/774: truncate d9/db/f2d 1351459 0 2024-02-15T18:27:18.005 INFO:tasks.workunit.client.1.smithi133.stdout:8/775: creat d3/d1c/d2f/d87/f107 x:0 0 0 2024-02-15T18:27:18.010 INFO:tasks.workunit.client.1.smithi133.stdout:5/783: creat d17/d20/d32/d9d/ffb x:0 0 0 2024-02-15T18:27:18.010 INFO:tasks.workunit.client.1.smithi133.stdout:8/776: mkdir d3/d1f/dde/d108 0 2024-02-15T18:27:18.010 INFO:tasks.workunit.client.1.smithi133.stdout:7/775: symlink d9/d36/lfc 0 2024-02-15T18:27:18.013 INFO:tasks.workunit.client.1.smithi133.stdout:3/949: dwrite d0/d15/d37/d95/f9c [0,4194304] 0 2024-02-15T18:27:18.013 INFO:tasks.workunit.client.1.smithi133.stdout:3/950: chown d0/d15/d37/d4a/de2/ff1 5186 1 2024-02-15T18:27:18.013 INFO:tasks.workunit.client.1.smithi133.stdout:8/777: mknod d3/d1f/d4f/c109 0 2024-02-15T18:27:18.013 INFO:tasks.workunit.client.1.smithi133.stdout:8/778: chown d3/de/d3e/d94/ded/d58/lf8 0 1 2024-02-15T18:27:18.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/702: dwrite d2/d5/d2b/d21/d2d/d44/f47 [0,4194304] 0 2024-02-15T18:27:18.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/703: dread - d2/d48/d5c/d93/d8d/f91 zero size 2024-02-15T18:27:18.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/704: dread - d2/d48/d5c/d93/d8d/f91 zero size 2024-02-15T18:27:18.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/705: truncate d2/d5/d2b/d21/d3b/d49/d98/fc7 1060469 0 2024-02-15T18:27:18.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/706: chown d2/d48/d5c/d9f/db6/cc8 1 1 2024-02-15T18:27:18.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/707: write d2/d48/d5c/fc4 [159084,42932] 0 2024-02-15T18:27:18.016 INFO:tasks.workunit.client.1.smithi133.stdout:3/951: rename d0/d15/d2f/d9b/d62/c84 to d0/d15/d37/d95/dc2/c12d 0 2024-02-15T18:27:18.017 INFO:tasks.workunit.client.1.smithi133.stdout:8/779: creat d3/d7/d40/f10a x:0 0 0 2024-02-15T18:27:18.018 INFO:tasks.workunit.client.1.smithi133.stdout:0/962: dwrite d9/d10/d19/d29/f8f [0,4194304] 0 2024-02-15T18:27:18.028 INFO:tasks.workunit.client.1.smithi133.stdout:7/776: dread d9/fd2 [0,4194304] 0 2024-02-15T18:27:18.028 INFO:tasks.workunit.client.1.smithi133.stdout:0/963: write d9/d10/d22/d2f/d9f/d119/d5e/f104 [9729909,85530] 0 2024-02-15T18:27:18.028 INFO:tasks.workunit.client.1.smithi133.stdout:0/964: write d9/d10/d19/d29/d10a/f11f [342367,26501] 0 2024-02-15T18:27:18.031 INFO:tasks.workunit.client.1.smithi133.stdout:3/952: link d0/d15/d54/l94 d0/d15/d37/d4a/l12e 0 2024-02-15T18:27:18.031 INFO:tasks.workunit.client.1.smithi133.stdout:8/780: unlink d3/d1c/d2f/l71 0 2024-02-15T18:27:18.031 INFO:tasks.workunit.client.1.smithi133.stdout:7/777: write d9/d36/d39/dd0/fe9 [3234702,30874] 0 2024-02-15T18:27:18.031 INFO:tasks.workunit.client.1.smithi133.stdout:5/784: fsync d17/d20/d32/d9d/ffb 0 2024-02-15T18:27:18.038 INFO:tasks.workunit.client.1.smithi133.stdout:4/708: dwrite d2/f29 [0,4194304] 0 2024-02-15T18:27:18.040 INFO:tasks.workunit.client.1.smithi133.stdout:3/953: dread d0/d15/d2f/db4/d89/ff9 [0,4194304] 0 2024-02-15T18:27:18.046 INFO:tasks.workunit.client.1.smithi133.stdout:9/742: dwrite d0/d8/d9/d12/d82/d42/d44/f7a [0,4194304] 0 2024-02-15T18:27:18.046 INFO:tasks.workunit.client.1.smithi133.stdout:9/743: chown d0/d8/d9/d12/d82/f40 2288 1 2024-02-15T18:27:18.052 INFO:tasks.workunit.client.1.smithi133.stdout:3/954: mkdir d0/d15/d37/d95/d12f 0 2024-02-15T18:27:18.052 INFO:tasks.workunit.client.1.smithi133.stdout:5/785: creat d17/d26/d7b/d87/ffc x:0 0 0 2024-02-15T18:27:18.052 INFO:tasks.workunit.client.1.smithi133.stdout:7/778: mknod d9/db/d16/d5d/d68/cfd 0 2024-02-15T18:27:18.052 INFO:tasks.workunit.client.1.smithi133.stdout:5/786: chown d17/d20/d4f/d5f/d93/dec/cb9 1505 1 2024-02-15T18:27:18.057 INFO:tasks.workunit.client.1.smithi133.stdout:0/965: dwrite d9/d10/d22/d2f/d9f/d119/f5a [4194304,4194304] 0 2024-02-15T18:27:18.057 INFO:tasks.workunit.client.1.smithi133.stdout:0/966: stat d9/d10/d19/d29/d67/d68/d96/d44/f6a 0 2024-02-15T18:27:18.059 INFO:tasks.workunit.client.1.smithi133.stdout:5/787: dread d17/d20/d4f/d5f/d93/dec/f41 [4194304,4194304] 0 2024-02-15T18:27:18.061 INFO:tasks.workunit.client.1.smithi133.stdout:4/709: dwrite d2/d5/d2b/f1a [0,4194304] 0 2024-02-15T18:27:18.063 INFO:tasks.workunit.client.1.smithi133.stdout:9/744: unlink d0/d8/d10/daa/cbd 0 2024-02-15T18:27:18.063 INFO:tasks.workunit.client.1.smithi133.stdout:3/955: link d0/d15/d2f/d9b/d72/ded/lf8 d0/d15/d2f/d5e/dff/l130 0 2024-02-15T18:27:18.066 INFO:tasks.workunit.client.1.smithi133.stdout:7/779: unlink d9/db/d16/d5d/d68/d73/d9b/da6/le0 0 2024-02-15T18:27:18.066 INFO:tasks.workunit.client.1.smithi133.stdout:5/788: creat d17/d20/d32/d9d/da9/ffd x:0 0 0 2024-02-15T18:27:18.076 INFO:tasks.workunit.client.1.smithi133.stdout:5/789: creat d17/d20/d32/d38/dbd/ffe x:0 0 0 2024-02-15T18:27:18.076 INFO:tasks.workunit.client.1.smithi133.stdout:5/790: chown d17/d20/dc3/lcc 55 1 2024-02-15T18:27:18.076 INFO:tasks.workunit.client.1.smithi133.stdout:9/745: mknod d0/d8/d9/d12/d82/d42/cf3 0 2024-02-15T18:27:18.080 INFO:tasks.workunit.client.1.smithi133.stdout:9/746: creat d0/d8/d9/d49/d4c/ff4 x:0 0 0 2024-02-15T18:27:18.083 INFO:tasks.workunit.client.1.smithi133.stdout:9/747: rename d0/d8/d9/d3c to d0/d8/d9/d12/d82/d42/d79/d90/de8/df5 0 2024-02-15T18:27:18.083 INFO:tasks.workunit.client.1.smithi133.stdout:9/748: stat d0/d37/c3a 0 2024-02-15T18:27:18.101 INFO:tasks.workunit.client.1.smithi133.stdout:0/967: dwrite d9/d10/dcb/ff2 [0,4194304] 0 2024-02-15T18:27:18.101 INFO:tasks.workunit.client.1.smithi133.stdout:0/968: chown d9/d10/d85/fcc 8 1 2024-02-15T18:27:18.101 INFO:tasks.workunit.client.1.smithi133.stdout:9/749: dread d0/d8/d9/d12/f1b [0,4194304] 0 2024-02-15T18:27:18.101 INFO:tasks.workunit.client.1.smithi133.stdout:0/969: write d9/d10/d19/d29/d67/d68/d96/d44/f120 [264479,71937] 0 2024-02-15T18:27:18.108 INFO:tasks.workunit.client.1.smithi133.stdout:7/780: dwrite f7 [0,4194304] 0 2024-02-15T18:27:18.108 INFO:tasks.workunit.client.1.smithi133.stdout:0/970: write d9/d10/d19/d29/d67/d68/d9c/f101 [3052155,13796] 0 2024-02-15T18:27:18.108 INFO:tasks.workunit.client.1.smithi133.stdout:0/971: write d9/d2b/f79 [2467977,45735] 0 2024-02-15T18:27:18.108 INFO:tasks.workunit.client.1.smithi133.stdout:7/781: mknod d9/d36/cfe 0 2024-02-15T18:27:18.108 INFO:tasks.workunit.client.1.smithi133.stdout:3/956: dwrite d0/d15/d2f/d9b/f58 [4194304,4194304] 0 2024-02-15T18:27:18.108 INFO:tasks.workunit.client.1.smithi133.stdout:5/791: dwrite d17/d20/f57 [0,4194304] 0 2024-02-15T18:27:18.109 INFO:tasks.workunit.client.1.smithi133.stdout:4/710: dwrite d2/f2a [0,4194304] 0 2024-02-15T18:27:18.111 INFO:tasks.workunit.client.1.smithi133.stdout:5/792: read d17/f6d [1949339,39518] 0 2024-02-15T18:27:18.116 INFO:tasks.workunit.client.1.smithi133.stdout:0/972: creat d9/d10/d22/d2f/d9f/d119/d5e/de6/f136 x:0 0 0 2024-02-15T18:27:18.116 INFO:tasks.workunit.client.1.smithi133.stdout:0/973: fdatasync d9/d10/d19/d29/d67/d68/d9c/da7/fca 0 2024-02-15T18:27:18.120 INFO:tasks.workunit.client.1.smithi133.stdout:9/750: dwrite d0/d8/d10/d4d/dc6/fc8 [0,4194304] 0 2024-02-15T18:27:18.120 INFO:tasks.workunit.client.1.smithi133.stdout:4/711: dread d2/f2a [0,4194304] 0 2024-02-15T18:27:18.121 INFO:tasks.workunit.client.1.smithi133.stdout:7/782: symlink d9/da/lff 0 2024-02-15T18:27:18.121 INFO:tasks.workunit.client.1.smithi133.stdout:0/974: symlink d9/d10/d22/d2f/d9f/l137 0 2024-02-15T18:27:18.121 INFO:tasks.workunit.client.1.smithi133.stdout:3/957: creat d0/d15/d2f/d9b/d39/dcd/f131 x:0 0 0 2024-02-15T18:27:18.121 INFO:tasks.workunit.client.1.smithi133.stdout:5/793: creat d17/d20/d32/d38/dfa/fff x:0 0 0 2024-02-15T18:27:18.121 INFO:tasks.workunit.client.1.smithi133.stdout:5/794: read - d17/d20/dc3/ded/fd8 zero size 2024-02-15T18:27:18.121 INFO:tasks.workunit.client.1.smithi133.stdout:5/795: dread - d17/f7a zero size 2024-02-15T18:27:18.122 INFO:tasks.workunit.client.1.smithi133.stdout:4/712: mkdir d2/d5/d2b/dd2/dda 0 2024-02-15T18:27:18.122 INFO:tasks.workunit.client.1.smithi133.stdout:4/713: fsync d2/d48/d5c/db7/dba/dab/fb1 0 2024-02-15T18:27:18.123 INFO:tasks.workunit.client.1.smithi133.stdout:9/751: symlink d0/d8/d9/d12/lf6 0 2024-02-15T18:27:18.124 INFO:tasks.workunit.client.1.smithi133.stdout:0/975: unlink d9/d10/d19/d8c/fea 0 2024-02-15T18:27:18.131 INFO:tasks.workunit.client.1.smithi133.stdout:5/796: symlink d17/d20/d32/d9d/l100 0 2024-02-15T18:27:18.131 INFO:tasks.workunit.client.1.smithi133.stdout:3/958: rename d0/d15/d2f/d5e/f8b to d0/d15/d2f/d9b/d39/d3f/f132 0 2024-02-15T18:27:18.131 INFO:tasks.workunit.client.1.smithi133.stdout:3/959: fsync d0/d15/d2f/d9b/d72/dbf/fc9 0 2024-02-15T18:27:18.131 INFO:tasks.workunit.client.1.smithi133.stdout:9/752: mkdir d0/d37/df7 0 2024-02-15T18:27:18.131 INFO:tasks.workunit.client.1.smithi133.stdout:9/753: dread - d0/d8/d9/d12/d82/d42/d79/fb0 zero size 2024-02-15T18:27:18.132 INFO:tasks.workunit.client.1.smithi133.stdout:5/797: mknod d17/d20/d4f/d5f/d93/dec/c101 0 2024-02-15T18:27:18.133 INFO:tasks.workunit.client.1.smithi133.stdout:9/754: symlink d0/d8/d10/daa/lf8 0 2024-02-15T18:27:18.135 INFO:tasks.workunit.client.1.smithi133.stdout:0/976: dread d9/d10/d19/d29/d67/d68/d9c/d95/f97 [0,4194304] 0 2024-02-15T18:27:18.135 INFO:tasks.workunit.client.1.smithi133.stdout:5/798: creat d17/d20/d32/d38/d86/f102 x:0 0 0 2024-02-15T18:27:18.136 INFO:tasks.workunit.client.1.smithi133.stdout:5/799: mkdir d17/d20/d32/d38/d103 0 2024-02-15T18:27:18.137 INFO:tasks.workunit.client.1.smithi133.stdout:9/755: rename d0/d8/f22 to d0/d8/d9/d12/d82/ff9 0 2024-02-15T18:27:18.137 INFO:tasks.workunit.client.1.smithi133.stdout:3/960: dread d0/d15/d37/f59 [0,4194304] 0 2024-02-15T18:27:18.137 INFO:tasks.workunit.client.1.smithi133.stdout:5/800: mknod d17/d26/d7b/c104 0 2024-02-15T18:27:18.138 INFO:tasks.workunit.client.1.smithi133.stdout:9/756: mkdir d0/d37/df7/dfa 0 2024-02-15T18:27:18.139 INFO:tasks.workunit.client.1.smithi133.stdout:5/801: dread d17/d20/d32/d38/f8b [0,4194304] 0 2024-02-15T18:27:18.139 INFO:tasks.workunit.client.1.smithi133.stdout:5/802: write f10 [3248979,107321] 0 2024-02-15T18:27:18.141 INFO:tasks.workunit.client.1.smithi133.stdout:0/977: rename d9/d2b/dd2 to d9/d10/d2c/df3/d122/d138 0 2024-02-15T18:27:18.141 INFO:tasks.workunit.client.1.smithi133.stdout:0/978: truncate d9/d28/f3a 1220297 0 2024-02-15T18:27:18.141 INFO:tasks.workunit.client.1.smithi133.stdout:0/979: write d9/d10/fae [4454839,130492] 0 2024-02-15T18:27:18.141 INFO:tasks.workunit.client.1.smithi133.stdout:0/980: stat d9/d2b/le0 0 2024-02-15T18:27:18.141 INFO:tasks.workunit.client.1.smithi133.stdout:0/981: chown d9/d2b/le0 587647 1 2024-02-15T18:27:18.142 INFO:tasks.workunit.client.1.smithi133.stdout:5/803: symlink d17/d26/d7b/de2/l105 0 2024-02-15T18:27:18.143 INFO:tasks.workunit.client.1.smithi133.stdout:0/982: dread d9/d10/d85/fcc [0,4194304] 0 2024-02-15T18:27:18.143 INFO:tasks.workunit.client.1.smithi133.stdout:0/983: chown d9/d10/d22/d2f/d9f/d119/d5e/cdb 134280463 1 2024-02-15T18:27:18.143 INFO:tasks.workunit.client.1.smithi133.stdout:0/984: getdents d9/d10/d19/d129 0 2024-02-15T18:27:18.144 INFO:tasks.workunit.client.1.smithi133.stdout:9/757: write d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/f62 [2695718,88761] 0 2024-02-15T18:27:18.144 INFO:tasks.workunit.client.1.smithi133.stdout:0/985: getdents d9/d10/d22/d2f/d9f/d119/d5e/de6 0 2024-02-15T18:27:18.145 INFO:tasks.workunit.client.1.smithi133.stdout:7/783: dwrite d9/db/d16/d4f/fdf [0,4194304] 0 2024-02-15T18:27:18.145 INFO:tasks.workunit.client.1.smithi133.stdout:0/986: truncate d9/d10/d19/d29/d67/d68/d96/f102 2615538 0 2024-02-15T18:27:18.145 INFO:tasks.workunit.client.1.smithi133.stdout:7/784: read d9/da/d48/d5a/f7b [162381,7421] 0 2024-02-15T18:27:18.146 INFO:tasks.workunit.client.1.smithi133.stdout:7/785: fsync d9/db/d16/d5d/d68/da2/fdd 0 2024-02-15T18:27:18.146 INFO:tasks.workunit.client.1.smithi133.stdout:4/714: dwrite d2/d48/d5c/db7/dba/f64 [0,4194304] 0 2024-02-15T18:27:18.147 INFO:tasks.workunit.client.1.smithi133.stdout:0/987: creat d9/d10/d19/d29/d67/d68/d96/d44/f139 x:0 0 0 2024-02-15T18:27:18.148 INFO:tasks.workunit.client.1.smithi133.stdout:9/758: write d0/d8/d9/d12/f1b [2205376,14053] 0 2024-02-15T18:27:18.148 INFO:tasks.workunit.client.1.smithi133.stdout:7/786: mknod d9/db/d16/d5d/d68/d73/c100 0 2024-02-15T18:27:18.151 INFO:tasks.workunit.client.1.smithi133.stdout:0/988: creat d9/d1c/f13a x:0 0 0 2024-02-15T18:27:18.151 INFO:tasks.workunit.client.1.smithi133.stdout:0/989: read d9/d10/fae [2546243,85809] 0 2024-02-15T18:27:18.152 INFO:tasks.workunit.client.1.smithi133.stdout:7/787: symlink d9/d36/d3d/d4c/d97/l101 0 2024-02-15T18:27:18.153 INFO:tasks.workunit.client.1.smithi133.stdout:0/990: write d9/d10/d2c/f91 [117391,6804] 0 2024-02-15T18:27:18.155 INFO:tasks.workunit.client.1.smithi133.stdout:0/991: rename d9/d10/ceb to d9/d100/c13b 0 2024-02-15T18:27:18.160 INFO:tasks.workunit.client.1.smithi133.stdout:4/715: dread d2/d5/d2b/d21/fa1 [0,4194304] 0 2024-02-15T18:27:18.168 INFO:tasks.workunit.client.1.smithi133.stdout:4/716: mkdir d2/d5/d2b/d21/da2/d5e/dd1/ddb 0 2024-02-15T18:27:18.169 INFO:tasks.workunit.client.1.smithi133.stdout:4/717: mkdir d2/d5/d2b/d21/d3b/d49/d98/ddc 0 2024-02-15T18:27:18.170 INFO:tasks.workunit.client.1.smithi133.stdout:9/759: dread d0/d37/fb9 [4194304,4194304] 0 2024-02-15T18:27:18.170 INFO:tasks.workunit.client.1.smithi133.stdout:9/760: chown d0/d8/d9/f31 2 1 2024-02-15T18:27:18.171 INFO:tasks.workunit.client.1.smithi133.stdout:4/718: symlink d2/d48/d6a/d9e/ldd 0 2024-02-15T18:27:18.172 INFO:tasks.workunit.client.1.smithi133.stdout:4/719: creat d2/d5/d2b/d21/d2d/d44/da4/fde x:0 0 0 2024-02-15T18:27:18.172 INFO:tasks.workunit.client.1.smithi133.stdout:4/720: fdatasync d2/d5/d2b/f24 0 2024-02-15T18:27:18.181 INFO:tasks.workunit.client.1.smithi133.stdout:3/961: dwrite d0/d15/d2f/d9b/d39/d3f/dc1/fa7 [0,4194304] 0 2024-02-15T18:27:18.181 INFO:tasks.workunit.client.1.smithi133.stdout:3/962: write d0/d15/d2f/d9b/d72/dbf/dd9/ffa [237032,44541] 0 2024-02-15T18:27:18.182 INFO:tasks.workunit.client.1.smithi133.stdout:3/963: symlink d0/d15/d2f/db4/df2/l133 0 2024-02-15T18:27:18.183 INFO:tasks.workunit.client.1.smithi133.stdout:5/804: dwrite d17/d20/d4f/d5f/ff0 [0,4194304] 0 2024-02-15T18:27:18.183 INFO:tasks.workunit.client.1.smithi133.stdout:9/761: dread d0/d8/d9/d12/d82/f7c [0,4194304] 0 2024-02-15T18:27:18.183 INFO:tasks.workunit.client.1.smithi133.stdout:5/805: stat d17/d26/fbe 0 2024-02-15T18:27:18.185 INFO:tasks.workunit.client.1.smithi133.stdout:0/992: dwrite d9/d10/d22/f12f [0,4194304] 0 2024-02-15T18:27:18.187 INFO:tasks.workunit.client.1.smithi133.stdout:3/964: unlink d0/d15/f67 0 2024-02-15T18:27:18.188 INFO:tasks.workunit.client.1.smithi133.stdout:9/762: rmdir d0/d8/d10/d4d/d92 39 2024-02-15T18:27:18.188 INFO:tasks.workunit.client.1.smithi133.stdout:3/965: chown d0/d15/d2f/db4/d106/l10d 1846786 1 2024-02-15T18:27:18.188 INFO:tasks.workunit.client.1.smithi133.stdout:5/806: mkdir d17/d20/d4f/d5f/d106 0 2024-02-15T18:27:18.191 INFO:tasks.workunit.client.1.smithi133.stdout:9/763: creat d0/d8/d9/d12/d82/ffb x:0 0 0 2024-02-15T18:27:18.192 INFO:tasks.workunit.client.1.smithi133.stdout:3/966: unlink d0/d15/d2f/d9b/f41 0 2024-02-15T18:27:18.193 INFO:tasks.workunit.client.1.smithi133.stdout:7/788: dwrite d9/db/d16/f25 [0,4194304] 0 2024-02-15T18:27:18.193 INFO:tasks.workunit.client.1.smithi133.stdout:4/721: dwrite d2/d5/fa0 [0,4194304] 0 2024-02-15T18:27:18.194 INFO:tasks.workunit.client.1.smithi133.stdout:9/764: mknod d0/d8/d10/d4d/cfc 0 2024-02-15T18:27:18.194 INFO:tasks.workunit.client.1.smithi133.stdout:4/722: write d2/d5/d2b/d21/da2/f27 [105250,130601] 0 2024-02-15T18:27:18.201 INFO:tasks.workunit.client.1.smithi133.stdout:3/967: unlink d0/d15/d2f/d9b/d39/dcd/lea 0 2024-02-15T18:27:18.205 INFO:tasks.workunit.client.1.smithi133.stdout:7/789: mknod d9/db/c102 0 2024-02-15T18:27:18.205 INFO:tasks.workunit.client.1.smithi133.stdout:9/765: link d0/d8/d9/d12/f97 d0/d8/d9/d12/d4f/ffd 0 2024-02-15T18:27:18.208 INFO:tasks.workunit.client.1.smithi133.stdout:0/993: dwrite d9/d10/d19/d29/d67/d68/d96/f102 [0,4194304] 0 2024-02-15T18:27:18.209 INFO:tasks.workunit.client.1.smithi133.stdout:4/723: mkdir d2/d5/d2b/d21/da2/d5e/d76/ddf 0 2024-02-15T18:27:18.209 INFO:tasks.workunit.client.1.smithi133.stdout:4/724: fdatasync d2/d5/d2b/d21/d2d/d4f/f53 0 2024-02-15T18:27:18.211 INFO:tasks.workunit.client.1.smithi133.stdout:4/725: write d2/d5/d2b/d21/d3b/f66 [2794973,68457] 0 2024-02-15T18:27:18.216 INFO:tasks.workunit.client.1.smithi133.stdout:3/968: creat d0/d15/d2f/d9b/d72/d10b/f134 x:0 0 0 2024-02-15T18:27:18.222 INFO:tasks.workunit.client.1.smithi133.stdout:9/766: creat d0/d7b/db7/ffe x:0 0 0 2024-02-15T18:27:18.222 INFO:tasks.workunit.client.1.smithi133.stdout:7/790: creat d9/da/d48/d62/f103 x:0 0 0 2024-02-15T18:27:18.224 INFO:tasks.workunit.client.1.smithi133.stdout:0/994: dread d9/d10/d22/d32/d7f/fa3 [0,4194304] 0 2024-02-15T18:27:18.232 INFO:tasks.workunit.client.1.smithi133.stdout:4/726: creat d2/d48/d5c/fe0 x:0 0 0 2024-02-15T18:27:18.232 INFO:tasks.workunit.client.1.smithi133.stdout:4/727: chown d2/d48/d5c/db7/dba/c40 13226 1 2024-02-15T18:27:18.232 INFO:tasks.workunit.client.1.smithi133.stdout:4/728: fsync d2/d5/d2b/f5b 0 2024-02-15T18:27:18.234 INFO:tasks.workunit.client.1.smithi133.stdout:9/767: unlink d0/d8/d10/d4d/f5e 0 2024-02-15T18:27:18.240 INFO:tasks.workunit.client.1.smithi133.stdout:9/768: dread d0/f7 [0,4194304] 0 2024-02-15T18:27:18.240 INFO:tasks.workunit.client.1.smithi133.stdout:9/769: stat d0/d8/d9/d49/f8e 0 2024-02-15T18:27:18.246 INFO:tasks.workunit.client.1.smithi133.stdout:7/791: rmdir d9/db 39 2024-02-15T18:27:18.246 INFO:tasks.workunit.client.1.smithi133.stdout:3/969: rename d0/d15/d2f/d9b/d39/da2 to d0/d15/d2f/d9b/dc5/ddb/d135 0 2024-02-15T18:27:18.246 INFO:tasks.workunit.client.1.smithi133.stdout:7/792: fdatasync d9/db/d16/d5d/d68/d73/ffa 0 2024-02-15T18:27:18.246 INFO:tasks.workunit.client.1.smithi133.stdout:0/995: dwrite d9/d10/d19/d29/d10a/f11f [0,4194304] 0 2024-02-15T18:27:18.248 INFO:tasks.workunit.client.1.smithi133.stdout:0/996: write d9/d10/d19/d29/d67/d68/d9c/da7/fbf [5630,64512] 0 2024-02-15T18:27:18.255 INFO:tasks.workunit.client.1.smithi133.stdout:2/894: sync 2024-02-15T18:27:18.255 INFO:tasks.workunit.client.1.smithi133.stdout:2/895: fsync d7/db/d67/da7/f103 0 2024-02-15T18:27:18.257 INFO:tasks.workunit.client.1.smithi133.stdout:4/729: rename d2/d5/d2b/d21/d2d/d44/l4e to d2/d5/d2b/d21/da2/le1 0 2024-02-15T18:27:18.257 INFO:tasks.workunit.client.1.smithi133.stdout:4/730: truncate d2/d48/d5c/db7/dba/f64 4469356 0 2024-02-15T18:27:18.257 INFO:tasks.workunit.client.1.smithi133.stdout:7/793: mknod d9/d36/d3d/d4c/d97/c104 0 2024-02-15T18:27:18.260 INFO:tasks.workunit.client.1.smithi133.stdout:2/896: symlink d7/db/d67/da7/l11f 0 2024-02-15T18:27:18.260 INFO:tasks.workunit.client.1.smithi133.stdout:2/897: fdatasync d7/d18/f6f 0 2024-02-15T18:27:18.260 INFO:tasks.workunit.client.1.smithi133.stdout:2/898: getdents d7/d18/d32/d65/d54 0 2024-02-15T18:27:18.260 INFO:tasks.workunit.client.1.smithi133.stdout:3/970: write d0/d15/d2f/d9b/d39/d3f/dc1/d78/f7c [388512,106010] 0 2024-02-15T18:27:18.260 INFO:tasks.workunit.client.1.smithi133.stdout:8/781: sync 2024-02-15T18:27:18.261 INFO:tasks.workunit.client.1.smithi133.stdout:0/997: rename d9/d10/d22/d2f/d9f/d119/d5e/lc4 to d9/d10/d19/d29/d67/d68/d9c/da7/l13c 0 2024-02-15T18:27:18.262 INFO:tasks.workunit.client.1.smithi133.stdout:0/998: chown d9/d10/d22/d32/d7f/l10d 99 1 2024-02-15T18:27:18.263 INFO:tasks.workunit.client.1.smithi133.stdout:2/899: rmdir d7/d18/d32/d65/d58 39 2024-02-15T18:27:18.263 INFO:tasks.workunit.client.1.smithi133.stdout:2/900: write d7/d18/d32/d65/d99/fc3 [245318,125724] 0 2024-02-15T18:27:18.264 INFO:tasks.workunit.client.1.smithi133.stdout:8/782: mknod d3/d1f/d4f/c10b 0 2024-02-15T18:27:18.264 INFO:tasks.workunit.client.1.smithi133.stdout:8/783: chown d3/d1c/d2f/d87/d73/d84/dda 221756 1 2024-02-15T18:27:18.264 INFO:tasks.workunit.client.1.smithi133.stdout:8/784: readlink d3/d1f/d4f/l96 0 2024-02-15T18:27:18.267 INFO:tasks.workunit.client.1.smithi133.stdout:9/770: dwrite d0/fad [0,4194304] 0 2024-02-15T18:27:18.268 INFO:tasks.workunit.client.1.smithi133.stdout:8/785: symlink d3/d1c/d37/d5c/l10c 0 2024-02-15T18:27:18.273 INFO:tasks.workunit.client.1.smithi133.stdout:4/731: dread d2/d48/fc2 [0,4194304] 0 2024-02-15T18:27:18.276 INFO:tasks.workunit.client.1.smithi133.stdout:4/732: rename d2/d48/d6a/l75 to d2/d48/d5c/le2 0 2024-02-15T18:27:18.279 INFO:tasks.workunit.client.1.smithi133.stdout:3/971: getdents d0/d15/d2f/d9b/d39 0 2024-02-15T18:27:18.284 INFO:tasks.workunit.client.1.smithi133.stdout:9/771: dread d0/d8/d9/d12/d4f/fe2 [0,4194304] 0 2024-02-15T18:27:18.285 INFO:tasks.workunit.client.1.smithi133.stdout:9/772: chown d0/fcc 3864 1 2024-02-15T18:27:18.285 INFO:tasks.workunit.client.1.smithi133.stdout:9/773: truncate d0/d37/fdb 570004 0 2024-02-15T18:27:18.288 INFO:tasks.workunit.client.1.smithi133.stdout:9/774: creat d0/d8/d9/fff x:0 0 0 2024-02-15T18:27:18.288 INFO:tasks.workunit.client.1.smithi133.stdout:8/786: dread d3/de/d3e/d94/ded/f74 [0,4194304] 0 2024-02-15T18:27:18.290 INFO:tasks.workunit.client.1.smithi133.stdout:4/733: creat d2/d5/d2b/dd2/fe3 x:0 0 0 2024-02-15T18:27:18.290 INFO:tasks.workunit.client.1.smithi133.stdout:9/775: creat d0/f100 x:0 0 0 2024-02-15T18:27:18.293 INFO:tasks.workunit.client.1.smithi133.stdout:4/734: rename d2/d5/d2b/d21/da2/le1 to d2/d5/d2b/dd2/le4 0 2024-02-15T18:27:18.294 INFO:tasks.workunit.client.1.smithi133.stdout:4/735: mknod d2/d5/ce5 0 2024-02-15T18:27:18.297 INFO:tasks.workunit.client.1.smithi133.stdout:4/736: write d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f90 [5859638,130319] 0 2024-02-15T18:27:18.300 INFO:tasks.workunit.client.1.smithi133.stdout:4/737: mkdir d2/d5/d2b/d21/d2d/d44/d51/d95/de6 0 2024-02-15T18:27:18.300 INFO:tasks.workunit.client.1.smithi133.stdout:4/738: chown d2/d5/d2b/d21/d2d/d4f/d87/d92/la8 1361 1 2024-02-15T18:27:18.300 INFO:tasks.workunit.client.1.smithi133.stdout:4/739: symlink d2/d5/le7 0 2024-02-15T18:27:18.301 INFO:tasks.workunit.client.1.smithi133.stdout:4/740: rmdir d2/d5/d2b/dd2/dda 0 2024-02-15T18:27:18.304 INFO:tasks.workunit.client.1.smithi133.stdout:2/901: dwrite d7/d2c/d5a/d66/d70/fbb [0,4194304] 0 2024-02-15T18:27:18.304 INFO:tasks.workunit.client.1.smithi133.stdout:2/902: fdatasync d7/d18/d32/d65/d58/ff3 0 2024-02-15T18:27:18.304 INFO:tasks.workunit.client.1.smithi133.stdout:2/903: chown d7/d2c/d31/lb8 356659396 1 2024-02-15T18:27:18.308 INFO:tasks.workunit.client.1.smithi133.stdout:2/904: write d7/d2c/d31/fbf [1486483,93932] 0 2024-02-15T18:27:18.313 INFO:tasks.workunit.client.1.smithi133.stdout:2/905: rename d7/d2c/d31/c36 to d7/db/d67/c120 0 2024-02-15T18:27:18.313 INFO:tasks.workunit.client.1.smithi133.stdout:2/906: creat d7/d18/d32/d65/d58/f121 x:0 0 0 2024-02-15T18:27:18.316 INFO:tasks.workunit.client.1.smithi133.stdout:7/794: dwrite d9/f2a [0,4194304] 0 2024-02-15T18:27:18.317 INFO:tasks.workunit.client.1.smithi133.stdout:3/972: dwrite d0/d15/d2f/d5e/f76 [0,4194304] 0 2024-02-15T18:27:18.321 INFO:tasks.workunit.client.1.smithi133.stdout:3/973: rename d0/d15/d2f/db4/df2 to d0/d15/d2f/d9b/dec/d136 0 2024-02-15T18:27:18.321 INFO:tasks.workunit.client.1.smithi133.stdout:3/974: readlink d0/d15/d37/d4a/dc4/d107/l115 0 2024-02-15T18:27:18.321 INFO:tasks.workunit.client.1.smithi133.stdout:3/975: symlink d0/d15/d37/d95/dc2/l137 0 2024-02-15T18:27:18.324 INFO:tasks.workunit.client.1.smithi133.stdout:3/976: link d0/d15/d37/d4a/de2/ff1 d0/d15/d37/d95/f138 0 2024-02-15T18:27:18.328 INFO:tasks.workunit.client.1.smithi133.stdout:7/795: dread d9/d36/d39/f52 [0,4194304] 0 2024-02-15T18:27:18.328 INFO:tasks.workunit.client.1.smithi133.stdout:7/796: fsync d9/d36/d31/dc1/dcd/dde/f35 0 2024-02-15T18:27:18.328 INFO:tasks.workunit.client.1.smithi133.stdout:7/797: readlink d9/db/lcb 0 2024-02-15T18:27:18.328 INFO:tasks.workunit.client.1.smithi133.stdout:4/741: dwrite d2/d5/d2b/d21/d3b/d49/d98/fb0 [0,4194304] 0 2024-02-15T18:27:18.328 INFO:tasks.workunit.client.1.smithi133.stdout:9/776: dwrite d0/d8/d9/d12/f64 [0,4194304] 0 2024-02-15T18:27:18.328 INFO:tasks.workunit.client.1.smithi133.stdout:9/777: chown d0/d8/d9/d12/d82/d42/d44/de1 110466 1 2024-02-15T18:27:18.332 INFO:tasks.workunit.client.1.smithi133.stdout:4/742: mknod d2/d5/d2b/d21/d3b/d49/d98/ddc/ce8 0 2024-02-15T18:27:18.335 INFO:tasks.workunit.client.1.smithi133.stdout:9/778: mknod d0/d8/d9/d49/c101 0 2024-02-15T18:27:18.335 INFO:tasks.workunit.client.1.smithi133.stdout:9/779: write d0/fcc [8691718,17437] 0 2024-02-15T18:27:18.339 INFO:tasks.workunit.client.1.smithi133.stdout:9/780: unlink d0/d8/d9/d12/l96 0 2024-02-15T18:27:18.340 INFO:tasks.workunit.client.1.smithi133.stdout:3/977: dread d0/d15/d54/ddc/fb1 [0,4194304] 0 2024-02-15T18:27:18.342 INFO:tasks.workunit.client.1.smithi133.stdout:7/798: dread d9/db/d16/d4f/fdf [0,4194304] 0 2024-02-15T18:27:18.343 INFO:tasks.workunit.client.1.smithi133.stdout:7/799: dread - d9/d36/d3d/d4c/d97/de4/fe1 zero size 2024-02-15T18:27:18.343 INFO:tasks.workunit.client.1.smithi133.stdout:3/978: truncate d0/d15/d2f/d9b/d39/fd6 979284 0 2024-02-15T18:27:18.343 INFO:tasks.workunit.client.1.smithi133.stdout:9/781: rmdir d0/d7b 39 2024-02-15T18:27:18.344 INFO:tasks.workunit.client.1.smithi133.stdout:3/979: symlink d0/d15/d2f/db4/l139 0 2024-02-15T18:27:18.346 INFO:tasks.workunit.client.1.smithi133.stdout:9/782: creat d0/d37/df7/f102 x:0 0 0 2024-02-15T18:27:18.348 INFO:tasks.workunit.client.1.smithi133.stdout:9/783: mkdir d0/d8/d9/d12/d4f/d103 0 2024-02-15T18:27:18.348 INFO:tasks.workunit.client.1.smithi133.stdout:9/784: chown d0/d8/d9/d12/d82/d42/f6a 7987646 1 2024-02-15T18:27:18.348 INFO:tasks.workunit.client.1.smithi133.stdout:9/785: dread - d0/d8/d9/fcd zero size 2024-02-15T18:27:18.350 INFO:tasks.workunit.client.1.smithi133.stdout:9/786: rename d0/d8/d9/d12/d82/d42/cd9 to d0/d8/d9/d49/c104 0 2024-02-15T18:27:18.353 INFO:tasks.workunit.client.1.smithi133.stdout:7/800: write d9/db/d16/f4b [431634,2970] 0 2024-02-15T18:27:18.353 INFO:tasks.workunit.client.1.smithi133.stdout:7/801: truncate d9/d36/d31/dc1/dcd/dde/d84/fb8 314242 0 2024-02-15T18:27:18.356 INFO:tasks.workunit.client.1.smithi133.stdout:4/743: dwrite d2/d48/d5c/fe0 [0,4194304] 0 2024-02-15T18:27:18.369 INFO:tasks.workunit.client.1.smithi133.stdout:4/744: truncate d2/d5/d2b/d21/da2/f6c 5843875 0 2024-02-15T18:27:18.386 INFO:tasks.workunit.client.1.smithi133.stdout:3/980: dwrite d0/d15/d37/f4b [4194304,4194304] 0 2024-02-15T18:27:18.386 INFO:tasks.workunit.client.1.smithi133.stdout:3/981: chown d0/d15/d37/d7b/l8c 23 1 2024-02-15T18:27:18.387 INFO:tasks.workunit.client.1.smithi133.stdout:3/982: stat d0/d15/d37/c73 0 2024-02-15T18:27:18.387 INFO:tasks.workunit.client.1.smithi133.stdout:3/983: chown d0/d15/d2f/d9b/d39/dcd/c12c 230943 1 2024-02-15T18:27:18.390 INFO:tasks.workunit.client.1.smithi133.stdout:3/984: rename d0/d15/d37/d4a/f101 to d0/d15/d2f/d9b/d39/f13a 0 2024-02-15T18:27:18.394 INFO:tasks.workunit.client.1.smithi133.stdout:7/802: dwrite d9/d36/d39/dd0/f66 [0,4194304] 0 2024-02-15T18:27:18.396 INFO:tasks.workunit.client.1.smithi133.stdout:3/985: symlink d0/d15/d2f/d9b/d39/dcd/de0/l13b 0 2024-02-15T18:27:18.396 INFO:tasks.workunit.client.1.smithi133.stdout:3/986: write d0/d15/d2f/d9b/f43 [5162673,14714] 0 2024-02-15T18:27:18.396 INFO:tasks.workunit.client.1.smithi133.stdout:9/787: dwrite d0/d8/d9/d12/d7f/d8f/fee [4194304,4194304] 0 2024-02-15T18:27:18.398 INFO:tasks.workunit.client.1.smithi133.stdout:4/745: dwrite d2/d5/d2b/d21/d3b/d49/d98/fb0 [0,4194304] 0 2024-02-15T18:27:18.398 INFO:tasks.workunit.client.1.smithi133.stdout:4/746: chown d2/d5/d2b/f5b 3 1 2024-02-15T18:27:18.400 INFO:tasks.workunit.client.1.smithi133.stdout:7/803: symlink d9/d36/d39/d98/l105 0 2024-02-15T18:27:18.402 INFO:tasks.workunit.client.1.smithi133.stdout:3/987: creat d0/d15/d2f/d9b/d72/f13c x:0 0 0 2024-02-15T18:27:18.405 INFO:tasks.workunit.client.1.smithi133.stdout:9/788: rename d0/d37/l38 to d0/d8/d9/d49/d4c/l105 0 2024-02-15T18:27:18.406 INFO:tasks.workunit.client.1.smithi133.stdout:7/804: creat d9/da/ddb/f106 x:0 0 0 2024-02-15T18:27:18.406 INFO:tasks.workunit.client.1.smithi133.stdout:7/805: fdatasync d9/db/d16/d4f/fdf 0 2024-02-15T18:27:18.406 INFO:tasks.workunit.client.1.smithi133.stdout:7/806: chown d9/d19/c20 7853 1 2024-02-15T18:27:18.406 INFO:tasks.workunit.client.1.smithi133.stdout:7/807: fdatasync d9/d36/f32 0 2024-02-15T18:27:18.406 INFO:tasks.workunit.client.1.smithi133.stdout:7/808: chown d9/d36/d3d/d4c/d97 0 1 2024-02-15T18:27:18.406 INFO:tasks.workunit.client.1.smithi133.stdout:7/809: readlink d9/d36/d39/dd0/lbf 0 2024-02-15T18:27:18.410 INFO:tasks.workunit.client.1.smithi133.stdout:4/747: dread d2/d5/d2b/f5b [4194304,4194304] 0 2024-02-15T18:27:18.413 INFO:tasks.workunit.client.1.smithi133.stdout:3/988: mknod d0/d15/d2f/d9b/dec/d136/c13d 0 2024-02-15T18:27:18.413 INFO:tasks.workunit.client.1.smithi133.stdout:9/789: rename d0/d8/d10/f36 to d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/f106 0 2024-02-15T18:27:18.413 INFO:tasks.workunit.client.1.smithi133.stdout:9/790: write d0/d7b/db7/ffe [831600,6977] 0 2024-02-15T18:27:18.414 INFO:tasks.workunit.client.1.smithi133.stdout:7/810: link d9/db/d16/d5d/d68/d73/lc3 d9/d36/l107 0 2024-02-15T18:27:18.415 INFO:tasks.workunit.client.1.smithi133.stdout:4/748: stat d2/d5/d2b/d21/d2d/d44/da4/cae 0 2024-02-15T18:27:18.422 INFO:tasks.workunit.client.1.smithi133.stdout:9/791: link d0/d8/d9/d12/d82/d42/d79/fb0 d0/d8/d9/d12/d7f/f107 0 2024-02-15T18:27:18.422 INFO:tasks.workunit.client.1.smithi133.stdout:4/749: mknod d2/d48/d5c/db7/dd4/ce9 0 2024-02-15T18:27:18.422 INFO:tasks.workunit.client.1.smithi133.stdout:9/792: read - d0/d8/d9/d12/d82/d42/d79/fb0 zero size 2024-02-15T18:27:18.422 INFO:tasks.workunit.client.1.smithi133.stdout:9/793: truncate d0/d8/d9/d49/d4c/f7d 992418 0 2024-02-15T18:27:18.423 INFO:tasks.workunit.client.1.smithi133.stdout:4/750: creat d2/d48/d5c/db7/dd4/fea x:0 0 0 2024-02-15T18:27:18.424 INFO:tasks.workunit.client.1.smithi133.stdout:9/794: mknod d0/d8/d9/d12/d4f/d103/c108 0 2024-02-15T18:27:18.429 INFO:tasks.workunit.client.1.smithi133.stdout:4/751: dread d2/d5/d2b/d21/d2d/d44/f46 [0,4194304] 0 2024-02-15T18:27:18.431 INFO:tasks.workunit.client.1.smithi133.stdout:4/752: creat d2/d48/d5c/d93/d8d/d96/feb x:0 0 0 2024-02-15T18:27:18.432 INFO:tasks.workunit.client.1.smithi133.stdout:4/753: mkdir d2/d5/d2b/d21/d2d/d44/da4/dd6/dec 0 2024-02-15T18:27:18.433 INFO:tasks.workunit.client.1.smithi133.stdout:7/811: dwrite d9/db/f4a [0,4194304] 0 2024-02-15T18:27:18.434 INFO:tasks.workunit.client.1.smithi133.stdout:4/754: symlink d2/d5/d2b/dd2/led 0 2024-02-15T18:27:18.446 INFO:tasks.workunit.client.1.smithi133.stdout:4/755: dread d2/fbe [0,4194304] 0 2024-02-15T18:27:18.447 INFO:tasks.workunit.client.1.smithi133.stdout:4/756: mkdir d2/d5/d2b/d21/d2d/d44/dee 0 2024-02-15T18:27:18.449 INFO:tasks.workunit.client.1.smithi133.stdout:7/812: dread d9/da/f3b [0,4194304] 0 2024-02-15T18:27:18.456 INFO:tasks.workunit.client.1.smithi133.stdout:3/989: dwrite d0/d15/d2f/d9b/f9a [0,4194304] 0 2024-02-15T18:27:18.457 INFO:tasks.workunit.client.1.smithi133.stdout:9/795: dwrite d0/d8/d9/d12/d4f/ffd [0,4194304] 0 2024-02-15T18:27:18.457 INFO:tasks.workunit.client.1.smithi133.stdout:9/796: write d0/d8/d9/d49/d4c/f7d [1538932,14087] 0 2024-02-15T18:27:18.462 INFO:tasks.workunit.client.1.smithi133.stdout:3/990: mkdir d0/d15/d2f/d9b/d72/d13e 0 2024-02-15T18:27:18.462 INFO:tasks.workunit.client.1.smithi133.stdout:3/991: write d0/d15/d37/d4a/dc4/d107/f11b [350830,111725] 0 2024-02-15T18:27:18.464 INFO:tasks.workunit.client.1.smithi133.stdout:9/797: creat d0/d8/d9/d12/d82/d42/d44/de1/f109 x:0 0 0 2024-02-15T18:27:18.468 INFO:tasks.workunit.client.1.smithi133.stdout:4/757: dwrite d2/d5/d2b/d21/d2d/d44/d51/f9c [0,4194304] 0 2024-02-15T18:27:18.473 INFO:tasks.workunit.client.1.smithi133.stdout:7/813: dwrite d9/db/d16/d5d/d68/da2/fdd [0,4194304] 0 2024-02-15T18:27:18.473 INFO:tasks.workunit.client.1.smithi133.stdout:7/814: dread - d9/d36/d31/dc1/dcd/dde/d84/fee zero size 2024-02-15T18:27:18.482 INFO:tasks.workunit.client.1.smithi133.stdout:3/992: dread d0/d15/d2f/d9b/f43 [0,4194304] 0 2024-02-15T18:27:18.497 INFO:tasks.workunit.client.1.smithi133.stdout:3/993: dread d0/d15/d2f/d9b/d39/d3f/dc1/d78/fcc [0,4194304] 0 2024-02-15T18:27:18.497 INFO:tasks.workunit.client.1.smithi133.stdout:3/994: readlink d0/d15/d37/d4a/l11c 0 2024-02-15T18:27:18.499 INFO:tasks.workunit.client.1.smithi133.stdout:3/995: unlink d0/d15/d2f/db4/d89/l113 0 2024-02-15T18:27:18.499 INFO:tasks.workunit.client.1.smithi133.stdout:3/996: write d0/d15/d2f/db4/d89/fc3 [283423,60162] 0 2024-02-15T18:27:18.499 INFO:tasks.workunit.client.1.smithi133.stdout:3/997: dread - d0/d15/d2f/d9b/fe5 zero size 2024-02-15T18:27:18.499 INFO:tasks.workunit.client.1.smithi133.stdout:3/998: chown d0/d15/d2f/d9b/d9d/la0 1693154708 1 2024-02-15T18:27:18.500 INFO:tasks.workunit.client.1.smithi133.stdout:3/999: mknod d0/d15/d37/d7b/c13f 0 2024-02-15T18:27:18.500 INFO:tasks.workunit.client.1.smithi133.stdout:4/758: dwrite d2/f2a [0,4194304] 0 2024-02-15T18:27:18.502 INFO:tasks.workunit.client.1.smithi133.stdout:7/815: dwrite d9/d36/d3d/fe6 [0,4194304] 0 2024-02-15T18:27:18.502 INFO:tasks.workunit.client.1.smithi133.stdout:9/798: dwrite d0/d8/d9/d12/f3f [0,4194304] 0 2024-02-15T18:27:18.503 INFO:tasks.workunit.client.1.smithi133.stdout:4/759: link d2/d48/d6a/d9e/fad d2/d5/d2b/d21/fef 0 2024-02-15T18:27:18.503 INFO:tasks.workunit.client.1.smithi133.stdout:4/760: chown d2/d5/d2b/d21/d3b/d49/c94 3 1 2024-02-15T18:27:18.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:16.688264+0000 mgr.smithi084.hjmnez (mgr.14596) 30 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 3.3 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 175 MiB/s rd, 360 MiB/s wr, 549 op/s 2024-02-15T18:27:18.512 INFO:tasks.workunit.client.1.smithi133.stdout:9/799: truncate d0/d8/d10/f30 447229 0 2024-02-15T18:27:18.514 INFO:tasks.workunit.client.1.smithi133.stdout:4/761: mkdir d2/d48/d6a/df0 0 2024-02-15T18:27:18.514 INFO:tasks.workunit.client.1.smithi133.stdout:9/800: symlink d0/d8/d9/d12/l10a 0 2024-02-15T18:27:18.518 INFO:tasks.workunit.client.1.smithi133.stdout:9/801: creat d0/d8/d9/d12/d82/d42/d79/f10b x:0 0 0 2024-02-15T18:27:18.518 INFO:tasks.workunit.client.1.smithi133.stdout:9/802: write d0/d7b/fd0 [42938,24330] 0 2024-02-15T18:27:18.519 INFO:tasks.workunit.client.1.smithi133.stdout:4/762: truncate d2/d5/d2b/d21/da2/d5e/f73 368557 0 2024-02-15T18:27:18.519 INFO:tasks.workunit.client.1.smithi133.stdout:4/763: chown d2/d5/d2b/d21/da2/f6c 1406 1 2024-02-15T18:27:18.521 INFO:tasks.workunit.client.1.smithi133.stdout:9/803: mkdir d0/d8/d9/d12/d4f/d10c 0 2024-02-15T18:27:18.521 INFO:tasks.workunit.client.1.smithi133.stdout:5/807: sync 2024-02-15T18:27:18.521 INFO:tasks.workunit.client.1.smithi133.stdout:8/787: sync 2024-02-15T18:27:18.521 INFO:tasks.workunit.client.1.smithi133.stdout:2/907: sync 2024-02-15T18:27:18.522 INFO:tasks.workunit.client.1.smithi133.stdout:0/999: sync 2024-02-15T18:27:18.522 INFO:tasks.workunit.client.1.smithi133.stdout:9/804: creat d0/d8/d9/d49/d4c/f10d x:0 0 0 2024-02-15T18:27:18.523 INFO:tasks.workunit.client.1.smithi133.stdout:4/764: dread d2/d5/d2b/f5b [4194304,4194304] 0 2024-02-15T18:27:18.523 INFO:tasks.workunit.client.1.smithi133.stdout:5/808: creat d17/d20/d4f/d5f/d106/f107 x:0 0 0 2024-02-15T18:27:18.524 INFO:tasks.workunit.client.1.smithi133.stdout:2/908: rmdir d7/db/d67 39 2024-02-15T18:27:18.524 INFO:tasks.workunit.client.1.smithi133.stdout:2/909: stat d7/d2c/d5a/d66/d70/fba 0 2024-02-15T18:27:18.526 INFO:tasks.workunit.client.1.smithi133.stdout:8/788: symlink d3/d7/d40/d61/dc8/d102/l10d 0 2024-02-15T18:27:18.530 INFO:tasks.workunit.client.1.smithi133.stdout:9/805: symlink d0/d8/d9/d49/dd4/l10e 0 2024-02-15T18:27:18.531 INFO:tasks.workunit.client.1.smithi133.stdout:4/765: creat d2/d5/d2b/d21/d2d/d44/dee/ff1 x:0 0 0 2024-02-15T18:27:18.531 INFO:tasks.workunit.client.1.smithi133.stdout:4/766: dread - d2/d5/d2b/dd2/fe3 zero size 2024-02-15T18:27:18.532 INFO:tasks.workunit.client.1.smithi133.stdout:5/809: link d17/f62 d17/d20/d32/d7d/f108 0 2024-02-15T18:27:18.532 INFO:tasks.workunit.client.1.smithi133.stdout:5/810: stat d17/d20/d32/d9d/l100 0 2024-02-15T18:27:18.533 INFO:tasks.workunit.client.1.smithi133.stdout:5/811: stat d17/d20/d4f/d5f 0 2024-02-15T18:27:18.533 INFO:tasks.workunit.client.1.smithi133.stdout:2/910: rmdir d7/d18/d32/d65/d99/dfb 39 2024-02-15T18:27:18.534 INFO:tasks.workunit.client.1.smithi133.stdout:8/789: symlink d3/d1c/d37/df0/l10e 0 2024-02-15T18:27:18.534 INFO:tasks.workunit.client.1.smithi133.stdout:8/790: write d3/d1c/d2f/d87/fbf [976995,80605] 0 2024-02-15T18:27:18.535 INFO:tasks.workunit.client.1.smithi133.stdout:4/767: mknod d2/d5/d2b/d21/da2/d5e/dd1/ddb/cf2 0 2024-02-15T18:27:18.535 INFO:tasks.workunit.client.1.smithi133.stdout:5/812: rmdir d17/d20/d32/d38/d86/db6 39 2024-02-15T18:27:18.536 INFO:tasks.workunit.client.1.smithi133.stdout:8/791: write d3/d1c/d2f/ff3 [2340211,120373] 0 2024-02-15T18:27:18.539 INFO:tasks.workunit.client.1.smithi133.stdout:2/911: symlink d7/db/d67/d7b/l122 0 2024-02-15T18:27:18.540 INFO:tasks.workunit.client.1.smithi133.stdout:2/912: fsync d7/d2c/d5a/d66/da5/ffa 0 2024-02-15T18:27:18.540 INFO:tasks.workunit.client.1.smithi133.stdout:2/913: chown d7/d2c/d3b/d48/f9f 20700671 1 2024-02-15T18:27:18.540 INFO:tasks.workunit.client.1.smithi133.stdout:2/914: readlink d7/d18/l1a 0 2024-02-15T18:27:18.540 INFO:tasks.workunit.client.1.smithi133.stdout:2/915: readlink d7/d18/d32/l63 0 2024-02-15T18:27:18.540 INFO:tasks.workunit.client.1.smithi133.stdout:5/813: symlink d17/d20/d4f/d5f/d93/l109 0 2024-02-15T18:27:18.543 INFO:tasks.workunit.client.1.smithi133.stdout:2/916: mknod d7/db/c123 0 2024-02-15T18:27:18.544 INFO:tasks.workunit.client.1.smithi133.stdout:4/768: dread d2/d48/d5c/fe0 [0,4194304] 0 2024-02-15T18:27:18.544 INFO:tasks.workunit.client.1.smithi133.stdout:2/917: write d7/d18/d32/d65/d54/f6c [4060608,73967] 0 2024-02-15T18:27:18.545 INFO:tasks.workunit.client.1.smithi133.stdout:4/769: symlink d2/d5/d2b/d21/d2d/d4f/d87/lf3 0 2024-02-15T18:27:18.549 INFO:tasks.workunit.client.1.smithi133.stdout:4/770: truncate d2/d5/d2b/d21/d2d/fb3 302799 0 2024-02-15T18:27:18.551 INFO:tasks.workunit.client.1.smithi133.stdout:4/771: rename d2/d5/d2b/d21/d2d/d44/d51/l7e to d2/d5/d2b/d21/d3b/d49/d98/lf4 0 2024-02-15T18:27:18.551 INFO:tasks.workunit.client.1.smithi133.stdout:4/772: dread - d2/d48/d5c/d93/d8d/f91 zero size 2024-02-15T18:27:18.552 INFO:tasks.workunit.client.1.smithi133.stdout:4/773: creat d2/d5/d2b/d21/da2/ff5 x:0 0 0 2024-02-15T18:27:18.554 INFO:tasks.workunit.client.1.smithi133.stdout:4/774: getdents d2/d5/d2b 0 2024-02-15T18:27:18.555 INFO:tasks.workunit.client.1.smithi133.stdout:2/918: dread d7/db/d67/da7/f103 [0,4194304] 0 2024-02-15T18:27:18.558 INFO:tasks.workunit.client.1.smithi133.stdout:2/919: rename d7/f16 to d7/d18/d32/d65/d54/dde/f124 0 2024-02-15T18:27:18.560 INFO:tasks.workunit.client.1.smithi133.stdout:2/920: symlink d7/d18/d32/d65/l125 0 2024-02-15T18:27:18.561 INFO:tasks.workunit.client.1.smithi133.stdout:2/921: mkdir d7/db/df6/d126 0 2024-02-15T18:27:18.563 INFO:tasks.workunit.client.1.smithi133.stdout:2/922: creat d7/d18/d32/d65/d54/dc9/de7/dd9/f127 x:0 0 0 2024-02-15T18:27:18.586 INFO:tasks.workunit.client.1.smithi133.stdout:2/923: dwrite d7/d2c/d46/f11d [0,4194304] 0 2024-02-15T18:27:18.587 INFO:tasks.workunit.client.1.smithi133.stdout:2/924: truncate d7/d2c/d3b/d48/d59/fcf 3494720 0 2024-02-15T18:27:18.588 INFO:tasks.workunit.client.1.smithi133.stdout:2/925: rename d7/d18/l1a to d7/db/d67/l128 0 2024-02-15T18:27:18.590 INFO:tasks.workunit.client.1.smithi133.stdout:2/926: rmdir d7/d2c/d3b/d48/d115 0 2024-02-15T18:27:18.590 INFO:tasks.workunit.client.1.smithi133.stdout:2/927: fsync d7/d2c/d31/f38 0 2024-02-15T18:27:18.592 INFO:tasks.workunit.client.1.smithi133.stdout:2/928: rename d7/d2c/d3b/d48/d6d/cdb to d7/d18/d32/d65/d99/dfb/c129 0 2024-02-15T18:27:18.592 INFO:tasks.workunit.client.1.smithi133.stdout:2/929: fsync d7/d2c/d31/f6a 0 2024-02-15T18:27:18.592 INFO:tasks.workunit.client.1.smithi133.stdout:2/930: read - d7/d18/d32/d65/d54/fdd zero size 2024-02-15T18:27:18.593 INFO:tasks.workunit.client.1.smithi133.stdout:2/931: creat d7/d2c/d3b/d48/d59/f12a x:0 0 0 2024-02-15T18:27:18.593 INFO:tasks.workunit.client.1.smithi133.stdout:2/932: chown d7/d18/d32/ddc/df2 13191842 1 2024-02-15T18:27:18.594 INFO:tasks.workunit.client.1.smithi133.stdout:2/933: creat d7/d18/d32/ddc/df2/f12b x:0 0 0 2024-02-15T18:27:18.595 INFO:tasks.workunit.client.1.smithi133.stdout:2/934: creat d7/db/df6/d126/f12c x:0 0 0 2024-02-15T18:27:18.595 INFO:tasks.workunit.client.1.smithi133.stdout:2/935: rmdir d7/d18/d32/d65/d99 39 2024-02-15T18:27:18.597 INFO:tasks.workunit.client.1.smithi133.stdout:2/936: link d7/d2c/d3b/d48/d59/l7f d7/d18/d32/df1/l12d 0 2024-02-15T18:27:18.597 INFO:tasks.workunit.client.1.smithi133.stdout:2/937: readlink d7/d18/d32/d65/l4e 0 2024-02-15T18:27:18.597 INFO:tasks.workunit.client.1.smithi133.stdout:2/938: truncate d7/db/d35/fb1 33600 0 2024-02-15T18:27:18.616 INFO:tasks.workunit.client.1.smithi133.stdout:2/939: getdents d7/d2c/d3b/d48 0 2024-02-15T18:27:18.619 INFO:tasks.workunit.client.1.smithi133.stdout:2/940: truncate d7/f3c 5334592 0 2024-02-15T18:27:18.627 INFO:tasks.workunit.client.1.smithi133.stdout:2/941: dread d7/d18/d32/d65/d54/f83 [4194304,4194304] 0 2024-02-15T18:27:18.628 INFO:tasks.workunit.client.1.smithi133.stdout:2/942: rmdir d7/d18/d32/d65/d99/dfb 39 2024-02-15T18:27:18.631 INFO:tasks.workunit.client.1.smithi133.stdout:2/943: creat d7/d2c/d3b/d48/d59/f12e x:0 0 0 2024-02-15T18:27:18.631 INFO:tasks.workunit.client.1.smithi133.stdout:2/944: stat d7/d18/d32/d65/d54/dc9/de7/dd9 0 2024-02-15T18:27:18.632 INFO:tasks.workunit.client.1.smithi133.stdout:2/945: link d7/db/d67/da7/l10f d7/db/d67/d105/l12f 0 2024-02-15T18:27:18.632 INFO:tasks.workunit.client.1.smithi133.stdout:2/946: write d7/d18/fa6 [851579,124810] 0 2024-02-15T18:27:18.632 INFO:tasks.workunit.client.1.smithi133.stdout:2/947: chown d7/d18/f40 10092774 1 2024-02-15T18:27:18.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:16.688264+0000 mgr.smithi084.hjmnez (mgr.14596) 30 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 3.3 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 175 MiB/s rd, 360 MiB/s wr, 549 op/s 2024-02-15T18:27:18.647 INFO:tasks.workunit.client.1.smithi133.stdout:2/948: dwrite d7/d18/d32/d65/d58/f64 [0,4194304] 0 2024-02-15T18:27:18.647 INFO:tasks.workunit.client.1.smithi133.stdout:2/949: stat d7/db/d67/f10b 0 2024-02-15T18:27:18.648 INFO:tasks.workunit.client.1.smithi133.stdout:2/950: creat d7/db/d67/f130 x:0 0 0 2024-02-15T18:27:18.651 INFO:tasks.workunit.client.1.smithi133.stdout:2/951: unlink d7/d18/f6f 0 2024-02-15T18:27:18.651 INFO:tasks.workunit.client.1.smithi133.stdout:2/952: read - d7/d2c/d3b/d48/d6d/f8b zero size 2024-02-15T18:27:18.651 INFO:tasks.workunit.client.1.smithi133.stdout:2/953: write d7/d18/d32/d65/d54/fdd [455131,125704] 0 2024-02-15T18:27:18.652 INFO:tasks.workunit.client.1.smithi133.stdout:2/954: dread - d7/db/d67/da7/fc6 zero size 2024-02-15T18:27:18.656 INFO:tasks.workunit.client.1.smithi133.stdout:2/955: read d7/d2c/d3b/d48/d6d/ff5 [890354,67417] 0 2024-02-15T18:27:18.657 INFO:tasks.workunit.client.1.smithi133.stdout:2/956: mknod d7/d118/c131 0 2024-02-15T18:27:18.657 INFO:tasks.workunit.client.1.smithi133.stdout:2/957: truncate d7/db/f101 875380 0 2024-02-15T18:27:18.657 INFO:tasks.workunit.client.1.smithi133.stdout:2/958: truncate d7/d2c/dd5/f109 516799 0 2024-02-15T18:27:18.672 INFO:tasks.workunit.client.1.smithi133.stdout:2/959: dread d7/d18/d32/d65/d54/dde/f124 [0,4194304] 0 2024-02-15T18:27:18.673 INFO:tasks.workunit.client.1.smithi133.stdout:2/960: getdents d7/d18/d32/d65/d99 0 2024-02-15T18:27:18.692 INFO:tasks.workunit.client.1.smithi133.stdout:2/961: dwrite d7/d18/d32/d65/d54/fdd [0,4194304] 0 2024-02-15T18:27:18.711 INFO:tasks.workunit.client.1.smithi133.stdout:2/962: link d7/d2c/d46/feb d7/d2c/d3b/d48/d6d/f132 0 2024-02-15T18:27:18.721 INFO:tasks.workunit.client.1.smithi133.stdout:2/963: mknod d7/d2c/c133 0 2024-02-15T18:27:18.721 INFO:tasks.workunit.client.1.smithi133.stdout:2/964: readlink d7/d18/d32/d65/l125 0 2024-02-15T18:27:18.725 INFO:tasks.workunit.client.1.smithi133.stdout:2/965: getdents d7/d2c 0 2024-02-15T18:27:18.725 INFO:tasks.workunit.client.1.smithi133.stdout:2/966: dread - d7/d2c/d5a/d66/da5/fff zero size 2024-02-15T18:27:18.725 INFO:tasks.workunit.client.1.smithi133.stdout:2/967: chown d7/d18/d32/d65/d99/la2 792 1 2024-02-15T18:27:18.745 INFO:tasks.workunit.client.1.smithi133.stdout:2/968: dwrite d7/d2c/fa4 [0,4194304] 0 2024-02-15T18:27:18.747 INFO:tasks.workunit.client.1.smithi133.stdout:2/969: write d7/d2c/dd5/f10e [579184,95765] 0 2024-02-15T18:27:18.748 INFO:tasks.workunit.client.1.smithi133.stdout:2/970: creat d7/d18/d32/d65/d99/f134 x:0 0 0 2024-02-15T18:27:18.749 INFO:tasks.workunit.client.1.smithi133.stdout:2/971: getdents d7/d118 0 2024-02-15T18:27:18.750 INFO:tasks.workunit.client.1.smithi133.stdout:2/972: creat d7/d2c/d46/f135 x:0 0 0 2024-02-15T18:27:18.750 INFO:tasks.workunit.client.1.smithi133.stdout:2/973: getdents d7/db/d67/da7 0 2024-02-15T18:27:18.752 INFO:tasks.workunit.client.1.smithi133.stdout:2/974: unlink d7/d2c/f49 0 2024-02-15T18:27:18.752 INFO:tasks.workunit.client.1.smithi133.stdout:2/975: write d7/d2c/d46/f72 [4516119,37985] 0 2024-02-15T18:27:18.752 INFO:tasks.workunit.client.1.smithi133.stdout:2/976: read d7/d2c/d31/f6a [912214,1598] 0 2024-02-15T18:27:18.851 INFO:tasks.workunit.client.1.smithi133.stdout:8/792: sync 2024-02-15T18:27:18.851 INFO:tasks.workunit.client.1.smithi133.stdout:9/806: sync 2024-02-15T18:27:18.851 INFO:tasks.workunit.client.1.smithi133.stdout:4/775: sync 2024-02-15T18:27:18.851 INFO:tasks.workunit.client.1.smithi133.stdout:7/816: sync 2024-02-15T18:27:18.851 INFO:tasks.workunit.client.1.smithi133.stdout:8/793: chown d3/d1f/d4f/c109 46363350 1 2024-02-15T18:27:18.852 INFO:tasks.workunit.client.1.smithi133.stdout:4/776: write d2/d5/d2b/d21/fb9 [270397,3059] 0 2024-02-15T18:27:18.852 INFO:tasks.workunit.client.1.smithi133.stdout:5/814: sync 2024-02-15T18:27:18.853 INFO:tasks.workunit.client.1.smithi133.stdout:9/807: unlink d0/d8/d9/d12/c32 0 2024-02-15T18:27:18.854 INFO:tasks.workunit.client.1.smithi133.stdout:7/817: creat d9/d36/f108 x:0 0 0 2024-02-15T18:27:18.854 INFO:tasks.workunit.client.1.smithi133.stdout:4/777: mkdir d2/d48/d5c/d9f/df6 0 2024-02-15T18:27:18.854 INFO:tasks.workunit.client.1.smithi133.stdout:5/815: creat d17/d20/d32/d9d/da9/de6/f10a x:0 0 0 2024-02-15T18:27:18.854 INFO:tasks.workunit.client.1.smithi133.stdout:4/778: fsync d2/d48/d5c/d93/d8d/f91 0 2024-02-15T18:27:18.855 INFO:tasks.workunit.client.1.smithi133.stdout:9/808: rename d0/d8/d10/d4d/dc6/fc8 to d0/d8/d9/d12/d82/d42/d79/d90/de8/f10f 0 2024-02-15T18:27:18.855 INFO:tasks.workunit.client.1.smithi133.stdout:9/809: stat d0/d8/fd 0 2024-02-15T18:27:18.856 INFO:tasks.workunit.client.1.smithi133.stdout:7/818: truncate d9/d36/d3d/d4c/f61 2747669 0 2024-02-15T18:27:18.858 INFO:tasks.workunit.client.1.smithi133.stdout:5/816: unlink d17/d20/dc3/lcc 0 2024-02-15T18:27:18.858 INFO:tasks.workunit.client.1.smithi133.stdout:5/817: dread - d17/f7a zero size 2024-02-15T18:27:18.859 INFO:tasks.workunit.client.1.smithi133.stdout:9/810: truncate d0/d8/d9/d12/f1b 3849298 0 2024-02-15T18:27:18.860 INFO:tasks.workunit.client.1.smithi133.stdout:9/811: write d0/d8/d9/d12/d82/d42/d44/fb6 [2610386,100151] 0 2024-02-15T18:27:18.861 INFO:tasks.workunit.client.1.smithi133.stdout:7/819: creat d9/db/d16/d5d/d68/d8a/f109 x:0 0 0 2024-02-15T18:27:18.861 INFO:tasks.workunit.client.1.smithi133.stdout:7/820: fdatasync d9/d36/d31/dc1/dcd/dde/d84/fb8 0 2024-02-15T18:27:18.865 INFO:tasks.workunit.client.1.smithi133.stdout:9/812: creat d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/f110 x:0 0 0 2024-02-15T18:27:18.865 INFO:tasks.workunit.client.1.smithi133.stdout:7/821: rename d9/d36/d31/dc1/dcd/dde/l44 to d9/da/d48/d62/l10a 0 2024-02-15T18:27:18.865 INFO:tasks.workunit.client.1.smithi133.stdout:7/822: write d9/d36/d39/d98/fac [386277,44461] 0 2024-02-15T18:27:18.866 INFO:tasks.workunit.client.1.smithi133.stdout:9/813: read d0/d8/f47 [367816,39424] 0 2024-02-15T18:27:18.866 INFO:tasks.workunit.client.1.smithi133.stdout:9/814: chown d0/d8/d9/d12/db8 0 1 2024-02-15T18:27:18.867 INFO:tasks.workunit.client.1.smithi133.stdout:8/794: dwrite d3/de/fd6 [0,4194304] 0 2024-02-15T18:27:18.868 INFO:tasks.workunit.client.1.smithi133.stdout:7/823: creat d9/db/d16/d5d/d68/da2/dd8/f10b x:0 0 0 2024-02-15T18:27:18.868 INFO:tasks.workunit.client.1.smithi133.stdout:9/815: dread d0/d7b/fd0 [0,4194304] 0 2024-02-15T18:27:18.870 INFO:tasks.workunit.client.1.smithi133.stdout:8/795: mknod d3/d7/d40/d61/dc8/d102/c10f 0 2024-02-15T18:27:18.871 INFO:tasks.workunit.client.1.smithi133.stdout:7/824: mknod d9/db/d16/d5d/d68/d73/d9c/c10c 0 2024-02-15T18:27:18.873 INFO:tasks.workunit.client.1.smithi133.stdout:9/816: rmdir d0/d8/d10/d4d/d92 39 2024-02-15T18:27:18.875 INFO:tasks.workunit.client.1.smithi133.stdout:5/818: dwrite d17/d20/d32/d38/d70/faf [0,4194304] 0 2024-02-15T18:27:18.875 INFO:tasks.workunit.client.1.smithi133.stdout:9/817: write d0/f5 [1342038,55899] 0 2024-02-15T18:27:18.875 INFO:tasks.workunit.client.1.smithi133.stdout:8/796: truncate d3/d92/fbd 3331756 0 2024-02-15T18:27:18.879 INFO:tasks.workunit.client.1.smithi133.stdout:7/825: mkdir d9/db/d16/d10d 0 2024-02-15T18:27:18.879 INFO:tasks.workunit.client.1.smithi133.stdout:7/826: truncate d9/db/d16/f4b 2741942 0 2024-02-15T18:27:18.883 INFO:tasks.workunit.client.1.smithi133.stdout:5/819: link d17/d26/c66 d17/d20/d4f/d5f/d106/c10b 0 2024-02-15T18:27:18.884 INFO:tasks.workunit.client.1.smithi133.stdout:5/820: dread d17/d20/d32/f37 [0,4194304] 0 2024-02-15T18:27:18.884 INFO:tasks.workunit.client.1.smithi133.stdout:7/827: write d9/db/d16/f25 [2301152,117108] 0 2024-02-15T18:27:18.888 INFO:tasks.workunit.client.1.smithi133.stdout:9/818: rmdir d0/d8/d9 39 2024-02-15T18:27:18.888 INFO:tasks.workunit.client.1.smithi133.stdout:9/819: write d0/d8/d9/d12/d82/d42/d79/f10b [737587,94064] 0 2024-02-15T18:27:18.890 INFO:tasks.workunit.client.1.smithi133.stdout:8/797: creat d3/de/f110 x:0 0 0 2024-02-15T18:27:18.895 INFO:tasks.workunit.client.1.smithi133.stdout:5/821: symlink d17/d20/d32/d9d/da9/dc6/l10c 0 2024-02-15T18:27:18.896 INFO:tasks.workunit.client.1.smithi133.stdout:9/820: rmdir d0/d8/d9/d12/db8 0 2024-02-15T18:27:18.897 INFO:tasks.workunit.client.1.smithi133.stdout:4/779: dwrite d2/f23 [0,4194304] 0 2024-02-15T18:27:18.897 INFO:tasks.workunit.client.1.smithi133.stdout:4/780: fdatasync d2/d5/fa0 0 2024-02-15T18:27:18.898 INFO:tasks.workunit.client.1.smithi133.stdout:4/781: write d2/d5/d2b/d21/d3b/f66 [1404824,32228] 0 2024-02-15T18:27:18.904 INFO:tasks.workunit.client.1.smithi133.stdout:5/822: dread d17/d20/d4f/d5f/f60 [0,4194304] 0 2024-02-15T18:27:18.908 INFO:tasks.workunit.client.1.smithi133.stdout:5/823: truncate d17/f47 3654794 0 2024-02-15T18:27:18.908 INFO:tasks.workunit.client.1.smithi133.stdout:4/782: dread d2/d5/d2b/d21/d2d/f56 [0,4194304] 0 2024-02-15T18:27:18.908 INFO:tasks.workunit.client.1.smithi133.stdout:4/783: write d2/d5/d2b/d21/d2d/d44/dee/ff1 [717668,112960] 0 2024-02-15T18:27:18.909 INFO:tasks.workunit.client.1.smithi133.stdout:9/821: dread d0/d8/d9/d12/d82/f40 [0,4194304] 0 2024-02-15T18:27:18.909 INFO:tasks.workunit.client.1.smithi133.stdout:9/822: chown d0/d8/d10/d4d/dc6/le9 43859 1 2024-02-15T18:27:18.909 INFO:tasks.workunit.client.1.smithi133.stdout:9/823: fdatasync d0/d8/d9/fcd 0 2024-02-15T18:27:18.909 INFO:tasks.workunit.client.1.smithi133.stdout:5/824: symlink d17/d20/d32/d38/d103/l10d 0 2024-02-15T18:27:18.912 INFO:tasks.workunit.client.1.smithi133.stdout:7/828: dwrite d9/d36/d39/f99 [0,4194304] 0 2024-02-15T18:27:18.912 INFO:tasks.workunit.client.1.smithi133.stdout:4/784: link d2/d5/l17 d2/d5/d2b/d21/da2/d5e/d76/ddf/lf7 0 2024-02-15T18:27:18.912 INFO:tasks.workunit.client.1.smithi133.stdout:4/785: read - d2/d5/d2b/d21/d2d/d44/d51/fca zero size 2024-02-15T18:27:18.913 INFO:tasks.workunit.client.1.smithi133.stdout:5/825: mknod d17/d20/d32/d38/d86/db6/df8/c10e 0 2024-02-15T18:27:18.913 INFO:tasks.workunit.client.1.smithi133.stdout:5/826: chown d17/d26/f5d 1848039 1 2024-02-15T18:27:18.913 INFO:tasks.workunit.client.1.smithi133.stdout:5/827: chown d17/d20/d5e/l83 1876 1 2024-02-15T18:27:18.913 INFO:tasks.workunit.client.1.smithi133.stdout:4/786: mknod d2/d5/d2b/d21/d2d/d44/da4/cf8 0 2024-02-15T18:27:18.916 INFO:tasks.workunit.client.1.smithi133.stdout:5/828: rename d17/d20/d32/d7d/d7e/l80 to d17/d20/d32/d38/l10f 0 2024-02-15T18:27:18.916 INFO:tasks.workunit.client.1.smithi133.stdout:5/829: readlink d17/le8 0 2024-02-15T18:27:18.918 INFO:tasks.workunit.client.1.smithi133.stdout:5/830: creat d17/d20/d4f/f110 x:0 0 0 2024-02-15T18:27:18.918 INFO:tasks.workunit.client.1.smithi133.stdout:4/787: write d2/d5/d2b/d21/da2/f6c [5421094,108149] 0 2024-02-15T18:27:18.919 INFO:tasks.workunit.client.1.smithi133.stdout:5/831: mkdir d17/d20/d32/d9d/da9/dc6/de4/d111 0 2024-02-15T18:27:18.921 INFO:tasks.workunit.client.1.smithi133.stdout:4/788: link d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f90 d2/d5/d2b/d21/d3b/d49/d98/ff9 0 2024-02-15T18:27:18.923 INFO:tasks.workunit.client.1.smithi133.stdout:4/789: symlink d2/d5/d2b/d21/da2/lfa 0 2024-02-15T18:27:18.926 INFO:tasks.workunit.client.1.smithi133.stdout:8/798: dwrite d3/d7/f4d [4194304,4194304] 0 2024-02-15T18:27:18.928 INFO:tasks.workunit.client.1.smithi133.stdout:8/799: symlink d3/d7/d40/dec/l111 0 2024-02-15T18:27:18.930 INFO:tasks.workunit.client.1.smithi133.stdout:8/800: creat d3/d1f/dde/d108/f112 x:0 0 0 2024-02-15T18:27:18.930 INFO:tasks.workunit.client.1.smithi133.stdout:8/801: write d3/d1c/d2f/d87/d73/d84/dda/fe3 [722688,84147] 0 2024-02-15T18:27:18.933 INFO:tasks.workunit.client.1.smithi133.stdout:8/802: creat d3/de/d3e/dc4/f113 x:0 0 0 2024-02-15T18:27:18.934 INFO:tasks.workunit.client.1.smithi133.stdout:8/803: read d3/d1c/d2f/d87/fac [926933,87152] 0 2024-02-15T18:27:18.935 INFO:tasks.workunit.client.1.smithi133.stdout:8/804: chown d3/d1c/d2f/d87/fbf 923989072 1 2024-02-15T18:27:18.938 INFO:tasks.workunit.client.1.smithi133.stdout:8/805: write d3/d1c/f51 [1606798,94567] 0 2024-02-15T18:27:18.943 INFO:tasks.workunit.client.1.smithi133.stdout:8/806: mknod d3/d1c/d2f/d87/d73/d84/dd3/c114 0 2024-02-15T18:27:18.950 INFO:tasks.workunit.client.1.smithi133.stdout:5/832: dwrite ff [0,4194304] 0 2024-02-15T18:27:18.950 INFO:tasks.workunit.client.1.smithi133.stdout:7/829: dwrite d9/d36/d39/d98/fac [0,4194304] 0 2024-02-15T18:27:18.950 INFO:tasks.workunit.client.1.smithi133.stdout:7/830: write d9/d36/d3d/fd4 [564851,57625] 0 2024-02-15T18:27:18.950 INFO:tasks.workunit.client.1.smithi133.stdout:5/833: creat d17/d20/d32/d9d/da9/f112 x:0 0 0 2024-02-15T18:27:18.951 INFO:tasks.workunit.client.1.smithi133.stdout:4/790: dwrite d2/d48/d6a/f9a [0,4194304] 0 2024-02-15T18:27:18.952 INFO:tasks.workunit.client.1.smithi133.stdout:5/834: dread d17/d20/d32/f37 [0,4194304] 0 2024-02-15T18:27:18.953 INFO:tasks.workunit.client.1.smithi133.stdout:7/831: unlink d9/d36/cfe 0 2024-02-15T18:27:18.956 INFO:tasks.workunit.client.1.smithi133.stdout:5/835: creat d17/d20/d32/d9d/f113 x:0 0 0 2024-02-15T18:27:18.957 INFO:tasks.workunit.client.1.smithi133.stdout:7/832: creat d9/da/f10e x:0 0 0 2024-02-15T18:27:18.958 INFO:tasks.workunit.client.1.smithi133.stdout:5/836: creat d17/d26/f114 x:0 0 0 2024-02-15T18:27:18.969 INFO:tasks.workunit.client.1.smithi133.stdout:7/833: dread d9/db/d55/fa0 [0,4194304] 0 2024-02-15T18:27:18.970 INFO:tasks.workunit.client.1.smithi133.stdout:5/837: dread d17/d20/d32/d7d/f108 [0,4194304] 0 2024-02-15T18:27:18.970 INFO:tasks.workunit.client.1.smithi133.stdout:5/838: fdatasync d17/d20/d32/d38/dbd/ffe 0 2024-02-15T18:27:18.970 INFO:tasks.workunit.client.1.smithi133.stdout:7/834: write d9/db/d16/d5d/d68/da2/fdd [1972390,5498] 0 2024-02-15T18:27:18.971 INFO:tasks.workunit.client.1.smithi133.stdout:5/839: mknod d17/d20/d32/d38/d86/db6/c115 0 2024-02-15T18:27:18.972 INFO:tasks.workunit.client.1.smithi133.stdout:7/835: mknod d9/d36/d39/d98/c10f 0 2024-02-15T18:27:18.973 INFO:tasks.workunit.client.1.smithi133.stdout:5/840: creat d17/d26/d7b/deb/f116 x:0 0 0 2024-02-15T18:27:18.974 INFO:tasks.workunit.client.1.smithi133.stdout:7/836: rmdir d9/d36/d31 39 2024-02-15T18:27:18.975 INFO:tasks.workunit.client.1.smithi133.stdout:5/841: mkdir d17/d20/d32/d9d/da9/d117 0 2024-02-15T18:27:18.977 INFO:tasks.workunit.client.1.smithi133.stdout:7/837: unlink d9/db/d16/d5d/d68/d73/ff1 0 2024-02-15T18:27:18.977 INFO:tasks.workunit.client.1.smithi133.stdout:7/838: fdatasync d9/d36/d31/dc1/dcd/dde/f28 0 2024-02-15T18:27:18.986 INFO:tasks.workunit.client.1.smithi133.stdout:7/839: dread d9/d36/d39/f5c [0,4194304] 0 2024-02-15T18:27:18.992 INFO:tasks.workunit.client.1.smithi133.stdout:5/842: dwrite d17/d26/d7b/de2/fe5 [0,4194304] 0 2024-02-15T18:27:18.992 INFO:tasks.workunit.client.1.smithi133.stdout:5/843: write d17/d26/fbe [425362,57187] 0 2024-02-15T18:27:19.003 INFO:tasks.workunit.client.1.smithi133.stdout:7/840: dwrite d9/db/d16/d5d/d68/d73/ffa [0,4194304] 0 2024-02-15T18:27:19.005 INFO:tasks.workunit.client.1.smithi133.stdout:7/841: symlink d9/da/l110 0 2024-02-15T18:27:19.005 INFO:tasks.workunit.client.1.smithi133.stdout:7/842: stat d9/c2c 0 2024-02-15T18:27:19.007 INFO:tasks.workunit.client.1.smithi133.stdout:7/843: link f7 d9/db/d16/d5d/d68/da2/f111 0 2024-02-15T18:27:19.007 INFO:tasks.workunit.client.1.smithi133.stdout:7/844: fdatasync d9/db/d16/d5d/d68/d8a/f109 0 2024-02-15T18:27:19.007 INFO:tasks.workunit.client.1.smithi133.stdout:7/845: mkdir d9/db/d55/d112 0 2024-02-15T18:27:19.011 INFO:tasks.workunit.client.1.smithi133.stdout:5/844: dwrite d17/d26/d7b/fc4 [0,4194304] 0 2024-02-15T18:27:19.019 INFO:tasks.workunit.client.1.smithi133.stdout:7/846: symlink d9/da/d48/d5a/l113 0 2024-02-15T18:27:19.019 INFO:tasks.workunit.client.1.smithi133.stdout:7/847: dread - d9/d36/d3d/d4c/d97/de4/fe1 zero size 2024-02-15T18:27:19.019 INFO:tasks.workunit.client.1.smithi133.stdout:7/848: write d9/db/f3e [1952750,100233] 0 2024-02-15T18:27:19.030 INFO:tasks.workunit.client.1.smithi133.stdout:5/845: creat d17/d20/d32/d9d/da9/f118 x:0 0 0 2024-02-15T18:27:19.038 INFO:tasks.workunit.client.1.smithi133.stdout:2/977: sync 2024-02-15T18:27:19.038 INFO:tasks.workunit.client.1.smithi133.stdout:5/846: getdents d17/d20/d32 0 2024-02-15T18:27:19.039 INFO:tasks.workunit.client.1.smithi133.stdout:2/978: dread d7/d2c/d5a/d66/da5/fe5 [0,4194304] 0 2024-02-15T18:27:19.039 INFO:tasks.workunit.client.1.smithi133.stdout:5/847: dread d17/f4a [0,4194304] 0 2024-02-15T18:27:19.041 INFO:tasks.workunit.client.1.smithi133.stdout:2/979: creat d7/db/df6/d126/f136 x:0 0 0 2024-02-15T18:27:19.042 INFO:tasks.workunit.client.1.smithi133.stdout:5/848: rmdir d17/d20/d32/d38/d103 39 2024-02-15T18:27:19.042 INFO:tasks.workunit.client.1.smithi133.stdout:5/849: fsync d17/d20/dc3/ded/fd8 0 2024-02-15T18:27:19.042 INFO:tasks.workunit.client.1.smithi133.stdout:7/849: dwrite d9/db/f8c [0,4194304] 0 2024-02-15T18:27:19.042 INFO:tasks.workunit.client.1.smithi133.stdout:7/850: dread - d9/da/fa8 zero size 2024-02-15T18:27:19.043 INFO:tasks.workunit.client.1.smithi133.stdout:2/980: link d7/d18/d32/l76 d7/l137 0 2024-02-15T18:27:19.044 INFO:tasks.workunit.client.1.smithi133.stdout:5/850: symlink d17/d20/d32/d38/d103/l119 0 2024-02-15T18:27:19.046 INFO:tasks.workunit.client.1.smithi133.stdout:2/981: creat d7/d2c/d5a/d66/f138 x:0 0 0 2024-02-15T18:27:19.046 INFO:tasks.workunit.client.1.smithi133.stdout:2/982: chown d7/d18/d32/d65/ce4 130875 1 2024-02-15T18:27:19.047 INFO:tasks.workunit.client.1.smithi133.stdout:5/851: unlink d17/d20/la8 0 2024-02-15T18:27:19.047 INFO:tasks.workunit.client.1.smithi133.stdout:5/852: readlink d17/d20/l29 0 2024-02-15T18:27:19.047 INFO:tasks.workunit.client.1.smithi133.stdout:5/853: chown d17/d26/d7b/lf7 215 1 2024-02-15T18:27:19.047 INFO:tasks.workunit.client.1.smithi133.stdout:5/854: dread - d17/d20/d4f/d5f/d93/dec/fd9 zero size 2024-02-15T18:27:19.047 INFO:tasks.workunit.client.1.smithi133.stdout:5/855: write d17/d20/d32/d38/d86/db6/fd3 [13343830,67179] 0 2024-02-15T18:27:19.048 INFO:tasks.workunit.client.1.smithi133.stdout:5/856: read d17/d20/d32/d38/d70/f72 [441302,63204] 0 2024-02-15T18:27:19.048 INFO:tasks.workunit.client.1.smithi133.stdout:5/857: write d17/d26/f5d [438397,21327] 0 2024-02-15T18:27:19.048 INFO:tasks.workunit.client.1.smithi133.stdout:5/858: chown d17/d20/d32/d38/dbd/lc8 11 1 2024-02-15T18:27:19.048 INFO:tasks.workunit.client.1.smithi133.stdout:5/859: chown d17/d20/d32/d38/d70/lbc 5176309 1 2024-02-15T18:27:19.048 INFO:tasks.workunit.client.1.smithi133.stdout:5/860: read - d17/d20/d32/d38/dbd/ffe zero size 2024-02-15T18:27:19.048 INFO:tasks.workunit.client.1.smithi133.stdout:5/861: chown d17/d20/d4f/f97 0 1 2024-02-15T18:27:19.050 INFO:tasks.workunit.client.1.smithi133.stdout:2/983: creat d7/d2c/d31/f139 x:0 0 0 2024-02-15T18:27:19.050 INFO:tasks.workunit.client.1.smithi133.stdout:2/984: write d7/d2c/d46/f135 [241015,108982] 0 2024-02-15T18:27:19.055 INFO:tasks.workunit.client.1.smithi133.stdout:7/851: dread d9/db/f50 [0,4194304] 0 2024-02-15T18:27:19.061 INFO:tasks.workunit.client.1.smithi133.stdout:7/852: dread d9/db/d16/d5d/d68/da2/f111 [4194304,4194304] 0 2024-02-15T18:27:19.062 INFO:tasks.workunit.client.1.smithi133.stdout:7/853: mknod d9/d36/d31/dc1/dcd/dde/c114 0 2024-02-15T18:27:19.064 INFO:tasks.workunit.client.1.smithi133.stdout:7/854: symlink d9/db/d16/d4f/df3/l115 0 2024-02-15T18:27:19.066 INFO:tasks.workunit.client.1.smithi133.stdout:7/855: mknod d9/d36/d39/dd0/c116 0 2024-02-15T18:27:19.070 INFO:tasks.workunit.client.1.smithi133.stdout:2/985: dwrite d7/db/d67/da7/fcb [0,4194304] 0 2024-02-15T18:27:19.073 INFO:tasks.workunit.client.1.smithi133.stdout:2/986: truncate d7/f30 371102 0 2024-02-15T18:27:19.073 INFO:tasks.workunit.client.1.smithi133.stdout:2/987: chown d7/ffc 36827 1 2024-02-15T18:27:19.108 INFO:tasks.workunit.client.1.smithi133.stdout:2/988: dwrite d7/db/f43 [0,4194304] 0 2024-02-15T18:27:19.108 INFO:tasks.workunit.client.1.smithi133.stdout:2/989: fdatasync d7/d2c/d31/f38 0 2024-02-15T18:27:19.108 INFO:tasks.workunit.client.1.smithi133.stdout:2/990: stat d7/d18/d32/df1/f10c 0 2024-02-15T18:27:19.110 INFO:tasks.workunit.client.1.smithi133.stdout:2/991: creat d7/d18/d32/df1/f13a x:0 0 0 2024-02-15T18:27:19.110 INFO:tasks.workunit.client.1.smithi133.stdout:2/992: dread - d7/d18/d32/d65/d99/f134 zero size 2024-02-15T18:27:19.112 INFO:tasks.workunit.client.1.smithi133.stdout:7/856: dwrite d9/db/d55/fb5 [0,4194304] 0 2024-02-15T18:27:19.112 INFO:tasks.workunit.client.1.smithi133.stdout:2/993: truncate d7/d2c/d3b/d48/d6d/fd6 1796707 0 2024-02-15T18:27:19.112 INFO:tasks.workunit.client.1.smithi133.stdout:2/994: readlink d7/d18/d32/d65/d54/dc9/de7/dd9/lf4 0 2024-02-15T18:27:19.114 INFO:tasks.workunit.client.1.smithi133.stdout:7/857: getdents d9/daf 0 2024-02-15T18:27:19.114 INFO:tasks.workunit.client.1.smithi133.stdout:7/858: write d9/db/d55/fc5 [149570,70189] 0 2024-02-15T18:27:19.116 INFO:tasks.workunit.client.1.smithi133.stdout:7/859: rmdir d9/d19 39 2024-02-15T18:27:19.117 INFO:tasks.workunit.client.1.smithi133.stdout:7/860: write d9/db/d55/fc5 [142150,87444] 0 2024-02-15T18:27:19.117 INFO:tasks.workunit.client.1.smithi133.stdout:7/861: write d9/da/d48/d62/ff5 [997690,27972] 0 2024-02-15T18:27:19.121 INFO:tasks.workunit.client.1.smithi133.stdout:7/862: creat d9/d36/d31/dc1/dcd/dde/d84/f117 x:0 0 0 2024-02-15T18:27:19.122 INFO:tasks.workunit.client.1.smithi133.stdout:7/863: truncate d9/d36/f32 2433703 0 2024-02-15T18:27:19.127 INFO:tasks.workunit.client.1.smithi133.stdout:7/864: write d9/d36/d39/d98/fa1 [183346,77904] 0 2024-02-15T18:27:19.129 INFO:tasks.workunit.client.1.smithi133.stdout:7/865: rmdir d9/da/d48 39 2024-02-15T18:27:19.131 INFO:tasks.workunit.client.1.smithi133.stdout:7/866: getdents d9/da/d48/d62/d64 0 2024-02-15T18:27:19.133 INFO:tasks.workunit.client.1.smithi133.stdout:7/867: unlink d9/d36/d31/dc1/dcd/dde/d84/f117 0 2024-02-15T18:27:19.133 INFO:tasks.workunit.client.1.smithi133.stdout:7/868: chown d9/d36/d31/dc1/dcd/dde/fe2 3194 1 2024-02-15T18:27:19.135 INFO:tasks.workunit.client.1.smithi133.stdout:7/869: rename d9/d36/d31/dc1/dcd/dde/l8d to d9/db/d16/l118 0 2024-02-15T18:27:19.137 INFO:tasks.workunit.client.1.smithi133.stdout:7/870: rmdir d9/db/d16/d5d/d68/d8a 39 2024-02-15T18:27:19.137 INFO:tasks.workunit.client.1.smithi133.stdout:7/871: truncate d9/da/ddb/f106 1000402 0 2024-02-15T18:27:19.138 INFO:tasks.workunit.client.1.smithi133.stdout:7/872: mknod d9/db/d16/d5d/d68/d73/d9b/c119 0 2024-02-15T18:27:19.138 INFO:tasks.workunit.client.1.smithi133.stdout:7/873: dread - d9/da/d48/d62/d64/fc9 zero size 2024-02-15T18:27:19.139 INFO:tasks.workunit.client.1.smithi133.stdout:2/995: dwrite d7/d2c/f114 [0,4194304] 0 2024-02-15T18:27:19.140 INFO:tasks.workunit.client.1.smithi133.stdout:2/996: dread - d7/d18/d32/d65/d54/fe1 zero size 2024-02-15T18:27:19.142 INFO:tasks.workunit.client.1.smithi133.stdout:7/874: link d9/da/d48/d62/d64/f9a d9/d36/d31/dc1/dcd/f11a 0 2024-02-15T18:27:19.150 INFO:tasks.workunit.client.1.smithi133.stdout:7/875: getdents d9/db/d16/d5d/d68/da2 0 2024-02-15T18:27:19.150 INFO:tasks.workunit.client.1.smithi133.stdout:2/997: mkdir d7/d118/d13b 0 2024-02-15T18:27:19.150 INFO:tasks.workunit.client.1.smithi133.stdout:7/876: truncate d9/fcf 633591 0 2024-02-15T18:27:19.151 INFO:tasks.workunit.client.1.smithi133.stdout:2/998: mkdir d7/db/d67/d13c 0 2024-02-15T18:27:19.151 INFO:tasks.workunit.client.1.smithi133.stdout:2/999: chown d7/db/d67/d7b 382564 1 2024-02-15T18:27:19.168 INFO:tasks.workunit.client.1.smithi133.stdout:7/877: dwrite d9/da/d48/d62/ff4 [0,4194304] 0 2024-02-15T18:27:19.184 INFO:tasks.workunit.client.1.smithi133.stdout:7/878: dwrite d9/d19/fe8 [0,4194304] 0 2024-02-15T18:27:19.187 INFO:tasks.workunit.client.1.smithi133.stdout:7/879: unlink d9/db/d16/f25 0 2024-02-15T18:27:19.187 INFO:tasks.workunit.client.1.smithi133.stdout:7/880: chown d9/db/d55/fa0 199 1 2024-02-15T18:27:19.195 INFO:tasks.workunit.client.1.smithi133.stdout:8/807: sync 2024-02-15T18:27:19.195 INFO:tasks.workunit.client.1.smithi133.stdout:9/824: sync 2024-02-15T18:27:19.195 INFO:tasks.workunit.client.1.smithi133.stdout:9/825: dread - d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/f110 zero size 2024-02-15T18:27:19.197 INFO:tasks.workunit.client.1.smithi133.stdout:9/826: unlink d0/d8/f48 0 2024-02-15T18:27:19.198 INFO:tasks.workunit.client.1.smithi133.stdout:8/808: mknod d3/d1f/d4f/dab/c115 0 2024-02-15T18:27:19.200 INFO:tasks.workunit.client.1.smithi133.stdout:9/827: creat d0/d8/d9/d12/d82/d42/d44/de1/f111 x:0 0 0 2024-02-15T18:27:19.201 INFO:tasks.workunit.client.1.smithi133.stdout:9/828: rename d0/d8/d9/d12/d82/d42/c4b to d0/d8/d10/d4d/c112 0 2024-02-15T18:27:19.201 INFO:tasks.workunit.client.1.smithi133.stdout:9/829: chown d0/d8/d9/l9e 0 1 2024-02-15T18:27:19.201 INFO:tasks.workunit.client.1.smithi133.stdout:9/830: write d0/d8/d10/db2/f72 [192645,30398] 0 2024-02-15T18:27:19.203 INFO:tasks.workunit.client.1.smithi133.stdout:9/831: rmdir d0/d8/d9/d12/d7f/dca 0 2024-02-15T18:27:19.204 INFO:tasks.workunit.client.1.smithi133.stdout:7/881: dwrite d9/db/d55/f7d [0,4194304] 0 2024-02-15T18:27:19.204 INFO:tasks.workunit.client.1.smithi133.stdout:7/882: dread - d9/d36/d3d/d4c/d97/de4/fe1 zero size 2024-02-15T18:27:19.204 INFO:tasks.workunit.client.1.smithi133.stdout:9/832: symlink d0/d8/d9/d12/d82/d42/d79/d90/de8/l113 0 2024-02-15T18:27:19.207 INFO:tasks.workunit.client.1.smithi133.stdout:7/883: symlink d9/db/l11b 0 2024-02-15T18:27:19.208 INFO:tasks.workunit.client.1.smithi133.stdout:9/833: truncate d0/d8/d10/f14 2641778 0 2024-02-15T18:27:19.209 INFO:tasks.workunit.client.1.smithi133.stdout:7/884: creat d9/db/d16/d5d/d68/d73/d9c/f11c x:0 0 0 2024-02-15T18:27:19.210 INFO:tasks.workunit.client.1.smithi133.stdout:9/834: dread d0/d8/d9/ff [0,4194304] 0 2024-02-15T18:27:19.211 INFO:tasks.workunit.client.1.smithi133.stdout:7/885: creat d9/db/f11d x:0 0 0 2024-02-15T18:27:19.211 INFO:tasks.workunit.client.1.smithi133.stdout:7/886: read d9/db/f50 [2647698,82082] 0 2024-02-15T18:27:19.212 INFO:tasks.workunit.client.1.smithi133.stdout:7/887: mknod d9/da/ddb/c11e 0 2024-02-15T18:27:19.214 INFO:tasks.workunit.client.1.smithi133.stdout:7/888: rename d9/db/d16/d5d/d68/d73/d9b/c119 to d9/d36/d3d/d4c/d97/da9/dc6/c11f 0 2024-02-15T18:27:19.214 INFO:tasks.workunit.client.1.smithi133.stdout:8/809: dwrite d3/d1f/f2a [4194304,4194304] 0 2024-02-15T18:27:19.221 INFO:tasks.workunit.client.1.smithi133.stdout:5/862: sync 2024-02-15T18:27:19.221 INFO:tasks.workunit.client.1.smithi133.stdout:5/863: fdatasync f15 0 2024-02-15T18:27:19.221 INFO:tasks.workunit.client.1.smithi133.stdout:4/791: sync 2024-02-15T18:27:19.221 INFO:tasks.workunit.client.1.smithi133.stdout:4/792: chown d2/d5/d2b/d21/da2/lfa 295746051 1 2024-02-15T18:27:19.221 INFO:tasks.workunit.client.1.smithi133.stdout:4/793: chown d2/d48/d5c/db7/dd4/ce9 0 1 2024-02-15T18:27:19.222 INFO:tasks.workunit.client.1.smithi133.stdout:9/835: dread d0/d8/d9/d12/f21 [0,4194304] 0 2024-02-15T18:27:19.225 INFO:tasks.workunit.client.1.smithi133.stdout:8/810: symlink d3/de/l116 0 2024-02-15T18:27:19.225 INFO:tasks.workunit.client.1.smithi133.stdout:8/811: readlink d3/d1f/d4f/l54 0 2024-02-15T18:27:19.227 INFO:tasks.workunit.client.1.smithi133.stdout:5/864: rename d17/d20/d32/d38/d70/ff3 to d17/d20/d32/d38/d86/db6/f11a 0 2024-02-15T18:27:19.228 INFO:tasks.workunit.client.1.smithi133.stdout:9/836: rmdir d0/d8/d10/d4d/d92 39 2024-02-15T18:27:19.228 INFO:tasks.workunit.client.1.smithi133.stdout:9/837: dread - d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/f110 zero size 2024-02-15T18:27:19.228 INFO:tasks.workunit.client.1.smithi133.stdout:9/838: write d0/d8/d10/d4d/fc2 [268848,983] 0 2024-02-15T18:27:19.228 INFO:tasks.workunit.client.1.smithi133.stdout:9/839: readlink d0/d8/d9/d12/d82/l68 0 2024-02-15T18:27:19.230 INFO:tasks.workunit.client.1.smithi133.stdout:8/812: getdents d3/d1c/d2f/d87/d73 0 2024-02-15T18:27:19.231 INFO:tasks.workunit.client.1.smithi133.stdout:9/840: rmdir d0/d7b/db7 39 2024-02-15T18:27:19.231 INFO:tasks.workunit.client.1.smithi133.stdout:9/841: write d0/d8/d10/fd6 [267967,33933] 0 2024-02-15T18:27:19.231 INFO:tasks.workunit.client.1.smithi133.stdout:9/842: fsync d0/d8/fd 0 2024-02-15T18:27:19.233 INFO:tasks.workunit.client.1.smithi133.stdout:9/843: mknod d0/d8/d9/d12/d82/d89/c114 0 2024-02-15T18:27:19.236 INFO:tasks.workunit.client.1.smithi133.stdout:9/844: unlink d0/d8/d9/c75 0 2024-02-15T18:27:19.236 INFO:tasks.workunit.client.1.smithi133.stdout:9/845: chown d0/d37/df7 0 1 2024-02-15T18:27:19.236 INFO:tasks.workunit.client.1.smithi133.stdout:9/846: chown d0/d37/df7/dfa 7 1 2024-02-15T18:27:19.236 INFO:tasks.workunit.client.1.smithi133.stdout:9/847: readlink d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/la3 0 2024-02-15T18:27:19.236 INFO:tasks.workunit.client.1.smithi133.stdout:4/794: dread d2/d48/d6a/f9a [0,4194304] 0 2024-02-15T18:27:19.239 INFO:tasks.workunit.client.1.smithi133.stdout:9/848: mkdir d0/d8/d9/d12/d82/d42/d115 0 2024-02-15T18:27:19.240 INFO:tasks.workunit.client.1.smithi133.stdout:4/795: read d2/d5/d2b/d21/d2d/d44/f46 [194646,62728] 0 2024-02-15T18:27:19.241 INFO:tasks.workunit.client.1.smithi133.stdout:7/889: dwrite d9/da/d48/f7e [0,4194304] 0 2024-02-15T18:27:19.241 INFO:tasks.workunit.client.1.smithi133.stdout:5/865: dread d17/d20/d32/d38/d86/db6/fd3 [4194304,4194304] 0 2024-02-15T18:27:19.241 INFO:tasks.workunit.client.1.smithi133.stdout:7/890: fsync d9/d19/fe8 0 2024-02-15T18:27:19.243 INFO:tasks.workunit.client.1.smithi133.stdout:9/849: creat d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/f116 x:0 0 0 2024-02-15T18:27:19.243 INFO:tasks.workunit.client.1.smithi133.stdout:4/796: symlink d2/d48/d6a/d9e/lfb 0 2024-02-15T18:27:19.243 INFO:tasks.workunit.client.1.smithi133.stdout:4/797: dread - d2/d5/d2b/d21/d2d/d44/d51/fca zero size 2024-02-15T18:27:19.244 INFO:tasks.workunit.client.1.smithi133.stdout:9/850: dread d0/d7b/db7/ffe [0,4194304] 0 2024-02-15T18:27:19.248 INFO:tasks.workunit.client.1.smithi133.stdout:5/866: link d17/d20/d32/d9d/l9e d17/d26/d7b/ddf/l11b 0 2024-02-15T18:27:19.248 INFO:tasks.workunit.client.1.smithi133.stdout:7/891: creat d9/da/d48/d62/d64/f120 x:0 0 0 2024-02-15T18:27:19.249 INFO:tasks.workunit.client.1.smithi133.stdout:4/798: creat d2/d5/d2b/d21/da2/d5e/ffc x:0 0 0 2024-02-15T18:27:19.249 INFO:tasks.workunit.client.1.smithi133.stdout:9/851: creat d0/d8/d9/d12/d82/d89/f117 x:0 0 0 2024-02-15T18:27:19.249 INFO:tasks.workunit.client.1.smithi133.stdout:5/867: creat d17/d20/f11c x:0 0 0 2024-02-15T18:27:19.251 INFO:tasks.workunit.client.1.smithi133.stdout:4/799: read d2/d5/d2b/d21/d2d/d44/d51/f67 [1781177,3226] 0 2024-02-15T18:27:19.251 INFO:tasks.workunit.client.1.smithi133.stdout:9/852: unlink d0/d8/d9/d12/d82/d42/d44/fa2 0 2024-02-15T18:27:19.251 INFO:tasks.workunit.client.1.smithi133.stdout:9/853: stat d0/d37 0 2024-02-15T18:27:19.253 INFO:tasks.workunit.client.1.smithi133.stdout:5/868: link d17/l39 d17/d20/d32/d7d/d7e/l11d 0 2024-02-15T18:27:19.254 INFO:tasks.workunit.client.1.smithi133.stdout:4/800: mknod d2/d48/d5c/d9f/df6/cfd 0 2024-02-15T18:27:19.254 INFO:tasks.workunit.client.1.smithi133.stdout:8/813: dwrite d3/d7/d40/d61/f65 [0,4194304] 0 2024-02-15T18:27:19.254 INFO:tasks.workunit.client.1.smithi133.stdout:9/854: mkdir d0/d37/df7/d118 0 2024-02-15T18:27:19.257 INFO:tasks.workunit.client.1.smithi133.stdout:4/801: symlink d2/d48/d5c/d93/d8d/d96/lfe 0 2024-02-15T18:27:19.262 INFO:tasks.workunit.client.1.smithi133.stdout:8/814: link d3/d1f/f2c d3/de/d3e/d82/d8b/f117 0 2024-02-15T18:27:19.264 INFO:tasks.workunit.client.1.smithi133.stdout:9/855: creat d0/d8/d9/d12/d82/d42/d79/d90/f119 x:0 0 0 2024-02-15T18:27:19.264 INFO:tasks.workunit.client.1.smithi133.stdout:5/869: symlink d17/d20/d32/d38/d70/l11e 0 2024-02-15T18:27:19.264 INFO:tasks.workunit.client.1.smithi133.stdout:5/870: dread - d17/d26/d7b/deb/f116 zero size 2024-02-15T18:27:19.264 INFO:tasks.workunit.client.1.smithi133.stdout:9/856: dread - d0/d8/d9/d12/d82/d42/fe4 zero size 2024-02-15T18:27:19.265 INFO:tasks.workunit.client.1.smithi133.stdout:5/871: read d17/d20/d32/d9d/da9/faa [593286,7563] 0 2024-02-15T18:27:19.266 INFO:tasks.workunit.client.1.smithi133.stdout:4/802: symlink d2/d5/d2b/d21/d2d/d44/dee/lff 0 2024-02-15T18:27:19.266 INFO:tasks.workunit.client.1.smithi133.stdout:9/857: write d0/d8/d9/d12/d7f/d8f/fee [3689379,60296] 0 2024-02-15T18:27:19.268 INFO:tasks.workunit.client.1.smithi133.stdout:7/892: dwrite d9/fd2 [0,4194304] 0 2024-02-15T18:27:19.268 INFO:tasks.workunit.client.1.smithi133.stdout:5/872: rmdir d17/d20/d32/d9d/da9/dc6/de4/d111 0 2024-02-15T18:27:19.271 INFO:tasks.workunit.client.1.smithi133.stdout:4/803: truncate d2/d5/d2b/f24 253900 0 2024-02-15T18:27:19.271 INFO:tasks.workunit.client.1.smithi133.stdout:4/804: write d2/d5/d2b/dd2/fe3 [598991,61933] 0 2024-02-15T18:27:19.272 INFO:tasks.workunit.client.1.smithi133.stdout:8/815: dread d3/d1f/fa7 [0,4194304] 0 2024-02-15T18:27:19.273 INFO:tasks.workunit.client.1.smithi133.stdout:7/893: mknod d9/db/d16/d5d/d68/c121 0 2024-02-15T18:27:19.274 INFO:tasks.workunit.client.1.smithi133.stdout:8/816: creat d3/de/d3e/dc4/f118 x:0 0 0 2024-02-15T18:27:19.275 INFO:tasks.workunit.client.1.smithi133.stdout:7/894: rmdir d9/d36/d3d/d4c/d97 39 2024-02-15T18:27:19.275 INFO:tasks.workunit.client.1.smithi133.stdout:7/895: fdatasync d9/d36/d39/f99 0 2024-02-15T18:27:19.277 INFO:tasks.workunit.client.1.smithi133.stdout:8/817: creat d3/de/d3e/d82/f119 x:0 0 0 2024-02-15T18:27:19.280 INFO:tasks.workunit.client.1.smithi133.stdout:8/818: getdents d3/d7 0 2024-02-15T18:27:19.281 INFO:tasks.workunit.client.1.smithi133.stdout:7/896: unlink d9/db/l13 0 2024-02-15T18:27:19.289 INFO:tasks.workunit.client.1.smithi133.stdout:4/805: dread d2/d48/d5c/d93/d8d/fb2 [0,4194304] 0 2024-02-15T18:27:19.295 INFO:tasks.workunit.client.1.smithi133.stdout:4/806: rename d2/d48/d5c/fc4 to d2/d5/d2b/d21/d2d/d4f/f100 0 2024-02-15T18:27:19.295 INFO:tasks.workunit.client.1.smithi133.stdout:4/807: readlink d2/d5/d2b/d21/da2/d5e/l68 0 2024-02-15T18:27:19.297 INFO:tasks.workunit.client.1.smithi133.stdout:4/808: rename d2/d5/d2b/d21/d2d/d44/d51/ld0 to d2/d5/d2b/d21/d2d/d4f/d87/d92/l101 0 2024-02-15T18:27:19.297 INFO:tasks.workunit.client.1.smithi133.stdout:4/809: write d2/d48/d5c/d93/d8d/d96/feb [308756,107229] 0 2024-02-15T18:27:19.297 INFO:tasks.workunit.client.1.smithi133.stdout:4/810: mknod d2/d48/d6a/d9e/c102 0 2024-02-15T18:27:19.342 INFO:tasks.workunit.client.1.smithi133.stdout:5/873: dwrite d17/d20/d32/d7d/f108 [0,4194304] 0 2024-02-15T18:27:19.343 INFO:tasks.workunit.client.1.smithi133.stdout:5/874: creat d17/d26/f11f x:0 0 0 2024-02-15T18:27:19.343 INFO:tasks.workunit.client.1.smithi133.stdout:5/875: stat d17/d20/d4f/d5f/d93/dec/cb9 0 2024-02-15T18:27:19.345 INFO:tasks.workunit.client.1.smithi133.stdout:8/819: dwrite d3/d1c/d37/d5c/f89 [0,4194304] 0 2024-02-15T18:27:19.347 INFO:tasks.workunit.client.1.smithi133.stdout:7/897: dwrite d9/db/d16/d5d/d68/d73/ffa [0,4194304] 0 2024-02-15T18:27:19.347 INFO:tasks.workunit.client.1.smithi133.stdout:7/898: fdatasync d9/d36/d31/dc1/dcd/dde/d84/fee 0 2024-02-15T18:27:19.347 INFO:tasks.workunit.client.1.smithi133.stdout:7/899: write d9/d36/d3d/f43 [870068,44362] 0 2024-02-15T18:27:19.347 INFO:tasks.workunit.client.1.smithi133.stdout:8/820: link d3/de/d3e/d94/ded/fcc d3/d1f/dde/f11a 0 2024-02-15T18:27:19.349 INFO:tasks.workunit.client.1.smithi133.stdout:4/811: dwrite d2/d5/d2b/d21/d2d/d44/dee/ff1 [0,4194304] 0 2024-02-15T18:27:19.349 INFO:tasks.workunit.client.1.smithi133.stdout:7/900: mkdir d9/d36/d3d/d122 0 2024-02-15T18:27:19.351 INFO:tasks.workunit.client.1.smithi133.stdout:8/821: creat d3/d1c/d2f/d87/d73/d84/dd3/f11b x:0 0 0 2024-02-15T18:27:19.352 INFO:tasks.workunit.client.1.smithi133.stdout:7/901: mkdir d9/db/d16/d10d/d123 0 2024-02-15T18:27:19.355 INFO:tasks.workunit.client.1.smithi133.stdout:8/822: write d3/de/f1d [1280778,107413] 0 2024-02-15T18:27:19.355 INFO:tasks.workunit.client.1.smithi133.stdout:8/823: fsync d3/d1c/d37/d5c/f89 0 2024-02-15T18:27:19.358 INFO:tasks.workunit.client.1.smithi133.stdout:7/902: rmdir d9/da/d48/d5a 39 2024-02-15T18:27:19.364 INFO:tasks.workunit.client.1.smithi133.stdout:5/876: dwrite d17/d20/d32/d9d/da9/f118 [0,4194304] 0 2024-02-15T18:27:19.364 INFO:tasks.workunit.client.1.smithi133.stdout:5/877: chown d17/d20/d32/d38/f8b 58 1 2024-02-15T18:27:19.364 INFO:tasks.workunit.client.1.smithi133.stdout:8/824: getdents d3/de 0 2024-02-15T18:27:19.364 INFO:tasks.workunit.client.1.smithi133.stdout:4/812: dread d2/d5/d2b/d21/d2d/d44/da4/fbd [0,4194304] 0 2024-02-15T18:27:19.365 INFO:tasks.workunit.client.1.smithi133.stdout:4/813: write d2/d5/d2b/d21/fb9 [1251301,60876] 0 2024-02-15T18:27:19.365 INFO:tasks.workunit.client.1.smithi133.stdout:7/903: creat d9/d36/d3d/d4c/d97/da9/f124 x:0 0 0 2024-02-15T18:27:19.373 INFO:tasks.workunit.client.1.smithi133.stdout:5/878: creat d17/d20/d4f/d5f/d106/f120 x:0 0 0 2024-02-15T18:27:19.373 INFO:tasks.workunit.client.1.smithi133.stdout:7/904: truncate d9/db/d55/f7d 1081334 0 2024-02-15T18:27:19.374 INFO:tasks.workunit.client.1.smithi133.stdout:5/879: mkdir d17/d20/d32/d9d/da9/d117/d121 0 2024-02-15T18:27:19.381 INFO:tasks.workunit.client.1.smithi133.stdout:5/880: mknod d17/d20/d32/d9d/da9/dc6/de4/c122 0 2024-02-15T18:27:19.381 INFO:tasks.workunit.client.1.smithi133.stdout:5/881: fsync d17/d20/d4f/d5f/d93/dec/f8a 0 2024-02-15T18:27:19.382 INFO:tasks.workunit.client.1.smithi133.stdout:5/882: symlink d17/d20/d32/d7d/l123 0 2024-02-15T18:27:19.384 INFO:tasks.workunit.client.1.smithi133.stdout:5/883: creat d17/d20/d32/d38/d70/f124 x:0 0 0 2024-02-15T18:27:19.384 INFO:tasks.workunit.client.1.smithi133.stdout:5/884: fsync d17/d20/d32/d38/d70/f72 0 2024-02-15T18:27:19.385 INFO:tasks.workunit.client.1.smithi133.stdout:5/885: mknod d17/d20/d4f/c125 0 2024-02-15T18:27:19.388 INFO:tasks.workunit.client.1.smithi133.stdout:7/905: dread d9/db/f4a [0,4194304] 0 2024-02-15T18:27:19.388 INFO:tasks.workunit.client.1.smithi133.stdout:5/886: rename d17/d20/l61 to d17/d20/dc3/ded/l126 0 2024-02-15T18:27:19.388 INFO:tasks.workunit.client.1.smithi133.stdout:7/906: creat d9/f125 x:0 0 0 2024-02-15T18:27:19.389 INFO:tasks.workunit.client.1.smithi133.stdout:7/907: write d9/db/d16/d5d/d68/da2/fdc [195912,122689] 0 2024-02-15T18:27:19.389 INFO:tasks.workunit.client.1.smithi133.stdout:5/887: creat d17/d20/f127 x:0 0 0 2024-02-15T18:27:19.390 INFO:tasks.workunit.client.1.smithi133.stdout:7/908: mknod d9/d36/d31/c126 0 2024-02-15T18:27:19.391 INFO:tasks.workunit.client.1.smithi133.stdout:5/888: unlink l1 0 2024-02-15T18:27:19.397 INFO:tasks.workunit.client.1.smithi133.stdout:5/889: read d17/d20/d32/d38/d70/faf [3414901,25630] 0 2024-02-15T18:27:19.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/825: dwrite d3/de/f110 [0,4194304] 0 2024-02-15T18:27:19.399 INFO:tasks.workunit.client.1.smithi133.stdout:4/814: dwrite d2/d48/d5c/db7/dba/dab/fb1 [0,4194304] 0 2024-02-15T18:27:19.401 INFO:tasks.workunit.client.1.smithi133.stdout:8/826: mknod d3/d1c/d2f/d87/d73/c11c 0 2024-02-15T18:27:19.405 INFO:tasks.workunit.client.1.smithi133.stdout:8/827: truncate d3/f86 93071 0 2024-02-15T18:27:19.405 INFO:tasks.workunit.client.1.smithi133.stdout:8/828: write d3/d7/d40/d61/fd1 [4563972,69872] 0 2024-02-15T18:27:19.414 INFO:tasks.workunit.client.1.smithi133.stdout:4/815: dread d2/d48/d5c/d93/d8d/d96/fb8 [0,4194304] 0 2024-02-15T18:27:19.414 INFO:tasks.workunit.client.1.smithi133.stdout:4/816: chown d2/d5/d2b/d21 29090937 1 2024-02-15T18:27:19.415 INFO:tasks.workunit.client.1.smithi133.stdout:7/909: dwrite d9/db/d16/d5d/d68/d73/ffa [0,4194304] 0 2024-02-15T18:27:19.415 INFO:tasks.workunit.client.1.smithi133.stdout:7/910: chown d9/da/ddb 46919 1 2024-02-15T18:27:19.420 INFO:tasks.workunit.client.1.smithi133.stdout:8/829: dread d3/d1c/f51 [0,4194304] 0 2024-02-15T18:27:19.420 INFO:tasks.workunit.client.1.smithi133.stdout:8/830: chown d3/d7/d40/dec 3 1 2024-02-15T18:27:19.437 INFO:tasks.workunit.client.1.smithi133.stdout:5/890: dwrite d17/d20/d32/d38/dbd/ffe [0,4194304] 0 2024-02-15T18:27:19.437 INFO:tasks.workunit.client.1.smithi133.stdout:5/891: fsync d17/d20/d4f/f110 0 2024-02-15T18:27:19.442 INFO:tasks.workunit.client.1.smithi133.stdout:5/892: mkdir d17/d20/d32/d38/dbd/d128 0 2024-02-15T18:27:19.442 INFO:tasks.workunit.client.1.smithi133.stdout:4/817: dwrite d2/d48/d5c/d93/d8d/d96/fb8 [0,4194304] 0 2024-02-15T18:27:19.444 INFO:tasks.workunit.client.1.smithi133.stdout:5/893: mknod d17/d20/d32/d7d/de7/c129 0 2024-02-15T18:27:19.444 INFO:tasks.workunit.client.1.smithi133.stdout:5/894: truncate d17/d20/d4f/d5f/d93/dec/fd9 569517 0 2024-02-15T18:27:19.445 INFO:tasks.workunit.client.1.smithi133.stdout:4/818: creat d2/d5/d2b/d21/d2d/d44/da4/dd6/f103 x:0 0 0 2024-02-15T18:27:19.446 INFO:tasks.workunit.client.1.smithi133.stdout:5/895: symlink d17/d26/d7b/d87/l12a 0 2024-02-15T18:27:19.446 INFO:tasks.workunit.client.1.smithi133.stdout:5/896: readlink d17/d26/d7b/de2/lf6 0 2024-02-15T18:27:19.448 INFO:tasks.workunit.client.1.smithi133.stdout:4/819: write d2/d48/d6a/f9a [3449444,112486] 0 2024-02-15T18:27:19.448 INFO:tasks.workunit.client.1.smithi133.stdout:4/820: readlink d2/d5/d2b/d21/d2d/d4f/d87/d92/la8 0 2024-02-15T18:27:19.448 INFO:tasks.workunit.client.1.smithi133.stdout:4/821: readlink d2/d5/l28 0 2024-02-15T18:27:19.449 INFO:tasks.workunit.client.1.smithi133.stdout:4/822: fdatasync d2/d5/d2b/d21/d2d/d44/da4/fde 0 2024-02-15T18:27:19.449 INFO:tasks.workunit.client.1.smithi133.stdout:5/897: getdents d17/d26 0 2024-02-15T18:27:19.469 INFO:tasks.workunit.client.1.smithi133.stdout:4/823: dread d2/d5/d2b/d21/d3b/f66 [0,4194304] 0 2024-02-15T18:27:19.472 INFO:tasks.workunit.client.1.smithi133.stdout:4/824: rename d2/d5/d2b/d21/d2d/f56 to d2/d5/d2b/d21/d2d/d44/da4/dd6/f104 0 2024-02-15T18:27:19.474 INFO:tasks.workunit.client.1.smithi133.stdout:4/825: link d2/d5/d2b/d21/d2d/fb3 d2/d48/d5c/d93/d8d/f105 0 2024-02-15T18:27:19.474 INFO:tasks.workunit.client.1.smithi133.stdout:4/826: write d2/d48/d5c/f62 [1464641,84798] 0 2024-02-15T18:27:19.476 INFO:tasks.workunit.client.1.smithi133.stdout:4/827: mkdir d2/d48/d5c/d93/d8d/d96/d106 0 2024-02-15T18:27:19.477 INFO:tasks.workunit.client.1.smithi133.stdout:5/898: dwrite d17/d20/d32/d9d/fce [0,4194304] 0 2024-02-15T18:27:19.477 INFO:tasks.workunit.client.1.smithi133.stdout:5/899: chown d17/d20/d32/d9d/da9/dc6/lda 1 1 2024-02-15T18:27:19.477 INFO:tasks.workunit.client.1.smithi133.stdout:5/900: chown d17/d20/d5e/l83 3 1 2024-02-15T18:27:19.478 INFO:tasks.workunit.client.1.smithi133.stdout:4/828: unlink d2/d5/d2b/d21/d2d/lcd 0 2024-02-15T18:27:19.479 INFO:tasks.workunit.client.1.smithi133.stdout:5/901: getdents d17/d20/d32/d38/dbd 0 2024-02-15T18:27:19.479 INFO:tasks.workunit.client.1.smithi133.stdout:5/902: stat d17/d20/d4f/d5f/d93/dec/f2d 0 2024-02-15T18:27:19.479 INFO:tasks.workunit.client.1.smithi133.stdout:5/903: getdents d17/d20/d32/d38/dbd 0 2024-02-15T18:27:19.479 INFO:tasks.workunit.client.1.smithi133.stdout:5/904: fdatasync d17/f62 0 2024-02-15T18:27:19.481 INFO:tasks.workunit.client.1.smithi133.stdout:4/829: rmdir d2/d48/d5c/d9f/df6 39 2024-02-15T18:27:19.484 INFO:tasks.workunit.client.1.smithi133.stdout:4/830: creat d2/d48/d5c/d93/d8d/f107 x:0 0 0 2024-02-15T18:27:19.484 INFO:tasks.workunit.client.1.smithi133.stdout:5/905: write d17/d20/d32/d38/d70/f91 [1827668,120044] 0 2024-02-15T18:27:19.486 INFO:tasks.workunit.client.1.smithi133.stdout:5/906: mknod d17/d20/c12b 0 2024-02-15T18:27:19.486 INFO:tasks.workunit.client.1.smithi133.stdout:5/907: chown d17/d20/c6a 0 1 2024-02-15T18:27:19.489 INFO:tasks.workunit.client.1.smithi133.stdout:5/908: creat d17/d20/d4f/d5f/f12c x:0 0 0 2024-02-15T18:27:19.501 INFO:tasks.workunit.client.1.smithi133.stdout:5/909: dread d17/d20/f8d [0,4194304] 0 2024-02-15T18:27:19.502 INFO:tasks.workunit.client.1.smithi133.stdout:5/910: truncate d17/f47 2524161 0 2024-02-15T18:27:19.502 INFO:tasks.workunit.client.1.smithi133.stdout:5/911: rename d17 to d17/d20/d4f/d12d 22 2024-02-15T18:27:19.511 INFO:tasks.workunit.client.1.smithi133.stdout:4/831: dwrite d2/d48/d5c/f80 [0,4194304] 0 2024-02-15T18:27:19.515 INFO:tasks.workunit.client.1.smithi133.stdout:4/832: write d2/d5/d2b/d21/f8f [7985907,4659] 0 2024-02-15T18:27:19.522 INFO:tasks.workunit.client.1.smithi133.stdout:4/833: creat d2/d5/d2b/d21/f108 x:0 0 0 2024-02-15T18:27:19.525 INFO:tasks.workunit.client.1.smithi133.stdout:4/834: write d2/d5/d2b/f5b [7478563,24417] 0 2024-02-15T18:27:19.526 INFO:tasks.workunit.client.1.smithi133.stdout:5/912: dwrite d17/d20/f43 [0,4194304] 0 2024-02-15T18:27:19.528 INFO:tasks.workunit.client.1.smithi133.stdout:5/913: write d17/d26/f52 [792767,88498] 0 2024-02-15T18:27:19.531 INFO:tasks.workunit.client.1.smithi133.stdout:5/914: mkdir d17/d20/d32/d9d/da9/dc6/d12e 0 2024-02-15T18:27:19.548 INFO:tasks.workunit.client.1.smithi133.stdout:4/835: dwrite d2/d5/d2b/d21/d3b/fa6 [0,4194304] 0 2024-02-15T18:27:19.555 INFO:tasks.workunit.client.1.smithi133.stdout:5/915: dwrite d17/d20/d32/d7d/d7e/f84 [0,4194304] 0 2024-02-15T18:27:19.568 INFO:tasks.workunit.client.1.smithi133.stdout:4/836: dwrite d2/d48/d5c/db7/dd4/fea [0,4194304] 0 2024-02-15T18:27:19.568 INFO:tasks.workunit.client.1.smithi133.stdout:4/837: write d2/d5/d2b/d21/d3b/d49/d98/fb0 [4280209,19969] 0 2024-02-15T18:27:19.569 INFO:tasks.workunit.client.1.smithi133.stdout:4/838: write d2/f29 [561834,125709] 0 2024-02-15T18:27:19.574 INFO:tasks.workunit.client.1.smithi133.stdout:4/839: rename d2/d5/d2b/d21/d2d/d4f/f53 to d2/d5/d2b/dd2/f109 0 2024-02-15T18:27:19.575 INFO:tasks.workunit.client.1.smithi133.stdout:9/858: sync 2024-02-15T18:27:19.576 INFO:tasks.workunit.client.1.smithi133.stdout:9/859: mkdir d0/d8/d10/daa/d11a 0 2024-02-15T18:27:19.578 INFO:tasks.workunit.client.1.smithi133.stdout:9/860: mknod d0/d8/d10/daa/d11a/c11b 0 2024-02-15T18:27:19.578 INFO:tasks.workunit.client.1.smithi133.stdout:9/861: fsync d0/d8/d9/d12/d82/d42/d44/f7a 0 2024-02-15T18:27:19.578 INFO:tasks.workunit.client.1.smithi133.stdout:9/862: fdatasync d0/d8/d9/d12/f8a 0 2024-02-15T18:27:19.597 INFO:tasks.workunit.client.1.smithi133.stdout:4/840: dwrite d2/f29 [0,4194304] 0 2024-02-15T18:27:19.597 INFO:tasks.workunit.client.1.smithi133.stdout:4/841: fsync d2/d5/d2b/d21/d2d/d44/da4/fbd 0 2024-02-15T18:27:19.597 INFO:tasks.workunit.client.1.smithi133.stdout:4/842: write d2/d5/d2b/d21/d2d/d44/d51/fca [780234,106751] 0 2024-02-15T18:27:19.604 INFO:tasks.workunit.client.1.smithi133.stdout:9/863: dwrite d0/d37/fdb [0,4194304] 0 2024-02-15T18:27:19.607 INFO:tasks.workunit.client.1.smithi133.stdout:9/864: creat d0/d8/d9/d12/d82/d89/f11c x:0 0 0 2024-02-15T18:27:19.608 INFO:tasks.workunit.client.1.smithi133.stdout:9/865: mknod d0/d8/d10/daa/d11a/c11d 0 2024-02-15T18:27:19.610 INFO:tasks.workunit.client.1.smithi133.stdout:9/866: rename d0/d8/d9/l4a to d0/d8/d10/d4d/dc6/l11e 0 2024-02-15T18:27:19.614 INFO:tasks.workunit.client.1.smithi133.stdout:4/843: dwrite d2/d5/d2b/d21/da2/f27 [0,4194304] 0 2024-02-15T18:27:19.616 INFO:tasks.workunit.client.1.smithi133.stdout:4/844: unlink d2/d48/d5c/l8a 0 2024-02-15T18:27:19.616 INFO:tasks.workunit.client.1.smithi133.stdout:4/845: fsync d2/fbe 0 2024-02-15T18:27:19.616 INFO:tasks.workunit.client.1.smithi133.stdout:4/846: write d2/d5/d2b/d21/da2/d5e/ffc [591277,96470] 0 2024-02-15T18:27:19.617 INFO:tasks.workunit.client.1.smithi133.stdout:4/847: symlink d2/d5/d2b/d21/d2d/d44/da4/dd6/dec/l10a 0 2024-02-15T18:27:19.617 INFO:tasks.workunit.client.1.smithi133.stdout:4/848: fdatasync d2/d48/d5c/db7/dba/f64 0 2024-02-15T18:27:19.618 INFO:tasks.workunit.client.1.smithi133.stdout:4/849: mkdir d2/d5/d2b/d21/da2/d5e/dd1/d10b 0 2024-02-15T18:27:19.618 INFO:tasks.workunit.client.1.smithi133.stdout:4/850: write d2/d48/d5c/f62 [1273907,41583] 0 2024-02-15T18:27:19.619 INFO:tasks.workunit.client.1.smithi133.stdout:4/851: mknod d2/d48/d5c/d9f/df6/c10c 0 2024-02-15T18:27:19.619 INFO:tasks.workunit.client.1.smithi133.stdout:4/852: truncate d2/d5/d2b/d21/f108 106338 0 2024-02-15T18:27:19.620 INFO:tasks.workunit.client.1.smithi133.stdout:4/853: mkdir d2/d48/d5c/db7/dba/d10d 0 2024-02-15T18:27:19.620 INFO:tasks.workunit.client.1.smithi133.stdout:4/854: chown d2/d48/d5c/db7/dba/l43 4045 1 2024-02-15T18:27:19.621 INFO:tasks.workunit.client.1.smithi133.stdout:4/855: write d2/d5/d2b/dd2/f109 [10930509,28584] 0 2024-02-15T18:27:19.621 INFO:tasks.workunit.client.1.smithi133.stdout:4/856: stat d2/d48/d5c/d93 0 2024-02-15T18:27:19.622 INFO:tasks.workunit.client.1.smithi133.stdout:4/857: unlink d2/d48/d5c/db7/dba/l43 0 2024-02-15T18:27:19.622 INFO:tasks.workunit.client.1.smithi133.stdout:4/858: chown d2/d48/d5c/d93/d8d/d96 119411 1 2024-02-15T18:27:19.623 INFO:tasks.workunit.client.1.smithi133.stdout:4/859: creat d2/d5/d2b/d21/d2d/d44/da4/dd6/f10e x:0 0 0 2024-02-15T18:27:19.623 INFO:tasks.workunit.client.1.smithi133.stdout:4/860: truncate d2/d5/d2b/d21/d3b/d49/f69 6931845 0 2024-02-15T18:27:19.625 INFO:tasks.workunit.client.1.smithi133.stdout:4/861: dread d2/d5/d2b/d21/d2d/d4f/f100 [0,4194304] 0 2024-02-15T18:27:19.627 INFO:tasks.workunit.client.1.smithi133.stdout:4/862: creat d2/d5/d2b/d21/d2d/d44/da4/dd6/dec/f10f x:0 0 0 2024-02-15T18:27:19.628 INFO:tasks.workunit.client.1.smithi133.stdout:4/863: read d2/d5/d2b/d21/d2d/d44/d51/fca [553091,126380] 0 2024-02-15T18:27:19.628 INFO:tasks.workunit.client.1.smithi133.stdout:4/864: chown d2/d5/d2b/d21/d2d/l84 21435134 1 2024-02-15T18:27:19.628 INFO:tasks.workunit.client.1.smithi133.stdout:4/865: chown d2/d5/d2b/d21/da2/d5e 15421 1 2024-02-15T18:27:19.628 INFO:tasks.workunit.client.1.smithi133.stdout:4/866: fdatasync d2/d48/d5c/db7/dd4/fea 0 2024-02-15T18:27:19.628 INFO:tasks.workunit.client.1.smithi133.stdout:4/867: write d2/d5/d2b/d21/da2/ff5 [318167,121398] 0 2024-02-15T18:27:19.636 INFO:tasks.workunit.client.1.smithi133.stdout:4/868: dread d2/d5/d2b/d21/d3b/fa6 [0,4194304] 0 2024-02-15T18:27:19.638 INFO:tasks.workunit.client.1.smithi133.stdout:4/869: mkdir d2/d5/d2b/d21/da2/d5e/d76/ddf/d110 0 2024-02-15T18:27:19.640 INFO:tasks.workunit.client.1.smithi133.stdout:4/870: write d2/d5/d2b/d21/da2/f27 [206322,41432] 0 2024-02-15T18:27:19.640 INFO:tasks.workunit.client.1.smithi133.stdout:4/871: fsync d2/d5/d2b/f1a 0 2024-02-15T18:27:19.641 INFO:tasks.workunit.client.1.smithi133.stdout:4/872: mknod d2/d5/d2b/d21/d3b/d49/d98/ddc/c111 0 2024-02-15T18:27:19.641 INFO:tasks.workunit.client.1.smithi133.stdout:4/873: chown d2/d48/d5c/d93/d8d/d96/lfe 3116051 1 2024-02-15T18:27:19.662 INFO:tasks.workunit.client.1.smithi133.stdout:4/874: dwrite d2/d5/d2b/d21/d2d/d44/da4/dd6/dec/f10f [0,4194304] 0 2024-02-15T18:27:19.664 INFO:tasks.workunit.client.1.smithi133.stdout:4/875: creat d2/d5/d2b/d21/d3b/f112 x:0 0 0 2024-02-15T18:27:19.665 INFO:tasks.workunit.client.1.smithi133.stdout:4/876: mknod d2/d5/d2b/d21/d2d/d44/d51/d60/c113 0 2024-02-15T18:27:19.666 INFO:tasks.workunit.client.1.smithi133.stdout:4/877: read d2/d5/d2b/d21/f99 [1620391,13752] 0 2024-02-15T18:27:19.666 INFO:tasks.workunit.client.1.smithi133.stdout:4/878: fdatasync d2/d5/fa0 0 2024-02-15T18:27:19.667 INFO:tasks.workunit.client.1.smithi133.stdout:4/879: symlink d2/l114 0 2024-02-15T18:27:19.667 INFO:tasks.workunit.client.1.smithi133.stdout:4/880: getdents d2/d48/d5c/d93/d8d/d96/d106 0 2024-02-15T18:27:19.668 INFO:tasks.workunit.client.1.smithi133.stdout:4/881: rename d2/d5/d2b/d21/d3b/d49/c8b to d2/d5/d2b/d21/d2d/d44/da4/dd6/c115 0 2024-02-15T18:27:19.669 INFO:tasks.workunit.client.1.smithi133.stdout:4/882: write d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 [6075950,70123] 0 2024-02-15T18:27:19.670 INFO:tasks.workunit.client.1.smithi133.stdout:4/883: mknod d2/d5/d2b/d21/d2d/d44/c116 0 2024-02-15T18:27:19.686 INFO:tasks.workunit.client.1.smithi133.stdout:4/884: dwrite d2/f2a [0,4194304] 0 2024-02-15T18:27:19.687 INFO:tasks.workunit.client.1.smithi133.stdout:4/885: getdents d2/d5/d2b/d21/da2/d5e/dd1 0 2024-02-15T18:27:19.687 INFO:tasks.workunit.client.1.smithi133.stdout:4/886: fdatasync d2/d5/d2b/d21/d2d/f2e 0 2024-02-15T18:27:19.688 INFO:tasks.workunit.client.1.smithi133.stdout:4/887: creat d2/d5/d2b/d21/d2d/d44/da4/dd6/dec/f117 x:0 0 0 2024-02-15T18:27:19.689 INFO:tasks.workunit.client.1.smithi133.stdout:4/888: creat d2/d5/d2b/d21/d2d/d44/f118 x:0 0 0 2024-02-15T18:27:19.691 INFO:tasks.workunit.client.1.smithi133.stdout:4/889: dread d2/d48/d5c/d93/d8d/f105 [0,4194304] 0 2024-02-15T18:27:19.691 INFO:tasks.workunit.client.1.smithi133.stdout:4/890: chown d2/d48/d5c/f80 712 1 2024-02-15T18:27:19.691 INFO:tasks.workunit.client.1.smithi133.stdout:4/891: read d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 [7085243,60309] 0 2024-02-15T18:27:19.707 INFO:tasks.workunit.client.1.smithi133.stdout:4/892: dwrite d2/d5/d2b/dd2/f109 [8388608,4194304] 0 2024-02-15T18:27:19.707 INFO:tasks.workunit.client.1.smithi133.stdout:4/893: fdatasync d2/d5/d2b/d21/d2d/d44/d51/d60/f83 0 2024-02-15T18:27:19.708 INFO:tasks.workunit.client.1.smithi133.stdout:4/894: mknod d2/d48/d5c/d9f/df6/c119 0 2024-02-15T18:27:19.715 INFO:tasks.workunit.client.1.smithi133.stdout:4/895: dread d2/d48/d5c/db7/dba/dab/fb1 [0,4194304] 0 2024-02-15T18:27:19.715 INFO:tasks.workunit.client.1.smithi133.stdout:4/896: chown d2/d5/l11 787 1 2024-02-15T18:27:19.716 INFO:tasks.workunit.client.1.smithi133.stdout:4/897: read d2/d5/d2b/d21/da2/f27 [3368185,27596] 0 2024-02-15T18:27:19.717 INFO:tasks.workunit.client.1.smithi133.stdout:4/898: creat d2/d5/d2b/d21/da2/f11a x:0 0 0 2024-02-15T18:27:19.717 INFO:tasks.workunit.client.1.smithi133.stdout:4/899: dread - d2/d48/d5c/db7/fcb zero size 2024-02-15T18:27:19.717 INFO:tasks.workunit.client.1.smithi133.stdout:4/900: truncate d2/d5/d2b/dd2/fe3 831937 0 2024-02-15T18:27:19.718 INFO:tasks.workunit.client.1.smithi133.stdout:4/901: read d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 [3481198,82836] 0 2024-02-15T18:27:19.719 INFO:tasks.workunit.client.1.smithi133.stdout:4/902: symlink d2/d48/d5c/d93/d8d/l11b 0 2024-02-15T18:27:19.720 INFO:tasks.workunit.client.1.smithi133.stdout:4/903: rmdir d2/d5/d2b/d21/da2/d5e/d76/ddf 39 2024-02-15T18:27:19.720 INFO:tasks.workunit.client.1.smithi133.stdout:4/904: stat d2/d48/d5c/d93/d8d/d96/fb8 0 2024-02-15T18:27:19.720 INFO:tasks.workunit.client.1.smithi133.stdout:4/905: chown d2/d5/d2b/d21/d2d/fb3 54390585 1 2024-02-15T18:27:19.720 INFO:tasks.workunit.client.1.smithi133.stdout:4/906: creat d2/d5/d2b/dd2/f11c x:0 0 0 2024-02-15T18:27:19.720 INFO:tasks.workunit.client.1.smithi133.stdout:4/907: chown d2/d48/d6a/df0 5721504 1 2024-02-15T18:27:19.721 INFO:tasks.workunit.client.1.smithi133.stdout:4/908: symlink d2/d5/l11d 0 2024-02-15T18:27:19.722 INFO:tasks.workunit.client.1.smithi133.stdout:4/909: rename c1 to d2/d5/d2b/d21/d2d/d44/d51/d95/c11e 0 2024-02-15T18:27:19.722 INFO:tasks.workunit.client.1.smithi133.stdout:4/910: write d2/d48/d5c/d93/d8d/f91 [526787,35094] 0 2024-02-15T18:27:19.723 INFO:tasks.workunit.client.1.smithi133.stdout:4/911: creat d2/d5/d2b/d21/da2/d5e/d76/ddf/d110/f11f x:0 0 0 2024-02-15T18:27:19.743 INFO:tasks.workunit.client.1.smithi133.stdout:4/912: dwrite d2/d5/d2b/d21/f8f [0,4194304] 0 2024-02-15T18:27:19.749 INFO:tasks.workunit.client.1.smithi133.stdout:4/913: rename d2/d5/d2b/d21/da2/f6c to d2/d5/f120 0 2024-02-15T18:27:19.749 INFO:tasks.workunit.client.1.smithi133.stdout:4/914: fsync d2/d5/d2b/d21/d2d/d44/d51/f52 0 2024-02-15T18:27:19.750 INFO:tasks.workunit.client.1.smithi133.stdout:4/915: mknod d2/d5/d2b/d21/d2d/d4f/d87/d92/c121 0 2024-02-15T18:27:19.751 INFO:tasks.workunit.client.1.smithi133.stdout:4/916: mknod d2/d48/d5c/db7/dba/dab/c122 0 2024-02-15T18:27:19.754 INFO:tasks.workunit.client.1.smithi133.stdout:4/917: unlink d2/d5/d2b/dd2/le4 0 2024-02-15T18:27:19.758 INFO:tasks.workunit.client.1.smithi133.stdout:7/911: sync 2024-02-15T18:27:19.758 INFO:tasks.workunit.client.1.smithi133.stdout:8/831: sync 2024-02-15T18:27:19.758 INFO:tasks.workunit.client.1.smithi133.stdout:8/832: stat d3/d7/d40/l5e 0 2024-02-15T18:27:19.758 INFO:tasks.workunit.client.1.smithi133.stdout:8/833: fdatasync d3/f46 0 2024-02-15T18:27:19.758 INFO:tasks.workunit.client.1.smithi133.stdout:7/912: write d9/da/ddb/f106 [1259891,78168] 0 2024-02-15T18:27:19.758 INFO:tasks.workunit.client.1.smithi133.stdout:4/918: symlink d2/d48/d5c/d9f/db6/l123 0 2024-02-15T18:27:19.759 INFO:tasks.workunit.client.1.smithi133.stdout:8/834: stat d3/d1f/d4f/lc3 0 2024-02-15T18:27:19.759 INFO:tasks.workunit.client.1.smithi133.stdout:4/919: read d2/f2a [565516,13583] 0 2024-02-15T18:27:19.759 INFO:tasks.workunit.client.1.smithi133.stdout:4/920: rename d2 to d2/d5/d2b/d21/d2d/d44/d51/d95/de6/d124 22 2024-02-15T18:27:19.759 INFO:tasks.workunit.client.1.smithi133.stdout:7/913: symlink d9/da/d48/d62/d64/l127 0 2024-02-15T18:27:19.759 INFO:tasks.workunit.client.1.smithi133.stdout:7/914: chown d9/da/d48/d62/d64/f120 1886 1 2024-02-15T18:27:19.760 INFO:tasks.workunit.client.1.smithi133.stdout:8/835: mkdir d3/d1c/d2f/d87/d73/d84/dd3/d11d 0 2024-02-15T18:27:19.760 INFO:tasks.workunit.client.1.smithi133.stdout:4/921: write d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f74 [6312858,39637] 0 2024-02-15T18:27:19.760 INFO:tasks.workunit.client.1.smithi133.stdout:4/922: fdatasync d2/f9 0 2024-02-15T18:27:19.761 INFO:tasks.workunit.client.1.smithi133.stdout:7/915: link d9/db/f2d d9/d36/d3d/d122/f128 0 2024-02-15T18:27:19.761 INFO:tasks.workunit.client.1.smithi133.stdout:7/916: readlink d9/db/d16/l18 0 2024-02-15T18:27:19.763 INFO:tasks.workunit.client.1.smithi133.stdout:7/917: creat d9/db/d16/d10d/f129 x:0 0 0 2024-02-15T18:27:19.763 INFO:tasks.workunit.client.1.smithi133.stdout:7/918: write d9/d36/d31/ff0 [973828,6499] 0 2024-02-15T18:27:19.765 INFO:tasks.workunit.client.1.smithi133.stdout:7/919: rename d9/fcf to d9/d36/f12a 0 2024-02-15T18:27:19.766 INFO:tasks.workunit.client.1.smithi133.stdout:7/920: mkdir d9/db/d16/d10d/d12b 0 2024-02-15T18:27:19.766 INFO:tasks.workunit.client.1.smithi133.stdout:7/921: readlink d9/db/l11b 0 2024-02-15T18:27:19.766 INFO:tasks.workunit.client.1.smithi133.stdout:7/922: chown d9/d36/d31/dc1/dcd/dde/d84/lb2 0 1 2024-02-15T18:27:19.783 INFO:tasks.workunit.client.1.smithi133.stdout:8/836: dwrite d3/d7/d40/d61/fdc [0,4194304] 0 2024-02-15T18:27:19.783 INFO:tasks.workunit.client.1.smithi133.stdout:4/923: dwrite d2/d48/d5c/fe0 [0,4194304] 0 2024-02-15T18:27:19.784 INFO:tasks.workunit.client.1.smithi133.stdout:4/924: readlink d2/l45 0 2024-02-15T18:27:19.785 INFO:tasks.workunit.client.1.smithi133.stdout:7/923: getdents d9/da/d48/d62/d64 0 2024-02-15T18:27:19.793 INFO:tasks.workunit.client.1.smithi133.stdout:4/925: creat d2/d48/d5c/db7/f125 x:0 0 0 2024-02-15T18:27:19.793 INFO:tasks.workunit.client.1.smithi133.stdout:7/924: dread d9/da/d48/f7e [0,4194304] 0 2024-02-15T18:27:19.795 INFO:tasks.workunit.client.1.smithi133.stdout:4/926: write d2/fbe [2245925,35807] 0 2024-02-15T18:27:19.795 INFO:tasks.workunit.client.1.smithi133.stdout:4/927: truncate d2/f72 1131762 0 2024-02-15T18:27:19.795 INFO:tasks.workunit.client.1.smithi133.stdout:7/925: creat d9/da/d48/d62/f12c x:0 0 0 2024-02-15T18:27:19.796 INFO:tasks.workunit.client.1.smithi133.stdout:7/926: mknod d9/db/d16/d4f/c12d 0 2024-02-15T18:27:19.799 INFO:tasks.workunit.client.1.smithi133.stdout:7/927: link d9/d36/d31/dc1/dcd/dde/c8f d9/d36/d31/dc1/dcd/dde/c12e 0 2024-02-15T18:27:19.799 INFO:tasks.workunit.client.1.smithi133.stdout:7/928: readlink d9/db/d16/d5d/d86/lae 0 2024-02-15T18:27:19.800 INFO:tasks.workunit.client.1.smithi133.stdout:7/929: mkdir d9/d36/d3d/d4c/d97/d12f 0 2024-02-15T18:27:19.800 INFO:tasks.workunit.client.1.smithi133.stdout:7/930: fdatasync d9/db/d16/f3a 0 2024-02-15T18:27:19.800 INFO:tasks.workunit.client.1.smithi133.stdout:7/931: fdatasync d9/da/d48/d62/f103 0 2024-02-15T18:27:19.800 INFO:tasks.workunit.client.1.smithi133.stdout:7/932: fdatasync d9/db/d16/d5d/d68/d73/ffa 0 2024-02-15T18:27:19.802 INFO:tasks.workunit.client.1.smithi133.stdout:7/933: symlink d9/db/d16/d10d/d123/l130 0 2024-02-15T18:27:19.804 INFO:tasks.workunit.client.1.smithi133.stdout:7/934: truncate d9/db/d16/f53 1405754 0 2024-02-15T18:27:19.806 INFO:tasks.workunit.client.1.smithi133.stdout:8/837: dwrite d3/d7/d40/d61/fdc [0,4194304] 0 2024-02-15T18:27:19.806 INFO:tasks.workunit.client.1.smithi133.stdout:7/935: creat d9/f131 x:0 0 0 2024-02-15T18:27:19.807 INFO:tasks.workunit.client.1.smithi133.stdout:7/936: fdatasync d9/da/d48/d62/d64/f120 0 2024-02-15T18:27:19.807 INFO:tasks.workunit.client.1.smithi133.stdout:7/937: fsync d9/da/d48/d62/d64/fc9 0 2024-02-15T18:27:19.809 INFO:tasks.workunit.client.1.smithi133.stdout:5/916: sync 2024-02-15T18:27:19.809 INFO:tasks.workunit.client.1.smithi133.stdout:9/867: sync 2024-02-15T18:27:19.809 INFO:tasks.workunit.client.1.smithi133.stdout:7/938: truncate d9/d36/d3d/fe6 986213 0 2024-02-15T18:27:19.809 INFO:tasks.workunit.client.1.smithi133.stdout:9/868: chown d0/d8/d9/d49/dd4/l10e 10225287 1 2024-02-15T18:27:19.812 INFO:tasks.workunit.client.1.smithi133.stdout:9/869: link d0/d8/d10/d4d/d92/cd3 d0/d8/d10/db2/c11f 0 2024-02-15T18:27:19.812 INFO:tasks.workunit.client.1.smithi133.stdout:7/939: rmdir d9/da/d48/d5a 39 2024-02-15T18:27:19.812 INFO:tasks.workunit.client.1.smithi133.stdout:5/917: truncate d17/d20/d32/d38/d86/db6/f11a 1897753 0 2024-02-15T18:27:19.815 INFO:tasks.workunit.client.1.smithi133.stdout:9/870: write d0/d8/d9/d12/d82/f7c [4166355,68794] 0 2024-02-15T18:27:19.815 INFO:tasks.workunit.client.1.smithi133.stdout:9/871: write d0/d8/d10/f14 [3363749,48091] 0 2024-02-15T18:27:19.817 INFO:tasks.workunit.client.1.smithi133.stdout:4/928: dwrite d2/d48/d5c/d93/d8d/d96/feb [0,4194304] 0 2024-02-15T18:27:19.821 INFO:tasks.workunit.client.1.smithi133.stdout:9/872: mknod d0/d8/d10/d4d/dc6/c120 0 2024-02-15T18:27:19.825 INFO:tasks.workunit.client.1.smithi133.stdout:7/940: dread d9/d36/d39/dd0/fe9 [0,4194304] 0 2024-02-15T18:27:19.825 INFO:tasks.workunit.client.1.smithi133.stdout:4/929: symlink d2/d48/d5c/db7/dba/l126 0 2024-02-15T18:27:19.825 INFO:tasks.workunit.client.1.smithi133.stdout:7/941: fdatasync d9/d36/d39/d98/fa1 0 2024-02-15T18:27:19.825 INFO:tasks.workunit.client.1.smithi133.stdout:7/942: dread - d9/db/d16/d5d/d68/da2/dd8/f10b zero size 2024-02-15T18:27:19.829 INFO:tasks.workunit.client.1.smithi133.stdout:7/943: unlink d9/fa5 0 2024-02-15T18:27:19.829 INFO:tasks.workunit.client.1.smithi133.stdout:7/944: fdatasync d9/db/d16/d5d/d68/d8a/f109 0 2024-02-15T18:27:19.829 INFO:tasks.workunit.client.1.smithi133.stdout:4/930: truncate d2/d5/d2b/d21/d2d/d44/d51/f9c 910508 0 2024-02-15T18:27:19.830 INFO:tasks.workunit.client.1.smithi133.stdout:7/945: creat d9/d36/d3d/d4c/d97/de4/f132 x:0 0 0 2024-02-15T18:27:19.838 INFO:tasks.workunit.client.1.smithi133.stdout:7/946: dread d9/d36/d39/f5c [0,4194304] 0 2024-02-15T18:27:19.840 INFO:tasks.workunit.client.1.smithi133.stdout:4/931: dread d2/d48/d5c/d93/d8d/fb2 [0,4194304] 0 2024-02-15T18:27:19.840 INFO:tasks.workunit.client.1.smithi133.stdout:4/932: readlink d2/d5/d2b/d21/d2d/l4b 0 2024-02-15T18:27:19.840 INFO:tasks.workunit.client.1.smithi133.stdout:4/933: stat d2/f9 0 2024-02-15T18:27:19.841 INFO:tasks.workunit.client.1.smithi133.stdout:4/934: write d2/d5/d2b/d21/d2d/d44/da4/dd6/f103 [428366,52274] 0 2024-02-15T18:27:19.841 INFO:tasks.workunit.client.1.smithi133.stdout:4/935: stat d2 0 2024-02-15T18:27:19.842 INFO:tasks.workunit.client.1.smithi133.stdout:7/947: dread d9/da/d48/f7e [0,4194304] 0 2024-02-15T18:27:19.845 INFO:tasks.workunit.client.1.smithi133.stdout:4/936: dread d2/d5/d2b/d21/d2d/d44/da4/fbd [0,4194304] 0 2024-02-15T18:27:19.847 INFO:tasks.workunit.client.1.smithi133.stdout:9/873: dwrite d0/d8/d9/d12/d82/f2e [0,4194304] 0 2024-02-15T18:27:19.849 INFO:tasks.workunit.client.1.smithi133.stdout:5/918: dwrite d17/d20/dc3/ded/fd8 [0,4194304] 0 2024-02-15T18:27:19.851 INFO:tasks.workunit.client.1.smithi133.stdout:9/874: dread d0/d8/d9/d49/d4c/f7d [0,4194304] 0 2024-02-15T18:27:19.855 INFO:tasks.workunit.client.1.smithi133.stdout:9/875: getdents d0/d37 0 2024-02-15T18:27:19.855 INFO:tasks.workunit.client.1.smithi133.stdout:7/948: dread d9/db/f8c [0,4194304] 0 2024-02-15T18:27:19.855 INFO:tasks.workunit.client.1.smithi133.stdout:7/949: fdatasync d9/da/f10e 0 2024-02-15T18:27:19.856 INFO:tasks.workunit.client.1.smithi133.stdout:7/950: symlink d9/d36/d3d/d4c/d97/da9/dc6/l133 0 2024-02-15T18:27:19.857 INFO:tasks.workunit.client.1.smithi133.stdout:7/951: symlink d9/db/d16/d5d/d68/da2/l134 0 2024-02-15T18:27:19.858 INFO:tasks.workunit.client.1.smithi133.stdout:7/952: chown d9/d36/d3d/d4c/c93 96962 1 2024-02-15T18:27:19.860 INFO:tasks.workunit.client.1.smithi133.stdout:7/953: mkdir d9/db/d55/d112/d135 0 2024-02-15T18:27:19.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/876: read d0/d8/d9/d12/d82/d42/d44/f7a [3724744,77758] 0 2024-02-15T18:27:19.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/877: truncate d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/f116 1026903 0 2024-02-15T18:27:19.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/878: chown d0/d8/d9/d12/d4f/d10c 1751056 1 2024-02-15T18:27:19.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/879: fdatasync d0/d8/d9/fff 0 2024-02-15T18:27:19.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/880: chown d0/d8/d10/d4d/d92/cd3 54939 1 2024-02-15T18:27:19.861 INFO:tasks.workunit.client.1.smithi133.stdout:9/881: chown d0/d8/d9/d12/d82/d42/d79/d90/ld7 47012936 1 2024-02-15T18:27:19.862 INFO:tasks.workunit.client.1.smithi133.stdout:7/954: link f7 d9/db/d16/d5d/d68/da2/f136 0 2024-02-15T18:27:19.862 INFO:tasks.workunit.client.1.smithi133.stdout:7/955: dread - d9/d36/f37 zero size 2024-02-15T18:27:19.863 INFO:tasks.workunit.client.1.smithi133.stdout:5/919: dread d17/d20/f43 [0,4194304] 0 2024-02-15T18:27:19.864 INFO:tasks.workunit.client.1.smithi133.stdout:7/956: dread d9/d36/d31/dc1/dcd/dde/fe2 [0,4194304] 0 2024-02-15T18:27:19.865 INFO:tasks.workunit.client.1.smithi133.stdout:7/957: write d9/d36/d39/f52 [3920277,129898] 0 2024-02-15T18:27:19.865 INFO:tasks.workunit.client.1.smithi133.stdout:7/958: stat d9/db/f50 0 2024-02-15T18:27:19.867 INFO:tasks.workunit.client.1.smithi133.stdout:5/920: rename d17/d20/l44 to d17/d20/d32/d38/d86/dd7/l12f 0 2024-02-15T18:27:19.867 INFO:tasks.workunit.client.1.smithi133.stdout:4/937: dwrite d2/d5/d2b/d21/da2/d5e/d76/ddf/d110/f11f [0,4194304] 0 2024-02-15T18:27:19.871 INFO:tasks.workunit.client.1.smithi133.stdout:4/938: creat d2/d5/d2b/d21/d3b/d49/d98/f127 x:0 0 0 2024-02-15T18:27:19.871 INFO:tasks.workunit.client.1.smithi133.stdout:4/939: chown d2/d5/d2b/d21/d3b/d49/c78 58161128 1 2024-02-15T18:27:19.872 INFO:tasks.workunit.client.1.smithi133.stdout:7/959: dread d9/d36/d3d/d122/f128 [0,4194304] 0 2024-02-15T18:27:19.872 INFO:tasks.workunit.client.1.smithi133.stdout:7/960: write d9/da/d48/d62/ff5 [1191431,46131] 0 2024-02-15T18:27:19.873 INFO:tasks.workunit.client.1.smithi133.stdout:5/921: read d17/d26/f21 [2652804,38405] 0 2024-02-15T18:27:19.875 INFO:tasks.workunit.client.1.smithi133.stdout:5/922: dread d17/d20/d32/d7d/fc9 [0,4194304] 0 2024-02-15T18:27:19.876 INFO:tasks.workunit.client.1.smithi133.stdout:5/923: rmdir d17/d20/d32/d7d/de7 39 2024-02-15T18:27:19.885 INFO:tasks.workunit.client.1.smithi133.stdout:7/961: dread d9/d36/d39/f99 [0,4194304] 0 2024-02-15T18:27:19.886 INFO:tasks.workunit.client.1.smithi133.stdout:9/882: dwrite d0/d8/fcf [0,4194304] 0 2024-02-15T18:27:19.888 INFO:tasks.workunit.client.1.smithi133.stdout:7/962: dread d9/d36/d3d/f43 [0,4194304] 0 2024-02-15T18:27:19.889 INFO:tasks.workunit.client.1.smithi133.stdout:9/883: link d0/d8/d10/daa/lf8 d0/d7b/db7/l121 0 2024-02-15T18:27:19.890 INFO:tasks.workunit.client.1.smithi133.stdout:7/963: symlink d9/db/d16/d5d/d68/l137 0 2024-02-15T18:27:19.891 INFO:tasks.workunit.client.1.smithi133.stdout:9/884: symlink d0/l122 0 2024-02-15T18:27:19.891 INFO:tasks.workunit.client.1.smithi133.stdout:9/885: chown d0/d8/d9/d12/d82/d42/d44/l53 6 1 2024-02-15T18:27:19.892 INFO:tasks.workunit.client.1.smithi133.stdout:9/886: fdatasync d0/d8/d9/f31 0 2024-02-15T18:27:19.892 INFO:tasks.workunit.client.1.smithi133.stdout:9/887: truncate d0/d8/d9/d12/d7f/f107 703117 0 2024-02-15T18:27:19.892 INFO:tasks.workunit.client.1.smithi133.stdout:9/888: read - d0/d8/d9/d12/d82/d89/f11c zero size 2024-02-15T18:27:19.892 INFO:tasks.workunit.client.1.smithi133.stdout:7/964: dread d9/d36/d3d/fd4 [0,4194304] 0 2024-02-15T18:27:19.892 INFO:tasks.workunit.client.1.smithi133.stdout:9/889: mkdir d0/d8/d9/d12/d82/d42/d79/d90/de8/d123 0 2024-02-15T18:27:19.892 INFO:tasks.workunit.client.1.smithi133.stdout:9/890: readlink d0/d8/d10/daa/lf8 0 2024-02-15T18:27:19.893 INFO:tasks.workunit.client.1.smithi133.stdout:9/891: chown d0/c4e 8353 1 2024-02-15T18:27:19.895 INFO:tasks.workunit.client.1.smithi133.stdout:7/965: mkdir d9/db/d55/d112/d135/d138 0 2024-02-15T18:27:19.895 INFO:tasks.workunit.client.1.smithi133.stdout:4/940: dwrite d2/d5/d2b/d21/d2d/d44/d51/d60/f83 [0,4194304] 0 2024-02-15T18:27:19.895 INFO:tasks.workunit.client.1.smithi133.stdout:4/941: write d2/d5/d2b/d21/f108 [714128,126171] 0 2024-02-15T18:27:19.897 INFO:tasks.workunit.client.1.smithi133.stdout:7/966: mkdir d9/db/d139 0 2024-02-15T18:27:19.898 INFO:tasks.workunit.client.1.smithi133.stdout:4/942: mkdir d2/d48/d5c/db7/d128 0 2024-02-15T18:27:19.898 INFO:tasks.workunit.client.1.smithi133.stdout:4/943: fdatasync d2/d5/d2b/d21/da2/d5e/d76/ddf/d110/f11f 0 2024-02-15T18:27:19.898 INFO:tasks.workunit.client.1.smithi133.stdout:4/944: dread d2/d5/d2b/d21/d2d/fb3 [0,4194304] 0 2024-02-15T18:27:19.899 INFO:tasks.workunit.client.1.smithi133.stdout:4/945: chown d2/d5/d2b/d21/da2/d5e/dd1/d10b 3617 1 2024-02-15T18:27:19.899 INFO:tasks.workunit.client.1.smithi133.stdout:4/946: write d2/d5/d2b/d21/d2d/d44/da4/dd6/dec/f117 [806133,43226] 0 2024-02-15T18:27:19.899 INFO:tasks.workunit.client.1.smithi133.stdout:5/924: dwrite d17/d20/d32/d38/d70/f72 [0,4194304] 0 2024-02-15T18:27:19.900 INFO:tasks.workunit.client.1.smithi133.stdout:4/947: symlink d2/d5/d2b/d21/d2d/d4f/d87/l129 0 2024-02-15T18:27:19.901 INFO:tasks.workunit.client.1.smithi133.stdout:5/925: write d17/d20/d32/d38/d70/f72 [2151372,44736] 0 2024-02-15T18:27:19.902 INFO:tasks.workunit.client.1.smithi133.stdout:4/948: creat d2/d48/d5c/d93/f12a x:0 0 0 2024-02-15T18:27:19.903 INFO:tasks.workunit.client.1.smithi133.stdout:5/926: creat d17/d20/d32/d38/f130 x:0 0 0 2024-02-15T18:27:19.903 INFO:tasks.workunit.client.1.smithi133.stdout:4/949: mkdir d2/d48/d5c/db7/dba/d10d/d12b 0 2024-02-15T18:27:19.903 INFO:tasks.workunit.client.1.smithi133.stdout:4/950: readlink d2/d5/d2b/d21/d2d/l8c 0 2024-02-15T18:27:19.904 INFO:tasks.workunit.client.1.smithi133.stdout:5/927: creat d17/d20/d4f/f131 x:0 0 0 2024-02-15T18:27:19.905 INFO:tasks.workunit.client.1.smithi133.stdout:4/951: rmdir d2/d48/d6a/df0 0 2024-02-15T18:27:19.905 INFO:tasks.workunit.client.1.smithi133.stdout:4/952: chown d2/d48/d5c/d93 355642730 1 2024-02-15T18:27:19.907 INFO:tasks.workunit.client.1.smithi133.stdout:4/953: mkdir d2/d48/d6a/d12c 0 2024-02-15T18:27:19.909 INFO:tasks.workunit.client.1.smithi133.stdout:4/954: rmdir d2/d5/d2b/d21/da2/d5e/dd1/d10b 0 2024-02-15T18:27:19.909 INFO:tasks.workunit.client.1.smithi133.stdout:4/955: chown d2/d48/d5c/d93/d8d 1 1 2024-02-15T18:27:19.911 INFO:tasks.workunit.client.1.smithi133.stdout:4/956: rename d2/d48/d5c/db7/dd4 to d2/d48/d5c/db7/dba/d10d/d12d 0 2024-02-15T18:27:19.912 INFO:tasks.workunit.client.1.smithi133.stdout:5/928: dread d17/f33 [0,4194304] 0 2024-02-15T18:27:19.913 INFO:tasks.workunit.client.1.smithi133.stdout:5/929: creat d17/d20/f132 x:0 0 0 2024-02-15T18:27:19.915 INFO:tasks.workunit.client.1.smithi133.stdout:5/930: rename d17/d20/d4f/d5f/d93/dec/c101 to d17/d20/d32/d9d/da9/dc6/de4/c133 0 2024-02-15T18:27:19.916 INFO:tasks.workunit.client.1.smithi133.stdout:5/931: mknod d17/d20/d4f/d5f/c134 0 2024-02-15T18:27:19.919 INFO:tasks.workunit.client.1.smithi133.stdout:7/967: dwrite d9/d36/d3d/d4c/d97/da9/f124 [0,4194304] 0 2024-02-15T18:27:19.926 INFO:tasks.workunit.client.1.smithi133.stdout:7/968: mkdir d9/d36/d39/dd0/d13a 0 2024-02-15T18:27:19.930 INFO:tasks.workunit.client.1.smithi133.stdout:7/969: unlink d9/da/ddb/c11e 0 2024-02-15T18:27:19.931 INFO:tasks.workunit.client.1.smithi133.stdout:7/970: creat d9/da/d48/d62/d64/f13b x:0 0 0 2024-02-15T18:27:19.931 INFO:tasks.workunit.client.1.smithi133.stdout:7/971: truncate d9/d36/d3d/d4c/d97/de4/fe1 1037146 0 2024-02-15T18:27:19.932 INFO:tasks.workunit.client.1.smithi133.stdout:7/972: rmdir d9/d36/d31/dc1/dcd 39 2024-02-15T18:27:19.943 INFO:tasks.workunit.client.1.smithi133.stdout:4/957: dwrite d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f90 [4194304,4194304] 0 2024-02-15T18:27:19.945 INFO:tasks.workunit.client.1.smithi133.stdout:5/932: dwrite d17/d20/d4f/d5f/d106/f120 [0,4194304] 0 2024-02-15T18:27:19.951 INFO:tasks.workunit.client.1.smithi133.stdout:4/958: dread d2/d5/d2b/dd2/f109 [8388608,4194304] 0 2024-02-15T18:27:19.951 INFO:tasks.workunit.client.1.smithi133.stdout:4/959: fdatasync d2/d5/d2b/d21/f8f 0 2024-02-15T18:27:19.953 INFO:tasks.workunit.client.1.smithi133.stdout:4/960: mknod d2/d5/d2b/d21/d2d/d4f/d87/d92/c12e 0 2024-02-15T18:27:19.954 INFO:tasks.workunit.client.1.smithi133.stdout:7/973: dwrite f6 [0,4194304] 0 2024-02-15T18:27:19.955 INFO:tasks.workunit.client.1.smithi133.stdout:4/961: truncate d2/d5/d2b/d21/f8f 583740 0 2024-02-15T18:27:19.955 INFO:tasks.workunit.client.1.smithi133.stdout:4/962: chown d2/d5/d2b/d21/da2/d5e/dd1/ddb/cf2 3 1 2024-02-15T18:27:19.955 INFO:tasks.workunit.client.1.smithi133.stdout:5/933: dread d17/f1c [4194304,4194304] 0 2024-02-15T18:27:19.955 INFO:tasks.workunit.client.1.smithi133.stdout:4/963: write d2/f2a [11791,128381] 0 2024-02-15T18:27:19.959 INFO:tasks.workunit.client.1.smithi133.stdout:5/934: dread d17/d26/fbe [0,4194304] 0 2024-02-15T18:27:19.963 INFO:tasks.workunit.client.1.smithi133.stdout:4/964: truncate d2/f29 2105108 0 2024-02-15T18:27:19.964 INFO:tasks.workunit.client.1.smithi133.stdout:5/935: unlink d17/d20/d32/d7d/ld6 0 2024-02-15T18:27:19.964 INFO:tasks.workunit.client.1.smithi133.stdout:5/936: write d17/d26/d7b/f89 [4564647,101491] 0 2024-02-15T18:27:19.968 INFO:tasks.workunit.client.1.smithi133.stdout:5/937: write d17/d20/d4f/d5f/d93/dec/f41 [4088319,58568] 0 2024-02-15T18:27:19.968 INFO:tasks.workunit.client.1.smithi133.stdout:5/938: getdents d17/d20/d32 0 2024-02-15T18:27:19.972 INFO:tasks.workunit.client.1.smithi133.stdout:5/939: link d17/d20/c81 d17/d20/d32/d9d/da9/d117/d121/c135 0 2024-02-15T18:27:19.972 INFO:tasks.workunit.client.1.smithi133.stdout:5/940: fsync d17/d20/d32/d38/d86/f102 0 2024-02-15T18:27:19.972 INFO:tasks.workunit.client.1.smithi133.stdout:5/941: fsync d17/d20/d4f/d5f/d93/dec/f94 0 2024-02-15T18:27:19.972 INFO:tasks.workunit.client.1.smithi133.stdout:4/965: dread d2/d5/d2b/d21/d2d/d44/d51/f67 [0,4194304] 0 2024-02-15T18:27:19.972 INFO:tasks.workunit.client.1.smithi133.stdout:5/942: write d17/d20/d32/d38/d86/db6/fd3 [12706230,117126] 0 2024-02-15T18:27:19.974 INFO:tasks.workunit.client.1.smithi133.stdout:5/943: mkdir d17/d20/d32/d9d/da9/d117/d121/d136 0 2024-02-15T18:27:19.976 INFO:tasks.workunit.client.1.smithi133.stdout:5/944: creat d17/d20/d5e/db1/f137 x:0 0 0 2024-02-15T18:27:19.976 INFO:tasks.workunit.client.1.smithi133.stdout:5/945: read - d17/d20/d5e/db1/f137 zero size 2024-02-15T18:27:19.977 INFO:tasks.workunit.client.1.smithi133.stdout:4/966: dread d2/d48/d5c/d93/d8d/fb2 [4194304,4194304] 0 2024-02-15T18:27:19.980 INFO:tasks.workunit.client.1.smithi133.stdout:4/967: rename d2/d5/d2b/d21/d2d/d44/d51/lc6 to d2/d5/d2b/d21/da2/d5e/l12f 0 2024-02-15T18:27:19.981 INFO:tasks.workunit.client.1.smithi133.stdout:4/968: link d2/d5/d2b/d21/d2d/d44/dee/lff d2/d5/d2b/d21/da2/d5e/d76/ddf/l130 0 2024-02-15T18:27:19.982 INFO:tasks.workunit.client.1.smithi133.stdout:4/969: chown d2/d5/d2b/d21/d3b/d49/d98/ddc/c111 9 1 2024-02-15T18:27:20.003 INFO:tasks.workunit.client.1.smithi133.stdout:5/946: dwrite d17/d26/d7b/de2/fe5 [0,4194304] 0 2024-02-15T18:27:20.004 INFO:tasks.workunit.client.1.smithi133.stdout:5/947: fsync d17/d20/d32/d38/d70/faf 0 2024-02-15T18:27:20.004 INFO:tasks.workunit.client.1.smithi133.stdout:5/948: chown d17/d20/dc3/ded/l126 1968 1 2024-02-15T18:27:20.005 INFO:tasks.workunit.client.1.smithi133.stdout:4/970: dwrite d2/d5/d2b/dd2/f109 [4194304,4194304] 0 2024-02-15T18:27:20.005 INFO:tasks.workunit.client.1.smithi133.stdout:5/949: rmdir d17/d20/d32/d38/d70 39 2024-02-15T18:27:20.005 INFO:tasks.workunit.client.1.smithi133.stdout:5/950: truncate d17/d26/d7b/d87/ffc 636516 0 2024-02-15T18:27:20.007 INFO:tasks.workunit.client.1.smithi133.stdout:4/971: mknod d2/d5/d2b/d21/d2d/d44/c131 0 2024-02-15T18:27:20.008 INFO:tasks.workunit.client.1.smithi133.stdout:4/972: creat d2/d5/d2b/dd2/f132 x:0 0 0 2024-02-15T18:27:20.010 INFO:tasks.workunit.client.1.smithi133.stdout:4/973: mkdir d2/d5/d2b/d21/da2/d5e/dd1/d133 0 2024-02-15T18:27:20.010 INFO:tasks.workunit.client.1.smithi133.stdout:4/974: dread - d2/d48/f8e zero size 2024-02-15T18:27:20.012 INFO:tasks.workunit.client.1.smithi133.stdout:4/975: rename d2/d48/d5c/fc3 to d2/d5/d2b/d21/d2d/d4f/d87/f134 0 2024-02-15T18:27:20.015 INFO:tasks.workunit.client.1.smithi133.stdout:4/976: rename d2/d5/d2b/d21/d3b to d2/d48/d5c/d93/d8d/d96/d135 0 2024-02-15T18:27:20.017 INFO:tasks.workunit.client.1.smithi133.stdout:4/977: rename d2/d5/d2b/d21/da2/f27 to d2/d48/d5c/db7/dba/d10d/d12b/f136 0 2024-02-15T18:27:20.018 INFO:tasks.workunit.client.1.smithi133.stdout:4/978: truncate d2/d5/d2b/d21/d2d/d44/d51/f52 1712316 0 2024-02-15T18:27:20.020 INFO:tasks.workunit.client.1.smithi133.stdout:4/979: creat d2/d48/d5c/f137 x:0 0 0 2024-02-15T18:27:20.021 INFO:tasks.workunit.client.1.smithi133.stdout:4/980: dread d2/d48/d5c/d93/d8d/f105 [0,4194304] 0 2024-02-15T18:27:20.024 INFO:tasks.workunit.client.1.smithi133.stdout:4/981: creat d2/d5/d2b/d21/f138 x:0 0 0 2024-02-15T18:27:20.024 INFO:tasks.workunit.client.1.smithi133.stdout:4/982: fdatasync d2/d48/d5c/d93/d8d/d96/d135/f66 0 2024-02-15T18:27:20.024 INFO:tasks.workunit.client.1.smithi133.stdout:4/983: readlink d2/d48/d5c/d9f/lc1 0 2024-02-15T18:27:20.024 INFO:tasks.workunit.client.1.smithi133.stdout:4/984: read d2/d5/d2b/d21/d2d/d44/da4/dd6/f104 [2003473,31178] 0 2024-02-15T18:27:20.024 INFO:tasks.workunit.client.1.smithi133.stdout:4/985: write d2/d5/d2b/d21/d2d/d44/f46 [1777997,3182] 0 2024-02-15T18:27:20.026 INFO:tasks.workunit.client.1.smithi133.stdout:5/951: dwrite d17/d20/d4f/f131 [0,4194304] 0 2024-02-15T18:27:20.028 INFO:tasks.workunit.client.1.smithi133.stdout:5/952: rmdir d17/d20/d32/d9d/da9/dc6/de4 39 2024-02-15T18:27:20.030 INFO:tasks.workunit.client.1.smithi133.stdout:5/953: link d17/f62 d17/d20/d4f/d5f/d93/f138 0 2024-02-15T18:27:20.048 INFO:tasks.workunit.client.1.smithi133.stdout:4/986: dwrite d2/d5/d2b/d21/d2d/d44/d51/d60/d63/f90 [4194304,4194304] 0 2024-02-15T18:27:20.049 INFO:tasks.workunit.client.1.smithi133.stdout:4/987: write d2/d5/d2b/d21/d2d/d44/da4/dd6/f104 [582739,75907] 0 2024-02-15T18:27:20.049 INFO:tasks.workunit.client.1.smithi133.stdout:4/988: readlink d2/d5/d2b/d21/d2d/d44/dee/lff 0 2024-02-15T18:27:20.049 INFO:tasks.workunit.client.1.smithi133.stdout:5/954: dwrite d17/d20/d32/fd1 [0,4194304] 0 2024-02-15T18:27:20.049 INFO:tasks.workunit.client.1.smithi133.stdout:4/989: write d2/d48/d5c/f80 [2520830,38802] 0 2024-02-15T18:27:20.071 INFO:tasks.workunit.client.1.smithi133.stdout:5/955: dwrite d17/d20/f11c [0,4194304] 0 2024-02-15T18:27:20.072 INFO:tasks.workunit.client.1.smithi133.stdout:4/990: dwrite d2/d48/d5c/d93/d8d/f107 [0,4194304] 0 2024-02-15T18:27:20.084 INFO:tasks.workunit.client.1.smithi133.stdout:4/991: creat d2/d5/d2b/d21/da2/d5e/d76/f139 x:0 0 0 2024-02-15T18:27:20.084 INFO:tasks.workunit.client.1.smithi133.stdout:4/992: chown d2/d5/d2b/d21/d2d/d4f/d87/d92/c12e 1 1 2024-02-15T18:27:20.088 INFO:tasks.workunit.client.1.smithi133.stdout:4/993: rename d2/d5/d2b/d21/da2/d5e/l6e to d2/d5/d2b/d21/d2d/d44/d51/d60/l13a 0 2024-02-15T18:27:20.089 INFO:tasks.workunit.client.1.smithi133.stdout:4/994: symlink d2/d5/d2b/d21/d2d/d44/d51/d95/de6/l13b 0 2024-02-15T18:27:20.090 INFO:tasks.workunit.client.1.smithi133.stdout:5/956: dwrite d17/f50 [4194304,4194304] 0 2024-02-15T18:27:20.092 INFO:tasks.workunit.client.1.smithi133.stdout:4/995: dread d2/d5/d2b/d21/fb9 [0,4194304] 0 2024-02-15T18:27:20.092 INFO:tasks.workunit.client.1.smithi133.stdout:4/996: fsync d2/d5/d2b/d21/f8f 0 2024-02-15T18:27:20.094 INFO:tasks.workunit.client.1.smithi133.stdout:5/957: symlink d17/d20/d32/d38/d86/l139 0 2024-02-15T18:27:20.094 INFO:tasks.workunit.client.1.smithi133.stdout:5/958: chown d17/d20/d4f/d5f/cac 12743 1 2024-02-15T18:27:20.095 INFO:tasks.workunit.client.1.smithi133.stdout:4/997: creat d2/d48/f13c x:0 0 0 2024-02-15T18:27:20.101 INFO:tasks.workunit.client.1.smithi133.stdout:5/959: dread d17/d20/d32/d38/d86/fa6 [0,4194304] 0 2024-02-15T18:27:20.101 INFO:tasks.workunit.client.1.smithi133.stdout:5/960: read - d17/d20/d32/f75 zero size 2024-02-15T18:27:20.103 INFO:tasks.workunit.client.1.smithi133.stdout:5/961: creat d17/d20/d32/d9d/da9/dc6/de4/f13a x:0 0 0 2024-02-15T18:27:20.104 INFO:tasks.workunit.client.1.smithi133.stdout:5/962: mkdir d17/d20/d32/d9d/da9/d13b 0 2024-02-15T18:27:20.105 INFO:tasks.workunit.client.1.smithi133.stdout:5/963: truncate d17/d20/d32/d9d/da9/fdb 2148035 0 2024-02-15T18:27:20.107 INFO:tasks.workunit.client.1.smithi133.stdout:5/964: rename d17/d20/d32/d38/lf9 to d17/d20/d32/d9d/da9/d13b/l13c 0 2024-02-15T18:27:20.109 INFO:tasks.workunit.client.1.smithi133.stdout:5/965: dread d17/f4a [0,4194304] 0 2024-02-15T18:27:20.114 INFO:tasks.workunit.client.1.smithi133.stdout:4/998: dwrite d2/d5/d2b/d21/d2d/d44/f47 [0,4194304] 0 2024-02-15T18:27:20.130 INFO:tasks.workunit.client.1.smithi133.stdout:9/892: sync 2024-02-15T18:27:20.130 INFO:tasks.workunit.client.1.smithi133.stdout:9/893: dread - d0/d8/d9/d12/d82/d42/d44/fc7 zero size 2024-02-15T18:27:20.131 INFO:tasks.workunit.client.1.smithi133.stdout:8/838: sync 2024-02-15T18:27:20.131 INFO:tasks.workunit.client.1.smithi133.stdout:8/839: write d3/d7/d40/fd0 [424477,17122] 0 2024-02-15T18:27:20.131 INFO:tasks.workunit.client.1.smithi133.stdout:8/840: read - d3/de/d3e/d94/ded/d58/fd9 zero size 2024-02-15T18:27:20.131 INFO:tasks.workunit.client.1.smithi133.stdout:9/894: mknod d0/d8/d9/d49/d4c/dba/c124 0 2024-02-15T18:27:20.132 INFO:tasks.workunit.client.1.smithi133.stdout:8/841: read d3/de/d3e/d94/ded/f41 [728189,385] 0 2024-02-15T18:27:20.132 INFO:tasks.workunit.client.1.smithi133.stdout:8/842: fdatasync d3/d1c/d2f/d87/d73/f103 0 2024-02-15T18:27:20.132 INFO:tasks.workunit.client.1.smithi133.stdout:5/966: dwrite d17/d20/d4f/d5f/d93/dec/fb2 [0,4194304] 0 2024-02-15T18:27:20.133 INFO:tasks.workunit.client.1.smithi133.stdout:9/895: creat d0/d8/d9/d12/d82/d42/d44/f125 x:0 0 0 2024-02-15T18:27:20.133 INFO:tasks.workunit.client.1.smithi133.stdout:8/843: mknod d3/d7/d40/d61/dc8/c11e 0 2024-02-15T18:27:20.136 INFO:tasks.workunit.client.1.smithi133.stdout:9/896: link d0/d8/d9/d12/d4f/f85 d0/f126 0 2024-02-15T18:27:20.136 INFO:tasks.workunit.client.1.smithi133.stdout:9/897: dread - d0/d8/d9/d49/d4c/f10d zero size 2024-02-15T18:27:20.139 INFO:tasks.workunit.client.1.smithi133.stdout:4/999: dwrite d2/d48/d5c/f137 [0,4194304] 0 2024-02-15T18:27:20.139 INFO:tasks.workunit.client.1.smithi133.stdout:5/967: dread d17/f1c [4194304,4194304] 0 2024-02-15T18:27:20.147 INFO:tasks.workunit.client.1.smithi133.stdout:5/968: creat d17/d20/d32/d38/f13d x:0 0 0 2024-02-15T18:27:20.156 INFO:tasks.workunit.client.1.smithi133.stdout:8/844: dwrite d3/de/f1d [4194304,4194304] 0 2024-02-15T18:27:20.156 INFO:tasks.workunit.client.1.smithi133.stdout:8/845: stat d3/d1c/d2f/d87/d73/c11c 0 2024-02-15T18:27:20.157 INFO:tasks.workunit.client.1.smithi133.stdout:8/846: write d3/d1f/d4f/dab/fd8 [4794033,37667] 0 2024-02-15T18:27:20.157 INFO:tasks.workunit.client.1.smithi133.stdout:5/969: link d17/d20/d32/d38/d86/db6/f9f d17/d20/d32/d9d/da9/de6/f13e 0 2024-02-15T18:27:20.158 INFO:tasks.workunit.client.1.smithi133.stdout:7/974: sync 2024-02-15T18:27:20.162 INFO:tasks.workunit.client.1.smithi133.stdout:7/975: write d9/db/f27 [5587344,102432] 0 2024-02-15T18:27:20.166 INFO:tasks.workunit.client.1.smithi133.stdout:5/970: mknod d17/d20/d32/d7d/c13f 0 2024-02-15T18:27:20.166 INFO:tasks.workunit.client.1.smithi133.stdout:5/971: write d17/d20/d32/d38/d86/fb0 [270322,88359] 0 2024-02-15T18:27:20.166 INFO:tasks.workunit.client.1.smithi133.stdout:5/972: dread - d17/d20/d32/d9d/da9/f112 zero size 2024-02-15T18:27:20.166 INFO:tasks.workunit.client.1.smithi133.stdout:7/976: unlink d9/d36/d31/dc1/dcd/dde/d84/fee 0 2024-02-15T18:27:20.168 INFO:tasks.workunit.client.1.smithi133.stdout:7/977: rmdir d9/daf 39 2024-02-15T18:27:20.169 INFO:tasks.workunit.client.1.smithi133.stdout:7/978: creat d9/d36/d3d/d4c/d97/de4/f13c x:0 0 0 2024-02-15T18:27:20.169 INFO:tasks.workunit.client.1.smithi133.stdout:8/847: dread d3/de/d3e/d82/d8b/f117 [0,4194304] 0 2024-02-15T18:27:20.170 INFO:tasks.workunit.client.1.smithi133.stdout:8/848: read d3/de/f25 [3060981,8698] 0 2024-02-15T18:27:20.170 INFO:tasks.workunit.client.1.smithi133.stdout:8/849: fsync d3/d1c/d37/d5c/f89 0 2024-02-15T18:27:20.170 INFO:tasks.workunit.client.1.smithi133.stdout:8/850: chown d3/d1c/d37/d5c 165 1 2024-02-15T18:27:20.170 INFO:tasks.workunit.client.1.smithi133.stdout:8/851: chown d3/de/d3e/d94/ded/d58/fb3 317144 1 2024-02-15T18:27:20.178 INFO:tasks.workunit.client.1.smithi133.stdout:7/979: link d9/f47 d9/da/d48/d62/d64/f13d 0 2024-02-15T18:27:20.178 INFO:tasks.workunit.client.1.smithi133.stdout:8/852: rmdir d3/d7/d40/d61 39 2024-02-15T18:27:20.178 INFO:tasks.workunit.client.1.smithi133.stdout:8/853: truncate d3/d1c/d2f/d87/d73/ff9 543525 0 2024-02-15T18:27:20.178 INFO:tasks.workunit.client.1.smithi133.stdout:8/854: dread - d3/de/d3e/dc4/f118 zero size 2024-02-15T18:27:20.178 INFO:tasks.workunit.client.1.smithi133.stdout:9/898: dwrite d0/d8/fd [0,4194304] 0 2024-02-15T18:27:20.180 INFO:tasks.workunit.client.1.smithi133.stdout:8/855: creat d3/de/d3e/d94/ded/d58/f11f x:0 0 0 2024-02-15T18:27:20.181 INFO:tasks.workunit.client.1.smithi133.stdout:9/899: mknod d0/d8/d10/d4d/d92/c127 0 2024-02-15T18:27:20.185 INFO:tasks.workunit.client.1.smithi133.stdout:9/900: creat d0/d37/f128 x:0 0 0 2024-02-15T18:27:20.187 INFO:tasks.workunit.client.1.smithi133.stdout:9/901: link d0/d8/d10/ce0 d0/d37/c129 0 2024-02-15T18:27:20.188 INFO:tasks.workunit.client.1.smithi133.stdout:5/973: dwrite d17/d26/d7b/deb/f116 [0,4194304] 0 2024-02-15T18:27:20.190 INFO:tasks.workunit.client.1.smithi133.stdout:5/974: write d17/d26/d7b/f89 [2042272,5499] 0 2024-02-15T18:27:20.190 INFO:tasks.workunit.client.1.smithi133.stdout:5/975: chown d17/d20/d4f/d5f/d106 13433057 1 2024-02-15T18:27:20.192 INFO:tasks.workunit.client.1.smithi133.stdout:5/976: creat d17/d20/d32/d9d/da9/f140 x:0 0 0 2024-02-15T18:27:20.198 INFO:tasks.workunit.client.1.smithi133.stdout:5/977: creat d17/d26/d7b/d87/f141 x:0 0 0 2024-02-15T18:27:20.200 INFO:tasks.workunit.client.1.smithi133.stdout:5/978: rename d17/d20/d32/d9d/l9e to d17/d20/d32/d38/d86/dd7/l142 0 2024-02-15T18:27:20.201 INFO:tasks.workunit.client.1.smithi133.stdout:5/979: creat d17/d26/d7b/deb/f143 x:0 0 0 2024-02-15T18:27:20.209 INFO:tasks.workunit.client.1.smithi133.stdout:5/980: dread d17/d20/d32/d9d/da9/f118 [0,4194304] 0 2024-02-15T18:27:20.209 INFO:tasks.workunit.client.1.smithi133.stdout:7/980: dwrite d9/db/d16/d5d/d68/d73/d9c/fab [0,4194304] 0 2024-02-15T18:27:20.209 INFO:tasks.workunit.client.1.smithi133.stdout:8/856: dwrite d3/d1c/d2f/d76/fe9 [0,4194304] 0 2024-02-15T18:27:20.209 INFO:tasks.workunit.client.1.smithi133.stdout:8/857: readlink d3/d92/lf1 0 2024-02-15T18:27:20.210 INFO:tasks.workunit.client.1.smithi133.stdout:7/981: write d9/db/d16/d5d/d68/da2/f111 [4315165,109819] 0 2024-02-15T18:27:20.210 INFO:tasks.workunit.client.1.smithi133.stdout:7/982: dread - d9/db/d16/d5d/d68/da2/dd8/f10b zero size 2024-02-15T18:27:20.210 INFO:tasks.workunit.client.1.smithi133.stdout:8/858: write d3/d1f/f2c [83948,101292] 0 2024-02-15T18:27:20.215 INFO:tasks.workunit.client.1.smithi133.stdout:5/981: rename d17/d20/d5e/f77 to d17/d20/dc3/ded/f144 0 2024-02-15T18:27:20.217 INFO:tasks.workunit.client.1.smithi133.stdout:7/983: truncate d9/fd2 3955657 0 2024-02-15T18:27:20.217 INFO:tasks.workunit.client.1.smithi133.stdout:7/984: write d9/db/d16/d5d/d68/d73/d9c/f11c [919767,6730] 0 2024-02-15T18:27:20.218 INFO:tasks.workunit.client.1.smithi133.stdout:8/859: creat d3/d92/f120 x:0 0 0 2024-02-15T18:27:20.224 INFO:tasks.workunit.client.1.smithi133.stdout:7/985: creat d9/d36/d39/f13e x:0 0 0 2024-02-15T18:27:20.224 INFO:tasks.workunit.client.1.smithi133.stdout:7/986: truncate d9/da/d48/d62/d64/f120 510014 0 2024-02-15T18:27:20.225 INFO:tasks.workunit.client.1.smithi133.stdout:8/860: mknod d3/de/d3e/d94/ded/d58/c121 0 2024-02-15T18:27:20.225 INFO:tasks.workunit.client.1.smithi133.stdout:8/861: fsync d3/d1c/f51 0 2024-02-15T18:27:20.225 INFO:tasks.workunit.client.1.smithi133.stdout:8/862: fdatasync d3/d1f/f2c 0 2024-02-15T18:27:20.227 INFO:tasks.workunit.client.1.smithi133.stdout:7/987: creat d9/d36/d39/f13f x:0 0 0 2024-02-15T18:27:20.231 INFO:tasks.workunit.client.1.smithi133.stdout:7/988: dread d9/d36/d31/dc1/dcd/dde/d84/fb8 [0,4194304] 0 2024-02-15T18:27:20.231 INFO:tasks.workunit.client.1.smithi133.stdout:5/982: rmdir d17/d20 39 2024-02-15T18:27:20.237 INFO:tasks.workunit.client.1.smithi133.stdout:8/863: rmdir d3/d7/d40/d61 39 2024-02-15T18:27:20.237 INFO:tasks.workunit.client.1.smithi133.stdout:7/989: creat d9/d36/d39/f140 x:0 0 0 2024-02-15T18:27:20.239 INFO:tasks.workunit.client.1.smithi133.stdout:5/983: mknod d17/d20/d5e/db1/c145 0 2024-02-15T18:27:20.239 INFO:tasks.workunit.client.1.smithi133.stdout:5/984: stat d17/d20/f132 0 2024-02-15T18:27:20.239 INFO:tasks.workunit.client.1.smithi133.stdout:5/985: dread - d17/d26/f11f zero size 2024-02-15T18:27:20.239 INFO:tasks.workunit.client.1.smithi133.stdout:5/986: write d17/f7a [478553,53171] 0 2024-02-15T18:27:20.239 INFO:tasks.workunit.client.1.smithi133.stdout:5/987: write d17/d20/d32/d9d/da9/de6/f13e [880271,10110] 0 2024-02-15T18:27:20.239 INFO:tasks.workunit.client.1.smithi133.stdout:8/864: creat d3/d1f/dde/d108/f122 x:0 0 0 2024-02-15T18:27:20.239 INFO:tasks.workunit.client.1.smithi133.stdout:8/865: chown d3/f14 157758 1 2024-02-15T18:27:20.240 INFO:tasks.workunit.client.1.smithi133.stdout:7/990: creat d9/db/d16/d4f/df3/f141 x:0 0 0 2024-02-15T18:27:20.246 INFO:tasks.workunit.client.1.smithi133.stdout:7/991: rename d9/d36/d3d/d4c/d97/de4/f132 to d9/d36/d3d/d4c/d97/da9/f142 0 2024-02-15T18:27:20.246 INFO:tasks.workunit.client.1.smithi133.stdout:8/866: truncate d3/f86 932853 0 2024-02-15T18:27:20.246 INFO:tasks.workunit.client.1.smithi133.stdout:8/867: readlink d3/d1c/d2f/d87/lb5 0 2024-02-15T18:27:20.247 INFO:tasks.workunit.client.1.smithi133.stdout:5/988: dread d17/d20/d32/d38/d70/f91 [0,4194304] 0 2024-02-15T18:27:20.247 INFO:tasks.workunit.client.1.smithi133.stdout:7/992: unlink f6 0 2024-02-15T18:27:20.248 INFO:tasks.workunit.client.1.smithi133.stdout:7/993: write d9/d36/f37 [846900,101752] 0 2024-02-15T18:27:20.248 INFO:tasks.workunit.client.1.smithi133.stdout:8/868: mkdir d3/de/d123 0 2024-02-15T18:27:20.251 INFO:tasks.workunit.client.1.smithi133.stdout:5/989: unlink d17/d26/d7b/lf7 0 2024-02-15T18:27:20.252 INFO:tasks.workunit.client.1.smithi133.stdout:7/994: mknod d9/db/d16/d10d/d12b/c143 0 2024-02-15T18:27:20.252 INFO:tasks.workunit.client.1.smithi133.stdout:5/990: read d17/d20/d32/d9d/fa5 [1124766,85542] 0 2024-02-15T18:27:20.253 INFO:tasks.workunit.client.1.smithi133.stdout:5/991: mknod d17/d20/d32/d9d/da9/d13b/c146 0 2024-02-15T18:27:20.253 INFO:tasks.workunit.client.1.smithi133.stdout:8/869: write d3/d7/d40/d61/fdc [2588099,67096] 0 2024-02-15T18:27:20.256 INFO:tasks.workunit.client.1.smithi133.stdout:7/995: dread d9/d36/d3d/d4c/d97/de4/fc4 [0,4194304] 0 2024-02-15T18:27:20.256 INFO:tasks.workunit.client.1.smithi133.stdout:7/996: fdatasync d9/da/f10e 0 2024-02-15T18:27:20.256 INFO:tasks.workunit.client.1.smithi133.stdout:5/992: mkdir d17/d26/d7b/d87/d147 0 2024-02-15T18:27:20.269 INFO:tasks.workunit.client.1.smithi133.stdout:8/870: link d3/d7/d40/fd0 d3/d1c/d2f/d87/d73/f124 0 2024-02-15T18:27:20.269 INFO:tasks.workunit.client.1.smithi133.stdout:7/997: rename d9/d36/d39/dd0/f66 to d9/db/d16/d5d/d68/d73/d9c/f144 0 2024-02-15T18:27:20.269 INFO:tasks.workunit.client.1.smithi133.stdout:5/993: dread d17/d20/d4f/d5f/d93/dec/f2d [0,4194304] 0 2024-02-15T18:27:20.274 INFO:tasks.workunit.client.1.smithi133.stdout:8/871: link d3/d1c/d2f/d87/d73/d84/f98 d3/d92/db4/f125 0 2024-02-15T18:27:20.274 INFO:tasks.workunit.client.1.smithi133.stdout:7/998: write d9/d36/d39/dd0/fe9 [880912,113470] 0 2024-02-15T18:27:20.274 INFO:tasks.workunit.client.1.smithi133.stdout:7/999: stat d9/db/d16/d4f/df3/f141 0 2024-02-15T18:27:20.277 INFO:tasks.workunit.client.1.smithi133.stdout:8/872: read d3/d1c/d2f/d76/f77 [2357821,60444] 0 2024-02-15T18:27:20.279 INFO:tasks.workunit.client.1.smithi133.stdout:8/873: write d3/d7/f72 [571363,12538] 0 2024-02-15T18:27:20.287 INFO:tasks.workunit.client.1.smithi133.stdout:8/874: dread d3/d1f/f31 [0,4194304] 0 2024-02-15T18:27:20.289 INFO:tasks.workunit.client.1.smithi133.stdout:8/875: symlink d3/d1c/d2f/d87/d9b/l126 0 2024-02-15T18:27:20.291 INFO:tasks.workunit.client.1.smithi133.stdout:8/876: dread d3/f46 [0,4194304] 0 2024-02-15T18:27:20.315 INFO:tasks.workunit.client.1.smithi133.stdout:8/877: dwrite d3/d7/d40/d61/fdc [0,4194304] 0 2024-02-15T18:27:20.315 INFO:tasks.workunit.client.1.smithi133.stdout:8/878: write d3/d7/d40/fd0 [1397215,77197] 0 2024-02-15T18:27:20.316 INFO:tasks.workunit.client.1.smithi133.stdout:8/879: write d3/d1c/d2f/d87/fbf [91831,81177] 0 2024-02-15T18:27:20.332 INFO:tasks.workunit.client.1.smithi133.stdout:8/880: truncate d3/d1c/d2f/d87/fbf 769805 0 2024-02-15T18:27:20.334 INFO:tasks.workunit.client.1.smithi133.stdout:8/881: truncate d3/f3a 105126 0 2024-02-15T18:27:20.337 INFO:tasks.workunit.client.1.smithi133.stdout:8/882: unlink d3/d1c/d2f/l7f 0 2024-02-15T18:27:20.363 INFO:tasks.workunit.client.1.smithi133.stdout:8/883: dwrite d3/de/d3e/d82/d8b/fd2 [0,4194304] 0 2024-02-15T18:27:20.371 INFO:tasks.workunit.client.1.smithi133.stdout:8/884: creat d3/d1c/d2f/d87/d9b/f127 x:0 0 0 2024-02-15T18:27:20.383 INFO:tasks.workunit.client.1.smithi133.stdout:8/885: dread d3/d1f/f2a [4194304,4194304] 0 2024-02-15T18:27:20.384 INFO:tasks.workunit.client.1.smithi133.stdout:8/886: getdents d3/de/d3e 0 2024-02-15T18:27:20.384 INFO:tasks.workunit.client.1.smithi133.stdout:8/887: truncate d3/d1f/dde/d108/f112 911637 0 2024-02-15T18:27:20.384 INFO:tasks.workunit.client.1.smithi133.stdout:8/888: creat d3/d7/d52/f128 x:0 0 0 2024-02-15T18:27:20.385 INFO:tasks.workunit.client.1.smithi133.stdout:8/889: mknod d3/de/d3e/d94/c129 0 2024-02-15T18:27:20.386 INFO:tasks.workunit.client.1.smithi133.stdout:8/890: getdents d3/d1c/d2f/d87/d73 0 2024-02-15T18:27:20.387 INFO:tasks.workunit.client.1.smithi133.stdout:8/891: getdents d3/de/d3e/d94/ded 0 2024-02-15T18:27:20.387 INFO:tasks.workunit.client.1.smithi133.stdout:8/892: write d3/de/d3e/d82/f119 [171015,16667] 0 2024-02-15T18:27:20.389 INFO:tasks.workunit.client.1.smithi133.stdout:8/893: mknod d3/d1f/d4f/dae/c12a 0 2024-02-15T18:27:20.390 INFO:tasks.workunit.client.1.smithi133.stdout:8/894: getdents d3/d1c/d2f/d87/d73/d84/dd3 0 2024-02-15T18:27:20.392 INFO:tasks.workunit.client.1.smithi133.stdout:8/895: symlink d3/d1c/d2f/d87/l12b 0 2024-02-15T18:27:20.395 INFO:tasks.workunit.client.1.smithi133.stdout:8/896: write d3/de/d3e/d94/ded/f41 [5757380,21985] 0 2024-02-15T18:27:20.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/897: creat d3/de/d3e/f12c x:0 0 0 2024-02-15T18:27:20.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/898: fdatasync d3/d1c/fa9 0 2024-02-15T18:27:20.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/899: dread - d3/de/d3e/d94/ded/d58/fd9 zero size 2024-02-15T18:27:20.398 INFO:tasks.workunit.client.1.smithi133.stdout:8/900: write d3/d1f/dde/f11a [168683,3568] 0 2024-02-15T18:27:20.421 INFO:tasks.workunit.client.1.smithi133.stdout:8/901: dwrite d3/d1c/d2f/d87/d73/d84/f98 [4194304,4194304] 0 2024-02-15T18:27:20.421 INFO:tasks.workunit.client.1.smithi133.stdout:8/902: creat d3/d1f/dde/d108/f12d x:0 0 0 2024-02-15T18:27:20.426 INFO:tasks.workunit.client.1.smithi133.stdout:8/903: rename d3/de/d3e/d82/fee to d3/de/d3e/d82/f12e 0 2024-02-15T18:27:20.426 INFO:tasks.workunit.client.1.smithi133.stdout:8/904: truncate d3/d1c/d37/f7b 3001823 0 2024-02-15T18:27:20.426 INFO:tasks.workunit.client.1.smithi133.stdout:8/905: creat d3/d7/d40/dce/f12f x:0 0 0 2024-02-15T18:27:20.445 INFO:tasks.workunit.client.1.smithi133.stdout:9/902: sync 2024-02-15T18:27:20.450 INFO:tasks.workunit.client.1.smithi133.stdout:8/906: dwrite d3/de/d3e/d94/ded/d58/fb3 [0,4194304] 0 2024-02-15T18:27:20.450 INFO:tasks.workunit.client.1.smithi133.stdout:8/907: dread - d3/de/d3e/dc4/f118 zero size 2024-02-15T18:27:20.452 INFO:tasks.workunit.client.1.smithi133.stdout:8/908: mknod d3/de/d3e/c130 0 2024-02-15T18:27:20.453 INFO:tasks.workunit.client.1.smithi133.stdout:8/909: link d3/d1c/d37/df0/l10e d3/d1c/d2f/d87/d73/d84/dda/l131 0 2024-02-15T18:27:20.453 INFO:tasks.workunit.client.1.smithi133.stdout:8/910: write d3/d1c/d2f/d87/d73/d84/dda/f100 [387485,13264] 0 2024-02-15T18:27:20.454 INFO:tasks.workunit.client.1.smithi133.stdout:8/911: chown d3/d1f/f2c 190 1 2024-02-15T18:27:20.454 INFO:tasks.workunit.client.1.smithi133.stdout:8/912: dread - d3/d7/d52/f83 zero size 2024-02-15T18:27:20.456 INFO:tasks.workunit.client.1.smithi133.stdout:5/994: sync 2024-02-15T18:27:20.462 INFO:tasks.workunit.client.1.smithi133.stdout:5/995: dread d17/f33 [0,4194304] 0 2024-02-15T18:27:20.462 INFO:tasks.workunit.client.1.smithi133.stdout:5/996: truncate d17/d20/d32/d9d/da9/ffd 764890 0 2024-02-15T18:27:20.465 INFO:tasks.workunit.client.1.smithi133.stdout:5/997: write d17/d20/d4f/f97 [2002383,1278] 0 2024-02-15T18:27:20.475 INFO:tasks.workunit.client.1.smithi133.stdout:9/903: dread d0/d8/d9/d12/d82/d42/d44/f7a [0,4194304] 0 2024-02-15T18:27:20.487 INFO:tasks.workunit.client.1.smithi133.stdout:8/913: dwrite d3/d7/d40/d61/fd1 [4194304,4194304] 0 2024-02-15T18:27:20.487 INFO:tasks.workunit.client.1.smithi133.stdout:8/914: chown d3/de/f9a 48769 1 2024-02-15T18:27:20.487 INFO:tasks.workunit.client.1.smithi133.stdout:8/915: truncate d3/d1f/f2c 3542383 0 2024-02-15T18:27:20.487 INFO:tasks.workunit.client.1.smithi133.stdout:8/916: stat d3/de/d3e/d94/ded/d58/fd9 0 2024-02-15T18:27:20.490 INFO:tasks.workunit.client.1.smithi133.stdout:5/998: dread d17/d20/d4f/f97 [0,4194304] 0 2024-02-15T18:27:20.537 INFO:tasks.workunit.client.1.smithi133.stdout:9/904: rename d0/d8/d9/d12/d82/ff9 to d0/d8/d9/d49/f12a 0 2024-02-15T18:27:20.538 INFO:tasks.workunit.client.1.smithi133.stdout:9/905: write d0/d8/d9/d12/d82/f40 [3159838,35824] 0 2024-02-15T18:27:20.561 INFO:tasks.workunit.client.1.smithi133.stdout:5/999: mknod d17/d26/d7b/deb/c148 0 2024-02-15T18:27:20.561 INFO:tasks.workunit.client.1.smithi133.stdout:9/906: mkdir d0/d8/d9/d12/d82/d42/d79/d90/de8/d12b 0 2024-02-15T18:27:20.582 INFO:tasks.workunit.client.1.smithi133.stdout:9/907: dwrite d0/d8/d9/d12/d82/d42/d79/f10b [0,4194304] 0 2024-02-15T18:27:20.583 INFO:tasks.workunit.client.1.smithi133.stdout:9/908: fdatasync d0/d8/d9/d12/f21 0 2024-02-15T18:27:20.583 INFO:tasks.workunit.client.1.smithi133.stdout:9/909: readlink d0/l24 0 2024-02-15T18:27:20.605 INFO:tasks.workunit.client.1.smithi133.stdout:9/910: dwrite d0/d8/d9/d49/f8e [0,4194304] 0 2024-02-15T18:27:20.620 INFO:tasks.workunit.client.1.smithi133.stdout:8/917: mkdir d3/d1f/d4f/d132 0 2024-02-15T18:27:20.623 INFO:tasks.workunit.client.1.smithi133.stdout:8/918: symlink d3/d7/d40/d61/dc8/l133 0 2024-02-15T18:27:20.623 INFO:tasks.workunit.client.1.smithi133.stdout:8/919: fsync d3/d1c/d2f/d87/d73/ff9 0 2024-02-15T18:27:20.624 INFO:tasks.workunit.client.1.smithi133.stdout:9/911: rename d0/d8/d9/d12/d82/d89/fed to d0/d8/d9/d12/d82/d42/d115/f12c 0 2024-02-15T18:27:20.624 INFO:tasks.workunit.client.1.smithi133.stdout:8/920: truncate d3/de/f53 3208530 0 2024-02-15T18:27:20.626 INFO:tasks.workunit.client.1.smithi133.stdout:9/912: unlink d0/d8/d9/d12/d82/d42/d44/de1/f111 0 2024-02-15T18:27:20.627 INFO:tasks.workunit.client.1.smithi133.stdout:8/921: truncate d3/d92/db4/f125 1890252 0 2024-02-15T18:27:20.627 INFO:tasks.workunit.client.1.smithi133.stdout:8/922: fdatasync d3/de/d3e/dc4/f113 0 2024-02-15T18:27:20.628 INFO:tasks.workunit.client.1.smithi133.stdout:8/923: mkdir d3/d7/d40/d61/dc8/d102/d134 0 2024-02-15T18:27:20.631 INFO:tasks.workunit.client.1.smithi133.stdout:9/913: dread d0/d8/d9/d12/f21 [0,4194304] 0 2024-02-15T18:27:20.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:18.688792+0000 mgr.smithi084.hjmnez (mgr.14596) 31 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 239 MiB/s rd, 481 MiB/s wr, 753 op/s 2024-02-15T18:27:20.655 INFO:tasks.workunit.client.1.smithi133.stdout:8/924: dwrite d3/d92/db4/fe2 [0,4194304] 0 2024-02-15T18:27:20.655 INFO:tasks.workunit.client.1.smithi133.stdout:8/925: truncate d3/de/d3e/dc4/f118 864056 0 2024-02-15T18:27:20.655 INFO:tasks.workunit.client.1.smithi133.stdout:8/926: chown d3/d92/f120 351509850 1 2024-02-15T18:27:20.655 INFO:tasks.workunit.client.1.smithi133.stdout:8/927: write d3/f2e [1610155,125320] 0 2024-02-15T18:27:20.655 INFO:tasks.workunit.client.1.smithi133.stdout:8/928: chown d3/d92/fbd 40854092 1 2024-02-15T18:27:20.655 INFO:tasks.workunit.client.1.smithi133.stdout:8/929: dread - d3/de/d3e/d82/f12e zero size 2024-02-15T18:27:20.655 INFO:tasks.workunit.client.1.smithi133.stdout:9/914: dwrite d0/f100 [0,4194304] 0 2024-02-15T18:27:20.657 INFO:tasks.workunit.client.1.smithi133.stdout:8/930: truncate d3/d1c/d37/d5c/f89 479451 0 2024-02-15T18:27:20.659 INFO:tasks.workunit.client.1.smithi133.stdout:9/915: mkdir d0/d37/de5/d12d 0 2024-02-15T18:27:20.659 INFO:tasks.workunit.client.1.smithi133.stdout:9/916: readlink d0/d8/d9/d12/d82/d42/d44/l53 0 2024-02-15T18:27:20.659 INFO:tasks.workunit.client.1.smithi133.stdout:8/931: mknod d3/de/d3e/d94/dc9/c135 0 2024-02-15T18:27:20.671 INFO:tasks.workunit.client.1.smithi133.stdout:8/932: dread d3/de/d3e/d82/f119 [0,4194304] 0 2024-02-15T18:27:20.675 INFO:tasks.workunit.client.1.smithi133.stdout:8/933: write d3/de/f1d [3367744,50559] 0 2024-02-15T18:27:20.675 INFO:tasks.workunit.client.1.smithi133.stdout:8/934: chown d3/d1c/d2f/d87/d73/d84/dda/f100 216 1 2024-02-15T18:27:20.676 INFO:tasks.workunit.client.1.smithi133.stdout:8/935: truncate d3/f81 3763217 0 2024-02-15T18:27:20.677 INFO:tasks.workunit.client.1.smithi133.stdout:8/936: creat d3/d1c/f136 x:0 0 0 2024-02-15T18:27:20.677 INFO:tasks.workunit.client.1.smithi133.stdout:8/937: write d3/de/f9a [965445,29436] 0 2024-02-15T18:27:20.678 INFO:tasks.workunit.client.1.smithi133.stdout:8/938: symlink d3/d1c/l137 0 2024-02-15T18:27:20.680 INFO:tasks.workunit.client.1.smithi133.stdout:8/939: rmdir d3/d1c/d2f/d87/d73/d84 39 2024-02-15T18:27:20.680 INFO:tasks.workunit.client.1.smithi133.stdout:8/940: chown d3/d7/d52/ff5 1 1 2024-02-15T18:27:20.680 INFO:tasks.workunit.client.1.smithi133.stdout:8/941: readlink d3/d1c/d2f/d76/ld4 0 2024-02-15T18:27:20.680 INFO:tasks.workunit.client.1.smithi133.stdout:9/917: dwrite d0/d8/d9/d12/d82/d42/d44/de1/f109 [0,4194304] 0 2024-02-15T18:27:20.682 INFO:tasks.workunit.client.1.smithi133.stdout:8/942: rename d3/d92/db4/fe2 to d3/d7/d40/f138 0 2024-02-15T18:27:20.683 INFO:tasks.workunit.client.1.smithi133.stdout:9/918: creat d0/d8/d10/d4d/dc6/f12e x:0 0 0 2024-02-15T18:27:20.684 INFO:tasks.workunit.client.1.smithi133.stdout:9/919: write d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/f116 [354828,121431] 0 2024-02-15T18:27:20.687 INFO:tasks.workunit.client.1.smithi133.stdout:9/920: unlink d0/d8/d10/f11 0 2024-02-15T18:27:20.687 INFO:tasks.workunit.client.1.smithi133.stdout:8/943: rename d3/d1f/dde/d108 to d3/d1c/d2f/d87/d73/d84/dd3/d139 0 2024-02-15T18:27:20.689 INFO:tasks.workunit.client.1.smithi133.stdout:8/944: mkdir d3/de/d3e/d82/d13a 0 2024-02-15T18:27:20.689 INFO:tasks.workunit.client.1.smithi133.stdout:9/921: write d0/d8/fcf [2330025,78840] 0 2024-02-15T18:27:20.690 INFO:tasks.workunit.client.1.smithi133.stdout:9/922: write d0/d8/d9/fcd [1033409,104000] 0 2024-02-15T18:27:20.691 INFO:tasks.workunit.client.1.smithi133.stdout:8/945: mkdir d3/de/d3e/d94/ded/d13b 0 2024-02-15T18:27:20.692 INFO:tasks.workunit.client.1.smithi133.stdout:8/946: stat d3/de/c8a 0 2024-02-15T18:27:20.696 INFO:tasks.workunit.client.1.smithi133.stdout:9/923: getdents d0/d8 0 2024-02-15T18:27:20.696 INFO:tasks.workunit.client.1.smithi133.stdout:8/947: creat d3/d1c/f13c x:0 0 0 2024-02-15T18:27:20.696 INFO:tasks.workunit.client.1.smithi133.stdout:8/948: write d3/de/fd6 [5128195,24098] 0 2024-02-15T18:27:20.697 INFO:tasks.workunit.client.1.smithi133.stdout:9/924: write d0/d8/d9/d12/d82/d42/d79/d90/de8/df5/f116 [494987,10552] 0 2024-02-15T18:27:20.707 INFO:tasks.workunit.client.1.smithi133.stdout:8/949: truncate d3/d7/f26 2353480 0 2024-02-15T18:27:20.718 INFO:tasks.workunit.client.1.smithi133.stdout:9/925: creat d0/d8/d9/d12/d4f/d10c/f12f x:0 0 0 2024-02-15T18:27:20.718 INFO:tasks.workunit.client.1.smithi133.stdout:8/950: symlink d3/de/d3e/d82/d8b/l13d 0 2024-02-15T18:27:20.721 INFO:tasks.workunit.client.1.smithi133.stdout:8/951: rename d3/de/d3e/d94/ded/d58/lf8 to d3/d1c/d2f/d87/d73/d84/dd3/d139/l13e 0 2024-02-15T18:27:20.723 INFO:tasks.workunit.client.1.smithi133.stdout:9/926: dread d0/f6 [0,4194304] 0 2024-02-15T18:27:20.726 INFO:tasks.workunit.client.1.smithi133.stdout:9/927: dread d0/d8/d10/fd6 [0,4194304] 0 2024-02-15T18:27:20.726 INFO:tasks.workunit.client.1.smithi133.stdout:9/928: chown d0/d8/d10/db2/l93 167673927 1 2024-02-15T18:27:20.745 INFO:tasks.workunit.client.1.smithi133.stdout:8/952: dwrite d3/d92/f8d [0,4194304] 0 2024-02-15T18:27:20.745 INFO:tasks.workunit.client.1.smithi133.stdout:8/953: dread - d3/d1c/d2f/d87/d73/d84/dd3/d139/f122 zero size 2024-02-15T18:27:20.745 INFO:tasks.workunit.client.1.smithi133.stdout:8/954: write d3/f4 [4464337,9341] 0 2024-02-15T18:27:20.747 INFO:tasks.workunit.client.1.smithi133.stdout:8/955: mkdir d3/d1f/d4f/d13f 0 2024-02-15T18:27:20.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:18.688792+0000 mgr.smithi084.hjmnez (mgr.14596) 31 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 239 MiB/s rd, 481 MiB/s wr, 753 op/s 2024-02-15T18:27:20.778 INFO:tasks.workunit.client.1.smithi133.stdout:8/956: dwrite d3/f14 [4194304,4194304] 0 2024-02-15T18:27:20.796 INFO:tasks.workunit.client.1.smithi133.stdout:8/957: dwrite d3/d92/fbd [4194304,4194304] 0 2024-02-15T18:27:20.796 INFO:tasks.workunit.client.1.smithi133.stdout:8/958: read - d3/ffd zero size 2024-02-15T18:27:20.799 INFO:tasks.workunit.client.1.smithi133.stdout:8/959: unlink d3/d7/d40/d61/dc8/d102/c10f 0 2024-02-15T18:27:20.800 INFO:tasks.workunit.client.1.smithi133.stdout:8/960: symlink d3/de/d3e/d82/d8b/l140 0 2024-02-15T18:27:21.067 INFO:tasks.workunit.client.1.smithi133.stdout:9/929: sync 2024-02-15T18:27:21.067 INFO:tasks.workunit.client.1.smithi133.stdout:8/961: sync 2024-02-15T18:27:21.068 INFO:tasks.workunit.client.1.smithi133.stdout:8/962: unlink d3/de/d3e/d94/ded/fcc 0 2024-02-15T18:27:21.069 INFO:tasks.workunit.client.1.smithi133.stdout:8/963: mkdir d3/de/d3e/d82/d13a/d141 0 2024-02-15T18:27:21.069 INFO:tasks.workunit.client.1.smithi133.stdout:8/964: dread - d3/d1c/d2f/d87/f107 zero size 2024-02-15T18:27:21.071 INFO:tasks.workunit.client.1.smithi133.stdout:8/965: mkdir d3/d92/d142 0 2024-02-15T18:27:21.089 INFO:tasks.workunit.client.1.smithi133.stdout:9/930: dwrite d0/d8/d10/f14 [0,4194304] 0 2024-02-15T18:27:21.089 INFO:tasks.workunit.client.1.smithi133.stdout:8/966: dwrite d3/ffd [0,4194304] 0 2024-02-15T18:27:21.090 INFO:tasks.workunit.client.1.smithi133.stdout:9/931: mknod d0/d8/d9/d12/d82/d42/d79/c130 0 2024-02-15T18:27:21.116 INFO:tasks.workunit.client.1.smithi133.stdout:9/932: dwrite d0/d37/fd8 [4194304,4194304] 0 2024-02-15T18:27:21.116 INFO:tasks.workunit.client.1.smithi133.stdout:9/933: chown d0/d8/d9/ca4 117 1 2024-02-15T18:27:21.117 INFO:tasks.workunit.client.1.smithi133.stdout:8/967: dwrite d3/d1c/d2f/d87/d9b/f127 [0,4194304] 0 2024-02-15T18:27:21.122 INFO:tasks.workunit.client.1.smithi133.stdout:8/968: mknod d3/d7/d40/dce/c143 0 2024-02-15T18:27:21.126 INFO:tasks.workunit.client.1.smithi133.stdout:8/969: rename d3/de/d3e/f12c to d3/de/d3e/d94/ded/d8c/f144 0 2024-02-15T18:27:21.127 INFO:tasks.workunit.client.1.smithi133.stdout:8/970: symlink d3/d7/d52/l145 0 2024-02-15T18:27:21.133 INFO:tasks.workunit.client.1.smithi133.stdout:9/934: dwrite d0/d8/d9/d12/d4f/f85 [0,4194304] 0 2024-02-15T18:27:21.135 INFO:tasks.workunit.client.1.smithi133.stdout:9/935: unlink d0/d8/d9/d49/d4c/dba/ldc 0 2024-02-15T18:27:21.137 INFO:tasks.workunit.client.1.smithi133.stdout:8/971: dread d3/d92/fbd [0,4194304] 0 2024-02-15T18:27:21.137 INFO:tasks.workunit.client.1.smithi133.stdout:9/936: rename d0/d8/d10/db2/l93 to d0/d37/df7/dfa/l131 0 2024-02-15T18:27:21.138 INFO:tasks.workunit.client.1.smithi133.stdout:8/972: creat d3/de/d123/f146 x:0 0 0 2024-02-15T18:27:21.140 INFO:tasks.workunit.client.1.smithi133.stdout:9/937: rename d0/d8/d10/d4d/d92 to d0/d8/d9/d12/d82/d42/d79/d90/de8/d123/d132 0 2024-02-15T18:27:21.141 INFO:tasks.workunit.client.1.smithi133.stdout:9/938: link d0/d8/cf2 d0/d8/d10/d4d/c133 0 2024-02-15T18:27:21.141 INFO:tasks.workunit.client.1.smithi133.stdout:9/939: write d0/d8/d9/fcd [2074231,128464] 0 2024-02-15T18:27:21.141 INFO:tasks.workunit.client.1.smithi133.stdout:9/940: chown d0/d8/d10/d4d/dc6/f12e 1 1 2024-02-15T18:27:21.146 INFO:tasks.workunit.client.1.smithi133.stdout:8/973: dread d3/d1c/d2f/d76/f77 [0,4194304] 0 2024-02-15T18:27:21.146 INFO:tasks.workunit.client.1.smithi133.stdout:8/974: truncate d3/d1c/d37/d5c/f89 1151001 0 2024-02-15T18:27:21.148 INFO:tasks.workunit.client.1.smithi133.stdout:8/975: write d3/d1f/d4f/dab/fd8 [6921568,4261] 0 2024-02-15T18:27:21.166 INFO:tasks.workunit.client.1.smithi133.stdout:8/976: dwrite d3/d1c/d2f/d87/d73/d84/dd3/f11b [0,4194304] 0 2024-02-15T18:27:21.183 INFO:tasks.workunit.client.1.smithi133.stdout:8/977: dwrite d3/d7/d40/fd0 [0,4194304] 0 2024-02-15T18:27:21.186 INFO:tasks.workunit.client.1.smithi133.stdout:8/978: truncate d3/d7/f72 1764805 0 2024-02-15T18:27:21.186 INFO:tasks.workunit.client.1.smithi133.stdout:8/979: truncate d3/d7/d52/f83 942221 0 2024-02-15T18:27:21.203 INFO:tasks.workunit.client.1.smithi133.stdout:8/980: dwrite d3/d1c/d2f/d87/d73/d84/dd3/d139/f112 [0,4194304] 0 2024-02-15T18:27:21.206 INFO:tasks.workunit.client.1.smithi133.stdout:8/981: rename d3/de/d3e/d94/ded/f41 to d3/de/d3e/d94/ded/d58/f147 0 2024-02-15T18:27:21.206 INFO:tasks.workunit.client.1.smithi133.stdout:8/982: fdatasync d3/d1f/fa7 0 2024-02-15T18:27:21.206 INFO:tasks.workunit.client.1.smithi133.stdout:8/983: stat d3/de/d3e/d94/dc9 0 2024-02-15T18:27:21.206 INFO:tasks.workunit.client.1.smithi133.stdout:8/984: creat d3/de/d3e/d94/dc9/d105/f148 x:0 0 0 2024-02-15T18:27:21.221 INFO:tasks.workunit.client.1.smithi133.stdout:8/985: dwrite d3/d1c/d2f/d87/fbf [0,4194304] 0 2024-02-15T18:27:21.222 INFO:tasks.workunit.client.1.smithi133.stdout:8/986: write d3/f14 [1723878,65247] 0 2024-02-15T18:27:21.224 INFO:tasks.workunit.client.1.smithi133.stdout:8/987: symlink d3/de/d3e/d94/ded/l149 0 2024-02-15T18:27:21.242 INFO:tasks.workunit.client.1.smithi133.stdout:8/988: dwrite d3/d1c/d2f/d87/d73/f124 [0,4194304] 0 2024-02-15T18:27:21.242 INFO:tasks.workunit.client.1.smithi133.stdout:8/989: stat d3/d1f/dde 0 2024-02-15T18:27:21.242 INFO:tasks.workunit.client.1.smithi133.stdout:8/990: chown d3/de 1298261 1 2024-02-15T18:27:21.244 INFO:tasks.workunit.client.1.smithi133.stdout:8/991: dread d3/d1c/d2f/d87/fac [0,4194304] 0 2024-02-15T18:27:21.244 INFO:tasks.workunit.client.1.smithi133.stdout:8/992: fdatasync d3/de/d3e/d94/ded/d58/f78 0 2024-02-15T18:27:21.371 INFO:tasks.workunit.client.1.smithi133.stdout:9/941: sync 2024-02-15T18:27:21.372 INFO:tasks.workunit.client.1.smithi133.stdout:9/942: fsync d0/d37/fa0 0 2024-02-15T18:27:21.372 INFO:tasks.workunit.client.1.smithi133.stdout:9/943: fsync d0/d8/d9/d12/d82/d42/d79/d90/de8/f10f 0 2024-02-15T18:27:21.372 INFO:tasks.workunit.client.1.smithi133.stdout:8/993: sync 2024-02-15T18:27:21.373 INFO:tasks.workunit.client.1.smithi133.stdout:9/944: truncate d0/d8/f47 276168 0 2024-02-15T18:27:21.374 INFO:tasks.workunit.client.1.smithi133.stdout:8/994: write d3/d7/f4d [6389362,43964] 0 2024-02-15T18:27:21.374 INFO:tasks.workunit.client.1.smithi133.stdout:8/995: chown d3/de/d3e/d94/ded/d58/f147 70494873 1 2024-02-15T18:27:21.374 INFO:tasks.workunit.client.1.smithi133.stdout:8/996: write d3/de/d3e/d94/ded/f74 [3729624,109288] 0 2024-02-15T18:27:21.377 INFO:tasks.workunit.client.1.smithi133.stdout:8/997: unlink d3/d7/f26 0 2024-02-15T18:27:21.377 INFO:tasks.workunit.client.1.smithi133.stdout:8/998: write d3/f2e [1927084,31121] 0 2024-02-15T18:27:21.377 INFO:tasks.workunit.client.1.smithi133.stdout:8/999: write d3/d7/d40/d61/f65 [5594422,51113] 0 2024-02-15T18:27:21.395 INFO:tasks.workunit.client.1.smithi133.stdout:9/945: dwrite d0/d8/d9/fcd [0,4194304] 0 2024-02-15T18:27:21.395 INFO:tasks.workunit.client.1.smithi133.stdout:9/946: stat d0/d8/d10/daa/d11a/c11d 0 2024-02-15T18:27:21.397 INFO:tasks.workunit.client.1.smithi133.stdout:9/947: write d0/d8/d9/d12/d82/d42/d44/f7a [457269,36147] 0 2024-02-15T18:27:21.400 INFO:tasks.workunit.client.1.smithi133.stdout:9/948: link d0/d8/d10/d4d/dc6/f12e d0/d37/f134 0 2024-02-15T18:27:21.423 INFO:tasks.workunit.client.1.smithi133.stdout:9/949: dwrite d0/d8/d9/d49/d4c/f10d [0,4194304] 0 2024-02-15T18:27:21.438 INFO:tasks.workunit.client.1.smithi133.stdout:9/950: dread d0/d8/d9/d12/f1b [0,4194304] 0 2024-02-15T18:27:21.440 INFO:tasks.workunit.client.1.smithi133.stdout:9/951: symlink d0/d8/d9/d12/d82/d42/d79/l135 0 2024-02-15T18:27:21.440 INFO:tasks.workunit.client.1.smithi133.stdout:9/952: write d0/d7b/fd0 [508133,81445] 0 2024-02-15T18:27:21.441 INFO:tasks.workunit.client.1.smithi133.stdout:9/953: truncate d0/d8/d9/ff 1111019 0 2024-02-15T18:27:21.446 INFO:tasks.workunit.client.1.smithi133.stdout:9/954: creat d0/d8/d9/d12/d82/d42/d44/f136 x:0 0 0 2024-02-15T18:27:21.449 INFO:tasks.workunit.client.1.smithi133.stdout:9/955: creat d0/d8/d9/d12/d4f/d103/f137 x:0 0 0 2024-02-15T18:27:21.449 INFO:tasks.workunit.client.1.smithi133.stdout:9/956: fsync d0/d7b/db7/ffe 0 2024-02-15T18:27:21.450 INFO:tasks.workunit.client.1.smithi133.stdout:9/957: creat d0/d8/d10/f138 x:0 0 0 2024-02-15T18:27:21.463 INFO:tasks.workunit.client.1.smithi133.stdout:9/958: rmdir d0/d8/d9/d12/d4f/d103 39 2024-02-15T18:27:21.463 INFO:tasks.workunit.client.1.smithi133.stdout:9/959: fsync d0/d8/d10/d4d/f66 0 2024-02-15T18:27:21.464 INFO:tasks.workunit.client.1.smithi133.stdout:9/960: chown d0/d8/d10/da1 15 1 2024-02-15T18:27:21.473 INFO:tasks.workunit.client.1.smithi133.stdout:9/961: dread d0/d8/d9/d12/f64 [0,4194304] 0 2024-02-15T18:27:21.476 INFO:tasks.workunit.client.1.smithi133.stdout:9/962: write d0/d8/d9/d49/f6f [91260,14765] 0 2024-02-15T18:27:21.480 INFO:tasks.workunit.client.1.smithi133.stdout:9/963: dread d0/d8/d9/d49/d4c/f7d [0,4194304] 0 2024-02-15T18:27:21.481 INFO:tasks.workunit.client.1.smithi133.stdout:9/964: symlink d0/d8/d10/daa/l139 0 2024-02-15T18:27:21.483 INFO:tasks.workunit.client.1.smithi133.stdout:9/965: creat d0/d8/d9/d12/d4f/d103/f13a x:0 0 0 2024-02-15T18:27:21.484 INFO:tasks.workunit.client.1.smithi133.stdout:9/966: mknod d0/d8/d9/d12/c13b 0 2024-02-15T18:27:21.485 INFO:tasks.workunit.client.1.smithi133.stdout:9/967: creat d0/d8/d9/d12/d4f/d103/f13c x:0 0 0 2024-02-15T18:27:21.485 INFO:tasks.workunit.client.1.smithi133.stdout:9/968: fsync d0/d37/fa0 0 2024-02-15T18:27:21.485 INFO:tasks.workunit.client.1.smithi133.stdout:9/969: dread - d0/d7b/fbe zero size 2024-02-15T18:27:21.486 INFO:tasks.workunit.client.1.smithi133.stdout:9/970: creat d0/d8/d9/d12/d82/d89/f13d x:0 0 0 2024-02-15T18:27:21.489 INFO:tasks.workunit.client.1.smithi133.stdout:9/971: rmdir d0/d8/d9/d12/d82/d42/d79/d90 39 2024-02-15T18:27:21.490 INFO:tasks.workunit.client.1.smithi133.stdout:9/972: getdents d0/d37/de5 0 2024-02-15T18:27:21.492 INFO:tasks.workunit.client.1.smithi133.stdout:9/973: unlink d0/d8/d9/d12/d82/f7c 0 2024-02-15T18:27:21.493 INFO:tasks.workunit.client.1.smithi133.stdout:9/974: mknod d0/d8/d9/d12/d82/d42/c13e 0 2024-02-15T18:27:21.495 INFO:tasks.workunit.client.1.smithi133.stdout:9/975: symlink d0/d8/d9/d12/d4f/l13f 0 2024-02-15T18:27:21.498 INFO:tasks.workunit.client.1.smithi133.stdout:9/976: rmdir d0/d8/d9/d12/d82/d42/d44/de1 39 2024-02-15T18:27:21.499 INFO:tasks.workunit.client.1.smithi133.stdout:9/977: read d0/d8/d9/d12/d7f/d8f/fee [3984408,7356] 0 2024-02-15T18:27:21.501 INFO:tasks.workunit.client.1.smithi133.stdout:9/978: link d0/d8/d9/d12/d4f/d103/c108 d0/d8/d9/d12/d82/d42/d115/c140 0 2024-02-15T18:27:21.502 INFO:tasks.workunit.client.1.smithi133.stdout:9/979: symlink d0/d8/d9/l141 0 2024-02-15T18:27:21.505 INFO:tasks.workunit.client.1.smithi133.stdout:9/980: symlink d0/d8/d9/d12/d82/d42/d44/de1/l142 0 2024-02-15T18:27:21.505 INFO:tasks.workunit.client.1.smithi133.stdout:9/981: chown d0/d8/l18 62878 1 2024-02-15T18:27:21.520 INFO:tasks.workunit.client.1.smithi133.stdout:9/982: dwrite d0/d8/fd [4194304,4194304] 0 2024-02-15T18:27:21.520 INFO:tasks.workunit.client.1.smithi133.stdout:9/983: fdatasync d0/d8/d9/d12/d82/d42/d79/fb3 0 2024-02-15T18:27:21.521 INFO:tasks.workunit.client.1.smithi133.stdout:9/984: write d0/d7b/db7/ffe [486929,33852] 0 2024-02-15T18:27:21.522 INFO:tasks.workunit.client.1.smithi133.stdout:9/985: getdents d0/d8/d9/d49/dd4 0 2024-02-15T18:27:21.523 INFO:tasks.workunit.client.1.smithi133.stdout:9/986: write d0/fad [52692,110622] 0 2024-02-15T18:27:21.525 INFO:tasks.workunit.client.1.smithi133.stdout:9/987: dread d0/f7 [0,4194304] 0 2024-02-15T18:27:21.526 INFO:tasks.workunit.client.1.smithi133.stdout:9/988: symlink d0/d37/l143 0 2024-02-15T18:27:21.527 INFO:tasks.workunit.client.1.smithi133.stdout:9/989: link d0/d8/d9/d12/d82/d42/d79/d90/de8/f10f d0/d8/d9/d49/d4c/f144 0 2024-02-15T18:27:21.528 INFO:tasks.workunit.client.1.smithi133.stdout:9/990: truncate d0/d8/f52 561446 0 2024-02-15T18:27:21.528 INFO:tasks.workunit.client.1.smithi133.stdout:9/991: fdatasync d0/d8/d9/d12/d4f/d10c/f12f 0 2024-02-15T18:27:21.831 INFO:tasks.workunit.client.1.smithi133.stdout:9/992: sync 2024-02-15T18:27:21.847 INFO:tasks.workunit.client.1.smithi133.stdout:9/993: dwrite d0/d8/d9/d12/d4f/d103/f13a [0,4194304] 0 2024-02-15T18:27:21.849 INFO:tasks.workunit.client.1.smithi133.stdout:9/994: getdents d0/d8/d10/db2 0 2024-02-15T18:27:21.849 INFO:tasks.workunit.client.1.smithi133.stdout:9/995: truncate d0/d8/d9/d12/d4f/fe2 4000329 0 2024-02-15T18:27:21.852 INFO:tasks.workunit.client.1.smithi133.stdout:9/996: rename d0/d8/d10/d4d/l86 to d0/d8/d9/d12/d82/d42/d44/de1/l145 0 2024-02-15T18:27:21.852 INFO:tasks.workunit.client.1.smithi133.stdout:9/997: fdatasync d0/d37/f128 0 2024-02-15T18:27:21.853 INFO:tasks.workunit.client.1.smithi133.stdout:9/998: mkdir d0/d37/de5/d12d/d146 0 2024-02-15T18:27:21.853 INFO:tasks.workunit.client.1.smithi133.stdout:9/999: truncate d0/faf 782998 0 2024-02-15T18:27:21.856 INFO:tasks.workunit.client.1.smithi133.stderr:+ rm -rf -- ./tmp.6uK42qkLLg 2024-02-15T18:27:22.292 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:20.689117+0000 mgr.smithi084.hjmnez (mgr.14596) 32 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 152 MiB/s rd, 294 MiB/s wr, 483 op/s 2024-02-15T18:27:22.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:20.689117+0000 mgr.smithi084.hjmnez (mgr.14596) 32 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 152 MiB/s rd, 294 MiB/s wr, 483 op/s 2024-02-15T18:27:23.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:22.720090+0000 mon.smithi084 (mon.0) 699 : cluster [DBG] Standby manager daemon smithi133.nxzroj restarted 2024-02-15T18:27:23.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:22.720211+0000 mon.smithi084 (mon.0) 700 : cluster [DBG] Standby manager daemon smithi133.nxzroj started 2024-02-15T18:27:23.644 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:22.721265+0000 mon.smithi133 (mon.1) 25 : audit [DBG] from='mgr.? 172.21.15.133:0/1244846161' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/crt"}]: dispatch 2024-02-15T18:27:23.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:22.721718+0000 mon.smithi133 (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.133:0/1244846161' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:27:23.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:22.724276+0000 mon.smithi133 (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.133:0/1244846161' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/key"}]: dispatch 2024-02-15T18:27:23.645 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:22.725101+0000 mon.smithi133 (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.133:0/1244846161' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:27:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:22.720090+0000 mon.smithi084 (mon.0) 699 : cluster [DBG] Standby manager daemon smithi133.nxzroj restarted 2024-02-15T18:27:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:22.720211+0000 mon.smithi084 (mon.0) 700 : cluster [DBG] Standby manager daemon smithi133.nxzroj started 2024-02-15T18:27:23.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:22.721265+0000 mon.smithi133 (mon.1) 25 : audit [DBG] from='mgr.? 172.21.15.133:0/1244846161' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/crt"}]: dispatch 2024-02-15T18:27:23.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:22.721718+0000 mon.smithi133 (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.133:0/1244846161' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:27:23.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:22.724276+0000 mon.smithi133 (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.133:0/1244846161' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi133.nxzroj/key"}]: dispatch 2024-02-15T18:27:23.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:22.725101+0000 mon.smithi133 (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.133:0/1244846161' entity='mgr.smithi133.nxzroj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:27:24.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:22.689410+0000 mgr.smithi084.hjmnez (mgr.14596) 33 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 152 MiB/s rd, 295 MiB/s wr, 483 op/s 2024-02-15T18:27:24.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:23.288314+0000 mon.smithi084 (mon.0) 701 : cluster [DBG] mgrmap e29: smithi084.hjmnez(active, since 47s), standbys: smithi133.nxzroj 2024-02-15T18:27:24.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.107851+0000 mon.smithi084 (mon.0) 702 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.109755+0000 mon.smithi084 (mon.0) 703 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.110892+0000 mon.smithi084 (mon.0) 704 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.120274+0000 mon.smithi084 (mon.0) 705 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.127997+0000 mon.smithi084 (mon.0) 706 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.132807+0000 mon.smithi084 (mon.0) 707 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.141301+0000 mon.smithi084 (mon.0) 708 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.143939+0000 mon.smithi084 (mon.0) 709 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi084.hjmnez"}]: dispatch 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.149241+0000 mon.smithi084 (mon.0) 710 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi084.hjmnez"}]': finished 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.150607+0000 mon.smithi084 (mon.0) 711 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi133.nxzroj"}]: dispatch 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.157610+0000 mon.smithi084 (mon.0) 712 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi133.nxzroj"}]': finished 2024-02-15T18:27:24.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:24.160552+0000 mon.smithi084 (mon.0) 713 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T18:27:24.734 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:22.689410+0000 mgr.smithi084.hjmnez (mgr.14596) 33 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 152 MiB/s rd, 295 MiB/s wr, 483 op/s 2024-02-15T18:27:24.734 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:23.288314+0000 mon.smithi084 (mon.0) 701 : cluster [DBG] mgrmap e29: smithi084.hjmnez(active, since 47s), standbys: smithi133.nxzroj 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.107851+0000 mon.smithi084 (mon.0) 702 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.109755+0000 mon.smithi084 (mon.0) 703 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.110892+0000 mon.smithi084 (mon.0) 704 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.120274+0000 mon.smithi084 (mon.0) 705 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.127997+0000 mon.smithi084 (mon.0) 706 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.132807+0000 mon.smithi084 (mon.0) 707 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.141301+0000 mon.smithi084 (mon.0) 708 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.143939+0000 mon.smithi084 (mon.0) 709 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi084.hjmnez"}]: dispatch 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.149241+0000 mon.smithi084 (mon.0) 710 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi084.hjmnez"}]': finished 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.150607+0000 mon.smithi084 (mon.0) 711 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi133.nxzroj"}]: dispatch 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.157610+0000 mon.smithi084 (mon.0) 712 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi133.nxzroj"}]': finished 2024-02-15T18:27:24.735 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:24.160552+0000 mon.smithi084 (mon.0) 713 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T18:27:25.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:27:24.111793+0000 mgr.smithi084.hjmnez (mgr.14596) 34 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:27:25.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:27:24.134704+0000 mgr.smithi084.hjmnez (mgr.14596) 35 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-15T18:27:25.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:27:24.111793+0000 mgr.smithi084.hjmnez (mgr.14596) 34 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:27:25.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:27:24.134704+0000 mgr.smithi084.hjmnez (mgr.14596) 35 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-15T18:27:26.538 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cluster 2024-02-15T18:27:24.689829+0000 mgr.smithi084.hjmnez (mgr.14596) 36 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 180 MiB/s rd, 352 MiB/s wr, 629 op/s 2024-02-15T18:27:26.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:25.969150+0000 mon.smithi084 (mon.0) 714 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:26.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:25.969950+0000 mon.smithi084 (mon.0) 715 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:27:26.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:25.970501+0000 mon.smithi084 (mon.0) 716 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:27:26.539 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: audit 2024-02-15T18:27:25.970986+0000 mon.smithi084 (mon.0) 717 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:26.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:24.689829+0000 mgr.smithi084.hjmnez (mgr.14596) 36 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 180 MiB/s rd, 352 MiB/s wr, 629 op/s 2024-02-15T18:27:26.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:25.969150+0000 mon.smithi084 (mon.0) 714 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:26.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:25.969950+0000 mon.smithi084 (mon.0) 715 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:27:26.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:25.970501+0000 mon.smithi084 (mon.0) 716 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:27:26.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:25.970986+0000 mon.smithi084 (mon.0) 717 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:27.498 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:27:25.963350+0000 mgr.smithi084.hjmnez (mgr.14596) 37 : cephadm [INF] Upgrade: Updating mon.smithi084 2024-02-15T18:27:27.498 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: cephadm 2024-02-15T18:27:25.971526+0000 mgr.smithi084.hjmnez (mgr.14596) 38 : cephadm [INF] Deploying daemon mon.smithi084 on smithi084 2024-02-15T18:27:27.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:27:25.963350+0000 mgr.smithi084.hjmnez (mgr.14596) 37 : cephadm [INF] Upgrade: Updating mon.smithi084 2024-02-15T18:27:27.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:27:25.971526+0000 mgr.smithi084.hjmnez (mgr.14596) 38 : cephadm [INF] Deploying daemon mon.smithi084 on smithi084 2024-02-15T18:27:27.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:27 smithi084 systemd[1]: Stopping Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:27:28.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:27:27.927+0000 7f74c1da1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi084 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:27:28.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084[38210]: debug 2024-02-15T18:27:27.927+0000 7f74c1da1700 -1 mon.smithi084@0(leader) e2 *** Got Signal Terminated *** 2024-02-15T18:27:28.465 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-15T18:27:28.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-15T18:27:28.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:28 smithi084 bash[77261]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084 2024-02-15T18:27:29.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:29 smithi084 systemd[1]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084.service: Succeeded. 2024-02-15T18:27:29.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:29 smithi084 systemd[1]: Stopped Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:27:29.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:29 smithi084 systemd[1]: Starting Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:27:30.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.011+0000 7f8e4b870880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.011+0000 7f8e4b870880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.011+0000 7f8e4b870880 0 pidfile_write: ignore empty --pid-file 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.015+0000 7f8e4b870880 0 load: jerasure load: lrc load: isa 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: RocksDB version: 6.8.1 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Compile date Feb 8 2024 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: DB SUMMARY 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: CURRENT file: CURRENT 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-15T18:27:30.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 779 Bytes 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi084/store.db dir, Total Num: 1, files: 000020.sst 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi084/store.db: 000018.log size: 80013 ; 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.error_if_exists: 0 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.create_if_missing: 0 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.paranoid_checks: 1 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.env: 0x55e2083b0080 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.fs: Posix File System 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.info_log: 0x55e208e38560 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.statistics: (nil) 2024-02-15T18:27:30.262 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.use_fsync: 0 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_log_file_size: 0 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.allow_fallocate: 1 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.use_direct_reads: 0 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.db_log_dir: 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi084/store.db 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T18:27:30.263 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_subcompactions: 1 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_background_flushes: -1 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.write_buffer_manager: 0x55e209b2a420 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T18:27:30.264 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.unordered_write: 0 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.row_cache: None 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.wal_filter: None 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.preserve_deletes: 0 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.two_write_queues: 0 2024-02-15T18:27:30.265 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.atomic_flush: 0 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.log_readahead_size: 0 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_background_jobs: 2 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_background_compactions: -1 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T18:27:30.266 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.max_open_files: -1 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Compression algorithms supported: 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: kZSTD supported: 0 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: kXpressCompression supported: 0 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: kLZ4Compression supported: 1 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: kBZip2Compression supported: 0 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: kZlibCompression supported: 1 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: kSnappyCompression supported: 1 2024-02-15T18:27:30.267 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.016+0000 7f8e4b870880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T18:27:30.268 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000008 2024-02-15T18:27:30.268 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.merge_operator: 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_filter: None 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e208dddd28) 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cache_index_and_filter_blocks: 1 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T18:27:30.269 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: pin_top_level_index_and_filter: 1 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: index_type: 0 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: data_block_index_type: 0 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: index_shortening: 1 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: data_block_hash_table_util_ratio: 0.750000 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: hash_index_allow_collision: 1 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: checksum: 1 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: no_block_cache: 0 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: block_cache: 0x55e208e12f10 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: block_cache_name: BinnedLRUCache 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: block_cache_options: 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: capacity : 536870912 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: num_shard_bits : 4 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: strict_capacity_limit : 0 2024-02-15T18:27:30.270 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: high_pri_pool_ratio: 0.000 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: block_cache_compressed: (nil) 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: persistent_cache: (nil) 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: block_size: 4096 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: block_size_deviation: 10 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: block_restart_interval: 16 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: index_block_restart_interval: 1 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: metadata_block_size: 4096 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: partition_filters: 0 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: use_delta_encoding: 1 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: whole_key_filtering: 1 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: verify_compression: 0 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: read_amp_bytes_per_bit: 0 2024-02-15T18:27:30.271 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: format_version: 2 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: enable_index_compression: 1 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: block_align: 0 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compression: NoCompression 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.num_levels: 7 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T18:27:30.272 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T18:27:30.273 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T18:27:30.274 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T18:27:30.275 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.table_properties_collectors: 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.inplace_update_support: 0 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.bloom_locality: 0 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.max_successive_merges: 0 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T18:27:30.276 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.ttl: 2592000 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi084/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 22, last_sequence is 9210, log_number is 18,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 18 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021650018651, "job": 1, "event": "recovery_started", "log_files": [18]} 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.017+0000 7f8e4b870880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #18 mode 2 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.018+0000 7f8e4b870880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.018+0000 7f8e4b870880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021650019469, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 22, "file_size": 80878, "table_properties": {"data_size": 79838, "index_size": 160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 435, "raw_average_key_size": 22, "raw_value_size": 79349, "raw_average_value_size": 4176, "num_data_blocks": 5, "num_entries": 19, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708021650, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.018+0000 7f8e4b870880 4 rocksdb: [version_set.cc:3826] Creating manifest 23 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.277 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.018+0000 7f8e4b870880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.019+0000 7f8e4b870880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021650019936, "job": 1, "event": "recovery_finished"} 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.019+0000 7f8e4b870880 4 rocksdb: DB pointer 0x55e208edb800 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.020+0000 7f8e32661700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.020+0000 7f8e32661700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ** DB Stats ** 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.278 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ** Compaction Stats [default] ** 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: L0 1/0 78.98 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.6 0.00 0.00 1 0.001 0 0 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: L6 1/0 21.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Sum 2/0 21.88 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.6 0.00 0.00 1 0.001 0 0 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.6 0.00 0.00 1 0.001 0 0 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ** Compaction Stats [default] ** 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 125.6 0.00 0.00 1 0.001 0 0 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:27:30.279 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Cumulative compaction: 0.00 GB write, 27.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Interval compaction: 0.00 GB write, 27.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ** Compaction Stats [default] ** 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: L0 1/0 78.98 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.6 0.00 0.00 1 0.001 0 0 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: L6 1/0 21.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Sum 2/0 21.88 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.6 0.00 0.00 1 0.001 0 0 2024-02-15T18:27:30.280 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ** Compaction Stats [default] ** 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 125.6 0.00 0.00 1 0.001 0 0 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Cumulative compaction: 0.00 GB write, 27.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:27:30.281 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.020+0000 7f8e4b870880 0 starting mon.smithi084 rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi084 fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.021+0000 7f8e4b870880 1 mon.smithi084@-1(???) e2 preinit fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.021+0000 7f8e4b870880 0 mon.smithi084@-1(???).mds e15 new map 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.021+0000 7f8e4b870880 0 mon.smithi084@-1(???).mds e15 print_map 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: e15 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: legacy client fscid: 1 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Filesystem 'cephfs' (1) 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: fs_name cephfs 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: epoch 15 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: flags 12 2024-02-15T18:27:30.282 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: modified 2024-02-15T18:26:32.713494+0000 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: tableserver 0 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: root 0 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: session_timeout 60 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: session_autoclose 300 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: max_file_size 1099511627776 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: required_client_features {} 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: last_failure 0 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: last_failure_osd_epoch 0 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: max_mds 2 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: in 0,1 2024-02-15T18:27:30.283 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: up {0=24239,1=14438} 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: failed 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: damaged 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: stopped 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: data_pools [3] 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: metadata_pool 2 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: inline_data disabled 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: balancer 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: standby_count_wanted 1 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: [mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: [mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:30.284 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: Standby daemons: 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: [mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: [mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.021+0000 7f8e4b870880 0 mon.smithi084@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.021+0000 7f8e4b870880 0 mon.smithi084@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.021+0000 7f8e4b870880 0 mon.smithi084@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.021+0000 7f8e4b870880 0 mon.smithi084@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:27:25.963350+0000 mgr.smithi084.hjmnez (mgr.14596) 37 : cephadm [INF] Upgrade: Updating mon.smithi084 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:27:25.971526+0000 mgr.smithi084.hjmnez (mgr.14596) 38 : cephadm [INF] Deploying daemon mon.smithi084 on smithi084 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:27:30.022+0000 7f8e4b870880 1 mon.smithi084@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-15T18:27:30.285 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 bash[77465]: d26a1a91345568112c2ce568132ef3da0e18d51eaccfd53f0bdda4c07b7783f9 2024-02-15T18:27:30.286 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:30 smithi084 systemd[1]: Started Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:27.934445+0000 mon.smithi133 (mon.1) 29 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:27.934670+0000 mon.smithi133 (mon.1) 30 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:28.690667+0000 mgr.smithi084.hjmnez (mgr.14596) 40 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 92 MiB/s rd, 180 MiB/s wr, 469 op/s 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:31.434550+0000 mon.smithi084 (mon.0) 1 : cluster [INF] mon.smithi084 calling monitor election 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:31.452402+0000 mon.smithi084 (mon.0) 2 : cluster [INF] mon.smithi084 is new leader, mons smithi084,smithi133 in quorum (ranks 0,1) 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:31.462774+0000 mon.smithi084 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:31.463439+0000 mon.smithi084 (mon.0) 4 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:31.463485+0000 mon.smithi084 (mon.0) 5 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:31.466392+0000 mon.smithi084 (mon.0) 6 : cluster [DBG] mgrmap e29: smithi084.hjmnez(active, since 55s), standbys: smithi133.nxzroj 2024-02-15T18:27:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:31.480341+0000 mon.smithi084 (mon.0) 7 : cluster [INF] overall HEALTH_OK 2024-02-15T18:27:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:31.480533+0000 mon.smithi084 (mon.0) 8 : audit [INF] from='mgr.14596 ' entity='' 2024-02-15T18:27:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:31.482590+0000 mon.smithi133 (mon.1) 31 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:32.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:27.934445+0000 mon.smithi133 (mon.1) 29 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:27:32.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:27.934670+0000 mon.smithi133 (mon.1) 30 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:28.690667+0000 mgr.smithi084.hjmnez (mgr.14596) 40 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 92 MiB/s rd, 180 MiB/s wr, 469 op/s 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:31.434550+0000 mon.smithi084 (mon.0) 1 : cluster [INF] mon.smithi084 calling monitor election 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:31.452402+0000 mon.smithi084 (mon.0) 2 : cluster [INF] mon.smithi084 is new leader, mons smithi084,smithi133 in quorum (ranks 0,1) 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:31.462774+0000 mon.smithi084 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:31.463439+0000 mon.smithi084 (mon.0) 4 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:31.463485+0000 mon.smithi084 (mon.0) 5 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:31.466392+0000 mon.smithi084 (mon.0) 6 : cluster [DBG] mgrmap e29: smithi084.hjmnez(active, since 55s), standbys: smithi133.nxzroj 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:31.480341+0000 mon.smithi084 (mon.0) 7 : cluster [INF] overall HEALTH_OK 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:31.480533+0000 mon.smithi084 (mon.0) 8 : audit [INF] from='mgr.14596 ' entity='' 2024-02-15T18:27:32.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:31.482590+0000 mon.smithi133 (mon.1) 31 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:32.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:30.690978+0000 mgr.smithi084.hjmnez (mgr.14596) 41 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 59 MiB/s wr, 265 op/s 2024-02-15T18:27:32.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:31.534107+0000 mon.smithi084 (mon.0) 9 : cluster [DBG] mgrmap e30: smithi084.hjmnez(active, since 55s), standbys: smithi133.nxzroj 2024-02-15T18:27:32.854 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-15T18:27:32.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-15T18:27:32.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:30.690978+0000 mgr.smithi084.hjmnez (mgr.14596) 41 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 59 MiB/s wr, 265 op/s 2024-02-15T18:27:32.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:31.534107+0000 mon.smithi084 (mon.0) 9 : cluster [DBG] mgrmap e30: smithi084.hjmnez(active, since 55s), standbys: smithi133.nxzroj 2024-02-15T18:27:34.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:32.691319+0000 mgr.smithi084.hjmnez (mgr.14596) 42 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 59 MiB/s wr, 265 op/s 2024-02-15T18:27:35.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:32.691319+0000 mgr.smithi084.hjmnez (mgr.14596) 42 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 59 MiB/s wr, 265 op/s 2024-02-15T18:27:36.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:34.691850+0000 mgr.smithi084.hjmnez (mgr.14596) 43 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 472 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 28 MiB/s rd, 60 MiB/s wr, 422 op/s 2024-02-15T18:27:37.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:34.691850+0000 mgr.smithi084.hjmnez (mgr.14596) 43 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 472 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 28 MiB/s rd, 60 MiB/s wr, 422 op/s 2024-02-15T18:27:38.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:36.692212+0000 mgr.smithi084.hjmnez (mgr.14596) 44 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 472 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 276 op/s 2024-02-15T18:27:39.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:36.692212+0000 mgr.smithi084.hjmnez (mgr.14596) 44 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 472 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 276 op/s 2024-02-15T18:27:40.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.827+0000 7f3226e66700 1 -- 172.21.15.84:0/77706467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 msgr2=0x7f32200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:40.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.827+0000 7f3226e66700 1 --2- 172.21.15.84:0/77706467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 0x7f32200f6cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f320c004660 tx=0x7f320c009b30).stop 2024-02-15T18:27:40.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.827+0000 7f3226e66700 1 -- 172.21.15.84:0/77706467 shutdown_connections 2024-02-15T18:27:40.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.827+0000 7f3226e66700 1 --2- 172.21.15.84:0/77706467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 0x7f32200f6cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:40.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.827+0000 7f3226e66700 1 --2- 172.21.15.84:0/77706467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200f55c0 0x7f32200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:40.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.827+0000 7f3226e66700 1 -- 172.21.15.84:0/77706467 >> 172.21.15.84:0/77706467 conn(0x7f32200f0d40 msgr2=0x7f32200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:40.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.827+0000 7f3226e66700 1 -- 172.21.15.84:0/77706467 shutdown_connections 2024-02-15T18:27:40.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.827+0000 7f3226e66700 1 -- 172.21.15.84:0/77706467 wait complete. 2024-02-15T18:27:40.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.828+0000 7f3226e66700 1 Processor -- start 2024-02-15T18:27:40.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.828+0000 7f3226e66700 1 -- start start 2024-02-15T18:27:40.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.828+0000 7f3226e66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200f55c0 0x7f32200f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.828+0000 7f3226e66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 0x7f32200f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.828+0000 7f3226e66700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32200f8100 con 0x7f32200f6860 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.828+0000 7f3226e66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32200f8240 con 0x7f32200f55c0 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.828+0000 7f3224c02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200f55c0 0x7f32200f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.828+0000 7f321ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 0x7f32200f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f321ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 0x7f32200f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43710/0 (socket says 172.21.15.84:43710) 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f321ffff700 1 -- 172.21.15.84:0/3208334316 learned_addr learned my addr 172.21.15.84:0/3208334316 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f3224c02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200f55c0 0x7f32200f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.84:41126/0 (socket says 172.21.15.84:41126) 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f321ffff700 1 -- 172.21.15.84:0/3208334316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200f55c0 msgr2=0x7f32200f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f321ffff700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200f55c0 0x7f32200f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f321ffff700 1 -- 172.21.15.84:0/3208334316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c005040 con 0x7f32200f6860 2024-02-15T18:27:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f321ffff700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 0x7f32200f7ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f320c009f50 tx=0x7f320c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:40.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f321d7fa700 1 -- 172.21.15.84:0/3208334316 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f320c018070 con 0x7f32200f6860 2024-02-15T18:27:40.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32200f84c0 con 0x7f32200f6860 2024-02-15T18:27:40.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f321d7fa700 1 -- 172.21.15.84:0/3208334316 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f320c004290 con 0x7f32200f6860 2024-02-15T18:27:40.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f321d7fa700 1 -- 172.21.15.84:0/3208334316 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f320c01c3c0 con 0x7f32200f6860 2024-02-15T18:27:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.829+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32200f89a0 con 0x7f32200f6860 2024-02-15T18:27:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.830+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3220045ad0 con 0x7f32200f6860 2024-02-15T18:27:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.831+0000 7f321d7fa700 1 -- 172.21.15.84:0/3208334316 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 30) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f320c007ca0 con 0x7f32200f6860 2024-02-15T18:27:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.832+0000 7f321d7fa700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3210060fb0 0x7f3210063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.832+0000 7f321d7fa700 1 -- 172.21.15.84:0/3208334316 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f320c07e270 con 0x7f32200f6860 2024-02-15T18:27:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.832+0000 7f3224c02700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3210060fb0 0x7f3210063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.832+0000 7f3224c02700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3210060fb0 0x7f3210063470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f32200f94b0 tx=0x7f321400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:40.837+0000 7f321d7fa700 1 -- 172.21.15.84:0/3208334316 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f320c04e660 con 0x7f32200f6860 2024-02-15T18:27:40.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:38.692892+0000 mgr.smithi084.hjmnez (mgr.14596) 45 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 2.9 MiB/s wr, 502 op/s 2024-02-15T18:27:41.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:38.692892+0000 mgr.smithi084.hjmnez (mgr.14596) 45 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61 KiB/s rd, 2.9 MiB/s wr, 502 op/s 2024-02-15T18:27:41.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.098+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3220057f10 con 0x7f3210060fb0 2024-02-15T18:27:41.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.100+0000 7f321d7fa700 1 -- 172.21.15.84:0/3208334316 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f3220057f10 con 0x7f3210060fb0 2024-02-15T18:27:41.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3210060fb0 msgr2=0x7f3210063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3210060fb0 0x7f3210063470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f32200f94b0 tx=0x7f321400b040).stop 2024-02-15T18:27:41.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 msgr2=0x7f32200f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 0x7f32200f7ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f320c009f50 tx=0x7f320c009b30).stop 2024-02-15T18:27:41.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 shutdown_connections 2024-02-15T18:27:41.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3210060fb0 0x7f3210063470 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200f55c0 0x7f32200f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 --2- 172.21.15.84:0/3208334316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32200f6860 0x7f32200f7ba0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 >> 172.21.15.84:0/3208334316 conn(0x7f32200f0d40 msgr2=0x7f32200fb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:41.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 shutdown_connections 2024-02-15T18:27:41.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.102+0000 7f3226e66700 1 -- 172.21.15.84:0/3208334316 wait complete. 2024-02-15T18:27:41.113 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:27:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.230+0000 7f2c1b846700 1 -- 172.21.15.84:0/1065066855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 msgr2=0x7f2c140f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.230+0000 7f2c1b846700 1 --2- 172.21.15.84:0/1065066855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 0x7f2c140f5a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f2c10004660 tx=0x7f2c10009b30).stop 2024-02-15T18:27:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.230+0000 7f2c1b846700 1 -- 172.21.15.84:0/1065066855 shutdown_connections 2024-02-15T18:27:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.230+0000 7f2c1b846700 1 --2- 172.21.15.84:0/1065066855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140f5ef0 0x7f2c140f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.230+0000 7f2c1b846700 1 --2- 172.21.15.84:0/1065066855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 0x7f2c140f5a00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.230+0000 7f2c1b846700 1 -- 172.21.15.84:0/1065066855 >> 172.21.15.84:0/1065066855 conn(0x7f2c140f0de0 msgr2=0x7f2c140f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:41.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.230+0000 7f2c1b846700 1 -- 172.21.15.84:0/1065066855 shutdown_connections 2024-02-15T18:27:41.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.230+0000 7f2c1b846700 1 -- 172.21.15.84:0/1065066855 wait complete. 2024-02-15T18:27:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c1b846700 1 Processor -- start 2024-02-15T18:27:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c1b846700 1 -- start start 2024-02-15T18:27:41.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c1b846700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 0x7f2c141091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c1b846700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140f5ef0 0x7f2c141096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c1b846700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c14109c70 con 0x7f2c140f55e0 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c1b846700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c14109db0 con 0x7f2c140f5ef0 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c195e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 0x7f2c141091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c195e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 0x7f2c141091d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43722/0 (socket says 172.21.15.84:43722) 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c195e2700 1 -- 172.21.15.84:0/225364913 learned_addr learned my addr 172.21.15.84:0/225364913 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.231+0000 7f2c18de1700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140f5ef0 0x7f2c141096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c195e2700 1 -- 172.21.15.84:0/225364913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140f5ef0 msgr2=0x7f2c141096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c195e2700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140f5ef0 0x7f2c141096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c195e2700 1 -- 172.21.15.84:0/225364913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10005040 con 0x7f2c140f55e0 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c18de1700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140f5ef0 0x7f2c141096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:27:41.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c195e2700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 0x7f2c141091d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2c10000c00 tx=0x7f2c1000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:41.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c09ffb700 1 -- 172.21.15.84:0/225364913 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c10019070 con 0x7f2c140f55e0 2024-02-15T18:27:41.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c09ffb700 1 -- 172.21.15.84:0/225364913 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f2c10007e80 con 0x7f2c140f55e0 2024-02-15T18:27:41.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c09ffb700 1 -- 172.21.15.84:0/225364913 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c10014db0 con 0x7f2c140f55e0 2024-02-15T18:27:41.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1410a6f0 con 0x7f2c140f55e0 2024-02-15T18:27:41.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.232+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1410ac50 con 0x7f2c140f55e0 2024-02-15T18:27:41.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.234+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c14045ad0 con 0x7f2c140f55e0 2024-02-15T18:27:41.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.234+0000 7f2c09ffb700 1 -- 172.21.15.84:0/225364913 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 30) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f2c10025070 con 0x7f2c140f55e0 2024-02-15T18:27:41.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.235+0000 7f2c09ffb700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2c00061000 0x7f2c000634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.235+0000 7f2c09ffb700 1 -- 172.21.15.84:0/225364913 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f2c1007d0a0 con 0x7f2c140f55e0 2024-02-15T18:27:41.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.235+0000 7f2c18de1700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2c00061000 0x7f2c000634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:41.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.235+0000 7f2c18de1700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2c00061000 0x7f2c000634c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2c04009fd0 tx=0x7f2c0400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:41.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.239+0000 7f2c09ffb700 1 -- 172.21.15.84:0/225364913 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2c10050e80 con 0x7f2c140f55e0 2024-02-15T18:27:41.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.550+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c1410aec0 con 0x7f2c00061000 2024-02-15T18:27:41.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.553+0000 7f2c09ffb700 1 -- 172.21.15.84:0/225364913 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f2c1410aec0 con 0x7f2c00061000 2024-02-15T18:27:41.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.556+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2c00061000 msgr2=0x7f2c000634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.556+0000 7f2c1b846700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2c00061000 0x7f2c000634c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2c04009fd0 tx=0x7f2c0400b040).stop 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.556+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 msgr2=0x7f2c141091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.556+0000 7f2c1b846700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 0x7f2c141091d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2c10000c00 tx=0x7f2c1000b040).stop 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.557+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 shutdown_connections 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.557+0000 7f2c1b846700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2c00061000 0x7f2c000634c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.557+0000 7f2c1b846700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c140f55e0 0x7f2c141091d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.557+0000 7f2c1b846700 1 --2- 172.21.15.84:0/225364913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c140f5ef0 0x7f2c141096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.557+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 >> 172.21.15.84:0/225364913 conn(0x7f2c140f0de0 msgr2=0x7f2c140fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.557+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 shutdown_connections 2024-02-15T18:27:41.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.557+0000 7f2c1b846700 1 -- 172.21.15.84:0/225364913 wait complete. 2024-02-15T18:27:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.707+0000 7fd350989700 1 -- 172.21.15.84:0/1920364619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f66e0 msgr2=0x7fd34c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.707+0000 7fd350989700 1 --2- 172.21.15.84:0/1920364619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f66e0 0x7fd34c0f6b00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fd33c004660 tx=0x7fd33c009b30).stop 2024-02-15T18:27:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 -- 172.21.15.84:0/1920364619 shutdown_connections 2024-02-15T18:27:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 --2- 172.21.15.84:0/1920364619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34c0f7980 0x7fd34c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 --2- 172.21.15.84:0/1920364619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f66e0 0x7fd34c0f6b00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 -- 172.21.15.84:0/1920364619 >> 172.21.15.84:0/1920364619 conn(0x7fd34c0f1e40 msgr2=0x7fd34c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 -- 172.21.15.84:0/1920364619 shutdown_connections 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 -- 172.21.15.84:0/1920364619 wait complete. 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 Processor -- start 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 -- start start 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34c0f66e0 0x7fd34c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f7980 0x7fd34c069130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c069730 con 0x7fd34c0f7980 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.708+0000 7fd350989700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c069870 con 0x7fd34c0f66e0 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd349d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f7980 0x7fd34c069130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd349d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f7980 0x7fd34c069130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43742/0 (socket says 172.21.15.84:43742) 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd349d9b700 1 -- 172.21.15.84:0/295934616 learned_addr learned my addr 172.21.15.84:0/295934616 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd34a59c700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34c0f66e0 0x7fd34c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd349d9b700 1 -- 172.21.15.84:0/295934616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34c0f66e0 msgr2=0x7fd34c068c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd349d9b700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34c0f66e0 0x7fd34c068c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd349d9b700 1 -- 172.21.15.84:0/295934616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c005040 con 0x7fd34c0f7980 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd349d9b700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f7980 0x7fd34c069130 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd34000e7f0 tx=0x7fd34000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd33affd700 1 -- 172.21.15.84:0/295934616 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3400092e0 con 0x7fd34c0f7980 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c110da0 con 0x7fd34c0f7980 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd33affd700 1 -- 172.21.15.84:0/295934616 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd34000f040 con 0x7fd34c0f7980 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c111360 con 0x7fd34c0f7980 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.709+0000 7fd33affd700 1 -- 172.21.15.84:0/295934616 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd340014850 con 0x7fd34c0f7980 2024-02-15T18:27:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.710+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c045ad0 con 0x7fd34c0f7980 2024-02-15T18:27:41.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.711+0000 7fd33affd700 1 -- 172.21.15.84:0/295934616 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 30) v1 ==== 77246+0+0 (secure 0 0 0) 0x7fd34001b030 con 0x7fd34c0f7980 2024-02-15T18:27:41.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.711+0000 7fd33affd700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd334060fb0 0x7fd334063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.711+0000 7fd33affd700 1 -- 172.21.15.84:0/295934616 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd34007bfe0 con 0x7fd34c0f7980 2024-02-15T18:27:41.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.711+0000 7fd34a59c700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd334060fb0 0x7fd334063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:41.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.712+0000 7fd34a59c700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd334060fb0 0x7fd334063470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd33c004d80 tx=0x7fd33c016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:41.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.718+0000 7fd33affd700 1 -- 172.21.15.84:0/295934616 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd34004c420 con 0x7fd34c0f7980 2024-02-15T18:27:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.937+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd34c0ff120 con 0x7fd334060fb0 2024-02-15T18:27:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.948+0000 7fd33affd700 1 -- 172.21.15.84:0/295934616 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd34c0ff120 con 0x7fd334060fb0 2024-02-15T18:27:41.943 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (7m) 0s ago 8m 15.4M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (8m) 0s ago 8m 6387k - 16.2.4 8d91d370c2b8 cfe2961e55e3 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (7m) 17s ago 7m 6400k - 16.2.4 8d91d370c2b8 d52ceb5fe65b 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (6m) 0s ago 8m 34.4M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (3m) 0s ago 3m 156M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (3m) 0s ago 3m 13.3M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (3m) 17s ago 3m 148M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (3m) 17s ago 3m 13.5M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (73s) 0s ago 10m 425M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (29s) 17s ago 7m 53.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (12s) 0s ago 10m 24.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:27:41.944 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (7m) 17s ago 7m 51.8M 2048M 16.2.4 8d91d370c2b8 c65c0defe0dd 2024-02-15T18:27:41.945 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (8m) 0s ago 8m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:27:41.945 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (7m) 17s ago 7m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:27:41.945 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (7m) 0s ago 7m 349M 4096M 16.2.4 8d91d370c2b8 20023f9a2292 2024-02-15T18:27:41.945 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 0s ago 6m 386M 4096M 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:27:41.945 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (6m) 0s ago 6m 300M 4096M 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:27:41.945 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (5m) 17s ago 5m 375M 4096M 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:27:41.945 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (5m) 17s ago 5m 340M 4096M 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:27:41.945 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (5m) 17s ago 5m 359M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:27:41.945 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (79s) 0s ago 8m 48.7M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.949+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd334060fb0 msgr2=0x7fd334063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.949+0000 7fd350989700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd334060fb0 0x7fd334063470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd33c004d80 tx=0x7fd33c016040).stop 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.949+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f7980 msgr2=0x7fd34c069130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.949+0000 7fd350989700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f7980 0x7fd34c069130 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd34000e7f0 tx=0x7fd34000b040).stop 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.950+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 shutdown_connections 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.950+0000 7fd350989700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd334060fb0 0x7fd334063470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.950+0000 7fd350989700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd34c0f66e0 0x7fd34c068c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.950+0000 7fd350989700 1 --2- 172.21.15.84:0/295934616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd34c0f7980 0x7fd34c069130 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.950+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 >> 172.21.15.84:0/295934616 conn(0x7fd34c0f1e40 msgr2=0x7fd34c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.950+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 shutdown_connections 2024-02-15T18:27:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:41.950+0000 7fd350989700 1 -- 172.21.15.84:0/295934616 wait complete. 2024-02-15T18:27:42.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.061+0000 7f4ff67e9700 1 -- 172.21.15.84:0/1101880284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f55c0 msgr2=0x7f4ff00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.061+0000 7f4ff67e9700 1 --2- 172.21.15.84:0/1101880284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f55c0 0x7f4ff00f59e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4fe0004660 tx=0x7f4fe0009b30).stop 2024-02-15T18:27:42.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.062+0000 7f4ff67e9700 1 -- 172.21.15.84:0/1101880284 shutdown_connections 2024-02-15T18:27:42.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.062+0000 7f4ff67e9700 1 --2- 172.21.15.84:0/1101880284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00f6860 0x7f4ff00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.062+0000 7f4ff67e9700 1 --2- 172.21.15.84:0/1101880284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f55c0 0x7f4ff00f59e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.062+0000 7f4ff67e9700 1 -- 172.21.15.84:0/1101880284 >> 172.21.15.84:0/1101880284 conn(0x7f4ff00f0d40 msgr2=0x7f4ff00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:42.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.062+0000 7f4ff67e9700 1 -- 172.21.15.84:0/1101880284 shutdown_connections 2024-02-15T18:27:42.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.062+0000 7f4ff67e9700 1 -- 172.21.15.84:0/1101880284 wait complete. 2024-02-15T18:27:42.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.062+0000 7f4ff67e9700 1 Processor -- start 2024-02-15T18:27:42.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.062+0000 7f4ff67e9700 1 -- start start 2024-02-15T18:27:42.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4ff67e9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00f55c0 0x7f4ff00f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:42.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4ff67e9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f6860 0x7f4ff00f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4ff67e9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00f8920 con 0x7f4ff00f6860 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4ff67e9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00f8a60 con 0x7f4ff00f55c0 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4fef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f6860 0x7f4ff00f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4fef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f6860 0x7f4ff00f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43760/0 (socket says 172.21.15.84:43760) 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4fef7fe700 1 -- 172.21.15.84:0/931364112 learned_addr learned my addr 172.21.15.84:0/931364112 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4feffff700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00f55c0 0x7f4ff00f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4fef7fe700 1 -- 172.21.15.84:0/931364112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00f55c0 msgr2=0x7f4ff00f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4fef7fe700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00f55c0 0x7f4ff00f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4fef7fe700 1 -- 172.21.15.84:0/931364112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0005040 con 0x7f4ff00f6860 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4fef7fe700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f6860 0x7f4ff00f83c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4fe400e7f0 tx=0x7f4fe400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.063+0000 7f4fecff9700 1 -- 172.21.15.84:0/931364112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fe40092e0 con 0x7f4ff00f6860 2024-02-15T18:27:42.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.064+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff00f8d40 con 0x7f4ff00f6860 2024-02-15T18:27:42.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.064+0000 7f4fecff9700 1 -- 172.21.15.84:0/931364112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f4fe400f040 con 0x7f4ff00f6860 2024-02-15T18:27:42.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.064+0000 7f4fecff9700 1 -- 172.21.15.84:0/931364112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fe4014850 con 0x7f4ff00f6860 2024-02-15T18:27:42.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.064+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff010eff0 con 0x7f4ff00f6860 2024-02-15T18:27:42.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.065+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff0045ad0 con 0x7f4ff00f6860 2024-02-15T18:27:42.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.065+0000 7f4fecff9700 1 -- 172.21.15.84:0/931364112 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 30) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f4fe401b030 con 0x7f4ff00f6860 2024-02-15T18:27:42.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.065+0000 7f4fecff9700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4fd8060fb0 0x7f4fd8063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:42.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.066+0000 7f4fecff9700 1 -- 172.21.15.84:0/931364112 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4fe407bf60 con 0x7f4ff00f6860 2024-02-15T18:27:42.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.066+0000 7f4feffff700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4fd8060fb0 0x7f4fd8063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:42.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.066+0000 7f4feffff700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4fd8060fb0 0x7f4fd8063470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4fe0004d80 tx=0x7f4fe0016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:42.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.070+0000 7f4fecff9700 1 -- 172.21.15.84:0/931364112 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4fe40aaf60 con 0x7f4ff00f6860 2024-02-15T18:27:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.367+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ff00fde90 con 0x7f4ff00f6860 2024-02-15T18:27:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.368+0000 7f4fecff9700 1 -- 172.21.15.84:0/931364112 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+806 (secure 0 0 0) 0x7f4fe4019070 con 0x7f4ff00f6860 2024-02-15T18:27:42.368 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:27:42.369 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3, 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 11 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.372+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4fd8060fb0 msgr2=0x7f4fd8063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.372+0000 7f4ff67e9700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4fd8060fb0 0x7f4fd8063470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4fe0004d80 tx=0x7f4fe0016040).stop 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.372+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f6860 msgr2=0x7f4ff00f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.372+0000 7f4ff67e9700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f6860 0x7f4ff00f83c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4fe400e7f0 tx=0x7f4fe400b040).stop 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.373+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 shutdown_connections 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.373+0000 7f4ff67e9700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4fd8060fb0 0x7f4fd8063470 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0x7f4fe0004d80 tx=0x7f4fe0016040).stop 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.373+0000 7f4ff67e9700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00f55c0 0x7f4ff00f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.373+0000 7f4ff67e9700 1 --2- 172.21.15.84:0/931364112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ff00f6860 0x7f4ff00f83c0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0x7f4fe400e7f0 tx=0x7f4fe400b040).stop 2024-02-15T18:27:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.373+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 >> 172.21.15.84:0/931364112 conn(0x7f4ff00f0d40 msgr2=0x7f4ff005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.375+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 shutdown_connections 2024-02-15T18:27:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.375+0000 7f4ff67e9700 1 -- 172.21.15.84:0/931364112 wait complete. 2024-02-15T18:27:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.500+0000 7f7a15183700 1 -- 172.21.15.84:0/4286376364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 msgr2=0x7f7a100fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.500+0000 7f7a15183700 1 --2- 172.21.15.84:0/4286376364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 0x7f7a100fb590 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f7a00004690 tx=0x7f7a00009b30).stop 2024-02-15T18:27:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.500+0000 7f7a15183700 1 -- 172.21.15.84:0/4286376364 shutdown_connections 2024-02-15T18:27:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.500+0000 7f7a15183700 1 --2- 172.21.15.84:0/4286376364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a100fba80 0x7f7a100fde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.500+0000 7f7a15183700 1 --2- 172.21.15.84:0/4286376364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 0x7f7a100fb590 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.500+0000 7f7a15183700 1 -- 172.21.15.84:0/4286376364 >> 172.21.15.84:0/4286376364 conn(0x7f7a100f0b90 msgr2=0x7f7a100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.501+0000 7f7a15183700 1 -- 172.21.15.84:0/4286376364 shutdown_connections 2024-02-15T18:27:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.501+0000 7f7a15183700 1 -- 172.21.15.84:0/4286376364 wait complete. 2024-02-15T18:27:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.501+0000 7f7a15183700 1 Processor -- start 2024-02-15T18:27:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.501+0000 7f7a15183700 1 -- start start 2024-02-15T18:27:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.501+0000 7f7a15183700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 0x7f7a10108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.501+0000 7f7a15183700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a100fba80 0x7f7a101094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.501+0000 7f7a15183700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10109a60 con 0x7f7a10060290 2024-02-15T18:27:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.501+0000 7f7a15183700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10109ba0 con 0x7f7a100fba80 2024-02-15T18:27:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.502+0000 7f7a0ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 0x7f7a10108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.502+0000 7f7a0ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 0x7f7a10108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43776/0 (socket says 172.21.15.84:43776) 2024-02-15T18:27:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.502+0000 7f7a0ffff700 1 -- 172.21.15.84:0/2700968527 learned_addr learned my addr 172.21.15.84:0/2700968527 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.502+0000 7f7a0f7fe700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a100fba80 0x7f7a101094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.502+0000 7f7a0ffff700 1 -- 172.21.15.84:0/2700968527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a100fba80 msgr2=0x7f7a101094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.502+0000 7f7a0ffff700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a100fba80 0x7f7a101094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.502+0000 7f7a0ffff700 1 -- 172.21.15.84:0/2700968527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a00005040 con 0x7f7a10060290 2024-02-15T18:27:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.502+0000 7f7a0f7fe700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a100fba80 0x7f7a101094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:27:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.502+0000 7f7a0ffff700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 0x7f7a10108fc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f7a00004d70 tx=0x7f7a0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.503+0000 7f7a0cff9700 1 -- 172.21.15.84:0/2700968527 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a00019070 con 0x7f7a10060290 2024-02-15T18:27:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.503+0000 7f7a0cff9700 1 -- 172.21.15.84:0/2700968527 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f7a0001e420 con 0x7f7a10060290 2024-02-15T18:27:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.503+0000 7f7a0cff9700 1 -- 172.21.15.84:0/2700968527 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a00014660 con 0x7f7a10060290 2024-02-15T18:27:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.504+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1010a4e0 con 0x7f7a10060290 2024-02-15T18:27:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.504+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1010a990 con 0x7f7a10060290 2024-02-15T18:27:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.505+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a10045ad0 con 0x7f7a10060290 2024-02-15T18:27:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.506+0000 7f7a0cff9700 1 -- 172.21.15.84:0/2700968527 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 30) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f7a0001ea70 con 0x7f7a10060290 2024-02-15T18:27:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.506+0000 7f7a0cff9700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79f8061000 0x7f79f80634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.506+0000 7f7a0cff9700 1 -- 172.21.15.84:0/2700968527 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7a0007d680 con 0x7f7a10060290 2024-02-15T18:27:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.507+0000 7f7a0f7fe700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79f8061000 0x7f79f80634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.507+0000 7f7a0f7fe700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79f8061000 0x7f79f80634c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7a10060060 tx=0x7f7a0400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.513+0000 7f7a0cff9700 1 -- 172.21.15.84:0/2700968527 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7a00051520 con 0x7f7a10060290 2024-02-15T18:27:42.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.843+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7a10101130 con 0x7f7a10060290 2024-02-15T18:27:42.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.843+0000 7f7a0cff9700 1 -- 172.21.15.84:0/2700968527 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1790 (secure 0 0 0) 0x7f7a00051110 con 0x7f7a10060290 2024-02-15T18:27:42.840 INFO:teuthology.orchestra.run.smithi084.stdout:e15 2024-02-15T18:27:42.840 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 15 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:26:32.713494+0000 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:27:42.841 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:27:42.842 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:42.843 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:42.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79f8061000 msgr2=0x7f79f80634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79f8061000 0x7f79f80634c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7a10060060 tx=0x7f7a0400b040).stop 2024-02-15T18:27:42.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 msgr2=0x7f7a10108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 0x7f7a10108fc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f7a00004d70 tx=0x7f7a0000b040).stop 2024-02-15T18:27:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 shutdown_connections 2024-02-15T18:27:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79f8061000 0x7f79f80634c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a10060290 0x7f7a10108fc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 --2- 172.21.15.84:0/2700968527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a100fba80 0x7f7a101094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 >> 172.21.15.84:0/2700968527 conn(0x7f7a100f0b90 msgr2=0x7f7a100f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 shutdown_connections 2024-02-15T18:27:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.846+0000 7f7a15183700 1 -- 172.21.15.84:0/2700968527 wait complete. 2024-02-15T18:27:42.845 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-02-15T18:27:42.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:40.693246+0000 mgr.smithi084.hjmnez (mgr.14596) 46 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 285 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 383 op/s 2024-02-15T18:27:42.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.100407+0000 mgr.smithi084.hjmnez (mgr.14596) 47 : audit [DBG] from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:42.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.554056+0000 mgr.smithi084.hjmnez (mgr.14596) 48 : audit [DBG] from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:42.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.740413+0000 mon.smithi084 (mon.0) 10 : audit [INF] from='mgr.14596 ' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:42.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.742789+0000 mon.smithi133 (mon.1) 32 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:42.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.743543+0000 mon.smithi133 (mon.1) 33 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:27:42.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.748036+0000 mon.smithi084 (mon.0) 11 : audit [INF] from='mgr.14596 ' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:42.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.753358+0000 mon.smithi133 (mon.1) 34 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:42.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.756375+0000 mon.smithi133 (mon.1) 35 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:27:42.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.757490+0000 mon.smithi133 (mon.1) 36 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T18:27:42.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:42.368999+0000 mon.smithi084 (mon.0) 12 : audit [DBG] from='client.? 172.21.15.84:0/931364112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.954+0000 7fd32ca29700 1 -- 172.21.15.84:0/1670693990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f55c0 msgr2=0x7fd3280f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.954+0000 7fd32ca29700 1 --2- 172.21.15.84:0/1670693990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f55c0 0x7fd3280f59e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd318004660 tx=0x7fd318009b30).stop 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 -- 172.21.15.84:0/1670693990 shutdown_connections 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 --2- 172.21.15.84:0/1670693990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3280f6860 0x7fd3280f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 --2- 172.21.15.84:0/1670693990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f55c0 0x7fd3280f59e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 -- 172.21.15.84:0/1670693990 >> 172.21.15.84:0/1670693990 conn(0x7fd3280f0d40 msgr2=0x7fd3280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 -- 172.21.15.84:0/1670693990 shutdown_connections 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 -- 172.21.15.84:0/1670693990 wait complete. 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 Processor -- start 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 -- start start 2024-02-15T18:27:42.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3280f55c0 0x7fd3280f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f6860 0x7fd3280f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280f8100 con 0x7fd3280f6860 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32ca29700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280f8240 con 0x7fd3280f55c0 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd325d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f6860 0x7fd3280f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd325d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f6860 0x7fd3280f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43800/0 (socket says 172.21.15.84:43800) 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd325d9b700 1 -- 172.21.15.84:0/32453984 learned_addr learned my addr 172.21.15.84:0/32453984 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.955+0000 7fd32659c700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3280f55c0 0x7fd3280f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.956+0000 7fd325d9b700 1 -- 172.21.15.84:0/32453984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3280f55c0 msgr2=0x7fd3280f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.956+0000 7fd325d9b700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3280f55c0 0x7fd3280f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.956+0000 7fd325d9b700 1 -- 172.21.15.84:0/32453984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318005040 con 0x7fd3280f6860 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.956+0000 7fd325d9b700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f6860 0x7fd3280f7ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fd31c00e7f0 tx=0x7fd31c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:42.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.956+0000 7fd316ffd700 1 -- 172.21.15.84:0/32453984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd31c0092e0 con 0x7fd3280f6860 2024-02-15T18:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.956+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3280f8520 con 0x7fd3280f6860 2024-02-15T18:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.956+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32810f020 con 0x7fd3280f6860 2024-02-15T18:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.956+0000 7fd316ffd700 1 -- 172.21.15.84:0/32453984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd31c00f040 con 0x7fd3280f6860 2024-02-15T18:27:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.956+0000 7fd316ffd700 1 -- 172.21.15.84:0/32453984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd31c014850 con 0x7fd3280f6860 2024-02-15T18:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.957+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30c004fa0 con 0x7fd3280f6860 2024-02-15T18:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.958+0000 7fd316ffd700 1 -- 172.21.15.84:0/32453984 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 30) v1 ==== 77246+0+0 (secure 0 0 0) 0x7fd31c01b030 con 0x7fd3280f6860 2024-02-15T18:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.958+0000 7fd316ffd700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd310060fb0 0x7fd310063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.958+0000 7fd316ffd700 1 -- 172.21.15.84:0/32453984 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd31c07bec0 con 0x7fd3280f6860 2024-02-15T18:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.958+0000 7fd32659c700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd310060fb0 0x7fd310063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.958+0000 7fd32659c700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd310060fb0 0x7fd310063470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd318004d80 tx=0x7fd318016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:42.962+0000 7fd316ffd700 1 -- 172.21.15.84:0/32453984 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd31c04c360 con 0x7fd3280f6860 2024-02-15T18:27:43.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:40.693246+0000 mgr.smithi084.hjmnez (mgr.14596) 46 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 285 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 383 op/s 2024-02-15T18:27:43.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.100407+0000 mgr.smithi084.hjmnez (mgr.14596) 47 : audit [DBG] from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:43.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.554056+0000 mgr.smithi084.hjmnez (mgr.14596) 48 : audit [DBG] from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:43.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.740413+0000 mon.smithi084 (mon.0) 10 : audit [INF] from='mgr.14596 ' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:43.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.742789+0000 mon.smithi133 (mon.1) 32 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:43.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.743543+0000 mon.smithi133 (mon.1) 33 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:27:43.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.748036+0000 mon.smithi084 (mon.0) 11 : audit [INF] from='mgr.14596 ' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:43.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.753358+0000 mon.smithi133 (mon.1) 34 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:43.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.756375+0000 mon.smithi133 (mon.1) 35 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:27:43.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.757490+0000 mon.smithi133 (mon.1) 36 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T18:27:43.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:42.368999+0000 mon.smithi084 (mon.0) 12 : audit [DBG] from='client.? 172.21.15.84:0/931364112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:27:43.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.173+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd30c000bc0 con 0x7fd310060fb0 2024-02-15T18:27:43.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.174+0000 7fd316ffd700 1 -- 172.21.15.84:0/32453984 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd30c000bc0 con 0x7fd310060fb0 2024-02-15T18:27:43.170 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "3/21 daemons upgraded", 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mon daemons", 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:27:43.171 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:27:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd310060fb0 msgr2=0x7fd310063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:43.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd310060fb0 0x7fd310063470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd318004d80 tx=0x7fd318016040).stop 2024-02-15T18:27:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f6860 msgr2=0x7fd3280f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f6860 0x7fd3280f7ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fd31c00e7f0 tx=0x7fd31c00b040).stop 2024-02-15T18:27:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 shutdown_connections 2024-02-15T18:27:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd310060fb0 0x7fd310063470 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3280f55c0 0x7fd3280f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 --2- 172.21.15.84:0/32453984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3280f6860 0x7fd3280f7ba0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 >> 172.21.15.84:0/32453984 conn(0x7fd3280f0d40 msgr2=0x7fd32805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 shutdown_connections 2024-02-15T18:27:43.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:27:43.177+0000 7fd32ca29700 1 -- 172.21.15.84:0/32453984 wait complete. 2024-02-15T18:27:43.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:27:41.744324+0000 mgr.smithi084.hjmnez (mgr.14596) 49 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:27:43.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:41.939044+0000 mgr.smithi084.hjmnez (mgr.14596) 50 : audit [DBG] from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:43.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:42.845464+0000 mon.smithi084 (mon.0) 13 : audit [DBG] from='client.? 172.21.15.84:0/2700968527' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:27:43.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:27:41.744324+0000 mgr.smithi084.hjmnez (mgr.14596) 49 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:27:43.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:41.939044+0000 mgr.smithi084.hjmnez (mgr.14596) 50 : audit [DBG] from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:43.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:42.845464+0000 mon.smithi084 (mon.0) 13 : audit [DBG] from='client.? 172.21.15.84:0/2700968527' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:27:44.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:42.693617+0000 mgr.smithi084.hjmnez (mgr.14596) 51 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 414 op/s 2024-02-15T18:27:44.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:43.175604+0000 mgr.smithi084.hjmnez (mgr.14596) 52 : audit [DBG] from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:45.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:42.693617+0000 mgr.smithi084.hjmnez (mgr.14596) 51 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 284 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.0 MiB/s wr, 414 op/s 2024-02-15T18:27:45.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:43.175604+0000 mgr.smithi084.hjmnez (mgr.14596) 52 : audit [DBG] from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:27:46.601 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:44.694071+0000 mgr.smithi084.hjmnez (mgr.14596) 53 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 291 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 65 KiB/s rd, 3.0 MiB/s wr, 608 op/s 2024-02-15T18:27:47.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:44.694071+0000 mgr.smithi084.hjmnez (mgr.14596) 53 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 291 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 65 KiB/s rd, 3.0 MiB/s wr, 608 op/s 2024-02-15T18:27:48.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:46.694395+0000 mgr.smithi084.hjmnez (mgr.14596) 54 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 291 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 451 op/s 2024-02-15T18:27:49.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:46.694395+0000 mgr.smithi084.hjmnez (mgr.14596) 54 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 291 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 451 op/s 2024-02-15T18:27:50.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:48.694968+0000 mgr.smithi084.hjmnez (mgr.14596) 55 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 67 KiB/s rd, 3.2 MiB/s wr, 662 op/s 2024-02-15T18:27:51.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:48.694968+0000 mgr.smithi084.hjmnez (mgr.14596) 55 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 67 KiB/s rd, 3.2 MiB/s wr, 662 op/s 2024-02-15T18:27:52.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:50.695418+0000 mgr.smithi084.hjmnez (mgr.14596) 56 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.1 MiB/s wr, 436 op/s 2024-02-15T18:27:52.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:27:50.966466+0000 mgr.smithi084.hjmnez (mgr.14596) 57 : cephadm [INF] Upgrade: Updating mon.smithi133 2024-02-15T18:27:52.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:50.970142+0000 mon.smithi084 (mon.0) 14 : audit [INF] from='mgr.14596 ' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:52.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:50.971533+0000 mon.smithi133 (mon.1) 37 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:27:52.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:50.972059+0000 mon.smithi133 (mon.1) 38 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:27:52.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:50.972660+0000 mon.smithi133 (mon.1) 39 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:52.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:27:50.973373+0000 mgr.smithi084.hjmnez (mgr.14596) 58 : cephadm [INF] Deploying daemon mon.smithi133 on smithi133 2024-02-15T18:27:52.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:50.695418+0000 mgr.smithi084.hjmnez (mgr.14596) 56 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.1 MiB/s wr, 436 op/s 2024-02-15T18:27:52.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:27:50.966466+0000 mgr.smithi084.hjmnez (mgr.14596) 57 : cephadm [INF] Upgrade: Updating mon.smithi133 2024-02-15T18:27:52.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:50.970142+0000 mon.smithi084 (mon.0) 14 : audit [INF] from='mgr.14596 ' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:52.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:50.971533+0000 mon.smithi133 (mon.1) 37 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:27:52.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:50.972059+0000 mon.smithi133 (mon.1) 38 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:27:52.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: audit 2024-02-15T18:27:50.972660+0000 mon.smithi133 (mon.1) 39 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:27:52.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cephadm 2024-02-15T18:27:50.973373+0000 mgr.smithi084.hjmnez (mgr.14596) 58 : cephadm [INF] Deploying daemon mon.smithi133 on smithi133 2024-02-15T18:27:54.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:52.695739+0000 mgr.smithi084.hjmnez (mgr.14596) 59 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.1 MiB/s wr, 436 op/s 2024-02-15T18:27:54.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: cluster 2024-02-15T18:27:52.695739+0000 mgr.smithi084.hjmnez (mgr.14596) 59 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.1 MiB/s wr, 436 op/s 2024-02-15T18:27:55.253 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:55 smithi133 systemd[1]: Stopping Ceph mon.smithi133 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:27:55.253 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: debug 2024-02-15T18:27:55.255+0000 7fe792a24700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi133 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:27:55.253 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133[40857]: debug 2024-02-15T18:27:55.255+0000 7fe792a24700 -1 mon.smithi133@1(peon) e2 *** Got Signal Terminated *** 2024-02-15T18:27:56.039 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:55 smithi133 bash[59405]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133 2024-02-15T18:27:56.310 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:56 smithi133 bash[59456]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133 2024-02-15T18:27:56.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:56 smithi133 systemd[1]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi133.service: Succeeded. 2024-02-15T18:27:56.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:56 smithi133 systemd[1]: Stopped Ceph mon.smithi133 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:27:56.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:56 smithi133 systemd[1]: Starting Ceph mon.smithi133 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:27:57.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.292+0000 7f6d63000880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-15T18:27:57.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.292+0000 7f6d63000880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-15T18:27:57.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.292+0000 7f6d63000880 0 pidfile_write: ignore empty --pid-file 2024-02-15T18:27:57.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.296+0000 7f6d63000880 0 load: jerasure load: lrc load: isa 2024-02-15T18:27:57.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: RocksDB version: 6.8.1 2024-02-15T18:27:57.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Compile date Feb 8 2024 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: DB SUMMARY 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: CURRENT file: CURRENT 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 703 Bytes 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi133/store.db dir, Total Num: 1, files: 000017.sst 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi133/store.db: 000015.log size: 2211229 ; 2024-02-15T18:27:57.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.error_if_exists: 0 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.create_if_missing: 0 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.paranoid_checks: 1 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.env: 0x563319e5b080 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.fs: Posix File System 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.info_log: 0x56331aebe560 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.statistics: (nil) 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.use_fsync: 0 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_log_file_size: 0 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T18:27:57.394 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.allow_fallocate: 1 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.use_direct_reads: 0 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.db_log_dir: 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi133/store.db 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T18:27:57.395 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_subcompactions: 1 2024-02-15T18:27:57.397 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_background_flushes: -1 2024-02-15T18:27:57.398 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T18:27:57.398 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T18:27:57.398 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T18:27:57.398 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T18:27:57.398 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T18:27:57.398 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-15T18:27:57.398 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-15T18:27:57.398 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.write_buffer_manager: 0x56331bbb0420 2024-02-15T18:27:57.398 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.unordered_write: 0 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T18:27:57.399 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.row_cache: None 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.wal_filter: None 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.preserve_deletes: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.two_write_queues: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.atomic_flush: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.log_readahead_size: 0 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-15T18:27:57.400 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_background_jobs: 2 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_background_compactions: -1 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.max_open_files: -1 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T18:27:57.401 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Compression algorithms supported: 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: kZSTD supported: 0 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: kXpressCompression supported: 0 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: kLZ4Compression supported: 1 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: kBZip2Compression supported: 0 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: kZlibCompression supported: 1 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: kSnappyCompression supported: 1 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.297+0000 7f6d63000880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi133/store.db/MANIFEST-000005 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T18:27:57.402 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.merge_operator: 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_filter: None 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56331ae63d28) 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cache_index_and_filter_blocks: 1 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: pin_top_level_index_and_filter: 1 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: index_type: 0 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: data_block_index_type: 0 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: index_shortening: 1 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: data_block_hash_table_util_ratio: 0.750000 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: hash_index_allow_collision: 1 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: checksum: 1 2024-02-15T18:27:57.403 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: no_block_cache: 0 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: block_cache: 0x56331ae98f10 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: block_cache_name: BinnedLRUCache 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: block_cache_options: 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: capacity : 536870912 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: num_shard_bits : 4 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: strict_capacity_limit : 0 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: high_pri_pool_ratio: 0.000 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: block_cache_compressed: (nil) 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: persistent_cache: (nil) 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: block_size: 4096 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: block_size_deviation: 10 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: block_restart_interval: 16 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: index_block_restart_interval: 1 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: metadata_block_size: 4096 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: partition_filters: 0 2024-02-15T18:27:57.404 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: use_delta_encoding: 1 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: whole_key_filtering: 1 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: verify_compression: 0 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: read_amp_bytes_per_bit: 0 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: format_version: 2 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: enable_index_compression: 1 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: block_align: 0 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compression: NoCompression 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.num_levels: 7 2024-02-15T18:27:57.405 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-15T18:27:57.406 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T18:27:57.407 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T18:27:57.408 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.table_properties_collectors: 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.inplace_update_support: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.bloom_locality: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.max_successive_merges: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-15T18:27:57.409 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.ttl: 2592000 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi133/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 19, last_sequence is 9263, log_number is 15,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 15 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021677300030, "job": 1, "event": "recovery_started", "log_files": [15]} 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.298+0000 7f6d63000880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #15 mode 2 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.300+0000 7f6d63000880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.303+0000 7f6d63000880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021677304305, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 19, "file_size": 1457785, "table_properties": {"data_size": 1454487, "index_size": 2160, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 325, "raw_key_size": 2558, "raw_average_key_size": 21, "raw_value_size": 1450907, "raw_average_value_size": 11990, "num_data_blocks": 69, "num_entries": 121, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708021677, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.303+0000 7f6d63000880 4 rocksdb: [version_set.cc:3826] Creating manifest 20 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.410 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.303+0000 7f6d63000880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.303+0000 7f6d63000880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021677304892, "job": 1, "event": "recovery_finished"} 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.304+0000 7f6d63000880 4 rocksdb: DB pointer 0x56331af61800 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.304+0000 7f6d49df1700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.304+0000 7f6d49df1700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ** DB Stats ** 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ** Compaction Stats [default] ** 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:27:57.411 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: L0 1/0 1.39 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.3 0.00 0.00 1 0.002 0 0 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: L6 1/0 21.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Sum 2/0 23.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.3 0.00 0.00 1 0.002 0 0 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.3 0.00 0.00 1 0.002 0 0 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ** Compaction Stats [default] ** 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 614.3 0.00 0.00 1 0.002 0 0 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Flush(GB): cumulative 0.001, interval 0.001 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:27:57.412 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Cumulative compaction: 0.00 GB write, 211.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Interval compaction: 0.00 GB write, 211.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ** Compaction Stats [default] ** 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: L0 1/0 1.39 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.3 0.00 0.00 1 0.002 0 0 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: L6 1/0 21.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Sum 2/0 23.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 614.3 0.00 0.00 1 0.002 0 0 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.413 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ** Compaction Stats [default] ** 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 614.3 0.00 0.00 1 0.002 0 0 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Flush(GB): cumulative 0.001, interval 0.000 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Cumulative compaction: 0.00 GB write, 210.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.414 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.305+0000 7f6d63000880 0 starting mon.smithi133 rank 1 at public addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] at bind addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi133 fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.306+0000 7f6d63000880 1 mon.smithi133@-1(???) e2 preinit fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.306+0000 7f6d63000880 0 mon.smithi133@-1(???).mds e15 new map 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.306+0000 7f6d63000880 0 mon.smithi133@-1(???).mds e15 print_map 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: e15 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: legacy client fscid: 1 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Filesystem 'cephfs' (1) 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: fs_name cephfs 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: epoch 15 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: flags 12 2024-02-15T18:27:57.415 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: modified 2024-02-15T18:26:32.713494+0000 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: tableserver 0 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: root 0 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: session_timeout 60 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: session_autoclose 300 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: max_file_size 1099511627776 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: required_client_features {} 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: last_failure 0 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: last_failure_osd_epoch 0 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: max_mds 2 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: in 0,1 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: up {0=24239,1=14438} 2024-02-15T18:27:57.416 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: failed 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: damaged 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: stopped 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: data_pools [3] 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: metadata_pool 2 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: inline_data disabled 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: balancer 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: standby_count_wanted 1 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: [mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: [mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: Standby daemons: 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.417 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: [mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: [mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.306+0000 7f6d63000880 0 mon.smithi133@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.306+0000 7f6d63000880 0 mon.smithi133@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.306+0000 7f6d63000880 0 mon.smithi133@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.306+0000 7f6d63000880 0 mon.smithi133@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:52.695739+0000 mgr.smithi084.hjmnez (mgr.14596) 59 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 288 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.1 MiB/s wr, 436 op/s 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:27:57.306+0000 7f6d63000880 1 mon.smithi133@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 bash[59587]: bafcf53882a8d3db31d268eb93021e71b17b8ff62628314cd88028889132c250 2024-02-15T18:27:57.418 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:57 smithi133 systemd[1]: Started Ceph mon.smithi133 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:27:58.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:55.261508+0000 mon.smithi084 (mon.0) 15 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:27:58.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:55.263237+0000 mon.smithi084 (mon.0) 16 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:27:58.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:27:55.261508+0000 mon.smithi084 (mon.0) 15 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi084"}]: dispatch 2024-02-15T18:27:58.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:27:55.263237+0000 mon.smithi084 (mon.0) 16 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mon metadata", "id": "smithi133"}]: dispatch 2024-02-15T18:27:59.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:56.696832+0000 mgr.smithi084.hjmnez (mgr.14596) 61 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 2.6 MiB/s wr, 383 op/s 2024-02-15T18:27:59.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:58.444894+0000 mon.smithi133 (mon.1) 1 : cluster [INF] mon.smithi133 calling monitor election 2024-02-15T18:27:59.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:58.445885+0000 mon.smithi084 (mon.0) 17 : cluster [INF] mon.smithi084 calling monitor election 2024-02-15T18:27:59.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:58.460225+0000 mon.smithi084 (mon.0) 18 : cluster [INF] mon.smithi084 is new leader, mons smithi084,smithi133 in quorum (ranks 0,1) 2024-02-15T18:27:59.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:58.464948+0000 mon.smithi084 (mon.0) 19 : cluster [DBG] monmap e2: 2 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} 2024-02-15T18:27:59.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:58.477178+0000 mon.smithi084 (mon.0) 20 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:27:59.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:58.477202+0000 mon.smithi084 (mon.0) 21 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-02-15T18:27:59.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:58.477497+0000 mon.smithi084 (mon.0) 22 : cluster [DBG] mgrmap e30: smithi084.hjmnez(active, since 82s), standbys: smithi133.nxzroj 2024-02-15T18:27:59.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:58.480950+0000 mon.smithi084 (mon.0) 23 : cluster [INF] overall HEALTH_OK 2024-02-15T18:27:59.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:58.486493+0000 mon.smithi084 (mon.0) 24 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:59.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:27:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:27:58.487941+0000 mon.smithi084 (mon.0) 25 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:59.897 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:56.696832+0000 mgr.smithi084.hjmnez (mgr.14596) 61 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 2.6 MiB/s wr, 383 op/s 2024-02-15T18:27:59.897 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:58.444894+0000 mon.smithi133 (mon.1) 1 : cluster [INF] mon.smithi133 calling monitor election 2024-02-15T18:27:59.897 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:58.445885+0000 mon.smithi084 (mon.0) 17 : cluster [INF] mon.smithi084 calling monitor election 2024-02-15T18:27:59.897 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:58.460225+0000 mon.smithi084 (mon.0) 18 : cluster [INF] mon.smithi084 is new leader, mons smithi084,smithi133 in quorum (ranks 0,1) 2024-02-15T18:27:59.897 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:58.464948+0000 mon.smithi084 (mon.0) 19 : cluster [DBG] monmap e2: 2 mons at {smithi084=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],smithi133=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0]} removed_ranks: {} 2024-02-15T18:27:59.898 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:58.477178+0000 mon.smithi084 (mon.0) 20 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:27:59.898 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:58.477202+0000 mon.smithi084 (mon.0) 21 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-02-15T18:27:59.898 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:58.477497+0000 mon.smithi084 (mon.0) 22 : cluster [DBG] mgrmap e30: smithi084.hjmnez(active, since 82s), standbys: smithi133.nxzroj 2024-02-15T18:27:59.898 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:58.480950+0000 mon.smithi084 (mon.0) 23 : cluster [INF] overall HEALTH_OK 2024-02-15T18:27:59.898 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:27:58.486493+0000 mon.smithi084 (mon.0) 24 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:27:59.898 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:27:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:27:58.487941+0000 mon.smithi084 (mon.0) 25 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:00.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:27:58.697302+0000 mgr.smithi084.hjmnez (mgr.14596) 62 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56 KiB/s rd, 3.8 MiB/s wr, 573 op/s 2024-02-15T18:28:00.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:27:58.697302+0000 mgr.smithi084.hjmnez (mgr.14596) 62 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 56 KiB/s rd, 3.8 MiB/s wr, 573 op/s 2024-02-15T18:28:02.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:00.697619+0000 mgr.smithi084.hjmnez (mgr.14596) 63 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 2.7 MiB/s wr, 362 op/s 2024-02-15T18:28:02.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:00.697619+0000 mgr.smithi084.hjmnez (mgr.14596) 63 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 2.7 MiB/s wr, 362 op/s 2024-02-15T18:28:04.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:02.698009+0000 mgr.smithi084.hjmnez (mgr.14596) 64 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 303 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 3.1 MiB/s wr, 395 op/s 2024-02-15T18:28:04.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:02.831355+0000 mon.smithi084 (mon.0) 26 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.200404+0000 mon.smithi084 (mon.0) 27 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.201153+0000 mon.smithi084 (mon.0) 28 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:03.201783+0000 mgr.smithi084.hjmnez (mgr.14596) 65 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.205457+0000 mon.smithi084 (mon.0) 29 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.209975+0000 mon.smithi084 (mon.0) 30 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.211974+0000 mon.smithi084 (mon.0) 31 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.213055+0000 mon.smithi084 (mon.0) 32 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:03.213550+0000 mgr.smithi084.hjmnez (mgr.14596) 66 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.219235+0000 mon.smithi084 (mon.0) 33 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.219993+0000 mon.smithi084 (mon.0) 34 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi084"}]: dispatch 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.226899+0000 mon.smithi084 (mon.0) 35 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi084"}]': finished 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.227574+0000 mon.smithi084 (mon.0) 36 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi133"}]: dispatch 2024-02-15T18:28:04.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:03.233080+0000 mon.smithi084 (mon.0) 37 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi133"}]': finished 2024-02-15T18:28:04.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:02.698009+0000 mgr.smithi084.hjmnez (mgr.14596) 64 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 303 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 3.1 MiB/s wr, 395 op/s 2024-02-15T18:28:04.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:02.831355+0000 mon.smithi084 (mon.0) 26 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:04.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.200404+0000 mon.smithi084 (mon.0) 27 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:04.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.201153+0000 mon.smithi084 (mon.0) 28 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:28:04.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:03.201783+0000 mgr.smithi084.hjmnez (mgr.14596) 65 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.205457+0000 mon.smithi084 (mon.0) 29 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.209975+0000 mon.smithi084 (mon.0) 30 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.211974+0000 mon.smithi084 (mon.0) 31 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.213055+0000 mon.smithi084 (mon.0) 32 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:03.213550+0000 mgr.smithi084.hjmnez (mgr.14596) 66 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.219235+0000 mon.smithi084 (mon.0) 33 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.219993+0000 mon.smithi084 (mon.0) 34 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi084"}]: dispatch 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.226899+0000 mon.smithi084 (mon.0) 35 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi084"}]': finished 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.227574+0000 mon.smithi084 (mon.0) 36 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi133"}]: dispatch 2024-02-15T18:28:04.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:03.233080+0000 mon.smithi084 (mon.0) 37 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi133"}]': finished 2024-02-15T18:28:06.127 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:04.698538+0000 mgr.smithi084.hjmnez (mgr.14596) 67 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60 KiB/s rd, 3.8 MiB/s wr, 600 op/s 2024-02-15T18:28:06.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:04.698538+0000 mgr.smithi084.hjmnez (mgr.14596) 67 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60 KiB/s rd, 3.8 MiB/s wr, 600 op/s 2024-02-15T18:28:07.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:06.041282+0000 mon.smithi084 (mon.0) 38 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:28:07.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:06.041282+0000 mon.smithi084 (mon.0) 38 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:28:08.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:06.698901+0000 mgr.smithi084.hjmnez (mgr.14596) 68 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.3 MiB/s wr, 428 op/s 2024-02-15T18:28:08.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:07.331088+0000 mgr.smithi084.hjmnez (mgr.14596) 69 : cephadm [INF] Upgrade: Updating crash.smithi084 (1/2) 2024-02-15T18:28:08.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:07.335084+0000 mon.smithi084 (mon.0) 39 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:08.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:07.335854+0000 mon.smithi084 (mon.0) 40 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:28:08.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:07.336395+0000 mon.smithi084 (mon.0) 41 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:08.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:07.336860+0000 mgr.smithi084.hjmnez (mgr.14596) 70 : cephadm [INF] Deploying daemon crash.smithi084 on smithi084 2024-02-15T18:28:08.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:06.698901+0000 mgr.smithi084.hjmnez (mgr.14596) 68 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 298 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.3 MiB/s wr, 428 op/s 2024-02-15T18:28:08.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:07.331088+0000 mgr.smithi084.hjmnez (mgr.14596) 69 : cephadm [INF] Upgrade: Updating crash.smithi084 (1/2) 2024-02-15T18:28:08.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:07.335084+0000 mon.smithi084 (mon.0) 39 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:08.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:07.335854+0000 mon.smithi084 (mon.0) 40 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi084", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:28:08.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:07.336395+0000 mon.smithi084 (mon.0) 41 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:08.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:07.336860+0000 mgr.smithi084.hjmnez (mgr.14596) 70 : cephadm [INF] Deploying daemon crash.smithi084 on smithi084 2024-02-15T18:28:10.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:08.699366+0000 mgr.smithi084.hjmnez (mgr.14596) 71 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 302 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 59 KiB/s rd, 3.1 MiB/s wr, 588 op/s 2024-02-15T18:28:10.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:09.344302+0000 mon.smithi084 (mon.0) 42 : cluster [DBG] mgrmap e31: smithi084.hjmnez(active, since 93s), standbys: smithi133.nxzroj 2024-02-15T18:28:10.648 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:08.699366+0000 mgr.smithi084.hjmnez (mgr.14596) 71 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 302 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 59 KiB/s rd, 3.1 MiB/s wr, 588 op/s 2024-02-15T18:28:10.649 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:09.344302+0000 mon.smithi084 (mon.0) 42 : cluster [DBG] mgrmap e31: smithi084.hjmnez(active, since 93s), standbys: smithi133.nxzroj 2024-02-15T18:28:13.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:10.699741+0000 mgr.smithi084.hjmnez (mgr.14596) 72 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 302 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 398 op/s 2024-02-15T18:28:13.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:11.662180+0000 mon.smithi084 (mon.0) 43 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:13.072 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:10.699741+0000 mgr.smithi084.hjmnez (mgr.14596) 72 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 302 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 398 op/s 2024-02-15T18:28:13.072 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:11.662180+0000 mon.smithi084 (mon.0) 43 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.314+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/710235244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f66e0 msgr2=0x7fe1a40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.314+0000 7fe1ab5a6700 1 --2- 172.21.15.84:0/710235244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f66e0 0x7fe1a40f6b00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe1a0004660 tx=0x7fe1a0009b30).stop 2024-02-15T18:28:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.314+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/710235244 shutdown_connections 2024-02-15T18:28:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.314+0000 7fe1ab5a6700 1 --2- 172.21.15.84:0/710235244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1a40f7980 0x7fe1a40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.314+0000 7fe1ab5a6700 1 --2- 172.21.15.84:0/710235244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f66e0 0x7fe1a40f6b00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.314+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/710235244 >> 172.21.15.84:0/710235244 conn(0x7fe1a40f1e40 msgr2=0x7fe1a40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.314+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/710235244 shutdown_connections 2024-02-15T18:28:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.314+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/710235244 wait complete. 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.315+0000 7fe1ab5a6700 1 Processor -- start 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.315+0000 7fe1ab5a6700 1 -- start start 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.315+0000 7fe1ab5a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1a40f66e0 0x7fe1a4107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.315+0000 7fe1ab5a6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f7980 0x7fe1a4107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.315+0000 7fe1ab5a6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4107ad0 con 0x7fe1a40f7980 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.315+0000 7fe1ab5a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4107c10 con 0x7fe1a40f66e0 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe1a8b41700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f7980 0x7fe1a4107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe1a8b41700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f7980 0x7fe1a4107520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53874/0 (socket says 172.21.15.84:53874) 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe1a8b41700 1 -- 172.21.15.84:0/1189746428 learned_addr learned my addr 172.21.15.84:0/1189746428 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe1a9342700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1a40f66e0 0x7fe1a4107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe1a8b41700 1 -- 172.21.15.84:0/1189746428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1a40f66e0 msgr2=0x7fe1a4107030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe1a8b41700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1a40f66e0 0x7fe1a4107030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe1a8b41700 1 -- 172.21.15.84:0/1189746428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a0005040 con 0x7fe1a40f7980 2024-02-15T18:28:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe1a8b41700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f7980 0x7fe1a4107520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe19400e7f0 tx=0x7fe19400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe199ffb700 1 -- 172.21.15.84:0/1189746428 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1940092e0 con 0x7fe1a40f7980 2024-02-15T18:28:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe199ffb700 1 -- 172.21.15.84:0/1189746428 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fe19400f040 con 0x7fe1a40f7980 2024-02-15T18:28:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a41085b0 con 0x7fe1a40f7980 2024-02-15T18:28:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.316+0000 7fe199ffb700 1 -- 172.21.15.84:0/1189746428 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe194014850 con 0x7fe1a40f7980 2024-02-15T18:28:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.317+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a4108b70 con 0x7fe1a40f7980 2024-02-15T18:28:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.318+0000 7fe199ffb700 1 -- 172.21.15.84:0/1189746428 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe19401b030 con 0x7fe1a40f7980 2024-02-15T18:28:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.318+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a4045ad0 con 0x7fe1a40f7980 2024-02-15T18:28:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.318+0000 7fe199ffb700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe190060f20 0x7fe1900633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.318+0000 7fe199ffb700 1 -- 172.21.15.84:0/1189746428 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe19407bef0 con 0x7fe1a40f7980 2024-02-15T18:28:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.318+0000 7fe1a9342700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe190060f20 0x7fe1900633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:13.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.319+0000 7fe1a9342700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe190060f20 0x7fe1900633e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe1a0009720 tx=0x7fe1a0016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:13.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.322+0000 7fe199ffb700 1 -- 172.21.15.84:0/1189746428 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe19404af60 con 0x7fe1a40f7980 2024-02-15T18:28:13.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.564+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1a40ff160 con 0x7fe190060f20 2024-02-15T18:28:13.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.565+0000 7fe199ffb700 1 -- 172.21.15.84:0/1189746428 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fe1a000f070 con 0x7fe190060f20 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.567+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe190060f20 msgr2=0x7fe1900633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.567+0000 7fe1ab5a6700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe190060f20 0x7fe1900633e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe1a0009720 tx=0x7fe1a0016040).stop 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.567+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f7980 msgr2=0x7fe1a4107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.567+0000 7fe1ab5a6700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f7980 0x7fe1a4107520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe19400e7f0 tx=0x7fe19400b040).stop 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.567+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 shutdown_connections 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.567+0000 7fe1ab5a6700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe190060f20 0x7fe1900633e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.567+0000 7fe1ab5a6700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1a40f66e0 0x7fe1a4107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.567+0000 7fe1ab5a6700 1 --2- 172.21.15.84:0/1189746428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a40f7980 0x7fe1a4107520 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.567+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 >> 172.21.15.84:0/1189746428 conn(0x7fe1a40f1e40 msgr2=0x7fe1a40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.568+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 shutdown_connections 2024-02-15T18:28:13.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.568+0000 7fe1ab5a6700 1 -- 172.21.15.84:0/1189746428 wait complete. 2024-02-15T18:28:13.576 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:28:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.687+0000 7fdb911f7700 1 -- 172.21.15.84:0/1077270305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f7980 msgr2=0x7fdb8c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.687+0000 7fdb911f7700 1 --2- 172.21.15.84:0/1077270305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f7980 0x7fdb8c0f7de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdb80004660 tx=0x7fdb80009b30).stop 2024-02-15T18:28:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.687+0000 7fdb911f7700 1 -- 172.21.15.84:0/1077270305 shutdown_connections 2024-02-15T18:28:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.687+0000 7fdb911f7700 1 --2- 172.21.15.84:0/1077270305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f7980 0x7fdb8c0f7de0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.687+0000 7fdb911f7700 1 --2- 172.21.15.84:0/1077270305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb8c0f66e0 0x7fdb8c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.687+0000 7fdb911f7700 1 -- 172.21.15.84:0/1077270305 >> 172.21.15.84:0/1077270305 conn(0x7fdb8c0f1e40 msgr2=0x7fdb8c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.687+0000 7fdb911f7700 1 -- 172.21.15.84:0/1077270305 shutdown_connections 2024-02-15T18:28:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.687+0000 7fdb911f7700 1 -- 172.21.15.84:0/1077270305 wait complete. 2024-02-15T18:28:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.688+0000 7fdb911f7700 1 Processor -- start 2024-02-15T18:28:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.688+0000 7fdb911f7700 1 -- start start 2024-02-15T18:28:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.688+0000 7fdb911f7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f66e0 0x7fdb8c107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.688+0000 7fdb911f7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb8c0f7980 0x7fdb8c1074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.688+0000 7fdb911f7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c107aa0 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.688+0000 7fdb911f7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c107be0 con 0x7fdb8c0f7980 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.688+0000 7fdb8ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f66e0 0x7fdb8c107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb8ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f66e0 0x7fdb8c107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53896/0 (socket says 172.21.15.84:53896) 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb8ad9d700 1 -- 172.21.15.84:0/2887535490 learned_addr learned my addr 172.21.15.84:0/2887535490 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb8a59c700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb8c0f7980 0x7fdb8c1074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb8ad9d700 1 -- 172.21.15.84:0/2887535490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb8c0f7980 msgr2=0x7fdb8c1074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb8ad9d700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb8c0f7980 0x7fdb8c1074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb8ad9d700 1 -- 172.21.15.84:0/2887535490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb80005040 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb8ad9d700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f66e0 0x7fdb8c107000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fdb7c002700 tx=0x7fdb7c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb737fe700 1 -- 172.21.15.84:0/2887535490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb7c0079c0 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb737fe700 1 -- 172.21.15.84:0/2887535490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fdb7c00f040 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8c108580 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb737fe700 1 -- 172.21.15.84:0/2887535490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb7c014940 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.689+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c108b40 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.690+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8c045ad0 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.691+0000 7fdb737fe700 1 -- 172.21.15.84:0/2887535490 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fdb7c01b060 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.691+0000 7fdb737fe700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdb74060f20 0x7fdb740633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:13.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.692+0000 7fdb737fe700 1 -- 172.21.15.84:0/2887535490 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdb7c07bf60 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.692+0000 7fdb8a59c700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdb74060f20 0x7fdb740633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:13.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.692+0000 7fdb8a59c700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdb74060f20 0x7fdb740633e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fdb80004630 tx=0x7fdb80009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:13.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.697+0000 7fdb737fe700 1 -- 172.21.15.84:0/2887535490 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fdb7c04fe10 con 0x7fdb8c0f66e0 2024-02-15T18:28:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.981+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb8c108dc0 con 0x7fdb74060f20 2024-02-15T18:28:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.985+0000 7fdb737fe700 1 -- 172.21.15.84:0/2887535490 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fdb8c108dc0 con 0x7fdb74060f20 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.987+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdb74060f20 msgr2=0x7fdb740633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.987+0000 7fdb911f7700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdb74060f20 0x7fdb740633e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fdb80004630 tx=0x7fdb80009b30).stop 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.987+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f66e0 msgr2=0x7fdb8c107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.987+0000 7fdb911f7700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f66e0 0x7fdb8c107000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fdb7c002700 tx=0x7fdb7c009d80).stop 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.987+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 shutdown_connections 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.987+0000 7fdb911f7700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdb74060f20 0x7fdb740633e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.987+0000 7fdb911f7700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb8c0f66e0 0x7fdb8c107000 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0x7fdb7c002700 tx=0x7fdb7c009d80).stop 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.987+0000 7fdb911f7700 1 --2- 172.21.15.84:0/2887535490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb8c0f7980 0x7fdb8c1074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.987+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 >> 172.21.15.84:0/2887535490 conn(0x7fdb8c0f1e40 msgr2=0x7fdb8c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.988+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 shutdown_connections 2024-02-15T18:28:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:13.988+0000 7fdb911f7700 1 -- 172.21.15.84:0/2887535490 wait complete. 2024-02-15T18:28:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.145+0000 7f79e1ba0700 1 -- 172.21.15.84:0/653233563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc068130 msgr2=0x7f79dc0685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.145+0000 7f79e1ba0700 1 --2- 172.21.15.84:0/653233563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc068130 0x7f79dc0685b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f79d0004f20 tx=0x7f79d00049a0).stop 2024-02-15T18:28:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.145+0000 7f79e1ba0700 1 -- 172.21.15.84:0/653233563 shutdown_connections 2024-02-15T18:28:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.145+0000 7f79e1ba0700 1 --2- 172.21.15.84:0/653233563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc068130 0x7f79dc0685b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.145+0000 7f79e1ba0700 1 --2- 172.21.15.84:0/653233563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc0696b0 0x7f79dc067bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.145+0000 7f79e1ba0700 1 -- 172.21.15.84:0/653233563 >> 172.21.15.84:0/653233563 conn(0x7f79dc0636c0 msgr2=0x7f79dc065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.145+0000 7f79e1ba0700 1 -- 172.21.15.84:0/653233563 shutdown_connections 2024-02-15T18:28:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.145+0000 7f79e1ba0700 1 -- 172.21.15.84:0/653233563 wait complete. 2024-02-15T18:28:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.146+0000 7f79e1ba0700 1 Processor -- start 2024-02-15T18:28:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.146+0000 7f79e1ba0700 1 -- start start 2024-02-15T18:28:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.146+0000 7f79e1ba0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc068130 0x7f79dc128510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.146+0000 7f79e1ba0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc128a00 0x7f79dc071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.147+0000 7f79e1ba0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc128f60 con 0x7f79dc128a00 2024-02-15T18:28:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.147+0000 7f79e1ba0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc1290a0 con 0x7f79dc068130 2024-02-15T18:28:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.147+0000 7f79daffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc128a00 0x7f79dc071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.147+0000 7f79daffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc128a00 0x7f79dc071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53916/0 (socket says 172.21.15.84:53916) 2024-02-15T18:28:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.147+0000 7f79daffd700 1 -- 172.21.15.84:0/179570904 learned_addr learned my addr 172.21.15.84:0/179570904 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.147+0000 7f79daffd700 1 -- 172.21.15.84:0/179570904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc068130 msgr2=0x7f79dc128510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.147+0000 7f79daffd700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc068130 0x7f79dc128510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.147+0000 7f79daffd700 1 -- 172.21.15.84:0/179570904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d0005040 con 0x7f79dc128a00 2024-02-15T18:28:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.148+0000 7f79daffd700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc128a00 0x7f79dc071700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f79d0010040 tx=0x7f79d00049a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.148+0000 7f79c3fff700 1 -- 172.21.15.84:0/179570904 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d001f070 con 0x7f79dc128a00 2024-02-15T18:28:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.148+0000 7f79c3fff700 1 -- 172.21.15.84:0/179570904 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f79d000fa70 con 0x7f79dc128a00 2024-02-15T18:28:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.148+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc071cb0 con 0x7f79dc128a00 2024-02-15T18:28:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.148+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc072160 con 0x7f79dc128a00 2024-02-15T18:28:14.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.148+0000 7f79c3fff700 1 -- 172.21.15.84:0/179570904 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d001a5d0 con 0x7f79dc128a00 2024-02-15T18:28:14.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.152+0000 7f79c3fff700 1 -- 172.21.15.84:0/179570904 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f79d000f040 con 0x7f79dc128a00 2024-02-15T18:28:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.153+0000 7f79c3fff700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79c4060f70 0x7f79c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.153+0000 7f79c3fff700 1 -- 172.21.15.84:0/179570904 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f79d007d6c0 con 0x7f79dc128a00 2024-02-15T18:28:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.153+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc004fa0 con 0x7f79dc128a00 2024-02-15T18:28:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.153+0000 7f79db7fe700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79c4060f70 0x7f79c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:14.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.154+0000 7f79db7fe700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79c4060f70 0x7f79c4063430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f79dc1282a0 tx=0x7f79cc006a30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:14.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.161+0000 7f79c3fff700 1 -- 172.21.15.84:0/179570904 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f79d004db60 con 0x7f79dc128a00 2024-02-15T18:28:14.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.414+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f79bc000bc0 con 0x7f79c4060f70 2024-02-15T18:28:14.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.427+0000 7f79c3fff700 1 -- 172.21.15.84:0/179570904 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f79bc000bc0 con 0x7f79c4060f70 2024-02-15T18:28:14.422 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (7m) 32s ago 9m 15.4M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 starting - - - - 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (8m) 11s ago 8m 6400k - 16.2.4 8d91d370c2b8 d52ceb5fe65b 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (7m) 32s ago 8m 34.4M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (4m) 32s ago 4m 156M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (3m) 32s ago 3m 13.3M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (4m) 11s ago 4m 156M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (4m) 11s ago 4m 14.2M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (106s) 32s ago 10m 425M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (61s) 11s ago 8m 387M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (44s) 32s ago 10m 24.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (17s) 11s ago 8m 17.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (8m) 32s ago 8m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (7m) 11s ago 7m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:28:14.423 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (7m) 32s ago 7m 349M 4096M 16.2.4 8d91d370c2b8 20023f9a2292 2024-02-15T18:28:14.424 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (7m) 32s ago 7m 386M 4096M 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:28:14.424 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (6m) 32s ago 6m 300M 4096M 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:28:14.424 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (6m) 11s ago 6m 408M 4096M 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:28:14.424 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (6m) 11s ago 6m 413M 4096M 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:28:14.424 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (5m) 11s ago 5m 416M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:28:14.424 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (111s) 32s ago 8m 48.7M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:28:14.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79c4060f70 msgr2=0x7f79c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79c4060f70 0x7f79c4063430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f79dc1282a0 tx=0x7f79cc006a30).stop 2024-02-15T18:28:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc128a00 msgr2=0x7f79dc071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc128a00 0x7f79dc071700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f79d0010040 tx=0x7f79d00049a0).stop 2024-02-15T18:28:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 shutdown_connections 2024-02-15T18:28:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f79c4060f70 0x7f79c4063430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc068130 0x7f79dc128510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 --2- 172.21.15.84:0/179570904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79dc128a00 0x7f79dc071700 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0x7f79d0010040 tx=0x7f79d00049a0).stop 2024-02-15T18:28:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 >> 172.21.15.84:0/179570904 conn(0x7f79dc0636c0 msgr2=0x7f79dc06c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 shutdown_connections 2024-02-15T18:28:14.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.430+0000 7f79e1ba0700 1 -- 172.21.15.84:0/179570904 wait complete. 2024-02-15T18:28:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.543+0000 7f23347a2700 1 -- 172.21.15.84:0/9983999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 msgr2=0x7f232c067d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.543+0000 7f23347a2700 1 --2- 172.21.15.84:0/9983999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 0x7f232c067d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f231c004660 tx=0x7f231c009b30).stop 2024-02-15T18:28:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.543+0000 7f23347a2700 1 -- 172.21.15.84:0/9983999 shutdown_connections 2024-02-15T18:28:14.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.543+0000 7f23347a2700 1 --2- 172.21.15.84:0/9983999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f232c068250 0x7f232c0686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.543+0000 7f23347a2700 1 --2- 172.21.15.84:0/9983999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 0x7f232c067d60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.543+0000 7f23347a2700 1 -- 172.21.15.84:0/9983999 >> 172.21.15.84:0/9983999 conn(0x7f232c0636c0 msgr2=0x7f232c065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:14.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.543+0000 7f23347a2700 1 -- 172.21.15.84:0/9983999 shutdown_connections 2024-02-15T18:28:14.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.543+0000 7f23347a2700 1 -- 172.21.15.84:0/9983999 wait complete. 2024-02-15T18:28:14.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.543+0000 7f23347a2700 1 Processor -- start 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f23347a2700 1 -- start start 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f23347a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f232c068250 0x7f232c10c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f23347a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 0x7f232c10cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f23347a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c10d2d0 con 0x7f232c0696d0 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f23347a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c10d410 con 0x7f232c068250 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f2331d3d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 0x7f232c10cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f2331d3d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 0x7f232c10cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53930/0 (socket says 172.21.15.84:53930) 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f233253e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f232c068250 0x7f232c10c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f2331d3d700 1 -- 172.21.15.84:0/579776027 learned_addr learned my addr 172.21.15.84:0/579776027 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f2331d3d700 1 -- 172.21.15.84:0/579776027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f232c068250 msgr2=0x7f232c10c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f2331d3d700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f232c068250 0x7f232c10c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f2331d3d700 1 -- 172.21.15.84:0/579776027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328005040 con 0x7f232c0696d0 2024-02-15T18:28:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f233253e700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f232c068250 0x7f232c10c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:28:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.544+0000 7f2331d3d700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 0x7f232c10cd20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f23280048a0 tx=0x7f2328009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.545+0000 7f2322ffd700 1 -- 172.21.15.84:0/579776027 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f232800e030 con 0x7f232c0696d0 2024-02-15T18:28:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.545+0000 7f2322ffd700 1 -- 172.21.15.84:0/579776027 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f232800f040 con 0x7f232c0696d0 2024-02-15T18:28:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.545+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c005040 con 0x7f232c0696d0 2024-02-15T18:28:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.545+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c11ff90 con 0x7f232c0696d0 2024-02-15T18:28:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.545+0000 7f2322ffd700 1 -- 172.21.15.84:0/579776027 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2328014820 con 0x7f232c0696d0 2024-02-15T18:28:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.546+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2314004fa0 con 0x7f232c0696d0 2024-02-15T18:28:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.546+0000 7f2322ffd700 1 -- 172.21.15.84:0/579776027 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f2328014b40 con 0x7f232c0696d0 2024-02-15T18:28:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.546+0000 7f2322ffd700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2318060f20 0x7f23180633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.547+0000 7f2322ffd700 1 -- 172.21.15.84:0/579776027 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f232807c720 con 0x7f232c0696d0 2024-02-15T18:28:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.547+0000 7f233253e700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2318060f20 0x7f23180633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.547+0000 7f233253e700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2318060f20 0x7f23180633e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f231c005010 tx=0x7f231c016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.551+0000 7f2322ffd700 1 -- 172.21.15.84:0/579776027 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2328050720 con 0x7f232c0696d0 2024-02-15T18:28:14.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:12.700087+0000 mgr.smithi084.hjmnez (mgr.14596) 73 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 424 op/s 2024-02-15T18:28:14.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:13.450484+0000 mgr.smithi084.hjmnez (mgr.14596) 74 : cephadm [INF] Upgrade: Updating crash.smithi133 (2/2) 2024-02-15T18:28:14.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:13.455109+0000 mon.smithi084 (mon.0) 44 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:14.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:13.455979+0000 mon.smithi084 (mon.0) 45 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:28:14.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:13.456730+0000 mon.smithi084 (mon.0) 46 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:14.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:13.457307+0000 mgr.smithi084.hjmnez (mgr.14596) 75 : cephadm [INF] Deploying daemon crash.smithi133 on smithi133 2024-02-15T18:28:14.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:13.566190+0000 mgr.smithi084.hjmnez (mgr.14596) 76 : audit [DBG] from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:14.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:12.700087+0000 mgr.smithi084.hjmnez (mgr.14596) 73 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 424 op/s 2024-02-15T18:28:14.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:13.450484+0000 mgr.smithi084.hjmnez (mgr.14596) 74 : cephadm [INF] Upgrade: Updating crash.smithi133 (2/2) 2024-02-15T18:28:14.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:13.455109+0000 mon.smithi084 (mon.0) 44 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:14.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:13.455979+0000 mon.smithi084 (mon.0) 45 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi133", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:28:14.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:13.456730+0000 mon.smithi084 (mon.0) 46 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:14.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:13.457307+0000 mgr.smithi084.hjmnez (mgr.14596) 75 : cephadm [INF] Deploying daemon crash.smithi133 on smithi133 2024-02-15T18:28:14.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:13.566190+0000 mgr.smithi084.hjmnez (mgr.14596) 76 : audit [DBG] from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:14.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.886+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2314005e80 con 0x7f232c0696d0 2024-02-15T18:28:14.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.887+0000 7f2322ffd700 1 -- 172.21.15.84:0/579776027 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+712 (secure 0 0 0) 0x7f2328050310 con 0x7f232c0696d0 2024-02-15T18:28:14.882 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:28:14.882 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:28:14.882 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:28:14.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4, 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:28:14.883 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:28:14.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.889+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2318060f20 msgr2=0x7f23180633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.889+0000 7f23347a2700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2318060f20 0x7f23180633e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f231c005010 tx=0x7f231c016040).stop 2024-02-15T18:28:14.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.889+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 msgr2=0x7f232c10cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.889+0000 7f23347a2700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 0x7f232c10cd20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f23280048a0 tx=0x7f2328009b30).stop 2024-02-15T18:28:14.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.890+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 shutdown_connections 2024-02-15T18:28:14.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.890+0000 7f23347a2700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2318060f20 0x7f23180633e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.890+0000 7f23347a2700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f232c068250 0x7f232c10c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.890+0000 7f23347a2700 1 --2- 172.21.15.84:0/579776027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f232c0696d0 0x7f232c10cd20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.890+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 >> 172.21.15.84:0/579776027 conn(0x7f232c0636c0 msgr2=0x7f232c101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:14.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.890+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 shutdown_connections 2024-02-15T18:28:14.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:14.890+0000 7f23347a2700 1 -- 172.21.15.84:0/579776027 wait complete. 2024-02-15T18:28:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.015+0000 7fa028c3d700 1 -- 172.21.15.84:0/981196132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0240f7620 msgr2=0x7fa0240f9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.015+0000 7fa028c3d700 1 --2- 172.21.15.84:0/981196132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0240f7620 0x7fa0240f9ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa014004660 tx=0x7fa014009b30).stop 2024-02-15T18:28:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.019+0000 7fa028c3d700 1 -- 172.21.15.84:0/981196132 shutdown_connections 2024-02-15T18:28:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.019+0000 7fa028c3d700 1 --2- 172.21.15.84:0/981196132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0240f7620 0x7fa0240f9ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.019+0000 7fa028c3d700 1 --2- 172.21.15.84:0/981196132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa024060410 0x7fa0240f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.019+0000 7fa028c3d700 1 -- 172.21.15.84:0/981196132 >> 172.21.15.84:0/981196132 conn(0x7fa0240f0d30 msgr2=0x7fa0240f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.019+0000 7fa028c3d700 1 -- 172.21.15.84:0/981196132 shutdown_connections 2024-02-15T18:28:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.019+0000 7fa028c3d700 1 -- 172.21.15.84:0/981196132 wait complete. 2024-02-15T18:28:15.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.020+0000 7fa028c3d700 1 Processor -- start 2024-02-15T18:28:15.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.020+0000 7fa028c3d700 1 -- start start 2024-02-15T18:28:15.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.020+0000 7fa028c3d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa024060410 0x7fa024102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:15.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.020+0000 7fa028c3d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240f7620 0x7fa024103330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:15.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.020+0000 7fa028c3d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa024103930 con 0x7fa024060410 2024-02-15T18:28:15.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.020+0000 7fa028c3d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa024117100 con 0x7fa0240f7620 2024-02-15T18:28:15.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.020+0000 7fa02259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa024060410 0x7fa024102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:15.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.020+0000 7fa02259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa024060410 0x7fa024102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53946/0 (socket says 172.21.15.84:53946) 2024-02-15T18:28:15.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.020+0000 7fa02259c700 1 -- 172.21.15.84:0/3652386566 learned_addr learned my addr 172.21.15.84:0/3652386566 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:15.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.021+0000 7fa02259c700 1 -- 172.21.15.84:0/3652386566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240f7620 msgr2=0x7fa024103330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.021+0000 7fa02259c700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240f7620 0x7fa024103330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.021+0000 7fa02259c700 1 -- 172.21.15.84:0/3652386566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014005040 con 0x7fa024060410 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.021+0000 7fa02259c700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa024060410 0x7fa024102e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa0180026d0 tx=0x7fa018009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.022+0000 7fa012ffd700 1 -- 172.21.15.84:0/3652386566 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa018009320 con 0x7fa024060410 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.022+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa024117380 con 0x7fa024060410 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.022+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa024117940 con 0x7fa024060410 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.023+0000 7fa012ffd700 1 -- 172.21.15.84:0/3652386566 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa01800f040 con 0x7fa024060410 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.023+0000 7fa012ffd700 1 -- 172.21.15.84:0/3652386566 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0180149a0 con 0x7fa024060410 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.023+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa008004fa0 con 0x7fa024060410 2024-02-15T18:28:15.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.025+0000 7fa012ffd700 1 -- 172.21.15.84:0/3652386566 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa018009480 con 0x7fa024060410 2024-02-15T18:28:15.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.025+0000 7fa012ffd700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa00c060f70 0x7fa00c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:15.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.025+0000 7fa012ffd700 1 -- 172.21.15.84:0/3652386566 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa01807ca20 con 0x7fa024060410 2024-02-15T18:28:15.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.027+0000 7fa021d9b700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa00c060f70 0x7fa00c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:15.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.028+0000 7fa021d9b700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa00c060f70 0x7fa00c063430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa014009f50 tx=0x7fa014009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:15.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.033+0000 7fa012ffd700 1 -- 172.21.15.84:0/3652386566 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa01804ce60 con 0x7fa024060410 2024-02-15T18:28:15.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.322+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa008005940 con 0x7fa024060410 2024-02-15T18:28:15.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.322+0000 7fa012ffd700 1 -- 172.21.15.84:0/3652386566 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1807 (secure 0 0 0) 0x7fa018050480 con 0x7fa024060410 2024-02-15T18:28:15.318 INFO:teuthology.orchestra.run.smithi084.stdout:e16 2024-02-15T18:28:15.318 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:28:15.318 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:28:15.318 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:28:15.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:28:15.318 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:28:15.318 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 16 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:28:06.036365+0000 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:28:15.319 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:28:15.320 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:28:15.321 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:28:15.321 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:28:15.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:28:15.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:28:15.321 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:28:15.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:28:15.321 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:28:15.321 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:28:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa00c060f70 msgr2=0x7fa00c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa00c060f70 0x7fa00c063430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa014009f50 tx=0x7fa014009b30).stop 2024-02-15T18:28:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa024060410 msgr2=0x7fa024102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa024060410 0x7fa024102e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa0180026d0 tx=0x7fa018009de0).stop 2024-02-15T18:28:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 shutdown_connections 2024-02-15T18:28:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa00c060f70 0x7fa00c063430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa024060410 0x7fa024102e40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 --2- 172.21.15.84:0/3652386566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240f7620 0x7fa024103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 >> 172.21.15.84:0/3652386566 conn(0x7fa0240f0d30 msgr2=0x7fa0240f3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:15.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 shutdown_connections 2024-02-15T18:28:15.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.324+0000 7fa028c3d700 1 -- 172.21.15.84:0/3652386566 wait complete. 2024-02-15T18:28:15.323 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2024-02-15T18:28:15.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.430+0000 7f0215406700 1 -- 172.21.15.84:0/2655924132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 msgr2=0x7f02100f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:15.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.430+0000 7f0215406700 1 --2- 172.21.15.84:0/2655924132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 0x7f02100f6b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0204004660 tx=0x7f0204009b30).stop 2024-02-15T18:28:15.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.430+0000 7f0215406700 1 -- 172.21.15.84:0/2655924132 shutdown_connections 2024-02-15T18:28:15.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.430+0000 7f0215406700 1 --2- 172.21.15.84:0/2655924132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 0x7f02100f6b40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.430+0000 7f0215406700 1 --2- 172.21.15.84:0/2655924132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02100f5440 0x7f02100f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.430+0000 7f0215406700 1 -- 172.21.15.84:0/2655924132 >> 172.21.15.84:0/2655924132 conn(0x7f02100f0ba0 msgr2=0x7f02100f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.430+0000 7f0215406700 1 -- 172.21.15.84:0/2655924132 shutdown_connections 2024-02-15T18:28:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.430+0000 7f0215406700 1 -- 172.21.15.84:0/2655924132 wait complete. 2024-02-15T18:28:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.430+0000 7f0215406700 1 Processor -- start 2024-02-15T18:28:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f0215406700 1 -- start start 2024-02-15T18:28:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f0215406700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02100f5440 0x7f0210106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f0215406700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 0x7f0210107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f0215406700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210107940 con 0x7f02100f66e0 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f0215406700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210108150 con 0x7f02100f5440 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f020f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 0x7f0210107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f020f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 0x7f0210107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53968/0 (socket says 172.21.15.84:53968) 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f020f7fe700 1 -- 172.21.15.84:0/2520642043 learned_addr learned my addr 172.21.15.84:0/2520642043 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f020ffff700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02100f5440 0x7f0210106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f020f7fe700 1 -- 172.21.15.84:0/2520642043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02100f5440 msgr2=0x7f0210106e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f020f7fe700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02100f5440 0x7f0210106e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f020f7fe700 1 -- 172.21.15.84:0/2520642043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204005040 con 0x7f02100f66e0 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.431+0000 7f020f7fe700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 0x7f0210107340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0204000c00 tx=0x7f020400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.432+0000 7f020cff9700 1 -- 172.21.15.84:0/2520642043 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0204019070 con 0x7f02100f66e0 2024-02-15T18:28:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.432+0000 7f020cff9700 1 -- 172.21.15.84:0/2520642043 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0204007e80 con 0x7f02100f66e0 2024-02-15T18:28:15.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.432+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0210108370 con 0x7f02100f66e0 2024-02-15T18:28:15.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.432+0000 7f020cff9700 1 -- 172.21.15.84:0/2520642043 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0204014db0 con 0x7f02100f66e0 2024-02-15T18:28:15.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.432+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02101088d0 con 0x7f02100f66e0 2024-02-15T18:28:15.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.433+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0210059100 con 0x7f02100f66e0 2024-02-15T18:28:15.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.433+0000 7f020cff9700 1 -- 172.21.15.84:0/2520642043 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f0204025070 con 0x7f02100f66e0 2024-02-15T18:28:15.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.433+0000 7f020cff9700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01f8060f10 0x7f01f80633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:15.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.433+0000 7f020cff9700 1 -- 172.21.15.84:0/2520642043 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f020407d040 con 0x7f02100f66e0 2024-02-15T18:28:15.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.433+0000 7f020ffff700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01f8060f10 0x7f01f80633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:15.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.434+0000 7f020ffff700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01f8060f10 0x7f01f80633d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0210106bc0 tx=0x7f020000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.438+0000 7f020cff9700 1 -- 172.21.15.84:0/2520642043 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f020404d4d0 con 0x7f02100f66e0 2024-02-15T18:28:15.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:13.983190+0000 mgr.smithi084.hjmnez (mgr.14596) 77 : audit [DBG] from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:15.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:14.416380+0000 mgr.smithi084.hjmnez (mgr.14596) 78 : audit [DBG] from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:15.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:14.887758+0000 mon.smithi084 (mon.0) 47 : audit [DBG] from='client.? 172.21.15.84:0/579776027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:15.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:15.323302+0000 mon.smithi084 (mon.0) 48 : audit [DBG] from='client.? 172.21.15.84:0/3652386566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:28:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.664+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02100fefb0 con 0x7f01f8060f10 2024-02-15T18:28:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.665+0000 7f020cff9700 1 -- 172.21.15.84:0/2520642043 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f02100fefb0 con 0x7f01f8060f10 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "4/21 daemons upgraded", 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading crash daemons", 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:28:15.661 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:28:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.667+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01f8060f10 msgr2=0x7f01f80633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.667+0000 7f0215406700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01f8060f10 0x7f01f80633d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0210106bc0 tx=0x7f020000b040).stop 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.667+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 msgr2=0x7f0210107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.667+0000 7f0215406700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 0x7f0210107340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0204000c00 tx=0x7f020400b040).stop 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.667+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 shutdown_connections 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.667+0000 7f0215406700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01f8060f10 0x7f01f80633d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.667+0000 7f0215406700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02100f5440 0x7f0210106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.667+0000 7f0215406700 1 --2- 172.21.15.84:0/2520642043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02100f66e0 0x7f0210107340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.667+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 >> 172.21.15.84:0/2520642043 conn(0x7f02100f0ba0 msgr2=0x7f02100fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.668+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 shutdown_connections 2024-02-15T18:28:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:15.668+0000 7f0215406700 1 -- 172.21.15.84:0/2520642043 wait complete. 2024-02-15T18:28:15.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:13.983190+0000 mgr.smithi084.hjmnez (mgr.14596) 77 : audit [DBG] from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:15.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:14.416380+0000 mgr.smithi084.hjmnez (mgr.14596) 78 : audit [DBG] from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:15.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:14.887758+0000 mon.smithi084 (mon.0) 47 : audit [DBG] from='client.? 172.21.15.84:0/579776027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:15.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:15.323302+0000 mon.smithi084 (mon.0) 48 : audit [DBG] from='client.? 172.21.15.84:0/3652386566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:28:16.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:14.700529+0000 mgr.smithi084.hjmnez (mgr.14596) 79 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s rd, 2.3 MiB/s wr, 581 op/s 2024-02-15T18:28:16.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:15.665993+0000 mgr.smithi084.hjmnez (mgr.14596) 80 : audit [DBG] from='client.34144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:16.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:14.700529+0000 mgr.smithi084.hjmnez (mgr.14596) 79 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s rd, 2.3 MiB/s wr, 581 op/s 2024-02-15T18:28:16.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:15.665993+0000 mgr.smithi084.hjmnez (mgr.14596) 80 : audit [DBG] from='client.34144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:17.592 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-15T18:28:17.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-15T18:28:17.967 DEBUG:teuthology.parallel:result is None 2024-02-15T18:28:18.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:16.700860+0000 mgr.smithi084.hjmnez (mgr.14596) 81 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.7 MiB/s wr, 376 op/s 2024-02-15T18:28:18.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:18.189266+0000 mon.smithi084 (mon.0) 49 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:18.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:18.190019+0000 mon.smithi084 (mon.0) 50 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:18.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:16.700860+0000 mgr.smithi084.hjmnez (mgr.14596) 81 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 301 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.7 MiB/s wr, 376 op/s 2024-02-15T18:28:18.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:18.189266+0000 mon.smithi084 (mon.0) 49 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:18.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:18.190019+0000 mon.smithi084 (mon.0) 50 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:20.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:18.701377+0000 mgr.smithi084.hjmnez (mgr.14596) 82 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54 KiB/s rd, 2.6 MiB/s wr, 590 op/s 2024-02-15T18:28:20.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:18.701377+0000 mgr.smithi084.hjmnez (mgr.14596) 82 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54 KiB/s rd, 2.6 MiB/s wr, 590 op/s 2024-02-15T18:28:22.734 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:20.701734+0000 mgr.smithi084.hjmnez (mgr.14596) 83 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 429 op/s 2024-02-15T18:28:22.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:20.701734+0000 mgr.smithi084.hjmnez (mgr.14596) 83 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 429 op/s 2024-02-15T18:28:25.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:22.702116+0000 mgr.smithi084.hjmnez (mgr.14596) 84 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 445 op/s 2024-02-15T18:28:25.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:23.670304+0000 mon.smithi084 (mon.0) 51 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:25.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:22.702116+0000 mgr.smithi084.hjmnez (mgr.14596) 84 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 299 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 445 op/s 2024-02-15T18:28:25.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:23.670304+0000 mon.smithi084 (mon.0) 51 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:26.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:24.702563+0000 mgr.smithi084.hjmnez (mgr.14596) 85 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50 KiB/s rd, 2.3 MiB/s wr, 537 op/s 2024-02-15T18:28:26.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.866564+0000 mon.smithi084 (mon.0) 52 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:26.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.867480+0000 mon.smithi084 (mon.0) 53 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.868132+0000 mon.smithi084 (mon.0) 54 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:24.868709+0000 mgr.smithi084.hjmnez (mgr.14596) 86 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.871884+0000 mon.smithi084 (mon.0) 55 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.876532+0000 mon.smithi084 (mon.0) 56 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.878627+0000 mon.smithi084 (mon.0) 57 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.879873+0000 mon.smithi084 (mon.0) 58 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.881254+0000 mon.smithi084 (mon.0) 59 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:24.881834+0000 mgr.smithi084.hjmnez (mgr.14596) 87 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.886531+0000 mon.smithi084 (mon.0) 60 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.887436+0000 mon.smithi084 (mon.0) 61 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi084"}]: dispatch 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.891307+0000 mon.smithi084 (mon.0) 62 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi084"}]': finished 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.892385+0000 mon.smithi084 (mon.0) 63 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi133"}]: dispatch 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.896407+0000 mon.smithi084 (mon.0) 64 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi133"}]': finished 2024-02-15T18:28:26.142 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.897792+0000 mon.smithi084 (mon.0) 65 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T18:28:26.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:24.897944+0000 mgr.smithi084.hjmnez (mgr.14596) 88 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T18:28:26.143 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:24.898743+0000 mgr.smithi084.hjmnez (mgr.14596) 89 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-15T18:28:26.144 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:24.702563+0000 mgr.smithi084.hjmnez (mgr.14596) 85 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50 KiB/s rd, 2.3 MiB/s wr, 537 op/s 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.866564+0000 mon.smithi084 (mon.0) 52 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.867480+0000 mon.smithi084 (mon.0) 53 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.868132+0000 mon.smithi084 (mon.0) 54 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:24.868709+0000 mgr.smithi084.hjmnez (mgr.14596) 86 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.871884+0000 mon.smithi084 (mon.0) 55 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.876532+0000 mon.smithi084 (mon.0) 56 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.878627+0000 mon.smithi084 (mon.0) 57 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.879873+0000 mon.smithi084 (mon.0) 58 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.881254+0000 mon.smithi084 (mon.0) 59 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:24.881834+0000 mgr.smithi084.hjmnez (mgr.14596) 87 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.886531+0000 mon.smithi084 (mon.0) 60 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.887436+0000 mon.smithi084 (mon.0) 61 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi084"}]: dispatch 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.891307+0000 mon.smithi084 (mon.0) 62 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi084"}]': finished 2024-02-15T18:28:26.145 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.892385+0000 mon.smithi084 (mon.0) 63 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi133"}]: dispatch 2024-02-15T18:28:26.146 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.896407+0000 mon.smithi084 (mon.0) 64 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi133"}]': finished 2024-02-15T18:28:26.146 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.897792+0000 mon.smithi084 (mon.0) 65 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T18:28:26.146 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:24.897944+0000 mgr.smithi084.hjmnez (mgr.14596) 88 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T18:28:26.146 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:24.898743+0000 mgr.smithi084.hjmnez (mgr.14596) 89 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-15T18:28:27.646 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:26.605326+0000 mgr.smithi084.hjmnez (mgr.14596) 90 : cephadm [INF] Upgrade: Updating osd.0 2024-02-15T18:28:27.646 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:26.610587+0000 mon.smithi084 (mon.0) 66 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:27.646 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:26.611309+0000 mon.smithi084 (mon.0) 67 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T18:28:27.647 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:26.611930+0000 mon.smithi084 (mon.0) 68 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:27.647 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:26.612909+0000 mgr.smithi084.hjmnez (mgr.14596) 91 : cephadm [INF] Deploying daemon osd.0 on smithi084 2024-02-15T18:28:27.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:26.605326+0000 mgr.smithi084.hjmnez (mgr.14596) 90 : cephadm [INF] Upgrade: Updating osd.0 2024-02-15T18:28:27.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:26.610587+0000 mon.smithi084 (mon.0) 66 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:27.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:26.611309+0000 mon.smithi084 (mon.0) 67 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T18:28:27.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:26.611930+0000 mon.smithi084 (mon.0) 68 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:27.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:26.612909+0000 mgr.smithi084.hjmnez (mgr.14596) 91 : cephadm [INF] Deploying daemon osd.0 on smithi084 2024-02-15T18:28:28.404 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-15T18:28:28.404 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-15T18:28:28.675 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:26.702903+0000 mgr.smithi084.hjmnez (mgr.14596) 92 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 347 op/s 2024-02-15T18:28:28.676 DEBUG:teuthology.parallel:result is None 2024-02-15T18:28:28.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-15T18:28:28.712 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-15T18:28:28.712 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-15T18:28:28.760 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-15T18:28:28.760 DEBUG:teuthology.parallel:result is None 2024-02-15T18:28:28.990 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:26.702903+0000 mgr.smithi084.hjmnez (mgr.14596) 92 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 347 op/s 2024-02-15T18:28:30.665 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:30 smithi084 systemd[1]: Stopping Ceph osd.0 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:28:30.665 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:28.703304+0000 mgr.smithi084.hjmnez (mgr.14596) 93 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 467 op/s 2024-02-15T18:28:30.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:28.703304+0000 mgr.smithi084.hjmnez (mgr.14596) 93 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 467 op/s 2024-02-15T18:28:31.009 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.0[48569]: debug 2024-02-15T18:28:30.669+0000 7f04bbdd9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:28:31.009 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.0[48569]: debug 2024-02-15T18:28:30.669+0000 7f04bbdd9700 -1 osd.0 48 *** Got signal Terminated *** 2024-02-15T18:28:31.009 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.0[48569]: debug 2024-02-15T18:28:30.669+0000 7f04bbdd9700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:28:31.500 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:31 smithi084 bash[80105]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.0 2024-02-15T18:28:31.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.921847+0000 mon.smithi084 (mon.0) 69 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:28:31.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.921889+0000 mon.smithi084 (mon.0) 70 : cluster [INF] osd.0 failed (root=default,host=smithi084) (connection refused reported by osd.5) 2024-02-15T18:28:31.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.922058+0000 mon.smithi084 (mon.0) 71 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:28:31.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.922132+0000 mon.smithi084 (mon.0) 72 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:28:31.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.922212+0000 mon.smithi084 (mon.0) 73 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:28:31.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.922281+0000 mon.smithi084 (mon.0) 74 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:28:31.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.922362+0000 mon.smithi084 (mon.0) 75 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.922436+0000 mon.smithi084 (mon.0) 76 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.922477+0000 mon.smithi084 (mon.0) 77 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.922576+0000 mon.smithi084 (mon.0) 78 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.922651+0000 mon.smithi084 (mon.0) 79 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.322785+0000 mon.smithi084 (mon.0) 80 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.322931+0000 mon.smithi084 (mon.0) 81 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.322996+0000 mon.smithi084 (mon.0) 82 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.323100+0000 mon.smithi084 (mon.0) 83 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.323172+0000 mon.smithi084 (mon.0) 84 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.323244+0000 mon.smithi084 (mon.0) 85 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:28:31.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.323332+0000 mon.smithi084 (mon.0) 86 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:28:31.761 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:31 smithi084 bash[80160]: Error: no container with name or ID "ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.0" found: no such container 2024-02-15T18:28:31.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.323372+0000 mon.smithi084 (mon.0) 87 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:28:31.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.323464+0000 mon.smithi084 (mon.0) 88 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:28:31.761 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.323538+0000 mon.smithi084 (mon.0) 89 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:28:31.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.921847+0000 mon.smithi084 (mon.0) 69 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:28:31.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.921889+0000 mon.smithi084 (mon.0) 70 : cluster [INF] osd.0 failed (root=default,host=smithi084) (connection refused reported by osd.5) 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.922058+0000 mon.smithi084 (mon.0) 71 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.922132+0000 mon.smithi084 (mon.0) 72 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.922212+0000 mon.smithi084 (mon.0) 73 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.922281+0000 mon.smithi084 (mon.0) 74 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.922362+0000 mon.smithi084 (mon.0) 75 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.922436+0000 mon.smithi084 (mon.0) 76 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.922477+0000 mon.smithi084 (mon.0) 77 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.922576+0000 mon.smithi084 (mon.0) 78 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.922651+0000 mon.smithi084 (mon.0) 79 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.322785+0000 mon.smithi084 (mon.0) 80 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:28:31.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.322931+0000 mon.smithi084 (mon.0) 81 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:28:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.322996+0000 mon.smithi084 (mon.0) 82 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:28:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.323100+0000 mon.smithi084 (mon.0) 83 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:28:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.323172+0000 mon.smithi084 (mon.0) 84 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:28:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.323244+0000 mon.smithi084 (mon.0) 85 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:28:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.323332+0000 mon.smithi084 (mon.0) 86 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:28:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.323372+0000 mon.smithi084 (mon.0) 87 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:28:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.323464+0000 mon.smithi084 (mon.0) 88 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:28:31.893 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.323538+0000 mon.smithi084 (mon.0) 89 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:28:32.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:30.703633+0000 mgr.smithi084.hjmnez (mgr.14596) 94 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 253 op/s 2024-02-15T18:28:32.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.616285+0000 mon.smithi084 (mon.0) 90 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:28:32.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:31.623877+0000 mon.smithi084 (mon.0) 91 : cluster [DBG] osdmap e49: 6 total, 5 up, 6 in 2024-02-15T18:28:32.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:31.624545+0000 mon.smithi084 (mon.0) 92 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:28:32.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:31.625839+0000 mon.smithi084 (mon.0) 93 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:28:33.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:30.703633+0000 mgr.smithi084.hjmnez (mgr.14596) 94 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 253 op/s 2024-02-15T18:28:33.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.616285+0000 mon.smithi084 (mon.0) 90 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:28:33.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:31.623877+0000 mon.smithi084 (mon.0) 91 : cluster [DBG] osdmap e49: 6 total, 5 up, 6 in 2024-02-15T18:28:33.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:31.624545+0000 mon.smithi084 (mon.0) 92 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:28:33.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:31.625839+0000 mon.smithi084 (mon.0) 93 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:28:33.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:32.627215+0000 mon.smithi084 (mon.0) 94 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:28:33.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:32.627374+0000 mon.smithi084 (mon.0) 95 : cluster [DBG] osdmap e50: 6 total, 5 up, 6 in 2024-02-15T18:28:33.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:32.627215+0000 mon.smithi084 (mon.0) 94 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:28:33.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:32.627374+0000 mon.smithi084 (mon.0) 95 : cluster [DBG] osdmap e50: 6 total, 5 up, 6 in 2024-02-15T18:28:34.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:32.704270+0000 mgr.smithi084.hjmnez (mgr.14596) 95 : cluster [DBG] pgmap v64: 65 pgs: 4 active+undersized+degraded, 2 active+undersized, 51 active+clean, 8 stale+active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 848 KiB/s wr, 193 op/s; 15/1623 objects degraded (0.924%) 2024-02-15T18:28:34.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:33.625374+0000 mon.smithi084 (mon.0) 96 : cluster [WRN] Health check failed: Degraded data redundancy: 15/1623 objects degraded (0.924%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T18:28:35.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:32.704270+0000 mgr.smithi084.hjmnez (mgr.14596) 95 : cluster [DBG] pgmap v64: 65 pgs: 4 active+undersized+degraded, 2 active+undersized, 51 active+clean, 8 stale+active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 848 KiB/s wr, 193 op/s; 15/1623 objects degraded (0.924%) 2024-02-15T18:28:35.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:33.625374+0000 mon.smithi084 (mon.0) 96 : cluster [WRN] Health check failed: Degraded data redundancy: 15/1623 objects degraded (0.924%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T18:28:36.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:34.704956+0000 mgr.smithi084.hjmnez (mgr.14596) 96 : cluster [DBG] pgmap v65: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1019 KiB/s wr, 255 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:37.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:34.704956+0000 mgr.smithi084.hjmnez (mgr.14596) 96 : cluster [DBG] pgmap v65: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1019 KiB/s wr, 255 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:37.896 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:36.705497+0000 mgr.smithi084.hjmnez (mgr.14596) 97 : cluster [DBG] pgmap v66: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.0 KiB/s rd, 172 KiB/s wr, 74 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:37.896 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:36.902549+0000 mon.smithi084 (mon.0) 97 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:38.259 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:37 smithi084 systemd[1]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.0.service: Succeeded. 2024-02-15T18:28:38.259 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:37 smithi084 systemd[1]: Stopped Ceph osd.0 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:28:38.259 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:38 smithi084 systemd[1]: Starting Ceph osd.0 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:28:38.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:36.705497+0000 mgr.smithi084.hjmnez (mgr.14596) 97 : cluster [DBG] pgmap v66: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.0 KiB/s rd, 172 KiB/s wr, 74 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:38.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:36.902549+0000 mon.smithi084 (mon.0) 97 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:40.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:38.706332+0000 mgr.smithi084.hjmnez (mgr.14596) 98 : cluster [DBG] pgmap v67: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.1 KiB/s rd, 173 KiB/s wr, 76 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:40.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:38.706332+0000 mgr.smithi084.hjmnez (mgr.14596) 98 : cluster [DBG] pgmap v67: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.1 KiB/s rd, 173 KiB/s wr, 76 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:41.179 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:40.042317+0000 mon.smithi084 (mon.0) 98 : cluster [WRN] Health check update: Degraded data redundancy: 67/345 objects degraded (19.420%), 18 pgs degraded (PG_DEGRADED) 2024-02-15T18:28:41.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:40.042317+0000 mon.smithi084 (mon.0) 98 : cluster [WRN] Health check update: Degraded data redundancy: 67/345 objects degraded (19.420%), 18 pgs degraded (PG_DEGRADED) 2024-02-15T18:28:41.508 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:41 smithi084 bash[80422]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:28:41.508 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:41 smithi084 bash[80422]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T18:28:41.509 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:41 smithi084 bash[80422]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-02-15T18:28:41.509 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:41 smithi084 bash[80422]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-15T18:28:41.509 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:41 smithi084 bash[80422]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-02-15T18:28:41.509 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:41 smithi084 bash[80422]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T18:28:41.509 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:41 smithi084 bash[80422]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T18:28:41.509 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:41 smithi084 bash[80422]: --> ceph-volume lvm activate successful for osd ID: 0 2024-02-15T18:28:42.354 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:40.706843+0000 mgr.smithi084.hjmnez (mgr.14596) 99 : cluster [DBG] pgmap v68: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.3 KiB/s rd, 152 KiB/s wr, 67 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:42.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:40.706843+0000 mgr.smithi084.hjmnez (mgr.14596) 99 : cluster [DBG] pgmap v68: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.3 KiB/s rd, 152 KiB/s wr, 67 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:42.758 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-0[80703]: debug 2024-02-15T18:28:42.358+0000 7fc855b18700 1 -- 172.21.15.84:0/144636273 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562497030680 con 0x562496ff7400 2024-02-15T18:28:42.759 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:42 smithi084 bash[80689]: 645894b31afa4758baddce191fbfc989e96dc6616db804afd52b6c0a1b5d4e82 2024-02-15T18:28:42.759 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:42 smithi084 systemd[1]: Started Ceph osd.0 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:28:43.258 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-0[80703]: debug 2024-02-15T18:28:42.878+0000 7fc85d5a6380 -1 Falling back to public interface 2024-02-15T18:28:43.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:42.479401+0000 mon.smithi084 (mon.0) 99 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:43.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:42.480103+0000 mon.smithi084 (mon.0) 100 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:43.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:42.716932+0000 mon.smithi084 (mon.0) 101 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:43.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:42.479401+0000 mon.smithi084 (mon.0) 99 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:43.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:42.480103+0000 mon.smithi084 (mon.0) 100 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:43.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:42.716932+0000 mon.smithi084 (mon.0) 101 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:44.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:42.707302+0000 mgr.smithi084.hjmnez (mgr.14596) 100 : cluster [DBG] pgmap v69: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 137 KiB/s wr, 60 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:44.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:42.707302+0000 mgr.smithi084.hjmnez (mgr.14596) 100 : cluster [DBG] pgmap v69: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 137 KiB/s wr, 60 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:45.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.774+0000 7ff8e56ef700 1 -- 172.21.15.84:0/822814507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 msgr2=0x7ff8e00f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.774+0000 7ff8e56ef700 1 --2- 172.21.15.84:0/822814507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 0x7ff8e00f6b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff8d4004660 tx=0x7ff8d4009b30).stop 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.774+0000 7ff8e56ef700 1 -- 172.21.15.84:0/822814507 shutdown_connections 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.774+0000 7ff8e56ef700 1 --2- 172.21.15.84:0/822814507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 0x7ff8e00f6b60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.774+0000 7ff8e56ef700 1 --2- 172.21.15.84:0/822814507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8e00f5460 0x7ff8e00f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.774+0000 7ff8e56ef700 1 -- 172.21.15.84:0/822814507 >> 172.21.15.84:0/822814507 conn(0x7ff8e00f0bc0 msgr2=0x7ff8e00f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.774+0000 7ff8e56ef700 1 -- 172.21.15.84:0/822814507 shutdown_connections 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.774+0000 7ff8e56ef700 1 -- 172.21.15.84:0/822814507 wait complete. 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8e56ef700 1 Processor -- start 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8e56ef700 1 -- start start 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8e56ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8e00f5460 0x7ff8e0105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8e56ef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 0x7ff8e0106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8e56ef700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0106840 con 0x7ff8e00f6700 2024-02-15T18:28:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8e56ef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0107050 con 0x7ff8e00f5460 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8de7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 0x7ff8e0106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8de7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 0x7ff8e0106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55104/0 (socket says 172.21.15.84:55104) 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8de7fc700 1 -- 172.21.15.84:0/2913757098 learned_addr learned my addr 172.21.15.84:0/2913757098 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8deffd700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8e00f5460 0x7ff8e0105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8de7fc700 1 -- 172.21.15.84:0/2913757098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8e00f5460 msgr2=0x7ff8e0105d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8de7fc700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8e00f5460 0x7ff8e0105d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.775+0000 7ff8de7fc700 1 -- 172.21.15.84:0/2913757098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4005040 con 0x7ff8e00f6700 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.776+0000 7ff8de7fc700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 0x7ff8e0106240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff8d4009f50 tx=0x7ff8d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.776+0000 7ff8c77fe700 1 -- 172.21.15.84:0/2913757098 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8d401a070 con 0x7ff8e00f6700 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.776+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e0107270 con 0x7ff8e00f6700 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.776+0000 7ff8c77fe700 1 -- 172.21.15.84:0/2913757098 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7ff8d401faf0 con 0x7ff8e00f6700 2024-02-15T18:28:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.776+0000 7ff8c77fe700 1 -- 172.21.15.84:0/2913757098 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8d401e860 con 0x7ff8e00f6700 2024-02-15T18:28:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.776+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e01077d0 con 0x7ff8e00f6700 2024-02-15T18:28:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.777+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e0059100 con 0x7ff8e00f6700 2024-02-15T18:28:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.777+0000 7ff8c77fe700 1 -- 172.21.15.84:0/2913757098 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ff8d401eb20 con 0x7ff8e00f6700 2024-02-15T18:28:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.777+0000 7ff8c77fe700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff8c8060f70 0x7ff8c8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.778+0000 7ff8c77fe700 1 -- 172.21.15.84:0/2913757098 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff8d40802e0 con 0x7ff8e00f6700 2024-02-15T18:28:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.778+0000 7ff8deffd700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff8c8060f70 0x7ff8c8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.778+0000 7ff8deffd700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff8c8060f70 0x7ff8c8063430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff8e0105ac0 tx=0x7ff8d000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.782+0000 7ff8c77fe700 1 -- 172.21.15.84:0/2913757098 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff8d40508b0 con 0x7ff8e00f6700 2024-02-15T18:28:45.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.983+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8e005f620 con 0x7ff8c8060f70 2024-02-15T18:28:45.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.985+0000 7ff8c77fe700 1 -- 172.21.15.84:0/2913757098 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff8e005f620 con 0x7ff8c8060f70 2024-02-15T18:28:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff8c8060f70 msgr2=0x7ff8c8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff8c8060f70 0x7ff8c8063430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff8e0105ac0 tx=0x7ff8d000b040).stop 2024-02-15T18:28:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 msgr2=0x7ff8e0106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 0x7ff8e0106240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff8d4009f50 tx=0x7ff8d4009b30).stop 2024-02-15T18:28:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 shutdown_connections 2024-02-15T18:28:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff8c8060f70 0x7ff8c8063430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8e00f5460 0x7ff8e0105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 --2- 172.21.15.84:0/2913757098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8e00f6700 0x7ff8e0106240 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 >> 172.21.15.84:0/2913757098 conn(0x7ff8e00f0bc0 msgr2=0x7ff8e00fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 shutdown_connections 2024-02-15T18:28:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:45.987+0000 7ff8e56ef700 1 -- 172.21.15.84:0/2913757098 wait complete. 2024-02-15T18:28:45.997 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:28:46.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.095+0000 7f70c4a17700 1 -- 172.21.15.84:0/3904297813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f6860 msgr2=0x7f70c00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.095+0000 7f70c4a17700 1 --2- 172.21.15.84:0/3904297813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f6860 0x7f70c00f6cc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f70b4004660 tx=0x7f70b4009b30).stop 2024-02-15T18:28:46.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.095+0000 7f70c4a17700 1 -- 172.21.15.84:0/3904297813 shutdown_connections 2024-02-15T18:28:46.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.095+0000 7f70c4a17700 1 --2- 172.21.15.84:0/3904297813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f6860 0x7f70c00f6cc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.095+0000 7f70c4a17700 1 --2- 172.21.15.84:0/3904297813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70c00f55c0 0x7f70c00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.095+0000 7f70c4a17700 1 -- 172.21.15.84:0/3904297813 >> 172.21.15.84:0/3904297813 conn(0x7f70c00f0d40 msgr2=0x7f70c00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:46.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.095+0000 7f70c4a17700 1 -- 172.21.15.84:0/3904297813 shutdown_connections 2024-02-15T18:28:46.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.095+0000 7f70c4a17700 1 -- 172.21.15.84:0/3904297813 wait complete. 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.095+0000 7f70c4a17700 1 Processor -- start 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70c4a17700 1 -- start start 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70c4a17700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f55c0 0x7f70c0109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70c4a17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70c00f6860 0x7f70c010c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70c4a17700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c00603c0 con 0x7f70c00f55c0 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70c4a17700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c0060500 con 0x7f70c00f6860 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f55c0 0x7f70c0109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f55c0 0x7f70c0109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55114/0 (socket says 172.21.15.84:55114) 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70be59c700 1 -- 172.21.15.84:0/1343401447 learned_addr learned my addr 172.21.15.84:0/1343401447 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70bdd9b700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70c00f6860 0x7f70c010c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70be59c700 1 -- 172.21.15.84:0/1343401447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70c00f6860 msgr2=0x7f70c010c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70be59c700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70c00f6860 0x7f70c010c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70be59c700 1 -- 172.21.15.84:0/1343401447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4005040 con 0x7f70c00f55c0 2024-02-15T18:28:46.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70be59c700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f55c0 0x7f70c0109cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f70b000e7c0 tx=0x7f70b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:46.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70aeffd700 1 -- 172.21.15.84:0/1343401447 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b00092e0 con 0x7f70c00f55c0 2024-02-15T18:28:46.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70aeffd700 1 -- 172.21.15.84:0/1343401447 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f70b000f040 con 0x7f70c00f55c0 2024-02-15T18:28:46.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.096+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c010c780 con 0x7f70c00f55c0 2024-02-15T18:28:46.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.097+0000 7f70aeffd700 1 -- 172.21.15.84:0/1343401447 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b0014920 con 0x7f70c00f55c0 2024-02-15T18:28:46.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.097+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c010cd10 con 0x7f70c00f55c0 2024-02-15T18:28:46.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.098+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c00f49b0 con 0x7f70c00f55c0 2024-02-15T18:28:46.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.098+0000 7f70aeffd700 1 -- 172.21.15.84:0/1343401447 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f70b001b030 con 0x7f70c00f55c0 2024-02-15T18:28:46.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.098+0000 7f70aeffd700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f70a8060f20 0x7f70a80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:46.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.098+0000 7f70aeffd700 1 -- 172.21.15.84:0/1343401447 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f70b007c020 con 0x7f70c00f55c0 2024-02-15T18:28:46.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.098+0000 7f70bdd9b700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f70a8060f20 0x7f70a80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:46.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.099+0000 7f70bdd9b700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f70a8060f20 0x7f70a80633e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f70b4004630 tx=0x7f70b4016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:46.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.103+0000 7f70aeffd700 1 -- 172.21.15.84:0/1343401447 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f70b004c4a0 con 0x7f70c00f55c0 2024-02-15T18:28:46.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.291+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70c00fe020 con 0x7f70a8060f20 2024-02-15T18:28:46.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.293+0000 7f70aeffd700 1 -- 172.21.15.84:0/1343401447 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f70c00fe020 con 0x7f70a8060f20 2024-02-15T18:28:46.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f70a8060f20 msgr2=0x7f70a80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f70a8060f20 0x7f70a80633e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f70b4004630 tx=0x7f70b4016040).stop 2024-02-15T18:28:46.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f55c0 msgr2=0x7f70c0109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f55c0 0x7f70c0109cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f70b000e7c0 tx=0x7f70b000b040).stop 2024-02-15T18:28:46.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 shutdown_connections 2024-02-15T18:28:46.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f70a8060f20 0x7f70a80633e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70c00f55c0 0x7f70c0109cd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 --2- 172.21.15.84:0/1343401447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70c00f6860 0x7f70c010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 >> 172.21.15.84:0/1343401447 conn(0x7f70c00f0d40 msgr2=0x7f70c00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:46.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 shutdown_connections 2024-02-15T18:28:46.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.295+0000 7f70c4a17700 1 -- 172.21.15.84:0/1343401447 wait complete. 2024-02-15T18:28:46.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.400+0000 7f8409cbc700 1 -- 172.21.15.84:0/1962298393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f6860 msgr2=0x7f84040f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.401+0000 7f8409cbc700 1 --2- 172.21.15.84:0/1962298393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f6860 0x7f84040f6cc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f83f8004660 tx=0x7f83f8009b30).stop 2024-02-15T18:28:46.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.401+0000 7f8409cbc700 1 -- 172.21.15.84:0/1962298393 shutdown_connections 2024-02-15T18:28:46.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.401+0000 7f8409cbc700 1 --2- 172.21.15.84:0/1962298393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f6860 0x7f84040f6cc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.401+0000 7f8409cbc700 1 --2- 172.21.15.84:0/1962298393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84040f55c0 0x7f84040f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.401+0000 7f8409cbc700 1 -- 172.21.15.84:0/1962298393 >> 172.21.15.84:0/1962298393 conn(0x7f84040f0d40 msgr2=0x7f84040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:46.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.401+0000 7f8409cbc700 1 -- 172.21.15.84:0/1962298393 shutdown_connections 2024-02-15T18:28:46.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.401+0000 7f8409cbc700 1 -- 172.21.15.84:0/1962298393 wait complete. 2024-02-15T18:28:46.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.401+0000 7f8409cbc700 1 Processor -- start 2024-02-15T18:28:46.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.401+0000 7f8409cbc700 1 -- start start 2024-02-15T18:28:46.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f8409cbc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f55c0 0x7f84040f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:46.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f8409cbc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84040f6860 0x7f84040f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:46.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f8409cbc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040f8100 con 0x7f84040f55c0 2024-02-15T18:28:46.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f8409cbc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040f8240 con 0x7f84040f6860 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f84037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f55c0 0x7f84040f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f84037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f55c0 0x7f84040f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55124/0 (socket says 172.21.15.84:55124) 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f84037fe700 1 -- 172.21.15.84:0/469751247 learned_addr learned my addr 172.21.15.84:0/469751247 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f8402ffd700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84040f6860 0x7f84040f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f84037fe700 1 -- 172.21.15.84:0/469751247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84040f6860 msgr2=0x7f84040f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f84037fe700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84040f6860 0x7f84040f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f84037fe700 1 -- 172.21.15.84:0/469751247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8005040 con 0x7f84040f55c0 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f84037fe700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f55c0 0x7f84040f9720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f83f400e7c0 tx=0x7f83f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f83ebfff700 1 -- 172.21.15.84:0/469751247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f40092e0 con 0x7f84040f55c0 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84040f8520 con 0x7f84040f55c0 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f83ebfff700 1 -- 172.21.15.84:0/469751247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f83f400f040 con 0x7f84040f55c0 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f83ebfff700 1 -- 172.21.15.84:0/469751247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f4014920 con 0x7f84040f55c0 2024-02-15T18:28:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.402+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840410eff0 con 0x7f84040f55c0 2024-02-15T18:28:46.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.403+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8404045ad0 con 0x7f84040f55c0 2024-02-15T18:28:46.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.405+0000 7f83ebfff700 1 -- 172.21.15.84:0/469751247 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f83f401b030 con 0x7f84040f55c0 2024-02-15T18:28:46.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.405+0000 7f83ebfff700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f83ec060f20 0x7f83ec0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:46.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.405+0000 7f83ebfff700 1 -- 172.21.15.84:0/469751247 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f83f407c580 con 0x7f84040f55c0 2024-02-15T18:28:46.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.405+0000 7f8402ffd700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f83ec060f20 0x7f83ec0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:46.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.405+0000 7f8402ffd700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f83ec060f20 0x7f83ec0633e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f83f8009720 tx=0x7f83f8016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:46.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.409+0000 7f83ebfff700 1 -- 172.21.15.84:0/469751247 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f83f404ca00 con 0x7f84040f55c0 2024-02-15T18:28:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.634+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f84040faca0 con 0x7f83ec060f20 2024-02-15T18:28:46.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.643+0000 7f83ebfff700 1 -- 172.21.15.84:0/469751247 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f84040faca0 con 0x7f83ec060f20 2024-02-15T18:28:46.639 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (8m) 21s ago 9m 18.0M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (35s) 21s ago 9m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (29s) 22s ago 8m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (7m) 21s ago 9m 36.2M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (4m) 21s ago 4m 135M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (4m) 21s ago 4m 13.7M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (4m) 22s ago 4m 137M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (4m) 22s ago 4m 14.3M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (2m) 21s ago 11m 428M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (93s) 22s ago 8m 388M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:28:46.640 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (77s) 21s ago 11m 42.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (49s) 22s ago 8m 24.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (9m) 21s ago 9m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (8m) 22s ago 8m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 starting - - - 4096M 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (7m) 21s ago 7m 407M 4096M 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (7m) 21s ago 7m 371M 4096M 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (6m) 22s ago 6m 442M 4096M 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (6m) 22s ago 6m 440M 4096M 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (6m) 22s ago 6m 391M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:28:46.641 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (2m) 21s ago 9m 63.7M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:28:46.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f83ec060f20 msgr2=0x7f83ec0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f83ec060f20 0x7f83ec0633e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f83f8009720 tx=0x7f83f8016040).stop 2024-02-15T18:28:46.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f55c0 msgr2=0x7f84040f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f55c0 0x7f84040f9720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f83f400e7c0 tx=0x7f83f400b040).stop 2024-02-15T18:28:46.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 shutdown_connections 2024-02-15T18:28:46.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f83ec060f20 0x7f83ec0633e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84040f55c0 0x7f84040f9720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 --2- 172.21.15.84:0/469751247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84040f6860 0x7f84040f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 >> 172.21.15.84:0/469751247 conn(0x7f84040f0d40 msgr2=0x7f840405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:46.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 shutdown_connections 2024-02-15T18:28:46.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.645+0000 7f8409cbc700 1 -- 172.21.15.84:0/469751247 wait complete. 2024-02-15T18:28:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.745+0000 7fb1aed31700 1 -- 172.21.15.84:0/1856302949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 msgr2=0x7fb1a80f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.745+0000 7fb1aed31700 1 --2- 172.21.15.84:0/1856302949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 0x7fb1a80f9360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb19c004660 tx=0x7fb19c009b30).stop 2024-02-15T18:28:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.745+0000 7fb1aed31700 1 -- 172.21.15.84:0/1856302949 shutdown_connections 2024-02-15T18:28:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.745+0000 7fb1aed31700 1 --2- 172.21.15.84:0/1856302949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1a80f9850 0x7fb1a80fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.745+0000 7fb1aed31700 1 --2- 172.21.15.84:0/1856302949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 0x7fb1a80f9360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.745+0000 7fb1aed31700 1 -- 172.21.15.84:0/1856302949 >> 172.21.15.84:0/1856302949 conn(0x7fb1a80f0d40 msgr2=0x7fb1a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.745+0000 7fb1aed31700 1 -- 172.21.15.84:0/1856302949 shutdown_connections 2024-02-15T18:28:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.745+0000 7fb1aed31700 1 -- 172.21.15.84:0/1856302949 wait complete. 2024-02-15T18:28:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1aed31700 1 Processor -- start 2024-02-15T18:28:46.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1aed31700 1 -- start start 2024-02-15T18:28:46.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1aed31700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 0x7fb1a8106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1aed31700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1a80f9850 0x7fb1a81074d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1aed31700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a8107a80 con 0x7fb1a8060250 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1aed31700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a8107bc0 con 0x7fb1a80f9850 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1acacd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 0x7fb1a8106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1acacd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 0x7fb1a8106fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55134/0 (socket says 172.21.15.84:55134) 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1acacd700 1 -- 172.21.15.84:0/2919557047 learned_addr learned my addr 172.21.15.84:0/2919557047 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.746+0000 7fb1a7fff700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1a80f9850 0x7fb1a81074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.747+0000 7fb1acacd700 1 -- 172.21.15.84:0/2919557047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1a80f9850 msgr2=0x7fb1a81074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.747+0000 7fb1acacd700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1a80f9850 0x7fb1a81074d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.747+0000 7fb1acacd700 1 -- 172.21.15.84:0/2919557047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c005040 con 0x7fb1a8060250 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.747+0000 7fb1acacd700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 0x7fb1a8106fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb19c0043a0 tx=0x7fb19c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:46.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.747+0000 7fb1a57fa700 1 -- 172.21.15.84:0/2919557047 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb19c019070 con 0x7fb1a8060250 2024-02-15T18:28:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.747+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a8108500 con 0x7fb1a8060250 2024-02-15T18:28:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.747+0000 7fb1a57fa700 1 -- 172.21.15.84:0/2919557047 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fb19c014420 con 0x7fb1a8060250 2024-02-15T18:28:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.747+0000 7fb1a57fa700 1 -- 172.21.15.84:0/2919557047 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb19c01d600 con 0x7fb1a8060250 2024-02-15T18:28:46.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.747+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a8108a60 con 0x7fb1a8060250 2024-02-15T18:28:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.749+0000 7fb1a57fa700 1 -- 172.21.15.84:0/2919557047 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fb19c025070 con 0x7fb1a8060250 2024-02-15T18:28:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.749+0000 7fb1a57fa700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb198060f20 0x7fb1980633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.749+0000 7fb1a57fa700 1 -- 172.21.15.84:0/2919557047 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb19c07cfa0 con 0x7fb1a8060250 2024-02-15T18:28:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.749+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a8045ad0 con 0x7fb1a8060250 2024-02-15T18:28:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.749+0000 7fb1a7fff700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb198060f20 0x7fb1980633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:46.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.750+0000 7fb1a7fff700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb198060f20 0x7fb1980633e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb194009fd0 tx=0x7fb19400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:46.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:46.754+0000 7fb1a57fa700 1 -- 172.21.15.84:0/2919557047 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb19c023070 con 0x7fb1a8060250 2024-02-15T18:28:46.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:44.707830+0000 mgr.smithi084.hjmnez (mgr.14596) 101 : cluster [DBG] pgmap v70: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 115 KiB/s wr, 41 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:46.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:44.707830+0000 mgr.smithi084.hjmnez (mgr.14596) 101 : cluster [DBG] pgmap v70: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 115 KiB/s wr, 41 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.005+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb1a80ff010 con 0x7fb1a8060250 2024-02-15T18:28:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.006+0000 7fb1a57fa700 1 -- 172.21.15.84:0/2919557047 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+711 (secure 0 0 0) 0x7fb19c04be60 con 0x7fb1a8060250 2024-02-15T18:28:47.002 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:28:47.002 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:28:47.002 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:28:47.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:28:47.002 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:28:47.002 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4, 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:28:47.003 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:28:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb198060f20 msgr2=0x7fb1980633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb198060f20 0x7fb1980633e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb194009fd0 tx=0x7fb19400b040).stop 2024-02-15T18:28:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 msgr2=0x7fb1a8106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 0x7fb1a8106fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb19c0043a0 tx=0x7fb19c00b040).stop 2024-02-15T18:28:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 shutdown_connections 2024-02-15T18:28:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb198060f20 0x7fb1980633e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a8060250 0x7fb1a8106fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 --2- 172.21.15.84:0/2919557047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1a80f9850 0x7fb1a81074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 >> 172.21.15.84:0/2919557047 conn(0x7fb1a80f0d40 msgr2=0x7fb1a80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 shutdown_connections 2024-02-15T18:28:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.008+0000 7fb1aed31700 1 -- 172.21.15.84:0/2919557047 wait complete. 2024-02-15T18:28:47.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.111+0000 7f65e759e700 1 -- 172.21.15.84:0/4119505526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e8060290 msgr2=0x7f65e80fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.111+0000 7f65e759e700 1 --2- 172.21.15.84:0/4119505526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e8060290 0x7f65e80fb590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f65d8004690 tx=0x7f65d8009b30).stop 2024-02-15T18:28:47.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.112+0000 7f65e759e700 1 -- 172.21.15.84:0/4119505526 shutdown_connections 2024-02-15T18:28:47.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.112+0000 7f65e759e700 1 --2- 172.21.15.84:0/4119505526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65e80fba80 0x7f65e80fde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.112+0000 7f65e759e700 1 --2- 172.21.15.84:0/4119505526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e8060290 0x7f65e80fb590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.112+0000 7f65e759e700 1 -- 172.21.15.84:0/4119505526 >> 172.21.15.84:0/4119505526 conn(0x7f65e80f0b90 msgr2=0x7f65e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:47.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.112+0000 7f65e759e700 1 -- 172.21.15.84:0/4119505526 shutdown_connections 2024-02-15T18:28:47.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.112+0000 7f65e759e700 1 -- 172.21.15.84:0/4119505526 wait complete. 2024-02-15T18:28:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.112+0000 7f65e759e700 1 Processor -- start 2024-02-15T18:28:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.112+0000 7f65e759e700 1 -- start start 2024-02-15T18:28:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65e8060290 0x7f65e8108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e80fba80 0x7f65e81094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:47.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8109a60 con 0x7f65e80fba80 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8109ba0 con 0x7f65e8060290 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e80fba80 0x7f65e81094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e80fba80 0x7f65e81094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55142/0 (socket says 172.21.15.84:55142) 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e5d9b700 1 -- 172.21.15.84:0/3998215954 learned_addr learned my addr 172.21.15.84:0/3998215954 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e659c700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65e8060290 0x7f65e8108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e5d9b700 1 -- 172.21.15.84:0/3998215954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65e8060290 msgr2=0x7f65e8108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e5d9b700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65e8060290 0x7f65e8108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e5d9b700 1 -- 172.21.15.84:0/3998215954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d8005040 con 0x7f65e80fba80 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e5d9b700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e80fba80 0x7f65e81094b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f65dc002700 tx=0x7f65dc009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65d6ffd700 1 -- 172.21.15.84:0/3998215954 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65dc0079c0 con 0x7f65e80fba80 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e810a540 con 0x7f65e80fba80 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65d6ffd700 1 -- 172.21.15.84:0/3998215954 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f65dc00f040 con 0x7f65e80fba80 2024-02-15T18:28:47.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.113+0000 7f65d6ffd700 1 -- 172.21.15.84:0/3998215954 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65dc0148c0 con 0x7f65e80fba80 2024-02-15T18:28:47.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.114+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e810aa80 con 0x7f65e80fba80 2024-02-15T18:28:47.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.114+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e8045ad0 con 0x7f65e80fba80 2024-02-15T18:28:47.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.115+0000 7f65d6ffd700 1 -- 172.21.15.84:0/3998215954 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f65dc01b060 con 0x7f65e80fba80 2024-02-15T18:28:47.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.115+0000 7f65d6ffd700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f65d0060f70 0x7f65d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:47.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.116+0000 7f65d6ffd700 1 -- 172.21.15.84:0/3998215954 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f65dc07bfe0 con 0x7f65e80fba80 2024-02-15T18:28:47.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.116+0000 7f65e659c700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f65d0060f70 0x7f65d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:47.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.116+0000 7f65e659c700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f65d0060f70 0x7f65d0063430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f65d8005010 tx=0x7f65d8009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:47.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.119+0000 7f65d6ffd700 1 -- 172.21.15.84:0/3998215954 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f65dc04fdf0 con 0x7f65e80fba80 2024-02-15T18:28:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.354+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f65e8027a00 con 0x7f65e80fba80 2024-02-15T18:28:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.354+0000 7f65d6ffd700 1 -- 172.21.15.84:0/3998215954 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f65dc04f9e0 con 0x7f65e80fba80 2024-02-15T18:28:47.350 INFO:teuthology.orchestra.run.smithi084.stdout:e16 2024-02-15T18:28:47.350 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 16 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:28:06.036365+0000 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:28:47.351 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:28:47.352 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:28:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.356+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f65d0060f70 msgr2=0x7f65d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.356+0000 7f65e759e700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f65d0060f70 0x7f65d0063430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f65d8005010 tx=0x7f65d8009b30).stop 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.356+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e80fba80 msgr2=0x7f65e81094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.356+0000 7f65e759e700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e80fba80 0x7f65e81094b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f65dc002700 tx=0x7f65dc009d60).stop 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.356+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 shutdown_connections 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.356+0000 7f65e759e700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f65d0060f70 0x7f65d0063430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.356+0000 7f65e759e700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65e8060290 0x7f65e8108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.356+0000 7f65e759e700 1 --2- 172.21.15.84:0/3998215954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65e80fba80 0x7f65e81094b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.356+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 >> 172.21.15.84:0/3998215954 conn(0x7f65e80f0b90 msgr2=0x7f65e80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.357+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 shutdown_connections 2024-02-15T18:28:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.357+0000 7f65e759e700 1 -- 172.21.15.84:0/3998215954 wait complete. 2024-02-15T18:28:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2024-02-15T18:28:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.470+0000 7fdf88ada700 1 -- 172.21.15.84:0/4092494742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406a3b0 msgr2=0x7fdf8406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.470+0000 7fdf88ada700 1 --2- 172.21.15.84:0/4092494742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406a3b0 0x7fdf8406a830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fdf780045a0 tx=0x7fdf78009b30).stop 2024-02-15T18:28:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.470+0000 7fdf88ada700 1 -- 172.21.15.84:0/4092494742 shutdown_connections 2024-02-15T18:28:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.470+0000 7fdf88ada700 1 --2- 172.21.15.84:0/4092494742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406a3b0 0x7fdf8406a830 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.470+0000 7fdf88ada700 1 --2- 172.21.15.84:0/4092494742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf8406b9c0 0x7fdf84069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.470+0000 7fdf88ada700 1 -- 172.21.15.84:0/4092494742 >> 172.21.15.84:0/4092494742 conn(0x7fdf840f1c90 msgr2=0x7fdf840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.470+0000 7fdf88ada700 1 -- 172.21.15.84:0/4092494742 shutdown_connections 2024-02-15T18:28:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.471+0000 7fdf88ada700 1 -- 172.21.15.84:0/4092494742 wait complete. 2024-02-15T18:28:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.471+0000 7fdf88ada700 1 Processor -- start 2024-02-15T18:28:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.471+0000 7fdf88ada700 1 -- start start 2024-02-15T18:28:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf88ada700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf8406a3b0 0x7fdf8410d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf88ada700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406b9c0 0x7fdf8410d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf88ada700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8410de70 con 0x7fdf8406b9c0 2024-02-15T18:28:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf88ada700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8410dfb0 con 0x7fdf8406a3b0 2024-02-15T18:28:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf82ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406b9c0 0x7fdf8410d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf82ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406b9c0 0x7fdf8410d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55158/0 (socket says 172.21.15.84:55158) 2024-02-15T18:28:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf82ffd700 1 -- 172.21.15.84:0/2240094995 learned_addr learned my addr 172.21.15.84:0/2240094995 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:28:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf837fe700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf8406a3b0 0x7fdf8410d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf82ffd700 1 -- 172.21.15.84:0/2240094995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf8406a3b0 msgr2=0x7fdf8410d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf82ffd700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf8406a3b0 0x7fdf8410d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf82ffd700 1 -- 172.21.15.84:0/2240094995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78005040 con 0x7fdf8406b9c0 2024-02-15T18:28:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.472+0000 7fdf82ffd700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406b9c0 0x7fdf8410d8c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fdf78009d30 tx=0x7fdf7800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.473+0000 7fdf6bfff700 1 -- 172.21.15.84:0/2240094995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf7800e070 con 0x7fdf8406b9c0 2024-02-15T18:28:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.473+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8410e8f0 con 0x7fdf8406b9c0 2024-02-15T18:28:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.473+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8410edd0 con 0x7fdf8406b9c0 2024-02-15T18:28:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.473+0000 7fdf6bfff700 1 -- 172.21.15.84:0/2240094995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fdf78007e80 con 0x7fdf8406b9c0 2024-02-15T18:28:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.473+0000 7fdf6bfff700 1 -- 172.21.15.84:0/2240094995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf78019070 con 0x7fdf8406b9c0 2024-02-15T18:28:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.474+0000 7fdf6bfff700 1 -- 172.21.15.84:0/2240094995 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fdf78025070 con 0x7fdf8406b9c0 2024-02-15T18:28:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.474+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf64004fa0 con 0x7fdf8406b9c0 2024-02-15T18:28:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.474+0000 7fdf6bfff700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdf6c060f70 0x7fdf6c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.475+0000 7fdf6bfff700 1 -- 172.21.15.84:0/2240094995 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdf7807de00 con 0x7fdf8406b9c0 2024-02-15T18:28:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.475+0000 7fdf837fe700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdf6c060f70 0x7fdf6c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.475+0000 7fdf837fe700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdf6c060f70 0x7fdf6c063430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdf74009880 tx=0x7fdf7400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.480+0000 7fdf6bfff700 1 -- 172.21.15.84:0/2240094995 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fdf78051d30 con 0x7fdf8406b9c0 2024-02-15T18:28:47.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.670+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf64002a40 con 0x7fdf6c060f70 2024-02-15T18:28:47.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.671+0000 7fdf6bfff700 1 -- 172.21.15.84:0/2240094995 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdf64002a40 con 0x7fdf6c060f70 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "6/21 daemons upgraded", 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:28:47.667 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:28:47.668 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:28:47.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdf6c060f70 msgr2=0x7fdf6c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdf6c060f70 0x7fdf6c063430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdf74009880 tx=0x7fdf7400b040).stop 2024-02-15T18:28:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406b9c0 msgr2=0x7fdf8410d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406b9c0 0x7fdf8410d8c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fdf78009d30 tx=0x7fdf7800b040).stop 2024-02-15T18:28:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 shutdown_connections 2024-02-15T18:28:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fdf6c060f70 0x7fdf6c063430 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf8406a3b0 0x7fdf8410d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 --2- 172.21.15.84:0/2240094995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf8406b9c0 0x7fdf8410d8c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:47.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 >> 172.21.15.84:0/2240094995 conn(0x7fdf840f1c90 msgr2=0x7fdf840f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:47.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 shutdown_connections 2024-02-15T18:28:47.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:28:47.673+0000 7fdf88ada700 1 -- 172.21.15.84:0/2240094995 wait complete. 2024-02-15T18:28:47.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:45.986360+0000 mgr.smithi084.hjmnez (mgr.14596) 102 : audit [DBG] from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:47.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:46.294351+0000 mgr.smithi084.hjmnez (mgr.14596) 103 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:47.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:46.637040+0000 mgr.smithi084.hjmnez (mgr.14596) 104 : audit [DBG] from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:47.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:47.008014+0000 mon.smithi084 (mon.0) 102 : audit [DBG] from='client.? 172.21.15.84:0/2919557047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:47.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:47.356489+0000 mon.smithi084 (mon.0) 103 : audit [DBG] from='client.? 172.21.15.84:0/3998215954' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:28:47.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:45.986360+0000 mgr.smithi084.hjmnez (mgr.14596) 102 : audit [DBG] from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:47.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:46.294351+0000 mgr.smithi084.hjmnez (mgr.14596) 103 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:47.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:46.637040+0000 mgr.smithi084.hjmnez (mgr.14596) 104 : audit [DBG] from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:47.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:47.008014+0000 mon.smithi084 (mon.0) 102 : audit [DBG] from='client.? 172.21.15.84:0/2919557047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:47.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:47.356489+0000 mon.smithi084 (mon.0) 103 : audit [DBG] from='client.? 172.21.15.84:0/3998215954' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:28:48.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:46.708226+0000 mgr.smithi084.hjmnez (mgr.14596) 105 : cluster [DBG] pgmap v71: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:48.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:47.672534+0000 mgr.smithi084.hjmnez (mgr.14596) 106 : audit [DBG] from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:48.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:46.708226+0000 mgr.smithi084.hjmnez (mgr.14596) 105 : cluster [DBG] pgmap v71: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:48.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:47.672534+0000 mgr.smithi084.hjmnez (mgr.14596) 106 : audit [DBG] from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:49.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.524611+0000 mon.smithi084 (mon.0) 104 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:49.904 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.525487+0000 mon.smithi084 (mon.0) 105 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:49.904 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.526119+0000 mon.smithi084 (mon.0) 106 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:28:49.904 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:48.526649+0000 mgr.smithi084.hjmnez (mgr.14596) 107 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:28:49.904 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.530634+0000 mon.smithi084 (mon.0) 107 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:49.904 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.535835+0000 mon.smithi084 (mon.0) 108 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:49.904 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.538081+0000 mon.smithi084 (mon.0) 109 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:49.905 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.539276+0000 mon.smithi084 (mon.0) 110 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:49.905 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.540499+0000 mon.smithi084 (mon.0) 111 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:49.905 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.541610+0000 mon.smithi084 (mon.0) 112 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:28:49.905 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:48.541751+0000 mgr.smithi084.hjmnez (mgr.14596) 108 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:28:49.905 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:28:48.542344+0000 mgr.smithi084.hjmnez (mgr.14596) 109 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-15T18:28:50.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.524611+0000 mon.smithi084 (mon.0) 104 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:50.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.525487+0000 mon.smithi084 (mon.0) 105 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.526119+0000 mon.smithi084 (mon.0) 106 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:48.526649+0000 mgr.smithi084.hjmnez (mgr.14596) 107 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.530634+0000 mon.smithi084 (mon.0) 107 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.535835+0000 mon.smithi084 (mon.0) 108 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.538081+0000 mon.smithi084 (mon.0) 109 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.539276+0000 mon.smithi084 (mon.0) 110 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.540499+0000 mon.smithi084 (mon.0) 111 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.541610+0000 mon.smithi084 (mon.0) 112 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:48.541751+0000 mgr.smithi084.hjmnez (mgr.14596) 108 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:28:50.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:28:48.542344+0000 mgr.smithi084.hjmnez (mgr.14596) 109 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-15T18:28:50.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:48.708716+0000 mgr.smithi084.hjmnez (mgr.14596) 110 : cluster [DBG] pgmap v72: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:51.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:48.708716+0000 mgr.smithi084.hjmnez (mgr.14596) 110 : cluster [DBG] pgmap v72: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 767 B/s wr, 0 op/s; 67/345 objects degraded (19.420%) 2024-02-15T18:28:51.009 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-0[80703]: debug 2024-02-15T18:28:50.569+0000 7fc85d5a6380 -1 osd.0 48 log_to_monitors {default=true} 2024-02-15T18:28:51.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:50.574023+0000 mon.smithi084 (mon.0) 113 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/4044199563,v1:172.21.15.84:6803/4044199563]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T18:28:52.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:50.574023+0000 mon.smithi084 (mon.0) 113 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/4044199563,v1:172.21.15.84:6803/4044199563]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T18:28:52.009 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:28:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-0[80703]: debug 2024-02-15T18:28:51.545+0000 7fc84da8b700 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:28:52.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:50.709139+0000 mgr.smithi084.hjmnez (mgr.14596) 111 : cluster [DBG] pgmap v73: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 67/345 objects degraded (19.420%) 2024-02-15T18:28:52.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:51.540772+0000 mon.smithi084 (mon.0) 114 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/4044199563,v1:172.21.15.84:6803/4044199563]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T18:28:52.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:51.540824+0000 mon.smithi084 (mon.0) 115 : cluster [DBG] osdmap e51: 6 total, 5 up, 6 in 2024-02-15T18:28:52.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:51.541403+0000 mon.smithi084 (mon.0) 116 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/4044199563,v1:172.21.15.84:6803/4044199563]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:28:53.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:50.709139+0000 mgr.smithi084.hjmnez (mgr.14596) 111 : cluster [DBG] pgmap v73: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 294 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 67/345 objects degraded (19.420%) 2024-02-15T18:28:53.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:51.540772+0000 mon.smithi084 (mon.0) 114 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/4044199563,v1:172.21.15.84:6803/4044199563]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T18:28:53.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:51.540824+0000 mon.smithi084 (mon.0) 115 : cluster [DBG] osdmap e51: 6 total, 5 up, 6 in 2024-02-15T18:28:53.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:51.541403+0000 mon.smithi084 (mon.0) 116 : audit [INF] from='osd.0 [v2:172.21.15.84:6802/4044199563,v1:172.21.15.84:6803/4044199563]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:28:53.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:52.539130+0000 mon.smithi084 (mon.0) 117 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:28:53.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:52.543410+0000 mon.smithi084 (mon.0) 118 : cluster [INF] osd.0 [v2:172.21.15.84:6802/4044199563,v1:172.21.15.84:6803/4044199563] boot 2024-02-15T18:28:53.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:52.543479+0000 mon.smithi084 (mon.0) 119 : cluster [DBG] osdmap e52: 6 total, 6 up, 6 in 2024-02-15T18:28:53.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:28:52.545237+0000 mon.smithi084 (mon.0) 120 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:28:53.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:53.545441+0000 mon.smithi084 (mon.0) 121 : cluster [DBG] osdmap e53: 6 total, 6 up, 6 in 2024-02-15T18:28:53.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:52.539130+0000 mon.smithi084 (mon.0) 117 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:28:53.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:52.543410+0000 mon.smithi084 (mon.0) 118 : cluster [INF] osd.0 [v2:172.21.15.84:6802/4044199563,v1:172.21.15.84:6803/4044199563] boot 2024-02-15T18:28:53.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:52.543479+0000 mon.smithi084 (mon.0) 119 : cluster [DBG] osdmap e52: 6 total, 6 up, 6 in 2024-02-15T18:28:53.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:28:52.545237+0000 mon.smithi084 (mon.0) 120 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:28:53.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:53.545441+0000 mon.smithi084 (mon.0) 121 : cluster [DBG] osdmap e53: 6 total, 6 up, 6 in 2024-02-15T18:28:54.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:52.709644+0000 mgr.smithi084.hjmnez (mgr.14596) 112 : cluster [DBG] pgmap v76: 65 pgs: 5 peering, 14 active+undersized+degraded, 15 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 52/345 objects degraded (15.072%) 2024-02-15T18:28:54.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:53.549932+0000 mon.smithi084 (mon.0) 122 : cluster [WRN] Health check update: Degraded data redundancy: 52/345 objects degraded (15.072%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T18:28:55.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:52.709644+0000 mgr.smithi084.hjmnez (mgr.14596) 112 : cluster [DBG] pgmap v76: 65 pgs: 5 peering, 14 active+undersized+degraded, 15 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 52/345 objects degraded (15.072%) 2024-02-15T18:28:55.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:53.549932+0000 mon.smithi084 (mon.0) 122 : cluster [WRN] Health check update: Degraded data redundancy: 52/345 objects degraded (15.072%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T18:28:56.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:54.710064+0000 mgr.smithi084.hjmnez (mgr.14596) 113 : cluster [DBG] pgmap v78: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 12/345 objects degraded (3.478%) 2024-02-15T18:28:57.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:54.710064+0000 mgr.smithi084.hjmnez (mgr.14596) 113 : cluster [DBG] pgmap v78: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 12/345 objects degraded (3.478%) 2024-02-15T18:28:57.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:57.567509+0000 mon.smithi084 (mon.0) 123 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/345 objects degraded (3.478%), 3 pgs degraded) 2024-02-15T18:28:57.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:57.567537+0000 mon.smithi084 (mon.0) 124 : cluster [INF] Cluster is now healthy 2024-02-15T18:28:58.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:57.567509+0000 mon.smithi084 (mon.0) 123 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/345 objects degraded (3.478%), 3 pgs degraded) 2024-02-15T18:28:58.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:57.567537+0000 mon.smithi084 (mon.0) 124 : cluster [INF] Cluster is now healthy 2024-02-15T18:28:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:28:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:56.710483+0000 mgr.smithi084.hjmnez (mgr.14596) 114 : cluster [DBG] pgmap v79: 65 pgs: 25 peering, 40 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 33 B/s, 0 objects/s recovering 2024-02-15T18:28:59.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:28:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:56.710483+0000 mgr.smithi084.hjmnez (mgr.14596) 114 : cluster [DBG] pgmap v79: 65 pgs: 25 peering, 40 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 33 B/s, 0 objects/s recovering 2024-02-15T18:29:00.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:28:58.711069+0000 mgr.smithi084.hjmnez (mgr.14596) 115 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 142 B/s wr, 0 op/s; 397 B/s, 0 objects/s recovering 2024-02-15T18:29:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:28:58.711069+0000 mgr.smithi084.hjmnez (mgr.14596) 115 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 142 B/s wr, 0 op/s; 397 B/s, 0 objects/s recovering 2024-02-15T18:29:02.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:00.711396+0000 mgr.smithi084.hjmnez (mgr.14596) 116 : cluster [DBG] pgmap v81: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 125 B/s wr, 0 op/s; 349 B/s, 0 objects/s recovering 2024-02-15T18:29:03.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:00.711396+0000 mgr.smithi084.hjmnez (mgr.14596) 116 : cluster [DBG] pgmap v81: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 125 B/s wr, 0 op/s; 349 B/s, 0 objects/s recovering 2024-02-15T18:29:03.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:03.557896+0000 mon.smithi084 (mon.0) 125 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:29:03.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:03.557896+0000 mon.smithi084 (mon.0) 125 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:29:04.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:02.711835+0000 mgr.smithi084.hjmnez (mgr.14596) 117 : cluster [DBG] pgmap v82: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 102 B/s wr, 0 op/s; 285 B/s, 0 objects/s recovering 2024-02-15T18:29:04.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:03.558119+0000 mgr.smithi084.hjmnez (mgr.14596) 118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:29:04.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:03.559228+0000 mgr.smithi084.hjmnez (mgr.14596) 119 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-15T18:29:05.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:02.711835+0000 mgr.smithi084.hjmnez (mgr.14596) 117 : cluster [DBG] pgmap v82: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 102 B/s wr, 0 op/s; 285 B/s, 0 objects/s recovering 2024-02-15T18:29:05.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:03.558119+0000 mgr.smithi084.hjmnez (mgr.14596) 118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:29:05.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:03.559228+0000 mgr.smithi084.hjmnez (mgr.14596) 119 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-15T18:29:06.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:04.712482+0000 mgr.smithi084.hjmnez (mgr.14596) 120 : cluster [DBG] pgmap v83: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 91 B/s wr, 0 op/s; 255 B/s, 0 objects/s recovering 2024-02-15T18:29:06.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:05.145062+0000 mgr.smithi084.hjmnez (mgr.14596) 121 : cephadm [INF] Upgrade: Updating osd.1 2024-02-15T18:29:06.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:05.149521+0000 mon.smithi084 (mon.0) 126 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:06.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:05.150327+0000 mon.smithi084 (mon.0) 127 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T18:29:06.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:05.150906+0000 mon.smithi084 (mon.0) 128 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:29:06.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:05.151918+0000 mgr.smithi084.hjmnez (mgr.14596) 122 : cephadm [INF] Deploying daemon osd.1 on smithi084 2024-02-15T18:29:06.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:04.712482+0000 mgr.smithi084.hjmnez (mgr.14596) 120 : cluster [DBG] pgmap v83: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 91 B/s wr, 0 op/s; 255 B/s, 0 objects/s recovering 2024-02-15T18:29:06.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:05.145062+0000 mgr.smithi084.hjmnez (mgr.14596) 121 : cephadm [INF] Upgrade: Updating osd.1 2024-02-15T18:29:06.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:05.149521+0000 mon.smithi084 (mon.0) 126 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:06.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:05.150327+0000 mon.smithi084 (mon.0) 127 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T18:29:06.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:05.150906+0000 mon.smithi084 (mon.0) 128 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:29:06.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:05.151918+0000 mgr.smithi084.hjmnez (mgr.14596) 122 : cephadm [INF] Deploying daemon osd.1 on smithi084 2024-02-15T18:29:08.243 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:08 smithi084 systemd[1]: Stopping Ceph osd.1 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:29:08.243 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:06.712873+0000 mgr.smithi084.hjmnez (mgr.14596) 123 : cluster [DBG] pgmap v84: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s; 237 B/s, 0 objects/s recovering 2024-02-15T18:29:08.243 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:06.902538+0000 mon.smithi084 (mon.0) 129 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:08.243 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:06.956366+0000 mon.smithi084 (mon.0) 130 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:08.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:06.712873+0000 mgr.smithi084.hjmnez (mgr.14596) 123 : cluster [DBG] pgmap v84: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s; 237 B/s, 0 objects/s recovering 2024-02-15T18:29:08.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:06.902538+0000 mon.smithi084 (mon.0) 129 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:08.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:06.956366+0000 mon.smithi084 (mon.0) 130 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:08.509 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.1[52354]: debug 2024-02-15T18:29:08.245+0000 7f5d5908c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:29:08.509 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.1[52354]: debug 2024-02-15T18:29:08.245+0000 7f5d5908c700 -1 osd.1 53 *** Got signal Terminated *** 2024-02-15T18:29:08.509 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.1[52354]: debug 2024-02-15T18:29:08.245+0000 7f5d5908c700 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:29:09.258 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:08 smithi084 bash[82826]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.1 2024-02-15T18:29:09.258 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:09 smithi084 bash[82879]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.1 2024-02-15T18:29:09.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.498692+0000 mon.smithi084 (mon.0) 131 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:29:09.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.498727+0000 mon.smithi084 (mon.0) 132 : cluster [INF] osd.1 failed (root=default,host=smithi084) (connection refused reported by osd.4) 2024-02-15T18:29:09.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.498944+0000 mon.smithi084 (mon.0) 133 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:29:09.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.499022+0000 mon.smithi084 (mon.0) 134 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:29:09.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.499195+0000 mon.smithi084 (mon.0) 135 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:29:09.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.499317+0000 mon.smithi084 (mon.0) 136 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:29:09.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.499439+0000 mon.smithi084 (mon.0) 137 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:29:09.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.499563+0000 mon.smithi084 (mon.0) 138 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.499678+0000 mon.smithi084 (mon.0) 139 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.499805+0000 mon.smithi084 (mon.0) 140 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.499926+0000 mon.smithi084 (mon.0) 141 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.899806+0000 mon.smithi084 (mon.0) 142 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.899998+0000 mon.smithi084 (mon.0) 143 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.900174+0000 mon.smithi084 (mon.0) 144 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.900315+0000 mon.smithi084 (mon.0) 145 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.900411+0000 mon.smithi084 (mon.0) 146 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.900490+0000 mon.smithi084 (mon.0) 147 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.900569+0000 mon.smithi084 (mon.0) 148 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.900613+0000 mon.smithi084 (mon.0) 149 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.900724+0000 mon.smithi084 (mon.0) 150 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:29:09.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.900792+0000 mon.smithi084 (mon.0) 151 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:29:09.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.498692+0000 mon.smithi084 (mon.0) 131 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:29:09.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.498727+0000 mon.smithi084 (mon.0) 132 : cluster [INF] osd.1 failed (root=default,host=smithi084) (connection refused reported by osd.4) 2024-02-15T18:29:09.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.498944+0000 mon.smithi084 (mon.0) 133 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:29:09.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.499022+0000 mon.smithi084 (mon.0) 134 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:29:09.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.499195+0000 mon.smithi084 (mon.0) 135 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:29:09.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.499317+0000 mon.smithi084 (mon.0) 136 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.499439+0000 mon.smithi084 (mon.0) 137 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.499563+0000 mon.smithi084 (mon.0) 138 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.499678+0000 mon.smithi084 (mon.0) 139 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.499805+0000 mon.smithi084 (mon.0) 140 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.499926+0000 mon.smithi084 (mon.0) 141 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.899806+0000 mon.smithi084 (mon.0) 142 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.899998+0000 mon.smithi084 (mon.0) 143 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.900174+0000 mon.smithi084 (mon.0) 144 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.900315+0000 mon.smithi084 (mon.0) 145 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.900411+0000 mon.smithi084 (mon.0) 146 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.900490+0000 mon.smithi084 (mon.0) 147 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:29:09.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.900569+0000 mon.smithi084 (mon.0) 148 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:29:09.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.900613+0000 mon.smithi084 (mon.0) 149 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:29:09.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.900724+0000 mon.smithi084 (mon.0) 150 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:29:09.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.900792+0000 mon.smithi084 (mon.0) 151 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:29:10.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.713327+0000 mgr.smithi084.hjmnez (mgr.14596) 124 : cluster [DBG] pgmap v85: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s; 220 B/s, 0 objects/s recovering 2024-02-15T18:29:10.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.903329+0000 mon.smithi084 (mon.0) 152 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:29:10.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:08.911154+0000 mon.smithi084 (mon.0) 153 : cluster [DBG] osdmap e54: 6 total, 5 up, 6 in 2024-02-15T18:29:10.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.713327+0000 mgr.smithi084.hjmnez (mgr.14596) 124 : cluster [DBG] pgmap v85: 65 pgs: 65 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s; 220 B/s, 0 objects/s recovering 2024-02-15T18:29:10.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.903329+0000 mon.smithi084 (mon.0) 152 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:29:10.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:08.911154+0000 mon.smithi084 (mon.0) 153 : cluster [DBG] osdmap e54: 6 total, 5 up, 6 in 2024-02-15T18:29:11.230 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:09.914568+0000 mon.smithi084 (mon.0) 154 : cluster [DBG] osdmap e55: 6 total, 5 up, 6 in 2024-02-15T18:29:11.230 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:11 smithi084 systemd[1]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.1.service: Succeeded. 2024-02-15T18:29:11.231 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:11 smithi084 systemd[1]: Stopped Ceph osd.1 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:29:11.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:09.914568+0000 mon.smithi084 (mon.0) 154 : cluster [DBG] osdmap e55: 6 total, 5 up, 6 in 2024-02-15T18:29:11.508 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:11 smithi084 systemd[1]: Starting Ceph osd.1 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:29:12.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:10.713840+0000 mgr.smithi084.hjmnez (mgr.14596) 125 : cluster [DBG] pgmap v88: 65 pgs: 12 stale+active+clean, 53 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:12.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:10.713840+0000 mgr.smithi084.hjmnez (mgr.14596) 125 : cluster [DBG] pgmap v88: 65 pgs: 12 stale+active+clean, 53 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:13.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:13.053709+0000 mon.smithi084 (mon.0) 155 : cluster [WRN] Health check failed: Degraded data redundancy: 34/345 objects degraded (9.855%), 9 pgs degraded (PG_DEGRADED) 2024-02-15T18:29:13.505 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:13.053709+0000 mon.smithi084 (mon.0) 155 : cluster [WRN] Health check failed: Degraded data redundancy: 34/345 objects degraded (9.855%), 9 pgs degraded (PG_DEGRADED) 2024-02-15T18:29:13.505 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:13 smithi084 bash[83141]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:29:13.505 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:13 smithi084 bash[83141]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T18:29:13.505 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:13 smithi084 bash[83141]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-02-15T18:29:13.505 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:13 smithi084 bash[83141]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-15T18:29:13.505 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:13 smithi084 bash[83141]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-02-15T18:29:13.505 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:13 smithi084 bash[83141]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T18:29:13.505 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:13 smithi084 bash[83141]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T18:29:13.505 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:13 smithi084 bash[83141]: --> ceph-volume lvm activate successful for osd ID: 1 2024-02-15T18:29:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:12.714402+0000 mgr.smithi084.hjmnez (mgr.14596) 126 : cluster [DBG] pgmap v89: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 34/345 objects degraded (9.855%) 2024-02-15T18:29:14.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:12.714402+0000 mgr.smithi084.hjmnez (mgr.14596) 126 : cluster [DBG] pgmap v89: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 34/345 objects degraded (9.855%) 2024-02-15T18:29:16.388 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:14.714913+0000 mgr.smithi084.hjmnez (mgr.14596) 127 : cluster [DBG] pgmap v90: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:16.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:14.714913+0000 mgr.smithi084.hjmnez (mgr.14596) 127 : cluster [DBG] pgmap v90: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:17.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.791+0000 7fe9a5288700 1 -- 172.21.15.84:0/414297243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f66e0 msgr2=0x7fe9a00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.791+0000 7fe9a5288700 1 --2- 172.21.15.84:0/414297243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f66e0 0x7fe9a00f6b00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe994004660 tx=0x7fe994009b30).stop 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.791+0000 7fe9a5288700 1 -- 172.21.15.84:0/414297243 shutdown_connections 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.791+0000 7fe9a5288700 1 --2- 172.21.15.84:0/414297243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a00f7980 0x7fe9a00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.791+0000 7fe9a5288700 1 --2- 172.21.15.84:0/414297243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f66e0 0x7fe9a00f6b00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.791+0000 7fe9a5288700 1 -- 172.21.15.84:0/414297243 >> 172.21.15.84:0/414297243 conn(0x7fe9a00f1e40 msgr2=0x7fe9a00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.791+0000 7fe9a5288700 1 -- 172.21.15.84:0/414297243 shutdown_connections 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.791+0000 7fe9a5288700 1 -- 172.21.15.84:0/414297243 wait complete. 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.791+0000 7fe9a5288700 1 Processor -- start 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe9a5288700 1 -- start start 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe9a5288700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a00f66e0 0x7fe9a0107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe9a5288700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f7980 0x7fe9a0107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe9a5288700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0107ad0 con 0x7fe9a00f7980 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe9a5288700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0107c10 con 0x7fe9a00f66e0 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe99e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f7980 0x7fe9a0107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe99e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f7980 0x7fe9a0107520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57514/0 (socket says 172.21.15.84:57514) 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe99e7fc700 1 -- 172.21.15.84:0/910500294 learned_addr learned my addr 172.21.15.84:0/910500294 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe99effd700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a00f66e0 0x7fe9a0107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe99e7fc700 1 -- 172.21.15.84:0/910500294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a00f66e0 msgr2=0x7fe9a0107030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe99e7fc700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a00f66e0 0x7fe9a0107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe99e7fc700 1 -- 172.21.15.84:0/910500294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994005040 con 0x7fe9a00f7980 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe99e7fc700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f7980 0x7fe9a0107520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe9900026d0 tx=0x7fe990009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.792+0000 7fe9877fe700 1 -- 172.21.15.84:0/910500294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe990009320 con 0x7fe9a00f7980 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.793+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a01085b0 con 0x7fe9a00f7980 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.793+0000 7fe9877fe700 1 -- 172.21.15.84:0/910500294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fe99000f040 con 0x7fe9a00f7980 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.793+0000 7fe9877fe700 1 -- 172.21.15.84:0/910500294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9900149b0 con 0x7fe9a00f7980 2024-02-15T18:29:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.793+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a0108b70 con 0x7fe9a00f7980 2024-02-15T18:29:17.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.794+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a0045ad0 con 0x7fe9a00f7980 2024-02-15T18:29:17.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.794+0000 7fe9877fe700 1 -- 172.21.15.84:0/910500294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe990009480 con 0x7fe9a00f7980 2024-02-15T18:29:17.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.794+0000 7fe9877fe700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe988060f20 0x7fe9880633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:17.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.795+0000 7fe9877fe700 1 -- 172.21.15.84:0/910500294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe99007c6c0 con 0x7fe9a00f7980 2024-02-15T18:29:17.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.795+0000 7fe99effd700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe988060f20 0x7fe9880633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:17.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.795+0000 7fe99effd700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe988060f20 0x7fe9880633e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe994009d60 tx=0x7fe994009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:17.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.799+0000 7fe9877fe700 1 -- 172.21.15.84:0/910500294 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe990050340 con 0x7fe9a00f7980 2024-02-15T18:29:17.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.984+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9a00ff120 con 0x7fe988060f20 2024-02-15T18:29:17.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.986+0000 7fe9877fe700 1 -- 172.21.15.84:0/910500294 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe9a00ff120 con 0x7fe988060f20 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe988060f20 msgr2=0x7fe9880633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe988060f20 0x7fe9880633e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe994009d60 tx=0x7fe994009b30).stop 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f7980 msgr2=0x7fe9a0107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f7980 0x7fe9a0107520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe9900026d0 tx=0x7fe990009de0).stop 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 shutdown_connections 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe988060f20 0x7fe9880633e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a00f66e0 0x7fe9a0107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 --2- 172.21.15.84:0/910500294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9a00f7980 0x7fe9a0107520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 >> 172.21.15.84:0/910500294 conn(0x7fe9a00f1e40 msgr2=0x7fe9a00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.987+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 shutdown_connections 2024-02-15T18:29:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:17.988+0000 7fe9a5288700 1 -- 172.21.15.84:0/910500294 wait complete. 2024-02-15T18:29:17.992 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:29:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.089+0000 7f4a44246700 1 -- 172.21.15.84:0/2649273381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f55c0 msgr2=0x7f4a3c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.089+0000 7f4a44246700 1 --2- 172.21.15.84:0/2649273381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f55c0 0x7f4a3c0f59e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f4a2c004660 tx=0x7f4a2c009b30).stop 2024-02-15T18:29:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.089+0000 7f4a44246700 1 -- 172.21.15.84:0/2649273381 shutdown_connections 2024-02-15T18:29:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.089+0000 7f4a44246700 1 --2- 172.21.15.84:0/2649273381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a3c0f6860 0x7f4a3c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.089+0000 7f4a44246700 1 --2- 172.21.15.84:0/2649273381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f55c0 0x7f4a3c0f59e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.089+0000 7f4a44246700 1 -- 172.21.15.84:0/2649273381 >> 172.21.15.84:0/2649273381 conn(0x7f4a3c0f0d40 msgr2=0x7f4a3c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.089+0000 7f4a44246700 1 -- 172.21.15.84:0/2649273381 shutdown_connections 2024-02-15T18:29:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.089+0000 7f4a44246700 1 -- 172.21.15.84:0/2649273381 wait complete. 2024-02-15T18:29:18.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a44246700 1 Processor -- start 2024-02-15T18:29:18.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a44246700 1 -- start start 2024-02-15T18:29:18.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a44246700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a3c0f55c0 0x7f4a3c109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:18.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a44246700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f6860 0x7f4a3c10c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a44246700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0603e0 con 0x7f4a3c0f6860 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a44246700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c060520 con 0x7f4a3c0f55c0 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a417e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f6860 0x7f4a3c10c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a417e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f6860 0x7f4a3c10c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57532/0 (socket says 172.21.15.84:57532) 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a417e1700 1 -- 172.21.15.84:0/1321983603 learned_addr learned my addr 172.21.15.84:0/1321983603 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a41fe2700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a3c0f55c0 0x7f4a3c109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.090+0000 7f4a417e1700 1 -- 172.21.15.84:0/1321983603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a3c0f55c0 msgr2=0x7f4a3c109d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.091+0000 7f4a417e1700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a3c0f55c0 0x7f4a3c109d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.091+0000 7f4a417e1700 1 -- 172.21.15.84:0/1321983603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c005040 con 0x7f4a3c0f6860 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.091+0000 7f4a417e1700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f6860 0x7f4a3c10c200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4a380026d0 tx=0x7f4a38009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.091+0000 7f4a327fc700 1 -- 172.21.15.84:0/1321983603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a380079c0 con 0x7f4a3c0f6860 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.091+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c10c7b0 con 0x7f4a3c0f6860 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.091+0000 7f4a327fc700 1 -- 172.21.15.84:0/1321983603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f4a3800f040 con 0x7f4a3c0f6860 2024-02-15T18:29:18.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.091+0000 7f4a327fc700 1 -- 172.21.15.84:0/1321983603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a380149f0 con 0x7f4a3c0f6860 2024-02-15T18:29:18.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.091+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c10cd70 con 0x7f4a3c0f6860 2024-02-15T18:29:18.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.092+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3c045ad0 con 0x7f4a3c0f6860 2024-02-15T18:29:18.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.092+0000 7f4a327fc700 1 -- 172.21.15.84:0/1321983603 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f4a38007b20 con 0x7f4a3c0f6860 2024-02-15T18:29:18.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.092+0000 7f4a327fc700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a28060f20 0x7f4a280633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:18.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.092+0000 7f4a327fc700 1 -- 172.21.15.84:0/1321983603 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4a3807c0e0 con 0x7f4a3c0f6860 2024-02-15T18:29:18.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.093+0000 7f4a41fe2700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a28060f20 0x7f4a280633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:18.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.093+0000 7f4a41fe2700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a28060f20 0x7f4a280633e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4a3c060060 tx=0x7f4a2c009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:18.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.097+0000 7f4a327fc700 1 -- 172.21.15.84:0/1321983603 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4a3804c560 con 0x7f4a3c0f6860 2024-02-15T18:29:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.278+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a3c057f10 con 0x7f4a28060f20 2024-02-15T18:29:18.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.279+0000 7f4a327fc700 1 -- 172.21.15.84:0/1321983603 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4a3c057f10 con 0x7f4a28060f20 2024-02-15T18:29:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a28060f20 msgr2=0x7f4a280633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a28060f20 0x7f4a280633e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4a3c060060 tx=0x7f4a2c009b30).stop 2024-02-15T18:29:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f6860 msgr2=0x7f4a3c10c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f6860 0x7f4a3c10c200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4a380026d0 tx=0x7f4a38009de0).stop 2024-02-15T18:29:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 shutdown_connections 2024-02-15T18:29:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a28060f20 0x7f4a280633e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a3c0f55c0 0x7f4a3c109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 --2- 172.21.15.84:0/1321983603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a3c0f6860 0x7f4a3c10c200 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 >> 172.21.15.84:0/1321983603 conn(0x7f4a3c0f0d40 msgr2=0x7f4a3c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 shutdown_connections 2024-02-15T18:29:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.281+0000 7f4a44246700 1 -- 172.21.15.84:0/1321983603 wait complete. 2024-02-15T18:29:18.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.379+0000 7f7817fff700 1 -- 172.21.15.84:0/938127539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f77d0 msgr2=0x7f78180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.379+0000 7f7817fff700 1 --2- 172.21.15.84:0/938127539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f77d0 0x7f78180f7c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f7808004660 tx=0x7f7808009b30).stop 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.379+0000 7f7817fff700 1 -- 172.21.15.84:0/938127539 shutdown_connections 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.379+0000 7f7817fff700 1 --2- 172.21.15.84:0/938127539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f77d0 0x7f78180f7c30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.379+0000 7f7817fff700 1 --2- 172.21.15.84:0/938127539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78180f6530 0x7f78180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.379+0000 7f7817fff700 1 -- 172.21.15.84:0/938127539 >> 172.21.15.84:0/938127539 conn(0x7f78180f1c90 msgr2=0x7f78180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7817fff700 1 -- 172.21.15.84:0/938127539 shutdown_connections 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7817fff700 1 -- 172.21.15.84:0/938127539 wait complete. 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7817fff700 1 Processor -- start 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7817fff700 1 -- start start 2024-02-15T18:29:18.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7817fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f6530 0x7f7818106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7817fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78180f77d0 0x7f7818107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7817fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818107910 con 0x7f78180f6530 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7817fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818108120 con 0x7f78180f77d0 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7816ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f6530 0x7f7818106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7816ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f6530 0x7f7818106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57548/0 (socket says 172.21.15.84:57548) 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.380+0000 7f7816ffd700 1 -- 172.21.15.84:0/1492512577 learned_addr learned my addr 172.21.15.84:0/1492512577 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.381+0000 7f7816ffd700 1 -- 172.21.15.84:0/1492512577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78180f77d0 msgr2=0x7f7818107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.381+0000 7f7816ffd700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78180f77d0 0x7f7818107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.381+0000 7f7816ffd700 1 -- 172.21.15.84:0/1492512577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808005040 con 0x7f78180f6530 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.381+0000 7f7816ffd700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f6530 0x7f7818106e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f780c002700 tx=0x7f780c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.381+0000 7f77ff7fe700 1 -- 172.21.15.84:0/1492512577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f780c009320 con 0x7f78180f6530 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.381+0000 7f77ff7fe700 1 -- 172.21.15.84:0/1492512577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f780c00f040 con 0x7f78180f6530 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.381+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78181083a0 con 0x7f78180f6530 2024-02-15T18:29:18.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.381+0000 7f77ff7fe700 1 -- 172.21.15.84:0/1492512577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f780c0149d0 con 0x7f78180f6530 2024-02-15T18:29:18.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.381+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7818108960 con 0x7f78180f6530 2024-02-15T18:29:18.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.382+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7818059100 con 0x7f78180f6530 2024-02-15T18:29:18.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.382+0000 7f77ff7fe700 1 -- 172.21.15.84:0/1492512577 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f780c0077b0 con 0x7f78180f6530 2024-02-15T18:29:18.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.383+0000 7f77ff7fe700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7800060f70 0x7f7800063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:18.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.383+0000 7f77ff7fe700 1 -- 172.21.15.84:0/1492512577 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f780c07c370 con 0x7f78180f6530 2024-02-15T18:29:18.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.383+0000 7f78167fc700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7800060f70 0x7f7800063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:18.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.383+0000 7f78167fc700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7800060f70 0x7f7800063430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7808009f50 tx=0x7f7808009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:18.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.387+0000 7f77ff7fe700 1 -- 172.21.15.84:0/1492512577 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f780c04c7f0 con 0x7f78180f6530 2024-02-15T18:29:18.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:16.715397+0000 mgr.smithi084.hjmnez (mgr.14596) 128 : cluster [DBG] pgmap v91: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:18.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:16.715397+0000 mgr.smithi084.hjmnez (mgr.14596) 128 : cluster [DBG] pgmap v91: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:18.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.562+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f78180fefb0 con 0x7f7800060f70 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (8m) 30s ago 10m 18.0M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (67s) 30s ago 10m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (61s) 54s ago 9m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (8m) 30s ago 9m 35.3M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (5m) 30s ago 5m 121M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (5m) 30s ago 5m 13.7M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (5m) 54s ago 5m 137M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (5m) 54s ago 5m 14.3M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (2m) 30s ago 11m 430M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (2m) 54s ago 9m 388M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (108s) 30s ago 11m 43.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (81s) 54s ago 9m 24.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:29:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (9m) 30s ago 9m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (9m) 54s ago 9m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (36s) 30s ago 8m 16.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (8m) 30s ago 8m 414M 4096M 16.2.4 8d91d370c2b8 5f5c1e413e72 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (7m) 30s ago 7m 407M 4096M 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (7m) 54s ago 7m 442M 4096M 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (7m) 54s ago 7m 440M 4096M 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (6m) 54s ago 6m 391M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (2m) 30s ago 9m 63.7M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.571+0000 7f77ff7fe700 1 -- 172.21.15.84:0/1492512577 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f78080092e0 con 0x7f7800060f70 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.572+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7800060f70 msgr2=0x7f7800063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.572+0000 7f7817fff700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7800060f70 0x7f7800063430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7808009f50 tx=0x7f7808009b30).stop 2024-02-15T18:29:18.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.572+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f6530 msgr2=0x7f7818106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.572+0000 7f7817fff700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f6530 0x7f7818106e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f780c002700 tx=0x7f780c009d80).stop 2024-02-15T18:29:18.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.572+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 shutdown_connections 2024-02-15T18:29:18.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.572+0000 7f7817fff700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7800060f70 0x7f7800063430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.572+0000 7f7817fff700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78180f6530 0x7f7818106e20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.572+0000 7f7817fff700 1 --2- 172.21.15.84:0/1492512577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78180f77d0 0x7f7818107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:29:18.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.572+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 >> 172.21.15.84:0/1492512577 conn(0x7f78180f1c90 msgr2=0x7f78180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:18.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.573+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 shutdown_connections 2024-02-15T18:29:18.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.573+0000 7f7817fff700 1 -- 172.21.15.84:0/1492512577 wait complete. 2024-02-15T18:29:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.670+0000 7f6e0a407700 1 -- 172.21.15.84:0/1129607215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 msgr2=0x7f6e040f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.670+0000 7f6e0a407700 1 --2- 172.21.15.84:0/1129607215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 0x7f6e040f6cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f6df8004660 tx=0x7f6df8009b30).stop 2024-02-15T18:29:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.670+0000 7f6e0a407700 1 -- 172.21.15.84:0/1129607215 shutdown_connections 2024-02-15T18:29:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.670+0000 7f6e0a407700 1 --2- 172.21.15.84:0/1129607215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 0x7f6e040f6cc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.670+0000 7f6e0a407700 1 --2- 172.21.15.84:0/1129607215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e040f55c0 0x7f6e040f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.670+0000 7f6e0a407700 1 -- 172.21.15.84:0/1129607215 >> 172.21.15.84:0/1129607215 conn(0x7f6e040f0d40 msgr2=0x7f6e040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:18.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.670+0000 7f6e0a407700 1 -- 172.21.15.84:0/1129607215 shutdown_connections 2024-02-15T18:29:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.670+0000 7f6e0a407700 1 -- 172.21.15.84:0/1129607215 wait complete. 2024-02-15T18:29:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e0a407700 1 Processor -- start 2024-02-15T18:29:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e0a407700 1 -- start start 2024-02-15T18:29:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e0a407700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e040f55c0 0x7f6e04109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e0a407700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 0x7f6e0410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e0a407700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040603e0 con 0x7f6e040f6860 2024-02-15T18:29:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e0a407700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e04060520 con 0x7f6e040f55c0 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 0x7f6e0410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 0x7f6e0410c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57570/0 (socket says 172.21.15.84:57570) 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e037fe700 1 -- 172.21.15.84:0/3910653589 learned_addr learned my addr 172.21.15.84:0/3910653589 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.671+0000 7f6e03fff700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e040f55c0 0x7f6e04109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.672+0000 7f6e037fe700 1 -- 172.21.15.84:0/3910653589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e040f55c0 msgr2=0x7f6e04109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.672+0000 7f6e037fe700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e040f55c0 0x7f6e04109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.672+0000 7f6e037fe700 1 -- 172.21.15.84:0/3910653589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df8005040 con 0x7f6e040f6860 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.672+0000 7f6e037fe700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 0x7f6e0410c1b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6df8009f50 tx=0x7f6df8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.672+0000 7f6e00ff9700 1 -- 172.21.15.84:0/3910653589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df8018070 con 0x7f6e040f6860 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.672+0000 7f6e00ff9700 1 -- 172.21.15.84:0/3910653589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f6df8007ba0 con 0x7f6e040f6860 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.672+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0410c700 con 0x7f6e040f6860 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.672+0000 7f6e00ff9700 1 -- 172.21.15.84:0/3910653589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df801c420 con 0x7f6e040f6860 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.672+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0410cc60 con 0x7f6e040f6860 2024-02-15T18:29:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.673+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e04045ad0 con 0x7f6e040f6860 2024-02-15T18:29:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.673+0000 7f6e00ff9700 1 -- 172.21.15.84:0/3910653589 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f6df801d420 con 0x7f6e040f6860 2024-02-15T18:29:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.674+0000 7f6e00ff9700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6dec060f20 0x7f6dec0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.674+0000 7f6e00ff9700 1 -- 172.21.15.84:0/3910653589 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6df807dcf0 con 0x7f6e040f6860 2024-02-15T18:29:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.674+0000 7f6e03fff700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6dec060f20 0x7f6dec0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.674+0000 7f6e03fff700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6dec060f20 0x7f6dec0633e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6e04060060 tx=0x7f6df400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.678+0000 7f6e00ff9700 1 -- 172.21.15.84:0/3910653589 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6df804e190 con 0x7f6e040f6860 2024-02-15T18:29:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.908+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6e04027a00 con 0x7f6e040f6860 2024-02-15T18:29:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.909+0000 7f6e00ff9700 1 -- 172.21.15.84:0/3910653589 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f6df80517b0 con 0x7f6e040f6860 2024-02-15T18:29:18.903 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:29:18.903 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:29:18.903 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 5, 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2024-02-15T18:29:18.904 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:29:18.905 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:29:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.910+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6dec060f20 msgr2=0x7f6dec0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.910+0000 7f6e0a407700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6dec060f20 0x7f6dec0633e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6e04060060 tx=0x7f6df400b040).stop 2024-02-15T18:29:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.910+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 msgr2=0x7f6e0410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.910+0000 7f6e0a407700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 0x7f6e0410c1b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6df8009f50 tx=0x7f6df8009b30).stop 2024-02-15T18:29:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.911+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 shutdown_connections 2024-02-15T18:29:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.911+0000 7f6e0a407700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6dec060f20 0x7f6dec0633e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.911+0000 7f6e0a407700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e040f55c0 0x7f6e04109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.911+0000 7f6e0a407700 1 --2- 172.21.15.84:0/3910653589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040f6860 0x7f6e0410c1b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.911+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 >> 172.21.15.84:0/3910653589 conn(0x7f6e040f0d40 msgr2=0x7f6e040fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.911+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 shutdown_connections 2024-02-15T18:29:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:18.911+0000 7f6e0a407700 1 -- 172.21.15.84:0/3910653589 wait complete. 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 -- 172.21.15.84:0/2667263071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f66e0 msgr2=0x7f31dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 --2- 172.21.15.84:0/2667263071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f66e0 0x7f31dc0f6b00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f31cc004660 tx=0x7f31cc009b30).stop 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 -- 172.21.15.84:0/2667263071 shutdown_connections 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 --2- 172.21.15.84:0/2667263071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc0f7980 0x7f31dc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 --2- 172.21.15.84:0/2667263071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f66e0 0x7f31dc0f6b00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 -- 172.21.15.84:0/2667263071 >> 172.21.15.84:0/2667263071 conn(0x7f31dc0f1e40 msgr2=0x7f31dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 -- 172.21.15.84:0/2667263071 shutdown_connections 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 -- 172.21.15.84:0/2667263071 wait complete. 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 Processor -- start 2024-02-15T18:29:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.009+0000 7f31e2909700 1 -- start start 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31e2909700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc0f66e0 0x7f31dc107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31e2909700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f7980 0x7f31dc107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31e2909700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc107ad0 con 0x7f31dc0f7980 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31e2909700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc107c10 con 0x7f31dc0f66e0 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f7980 0x7f31dc107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f7980 0x7f31dc107520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57584/0 (socket says 172.21.15.84:57584) 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d3fff700 1 -- 172.21.15.84:0/1734713579 learned_addr learned my addr 172.21.15.84:0/1734713579 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31dbfff700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc0f66e0 0x7f31dc107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d3fff700 1 -- 172.21.15.84:0/1734713579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc0f66e0 msgr2=0x7f31dc107030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d3fff700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc0f66e0 0x7f31dc107030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d3fff700 1 -- 172.21.15.84:0/1734713579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc005040 con 0x7f31dc0f7980 2024-02-15T18:29:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d3fff700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f7980 0x7f31dc107520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f31c400c530 tx=0x7f31c4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d97fa700 1 -- 172.21.15.84:0/1734713579 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c400f650 con 0x7f31dc0f7980 2024-02-15T18:29:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d97fa700 1 -- 172.21.15.84:0/1734713579 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f31c400fca0 con 0x7f31dc0f7980 2024-02-15T18:29:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc1085b0 con 0x7f31dc0f7980 2024-02-15T18:29:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31d97fa700 1 -- 172.21.15.84:0/1734713579 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c4012d40 con 0x7f31dc0f7980 2024-02-15T18:29:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.010+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc108b70 con 0x7f31dc0f7980 2024-02-15T18:29:19.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.011+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31dc045ad0 con 0x7f31dc0f7980 2024-02-15T18:29:19.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.012+0000 7f31d97fa700 1 -- 172.21.15.84:0/1734713579 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f31c4010070 con 0x7f31dc0f7980 2024-02-15T18:29:19.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.012+0000 7f31d97fa700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f31c8060f20 0x7f31c80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:19.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.012+0000 7f31d97fa700 1 -- 172.21.15.84:0/1734713579 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f31c407bd90 con 0x7f31dc0f7980 2024-02-15T18:29:19.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.012+0000 7f31dbfff700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f31c8060f20 0x7f31c80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:19.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.012+0000 7f31dbfff700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f31c8060f20 0x7f31c80633e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f31cc004630 tx=0x7f31cc009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.016+0000 7f31d97fa700 1 -- 172.21.15.84:0/1734713579 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f31c4047f60 con 0x7f31dc0f7980 2024-02-15T18:29:19.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.223+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f31dc027a00 con 0x7f31dc0f7980 2024-02-15T18:29:19.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.224+0000 7f31d97fa700 1 -- 172.21.15.84:0/1734713579 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f31c404fc40 con 0x7f31dc0f7980 2024-02-15T18:29:19.218 INFO:teuthology.orchestra.run.smithi084.stdout:e16 2024-02-15T18:29:19.218 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 16 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:28:06.036365+0000 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:29:19.219 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:29:19.220 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:29:19.221 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:29:19.222 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:29:19.222 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:29:19.222 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f31c8060f20 msgr2=0x7f31c80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f31c8060f20 0x7f31c80633e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f31cc004630 tx=0x7f31cc009b30).stop 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f7980 msgr2=0x7f31dc107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f7980 0x7f31dc107520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f31c400c530 tx=0x7f31c4007e20).stop 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 shutdown_connections 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f31c8060f20 0x7f31c80633e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc0f66e0 0x7f31dc107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 --2- 172.21.15.84:0/1734713579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0f7980 0x7f31dc107520 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 >> 172.21.15.84:0/1734713579 conn(0x7f31dc0f1e40 msgr2=0x7f31dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.225+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 shutdown_connections 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.226+0000 7f31e2909700 1 -- 172.21.15.84:0/1734713579 wait complete. 2024-02-15T18:29:19.223 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2024-02-15T18:29:19.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.325+0000 7f49d2c1d700 1 -- 172.21.15.84:0/4009943212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 msgr2=0x7f49cc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.325+0000 7f49d2c1d700 1 --2- 172.21.15.84:0/4009943212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 0x7f49cc0f7de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f49b8004660 tx=0x7f49b8009b30).stop 2024-02-15T18:29:19.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.325+0000 7f49d2c1d700 1 -- 172.21.15.84:0/4009943212 shutdown_connections 2024-02-15T18:29:19.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.325+0000 7f49d2c1d700 1 --2- 172.21.15.84:0/4009943212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 0x7f49cc0f7de0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.325+0000 7f49d2c1d700 1 --2- 172.21.15.84:0/4009943212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f66e0 0x7f49cc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.325+0000 7f49d2c1d700 1 -- 172.21.15.84:0/4009943212 >> 172.21.15.84:0/4009943212 conn(0x7f49cc0f1e40 msgr2=0x7f49cc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.326+0000 7f49d2c1d700 1 -- 172.21.15.84:0/4009943212 shutdown_connections 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.326+0000 7f49d2c1d700 1 -- 172.21.15.84:0/4009943212 wait complete. 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.326+0000 7f49d2c1d700 1 Processor -- start 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.326+0000 7f49d2c1d700 1 -- start start 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.326+0000 7f49d2c1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f66e0 0x7f49cc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.326+0000 7f49d2c1d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 0x7f49cc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.326+0000 7f49d2c1d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc06a380 con 0x7f49cc0f7980 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.326+0000 7f49d2c1d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc06a4c0 con 0x7f49cc0f66e0 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 0x7f49cc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 0x7f49cc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57600/0 (socket says 172.21.15.84:57600) 2024-02-15T18:29:19.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49cbfff700 1 -- 172.21.15.84:0/2093329516 learned_addr learned my addr 172.21.15.84:0/2093329516 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49d09b9700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f66e0 0x7f49cc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49cbfff700 1 -- 172.21.15.84:0/2093329516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f66e0 msgr2=0x7f49cc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49cbfff700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f66e0 0x7f49cc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49cbfff700 1 -- 172.21.15.84:0/2093329516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8005040 con 0x7f49cc0f7980 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49d09b9700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f66e0 0x7f49cc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49cbfff700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 0x7f49cc069e20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f49b8009f50 tx=0x7f49b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49c97fa700 1 -- 172.21.15.84:0/2093329516 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b8018070 con 0x7f49cc0f7980 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49c97fa700 1 -- 172.21.15.84:0/2093329516 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f49b8007d70 con 0x7f49cc0f7980 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc06a740 con 0x7f49cc0f7980 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49c97fa700 1 -- 172.21.15.84:0/2093329516 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b801c620 con 0x7f49cc0f7980 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.327+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc06aca0 con 0x7f49cc0f7980 2024-02-15T18:29:19.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.328+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc045ad0 con 0x7f49cc0f7980 2024-02-15T18:29:19.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.328+0000 7f49c97fa700 1 -- 172.21.15.84:0/2093329516 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f49b801c8e0 con 0x7f49cc0f7980 2024-02-15T18:29:19.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.329+0000 7f49c97fa700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49bc060f20 0x7f49bc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:19.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.329+0000 7f49c97fa700 1 -- 172.21.15.84:0/2093329516 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f49b807e070 con 0x7f49cc0f7980 2024-02-15T18:29:19.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.329+0000 7f49d09b9700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49bc060f20 0x7f49bc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:19.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.329+0000 7f49d09b9700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49bc060f20 0x7f49bc0633e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f49cc06b730 tx=0x7f49c0009040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:19.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.333+0000 7f49c97fa700 1 -- 172.21.15.84:0/2093329516 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f49b804e4f0 con 0x7f49cc0f7980 2024-02-15T18:29:19.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:17.986315+0000 mgr.smithi084.hjmnez (mgr.14596) 129 : audit [DBG] from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:19.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:18.280210+0000 mgr.smithi084.hjmnez (mgr.14596) 130 : audit [DBG] from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:19.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:18.563536+0000 mgr.smithi084.hjmnez (mgr.14596) 131 : audit [DBG] from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:19.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:18.909672+0000 mon.smithi084 (mon.0) 156 : audit [DBG] from='client.? 172.21.15.84:0/3910653589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:19.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:17.986315+0000 mgr.smithi084.hjmnez (mgr.14596) 129 : audit [DBG] from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:19.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:18.280210+0000 mgr.smithi084.hjmnez (mgr.14596) 130 : audit [DBG] from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:19.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:18.563536+0000 mgr.smithi084.hjmnez (mgr.14596) 131 : audit [DBG] from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:19.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:18.909672+0000 mon.smithi084 (mon.0) 156 : audit [DBG] from='client.? 172.21.15.84:0/3910653589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:19.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.517+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49cc0ff020 con 0x7f49bc060f20 2024-02-15T18:29:19.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.518+0000 7f49c97fa700 1 -- 172.21.15.84:0/2093329516 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f49cc0ff020 con 0x7f49bc060f20 2024-02-15T18:29:19.513 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:29:19.513 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "7/21 daemons upgraded", 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:29:19.514 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:29:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.520+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49bc060f20 msgr2=0x7f49bc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.520+0000 7f49d2c1d700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49bc060f20 0x7f49bc0633e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f49cc06b730 tx=0x7f49c0009040).stop 2024-02-15T18:29:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.520+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 msgr2=0x7f49cc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.520+0000 7f49d2c1d700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 0x7f49cc069e20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f49b8009f50 tx=0x7f49b8009b30).stop 2024-02-15T18:29:19.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.521+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 shutdown_connections 2024-02-15T18:29:19.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.521+0000 7f49d2c1d700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49bc060f20 0x7f49bc0633e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.521+0000 7f49d2c1d700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f66e0 0x7f49cc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.521+0000 7f49d2c1d700 1 --2- 172.21.15.84:0/2093329516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f7980 0x7f49cc069e20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.521+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 >> 172.21.15.84:0/2093329516 conn(0x7f49cc0f1e40 msgr2=0x7f49cc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:19.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.521+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 shutdown_connections 2024-02-15T18:29:19.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:19.521+0000 7f49d2c1d700 1 -- 172.21.15.84:0/2093329516 wait complete. 2024-02-15T18:29:20.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:18.715922+0000 mgr.smithi084.hjmnez (mgr.14596) 132 : cluster [DBG] pgmap v92: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:20.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:19.224604+0000 mon.smithi084 (mon.0) 157 : audit [DBG] from='client.? 172.21.15.84:0/1734713579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:29:20.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:19.519226+0000 mgr.smithi084.hjmnez (mgr.14596) 133 : audit [DBG] from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:20.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:20.050777+0000 mon.smithi084 (mon.0) 158 : cluster [WRN] Health check update: Degraded data redundancy: 53/345 objects degraded (15.362%), 15 pgs degraded (PG_DEGRADED) 2024-02-15T18:29:20.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:18.715922+0000 mgr.smithi084.hjmnez (mgr.14596) 132 : cluster [DBG] pgmap v92: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:20.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:19.224604+0000 mon.smithi084 (mon.0) 157 : audit [DBG] from='client.? 172.21.15.84:0/1734713579' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:29:20.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:19.519226+0000 mgr.smithi084.hjmnez (mgr.14596) 133 : audit [DBG] from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:20.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:20.050777+0000 mon.smithi084 (mon.0) 158 : cluster [WRN] Health check update: Degraded data redundancy: 53/345 objects degraded (15.362%), 15 pgs degraded (PG_DEGRADED) 2024-02-15T18:29:21.758 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-1[83547]: debug 2024-02-15T18:29:21.504+0000 7fde25c94700 1 -- 172.21.15.84:0/1754006239 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ca8a62c680 con 0x55ca8a5f3000 2024-02-15T18:29:21.758 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:21 smithi084 bash[83532]: 2d8c766ef013418620f73b5cfc04cfb1f30128f67d2ad17dc4fcabbb251b3544 2024-02-15T18:29:21.758 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:21 smithi084 systemd[1]: Started Ceph osd.1 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:29:22.270 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-1[83547]: debug 2024-02-15T18:29:22.024+0000 7fde2d722380 -1 Falling back to public interface 2024-02-15T18:29:22.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:20.716329+0000 mgr.smithi084.hjmnez (mgr.14596) 134 : cluster [DBG] pgmap v93: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:22.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:21.627148+0000 mon.smithi084 (mon.0) 159 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:22.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:21.627922+0000 mon.smithi084 (mon.0) 160 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:22.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:21.902650+0000 mon.smithi084 (mon.0) 161 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:23.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:20.716329+0000 mgr.smithi084.hjmnez (mgr.14596) 134 : cluster [DBG] pgmap v93: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:23.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:21.627148+0000 mon.smithi084 (mon.0) 159 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:23.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:21.627922+0000 mon.smithi084 (mon.0) 160 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:23.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:21.902650+0000 mon.smithi084 (mon.0) 161 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:22.716776+0000 mgr.smithi084.hjmnez (mgr.14596) 135 : cluster [DBG] pgmap v94: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:25.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:22.716776+0000 mgr.smithi084.hjmnez (mgr.14596) 135 : cluster [DBG] pgmap v94: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:26.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:24.717377+0000 mgr.smithi084.hjmnez (mgr.14596) 136 : cluster [DBG] pgmap v95: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:27.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:24.717377+0000 mgr.smithi084.hjmnez (mgr.14596) 136 : cluster [DBG] pgmap v95: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:26.717784+0000 mgr.smithi084.hjmnez (mgr.14596) 137 : cluster [DBG] pgmap v96: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.381689+0000 mon.smithi084 (mon.0) 162 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.683370+0000 mon.smithi084 (mon.0) 163 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.684034+0000 mon.smithi084 (mon.0) 164 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:27.684491+0000 mgr.smithi084.hjmnez (mgr.14596) 138 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.688256+0000 mon.smithi084 (mon.0) 165 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.692909+0000 mon.smithi084 (mon.0) 166 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.694863+0000 mon.smithi084 (mon.0) 167 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.695937+0000 mon.smithi084 (mon.0) 168 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.696889+0000 mon.smithi084 (mon.0) 169 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:28.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.697821+0000 mon.smithi084 (mon.0) 170 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:29:28.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:26.717784+0000 mgr.smithi084.hjmnez (mgr.14596) 137 : cluster [DBG] pgmap v96: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:28.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.381689+0000 mon.smithi084 (mon.0) 162 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:28.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.683370+0000 mon.smithi084 (mon.0) 163 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:29:28.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.684034+0000 mon.smithi084 (mon.0) 164 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:29:28.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:27.684491+0000 mgr.smithi084.hjmnez (mgr.14596) 138 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:29:28.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.688256+0000 mon.smithi084 (mon.0) 165 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:28.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.692909+0000 mon.smithi084 (mon.0) 166 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:28.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.694863+0000 mon.smithi084 (mon.0) 167 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:28.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.695937+0000 mon.smithi084 (mon.0) 168 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:28.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.696889+0000 mon.smithi084 (mon.0) 169 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:28.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.697821+0000 mon.smithi084 (mon.0) 170 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:29:29.008 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-1[83547]: debug 2024-02-15T18:29:28.895+0000 7fde2d722380 -1 osd.1 53 log_to_monitors {default=true} 2024-02-15T18:29:29.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:27.697935+0000 mgr.smithi084.hjmnez (mgr.14596) 139 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:29:29.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:27.698446+0000 mgr.smithi084.hjmnez (mgr.14596) 140 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-15T18:29:29.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:28.899185+0000 mon.smithi084 (mon.0) 171 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/1708624404,v1:172.21.15.84:6811/1708624404]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T18:29:29.758 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:29:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-1[83547]: debug 2024-02-15T18:29:29.394+0000 7fde1f40a700 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:29:29.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:27.697935+0000 mgr.smithi084.hjmnez (mgr.14596) 139 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:29:29.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:27.698446+0000 mgr.smithi084.hjmnez (mgr.14596) 140 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-15T18:29:29.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:28.899185+0000 mon.smithi084 (mon.0) 171 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/1708624404,v1:172.21.15.84:6811/1708624404]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T18:29:30.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:28.718294+0000 mgr.smithi084.hjmnez (mgr.14596) 141 : cluster [DBG] pgmap v97: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:30.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:29.390055+0000 mon.smithi084 (mon.0) 172 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/1708624404,v1:172.21.15.84:6811/1708624404]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T18:29:30.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:29.390121+0000 mon.smithi084 (mon.0) 173 : cluster [DBG] osdmap e56: 6 total, 5 up, 6 in 2024-02-15T18:29:30.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:29.390998+0000 mon.smithi084 (mon.0) 174 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/1708624404,v1:172.21.15.84:6811/1708624404]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:29:30.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:28.718294+0000 mgr.smithi084.hjmnez (mgr.14596) 141 : cluster [DBG] pgmap v97: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:30.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:29.390055+0000 mon.smithi084 (mon.0) 172 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/1708624404,v1:172.21.15.84:6811/1708624404]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T18:29:30.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:29.390121+0000 mon.smithi084 (mon.0) 173 : cluster [DBG] osdmap e56: 6 total, 5 up, 6 in 2024-02-15T18:29:30.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:29.390998+0000 mon.smithi084 (mon.0) 174 : audit [INF] from='osd.1 [v2:172.21.15.84:6810/1708624404,v1:172.21.15.84:6811/1708624404]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:29:31.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:30.385896+0000 mon.smithi084 (mon.0) 175 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:29:31.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:30.389488+0000 mon.smithi084 (mon.0) 176 : cluster [INF] osd.1 [v2:172.21.15.84:6810/1708624404,v1:172.21.15.84:6811/1708624404] boot 2024-02-15T18:29:31.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:30.389550+0000 mon.smithi084 (mon.0) 177 : cluster [DBG] osdmap e57: 6 total, 6 up, 6 in 2024-02-15T18:29:31.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:30.390071+0000 mon.smithi084 (mon.0) 178 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:29:31.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:31.392114+0000 mon.smithi084 (mon.0) 179 : cluster [DBG] osdmap e58: 6 total, 6 up, 6 in 2024-02-15T18:29:31.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:30.385896+0000 mon.smithi084 (mon.0) 175 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:29:31.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:30.389488+0000 mon.smithi084 (mon.0) 176 : cluster [INF] osd.1 [v2:172.21.15.84:6810/1708624404,v1:172.21.15.84:6811/1708624404] boot 2024-02-15T18:29:31.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:30.389550+0000 mon.smithi084 (mon.0) 177 : cluster [DBG] osdmap e57: 6 total, 6 up, 6 in 2024-02-15T18:29:31.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:30.390071+0000 mon.smithi084 (mon.0) 178 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:29:31.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:31.392114+0000 mon.smithi084 (mon.0) 179 : cluster [DBG] osdmap e58: 6 total, 6 up, 6 in 2024-02-15T18:29:32.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:30.718920+0000 mgr.smithi084.hjmnez (mgr.14596) 142 : cluster [DBG] pgmap v100: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:32.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:30.718920+0000 mgr.smithi084.hjmnez (mgr.14596) 142 : cluster [DBG] pgmap v100: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:29:33.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:33.410837+0000 mon.smithi084 (mon.0) 180 : cluster [WRN] Health check update: Degraded data redundancy: 35/345 objects degraded (10.145%), 11 pgs degraded (PG_DEGRADED) 2024-02-15T18:29:33.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:33.410837+0000 mon.smithi084 (mon.0) 180 : cluster [WRN] Health check update: Degraded data redundancy: 35/345 objects degraded (10.145%), 11 pgs degraded (PG_DEGRADED) 2024-02-15T18:29:34.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:32.719426+0000 mgr.smithi084.hjmnez (mgr.14596) 143 : cluster [DBG] pgmap v102: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 35/345 objects degraded (10.145%) 2024-02-15T18:29:34.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:32.719426+0000 mgr.smithi084.hjmnez (mgr.14596) 143 : cluster [DBG] pgmap v102: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 35/345 objects degraded (10.145%) 2024-02-15T18:29:36.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:34.719941+0000 mgr.smithi084.hjmnez (mgr.14596) 144 : cluster [DBG] pgmap v103: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:36.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:35.464846+0000 mon.smithi084 (mon.0) 181 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/345 objects degraded (10.145%), 11 pgs degraded) 2024-02-15T18:29:36.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:35.464893+0000 mon.smithi084 (mon.0) 182 : cluster [INF] Cluster is now healthy 2024-02-15T18:29:36.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:34.719941+0000 mgr.smithi084.hjmnez (mgr.14596) 144 : cluster [DBG] pgmap v103: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:36.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:35.464846+0000 mon.smithi084 (mon.0) 181 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/345 objects degraded (10.145%), 11 pgs degraded) 2024-02-15T18:29:36.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:35.464893+0000 mon.smithi084 (mon.0) 182 : cluster [INF] Cluster is now healthy 2024-02-15T18:29:38.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:36.720459+0000 mgr.smithi084.hjmnez (mgr.14596) 145 : cluster [DBG] pgmap v104: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:38.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:36.903949+0000 mon.smithi084 (mon.0) 183 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:38.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:36.720459+0000 mgr.smithi084.hjmnez (mgr.14596) 145 : cluster [DBG] pgmap v104: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:38.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:36.903949+0000 mon.smithi084 (mon.0) 183 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:40.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:38.721033+0000 mgr.smithi084.hjmnez (mgr.14596) 146 : cluster [DBG] pgmap v105: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:40.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:38.721033+0000 mgr.smithi084.hjmnez (mgr.14596) 146 : cluster [DBG] pgmap v105: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:42.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:40.721507+0000 mgr.smithi084.hjmnez (mgr.14596) 147 : cluster [DBG] pgmap v106: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:42.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:41.972180+0000 mon.smithi084 (mon.0) 184 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:42.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:40.721507+0000 mgr.smithi084.hjmnez (mgr.14596) 147 : cluster [DBG] pgmap v106: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:42.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:41.972180+0000 mon.smithi084 (mon.0) 184 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:43.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:42.706206+0000 mon.smithi084 (mon.0) 185 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:29:43.459 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:42.706206+0000 mon.smithi084 (mon.0) 185 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:29:44.199 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:42.706460+0000 mgr.smithi084.hjmnez (mgr.14596) 148 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:29:44.199 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:42.707590+0000 mgr.smithi084.hjmnez (mgr.14596) 149 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-15T18:29:44.199 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:42.721951+0000 mgr.smithi084.hjmnez (mgr.14596) 150 : cluster [DBG] pgmap v107: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:44.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:42.706460+0000 mgr.smithi084.hjmnez (mgr.14596) 148 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:29:44.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:42.707590+0000 mgr.smithi084.hjmnez (mgr.14596) 149 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-15T18:29:44.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:42.721951+0000 mgr.smithi084.hjmnez (mgr.14596) 150 : cluster [DBG] pgmap v107: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:45.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:44.227020+0000 mgr.smithi084.hjmnez (mgr.14596) 151 : cephadm [INF] Upgrade: Updating osd.2 2024-02-15T18:29:45.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:44.231661+0000 mon.smithi084 (mon.0) 186 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:45.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:44.232503+0000 mon.smithi084 (mon.0) 187 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T18:29:45.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:44.233144+0000 mon.smithi084 (mon.0) 188 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:29:45.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:44.234158+0000 mgr.smithi084.hjmnez (mgr.14596) 152 : cephadm [INF] Deploying daemon osd.2 on smithi084 2024-02-15T18:29:45.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:44.227020+0000 mgr.smithi084.hjmnez (mgr.14596) 151 : cephadm [INF] Upgrade: Updating osd.2 2024-02-15T18:29:45.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:44.231661+0000 mon.smithi084 (mon.0) 186 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:45.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:44.232503+0000 mon.smithi084 (mon.0) 187 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T18:29:45.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:44.233144+0000 mon.smithi084 (mon.0) 188 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:29:45.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:44.234158+0000 mgr.smithi084.hjmnez (mgr.14596) 152 : cephadm [INF] Deploying daemon osd.2 on smithi084 2024-02-15T18:29:46.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:44.722315+0000 mgr.smithi084.hjmnez (mgr.14596) 153 : cluster [DBG] pgmap v108: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:46.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:44.722315+0000 mgr.smithi084.hjmnez (mgr.14596) 153 : cluster [DBG] pgmap v108: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:47.417 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:47 smithi084 systemd[1]: Stopping Ceph osd.2 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:29:47.758 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.2[56624]: debug 2024-02-15T18:29:47.421+0000 7f250b33c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:29:47.758 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.2[56624]: debug 2024-02-15T18:29:47.421+0000 7f250b33c700 -1 osd.2 58 *** Got signal Terminated *** 2024-02-15T18:29:47.758 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.2[56624]: debug 2024-02-15T18:29:47.421+0000 7f250b33c700 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:29:48.234 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:47 smithi084 bash[85515]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.2 2024-02-15T18:29:48.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:46.722810+0000 mgr.smithi084.hjmnez (mgr.14596) 154 : cluster [DBG] pgmap v109: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:48.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.526914+0000 mon.smithi084 (mon.0) 189 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.526944+0000 mon.smithi084 (mon.0) 190 : cluster [INF] osd.2 failed (root=default,host=smithi084) (connection refused reported by osd.4) 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677061+0000 mon.smithi084 (mon.0) 191 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677160+0000 mon.smithi084 (mon.0) 192 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677212+0000 mon.smithi084 (mon.0) 193 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677343+0000 mon.smithi084 (mon.0) 194 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677401+0000 mon.smithi084 (mon.0) 195 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677606+0000 mon.smithi084 (mon.0) 196 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677689+0000 mon.smithi084 (mon.0) 197 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677779+0000 mon.smithi084 (mon.0) 198 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677854+0000 mon.smithi084 (mon.0) 199 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.677905+0000 mon.smithi084 (mon.0) 200 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.678000+0000 mon.smithi084 (mon.0) 201 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.678073+0000 mon.smithi084 (mon.0) 202 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:47.727008+0000 mon.smithi084 (mon.0) 203 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.077868+0000 mon.smithi084 (mon.0) 204 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.077957+0000 mon.smithi084 (mon.0) 205 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.078166+0000 mon.smithi084 (mon.0) 206 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.078295+0000 mon.smithi084 (mon.0) 207 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.078435+0000 mon.smithi084 (mon.0) 208 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.078564+0000 mon.smithi084 (mon.0) 209 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.078690+0000 mon.smithi084 (mon.0) 210 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.078821+0000 mon.smithi084 (mon.0) 211 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.078942+0000 mon.smithi084 (mon.0) 212 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.079074+0000 mon.smithi084 (mon.0) 213 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.079188+0000 mon.smithi084 (mon.0) 214 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.079300+0000 mon.smithi084 (mon.0) 215 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.128647+0000 mon.smithi084 (mon.0) 216 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:46.722810+0000 mgr.smithi084.hjmnez (mgr.14596) 154 : cluster [DBG] pgmap v109: 65 pgs: 65 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.526914+0000 mon.smithi084 (mon.0) 189 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.526944+0000 mon.smithi084 (mon.0) 190 : cluster [INF] osd.2 failed (root=default,host=smithi084) (connection refused reported by osd.4) 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677061+0000 mon.smithi084 (mon.0) 191 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677160+0000 mon.smithi084 (mon.0) 192 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677212+0000 mon.smithi084 (mon.0) 193 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677343+0000 mon.smithi084 (mon.0) 194 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677401+0000 mon.smithi084 (mon.0) 195 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677606+0000 mon.smithi084 (mon.0) 196 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677689+0000 mon.smithi084 (mon.0) 197 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.641 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677779+0000 mon.smithi084 (mon.0) 198 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677854+0000 mon.smithi084 (mon.0) 199 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.677905+0000 mon.smithi084 (mon.0) 200 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.678000+0000 mon.smithi084 (mon.0) 201 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.678073+0000 mon.smithi084 (mon.0) 202 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:47.727008+0000 mon.smithi084 (mon.0) 203 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.077868+0000 mon.smithi084 (mon.0) 204 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.077957+0000 mon.smithi084 (mon.0) 205 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.078166+0000 mon.smithi084 (mon.0) 206 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.078295+0000 mon.smithi084 (mon.0) 207 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.078435+0000 mon.smithi084 (mon.0) 208 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.078564+0000 mon.smithi084 (mon.0) 209 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.078690+0000 mon.smithi084 (mon.0) 210 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.078821+0000 mon.smithi084 (mon.0) 211 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.078942+0000 mon.smithi084 (mon.0) 212 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.642 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.079074+0000 mon.smithi084 (mon.0) 213 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:29:48.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.079188+0000 mon.smithi084 (mon.0) 214 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:29:48.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.079300+0000 mon.smithi084 (mon.0) 215 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:29:48.643 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.128647+0000 mon.smithi084 (mon.0) 216 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:29:49.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.239522+0000 mon.smithi084 (mon.0) 217 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:29:49.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.247495+0000 mon.smithi084 (mon.0) 218 : cluster [DBG] osdmap e59: 6 total, 5 up, 6 in 2024-02-15T18:29:49.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.623+0000 7f994e8fe700 1 -- 172.21.15.84:0/2600357678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f66e0 msgr2=0x7f99480f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:49.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.623+0000 7f994e8fe700 1 --2- 172.21.15.84:0/2600357678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f66e0 0x7f99480f6b00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f993c004660 tx=0x7f993c009b30).stop 2024-02-15T18:29:49.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.623+0000 7f994e8fe700 1 -- 172.21.15.84:0/2600357678 shutdown_connections 2024-02-15T18:29:49.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.623+0000 7f994e8fe700 1 --2- 172.21.15.84:0/2600357678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480f7980 0x7f99480f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.623+0000 7f994e8fe700 1 --2- 172.21.15.84:0/2600357678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f66e0 0x7f99480f6b00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.623+0000 7f994e8fe700 1 -- 172.21.15.84:0/2600357678 >> 172.21.15.84:0/2600357678 conn(0x7f99480f1e40 msgr2=0x7f99480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.623+0000 7f994e8fe700 1 -- 172.21.15.84:0/2600357678 shutdown_connections 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.623+0000 7f994e8fe700 1 -- 172.21.15.84:0/2600357678 wait complete. 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.623+0000 7f994e8fe700 1 Processor -- start 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f994e8fe700 1 -- start start 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f994e8fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480f66e0 0x7f994806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f994e8fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f7980 0x7f9948069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f994e8fe700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994806a380 con 0x7f99480f7980 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f994e8fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994806a4c0 con 0x7f99480f66e0 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f99477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f7980 0x7f9948069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f99477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f7980 0x7f9948069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34504/0 (socket says 172.21.15.84:34504) 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f99477fe700 1 -- 172.21.15.84:0/2566199279 learned_addr learned my addr 172.21.15.84:0/2566199279 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:49.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f9947fff700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480f66e0 0x7f994806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f99477fe700 1 -- 172.21.15.84:0/2566199279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480f66e0 msgr2=0x7f994806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f99477fe700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480f66e0 0x7f994806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f99477fe700 1 -- 172.21.15.84:0/2566199279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c005040 con 0x7f99480f7980 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f99477fe700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f7980 0x7f9948069e20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f993800c790 tx=0x7f9938007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f9944ff9700 1 -- 172.21.15.84:0/2566199279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9938002590 con 0x7f99480f7980 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994806a7a0 con 0x7f99480f7980 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.624+0000 7f9944ff9700 1 -- 172.21.15.84:0/2566199279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9938002be0 con 0x7f99480f7980 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.625+0000 7f9944ff9700 1 -- 172.21.15.84:0/2566199279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99380123b0 con 0x7f99480f7980 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.625+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994810f060 con 0x7f99480f7980 2024-02-15T18:29:49.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.625+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9948045ad0 con 0x7f99480f7980 2024-02-15T18:29:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.627+0000 7f9944ff9700 1 -- 172.21.15.84:0/2566199279 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f993801a060 con 0x7f99480f7980 2024-02-15T18:29:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.627+0000 7f9944ff9700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9930060f20 0x7f99300633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.627+0000 7f9944ff9700 1 -- 172.21.15.84:0/2566199279 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f993807c550 con 0x7f99480f7980 2024-02-15T18:29:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.627+0000 7f9947fff700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9930060f20 0x7f99300633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:49.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.627+0000 7f9947fff700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9930060f20 0x7f99300633e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f994806b730 tx=0x7f993c009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:49.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.631+0000 7f9944ff9700 1 -- 172.21.15.84:0/2566199279 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f993804ca50 con 0x7f99480f7980 2024-02-15T18:29:49.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.239522+0000 mon.smithi084 (mon.0) 217 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:29:49.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.247495+0000 mon.smithi084 (mon.0) 218 : cluster [DBG] osdmap e59: 6 total, 5 up, 6 in 2024-02-15T18:29:49.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.814+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9948057f10 con 0x7f9930060f20 2024-02-15T18:29:49.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.816+0000 7f9944ff9700 1 -- 172.21.15.84:0/2566199279 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9948057f10 con 0x7f9930060f20 2024-02-15T18:29:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.817+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9930060f20 msgr2=0x7f99300633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.817+0000 7f994e8fe700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9930060f20 0x7f99300633e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f994806b730 tx=0x7f993c009b30).stop 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.817+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f7980 msgr2=0x7f9948069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.817+0000 7f994e8fe700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f7980 0x7f9948069e20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f993800c790 tx=0x7f9938007d70).stop 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.817+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 shutdown_connections 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.817+0000 7f994e8fe700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9930060f20 0x7f99300633e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.817+0000 7f994e8fe700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480f66e0 0x7f994806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.817+0000 7f994e8fe700 1 --2- 172.21.15.84:0/2566199279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99480f7980 0x7f9948069e20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.817+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 >> 172.21.15.84:0/2566199279 conn(0x7f99480f1e40 msgr2=0x7f99480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.818+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 shutdown_connections 2024-02-15T18:29:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.818+0000 7f994e8fe700 1 -- 172.21.15.84:0/2566199279 wait complete. 2024-02-15T18:29:49.823 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:29:49.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.917+0000 7ff54ca92700 1 -- 172.21.15.84:0/3677515944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 msgr2=0x7ff5480f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:49.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.917+0000 7ff54ca92700 1 --2- 172.21.15.84:0/3677515944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 0x7ff5480f6b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff53c004660 tx=0x7ff53c009b30).stop 2024-02-15T18:29:49.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.917+0000 7ff54ca92700 1 -- 172.21.15.84:0/3677515944 shutdown_connections 2024-02-15T18:29:49.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.917+0000 7ff54ca92700 1 --2- 172.21.15.84:0/3677515944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5480f7980 0x7ff5480f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:49.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.917+0000 7ff54ca92700 1 --2- 172.21.15.84:0/3677515944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 0x7ff5480f6b00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:49.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.917+0000 7ff54ca92700 1 -- 172.21.15.84:0/3677515944 >> 172.21.15.84:0/3677515944 conn(0x7ff5480f1e40 msgr2=0x7ff5480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:49.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.917+0000 7ff54ca92700 1 -- 172.21.15.84:0/3677515944 shutdown_connections 2024-02-15T18:29:49.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.917+0000 7ff54ca92700 1 -- 172.21.15.84:0/3677515944 wait complete. 2024-02-15T18:29:49.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.917+0000 7ff54ca92700 1 Processor -- start 2024-02-15T18:29:49.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54ca92700 1 -- start start 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54ca92700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 0x7ff548107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54ca92700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5480f7980 0x7ff548107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54ca92700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548107ad0 con 0x7ff5480f66e0 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54ca92700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548107c10 con 0x7ff5480f7980 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 0x7ff548107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 0x7ff548107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34528/0 (socket says 172.21.15.84:34528) 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54659c700 1 -- 172.21.15.84:0/1404039029 learned_addr learned my addr 172.21.15.84:0/1404039029 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff545d9b700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5480f7980 0x7ff548107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54659c700 1 -- 172.21.15.84:0/1404039029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5480f7980 msgr2=0x7ff548107520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54659c700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5480f7980 0x7ff548107520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54659c700 1 -- 172.21.15.84:0/1404039029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c005040 con 0x7ff5480f66e0 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff54659c700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 0x7ff548107030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff53c002040 tx=0x7ff53c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:49.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.918+0000 7ff536ffd700 1 -- 172.21.15.84:0/1404039029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff53c019070 con 0x7ff5480f66e0 2024-02-15T18:29:49.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.919+0000 7ff536ffd700 1 -- 172.21.15.84:0/1404039029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7ff53c007e80 con 0x7ff5480f66e0 2024-02-15T18:29:49.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.919+0000 7ff536ffd700 1 -- 172.21.15.84:0/1404039029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff53c014db0 con 0x7ff5480f66e0 2024-02-15T18:29:49.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.919+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff548108550 con 0x7ff5480f66e0 2024-02-15T18:29:49.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.919+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff548108ab0 con 0x7ff5480f66e0 2024-02-15T18:29:49.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.920+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff548045ad0 con 0x7ff5480f66e0 2024-02-15T18:29:49.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.920+0000 7ff536ffd700 1 -- 172.21.15.84:0/1404039029 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ff53c025070 con 0x7ff5480f66e0 2024-02-15T18:29:49.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.920+0000 7ff536ffd700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff530060ec0 0x7ff530063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:49.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.920+0000 7ff536ffd700 1 -- 172.21.15.84:0/1404039029 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff53c07cff0 con 0x7ff5480f66e0 2024-02-15T18:29:49.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.920+0000 7ff545d9b700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff530060ec0 0x7ff530063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:49.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.921+0000 7ff545d9b700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff530060ec0 0x7ff530063380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff538009fd0 tx=0x7ff53800b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:49.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:49.924+0000 7ff536ffd700 1 -- 172.21.15.84:0/1404039029 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff53c050e40 con 0x7ff5480f66e0 2024-02-15T18:29:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.109+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5480ff130 con 0x7ff530060ec0 2024-02-15T18:29:50.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.110+0000 7ff536ffd700 1 -- 172.21.15.84:0/1404039029 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff5480ff130 con 0x7ff530060ec0 2024-02-15T18:29:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.112+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff530060ec0 msgr2=0x7ff530063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.112+0000 7ff54ca92700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff530060ec0 0x7ff530063380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff538009fd0 tx=0x7ff53800b040).stop 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.112+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 msgr2=0x7ff548107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.112+0000 7ff54ca92700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 0x7ff548107030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff53c002040 tx=0x7ff53c00b040).stop 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.112+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 shutdown_connections 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.112+0000 7ff54ca92700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff530060ec0 0x7ff530063380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.112+0000 7ff54ca92700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480f66e0 0x7ff548107030 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.112+0000 7ff54ca92700 1 --2- 172.21.15.84:0/1404039029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5480f7980 0x7ff548107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.112+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 >> 172.21.15.84:0/1404039029 conn(0x7ff5480f1e40 msgr2=0x7ff5480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.113+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 shutdown_connections 2024-02-15T18:29:50.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.113+0000 7ff54ca92700 1 -- 172.21.15.84:0/1404039029 wait complete. 2024-02-15T18:29:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.227+0000 7f260744a700 1 -- 172.21.15.84:0/2180458379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2600068250 msgr2=0x7f26000686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.227+0000 7f260744a700 1 --2- 172.21.15.84:0/2180458379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2600068250 0x7f26000686d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f25fc004660 tx=0x7f25fc009b30).stop 2024-02-15T18:29:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.227+0000 7f260744a700 1 -- 172.21.15.84:0/2180458379 shutdown_connections 2024-02-15T18:29:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.227+0000 7f260744a700 1 --2- 172.21.15.84:0/2180458379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2600068250 0x7f26000686d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.227+0000 7f260744a700 1 --2- 172.21.15.84:0/2180458379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26000696d0 0x7f2600067d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.227+0000 7f260744a700 1 -- 172.21.15.84:0/2180458379 >> 172.21.15.84:0/2180458379 conn(0x7f26000636c0 msgr2=0x7f2600065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.227+0000 7f260744a700 1 -- 172.21.15.84:0/2180458379 shutdown_connections 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.227+0000 7f260744a700 1 -- 172.21.15.84:0/2180458379 wait complete. 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f260744a700 1 Processor -- start 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f260744a700 1 -- start start 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f260744a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2600068250 0x7f2600115e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f260744a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26000696d0 0x7f2600116330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f260744a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26001169c0 con 0x7f26000696d0 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f260744a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600117140 con 0x7f2600068250 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f26049e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26000696d0 0x7f2600116330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f26049e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26000696d0 0x7f2600116330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34554/0 (socket says 172.21.15.84:34554) 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f26049e5700 1 -- 172.21.15.84:0/995407947 learned_addr learned my addr 172.21.15.84:0/995407947 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.228+0000 7f26051e6700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2600068250 0x7f2600115e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f26051e6700 1 -- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26000696d0 msgr2=0x7f2600116330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f26051e6700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26000696d0 0x7f2600116330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f26051e6700 1 -- 172.21.15.84:0/995407947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc005040 con 0x7f2600068250 2024-02-15T18:29:50.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f26049e5700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26000696d0 0x7f2600116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:29:50.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f26051e6700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2600068250 0x7f2600115e40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2600067c50 tx=0x7f25f0006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:50.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f25f5ffb700 1 -- 172.21.15.84:0/995407947 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f0013640 con 0x7f2600068250 2024-02-15T18:29:50.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26001173c0 con 0x7f2600068250 2024-02-15T18:29:50.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f25f5ffb700 1 -- 172.21.15.84:0/995407947 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f25f0013c90 con 0x7f2600068250 2024-02-15T18:29:50.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f25f5ffb700 1 -- 172.21.15.84:0/995407947 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f0012c90 con 0x7f2600068250 2024-02-15T18:29:50.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.229+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2600117900 con 0x7f2600068250 2024-02-15T18:29:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.230+0000 7f25f5ffb700 1 -- 172.21.15.84:0/995407947 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f25f001a060 con 0x7f2600068250 2024-02-15T18:29:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.230+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2600045ad0 con 0x7f2600068250 2024-02-15T18:29:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.231+0000 7f25f5ffb700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f25ec060f20 0x7f25ec0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.231+0000 7f25f5ffb700 1 -- 172.21.15.84:0/995407947 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f25f007c220 con 0x7f2600068250 2024-02-15T18:29:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.231+0000 7f26049e5700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f25ec060f20 0x7f25ec0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.231+0000 7f26049e5700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f25ec060f20 0x7f25ec0633e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f25fc013fd0 tx=0x7f25fc009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:50.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.235+0000 7f25f5ffb700 1 -- 172.21.15.84:0/995407947 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f25f0050ef0 con 0x7f2600068250 2024-02-15T18:29:50.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.422+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f260010dfe0 con 0x7f25ec060f20 2024-02-15T18:29:50.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.433+0000 7f25f5ffb700 1 -- 172.21.15.84:0/995407947 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f260010dfe0 con 0x7f25ec060f20 2024-02-15T18:29:50.428 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:29:50.428 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (9m) 23s ago 10m 18.0M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:29:50.428 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (99s) 23s ago 10m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:29:50.428 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (92s) 86s ago 9m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:29:50.428 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (9m) 23s ago 10m 35.5M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:29:50.428 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (5m) 23s ago 5m 121M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:29:50.428 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (5m) 23s ago 5m 13.9M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (5m) 86s ago 5m 137M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (5m) 86s ago 5m 14.3M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (3m) 23s ago 12m 432M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (2m) 86s ago 9m 388M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (2m) 23s ago 12m 47.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (113s) 86s ago 9m 24.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (10m) 23s ago 10m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (9m) 86s ago 9m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (68s) 23s ago 9m 209M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (29s) 23s ago 8m 15.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (8m) 23s ago 8m 402M 4096M 16.2.4 8d91d370c2b8 bb29f6abf200 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (8m) 86s ago 8m 442M 4096M 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (7m) 86s ago 7m 440M 4096M 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:29:50.429 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (7m) 86s ago 7m 391M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:29:50.430 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (3m) 23s ago 10m 63.7M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:29:50.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f25ec060f20 msgr2=0x7f25ec0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f25ec060f20 0x7f25ec0633e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f25fc013fd0 tx=0x7f25fc009b30).stop 2024-02-15T18:29:50.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2600068250 msgr2=0x7f2600115e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2600068250 0x7f2600115e40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2600067c50 tx=0x7f25f0006e30).stop 2024-02-15T18:29:50.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 shutdown_connections 2024-02-15T18:29:50.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f25ec060f20 0x7f25ec0633e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2600068250 0x7f2600115e40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 --2- 172.21.15.84:0/995407947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26000696d0 0x7f2600116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 >> 172.21.15.84:0/995407947 conn(0x7f26000636c0 msgr2=0x7f2600101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:50.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 shutdown_connections 2024-02-15T18:29:50.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.435+0000 7f260744a700 1 -- 172.21.15.84:0/995407947 wait complete. 2024-02-15T18:29:50.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:48.723106+0000 mgr.smithi084.hjmnez (mgr.14596) 155 : cluster [DBG] pgmap v111: 65 pgs: 9 stale+active+clean, 56 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:50.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:49.250685+0000 mon.smithi084 (mon.0) 219 : cluster [DBG] osdmap e60: 6 total, 5 up, 6 in 2024-02-15T18:29:50.508 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:50 smithi084 systemd[1]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.2.service: Succeeded. 2024-02-15T18:29:50.508 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:50 smithi084 systemd[1]: Stopped Ceph osd.2 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:29:50.508 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:50 smithi084 systemd[1]: Starting Ceph osd.2 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:29:50.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.537+0000 7f636028c700 1 -- 172.21.15.84:0/2945022673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 msgr2=0x7f63580f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.537+0000 7f636028c700 1 --2- 172.21.15.84:0/2945022673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 0x7f63580f7de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6354004660 tx=0x7f6354009b30).stop 2024-02-15T18:29:50.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.537+0000 7f636028c700 1 -- 172.21.15.84:0/2945022673 shutdown_connections 2024-02-15T18:29:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.537+0000 7f636028c700 1 --2- 172.21.15.84:0/2945022673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 0x7f63580f7de0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.537+0000 7f636028c700 1 --2- 172.21.15.84:0/2945022673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63580f66e0 0x7f63580f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.537+0000 7f636028c700 1 -- 172.21.15.84:0/2945022673 >> 172.21.15.84:0/2945022673 conn(0x7f63580f1e40 msgr2=0x7f63580f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.537+0000 7f636028c700 1 -- 172.21.15.84:0/2945022673 shutdown_connections 2024-02-15T18:29:50.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.537+0000 7f636028c700 1 -- 172.21.15.84:0/2945022673 wait complete. 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f636028c700 1 Processor -- start 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f636028c700 1 -- start start 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f636028c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63580f66e0 0x7f6358107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f636028c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 0x7f63581074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f636028c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6358107aa0 con 0x7f63580f7980 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f636028c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6358107be0 con 0x7f63580f66e0 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f635d827700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 0x7f63581074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f635d827700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 0x7f63581074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34572/0 (socket says 172.21.15.84:34572) 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f635d827700 1 -- 172.21.15.84:0/1463341954 learned_addr learned my addr 172.21.15.84:0/1463341954 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.538+0000 7f635d827700 1 -- 172.21.15.84:0/1463341954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63580f66e0 msgr2=0x7f6358107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f635e028700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63580f66e0 0x7f6358107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f635d827700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63580f66e0 0x7f6358107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f635d827700 1 -- 172.21.15.84:0/1463341954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6354005040 con 0x7f63580f7980 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f635e028700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63580f66e0 0x7f6358107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f635d827700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 0x7f63581074f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6354009f50 tx=0x7f6354009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f634effd700 1 -- 172.21.15.84:0/1463341954 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6354018070 con 0x7f63580f7980 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6358108520 con 0x7f63580f7980 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f634effd700 1 -- 172.21.15.84:0/1463341954 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f6354007d70 con 0x7f63580f7980 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f634effd700 1 -- 172.21.15.84:0/1463341954 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f635401c620 con 0x7f63580f7980 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.539+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6358108a80 con 0x7f63580f7980 2024-02-15T18:29:50.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.540+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6358045ad0 con 0x7f63580f7980 2024-02-15T18:29:50.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.540+0000 7f634effd700 1 -- 172.21.15.84:0/1463341954 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f635401c8e0 con 0x7f63580f7980 2024-02-15T18:29:50.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.541+0000 7f634effd700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6344060f20 0x7f63440633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:50.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.541+0000 7f634effd700 1 -- 172.21.15.84:0/1463341954 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f635407e070 con 0x7f63580f7980 2024-02-15T18:29:50.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.541+0000 7f635e028700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6344060f20 0x7f63440633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:50.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.541+0000 7f635e028700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6344060f20 0x7f63440633e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f63580f77e0 tx=0x7f6348009040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:50.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.545+0000 7f634effd700 1 -- 172.21.15.84:0/1463341954 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6354051f20 con 0x7f63580f7980 2024-02-15T18:29:50.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:48.723106+0000 mgr.smithi084.hjmnez (mgr.14596) 155 : cluster [DBG] pgmap v111: 65 pgs: 9 stale+active+clean, 56 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:29:50.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:49.250685+0000 mon.smithi084 (mon.0) 219 : cluster [DBG] osdmap e60: 6 total, 5 up, 6 in 2024-02-15T18:29:50.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.786+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6358027a00 con 0x7f63580f7980 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.787+0000 7f634effd700 1 -- 172.21.15.84:0/1463341954 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f6354051b10 con 0x7f63580f7980 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2, 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3 2024-02-15T18:29:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:29:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:29:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:29:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:29:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:29:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6, 2024-02-15T18:29:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2024-02-15T18:29:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:29:50.783 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.788+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6344060f20 msgr2=0x7f63440633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.788+0000 7f636028c700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6344060f20 0x7f63440633e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f63580f77e0 tx=0x7f6348009040).stop 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.788+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 msgr2=0x7f63581074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.788+0000 7f636028c700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 0x7f63581074f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6354009f50 tx=0x7f6354009b30).stop 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.788+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 shutdown_connections 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.788+0000 7f636028c700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6344060f20 0x7f63440633e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.788+0000 7f636028c700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63580f66e0 0x7f6358107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.788+0000 7f636028c700 1 --2- 172.21.15.84:0/1463341954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63580f7980 0x7f63581074f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.789+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 >> 172.21.15.84:0/1463341954 conn(0x7f63580f1e40 msgr2=0x7f63580fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.789+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 shutdown_connections 2024-02-15T18:29:50.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.789+0000 7f636028c700 1 -- 172.21.15.84:0/1463341954 wait complete. 2024-02-15T18:29:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.890+0000 7f809cbc5700 1 -- 172.21.15.84:0/3365036236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8098060310 msgr2=0x7f80980f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.890+0000 7f809cbc5700 1 --2- 172.21.15.84:0/3365036236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8098060310 0x7f80980f92a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f8088004660 tx=0x7f8088009b30).stop 2024-02-15T18:29:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.890+0000 7f809cbc5700 1 -- 172.21.15.84:0/3365036236 shutdown_connections 2024-02-15T18:29:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.890+0000 7f809cbc5700 1 --2- 172.21.15.84:0/3365036236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80980f9820 0x7f80980fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.890+0000 7f809cbc5700 1 --2- 172.21.15.84:0/3365036236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8098060310 0x7f80980f92a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.890+0000 7f809cbc5700 1 -- 172.21.15.84:0/3365036236 >> 172.21.15.84:0/3365036236 conn(0x7f80980f0d40 msgr2=0x7f80980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f809cbc5700 1 -- 172.21.15.84:0/3365036236 shutdown_connections 2024-02-15T18:29:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f809cbc5700 1 -- 172.21.15.84:0/3365036236 wait complete. 2024-02-15T18:29:50.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f809cbc5700 1 Processor -- start 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f809cbc5700 1 -- start start 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f809cbc5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8098060310 0x7f80980f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f809cbc5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80980f9820 0x7f80980f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f809cbc5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80980f5700 con 0x7f80980f9820 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f809cbc5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80980f5840 con 0x7f8098060310 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f8095d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80980f9820 0x7f80980f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f8095d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80980f9820 0x7f80980f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34590/0 (socket says 172.21.15.84:34590) 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f8095d9b700 1 -- 172.21.15.84:0/2745172551 learned_addr learned my addr 172.21.15.84:0/2745172551 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.891+0000 7f809659c700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8098060310 0x7f80980f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.892+0000 7f8095d9b700 1 -- 172.21.15.84:0/2745172551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8098060310 msgr2=0x7f80980f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.892+0000 7f8095d9b700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8098060310 0x7f80980f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.892+0000 7f8095d9b700 1 -- 172.21.15.84:0/2745172551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8088005040 con 0x7f80980f9820 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.892+0000 7f8095d9b700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80980f9820 0x7f80980f51a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f808c002700 tx=0x7f808c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:50.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.892+0000 7f8086ffd700 1 -- 172.21.15.84:0/2745172551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f808c0079c0 con 0x7f80980f9820 2024-02-15T18:29:50.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.892+0000 7f8086ffd700 1 -- 172.21.15.84:0/2745172551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f808c00f040 con 0x7f80980f9820 2024-02-15T18:29:50.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.892+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80980f5b20 con 0x7f80980f9820 2024-02-15T18:29:50.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.892+0000 7f8086ffd700 1 -- 172.21.15.84:0/2745172551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f808c0148c0 con 0x7f80980f9820 2024-02-15T18:29:50.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.892+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809810eff0 con 0x7f80980f9820 2024-02-15T18:29:50.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.893+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8098045ad0 con 0x7f80980f9820 2024-02-15T18:29:50.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.894+0000 7f8086ffd700 1 -- 172.21.15.84:0/2745172551 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f808c01b060 con 0x7f80980f9820 2024-02-15T18:29:50.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.894+0000 7f8086ffd700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8080060f20 0x7f80800633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:50.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.894+0000 7f8086ffd700 1 -- 172.21.15.84:0/2745172551 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f808c07bf40 con 0x7f80980f9820 2024-02-15T18:29:50.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.894+0000 7f809659c700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8080060f20 0x7f80800633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:50.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.895+0000 7f809659c700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8080060f20 0x7f80800633e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8088004630 tx=0x7f8088009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:50.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:50.899+0000 7f8086ffd700 1 -- 172.21.15.84:0/2745172551 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f808c04c3c0 con 0x7f80980f9820 2024-02-15T18:29:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.115+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8098027a00 con 0x7f80980f9820 2024-02-15T18:29:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.115+0000 7f8086ffd700 1 -- 172.21.15.84:0/2745172551 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f808c04f9e0 con 0x7f80980f9820 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:e16 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 16 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:28:06.036365+0000 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:29:51.111 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:29:51.112 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:29:51.113 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8080060f20 msgr2=0x7f80800633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8080060f20 0x7f80800633e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8088004630 tx=0x7f8088009b30).stop 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80980f9820 msgr2=0x7f80980f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80980f9820 0x7f80980f51a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f808c002700 tx=0x7f808c009d60).stop 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 shutdown_connections 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8080060f20 0x7f80800633e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8098060310 0x7f80980f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 --2- 172.21.15.84:0/2745172551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80980f9820 0x7f80980f51a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 >> 172.21.15.84:0/2745172551 conn(0x7f80980f0d40 msgr2=0x7f80980f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:51.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 shutdown_connections 2024-02-15T18:29:51.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.117+0000 7f809cbc5700 1 -- 172.21.15.84:0/2745172551 wait complete. 2024-02-15T18:29:51.115 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2024-02-15T18:29:51.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.223+0000 7f0def078700 1 -- 172.21.15.84:0/47469931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80fbbf0 msgr2=0x7f0de80fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:51.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.223+0000 7f0def078700 1 --2- 172.21.15.84:0/47469931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80fbbf0 0x7f0de80fdfe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0dd4004660 tx=0x7f0dd4009b30).stop 2024-02-15T18:29:51.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.223+0000 7f0def078700 1 -- 172.21.15.84:0/47469931 shutdown_connections 2024-02-15T18:29:51.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.223+0000 7f0def078700 1 --2- 172.21.15.84:0/47469931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80fbbf0 0x7f0de80fdfe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:51.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.223+0000 7f0def078700 1 --2- 172.21.15.84:0/47469931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de80602b0 0x7f0de80fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:51.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.223+0000 7f0def078700 1 -- 172.21.15.84:0/47469931 >> 172.21.15.84:0/47469931 conn(0x7f0de80f0d40 msgr2=0x7f0de80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:51.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.223+0000 7f0def078700 1 -- 172.21.15.84:0/47469931 shutdown_connections 2024-02-15T18:29:51.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.223+0000 7f0def078700 1 -- 172.21.15.84:0/47469931 wait complete. 2024-02-15T18:29:51.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0def078700 1 Processor -- start 2024-02-15T18:29:51.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0def078700 1 -- start start 2024-02-15T18:29:51.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0def078700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80602b0 0x7f0de81091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0def078700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de80fbbf0 0x7f0de81096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0def078700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8109c70 con 0x7f0de80602b0 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0def078700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8109db0 con 0x7f0de80fbbf0 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0dece14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80602b0 0x7f0de81091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0dece14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80602b0 0x7f0de81091d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34604/0 (socket says 172.21.15.84:34604) 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0dece14700 1 -- 172.21.15.84:0/4239560211 learned_addr learned my addr 172.21.15.84:0/4239560211 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0de7fff700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de80fbbf0 0x7f0de81096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0dece14700 1 -- 172.21.15.84:0/4239560211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de80fbbf0 msgr2=0x7f0de81096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0dece14700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de80fbbf0 0x7f0de81096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.224+0000 7f0dece14700 1 -- 172.21.15.84:0/4239560211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4005040 con 0x7f0de80602b0 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.225+0000 7f0dece14700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80602b0 0x7f0de81091d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0ddc0026d0 tx=0x7f0ddc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.225+0000 7f0de57fa700 1 -- 172.21.15.84:0/4239560211 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ddc0079c0 con 0x7f0de80602b0 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.225+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de810a750 con 0x7f0de80602b0 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.225+0000 7f0de57fa700 1 -- 172.21.15.84:0/4239560211 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0ddc00f040 con 0x7f0de80602b0 2024-02-15T18:29:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.225+0000 7f0de57fa700 1 -- 172.21.15.84:0/4239560211 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ddc0149f0 con 0x7f0de80602b0 2024-02-15T18:29:51.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.225+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de810ad10 con 0x7f0de80602b0 2024-02-15T18:29:51.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.226+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de8045ad0 con 0x7f0de80602b0 2024-02-15T18:29:51.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.226+0000 7f0de57fa700 1 -- 172.21.15.84:0/4239560211 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f0ddc007b20 con 0x7f0de80602b0 2024-02-15T18:29:51.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.227+0000 7f0de57fa700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0dd8060f20 0x7f0dd80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:51.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.227+0000 7f0de57fa700 1 -- 172.21.15.84:0/4239560211 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0ddc07b810 con 0x7f0de80602b0 2024-02-15T18:29:51.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.227+0000 7f0de7fff700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0dd8060f20 0x7f0dd80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:51.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.227+0000 7f0de7fff700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0dd8060f20 0x7f0dd80633e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0dd4004630 tx=0x7f0dd4009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:51.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.231+0000 7f0de57fa700 1 -- 172.21.15.84:0/4239560211 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0ddc04f710 con 0x7f0de80602b0 2024-02-15T18:29:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.416+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0de810af60 con 0x7f0dd8060f20 2024-02-15T18:29:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.418+0000 7f0de57fa700 1 -- 172.21.15.84:0/4239560211 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0de810af60 con 0x7f0dd8060f20 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "8/21 daemons upgraded", 2024-02-15T18:29:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:29:51.414 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:29:51.414 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:29:51.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.419+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0dd8060f20 msgr2=0x7f0dd80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.419+0000 7f0def078700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0dd8060f20 0x7f0dd80633e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0dd4004630 tx=0x7f0dd4009b30).stop 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.419+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80602b0 msgr2=0x7f0de81091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.419+0000 7f0def078700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80602b0 0x7f0de81091d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0ddc0026d0 tx=0x7f0ddc009de0).stop 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.419+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 shutdown_connections 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.419+0000 7f0def078700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0dd8060f20 0x7f0dd80633e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.419+0000 7f0def078700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0de80602b0 0x7f0de81091d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.419+0000 7f0def078700 1 --2- 172.21.15.84:0/4239560211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de80fbbf0 0x7f0de81096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.419+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 >> 172.21.15.84:0/4239560211 conn(0x7f0de80f0d40 msgr2=0x7f0de80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.420+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 shutdown_connections 2024-02-15T18:29:51.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:29:51.420+0000 7f0def078700 1 -- 172.21.15.84:0/4239560211 wait complete. 2024-02-15T18:29:51.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:49.817297+0000 mgr.smithi084.hjmnez (mgr.14596) 156 : audit [DBG] from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:51.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:50.112044+0000 mgr.smithi084.hjmnez (mgr.14596) 157 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:51.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:50.424787+0000 mgr.smithi084.hjmnez (mgr.14596) 158 : audit [DBG] from='client.44169 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:51.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:50.788586+0000 mon.smithi084 (mon.0) 220 : audit [DBG] from='client.? 172.21.15.84:0/1463341954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:51.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:51.117318+0000 mon.smithi084 (mon.0) 221 : audit [DBG] from='client.? 172.21.15.84:0/2745172551' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:29:51.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:51 smithi084 bash[85886]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:29:51.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:51 smithi084 bash[85886]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T18:29:51.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:51 smithi084 bash[85886]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-02-15T18:29:51.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:51 smithi084 bash[85886]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-15T18:29:51.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:51 smithi084 bash[85886]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-02-15T18:29:51.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:51 smithi084 bash[85886]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T18:29:51.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:51 smithi084 bash[85886]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T18:29:51.509 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:51 smithi084 bash[85886]: --> ceph-volume lvm activate successful for osd ID: 2 2024-02-15T18:29:51.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:49.817297+0000 mgr.smithi084.hjmnez (mgr.14596) 156 : audit [DBG] from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:51.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:50.112044+0000 mgr.smithi084.hjmnez (mgr.14596) 157 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:51.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:50.424787+0000 mgr.smithi084.hjmnez (mgr.14596) 158 : audit [DBG] from='client.44169 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:51.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:50.788586+0000 mon.smithi084 (mon.0) 220 : audit [DBG] from='client.? 172.21.15.84:0/1463341954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:51.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:51.117318+0000 mon.smithi084 (mon.0) 221 : audit [DBG] from='client.? 172.21.15.84:0/2745172551' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:29:52.508 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-2[86222]: debug 2024-02-15T18:29:52.485+0000 7fa9eb682700 1 -- 172.21.15.84:0/3105294823 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5596bcd5a680 con 0x5596bcd21000 2024-02-15T18:29:52.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:50.723506+0000 mgr.smithi084.hjmnez (mgr.14596) 159 : cluster [DBG] pgmap v113: 65 pgs: 3 active+undersized+degraded, 5 stale+active+clean, 4 active+undersized, 53 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 13/345 objects degraded (3.768%) 2024-02-15T18:29:52.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:51.250059+0000 mon.smithi084 (mon.0) 222 : cluster [WRN] Health check failed: Degraded data redundancy: 13/345 objects degraded (3.768%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T18:29:52.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:51.419243+0000 mgr.smithi084.hjmnez (mgr.14596) 160 : audit [DBG] from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:52.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:51.903411+0000 mon.smithi084 (mon.0) 223 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:52.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:50.723506+0000 mgr.smithi084.hjmnez (mgr.14596) 159 : cluster [DBG] pgmap v113: 65 pgs: 3 active+undersized+degraded, 5 stale+active+clean, 4 active+undersized, 53 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 13/345 objects degraded (3.768%) 2024-02-15T18:29:52.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:51.250059+0000 mon.smithi084 (mon.0) 222 : cluster [WRN] Health check failed: Degraded data redundancy: 13/345 objects degraded (3.768%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T18:29:52.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:51.419243+0000 mgr.smithi084.hjmnez (mgr.14596) 160 : audit [DBG] from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:52.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:51.903411+0000 mon.smithi084 (mon.0) 223 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:53.001 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:52 smithi084 bash[86207]: 29a8be1b61c75103a2490d927d15548b41af8530d1e65b0e4b1446f390245508 2024-02-15T18:29:53.001 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:52 smithi084 systemd[1]: Started Ceph osd.2 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:29:53.258 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-2[86222]: debug 2024-02-15T18:29:53.005+0000 7fa9f3110380 -1 Falling back to public interface 2024-02-15T18:29:53.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:52.627143+0000 mon.smithi084 (mon.0) 224 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:53.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:52.627872+0000 mon.smithi084 (mon.0) 225 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:53.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:52.875871+0000 mon.smithi084 (mon.0) 226 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:54.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:52.627143+0000 mon.smithi084 (mon.0) 224 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:54.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:52.627872+0000 mon.smithi084 (mon.0) 225 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:54.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:52.875871+0000 mon.smithi084 (mon.0) 226 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:54.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:52.723994+0000 mgr.smithi084.hjmnez (mgr.14596) 161 : cluster [DBG] pgmap v114: 65 pgs: 11 active+undersized+degraded, 13 active+undersized, 41 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 40/345 objects degraded (11.594%) 2024-02-15T18:29:55.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:52.723994+0000 mgr.smithi084.hjmnez (mgr.14596) 161 : cluster [DBG] pgmap v114: 65 pgs: 11 active+undersized+degraded, 13 active+undersized, 41 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 40/345 objects degraded (11.594%) 2024-02-15T18:29:56.889 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:54.724428+0000 mgr.smithi084.hjmnez (mgr.14596) 162 : cluster [DBG] pgmap v115: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 42/345 objects degraded (12.174%) 2024-02-15T18:29:56.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:54.724428+0000 mgr.smithi084.hjmnez (mgr.14596) 162 : cluster [DBG] pgmap v115: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 42/345 objects degraded (12.174%) 2024-02-15T18:29:58.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:56.724912+0000 mgr.smithi084.hjmnez (mgr.14596) 163 : cluster [DBG] pgmap v116: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 42/345 objects degraded (12.174%) 2024-02-15T18:29:58.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.388530+0000 mon.smithi084 (mon.0) 227 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:58.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.389324+0000 mon.smithi084 (mon.0) 228 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:29:58.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.389965+0000 mon.smithi084 (mon.0) 229 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:29:58.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.393694+0000 mon.smithi084 (mon.0) 230 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:58.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.398326+0000 mon.smithi084 (mon.0) 231 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:58.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.400261+0000 mon.smithi084 (mon.0) 232 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:58.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.401338+0000 mon.smithi084 (mon.0) 233 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:58.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.402363+0000 mon.smithi084 (mon.0) 234 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:58.652 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.403419+0000 mon.smithi084 (mon.0) 235 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:29:58.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:56.724912+0000 mgr.smithi084.hjmnez (mgr.14596) 163 : cluster [DBG] pgmap v116: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 42/345 objects degraded (12.174%) 2024-02-15T18:29:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.388530+0000 mon.smithi084 (mon.0) 227 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.389324+0000 mon.smithi084 (mon.0) 228 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:29:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.389965+0000 mon.smithi084 (mon.0) 229 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:29:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.393694+0000 mon.smithi084 (mon.0) 230 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:29:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.398326+0000 mon.smithi084 (mon.0) 231 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.400261+0000 mon.smithi084 (mon.0) 232 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.401338+0000 mon.smithi084 (mon.0) 233 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.402363+0000 mon.smithi084 (mon.0) 234 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:58.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.403419+0000 mon.smithi084 (mon.0) 235 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:29:59.758 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-2[86222]: debug 2024-02-15T18:29:59.429+0000 7fa9f3110380 -1 osd.2 58 log_to_monitors {default=true} 2024-02-15T18:29:59.758 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:29:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-2[86222]: debug 2024-02-15T18:29:59.653+0000 7fa9e2df4700 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:29:59.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:58.390491+0000 mgr.smithi084.hjmnez (mgr.14596) 164 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:29:59.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:58.403576+0000 mgr.smithi084.hjmnez (mgr.14596) 165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:29:59.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:29:58.404188+0000 mgr.smithi084.hjmnez (mgr.14596) 166 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T18:29:59.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:29:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:59.432457+0000 mon.smithi084 (mon.0) 236 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/3720028012,v1:172.21.15.84:6819/3720028012]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T18:29:59.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:58.390491+0000 mgr.smithi084.hjmnez (mgr.14596) 164 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:29:59.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:58.403576+0000 mgr.smithi084.hjmnez (mgr.14596) 165 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:29:59.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:29:58.404188+0000 mgr.smithi084.hjmnez (mgr.14596) 166 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T18:29:59.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:29:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:59.432457+0000 mon.smithi084 (mon.0) 236 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/3720028012,v1:172.21.15.84:6819/3720028012]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T18:30:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:58.725364+0000 mgr.smithi084.hjmnez (mgr.14596) 167 : cluster [DBG] pgmap v117: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 42/345 objects degraded (12.174%) 2024-02-15T18:30:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:59.648469+0000 mon.smithi084 (mon.0) 237 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/3720028012,v1:172.21.15.84:6819/3720028012]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T18:30:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:29:59.648536+0000 mon.smithi084 (mon.0) 238 : cluster [DBG] osdmap e61: 6 total, 5 up, 6 in 2024-02-15T18:30:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:29:59.649128+0000 mon.smithi084 (mon.0) 239 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/3720028012,v1:172.21.15.84:6819/3720028012]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:30:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000172+0000 mon.smithi084 (mon.0) 240 : cluster [WRN] Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 42/345 objects degraded (12.174%), 12 pgs degraded 2024-02-15T18:30:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000218+0000 mon.smithi084 (mon.0) 241 : cluster [WRN] [WRN] OSD_DOWN: 1 osds down 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000242+0000 mon.smithi084 (mon.0) 242 : cluster [WRN] osd.2 (root=default,host=smithi084) is down 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000265+0000 mon.smithi084 (mon.0) 243 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 42/345 objects degraded (12.174%), 12 pgs degraded 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000286+0000 mon.smithi084 (mon.0) 244 : cluster [WRN] pg 2.1 is active+undersized+degraded, acting [1,0] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000314+0000 mon.smithi084 (mon.0) 245 : cluster [WRN] pg 2.3 is active+undersized+degraded, acting [5,1] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000322+0000 mon.smithi084 (mon.0) 246 : cluster [WRN] pg 2.7 is active+undersized+degraded, acting [3,4] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000329+0000 mon.smithi084 (mon.0) 247 : cluster [WRN] pg 2.d is active+undersized+degraded, acting [1,3] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000338+0000 mon.smithi084 (mon.0) 248 : cluster [WRN] pg 2.e is active+undersized+degraded, acting [0,3] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000346+0000 mon.smithi084 (mon.0) 249 : cluster [WRN] pg 2.10 is active+undersized+degraded, acting [1,0] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000355+0000 mon.smithi084 (mon.0) 250 : cluster [WRN] pg 2.13 is active+undersized+degraded, acting [0,4] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000363+0000 mon.smithi084 (mon.0) 251 : cluster [WRN] pg 2.16 is active+undersized+degraded, acting [5,3] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000373+0000 mon.smithi084 (mon.0) 252 : cluster [WRN] pg 2.17 is active+undersized+degraded, acting [5,1] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000381+0000 mon.smithi084 (mon.0) 253 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [0,4] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000390+0000 mon.smithi084 (mon.0) 254 : cluster [WRN] pg 2.1c is active+undersized+degraded, acting [4,5] 2024-02-15T18:30:01.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.000398+0000 mon.smithi084 (mon.0) 255 : cluster [WRN] pg 2.1e is active+undersized+degraded, acting [0,5] 2024-02-15T18:30:01.010 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.059664+0000 mon.smithi084 (mon.0) 256 : cluster [WRN] Health check update: Degraded data redundancy: 42/345 objects degraded (12.174%), 12 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:58.725364+0000 mgr.smithi084.hjmnez (mgr.14596) 167 : cluster [DBG] pgmap v117: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 294 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 42/345 objects degraded (12.174%) 2024-02-15T18:30:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:59.648469+0000 mon.smithi084 (mon.0) 237 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/3720028012,v1:172.21.15.84:6819/3720028012]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T18:30:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:29:59.648536+0000 mon.smithi084 (mon.0) 238 : cluster [DBG] osdmap e61: 6 total, 5 up, 6 in 2024-02-15T18:30:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:29:59.649128+0000 mon.smithi084 (mon.0) 239 : audit [INF] from='osd.2 [v2:172.21.15.84:6818/3720028012,v1:172.21.15.84:6819/3720028012]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-02-15T18:30:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000172+0000 mon.smithi084 (mon.0) 240 : cluster [WRN] Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 42/345 objects degraded (12.174%), 12 pgs degraded 2024-02-15T18:30:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000218+0000 mon.smithi084 (mon.0) 241 : cluster [WRN] [WRN] OSD_DOWN: 1 osds down 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000242+0000 mon.smithi084 (mon.0) 242 : cluster [WRN] osd.2 (root=default,host=smithi084) is down 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000265+0000 mon.smithi084 (mon.0) 243 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 42/345 objects degraded (12.174%), 12 pgs degraded 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000286+0000 mon.smithi084 (mon.0) 244 : cluster [WRN] pg 2.1 is active+undersized+degraded, acting [1,0] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000314+0000 mon.smithi084 (mon.0) 245 : cluster [WRN] pg 2.3 is active+undersized+degraded, acting [5,1] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000322+0000 mon.smithi084 (mon.0) 246 : cluster [WRN] pg 2.7 is active+undersized+degraded, acting [3,4] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000329+0000 mon.smithi084 (mon.0) 247 : cluster [WRN] pg 2.d is active+undersized+degraded, acting [1,3] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000338+0000 mon.smithi084 (mon.0) 248 : cluster [WRN] pg 2.e is active+undersized+degraded, acting [0,3] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000346+0000 mon.smithi084 (mon.0) 249 : cluster [WRN] pg 2.10 is active+undersized+degraded, acting [1,0] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000355+0000 mon.smithi084 (mon.0) 250 : cluster [WRN] pg 2.13 is active+undersized+degraded, acting [0,4] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000363+0000 mon.smithi084 (mon.0) 251 : cluster [WRN] pg 2.16 is active+undersized+degraded, acting [5,3] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000373+0000 mon.smithi084 (mon.0) 252 : cluster [WRN] pg 2.17 is active+undersized+degraded, acting [5,1] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000381+0000 mon.smithi084 (mon.0) 253 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [0,4] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000390+0000 mon.smithi084 (mon.0) 254 : cluster [WRN] pg 2.1c is active+undersized+degraded, acting [4,5] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.000398+0000 mon.smithi084 (mon.0) 255 : cluster [WRN] pg 2.1e is active+undersized+degraded, acting [0,5] 2024-02-15T18:30:01.141 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.059664+0000 mon.smithi084 (mon.0) 256 : cluster [WRN] Health check update: Degraded data redundancy: 42/345 objects degraded (12.174%), 12 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:02.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.646255+0000 mon.smithi084 (mon.0) 257 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:30:02.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.650737+0000 mon.smithi084 (mon.0) 258 : cluster [INF] osd.2 [v2:172.21.15.84:6818/3720028012,v1:172.21.15.84:6819/3720028012] boot 2024-02-15T18:30:02.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.650807+0000 mon.smithi084 (mon.0) 259 : cluster [DBG] osdmap e62: 6 total, 6 up, 6 in 2024-02-15T18:30:02.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:00.651631+0000 mon.smithi084 (mon.0) 260 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:30:02.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:01.652340+0000 mon.smithi084 (mon.0) 261 : cluster [DBG] osdmap e63: 6 total, 6 up, 6 in 2024-02-15T18:30:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.646255+0000 mon.smithi084 (mon.0) 257 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:30:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.650737+0000 mon.smithi084 (mon.0) 258 : cluster [INF] osd.2 [v2:172.21.15.84:6818/3720028012,v1:172.21.15.84:6819/3720028012] boot 2024-02-15T18:30:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.650807+0000 mon.smithi084 (mon.0) 259 : cluster [DBG] osdmap e62: 6 total, 6 up, 6 in 2024-02-15T18:30:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:00.651631+0000 mon.smithi084 (mon.0) 260 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:30:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:01.652340+0000 mon.smithi084 (mon.0) 261 : cluster [DBG] osdmap e63: 6 total, 6 up, 6 in 2024-02-15T18:30:03.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:00.725774+0000 mgr.smithi084.hjmnez (mgr.14596) 168 : cluster [DBG] pgmap v120: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 42/345 objects degraded (12.174%) 2024-02-15T18:30:03.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:01.982860+0000 mon.smithi084 (mon.0) 262 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:03.058 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:00.725774+0000 mgr.smithi084.hjmnez (mgr.14596) 168 : cluster [DBG] pgmap v120: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 42/345 objects degraded (12.174%) 2024-02-15T18:30:03.058 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:01.982860+0000 mon.smithi084 (mon.0) 262 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:05.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:02.726281+0000 mgr.smithi084.hjmnez (mgr.14596) 169 : cluster [DBG] pgmap v122: 65 pgs: 5 peering, 6 active+undersized+degraded, 9 active+undersized, 45 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 20/345 objects degraded (5.797%) 2024-02-15T18:30:05.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:02.726281+0000 mgr.smithi084.hjmnez (mgr.14596) 169 : cluster [DBG] pgmap v122: 65 pgs: 5 peering, 6 active+undersized+degraded, 9 active+undersized, 45 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 20/345 objects degraded (5.797%) 2024-02-15T18:30:06.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:05.060635+0000 mon.smithi084 (mon.0) 263 : cluster [WRN] Health check update: Degraded data redundancy: 20/345 objects degraded (5.797%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:06.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:05.060635+0000 mon.smithi084 (mon.0) 263 : cluster [WRN] Health check update: Degraded data redundancy: 20/345 objects degraded (5.797%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:07.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:04.726795+0000 mgr.smithi084.hjmnez (mgr.14596) 170 : cluster [DBG] pgmap v123: 65 pgs: 5 peering, 60 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 0 op/s 2024-02-15T18:30:07.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:05.672263+0000 mon.smithi084 (mon.0) 264 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/345 objects degraded (5.797%), 6 pgs degraded) 2024-02-15T18:30:07.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:05.672296+0000 mon.smithi084 (mon.0) 265 : cluster [INF] Cluster is now healthy 2024-02-15T18:30:07.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:04.726795+0000 mgr.smithi084.hjmnez (mgr.14596) 170 : cluster [DBG] pgmap v123: 65 pgs: 5 peering, 60 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 0 op/s 2024-02-15T18:30:07.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:05.672263+0000 mon.smithi084 (mon.0) 264 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/345 objects degraded (5.797%), 6 pgs degraded) 2024-02-15T18:30:07.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:05.672296+0000 mon.smithi084 (mon.0) 265 : cluster [INF] Cluster is now healthy 2024-02-15T18:30:08.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:06.727302+0000 mgr.smithi084.hjmnez (mgr.14596) 171 : cluster [DBG] pgmap v124: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 144 B/s rd, 0 op/s 2024-02-15T18:30:08.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:06.906041+0000 mon.smithi084 (mon.0) 266 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:08.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:06.727302+0000 mgr.smithi084.hjmnez (mgr.14596) 171 : cluster [DBG] pgmap v124: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 144 B/s rd, 0 op/s 2024-02-15T18:30:08.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:06.906041+0000 mon.smithi084 (mon.0) 266 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:10.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:08.728032+0000 mgr.smithi084.hjmnez (mgr.14596) 172 : cluster [DBG] pgmap v125: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 126 B/s rd, 0 op/s 2024-02-15T18:30:10.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:08.728032+0000 mgr.smithi084.hjmnez (mgr.14596) 172 : cluster [DBG] pgmap v125: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 126 B/s rd, 0 op/s 2024-02-15T18:30:12.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:10.728514+0000 mgr.smithi084.hjmnez (mgr.14596) 173 : cluster [DBG] pgmap v126: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-15T18:30:12.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:11.991817+0000 mon.smithi084 (mon.0) 267 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:12.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:10.728514+0000 mgr.smithi084.hjmnez (mgr.14596) 173 : cluster [DBG] pgmap v126: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-15T18:30:12.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:11.991817+0000 mon.smithi084 (mon.0) 267 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:14.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:12.729183+0000 mgr.smithi084.hjmnez (mgr.14596) 174 : cluster [DBG] pgmap v127: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 92 B/s rd, 0 op/s 2024-02-15T18:30:14.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:13.412723+0000 mon.smithi084 (mon.0) 268 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:30:14.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:13.412927+0000 mgr.smithi084.hjmnez (mgr.14596) 175 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:30:14.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:13.413993+0000 mgr.smithi084.hjmnez (mgr.14596) 176 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-15T18:30:14.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:12.729183+0000 mgr.smithi084.hjmnez (mgr.14596) 174 : cluster [DBG] pgmap v127: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 92 B/s rd, 0 op/s 2024-02-15T18:30:14.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:13.412723+0000 mon.smithi084 (mon.0) 268 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:30:14.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:13.412927+0000 mgr.smithi084.hjmnez (mgr.14596) 175 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:30:14.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:13.413993+0000 mgr.smithi084.hjmnez (mgr.14596) 176 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-15T18:30:16.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:14.729637+0000 mgr.smithi084.hjmnez (mgr.14596) 177 : cluster [DBG] pgmap v128: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 0 op/s 2024-02-15T18:30:16.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:14.925939+0000 mgr.smithi084.hjmnez (mgr.14596) 178 : cephadm [INF] Upgrade: Updating osd.3 2024-02-15T18:30:16.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:14.931172+0000 mon.smithi084 (mon.0) 269 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:16.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:14.931997+0000 mon.smithi084 (mon.0) 270 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T18:30:16.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:14.932639+0000 mon.smithi084 (mon.0) 271 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:16.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:14.933760+0000 mgr.smithi084.hjmnez (mgr.14596) 179 : cephadm [INF] Deploying daemon osd.3 on smithi133 2024-02-15T18:30:16.279 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:14.729637+0000 mgr.smithi084.hjmnez (mgr.14596) 177 : cluster [DBG] pgmap v128: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 0 op/s 2024-02-15T18:30:16.279 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:14.925939+0000 mgr.smithi084.hjmnez (mgr.14596) 178 : cephadm [INF] Upgrade: Updating osd.3 2024-02-15T18:30:16.279 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:14.931172+0000 mon.smithi084 (mon.0) 269 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:16.279 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:14.931997+0000 mon.smithi084 (mon.0) 270 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T18:30:16.279 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:14.932639+0000 mon.smithi084 (mon.0) 271 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:16.279 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:14.933760+0000 mgr.smithi084.hjmnez (mgr.14596) 179 : cephadm [INF] Deploying daemon osd.3 on smithi133 2024-02-15T18:30:17.890 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:17 smithi133 systemd[1]: Stopping Ceph osd.3 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:30:18.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:16.730167+0000 mgr.smithi084.hjmnez (mgr.14596) 180 : cluster [DBG] pgmap v129: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:18.259 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:16.730167+0000 mgr.smithi084.hjmnez (mgr.14596) 180 : cluster [DBG] pgmap v129: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:18.259 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.3[45076]: debug 2024-02-15T18:30:17.920+0000 7f63ab4b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:30:18.260 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.3[45076]: debug 2024-02-15T18:30:17.920+0000 7f63ab4b0700 -1 osd.3 63 *** Got signal Terminated *** 2024-02-15T18:30:18.260 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.3[45076]: debug 2024-02-15T18:30:17.920+0000 7f63ab4b0700 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:30:18.537 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:18 smithi133 bash[61440]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.3 2024-02-15T18:30:18.797 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:18 smithi133 bash[61492]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.3 2024-02-15T18:30:19.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.180245+0000 mon.smithi084 (mon.0) 272 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:30:19.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.180285+0000 mon.smithi084 (mon.0) 273 : cluster [INF] osd.3 failed (root=default,host=smithi133) (connection refused reported by osd.2) 2024-02-15T18:30:19.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.180533+0000 mon.smithi084 (mon.0) 274 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:30:19.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.180681+0000 mon.smithi084 (mon.0) 275 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:30:19.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.180840+0000 mon.smithi084 (mon.0) 276 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.180974+0000 mon.smithi084 (mon.0) 277 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.181123+0000 mon.smithi084 (mon.0) 278 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.181251+0000 mon.smithi084 (mon.0) 279 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.181406+0000 mon.smithi084 (mon.0) 280 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.181551+0000 mon.smithi084 (mon.0) 281 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.181698+0000 mon.smithi084 (mon.0) 282 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.581144+0000 mon.smithi084 (mon.0) 283 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.581250+0000 mon.smithi084 (mon.0) 284 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.581369+0000 mon.smithi084 (mon.0) 285 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.581478+0000 mon.smithi084 (mon.0) 286 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.581623+0000 mon.smithi084 (mon.0) 287 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.581713+0000 mon.smithi084 (mon.0) 288 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.581817+0000 mon.smithi084 (mon.0) 289 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:30:19.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.581904+0000 mon.smithi084 (mon.0) 290 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:30:19.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.582008+0000 mon.smithi084 (mon.0) 291 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:30:19.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.582090+0000 mon.smithi084 (mon.0) 292 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:30:19.276 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.180245+0000 mon.smithi084 (mon.0) 272 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:30:19.276 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.180285+0000 mon.smithi084 (mon.0) 273 : cluster [INF] osd.3 failed (root=default,host=smithi133) (connection refused reported by osd.2) 2024-02-15T18:30:19.276 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.180533+0000 mon.smithi084 (mon.0) 274 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.180681+0000 mon.smithi084 (mon.0) 275 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.180840+0000 mon.smithi084 (mon.0) 276 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.180974+0000 mon.smithi084 (mon.0) 277 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.181123+0000 mon.smithi084 (mon.0) 278 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.181251+0000 mon.smithi084 (mon.0) 279 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.181406+0000 mon.smithi084 (mon.0) 280 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.181551+0000 mon.smithi084 (mon.0) 281 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.181698+0000 mon.smithi084 (mon.0) 282 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.581144+0000 mon.smithi084 (mon.0) 283 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.581250+0000 mon.smithi084 (mon.0) 284 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.581369+0000 mon.smithi084 (mon.0) 285 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.581478+0000 mon.smithi084 (mon.0) 286 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.581623+0000 mon.smithi084 (mon.0) 287 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.581713+0000 mon.smithi084 (mon.0) 288 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:30:19.277 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.581817+0000 mon.smithi084 (mon.0) 289 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:30:19.278 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.581904+0000 mon.smithi084 (mon.0) 290 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:30:19.278 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.582008+0000 mon.smithi084 (mon.0) 291 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:30:19.278 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.582090+0000 mon.smithi084 (mon.0) 292 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:30:20.108 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.730728+0000 mgr.smithi084.hjmnez (mgr.14596) 181 : cluster [DBG] pgmap v130: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:20.108 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.933937+0000 mon.smithi084 (mon.0) 293 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:30:20.108 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:18.945912+0000 mon.smithi084 (mon.0) 294 : cluster [DBG] osdmap e64: 6 total, 5 up, 6 in 2024-02-15T18:30:20.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.730728+0000 mgr.smithi084.hjmnez (mgr.14596) 181 : cluster [DBG] pgmap v130: 65 pgs: 65 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:20.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.933937+0000 mon.smithi084 (mon.0) 293 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:30:20.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:18.945912+0000 mon.smithi084 (mon.0) 294 : cluster [DBG] osdmap e64: 6 total, 5 up, 6 in 2024-02-15T18:30:20.890 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:20 smithi133 systemd[1]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.3.service: Succeeded. 2024-02-15T18:30:20.891 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:20 smithi133 systemd[1]: Stopped Ceph osd.3 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:30:20.891 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:20 smithi133 systemd[1]: Starting Ceph osd.3 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:30:21.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:19.946027+0000 mon.smithi084 (mon.0) 295 : cluster [DBG] osdmap e65: 6 total, 5 up, 6 in 2024-02-15T18:30:21.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:19.946027+0000 mon.smithi084 (mon.0) 295 : cluster [DBG] osdmap e65: 6 total, 5 up, 6 in 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.533+0000 7f4a5a35a700 1 -- 172.21.15.84:0/1112579116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a540f55c0 msgr2=0x7f4a540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.533+0000 7f4a5a35a700 1 --2- 172.21.15.84:0/1112579116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a540f55c0 0x7f4a540f59e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f4a3c004660 tx=0x7f4a3c009b30).stop 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.533+0000 7f4a5a35a700 1 -- 172.21.15.84:0/1112579116 shutdown_connections 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.533+0000 7f4a5a35a700 1 --2- 172.21.15.84:0/1112579116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a540f6860 0x7f4a540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.533+0000 7f4a5a35a700 1 --2- 172.21.15.84:0/1112579116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a540f55c0 0x7f4a540f59e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.533+0000 7f4a5a35a700 1 -- 172.21.15.84:0/1112579116 >> 172.21.15.84:0/1112579116 conn(0x7f4a540f0d40 msgr2=0x7f4a540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.533+0000 7f4a5a35a700 1 -- 172.21.15.84:0/1112579116 shutdown_connections 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.533+0000 7f4a5a35a700 1 -- 172.21.15.84:0/1112579116 wait complete. 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a5a35a700 1 Processor -- start 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a5a35a700 1 -- start start 2024-02-15T18:30:21.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a5a35a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a540f6860 0x7f4a54106090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a5a35a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a54106580 0x7f4a54107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a5a35a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54106a50 con 0x7f4a54106580 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a5a35a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54106b90 con 0x7f4a540f6860 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a537fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a54106580 0x7f4a54107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a537fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a54106580 0x7f4a54107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40208/0 (socket says 172.21.15.84:40208) 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a537fe700 1 -- 172.21.15.84:0/2760051559 learned_addr learned my addr 172.21.15.84:0/2760051559 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a53fff700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a540f6860 0x7f4a54106090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.534+0000 7f4a537fe700 1 -- 172.21.15.84:0/2760051559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a540f6860 msgr2=0x7f4a54106090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.535+0000 7f4a537fe700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a540f6860 0x7f4a54106090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.535+0000 7f4a537fe700 1 -- 172.21.15.84:0/2760051559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c005040 con 0x7f4a54106580 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.535+0000 7f4a537fe700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a54106580 0x7f4a54107470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4a4400e7f0 tx=0x7f4a4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.535+0000 7f4a50ff9700 1 -- 172.21.15.84:0/2760051559 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a440092e0 con 0x7f4a54106580 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.535+0000 7f4a50ff9700 1 -- 172.21.15.84:0/2760051559 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f4a4400f040 con 0x7f4a54106580 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.535+0000 7f4a50ff9700 1 -- 172.21.15.84:0/2760051559 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a44014850 con 0x7f4a54106580 2024-02-15T18:30:21.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.535+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a54107a20 con 0x7f4a54106580 2024-02-15T18:30:21.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.535+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a54107fe0 con 0x7f4a54106580 2024-02-15T18:30:21.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.536+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a540f49b0 con 0x7f4a54106580 2024-02-15T18:30:21.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.536+0000 7f4a50ff9700 1 -- 172.21.15.84:0/2760051559 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f4a4401b030 con 0x7f4a54106580 2024-02-15T18:30:21.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.537+0000 7f4a50ff9700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a40060f20 0x7f4a400633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:21.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.537+0000 7f4a50ff9700 1 -- 172.21.15.84:0/2760051559 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4a4407be90 con 0x7f4a54106580 2024-02-15T18:30:21.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.537+0000 7f4a53fff700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a40060f20 0x7f4a400633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:21.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.537+0000 7f4a53fff700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a40060f20 0x7f4a400633e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4a3c004630 tx=0x7f4a3c009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:21.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.541+0000 7f4a50ff9700 1 -- 172.21.15.84:0/2760051559 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4a4404fdf0 con 0x7f4a54106580 2024-02-15T18:30:21.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.722+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a540fde90 con 0x7f4a40060f20 2024-02-15T18:30:21.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.724+0000 7f4a50ff9700 1 -- 172.21.15.84:0/2760051559 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4a540fde90 con 0x7f4a40060f20 2024-02-15T18:30:21.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.725+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a40060f20 msgr2=0x7f4a400633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:21.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.725+0000 7f4a5a35a700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a40060f20 0x7f4a400633e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4a3c004630 tx=0x7f4a3c009b30).stop 2024-02-15T18:30:21.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.725+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a54106580 msgr2=0x7f4a54107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:21.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.725+0000 7f4a5a35a700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a54106580 0x7f4a54107470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4a4400e7f0 tx=0x7f4a4400b040).stop 2024-02-15T18:30:21.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.725+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 shutdown_connections 2024-02-15T18:30:21.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.725+0000 7f4a5a35a700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4a40060f20 0x7f4a400633e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:21.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.725+0000 7f4a5a35a700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a540f6860 0x7f4a54106090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:21.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.725+0000 7f4a5a35a700 1 --2- 172.21.15.84:0/2760051559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a54106580 0x7f4a54107470 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:21.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.725+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 >> 172.21.15.84:0/2760051559 conn(0x7f4a540f0d40 msgr2=0x7f4a540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:21.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.726+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 shutdown_connections 2024-02-15T18:30:21.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.726+0000 7f4a5a35a700 1 -- 172.21.15.84:0/2760051559 wait complete. 2024-02-15T18:30:21.729 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:30:21.798 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:21 smithi133 bash[61755]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:30:21.798 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:21 smithi133 bash[61755]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T18:30:21.798 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:21 smithi133 bash[61755]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-02-15T18:30:21.798 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:21 smithi133 bash[61755]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-15T18:30:21.798 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:21 smithi133 bash[61755]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-02-15T18:30:21.798 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:21 smithi133 bash[61755]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T18:30:21.798 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:21 smithi133 bash[61755]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T18:30:21.798 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:21 smithi133 bash[61755]: --> ceph-volume lvm activate successful for osd ID: 3 2024-02-15T18:30:21.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/1383173522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f7980 msgr2=0x7fb6b40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 --2- 172.21.15.84:0/1383173522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f7980 0x7fb6b40f7de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb6a0004660 tx=0x7fb6a0009b30).stop 2024-02-15T18:30:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/1383173522 shutdown_connections 2024-02-15T18:30:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 --2- 172.21.15.84:0/1383173522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f7980 0x7fb6b40f7de0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 --2- 172.21.15.84:0/1383173522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6b40f66e0 0x7fb6b40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/1383173522 >> 172.21.15.84:0/1383173522 conn(0x7fb6b40f1e40 msgr2=0x7fb6b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/1383173522 shutdown_connections 2024-02-15T18:30:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/1383173522 wait complete. 2024-02-15T18:30:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 Processor -- start 2024-02-15T18:30:21.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.824+0000 7fb6bb1bb700 1 -- start start 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6bb1bb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f66e0 0x7fb6b406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6bb1bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6b40f7980 0x7fb6b4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6bb1bb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b406a380 con 0x7fb6b40f66e0 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6bb1bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b406a4c0 con 0x7fb6b40f7980 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b8f57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f66e0 0x7fb6b406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b8f57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f66e0 0x7fb6b406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40216/0 (socket says 172.21.15.84:40216) 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b8f57700 1 -- 172.21.15.84:0/2106674686 learned_addr learned my addr 172.21.15.84:0/2106674686 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b3fff700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6b40f7980 0x7fb6b4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b8f57700 1 -- 172.21.15.84:0/2106674686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6b40f7980 msgr2=0x7fb6b4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b8f57700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6b40f7980 0x7fb6b4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b8f57700 1 -- 172.21.15.84:0/2106674686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a0005040 con 0x7fb6b40f66e0 2024-02-15T18:30:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b3fff700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6b40f7980 0x7fb6b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:30:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b8f57700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f66e0 0x7fb6b406b9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fb6a8002700 tx=0x7fb6a8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b17fa700 1 -- 172.21.15.84:0/2106674686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6a8009320 con 0x7fb6b40f66e0 2024-02-15T18:30:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b406a7a0 con 0x7fb6b40f66e0 2024-02-15T18:30:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b17fa700 1 -- 172.21.15.84:0/2106674686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fb6a800f040 con 0x7fb6b40f66e0 2024-02-15T18:30:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.825+0000 7fb6b17fa700 1 -- 172.21.15.84:0/2106674686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6a80149d0 con 0x7fb6b40f66e0 2024-02-15T18:30:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.826+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b410f030 con 0x7fb6b40f66e0 2024-02-15T18:30:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.826+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b4045ad0 con 0x7fb6b40f66e0 2024-02-15T18:30:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.827+0000 7fb6b17fa700 1 -- 172.21.15.84:0/2106674686 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fb6a80077b0 con 0x7fb6b40f66e0 2024-02-15T18:30:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.827+0000 7fb6b17fa700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb6a4060f20 0x7fb6a40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.827+0000 7fb6b17fa700 1 -- 172.21.15.84:0/2106674686 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb6a807c370 con 0x7fb6b40f66e0 2024-02-15T18:30:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.827+0000 7fb6b3fff700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb6a4060f20 0x7fb6a40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.828+0000 7fb6b3fff700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb6a4060f20 0x7fb6a40633e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb6a0005010 tx=0x7fb6a0009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:21.831+0000 7fb6b17fa700 1 -- 172.21.15.84:0/2106674686 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb6a804c7f0 con 0x7fb6b40f66e0 2024-02-15T18:30:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.013+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6b40ff130 con 0x7fb6a4060f20 2024-02-15T18:30:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.014+0000 7fb6b17fa700 1 -- 172.21.15.84:0/2106674686 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb6b40ff130 con 0x7fb6a4060f20 2024-02-15T18:30:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.016+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb6a4060f20 msgr2=0x7fb6a40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.016+0000 7fb6bb1bb700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb6a4060f20 0x7fb6a40633e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb6a0005010 tx=0x7fb6a0009b30).stop 2024-02-15T18:30:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.016+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f66e0 msgr2=0x7fb6b406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.016+0000 7fb6bb1bb700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f66e0 0x7fb6b406b9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fb6a8002700 tx=0x7fb6a8009d80).stop 2024-02-15T18:30:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.017+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 shutdown_connections 2024-02-15T18:30:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.017+0000 7fb6bb1bb700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb6a4060f20 0x7fb6a40633e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.017+0000 7fb6bb1bb700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b40f66e0 0x7fb6b406b9a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.017+0000 7fb6bb1bb700 1 --2- 172.21.15.84:0/2106674686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6b40f7980 0x7fb6b4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.017+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 >> 172.21.15.84:0/2106674686 conn(0x7fb6b40f1e40 msgr2=0x7fb6b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.017+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 shutdown_connections 2024-02-15T18:30:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.017+0000 7fb6bb1bb700 1 -- 172.21.15.84:0/2106674686 wait complete. 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.114+0000 7fc12af9f700 1 -- 172.21.15.84:0/2941089112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 msgr2=0x7fc1240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.114+0000 7fc12af9f700 1 --2- 172.21.15.84:0/2941089112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 0x7fc1240f6cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc110004660 tx=0x7fc110009b30).stop 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.114+0000 7fc12af9f700 1 -- 172.21.15.84:0/2941089112 shutdown_connections 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.114+0000 7fc12af9f700 1 --2- 172.21.15.84:0/2941089112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 0x7fc1240f6cc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.114+0000 7fc12af9f700 1 --2- 172.21.15.84:0/2941089112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1240f55c0 0x7fc1240f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.114+0000 7fc12af9f700 1 -- 172.21.15.84:0/2941089112 >> 172.21.15.84:0/2941089112 conn(0x7fc1240f0d40 msgr2=0x7fc1240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.114+0000 7fc12af9f700 1 -- 172.21.15.84:0/2941089112 shutdown_connections 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.114+0000 7fc12af9f700 1 -- 172.21.15.84:0/2941089112 wait complete. 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.114+0000 7fc12af9f700 1 Processor -- start 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc12af9f700 1 -- start start 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc12af9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1240f55c0 0x7fc124106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc12af9f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 0x7fc1241074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc12af9f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc124107a60 con 0x7fc1240f6860 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc12af9f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc124107ba0 con 0x7fc1240f55c0 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc123fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 0x7fc1241074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc123fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 0x7fc1241074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40242/0 (socket says 172.21.15.84:40242) 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc123fff700 1 -- 172.21.15.84:0/117344689 learned_addr learned my addr 172.21.15.84:0/117344689 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc128d3b700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1240f55c0 0x7fc124106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc123fff700 1 -- 172.21.15.84:0/117344689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1240f55c0 msgr2=0x7fc124106fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc123fff700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1240f55c0 0x7fc124106fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc123fff700 1 -- 172.21.15.84:0/117344689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc110005040 con 0x7fc1240f6860 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.115+0000 7fc123fff700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 0x7fc1241074b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc110000c00 tx=0x7fc11000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.116+0000 7fc1217fa700 1 -- 172.21.15.84:0/117344689 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc110019070 con 0x7fc1240f6860 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.116+0000 7fc1217fa700 1 -- 172.21.15.84:0/117344689 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fc110007e80 con 0x7fc1240f6860 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.116+0000 7fc1217fa700 1 -- 172.21.15.84:0/117344689 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc110014db0 con 0x7fc1240f6860 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.116+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1241084e0 con 0x7fc1240f6860 2024-02-15T18:30:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.116+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc124108a40 con 0x7fc1240f6860 2024-02-15T18:30:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.117+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc124045ad0 con 0x7fc1240f6860 2024-02-15T18:30:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.117+0000 7fc1217fa700 1 -- 172.21.15.84:0/117344689 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fc110025070 con 0x7fc1240f6860 2024-02-15T18:30:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.117+0000 7fc1217fa700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fc114060ec0 0x7fc114063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.117+0000 7fc1217fa700 1 -- 172.21.15.84:0/117344689 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc11007cff0 con 0x7fc1240f6860 2024-02-15T18:30:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.117+0000 7fc128d3b700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fc114060ec0 0x7fc114063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.118+0000 7fc128d3b700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fc114060ec0 0x7fc114063380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc118009fd0 tx=0x7fc11800b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.121+0000 7fc1217fa700 1 -- 172.21.15.84:0/117344689 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc110050ea0 con 0x7fc1240f6860 2024-02-15T18:30:22.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:20.731189+0000 mgr.smithi084.hjmnez (mgr.14596) 182 : cluster [DBG] pgmap v133: 65 pgs: 13 peering, 13 stale+active+clean, 39 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:22.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:21.065461+0000 mon.smithi084 (mon.0) 296 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-15T18:30:22.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:21.904402+0000 mon.smithi084 (mon.0) 297 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:22.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:20.731189+0000 mgr.smithi084.hjmnez (mgr.14596) 182 : cluster [DBG] pgmap v133: 65 pgs: 13 peering, 13 stale+active+clean, 39 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:22.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:21.065461+0000 mon.smithi084 (mon.0) 296 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-15T18:30:22.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:21.904402+0000 mon.smithi084 (mon.0) 297 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:22.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.293+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1240faca0 con 0x7fc114060ec0 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.302+0000 7fc1217fa700 1 -- 172.21.15.84:0/117344689 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc1240faca0 con 0x7fc114060ec0 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (9m) 23s ago 11m 18.0M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (2m) 23s ago 11m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (2m) 118s ago 10m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (9m) 23s ago 11m 35.6M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (6m) 23s ago 6m 121M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (6m) 23s ago 6m 14.1M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (6m) 118s ago 6m 137M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:30:22.296 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (6m) 118s ago 6m 14.3M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (3m) 23s ago 12m 433M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (3m) 118s ago 10m 388M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (2m) 23s ago 12m 46.1M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (2m) 118s ago 10m 24.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (10m) 23s ago 10m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (10m) 118s ago 10m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (100s) 23s ago 9m 207M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (61s) 23s ago 9m 236M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (30s) 23s ago 8m 12.8M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (8m) 118s ago 8m 442M 4096M 16.2.4 8d91d370c2b8 69048e5abdfc 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (8m) 118s ago 8m 440M 4096M 16.2.4 8d91d370c2b8 8e223941aff1 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (7m) 118s ago 7m 391M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:30:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (3m) 23s ago 10m 67.9M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:30:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fc114060ec0 msgr2=0x7fc114063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fc114060ec0 0x7fc114063380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc118009fd0 tx=0x7fc11800b040).stop 2024-02-15T18:30:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 msgr2=0x7fc1241074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 0x7fc1241074b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc110000c00 tx=0x7fc11000b040).stop 2024-02-15T18:30:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 shutdown_connections 2024-02-15T18:30:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fc114060ec0 0x7fc114063380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1240f55c0 0x7fc124106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 --2- 172.21.15.84:0/117344689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1240f6860 0x7fc1241074b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 >> 172.21.15.84:0/117344689 conn(0x7fc1240f0d40 msgr2=0x7fc12405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 shutdown_connections 2024-02-15T18:30:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.304+0000 7fc12af9f700 1 -- 172.21.15.84:0/117344689 wait complete. 2024-02-15T18:30:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.400+0000 7fb15a613700 1 -- 172.21.15.84:0/450663734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f5440 msgr2=0x7fb1540f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.400+0000 7fb15a613700 1 --2- 172.21.15.84:0/450663734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f5440 0x7fb1540f5860 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb150004660 tx=0x7fb150009b30).stop 2024-02-15T18:30:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.400+0000 7fb15a613700 1 -- 172.21.15.84:0/450663734 shutdown_connections 2024-02-15T18:30:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.400+0000 7fb15a613700 1 --2- 172.21.15.84:0/450663734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1540f66e0 0x7fb1540f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.400+0000 7fb15a613700 1 --2- 172.21.15.84:0/450663734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f5440 0x7fb1540f5860 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.400+0000 7fb15a613700 1 -- 172.21.15.84:0/450663734 >> 172.21.15.84:0/450663734 conn(0x7fb1540f0ba0 msgr2=0x7fb1540f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.400+0000 7fb15a613700 1 -- 172.21.15.84:0/450663734 shutdown_connections 2024-02-15T18:30:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.400+0000 7fb15a613700 1 -- 172.21.15.84:0/450663734 wait complete. 2024-02-15T18:30:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb15a613700 1 Processor -- start 2024-02-15T18:30:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb15a613700 1 -- start start 2024-02-15T18:30:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb15a613700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1540f5440 0x7fb154109b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb15a613700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f66e0 0x7fb15410c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb15a613700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540603c0 con 0x7fb1540f66e0 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb15a613700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb154060500 con 0x7fb1540f5440 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb158e10700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f66e0 0x7fb15410c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb158e10700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f66e0 0x7fb15410c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40268/0 (socket says 172.21.15.84:40268) 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb159611700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1540f5440 0x7fb154109b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb158e10700 1 -- 172.21.15.84:0/231536464 learned_addr learned my addr 172.21.15.84:0/231536464 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb158e10700 1 -- 172.21.15.84:0/231536464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1540f5440 msgr2=0x7fb154109b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb158e10700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1540f5440 0x7fb154109b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.401+0000 7fb158e10700 1 -- 172.21.15.84:0/231536464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150005040 con 0x7fb1540f66e0 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.402+0000 7fb158e10700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f66e0 0x7fb15410c010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb14400c790 tx=0x7fb144007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.402+0000 7fb149ffb700 1 -- 172.21.15.84:0/231536464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb144002590 con 0x7fb1540f66e0 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.402+0000 7fb149ffb700 1 -- 172.21.15.84:0/231536464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fb144002be0 con 0x7fb1540f66e0 2024-02-15T18:30:22.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.402+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15410c5c0 con 0x7fb1540f66e0 2024-02-15T18:30:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.402+0000 7fb149ffb700 1 -- 172.21.15.84:0/231536464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1440123b0 con 0x7fb1540f66e0 2024-02-15T18:30:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.402+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15410cb50 con 0x7fb1540f66e0 2024-02-15T18:30:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.403+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb154059100 con 0x7fb1540f66e0 2024-02-15T18:30:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.403+0000 7fb149ffb700 1 -- 172.21.15.84:0/231536464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fb14401a060 con 0x7fb1540f66e0 2024-02-15T18:30:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.403+0000 7fb149ffb700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb140060f70 0x7fb140063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:22.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.403+0000 7fb149ffb700 1 -- 172.21.15.84:0/231536464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb14407c380 con 0x7fb1540f66e0 2024-02-15T18:30:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.403+0000 7fb159611700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb140060f70 0x7fb140063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.404+0000 7fb159611700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb140060f70 0x7fb140063430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb154060040 tx=0x7fb150009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.408+0000 7fb149ffb700 1 -- 172.21.15.84:0/231536464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb144050230 con 0x7fb1540f66e0 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.641+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb1540fdea0 con 0x7fb1540f66e0 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.642+0000 7fb149ffb700 1 -- 172.21.15.84:0/231536464 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7fb1540fdea0 con 0x7fb1540f66e0 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:30:22.636 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3, 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 7, 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:30:22.637 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.643+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb140060f70 msgr2=0x7fb140063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.643+0000 7fb15a613700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb140060f70 0x7fb140063430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb154060040 tx=0x7fb150009b30).stop 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.643+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f66e0 msgr2=0x7fb15410c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.643+0000 7fb15a613700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f66e0 0x7fb15410c010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fb14400c790 tx=0x7fb144007d70).stop 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.644+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 shutdown_connections 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.644+0000 7fb15a613700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fb140060f70 0x7fb140063430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.644+0000 7fb15a613700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1540f5440 0x7fb154109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.644+0000 7fb15a613700 1 --2- 172.21.15.84:0/231536464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1540f66e0 0x7fb15410c010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.644+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 >> 172.21.15.84:0/231536464 conn(0x7fb1540f0ba0 msgr2=0x7fb1540fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.644+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 shutdown_connections 2024-02-15T18:30:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.644+0000 7fb15a613700 1 -- 172.21.15.84:0/231536464 wait complete. 2024-02-15T18:30:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.744+0000 7f63c653c700 1 -- 172.21.15.84:0/3952440710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 msgr2=0x7f63c00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.744+0000 7f63c653c700 1 --2- 172.21.15.84:0/3952440710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 0x7f63c00f6950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f63b4004660 tx=0x7f63b4009b30).stop 2024-02-15T18:30:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.744+0000 7f63c653c700 1 -- 172.21.15.84:0/3952440710 shutdown_connections 2024-02-15T18:30:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.744+0000 7f63c653c700 1 --2- 172.21.15.84:0/3952440710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00f77d0 0x7f63c00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.744+0000 7f63c653c700 1 --2- 172.21.15.84:0/3952440710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 0x7f63c00f6950 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.744+0000 7f63c653c700 1 -- 172.21.15.84:0/3952440710 >> 172.21.15.84:0/3952440710 conn(0x7f63c00f1c90 msgr2=0x7f63c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.744+0000 7f63c653c700 1 -- 172.21.15.84:0/3952440710 shutdown_connections 2024-02-15T18:30:22.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.744+0000 7f63c653c700 1 -- 172.21.15.84:0/3952440710 wait complete. 2024-02-15T18:30:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c653c700 1 Processor -- start 2024-02-15T18:30:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c653c700 1 -- start start 2024-02-15T18:30:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c653c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 0x7f63c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c653c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00f77d0 0x7f63c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c653c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c006a380 con 0x7f63c00f6530 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c653c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c006a4c0 con 0x7f63c00f77d0 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c553a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 0x7f63c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c553a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 0x7f63c006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40280/0 (socket says 172.21.15.84:40280) 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c553a700 1 -- 172.21.15.84:0/3918421813 learned_addr learned my addr 172.21.15.84:0/3918421813 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c4d39700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00f77d0 0x7f63c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c553a700 1 -- 172.21.15.84:0/3918421813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00f77d0 msgr2=0x7f63c0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c553a700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00f77d0 0x7f63c0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.745+0000 7f63c553a700 1 -- 172.21.15.84:0/3918421813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b4005040 con 0x7f63c00f6530 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.746+0000 7f63c553a700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 0x7f63c006b9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f63b4004e30 tx=0x7f63b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.746+0000 7f63b1ffb700 1 -- 172.21.15.84:0/3918421813 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b4018070 con 0x7f63c00f6530 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.746+0000 7f63b1ffb700 1 -- 172.21.15.84:0/3918421813 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f63b4007ba0 con 0x7f63c00f6530 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.746+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c006a740 con 0x7f63c00f6530 2024-02-15T18:30:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.746+0000 7f63b1ffb700 1 -- 172.21.15.84:0/3918421813 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b401c3c0 con 0x7f63c00f6530 2024-02-15T18:30:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.746+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c006aca0 con 0x7f63c00f6530 2024-02-15T18:30:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.747+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c0045ad0 con 0x7f63c00f6530 2024-02-15T18:30:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.747+0000 7f63b1ffb700 1 -- 172.21.15.84:0/3918421813 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f63b401d420 con 0x7f63c00f6530 2024-02-15T18:30:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.748+0000 7f63b1ffb700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f63ac060f70 0x7f63ac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.748+0000 7f63b1ffb700 1 -- 172.21.15.84:0/3918421813 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f63b407dd00 con 0x7f63c00f6530 2024-02-15T18:30:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.748+0000 7f63c4d39700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f63ac060f70 0x7f63ac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.748+0000 7f63c4d39700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f63ac060f70 0x7f63ac063430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f63bc004e20 tx=0x7f63bc00b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.752+0000 7f63b1ffb700 1 -- 172.21.15.84:0/3918421813 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f63b4081030 con 0x7f63c00f6530 2024-02-15T18:30:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.956+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f63c00feed0 con 0x7f63c00f6530 2024-02-15T18:30:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.957+0000 7f63b1ffb700 1 -- 172.21.15.84:0/3918421813 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f63b404e230 con 0x7f63c00f6530 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:e16 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 16 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:28:06.036365+0000 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:30:22.951 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:30:22.952 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:30:22.953 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:30:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f63ac060f70 msgr2=0x7f63ac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f63ac060f70 0x7f63ac063430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f63bc004e20 tx=0x7f63bc00b040).stop 2024-02-15T18:30:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 msgr2=0x7f63c006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 0x7f63c006b9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f63b4004e30 tx=0x7f63b4009b30).stop 2024-02-15T18:30:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 shutdown_connections 2024-02-15T18:30:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f63ac060f70 0x7f63ac063430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c00f6530 0x7f63c006b9a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 --2- 172.21.15.84:0/3918421813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00f77d0 0x7f63c0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 >> 172.21.15.84:0/3918421813 conn(0x7f63c00f1c90 msgr2=0x7f63c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 shutdown_connections 2024-02-15T18:30:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:22.959+0000 7f63c653c700 1 -- 172.21.15.84:0/3918421813 wait complete. 2024-02-15T18:30:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2024-02-15T18:30:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.060+0000 7fd62b19f700 1 -- 172.21.15.84:0/2216239413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 msgr2=0x7fd6240f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.060+0000 7fd62b19f700 1 --2- 172.21.15.84:0/2216239413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 0x7fd6240f59e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd618004660 tx=0x7fd618009b30).stop 2024-02-15T18:30:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.060+0000 7fd62b19f700 1 -- 172.21.15.84:0/2216239413 shutdown_connections 2024-02-15T18:30:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.060+0000 7fd62b19f700 1 --2- 172.21.15.84:0/2216239413 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6240f6860 0x7fd6240f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.060+0000 7fd62b19f700 1 --2- 172.21.15.84:0/2216239413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 0x7fd6240f59e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.060+0000 7fd62b19f700 1 -- 172.21.15.84:0/2216239413 >> 172.21.15.84:0/2216239413 conn(0x7fd6240f0d40 msgr2=0x7fd6240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.060+0000 7fd62b19f700 1 -- 172.21.15.84:0/2216239413 shutdown_connections 2024-02-15T18:30:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.060+0000 7fd62b19f700 1 -- 172.21.15.84:0/2216239413 wait complete. 2024-02-15T18:30:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd62b19f700 1 Processor -- start 2024-02-15T18:30:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd62b19f700 1 -- start start 2024-02-15T18:30:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd62b19f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 0x7fd624109d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd62b19f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6240f6860 0x7fd62410c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd62b19f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240603c0 con 0x7fd6240f55c0 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd62b19f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd624060500 con 0x7fd6240f6860 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd628f3b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 0x7fd624109d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd628f3b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 0x7fd624109d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40286/0 (socket says 172.21.15.84:40286) 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd628f3b700 1 -- 172.21.15.84:0/975774361 learned_addr learned my addr 172.21.15.84:0/975774361 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd623fff700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6240f6860 0x7fd62410c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd628f3b700 1 -- 172.21.15.84:0/975774361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6240f6860 msgr2=0x7fd62410c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd628f3b700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6240f6860 0x7fd62410c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.061+0000 7fd628f3b700 1 -- 172.21.15.84:0/975774361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618005040 con 0x7fd6240f55c0 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.062+0000 7fd628f3b700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 0x7fd624109d20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd618002040 tx=0x7fd61800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.062+0000 7fd6217fa700 1 -- 172.21.15.84:0/975774361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd618019070 con 0x7fd6240f55c0 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.062+0000 7fd6217fa700 1 -- 172.21.15.84:0/975774361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd618007e80 con 0x7fd6240f55c0 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.062+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62410c770 con 0x7fd6240f55c0 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.062+0000 7fd6217fa700 1 -- 172.21.15.84:0/975774361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd618014db0 con 0x7fd6240f55c0 2024-02-15T18:30:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.062+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62410cca0 con 0x7fd6240f55c0 2024-02-15T18:30:23.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.063+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd624045ad0 con 0x7fd6240f55c0 2024-02-15T18:30:23.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.063+0000 7fd6217fa700 1 -- 172.21.15.84:0/975774361 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd618025070 con 0x7fd6240f55c0 2024-02-15T18:30:23.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.064+0000 7fd6217fa700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd614060ec0 0x7fd614063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:23.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.064+0000 7fd6217fa700 1 -- 172.21.15.84:0/975774361 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd61807d3d0 con 0x7fd6240f55c0 2024-02-15T18:30:23.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.064+0000 7fd623fff700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd614060ec0 0x7fd614063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:23.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.064+0000 7fd623fff700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd614060ec0 0x7fd614063380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd610009fd0 tx=0x7fd61000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:23.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.067+0000 7fd6217fa700 1 -- 172.21.15.84:0/975774361 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd6180512a0 con 0x7fd6240f55c0 2024-02-15T18:30:23.140 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:30:22.908+0000 7fa4fb8fd700 1 -- 172.21.15.133:0/2482923186 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5623eff14680 con 0x5623efedb400 2024-02-15T18:30:23.140 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:22 smithi133 bash[62001]: b8c15d05905aa528abe66c78ea798f3be9dbc46018f95ef3c292013ecbd28825 2024-02-15T18:30:23.140 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:22 smithi133 systemd[1]: Started Ceph osd.3 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:30:23.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:21.724397+0000 mgr.smithi084.hjmnez (mgr.14596) 183 : audit [DBG] from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:23.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:22.015206+0000 mgr.smithi084.hjmnez (mgr.14596) 184 : audit [DBG] from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:23.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:22.294730+0000 mgr.smithi084.hjmnez (mgr.14596) 185 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:23.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:22.642665+0000 mon.smithi084 (mon.0) 298 : audit [DBG] from='client.? 172.21.15.84:0/231536464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:23.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.246+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd624057f10 con 0x7fd614060ec0 2024-02-15T18:30:23.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.247+0000 7fd6217fa700 1 -- 172.21.15.84:0/975774361 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd624057f10 con 0x7fd614060ec0 2024-02-15T18:30:23.241 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:30:23.241 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:30:23.241 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:30:23.241 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:30:23.241 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:30:23.241 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:30:23.241 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:30:23.242 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:30:23.242 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:30:23.242 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "9/21 daemons upgraded", 2024-02-15T18:30:23.242 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:30:23.242 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:30:23.242 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:30:23.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd614060ec0 msgr2=0x7fd614063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:23.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd614060ec0 0x7fd614063380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd610009fd0 tx=0x7fd61000b040).stop 2024-02-15T18:30:23.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 msgr2=0x7fd624109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:23.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 0x7fd624109d20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd618002040 tx=0x7fd61800b040).stop 2024-02-15T18:30:23.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 shutdown_connections 2024-02-15T18:30:23.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd614060ec0 0x7fd614063380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:23.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6240f55c0 0x7fd624109d20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:23.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 --2- 172.21.15.84:0/975774361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6240f6860 0x7fd62410c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:23.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 >> 172.21.15.84:0/975774361 conn(0x7fd6240f0d40 msgr2=0x7fd6240fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:23.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 shutdown_connections 2024-02-15T18:30:23.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:23.249+0000 7fd62b19f700 1 -- 172.21.15.84:0/975774361 wait complete. 2024-02-15T18:30:23.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:21.724397+0000 mgr.smithi084.hjmnez (mgr.14596) 183 : audit [DBG] from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:23.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:22.015206+0000 mgr.smithi084.hjmnez (mgr.14596) 184 : audit [DBG] from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:23.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:22.294730+0000 mgr.smithi084.hjmnez (mgr.14596) 185 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:23.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:22.642665+0000 mon.smithi084 (mon.0) 298 : audit [DBG] from='client.? 172.21.15.84:0/231536464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:23.705 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:30:23.425+0000 7fa50338b380 -1 Falling back to public interface 2024-02-15T18:30:24.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:22.731721+0000 mgr.smithi084.hjmnez (mgr.14596) 186 : cluster [DBG] pgmap v134: 65 pgs: 6 active+undersized+degraded, 13 peering, 7 stale+active+clean, 10 active+undersized, 29 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23/345 objects degraded (6.667%) 2024-02-15T18:30:24.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:22.946250+0000 mon.smithi084 (mon.0) 299 : cluster [WRN] Health check failed: Degraded data redundancy: 23/345 objects degraded (6.667%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:24.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:22.957850+0000 mon.smithi084 (mon.0) 300 : audit [DBG] from='client.? 172.21.15.84:0/3918421813' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:30:24.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:23.037958+0000 mon.smithi084 (mon.0) 301 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:24.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:23.038721+0000 mon.smithi084 (mon.0) 302 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:24.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:23.247966+0000 mgr.smithi084.hjmnez (mgr.14596) 187 : audit [DBG] from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:24.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:22.731721+0000 mgr.smithi084.hjmnez (mgr.14596) 186 : cluster [DBG] pgmap v134: 65 pgs: 6 active+undersized+degraded, 13 peering, 7 stale+active+clean, 10 active+undersized, 29 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23/345 objects degraded (6.667%) 2024-02-15T18:30:24.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:22.946250+0000 mon.smithi084 (mon.0) 299 : cluster [WRN] Health check failed: Degraded data redundancy: 23/345 objects degraded (6.667%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:24.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:22.957850+0000 mon.smithi084 (mon.0) 300 : audit [DBG] from='client.? 172.21.15.84:0/3918421813' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:30:24.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:23.037958+0000 mon.smithi084 (mon.0) 301 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:24.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:23.038721+0000 mon.smithi084 (mon.0) 302 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:24.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:23.247966+0000 mgr.smithi084.hjmnez (mgr.14596) 187 : audit [DBG] from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:25.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:24.952174+0000 mon.smithi084 (mon.0) 303 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-15T18:30:25.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:24.952174+0000 mon.smithi084 (mon.0) 303 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-15T18:30:26.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:24.732287+0000 mgr.smithi084.hjmnez (mgr.14596) 188 : cluster [DBG] pgmap v135: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:26.500 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:24.732287+0000 mgr.smithi084.hjmnez (mgr.14596) 188 : cluster [DBG] pgmap v135: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:27.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.178078+0000 mon.smithi084 (mon.0) 304 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.487146+0000 mon.smithi084 (mon.0) 305 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.488132+0000 mon.smithi084 (mon.0) 306 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:26.488950+0000 mgr.smithi084.hjmnez (mgr.14596) 189 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.493398+0000 mon.smithi084 (mon.0) 307 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.500112+0000 mon.smithi084 (mon.0) 308 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.502685+0000 mon.smithi084 (mon.0) 309 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.504163+0000 mon.smithi084 (mon.0) 310 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.505650+0000 mon.smithi084 (mon.0) 311 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.507101+0000 mon.smithi084 (mon.0) 312 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:26.507283+0000 mgr.smithi084.hjmnez (mgr.14596) 190 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:30:27.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:26.508136+0000 mgr.smithi084.hjmnez (mgr.14596) 191 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.178078+0000 mon.smithi084 (mon.0) 304 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.487146+0000 mon.smithi084 (mon.0) 305 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.488132+0000 mon.smithi084 (mon.0) 306 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:26.488950+0000 mgr.smithi084.hjmnez (mgr.14596) 189 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.493398+0000 mon.smithi084 (mon.0) 307 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.500112+0000 mon.smithi084 (mon.0) 308 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.502685+0000 mon.smithi084 (mon.0) 309 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.504163+0000 mon.smithi084 (mon.0) 310 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.505650+0000 mon.smithi084 (mon.0) 311 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.507101+0000 mon.smithi084 (mon.0) 312 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:26.507283+0000 mgr.smithi084.hjmnez (mgr.14596) 190 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:30:27.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:26.508136+0000 mgr.smithi084.hjmnez (mgr.14596) 191 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-15T18:30:28.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:26.732758+0000 mgr.smithi084.hjmnez (mgr.14596) 192 : cluster [DBG] pgmap v136: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:28.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:26.732758+0000 mgr.smithi084.hjmnez (mgr.14596) 192 : cluster [DBG] pgmap v136: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:30.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:28.733277+0000 mgr.smithi084.hjmnez (mgr.14596) 193 : cluster [DBG] pgmap v137: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:30.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:30.066074+0000 mon.smithi084 (mon.0) 313 : cluster [WRN] Health check update: Degraded data redundancy: 71/345 objects degraded (20.580%), 18 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:30.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:28.733277+0000 mgr.smithi084.hjmnez (mgr.14596) 193 : cluster [DBG] pgmap v137: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:30.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:30.066074+0000 mon.smithi084 (mon.0) 313 : cluster [WRN] Health check update: Degraded data redundancy: 71/345 objects degraded (20.580%), 18 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:32.389 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:30:31.935+0000 7fa50338b380 -1 osd.3 63 log_to_monitors {default=true} 2024-02-15T18:30:32.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:30.733928+0000 mgr.smithi084.hjmnez (mgr.14596) 194 : cluster [DBG] pgmap v138: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:32.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:31.939025+0000 mon.smithi133 (mon.1) 2 : audit [INF] from='osd.3 [v2:172.21.15.133:6800/927364561,v1:172.21.15.133:6801/927364561]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:30:32.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:31.939534+0000 mon.smithi084 (mon.0) 314 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:30:32.890 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:30:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:30:32.518+0000 7fa4f206d700 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:30:32.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:30.733928+0000 mgr.smithi084.hjmnez (mgr.14596) 194 : cluster [DBG] pgmap v138: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:32.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:31.939025+0000 mon.smithi133 (mon.1) 2 : audit [INF] from='osd.3 [v2:172.21.15.133:6800/927364561,v1:172.21.15.133:6801/927364561]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:30:32.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:31.939534+0000 mon.smithi084 (mon.0) 314 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:30:33.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:32.505594+0000 mon.smithi084 (mon.0) 315 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T18:30:33.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:32.505667+0000 mon.smithi084 (mon.0) 316 : cluster [DBG] osdmap e66: 6 total, 5 up, 6 in 2024-02-15T18:30:33.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:32.508197+0000 mon.smithi133 (mon.1) 3 : audit [INF] from='osd.3 [v2:172.21.15.133:6800/927364561,v1:172.21.15.133:6801/927364561]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:30:33.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:32.511063+0000 mon.smithi084 (mon.0) 317 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:30:33.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:32.505594+0000 mon.smithi084 (mon.0) 315 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T18:30:33.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:32.505667+0000 mon.smithi084 (mon.0) 316 : cluster [DBG] osdmap e66: 6 total, 5 up, 6 in 2024-02-15T18:30:33.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:32.508197+0000 mon.smithi133 (mon.1) 3 : audit [INF] from='osd.3 [v2:172.21.15.133:6800/927364561,v1:172.21.15.133:6801/927364561]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:30:33.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:32.511063+0000 mon.smithi084 (mon.0) 317 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:30:34.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:32.734358+0000 mgr.smithi084.hjmnez (mgr.14596) 195 : cluster [DBG] pgmap v140: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:34.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:33.508889+0000 mon.smithi084 (mon.0) 318 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:30:34.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:33.515388+0000 mon.smithi084 (mon.0) 319 : cluster [INF] osd.3 [v2:172.21.15.133:6800/927364561,v1:172.21.15.133:6801/927364561] boot 2024-02-15T18:30:34.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:33.515424+0000 mon.smithi084 (mon.0) 320 : cluster [DBG] osdmap e67: 6 total, 6 up, 6 in 2024-02-15T18:30:34.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:33.515993+0000 mon.smithi084 (mon.0) 321 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:30:35.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:32.734358+0000 mgr.smithi084.hjmnez (mgr.14596) 195 : cluster [DBG] pgmap v140: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-02-15T18:30:35.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:33.508889+0000 mon.smithi084 (mon.0) 318 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:30:35.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:33.515388+0000 mon.smithi084 (mon.0) 319 : cluster [INF] osd.3 [v2:172.21.15.133:6800/927364561,v1:172.21.15.133:6801/927364561] boot 2024-02-15T18:30:35.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:33.515424+0000 mon.smithi084 (mon.0) 320 : cluster [DBG] osdmap e67: 6 total, 6 up, 6 in 2024-02-15T18:30:35.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:33.515993+0000 mon.smithi084 (mon.0) 321 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:30:35.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:34.526045+0000 mon.smithi084 (mon.0) 322 : cluster [DBG] osdmap e68: 6 total, 6 up, 6 in 2024-02-15T18:30:36.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:34.526045+0000 mon.smithi084 (mon.0) 322 : cluster [DBG] osdmap e68: 6 total, 6 up, 6 in 2024-02-15T18:30:36.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:34.734793+0000 mgr.smithi084.hjmnez (mgr.14596) 196 : cluster [DBG] pgmap v143: 65 pgs: 1 active, 7 peering, 13 active+undersized+degraded, 15 active+undersized, 29 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/345 objects degraded (16.232%) 2024-02-15T18:30:36.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:35.523978+0000 mon.smithi084 (mon.0) 323 : cluster [WRN] Health check update: Degraded data redundancy: 56/345 objects degraded (16.232%), 13 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:37.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:34.734793+0000 mgr.smithi084.hjmnez (mgr.14596) 196 : cluster [DBG] pgmap v143: 65 pgs: 1 active, 7 peering, 13 active+undersized+degraded, 15 active+undersized, 29 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/345 objects degraded (16.232%) 2024-02-15T18:30:37.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:35.523978+0000 mon.smithi084 (mon.0) 323 : cluster [WRN] Health check update: Degraded data redundancy: 56/345 objects degraded (16.232%), 13 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:38.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:36.735311+0000 mgr.smithi084.hjmnez (mgr.14596) 197 : cluster [DBG] pgmap v144: 65 pgs: 1 active, 7 peering, 12 active+undersized+degraded, 12 active+undersized, 33 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 52/345 objects degraded (15.072%) 2024-02-15T18:30:38.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:36.906972+0000 mon.smithi084 (mon.0) 324 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:38.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:36.735311+0000 mgr.smithi084.hjmnez (mgr.14596) 197 : cluster [DBG] pgmap v144: 65 pgs: 1 active, 7 peering, 12 active+undersized+degraded, 12 active+undersized, 33 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 52/345 objects degraded (15.072%) 2024-02-15T18:30:38.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:36.906972+0000 mon.smithi084 (mon.0) 324 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:39.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:38.908091+0000 mon.smithi084 (mon.0) 325 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/345 objects degraded (15.072%), 12 pgs degraded) 2024-02-15T18:30:39.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:38.908123+0000 mon.smithi084 (mon.0) 326 : cluster [INF] Cluster is now healthy 2024-02-15T18:30:39.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:38.908091+0000 mon.smithi084 (mon.0) 325 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 52/345 objects degraded (15.072%), 12 pgs degraded) 2024-02-15T18:30:39.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:38.908123+0000 mon.smithi084 (mon.0) 326 : cluster [INF] Cluster is now healthy 2024-02-15T18:30:40.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:38.735830+0000 mgr.smithi084.hjmnez (mgr.14596) 198 : cluster [DBG] pgmap v145: 65 pgs: 1 active, 7 peering, 57 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:40.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:38.735830+0000 mgr.smithi084.hjmnez (mgr.14596) 198 : cluster [DBG] pgmap v145: 65 pgs: 1 active, 7 peering, 57 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:42.305 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:40.736316+0000 mgr.smithi084.hjmnez (mgr.14596) 199 : cluster [DBG] pgmap v146: 65 pgs: 65 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:42.305 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:41.076176+0000 mon.smithi084 (mon.0) 327 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:30:42.305 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:41.521744+0000 mon.smithi084 (mon.0) 328 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:30:42.305 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:41.521953+0000 mgr.smithi084.hjmnez (mgr.14596) 200 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:30:42.305 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:41.522961+0000 mgr.smithi084.hjmnez (mgr.14596) 201 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-15T18:30:42.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:40.736316+0000 mgr.smithi084.hjmnez (mgr.14596) 199 : cluster [DBG] pgmap v146: 65 pgs: 65 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:42.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:41.076176+0000 mon.smithi084 (mon.0) 327 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:30:42.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:41.521744+0000 mon.smithi084 (mon.0) 328 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:30:42.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:41.521953+0000 mgr.smithi084.hjmnez (mgr.14596) 200 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:30:42.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:41.522961+0000 mgr.smithi084.hjmnez (mgr.14596) 201 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-15T18:30:44.194 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:42.736841+0000 mgr.smithi084.hjmnez (mgr.14596) 202 : cluster [DBG] pgmap v147: 65 pgs: 65 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:44.194 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:42.914478+0000 mgr.smithi084.hjmnez (mgr.14596) 203 : cephadm [INF] Upgrade: Updating osd.4 2024-02-15T18:30:44.194 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:42.919373+0000 mon.smithi084 (mon.0) 329 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:44.194 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:42.920290+0000 mon.smithi084 (mon.0) 330 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T18:30:44.194 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:42.920955+0000 mon.smithi084 (mon.0) 331 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:44.194 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:42.922062+0000 mgr.smithi084.hjmnez (mgr.14596) 204 : cephadm [INF] Deploying daemon osd.4 on smithi133 2024-02-15T18:30:44.194 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:43.082229+0000 mon.smithi084 (mon.0) 332 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:30:44.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:42.736841+0000 mgr.smithi084.hjmnez (mgr.14596) 202 : cluster [DBG] pgmap v147: 65 pgs: 65 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:44.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:42.914478+0000 mgr.smithi084.hjmnez (mgr.14596) 203 : cephadm [INF] Upgrade: Updating osd.4 2024-02-15T18:30:44.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:42.919373+0000 mon.smithi084 (mon.0) 329 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:44.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:42.920290+0000 mon.smithi084 (mon.0) 330 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T18:30:44.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:42.920955+0000 mon.smithi084 (mon.0) 331 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:44.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:42.922062+0000 mgr.smithi084.hjmnez (mgr.14596) 204 : cephadm [INF] Deploying daemon osd.4 on smithi133 2024-02-15T18:30:44.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:43.082229+0000 mon.smithi084 (mon.0) 332 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:30:46.062 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:45 smithi133 systemd[1]: Stopping Ceph osd.4 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:30:46.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:44.737290+0000 mgr.smithi084.hjmnez (mgr.14596) 205 : cluster [DBG] pgmap v148: 65 pgs: 65 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:46.390 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.4[48672]: debug 2024-02-15T18:30:46.067+0000 7fcb575af700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:30:46.390 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.4[48672]: debug 2024-02-15T18:30:46.067+0000 7fcb575af700 -1 osd.4 68 *** Got signal Terminated *** 2024-02-15T18:30:46.390 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.4[48672]: debug 2024-02-15T18:30:46.067+0000 7fcb575af700 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:30:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:44.737290+0000 mgr.smithi084.hjmnez (mgr.14596) 205 : cluster [DBG] pgmap v148: 65 pgs: 65 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:46.800 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:46 smithi133 bash[63711]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.4 2024-02-15T18:30:47.059 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:46 smithi133 bash[63764]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.4 2024-02-15T18:30:47.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.329837+0000 mon.smithi084 (mon.0) 333 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:30:47.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.329876+0000 mon.smithi084 (mon.0) 334 : cluster [INF] osd.4 failed (root=default,host=smithi133) (connection refused reported by osd.5) 2024-02-15T18:30:47.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.329952+0000 mon.smithi084 (mon.0) 335 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:30:47.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.331112+0000 mon.smithi084 (mon.0) 336 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:30:47.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.331265+0000 mon.smithi084 (mon.0) 337 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:30:47.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.331363+0000 mon.smithi084 (mon.0) 338 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:30:47.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.331446+0000 mon.smithi084 (mon.0) 339 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.331531+0000 mon.smithi084 (mon.0) 340 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.331613+0000 mon.smithi084 (mon.0) 341 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.331694+0000 mon.smithi084 (mon.0) 342 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.331809+0000 mon.smithi084 (mon.0) 343 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.730863+0000 mon.smithi084 (mon.0) 344 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.730923+0000 mon.smithi084 (mon.0) 345 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.731083+0000 mon.smithi084 (mon.0) 346 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.731216+0000 mon.smithi084 (mon.0) 347 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.732121+0000 mon.smithi084 (mon.0) 348 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.732221+0000 mon.smithi084 (mon.0) 349 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.732310+0000 mon.smithi084 (mon.0) 350 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.732403+0000 mon.smithi084 (mon.0) 351 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.732492+0000 mon.smithi084 (mon.0) 352 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.732578+0000 mon.smithi084 (mon.0) 353 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:30:47.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:47.008627+0000 mon.smithi084 (mon.0) 354 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:47.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.329837+0000 mon.smithi084 (mon.0) 333 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:30:47.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.329876+0000 mon.smithi084 (mon.0) 334 : cluster [INF] osd.4 failed (root=default,host=smithi133) (connection refused reported by osd.5) 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.329952+0000 mon.smithi084 (mon.0) 335 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.331112+0000 mon.smithi084 (mon.0) 336 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.331265+0000 mon.smithi084 (mon.0) 337 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.331363+0000 mon.smithi084 (mon.0) 338 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.331446+0000 mon.smithi084 (mon.0) 339 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.331531+0000 mon.smithi084 (mon.0) 340 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.331613+0000 mon.smithi084 (mon.0) 341 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.331694+0000 mon.smithi084 (mon.0) 342 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.331809+0000 mon.smithi084 (mon.0) 343 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.730863+0000 mon.smithi084 (mon.0) 344 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.730923+0000 mon.smithi084 (mon.0) 345 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:30:47.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.731083+0000 mon.smithi084 (mon.0) 346 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:30:47.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.731216+0000 mon.smithi084 (mon.0) 347 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:30:47.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.732121+0000 mon.smithi084 (mon.0) 348 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:30:47.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.732221+0000 mon.smithi084 (mon.0) 349 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:30:47.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.732310+0000 mon.smithi084 (mon.0) 350 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:30:47.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.732403+0000 mon.smithi084 (mon.0) 351 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:30:47.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.732492+0000 mon.smithi084 (mon.0) 352 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:30:47.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.732578+0000 mon.smithi084 (mon.0) 353 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:30:47.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:47.008627+0000 mon.smithi084 (mon.0) 354 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:48.307 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:46.737866+0000 mgr.smithi084.hjmnez (mgr.14596) 206 : cluster [DBG] pgmap v149: 65 pgs: 65 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:48.307 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:47.073305+0000 mon.smithi084 (mon.0) 355 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:30:48.307 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:47.081053+0000 mon.smithi084 (mon.0) 356 : cluster [DBG] osdmap e69: 6 total, 5 up, 6 in 2024-02-15T18:30:48.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:46.737866+0000 mgr.smithi084.hjmnez (mgr.14596) 206 : cluster [DBG] pgmap v149: 65 pgs: 65 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:48.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:47.073305+0000 mon.smithi084 (mon.0) 355 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:30:48.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:47.081053+0000 mon.smithi084 (mon.0) 356 : cluster [DBG] osdmap e69: 6 total, 5 up, 6 in 2024-02-15T18:30:49.382 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:49 smithi133 systemd[1]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.4.service: Succeeded. 2024-02-15T18:30:49.383 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:49 smithi133 systemd[1]: Stopped Ceph osd.4 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:30:49.383 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:49 smithi133 systemd[1]: Starting Ceph osd.4 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:30:49.383 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:48.090840+0000 mon.smithi084 (mon.0) 357 : cluster [DBG] osdmap e70: 6 total, 5 up, 6 in 2024-02-15T18:30:49.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:48.090840+0000 mon.smithi084 (mon.0) 357 : cluster [DBG] osdmap e70: 6 total, 5 up, 6 in 2024-02-15T18:30:50.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:48.738269+0000 mgr.smithi084.hjmnez (mgr.14596) 207 : cluster [DBG] pgmap v152: 65 pgs: 16 peering, 4 stale+active+clean, 45 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:50.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:49.085336+0000 mon.smithi084 (mon.0) 358 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-15T18:30:50.392 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:50 smithi133 bash[64017]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:30:50.392 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:50 smithi133 bash[64017]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T18:30:50.392 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:50 smithi133 bash[64017]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-02-15T18:30:50.392 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:50 smithi133 bash[64017]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-15T18:30:50.393 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:50 smithi133 bash[64017]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-02-15T18:30:50.393 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:50 smithi133 bash[64017]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T18:30:50.393 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:50 smithi133 bash[64017]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T18:30:50.393 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:50 smithi133 bash[64017]: --> ceph-volume lvm activate successful for osd ID: 4 2024-02-15T18:30:50.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:48.738269+0000 mgr.smithi084.hjmnez (mgr.14596) 207 : cluster [DBG] pgmap v152: 65 pgs: 16 peering, 4 stale+active+clean, 45 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:30:50.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:49.085336+0000 mon.smithi084 (mon.0) 358 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-15T18:30:51.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:51 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:51.093760+0000 mon.smithi084 (mon.0) 359 : cluster [WRN] Health check failed: Degraded data redundancy: 12/345 objects degraded (3.478%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:51.511 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:51.093760+0000 mon.smithi084 (mon.0) 359 : cluster [WRN] Health check failed: Degraded data redundancy: 12/345 objects degraded (3.478%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T18:30:51.889 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:30:51.517+0000 7f3a1eee9700 1 -- 172.21.15.133:0/1172960439 <== mon.1 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558a09fba680 con 0x558a09f81000 2024-02-15T18:30:51.889 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:51 smithi133 bash[64286]: 612e5da9dba42f804ef9d68ac66449bc823be1cec64676856c68e4f208806cc4 2024-02-15T18:30:51.890 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:51 smithi133 systemd[1]: Started Ceph osd.4 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:30:52.295 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:30:52.035+0000 7f3a26977380 -1 Falling back to public interface 2024-02-15T18:30:52.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:50.738796+0000 mgr.smithi084.hjmnez (mgr.14596) 208 : cluster [DBG] pgmap v153: 65 pgs: 4 active+undersized+degraded, 16 peering, 2 stale+active+clean, 6 active+undersized, 37 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 12/345 objects degraded (3.478%) 2024-02-15T18:30:52.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:51.632346+0000 mon.smithi084 (mon.0) 360 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:52.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:51.633156+0000 mon.smithi084 (mon.0) 361 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:52.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:51.906627+0000 mon.smithi084 (mon.0) 362 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:53.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:50.738796+0000 mgr.smithi084.hjmnez (mgr.14596) 208 : cluster [DBG] pgmap v153: 65 pgs: 4 active+undersized+degraded, 16 peering, 2 stale+active+clean, 6 active+undersized, 37 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 12/345 objects degraded (3.478%) 2024-02-15T18:30:53.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:51.632346+0000 mon.smithi084 (mon.0) 360 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:53.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:51.633156+0000 mon.smithi084 (mon.0) 361 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:53.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:51.906627+0000 mon.smithi084 (mon.0) 362 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.359+0000 7fe34cfdb700 1 -- 172.21.15.84:0/3495824827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f7980 msgr2=0x7fe3480f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.359+0000 7fe34cfdb700 1 --2- 172.21.15.84:0/3495824827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f7980 0x7fe3480f7de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe338004660 tx=0x7fe338009b30).stop 2024-02-15T18:30:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.359+0000 7fe34cfdb700 1 -- 172.21.15.84:0/3495824827 shutdown_connections 2024-02-15T18:30:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.359+0000 7fe34cfdb700 1 --2- 172.21.15.84:0/3495824827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f7980 0x7fe3480f7de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.359+0000 7fe34cfdb700 1 --2- 172.21.15.84:0/3495824827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3480f66e0 0x7fe3480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.359+0000 7fe34cfdb700 1 -- 172.21.15.84:0/3495824827 >> 172.21.15.84:0/3495824827 conn(0x7fe3480f1e40 msgr2=0x7fe3480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.359+0000 7fe34cfdb700 1 -- 172.21.15.84:0/3495824827 shutdown_connections 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.359+0000 7fe34cfdb700 1 -- 172.21.15.84:0/3495824827 wait complete. 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34cfdb700 1 Processor -- start 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34cfdb700 1 -- start start 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34cfdb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f66e0 0x7fe348107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34cfdb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3480f7980 0x7fe3481074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34cfdb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348107aa0 con 0x7fe3480f66e0 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34cfdb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348107be0 con 0x7fe3480f7980 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f66e0 0x7fe348107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f66e0 0x7fe348107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44070/0 (socket says 172.21.15.84:44070) 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34659c700 1 -- 172.21.15.84:0/877572335 learned_addr learned my addr 172.21.15.84:0/877572335 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe345d9b700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3480f7980 0x7fe3481074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34659c700 1 -- 172.21.15.84:0/877572335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3480f7980 msgr2=0x7fe3481074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34659c700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3480f7980 0x7fe3481074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.360+0000 7fe34659c700 1 -- 172.21.15.84:0/877572335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe338005040 con 0x7fe3480f66e0 2024-02-15T18:30:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.361+0000 7fe34659c700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f66e0 0x7fe348107000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fe33c002700 tx=0x7fe33c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.361+0000 7fe336ffd700 1 -- 172.21.15.84:0/877572335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe33c0079c0 con 0x7fe3480f66e0 2024-02-15T18:30:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.361+0000 7fe336ffd700 1 -- 172.21.15.84:0/877572335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fe33c00f040 con 0x7fe3480f66e0 2024-02-15T18:30:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.361+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe348108580 con 0x7fe3480f66e0 2024-02-15T18:30:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.361+0000 7fe336ffd700 1 -- 172.21.15.84:0/877572335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe33c014940 con 0x7fe3480f66e0 2024-02-15T18:30:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.361+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe348108b40 con 0x7fe3480f66e0 2024-02-15T18:30:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.362+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe348045ad0 con 0x7fe3480f66e0 2024-02-15T18:30:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.362+0000 7fe336ffd700 1 -- 172.21.15.84:0/877572335 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe33c01b060 con 0x7fe3480f66e0 2024-02-15T18:30:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.363+0000 7fe336ffd700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe330060f20 0x7fe3300633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.363+0000 7fe336ffd700 1 -- 172.21.15.84:0/877572335 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe33c07bf60 con 0x7fe3480f66e0 2024-02-15T18:30:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.363+0000 7fe345d9b700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe330060f20 0x7fe3300633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.363+0000 7fe345d9b700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe330060f20 0x7fe3300633e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe338004630 tx=0x7fe338009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:53.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.367+0000 7fe336ffd700 1 -- 172.21.15.84:0/877572335 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe33c04fe10 con 0x7fe3480f66e0 2024-02-15T18:30:53.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.548+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe348108dc0 con 0x7fe330060f20 2024-02-15T18:30:53.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.549+0000 7fe336ffd700 1 -- 172.21.15.84:0/877572335 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe348108dc0 con 0x7fe330060f20 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe330060f20 msgr2=0x7fe3300633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe330060f20 0x7fe3300633e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe338004630 tx=0x7fe338009b30).stop 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f66e0 msgr2=0x7fe348107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f66e0 0x7fe348107000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fe33c002700 tx=0x7fe33c009d80).stop 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 shutdown_connections 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe330060f20 0x7fe3300633e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3480f66e0 0x7fe348107000 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 --2- 172.21.15.84:0/877572335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3480f7980 0x7fe3481074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 >> 172.21.15.84:0/877572335 conn(0x7fe3480f1e40 msgr2=0x7fe3480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 shutdown_connections 2024-02-15T18:30:53.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.551+0000 7fe34cfdb700 1 -- 172.21.15.84:0/877572335 wait complete. 2024-02-15T18:30:53.555 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:30:53.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 -- 172.21.15.84:0/3258126036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f7980 msgr2=0x7f68c80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 --2- 172.21.15.84:0/3258126036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f7980 0x7f68c80f7de0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f68b8004660 tx=0x7f68b8009b30).stop 2024-02-15T18:30:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 -- 172.21.15.84:0/3258126036 shutdown_connections 2024-02-15T18:30:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 --2- 172.21.15.84:0/3258126036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f7980 0x7f68c80f7de0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 --2- 172.21.15.84:0/3258126036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c80f66e0 0x7f68c80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 -- 172.21.15.84:0/3258126036 >> 172.21.15.84:0/3258126036 conn(0x7f68c80f1e40 msgr2=0x7f68c80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 -- 172.21.15.84:0/3258126036 shutdown_connections 2024-02-15T18:30:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 -- 172.21.15.84:0/3258126036 wait complete. 2024-02-15T18:30:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 Processor -- start 2024-02-15T18:30:53.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.651+0000 7f68ce419700 1 -- start start 2024-02-15T18:30:53.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68ce419700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f66e0 0x7f68c8107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68ce419700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c80f7980 0x7f68c81074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68ce419700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c8107aa0 con 0x7f68c80f66e0 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68ce419700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c8107be0 con 0x7f68c80f7980 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f66e0 0x7f68c8107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f66e0 0x7f68c8107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44088/0 (socket says 172.21.15.84:44088) 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c7fff700 1 -- 172.21.15.84:0/202123902 learned_addr learned my addr 172.21.15.84:0/202123902 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c77fe700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c80f7980 0x7f68c81074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c7fff700 1 -- 172.21.15.84:0/202123902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c80f7980 msgr2=0x7f68c81074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c7fff700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c80f7980 0x7f68c81074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c7fff700 1 -- 172.21.15.84:0/202123902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8005040 con 0x7f68c80f66e0 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c7fff700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f66e0 0x7f68c8107000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f68b0002700 tx=0x7f68b0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c4ff9700 1 -- 172.21.15.84:0/202123902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68b00079c0 con 0x7f68c80f66e0 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c4ff9700 1 -- 172.21.15.84:0/202123902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f68b000f040 con 0x7f68c80f66e0 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c8108580 con 0x7f68c80f66e0 2024-02-15T18:30:53.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68c4ff9700 1 -- 172.21.15.84:0/202123902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68b0014940 con 0x7f68c80f66e0 2024-02-15T18:30:53.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.652+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c8108b40 con 0x7f68c80f66e0 2024-02-15T18:30:53.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.653+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c8045ad0 con 0x7f68c80f66e0 2024-02-15T18:30:53.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.654+0000 7f68c4ff9700 1 -- 172.21.15.84:0/202123902 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f68b001b060 con 0x7f68c80f66e0 2024-02-15T18:30:53.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.654+0000 7f68c4ff9700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f68b4060f20 0x7f68b40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:53.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.654+0000 7f68c4ff9700 1 -- 172.21.15.84:0/202123902 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f68b007bf60 con 0x7f68c80f66e0 2024-02-15T18:30:53.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.654+0000 7f68c77fe700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f68b4060f20 0x7f68b40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:53.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.654+0000 7f68c77fe700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f68b4060f20 0x7f68b40633e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f68b8004630 tx=0x7f68b8009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.658+0000 7f68c4ff9700 1 -- 172.21.15.84:0/202123902 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f68b004fe10 con 0x7f68c80f66e0 2024-02-15T18:30:53.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:53 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:53.632055+0000 mon.smithi084 (mon.0) 363 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-15T18:30:53.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.844+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68c8108dc0 con 0x7f68b4060f20 2024-02-15T18:30:53.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.845+0000 7f68c4ff9700 1 -- 172.21.15.84:0/202123902 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f68c8108dc0 con 0x7f68b4060f20 2024-02-15T18:30:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f68b4060f20 msgr2=0x7f68b40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f68b4060f20 0x7f68b40633e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f68b8004630 tx=0x7f68b8009b30).stop 2024-02-15T18:30:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f66e0 msgr2=0x7f68c8107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f66e0 0x7f68c8107000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f68b0002700 tx=0x7f68b0009d80).stop 2024-02-15T18:30:53.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 shutdown_connections 2024-02-15T18:30:53.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f68b4060f20 0x7f68b40633e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68c80f66e0 0x7f68c8107000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 --2- 172.21.15.84:0/202123902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c80f7980 0x7f68c81074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 >> 172.21.15.84:0/202123902 conn(0x7f68c80f1e40 msgr2=0x7f68c80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:53.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 shutdown_connections 2024-02-15T18:30:53.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.847+0000 7f68ce419700 1 -- 172.21.15.84:0/202123902 wait complete. 2024-02-15T18:30:53.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.944+0000 7fe655c43700 1 -- 172.21.15.84:0/675172052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 msgr2=0x7fe6500f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.944+0000 7fe655c43700 1 --2- 172.21.15.84:0/675172052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 0x7fe6500f6b00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe648004660 tx=0x7fe648009b30).stop 2024-02-15T18:30:53.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.944+0000 7fe655c43700 1 -- 172.21.15.84:0/675172052 shutdown_connections 2024-02-15T18:30:53.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.944+0000 7fe655c43700 1 --2- 172.21.15.84:0/675172052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6500f7980 0x7fe6500f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.944+0000 7fe655c43700 1 --2- 172.21.15.84:0/675172052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 0x7fe6500f6b00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.944+0000 7fe655c43700 1 -- 172.21.15.84:0/675172052 >> 172.21.15.84:0/675172052 conn(0x7fe6500f1e40 msgr2=0x7fe6500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:53.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.944+0000 7fe655c43700 1 -- 172.21.15.84:0/675172052 shutdown_connections 2024-02-15T18:30:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.944+0000 7fe655c43700 1 -- 172.21.15.84:0/675172052 wait complete. 2024-02-15T18:30:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe655c43700 1 Processor -- start 2024-02-15T18:30:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe655c43700 1 -- start start 2024-02-15T18:30:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe655c43700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 0x7fe650107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe655c43700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6500f7980 0x7fe650107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe655c43700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe650107ad0 con 0x7fe6500f66e0 2024-02-15T18:30:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe655c43700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe650107c10 con 0x7fe6500f7980 2024-02-15T18:30:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe64f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 0x7fe650107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe64f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 0x7fe650107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44102/0 (socket says 172.21.15.84:44102) 2024-02-15T18:30:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe64f7fe700 1 -- 172.21.15.84:0/189180062 learned_addr learned my addr 172.21.15.84:0/189180062 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe64effd700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6500f7980 0x7fe650107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe64f7fe700 1 -- 172.21.15.84:0/189180062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6500f7980 msgr2=0x7fe650107520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe64f7fe700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6500f7980 0x7fe650107520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.945+0000 7fe64f7fe700 1 -- 172.21.15.84:0/189180062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe648005040 con 0x7fe6500f66e0 2024-02-15T18:30:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.946+0000 7fe64f7fe700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 0x7fe650107030 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe648004e30 tx=0x7fe648009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.946+0000 7fe647fff700 1 -- 172.21.15.84:0/189180062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe648018070 con 0x7fe6500f66e0 2024-02-15T18:30:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.946+0000 7fe647fff700 1 -- 172.21.15.84:0/189180062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fe648007ba0 con 0x7fe6500f66e0 2024-02-15T18:30:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.946+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe650108550 con 0x7fe6500f66e0 2024-02-15T18:30:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.946+0000 7fe647fff700 1 -- 172.21.15.84:0/189180062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe64801c3c0 con 0x7fe6500f66e0 2024-02-15T18:30:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.946+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe650108ab0 con 0x7fe6500f66e0 2024-02-15T18:30:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.947+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe650045ad0 con 0x7fe6500f66e0 2024-02-15T18:30:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.947+0000 7fe647fff700 1 -- 172.21.15.84:0/189180062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe64801d420 con 0x7fe6500f66e0 2024-02-15T18:30:53.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.947+0000 7fe647fff700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe63c060f20 0x7fe63c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:53.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.948+0000 7fe647fff700 1 -- 172.21.15.84:0/189180062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe64807dd10 con 0x7fe6500f66e0 2024-02-15T18:30:53.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.948+0000 7fe64effd700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe63c060f20 0x7fe63c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:53.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.948+0000 7fe64effd700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe63c060f20 0x7fe63c0633e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe638004c40 tx=0x7fe63800b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:53.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:53.952+0000 7fe647fff700 1 -- 172.21.15.84:0/189180062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe648051c30 con 0x7fe6500f66e0 2024-02-15T18:30:54.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.124+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6500ff130 con 0x7fe63c060f20 2024-02-15T18:30:54.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.133+0000 7fe647fff700 1 -- 172.21.15.84:0/189180062 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe6500ff130 con 0x7fe63c060f20 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (10m) 55s ago 11m 18.0M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (2m) 55s ago 11m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (2m) 27s ago 10m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (10m) 55s ago 11m 35.6M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (6m) 55s ago 6m 121M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (6m) 55s ago 6m 14.1M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (6m) 27s ago 6m 124M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (6m) 27s ago 6m 14.8M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (4m) 55s ago 13m 433M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (3m) 27s ago 10m 389M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (3m) 55s ago 13m 46.1M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:30:54.127 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (2m) 27s ago 10m 35.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:30:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (11m) 55s ago 11m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:30:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (10m) 27s ago 10m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:30:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (2m) 55s ago 10m 207M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:30:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (93s) 55s ago 9m 236M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:30:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (62s) 55s ago 9m 12.8M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:30:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (31s) 27s ago 9m 11.6M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc b8c15d05905a 2024-02-15T18:30:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 starting - - - 4096M 2024-02-15T18:30:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (8m) 27s ago 8m 377M 4096M 16.2.4 8d91d370c2b8 4ed8f60a86a2 2024-02-15T18:30:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (4m) 55s ago 11m 67.9M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe63c060f20 msgr2=0x7fe63c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe63c060f20 0x7fe63c0633e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe638004c40 tx=0x7fe63800b040).stop 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 msgr2=0x7fe650107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 0x7fe650107030 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe648004e30 tx=0x7fe648009b30).stop 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 shutdown_connections 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe63c060f20 0x7fe63c0633e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6500f66e0 0x7fe650107030 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 --2- 172.21.15.84:0/189180062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6500f7980 0x7fe650107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 >> 172.21.15.84:0/189180062 conn(0x7fe6500f1e40 msgr2=0x7fe6500fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:54.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 shutdown_connections 2024-02-15T18:30:54.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.135+0000 7fe655c43700 1 -- 172.21.15.84:0/189180062 wait complete. 2024-02-15T18:30:54.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:53.632055+0000 mon.smithi084 (mon.0) 363 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-15T18:30:54.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.232+0000 7feaed73e700 1 -- 172.21.15.84:0/2757624437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f7980 msgr2=0x7feae80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.232+0000 7feaed73e700 1 --2- 172.21.15.84:0/2757624437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f7980 0x7feae80f7de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7feadc004660 tx=0x7feadc009b30).stop 2024-02-15T18:30:54.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.232+0000 7feaed73e700 1 -- 172.21.15.84:0/2757624437 shutdown_connections 2024-02-15T18:30:54.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.232+0000 7feaed73e700 1 --2- 172.21.15.84:0/2757624437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f7980 0x7feae80f7de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.232+0000 7feaed73e700 1 --2- 172.21.15.84:0/2757624437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80f66e0 0x7feae80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:30:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.232+0000 7feaed73e700 1 -- 172.21.15.84:0/2757624437 >> 172.21.15.84:0/2757624437 conn(0x7feae80f1e40 msgr2=0x7feae80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.232+0000 7feaed73e700 1 -- 172.21.15.84:0/2757624437 shutdown_connections 2024-02-15T18:30:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.232+0000 7feaed73e700 1 -- 172.21.15.84:0/2757624437 wait complete. 2024-02-15T18:30:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feaed73e700 1 Processor -- start 2024-02-15T18:30:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feaed73e700 1 -- start start 2024-02-15T18:30:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feaed73e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f66e0 0x7feae806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feaed73e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80f7980 0x7feae8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feaed73e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae806a410 con 0x7feae80f66e0 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feaed73e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae806a550 con 0x7feae80f7980 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feae6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f66e0 0x7feae806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feae6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f66e0 0x7feae806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44122/0 (socket says 172.21.15.84:44122) 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feae67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80f7980 0x7feae8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feae6ffd700 1 -- 172.21.15.84:0/2030373091 learned_addr learned my addr 172.21.15.84:0/2030373091 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feae6ffd700 1 -- 172.21.15.84:0/2030373091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80f7980 msgr2=0x7feae8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feae6ffd700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80f7980 0x7feae8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.233+0000 7feae6ffd700 1 -- 172.21.15.84:0/2030373091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc005040 con 0x7feae80f66e0 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.234+0000 7feae6ffd700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f66e0 0x7feae806b9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fead80093f0 tx=0x7fead8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.234+0000 7feacf7fe700 1 -- 172.21.15.84:0/2030373091 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead8013640 con 0x7feae80f66e0 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.234+0000 7feacf7fe700 1 -- 172.21.15.84:0/2030373091 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fead8013c90 con 0x7feae80f66e0 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.234+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae806a830 con 0x7feae80f66e0 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.234+0000 7feacf7fe700 1 -- 172.21.15.84:0/2030373091 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead8012de0 con 0x7feae80f66e0 2024-02-15T18:30:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.234+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae810f0a0 con 0x7feae80f66e0 2024-02-15T18:30:54.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.235+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae8045ad0 con 0x7feae80f66e0 2024-02-15T18:30:54.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.235+0000 7feacf7fe700 1 -- 172.21.15.84:0/2030373091 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fead801a060 con 0x7feae80f66e0 2024-02-15T18:30:54.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.235+0000 7feacf7fe700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fead0060f20 0x7fead00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.235+0000 7feacf7fe700 1 -- 172.21.15.84:0/2030373091 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fead807c0a0 con 0x7feae80f66e0 2024-02-15T18:30:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.236+0000 7feae67fc700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fead0060f20 0x7fead00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.236+0000 7feae67fc700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fead0060f20 0x7fead00633e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7feadc009f50 tx=0x7feadc009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.240+0000 7feacf7fe700 1 -- 172.21.15.84:0/2030373091 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fead804c4c0 con 0x7feae80f66e0 2024-02-15T18:30:54.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.468+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feae8027a00 con 0x7feae80f66e0 2024-02-15T18:30:54.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.469+0000 7feacf7fe700 1 -- 172.21.15.84:0/2030373091 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7fead804fae0 con 0x7feae80f66e0 2024-02-15T18:30:54.462 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4, 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:30:54.463 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:30:54.464 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 8, 2024-02-15T18:30:54.464 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2024-02-15T18:30:54.464 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:30:54.464 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:30:54.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fead0060f20 msgr2=0x7fead00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fead0060f20 0x7fead00633e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7feadc009f50 tx=0x7feadc009b30).stop 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f66e0 msgr2=0x7feae806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f66e0 0x7feae806b9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fead80093f0 tx=0x7fead8006ec0).stop 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 shutdown_connections 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fead0060f20 0x7fead00633e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae80f66e0 0x7feae806b9a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 --2- 172.21.15.84:0/2030373091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80f7980 0x7feae8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 >> 172.21.15.84:0/2030373091 conn(0x7feae80f1e40 msgr2=0x7feae80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 shutdown_connections 2024-02-15T18:30:54.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.471+0000 7feaed73e700 1 -- 172.21.15.84:0/2030373091 wait complete. 2024-02-15T18:30:54.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.568+0000 7f159ec13700 1 -- 172.21.15.84:0/993124285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f6860 msgr2=0x7f15980f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.568+0000 7f159ec13700 1 --2- 172.21.15.84:0/993124285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f6860 0x7f15980f6cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f1584004660 tx=0x7f1584009b30).stop 2024-02-15T18:30:54.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 -- 172.21.15.84:0/993124285 shutdown_connections 2024-02-15T18:30:54.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 --2- 172.21.15.84:0/993124285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f6860 0x7f15980f6cc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 --2- 172.21.15.84:0/993124285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15980f55c0 0x7f15980f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 -- 172.21.15.84:0/993124285 >> 172.21.15.84:0/993124285 conn(0x7f15980f0d40 msgr2=0x7f15980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:54.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 -- 172.21.15.84:0/993124285 shutdown_connections 2024-02-15T18:30:54.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 -- 172.21.15.84:0/993124285 wait complete. 2024-02-15T18:30:54.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 Processor -- start 2024-02-15T18:30:54.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 -- start start 2024-02-15T18:30:54.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f55c0 0x7f1598109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15980f6860 0x7f159810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15980603e0 con 0x7f15980f55c0 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.569+0000 7f159ec13700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598060520 con 0x7f15980f6860 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f159c9af700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f55c0 0x7f1598109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f159c9af700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f55c0 0x7f1598109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44134/0 (socket says 172.21.15.84:44134) 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f159c9af700 1 -- 172.21.15.84:0/28040075 learned_addr learned my addr 172.21.15.84:0/28040075 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f1597fff700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15980f6860 0x7f159810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f159c9af700 1 -- 172.21.15.84:0/28040075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15980f6860 msgr2=0x7f159810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f159c9af700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15980f6860 0x7f159810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f159c9af700 1 -- 172.21.15.84:0/28040075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1584005040 con 0x7f15980f55c0 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f159c9af700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f55c0 0x7f1598109cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f158c00e7c0 tx=0x7f158c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f15957fa700 1 -- 172.21.15.84:0/28040075 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f158c0092e0 con 0x7f15980f55c0 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f15957fa700 1 -- 172.21.15.84:0/28040075 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f158c00f040 con 0x7f15980f55c0 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159810c760 con 0x7f15980f55c0 2024-02-15T18:30:54.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f15957fa700 1 -- 172.21.15.84:0/28040075 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f158c014920 con 0x7f15980f55c0 2024-02-15T18:30:54.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.570+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159810cd20 con 0x7f15980f55c0 2024-02-15T18:30:54.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.571+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1598045ad0 con 0x7f15980f55c0 2024-02-15T18:30:54.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.572+0000 7f15957fa700 1 -- 172.21.15.84:0/28040075 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f158c01b030 con 0x7f15980f55c0 2024-02-15T18:30:54.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.572+0000 7f15957fa700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1588060f20 0x7f15880633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:54.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.572+0000 7f15957fa700 1 -- 172.21.15.84:0/28040075 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f158c07bf90 con 0x7f15980f55c0 2024-02-15T18:30:54.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.572+0000 7f1597fff700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1588060f20 0x7f15880633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:54.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.572+0000 7f1597fff700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1588060f20 0x7f15880633e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f1584009720 tx=0x7f1584016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:54.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.576+0000 7f15957fa700 1 -- 172.21.15.84:0/28040075 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f158c04c410 con 0x7f15980f55c0 2024-02-15T18:30:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.783+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1598027a00 con 0x7f15980f55c0 2024-02-15T18:30:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.784+0000 7f15957fa700 1 -- 172.21.15.84:0/28040075 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1773 (secure 0 0 0) 0x7f158c019070 con 0x7f15980f55c0 2024-02-15T18:30:54.777 INFO:teuthology.orchestra.run.smithi084.stdout:e18 2024-02-15T18:30:54.777 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:30:54.777 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:30:54.777 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:30:54.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:30:54.777 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:30:54.777 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 18 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:30:43.076507+0000 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:30:54.778 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:30:54.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:30:54.780 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:30:54.780 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:30:54.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1588060f20 msgr2=0x7f15880633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1588060f20 0x7f15880633e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f1584009720 tx=0x7f1584016040).stop 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f55c0 msgr2=0x7f1598109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f55c0 0x7f1598109cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f158c00e7c0 tx=0x7f158c00b040).stop 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 shutdown_connections 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1588060f20 0x7f15880633e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15980f55c0 0x7f1598109cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 --2- 172.21.15.84:0/28040075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15980f6860 0x7f159810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 >> 172.21.15.84:0/28040075 conn(0x7f15980f0d40 msgr2=0x7f15980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.785+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 shutdown_connections 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.786+0000 7f159ec13700 1 -- 172.21.15.84:0/28040075 wait complete. 2024-02-15T18:30:54.781 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2024-02-15T18:30:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 -- 172.21.15.84:0/953459340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 msgr2=0x7f36bc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 --2- 172.21.15.84:0/953459340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 0x7f36bc0f7de0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f36ac004660 tx=0x7f36ac009b30).stop 2024-02-15T18:30:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 -- 172.21.15.84:0/953459340 shutdown_connections 2024-02-15T18:30:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 --2- 172.21.15.84:0/953459340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 0x7f36bc0f7de0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 --2- 172.21.15.84:0/953459340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36bc0f66e0 0x7f36bc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 -- 172.21.15.84:0/953459340 >> 172.21.15.84:0/953459340 conn(0x7f36bc0f1e40 msgr2=0x7f36bc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 -- 172.21.15.84:0/953459340 shutdown_connections 2024-02-15T18:30:54.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 -- 172.21.15.84:0/953459340 wait complete. 2024-02-15T18:30:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 Processor -- start 2024-02-15T18:30:54.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 -- start start 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36bc0f66e0 0x7f36bc107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 0x7f36bc1074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc107aa0 con 0x7f36bc0f7980 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.884+0000 7f36c0c27700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc107be0 con 0x7f36bc0f66e0 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36b9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 0x7f36bc1074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36b9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 0x7f36bc1074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44140/0 (socket says 172.21.15.84:44140) 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36b9d9b700 1 -- 172.21.15.84:0/48398100 learned_addr learned my addr 172.21.15.84:0/48398100 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36ba59c700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36bc0f66e0 0x7f36bc107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36b9d9b700 1 -- 172.21.15.84:0/48398100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36bc0f66e0 msgr2=0x7f36bc107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36b9d9b700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36bc0f66e0 0x7f36bc107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36b9d9b700 1 -- 172.21.15.84:0/48398100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac005040 con 0x7f36bc0f7980 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36b9d9b700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 0x7f36bc1074f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f36ac009f50 tx=0x7f36ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36aaffd700 1 -- 172.21.15.84:0/48398100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ac018070 con 0x7f36bc0f7980 2024-02-15T18:30:54.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36aaffd700 1 -- 172.21.15.84:0/48398100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f36ac007ba0 con 0x7f36bc0f7980 2024-02-15T18:30:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36bc108520 con 0x7f36bc0f7980 2024-02-15T18:30:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36aaffd700 1 -- 172.21.15.84:0/48398100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36ac01c420 con 0x7f36bc0f7980 2024-02-15T18:30:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.885+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36bc108a80 con 0x7f36bc0f7980 2024-02-15T18:30:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.886+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36bc045ad0 con 0x7f36bc0f7980 2024-02-15T18:30:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.886+0000 7f36aaffd700 1 -- 172.21.15.84:0/48398100 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f36ac01d420 con 0x7f36bc0f7980 2024-02-15T18:30:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.887+0000 7f36aaffd700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f36a4060f20 0x7f36a40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:54.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.887+0000 7f36aaffd700 1 -- 172.21.15.84:0/48398100 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f36ac07dcf0 con 0x7f36bc0f7980 2024-02-15T18:30:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.887+0000 7f36ba59c700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f36a4060f20 0x7f36a40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:54.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.887+0000 7f36ba59c700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f36a4060f20 0x7f36a40633e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f36bc0f77e0 tx=0x7f36b000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:54.891+0000 7f36aaffd700 1 -- 172.21.15.84:0/48398100 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f36ac051bc0 con 0x7f36bc0f7980 2024-02-15T18:30:55.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:52.739436+0000 mgr.smithi084.hjmnez (mgr.14596) 209 : cluster [DBG] pgmap v154: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:30:55.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:53.550182+0000 mgr.smithi084.hjmnez (mgr.14596) 210 : audit [DBG] from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:55.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:54.469680+0000 mon.smithi084 (mon.0) 364 : audit [DBG] from='client.? 172.21.15.84:0/2030373091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:55.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.082+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36bc108cf0 con 0x7f36a4060f20 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.083+0000 7f36aaffd700 1 -- 172.21.15.84:0/48398100 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f36bc108cf0 con 0x7f36a4060f20 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:30:55.077 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:30:55.078 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "11/21 daemons upgraded", 2024-02-15T18:30:55.078 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:30:55.078 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:30:55.078 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f36a4060f20 msgr2=0x7f36a40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f36a4060f20 0x7f36a40633e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f36bc0f77e0 tx=0x7f36b000b040).stop 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 msgr2=0x7f36bc1074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 0x7f36bc1074f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f36ac009f50 tx=0x7f36ac009b30).stop 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 shutdown_connections 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f36a4060f20 0x7f36a40633e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36bc0f66e0 0x7f36bc107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 --2- 172.21.15.84:0/48398100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36bc0f7980 0x7f36bc1074f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 >> 172.21.15.84:0/48398100 conn(0x7f36bc0f1e40 msgr2=0x7f36bc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 shutdown_connections 2024-02-15T18:30:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:30:55.085+0000 7f36c0c27700 1 -- 172.21.15.84:0/48398100 wait complete. 2024-02-15T18:30:55.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:52.739436+0000 mgr.smithi084.hjmnez (mgr.14596) 209 : cluster [DBG] pgmap v154: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:30:55.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:53.550182+0000 mgr.smithi084.hjmnez (mgr.14596) 210 : audit [DBG] from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:55.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:54.469680+0000 mon.smithi084 (mon.0) 364 : audit [DBG] from='client.? 172.21.15.84:0/2030373091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:56.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:53.845591+0000 mgr.smithi084.hjmnez (mgr.14596) 211 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:56.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:54.125930+0000 mgr.smithi084.hjmnez (mgr.14596) 212 : audit [DBG] from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:56.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:54.784638+0000 mon.smithi084 (mon.0) 365 : audit [DBG] from='client.? 172.21.15.84:0/28040075' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:30:56.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.058014+0000 mon.smithi084 (mon.0) 366 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:56.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.058684+0000 mon.smithi084 (mon.0) 367 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:56.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.059251+0000 mon.smithi084 (mon.0) 368 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:30:56.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.063026+0000 mon.smithi084 (mon.0) 369 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:56.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.070709+0000 mon.smithi084 (mon.0) 370 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:56.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.075545+0000 mon.smithi084 (mon.0) 371 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:56.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.077050+0000 mon.smithi084 (mon.0) 372 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:56.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.078476+0000 mon.smithi084 (mon.0) 373 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:56.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.080007+0000 mon.smithi084 (mon.0) 374 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:30:56.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:53.845591+0000 mgr.smithi084.hjmnez (mgr.14596) 211 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:56.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:54.125930+0000 mgr.smithi084.hjmnez (mgr.14596) 212 : audit [DBG] from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:56.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:54.784638+0000 mon.smithi084 (mon.0) 365 : audit [DBG] from='client.? 172.21.15.84:0/28040075' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:30:56.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.058014+0000 mon.smithi084 (mon.0) 366 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:56.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.058684+0000 mon.smithi084 (mon.0) 367 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:56.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.059251+0000 mon.smithi084 (mon.0) 368 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:30:56.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.063026+0000 mon.smithi084 (mon.0) 369 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:30:56.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.070709+0000 mon.smithi084 (mon.0) 370 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:56.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.075545+0000 mon.smithi084 (mon.0) 371 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:56.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.077050+0000 mon.smithi084 (mon.0) 372 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:56.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.078476+0000 mon.smithi084 (mon.0) 373 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:56.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.080007+0000 mon.smithi084 (mon.0) 374 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:30:57.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:54.739934+0000 mgr.smithi084.hjmnez (mgr.14596) 213 : cluster [DBG] pgmap v155: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:30:57.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:55.059739+0000 mgr.smithi084.hjmnez (mgr.14596) 214 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:30:57.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.080148+0000 mgr.smithi084.hjmnez (mgr.14596) 215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:30:57.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:30:55.080732+0000 mgr.smithi084.hjmnez (mgr.14596) 216 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T18:30:57.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:55.084333+0000 mgr.smithi084.hjmnez (mgr.14596) 217 : audit [DBG] from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:57.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:54.739934+0000 mgr.smithi084.hjmnez (mgr.14596) 213 : cluster [DBG] pgmap v155: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:30:57.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:55.059739+0000 mgr.smithi084.hjmnez (mgr.14596) 214 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:30:57.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.080148+0000 mgr.smithi084.hjmnez (mgr.14596) 215 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:30:57.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:30:55.080732+0000 mgr.smithi084.hjmnez (mgr.14596) 216 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T18:30:57.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:55.084333+0000 mgr.smithi084.hjmnez (mgr.14596) 217 : audit [DBG] from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:59.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:56.740414+0000 mgr.smithi084.hjmnez (mgr.14596) 218 : cluster [DBG] pgmap v156: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:30:59.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:56.740414+0000 mgr.smithi084.hjmnez (mgr.14596) 218 : cluster [DBG] pgmap v156: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:30:59.639 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:30:59.254+0000 7f3a26977380 -1 osd.4 68 log_to_monitors {default=true} 2024-02-15T18:31:00.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:59.258430+0000 mon.smithi133 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.133:6808/2903661734,v1:172.21.15.133:6809/2903661734]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:31:00.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:30:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:59.258961+0000 mon.smithi084 (mon.0) 375 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:31:00.139 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:30:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:30:59.713+0000 7f3a15659700 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:31:00.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:59.258430+0000 mon.smithi133 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.133:6808/2903661734,v1:172.21.15.133:6809/2903661734]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:31:00.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:30:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:59.258961+0000 mon.smithi084 (mon.0) 375 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:31:01.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:58.740958+0000 mgr.smithi084.hjmnez (mgr.14596) 219 : cluster [DBG] pgmap v157: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:31:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:59.703604+0000 mon.smithi084 (mon.0) 376 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T18:31:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:30:59.703668+0000 mon.smithi084 (mon.0) 377 : cluster [DBG] osdmap e71: 6 total, 5 up, 6 in 2024-02-15T18:31:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:59.705995+0000 mon.smithi133 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.133:6808/2903661734,v1:172.21.15.133:6809/2903661734]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:31:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:30:59.706548+0000 mon.smithi084 (mon.0) 378 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:31:01.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:00.071937+0000 mon.smithi084 (mon.0) 379 : cluster [WRN] Health check update: Degraded data redundancy: 59/345 objects degraded (17.101%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T18:31:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:58.740958+0000 mgr.smithi084.hjmnez (mgr.14596) 219 : cluster [DBG] pgmap v157: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:31:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:59.703604+0000 mon.smithi084 (mon.0) 376 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T18:31:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:30:59.703668+0000 mon.smithi084 (mon.0) 377 : cluster [DBG] osdmap e71: 6 total, 5 up, 6 in 2024-02-15T18:31:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:59.705995+0000 mon.smithi133 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.133:6808/2903661734,v1:172.21.15.133:6809/2903661734]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:31:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:30:59.706548+0000 mon.smithi084 (mon.0) 378 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:31:01.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:00.071937+0000 mon.smithi084 (mon.0) 379 : cluster [WRN] Health check update: Degraded data redundancy: 59/345 objects degraded (17.101%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T18:31:02.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:00.701565+0000 mon.smithi084 (mon.0) 380 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:31:02.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:00.705393+0000 mon.smithi084 (mon.0) 381 : cluster [INF] osd.4 [v2:172.21.15.133:6808/2903661734,v1:172.21.15.133:6809/2903661734] boot 2024-02-15T18:31:02.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:00.705437+0000 mon.smithi084 (mon.0) 382 : cluster [DBG] osdmap e72: 6 total, 6 up, 6 in 2024-02-15T18:31:02.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:00.705951+0000 mon.smithi084 (mon.0) 383 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:31:02.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:00.741529+0000 mgr.smithi084.hjmnez (mgr.14596) 220 : cluster [DBG] pgmap v160: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:31:02.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:01.710988+0000 mon.smithi084 (mon.0) 384 : cluster [DBG] osdmap e73: 6 total, 6 up, 6 in 2024-02-15T18:31:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:00.701565+0000 mon.smithi084 (mon.0) 380 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:31:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:00.705393+0000 mon.smithi084 (mon.0) 381 : cluster [INF] osd.4 [v2:172.21.15.133:6808/2903661734,v1:172.21.15.133:6809/2903661734] boot 2024-02-15T18:31:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:00.705437+0000 mon.smithi084 (mon.0) 382 : cluster [DBG] osdmap e72: 6 total, 6 up, 6 in 2024-02-15T18:31:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:00.705951+0000 mon.smithi084 (mon.0) 383 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:31:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:00.741529+0000 mgr.smithi084.hjmnez (mgr.14596) 220 : cluster [DBG] pgmap v160: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 59/345 objects degraded (17.101%) 2024-02-15T18:31:02.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:01.710988+0000 mon.smithi084 (mon.0) 384 : cluster [DBG] osdmap e73: 6 total, 6 up, 6 in 2024-02-15T18:31:04.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:02.742075+0000 mgr.smithi084.hjmnez (mgr.14596) 221 : cluster [DBG] pgmap v162: 65 pgs: 6 peering, 7 active+undersized+degraded, 7 active+undersized, 45 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 19/345 objects degraded (5.507%) 2024-02-15T18:31:04.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:02.742075+0000 mgr.smithi084.hjmnez (mgr.14596) 221 : cluster [DBG] pgmap v162: 65 pgs: 6 peering, 7 active+undersized+degraded, 7 active+undersized, 45 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 19/345 objects degraded (5.507%) 2024-02-15T18:31:05.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:04.796586+0000 mon.smithi084 (mon.0) 385 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/345 objects degraded (5.507%), 7 pgs degraded) 2024-02-15T18:31:05.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:04.796643+0000 mon.smithi084 (mon.0) 386 : cluster [INF] Cluster is now healthy 2024-02-15T18:31:05.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:04.796586+0000 mon.smithi084 (mon.0) 385 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/345 objects degraded (5.507%), 7 pgs degraded) 2024-02-15T18:31:05.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:04.796643+0000 mon.smithi084 (mon.0) 386 : cluster [INF] Cluster is now healthy 2024-02-15T18:31:06.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:04.742623+0000 mgr.smithi084.hjmnez (mgr.14596) 222 : cluster [DBG] pgmap v163: 65 pgs: 6 peering, 59 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:06.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:04.742623+0000 mgr.smithi084.hjmnez (mgr.14596) 222 : cluster [DBG] pgmap v163: 65 pgs: 6 peering, 59 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:08.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:06.743230+0000 mgr.smithi084.hjmnez (mgr.14596) 223 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:08.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:06.905733+0000 mon.smithi084 (mon.0) 387 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:08.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:06.743230+0000 mgr.smithi084.hjmnez (mgr.14596) 223 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:08.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:06.905733+0000 mon.smithi084 (mon.0) 387 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:10.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:08.743794+0000 mgr.smithi084.hjmnez (mgr.14596) 224 : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:10.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:08.743794+0000 mgr.smithi084.hjmnez (mgr.14596) 224 : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:11.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:10.096322+0000 mon.smithi084 (mon.0) 388 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:31:11.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:10.096525+0000 mgr.smithi084.hjmnez (mgr.14596) 225 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:31:11.140 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:10.097590+0000 mgr.smithi084.hjmnez (mgr.14596) 226 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-15T18:31:11.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:10.096322+0000 mon.smithi084 (mon.0) 388 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:31:11.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:10.096525+0000 mgr.smithi084.hjmnez (mgr.14596) 225 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:31:11.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:10.097590+0000 mgr.smithi084.hjmnez (mgr.14596) 226 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-15T18:31:12.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:10.744233+0000 mgr.smithi084.hjmnez (mgr.14596) 227 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:12.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:11.534037+0000 mgr.smithi084.hjmnez (mgr.14596) 228 : cephadm [INF] Upgrade: Updating osd.5 2024-02-15T18:31:12.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:11.539092+0000 mon.smithi084 (mon.0) 389 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:12.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:11.539940+0000 mon.smithi084 (mon.0) 390 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T18:31:12.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:11.540636+0000 mon.smithi084 (mon.0) 391 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:12.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:11.541833+0000 mgr.smithi084.hjmnez (mgr.14596) 229 : cephadm [INF] Deploying daemon osd.5 on smithi133 2024-02-15T18:31:12.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:12.021915+0000 mon.smithi084 (mon.0) 392 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:13.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:10.744233+0000 mgr.smithi084.hjmnez (mgr.14596) 227 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:13.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:11.534037+0000 mgr.smithi084.hjmnez (mgr.14596) 228 : cephadm [INF] Upgrade: Updating osd.5 2024-02-15T18:31:13.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:11.539092+0000 mon.smithi084 (mon.0) 389 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:13.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:11.539940+0000 mon.smithi084 (mon.0) 390 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T18:31:13.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:11.540636+0000 mon.smithi084 (mon.0) 391 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:13.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:11.541833+0000 mgr.smithi084.hjmnez (mgr.14596) 229 : cephadm [INF] Deploying daemon osd.5 on smithi133 2024-02-15T18:31:13.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:12.021915+0000 mon.smithi084 (mon.0) 392 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:14.534 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:14 smithi133 systemd[1]: Stopping Ceph osd.5 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:31:14.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:12.744737+0000 mgr.smithi084.hjmnez (mgr.14596) 230 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:14.892 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.5[52339]: debug 2024-02-15T18:31:14.559+0000 7f538b534700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:31:14.893 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.5[52339]: debug 2024-02-15T18:31:14.559+0000 7f538b534700 -1 osd.5 73 *** Got signal Terminated *** 2024-02-15T18:31:14.893 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.5[52339]: debug 2024-02-15T18:31:14.559+0000 7f538b534700 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:31:15.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:12.744737+0000 mgr.smithi084.hjmnez (mgr.14596) 230 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:15.389 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:15 smithi133 bash[65945]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.5 2024-02-15T18:31:15.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.682838+0000 mon.smithi084 (mon.0) 393 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.682871+0000 mon.smithi084 (mon.0) 394 : cluster [INF] osd.5 failed (root=default,host=smithi133) (connection refused reported by osd.1) 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.817659+0000 mon.smithi084 (mon.0) 395 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.817992+0000 mon.smithi084 (mon.0) 396 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.818127+0000 mon.smithi084 (mon.0) 397 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.818358+0000 mon.smithi084 (mon.0) 398 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.818488+0000 mon.smithi084 (mon.0) 399 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.818584+0000 mon.smithi084 (mon.0) 400 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.818669+0000 mon.smithi084 (mon.0) 401 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.818805+0000 mon.smithi084 (mon.0) 402 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:15.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.818916+0000 mon.smithi084 (mon.0) 403 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.819031+0000 mon.smithi084 (mon.0) 404 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.819119+0000 mon.smithi084 (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.219047+0000 mon.smithi084 (mon.0) 406 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.219268+0000 mon.smithi084 (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.219414+0000 mon.smithi084 (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.219556+0000 mon.smithi084 (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.219708+0000 mon.smithi084 (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.219924+0000 mon.smithi084 (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.220076+0000 mon.smithi084 (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.220212+0000 mon.smithi084 (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.220367+0000 mon.smithi084 (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.220549+0000 mon.smithi084 (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:15.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.220739+0000 mon.smithi084 (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:16.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.682838+0000 mon.smithi084 (mon.0) 393 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:16.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.682871+0000 mon.smithi084 (mon.0) 394 : cluster [INF] osd.5 failed (root=default,host=smithi133) (connection refused reported by osd.1) 2024-02-15T18:31:16.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.817659+0000 mon.smithi084 (mon.0) 395 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:31:16.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.817992+0000 mon.smithi084 (mon.0) 396 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.818127+0000 mon.smithi084 (mon.0) 397 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.818358+0000 mon.smithi084 (mon.0) 398 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.818488+0000 mon.smithi084 (mon.0) 399 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.818584+0000 mon.smithi084 (mon.0) 400 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.818669+0000 mon.smithi084 (mon.0) 401 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.818805+0000 mon.smithi084 (mon.0) 402 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.818916+0000 mon.smithi084 (mon.0) 403 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.819031+0000 mon.smithi084 (mon.0) 404 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.819119+0000 mon.smithi084 (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.219047+0000 mon.smithi084 (mon.0) 406 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.219268+0000 mon.smithi084 (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.219414+0000 mon.smithi084 (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.219556+0000 mon.smithi084 (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:16.008 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.219708+0000 mon.smithi084 (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:31:16.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.219924+0000 mon.smithi084 (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:16.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.220076+0000 mon.smithi084 (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:31:16.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.220212+0000 mon.smithi084 (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:31:16.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.220367+0000 mon.smithi084 (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:31:16.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.220549+0000 mon.smithi084 (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:16.009 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.220739+0000 mon.smithi084 (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:31:16.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:14.745244+0000 mgr.smithi084.hjmnez (mgr.14596) 231 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:16.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.541381+0000 mon.smithi084 (mon.0) 417 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:31:16.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:15.548910+0000 mon.smithi084 (mon.0) 418 : cluster [DBG] osdmap e74: 6 total, 5 up, 6 in 2024-02-15T18:31:17.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:14.745244+0000 mgr.smithi084.hjmnez (mgr.14596) 231 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:17.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.541381+0000 mon.smithi084 (mon.0) 417 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:31:17.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:15.548910+0000 mon.smithi084 (mon.0) 418 : cluster [DBG] osdmap e74: 6 total, 5 up, 6 in 2024-02-15T18:31:17.390 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:17 smithi133 systemd[1]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.5.service: Succeeded. 2024-02-15T18:31:17.390 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:17 smithi133 systemd[1]: Stopped Ceph osd.5 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:31:17.390 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:17 smithi133 systemd[1]: Starting Ceph osd.5 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:31:17.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:16.549567+0000 mon.smithi084 (mon.0) 419 : cluster [DBG] osdmap e75: 6 total, 5 up, 6 in 2024-02-15T18:31:18.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:16.549567+0000 mon.smithi084 (mon.0) 419 : cluster [DBG] osdmap e75: 6 total, 5 up, 6 in 2024-02-15T18:31:18.375 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:18 smithi133 bash[66243]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:31:18.375 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:18 smithi133 bash[66243]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T18:31:18.375 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:18 smithi133 bash[66243]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-02-15T18:31:18.375 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:18 smithi133 bash[66243]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-15T18:31:18.375 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:18 smithi133 bash[66243]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-02-15T18:31:18.375 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:18 smithi133 bash[66243]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T18:31:18.375 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:18 smithi133 bash[66243]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T18:31:18.375 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:18 smithi133 bash[66243]: --> ceph-volume lvm activate successful for osd ID: 5 2024-02-15T18:31:18.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:16.745885+0000 mgr.smithi084.hjmnez (mgr.14596) 232 : cluster [DBG] pgmap v171: 65 pgs: 11 stale+active+clean, 3 active+undersized, 51 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:19.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:16.745885+0000 mgr.smithi084.hjmnez (mgr.14596) 232 : cluster [DBG] pgmap v171: 65 pgs: 11 stale+active+clean, 3 active+undersized, 51 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:31:19.639 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:19 smithi133 bash[66491]: 93c01314b4557192a1d76cf6d8544e4fd6ce6f6a924a35b43230c7cc48edb6f5 2024-02-15T18:31:19.639 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:19 smithi133 systemd[1]: Started Ceph osd.5 for 631a4cdc-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:31:20.103 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:31:19.689+0000 7f99c04ae380 -1 Falling back to public interface 2024-02-15T18:31:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:18.746452+0000 mgr.smithi084.hjmnez (mgr.14596) 233 : cluster [DBG] pgmap v172: 65 pgs: 6 active+undersized+degraded, 8 stale+active+clean, 7 active+undersized, 44 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31/345 objects degraded (8.986%) 2024-02-15T18:31:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:19.304925+0000 mon.smithi084 (mon.0) 420 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:19.305767+0000 mon.smithi084 (mon.0) 421 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:19.555805+0000 mon.smithi084 (mon.0) 422 : cluster [WRN] Health check failed: Degraded data redundancy: 31/345 objects degraded (8.986%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:31:20.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:18.746452+0000 mgr.smithi084.hjmnez (mgr.14596) 233 : cluster [DBG] pgmap v172: 65 pgs: 6 active+undersized+degraded, 8 stale+active+clean, 7 active+undersized, 44 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31/345 objects degraded (8.986%) 2024-02-15T18:31:20.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:19.304925+0000 mon.smithi084 (mon.0) 420 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:20.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:19.305767+0000 mon.smithi084 (mon.0) 421 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:20.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:19.555805+0000 mon.smithi084 (mon.0) 422 : cluster [WRN] Health check failed: Degraded data redundancy: 31/345 objects degraded (8.986%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:31:22.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:20.747063+0000 mgr.smithi084.hjmnez (mgr.14596) 234 : cluster [DBG] pgmap v173: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:31:22.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:21.905769+0000 mon.smithi084 (mon.0) 423 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:22.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:20.747063+0000 mgr.smithi084.hjmnez (mgr.14596) 234 : cluster [DBG] pgmap v173: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:31:22.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:21.905769+0000 mon.smithi084 (mon.0) 423 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:23.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.431860+0000 mon.smithi084 (mon.0) 424 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.432736+0000 mon.smithi084 (mon.0) 425 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.433553+0000 mon.smithi084 (mon.0) 426 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:22.434270+0000 mgr.smithi084.hjmnez (mgr.14596) 235 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.437895+0000 mon.smithi084 (mon.0) 427 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.443539+0000 mon.smithi084 (mon.0) 428 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.446428+0000 mon.smithi084 (mon.0) 429 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.448060+0000 mon.smithi084 (mon.0) 430 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.449650+0000 mon.smithi084 (mon.0) 431 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.451421+0000 mon.smithi084 (mon.0) 432 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:22.452055+0000 mgr.smithi084.hjmnez (mgr.14596) 236 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-15T18:31:23.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.457976+0000 mon.smithi084 (mon.0) 433 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.458871+0000 mon.smithi084 (mon.0) 434 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.462322+0000 mon.smithi084 (mon.0) 435 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.462996+0000 mon.smithi084 (mon.0) 436 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.468521+0000 mon.smithi084 (mon.0) 437 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.469205+0000 mon.smithi084 (mon.0) 438 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.472514+0000 mon.smithi084 (mon.0) 439 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.473156+0000 mon.smithi084 (mon.0) 440 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.478638+0000 mon.smithi084 (mon.0) 441 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.479269+0000 mon.smithi084 (mon.0) 442 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.482486+0000 mon.smithi084 (mon.0) 443 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.483113+0000 mon.smithi084 (mon.0) 444 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-15T18:31:23.759 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.486577+0000 mon.smithi084 (mon.0) 445 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-15T18:31:23.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:22.488089+0000 mgr.smithi084.hjmnez (mgr.14596) 237 : cephadm [INF] Upgrade: Scaling down filesystem cephfs 2024-02-15T18:31:23.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.490680+0000 mon.smithi084 (mon.0) 446 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:23.760 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:22.491061+0000 mon.smithi084 (mon.0) 447 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.431860+0000 mon.smithi084 (mon.0) 424 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.432736+0000 mon.smithi084 (mon.0) 425 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.433553+0000 mon.smithi084 (mon.0) 426 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:22.434270+0000 mgr.smithi084.hjmnez (mgr.14596) 235 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.437895+0000 mon.smithi084 (mon.0) 427 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.443539+0000 mon.smithi084 (mon.0) 428 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.446428+0000 mon.smithi084 (mon.0) 429 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.448060+0000 mon.smithi084 (mon.0) 430 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.449650+0000 mon.smithi084 (mon.0) 431 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:23.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.451421+0000 mon.smithi084 (mon.0) 432 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:22.452055+0000 mgr.smithi084.hjmnez (mgr.14596) 236 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.457976+0000 mon.smithi084 (mon.0) 433 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.458871+0000 mon.smithi084 (mon.0) 434 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.462322+0000 mon.smithi084 (mon.0) 435 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.462996+0000 mon.smithi084 (mon.0) 436 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.468521+0000 mon.smithi084 (mon.0) 437 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.469205+0000 mon.smithi084 (mon.0) 438 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.472514+0000 mon.smithi084 (mon.0) 439 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.473156+0000 mon.smithi084 (mon.0) 440 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.478638+0000 mon.smithi084 (mon.0) 441 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.479269+0000 mon.smithi084 (mon.0) 442 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.482486+0000 mon.smithi084 (mon.0) 443 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.483113+0000 mon.smithi084 (mon.0) 444 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-15T18:31:23.891 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.486577+0000 mon.smithi084 (mon.0) 445 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-15T18:31:23.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:22.488089+0000 mgr.smithi084.hjmnez (mgr.14596) 237 : cephadm [INF] Upgrade: Scaling down filesystem cephfs 2024-02-15T18:31:23.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.490680+0000 mon.smithi084 (mon.0) 446 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:23.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:22.491061+0000 mon.smithi084 (mon.0) 447 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-15T18:31:24.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:22.747608+0000 mgr.smithi084.hjmnez (mgr.14596) 238 : cluster [DBG] pgmap v174: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:31:24.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.494815+0000 mon.smithi084 (mon.0) 448 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-15T18:31:24.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:23.494884+0000 mon.smithi084 (mon.0) 449 : cluster [INF] stopping daemon mds.cephfs.smithi084.cuytny 2024-02-15T18:31:24.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:23.495166+0000 mon.smithi084 (mon.0) 450 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:31:24.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:23.497540+0000 mon.smithi084 (mon.0) 451 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:stopping} 2 up:standby 2024-02-15T18:31:24.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.497712+0000 mon.smithi084 (mon.0) 452 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.499471+0000 mon.smithi084 (mon.0) 453 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.500246+0000 mon.smithi084 (mon.0) 454 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:23.500918+0000 mgr.smithi084.hjmnez (mgr.14596) 239 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.504641+0000 mon.smithi084 (mon.0) 455 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.510632+0000 mon.smithi084 (mon.0) 456 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.513032+0000 mon.smithi084 (mon.0) 457 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.514334+0000 mon.smithi084 (mon.0) 458 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.515855+0000 mon.smithi084 (mon.0) 459 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:23.517861+0000 mon.smithi084 (mon.0) 460 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:24.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:23.519466+0000 mgr.smithi084.hjmnez (mgr.14596) 240 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:31:24.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:22.747608+0000 mgr.smithi084.hjmnez (mgr.14596) 238 : cluster [DBG] pgmap v174: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:31:24.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.494815+0000 mon.smithi084 (mon.0) 448 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-15T18:31:24.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:23.494884+0000 mon.smithi084 (mon.0) 449 : cluster [INF] stopping daemon mds.cephfs.smithi084.cuytny 2024-02-15T18:31:24.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:23.495166+0000 mon.smithi084 (mon.0) 450 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:active} 2 up:standby 2024-02-15T18:31:24.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:23.497540+0000 mon.smithi084 (mon.0) 451 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:stopping} 2 up:standby 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.497712+0000 mon.smithi084 (mon.0) 452 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.499471+0000 mon.smithi084 (mon.0) 453 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.500246+0000 mon.smithi084 (mon.0) 454 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:23.500918+0000 mgr.smithi084.hjmnez (mgr.14596) 239 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.504641+0000 mon.smithi084 (mon.0) 455 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.510632+0000 mon.smithi084 (mon.0) 456 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.513032+0000 mon.smithi084 (mon.0) 457 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.514334+0000 mon.smithi084 (mon.0) 458 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.515855+0000 mon.smithi084 (mon.0) 459 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:23.517861+0000 mon.smithi084 (mon.0) 460 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:24.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:23.519466+0000 mgr.smithi084.hjmnez (mgr.14596) 240 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:31:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.195+0000 7f01e0482700 1 -- 172.21.15.84:0/4132296262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f66e0 msgr2=0x7f01d80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.195+0000 7f01e0482700 1 --2- 172.21.15.84:0/4132296262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f66e0 0x7f01d80f6b00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f01d4004660 tx=0x7f01d4009b30).stop 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.195+0000 7f01e0482700 1 -- 172.21.15.84:0/4132296262 shutdown_connections 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.195+0000 7f01e0482700 1 --2- 172.21.15.84:0/4132296262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d80f7980 0x7f01d80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.195+0000 7f01e0482700 1 --2- 172.21.15.84:0/4132296262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f66e0 0x7f01d80f6b00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01e0482700 1 -- 172.21.15.84:0/4132296262 >> 172.21.15.84:0/4132296262 conn(0x7f01d80f1e40 msgr2=0x7f01d80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01e0482700 1 -- 172.21.15.84:0/4132296262 shutdown_connections 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01e0482700 1 -- 172.21.15.84:0/4132296262 wait complete. 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01e0482700 1 Processor -- start 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01e0482700 1 -- start start 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01e0482700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d80f66e0 0x7f01d806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01e0482700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f7980 0x7f01d8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01e0482700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d806a380 con 0x7f01d80f7980 2024-02-15T18:31:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01e0482700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d806a4c0 con 0x7f01d80f66e0 2024-02-15T18:31:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01dda1d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f7980 0x7f01d8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01dda1d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f7980 0x7f01d8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38676/0 (socket says 172.21.15.84:38676) 2024-02-15T18:31:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.196+0000 7f01dda1d700 1 -- 172.21.15.84:0/3173486914 learned_addr learned my addr 172.21.15.84:0/3173486914 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01de21e700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d80f66e0 0x7f01d806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01dda1d700 1 -- 172.21.15.84:0/3173486914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d80f66e0 msgr2=0x7f01d806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01dda1d700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d80f66e0 0x7f01d806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01dda1d700 1 -- 172.21.15.84:0/3173486914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4005040 con 0x7f01d80f7980 2024-02-15T18:31:25.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01dda1d700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f7980 0x7f01d8069e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f01cc00e7f0 tx=0x7f01cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01caffd700 1 -- 172.21.15.84:0/3173486914 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01cc0092e0 con 0x7f01d80f7980 2024-02-15T18:31:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d806a7a0 con 0x7f01d80f7980 2024-02-15T18:31:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01caffd700 1 -- 172.21.15.84:0/3173486914 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f01cc00f040 con 0x7f01d80f7980 2024-02-15T18:31:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01caffd700 1 -- 172.21.15.84:0/3173486914 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01cc014850 con 0x7f01d80f7980 2024-02-15T18:31:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.197+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d810f060 con 0x7f01d80f7980 2024-02-15T18:31:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.198+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d8045ad0 con 0x7f01d80f7980 2024-02-15T18:31:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.198+0000 7f01caffd700 1 -- 172.21.15.84:0/3173486914 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f01cc01b030 con 0x7f01d80f7980 2024-02-15T18:31:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.199+0000 7f01caffd700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01c4060f20 0x7f01c40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.199+0000 7f01caffd700 1 -- 172.21.15.84:0/3173486914 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f01cc07be30 con 0x7f01d80f7980 2024-02-15T18:31:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.199+0000 7f01de21e700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01c4060f20 0x7f01c40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:25.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.199+0000 7f01de21e700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01c4060f20 0x7f01c40633e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f01d4004d80 tx=0x7f01d4016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:25.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.203+0000 7f01caffd700 1 -- 172.21.15.84:0/3173486914 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f01cc04c360 con 0x7f01d80f7980 2024-02-15T18:31:25.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.382+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01d80ff120 con 0x7f01c4060f20 2024-02-15T18:31:25.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.383+0000 7f01caffd700 1 -- 172.21.15.84:0/3173486914 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f01d80ff120 con 0x7f01c4060f20 2024-02-15T18:31:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01c4060f20 msgr2=0x7f01c40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01c4060f20 0x7f01c40633e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f01d4004d80 tx=0x7f01d4016040).stop 2024-02-15T18:31:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f7980 msgr2=0x7f01d8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f7980 0x7f01d8069e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f01cc00e7f0 tx=0x7f01cc00b040).stop 2024-02-15T18:31:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 shutdown_connections 2024-02-15T18:31:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f01c4060f20 0x7f01c40633e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d80f66e0 0x7f01d806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 --2- 172.21.15.84:0/3173486914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d80f7980 0x7f01d8069e20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 >> 172.21.15.84:0/3173486914 conn(0x7f01d80f1e40 msgr2=0x7f01d80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:25.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 shutdown_connections 2024-02-15T18:31:25.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.385+0000 7f01e0482700 1 -- 172.21.15.84:0/3173486914 wait complete. 2024-02-15T18:31:25.388 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.483+0000 7f9cbb59e700 1 -- 172.21.15.84:0/1922026662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 msgr2=0x7f9cbc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.483+0000 7f9cbb59e700 1 --2- 172.21.15.84:0/1922026662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 0x7f9cbc0f6b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9cb0004660 tx=0x7f9cb0009b30).stop 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.483+0000 7f9cbb59e700 1 -- 172.21.15.84:0/1922026662 shutdown_connections 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.483+0000 7f9cbb59e700 1 --2- 172.21.15.84:0/1922026662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 0x7f9cbc0f6b30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.483+0000 7f9cbb59e700 1 --2- 172.21.15.84:0/1922026662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cbc0f5430 0x7f9cbc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.483+0000 7f9cbb59e700 1 -- 172.21.15.84:0/1922026662 >> 172.21.15.84:0/1922026662 conn(0x7f9cbc0f0b90 msgr2=0x7f9cbc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.483+0000 7f9cbb59e700 1 -- 172.21.15.84:0/1922026662 shutdown_connections 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.483+0000 7f9cbb59e700 1 -- 172.21.15.84:0/1922026662 wait complete. 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cbb59e700 1 Processor -- start 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cbb59e700 1 -- start start 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cbb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cbc0f5430 0x7f9cbc105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cbb59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 0x7f9cbc106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cbb59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc1067f0 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cbb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc106ff0 con 0x7f9cbc0f5430 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cb9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 0x7f9cbc106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cb9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 0x7f9cbc106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38694/0 (socket says 172.21.15.84:38694) 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cb9d9b700 1 -- 172.21.15.84:0/4024114620 learned_addr learned my addr 172.21.15.84:0/4024114620 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cba59c700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cbc0f5430 0x7f9cbc105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cb9d9b700 1 -- 172.21.15.84:0/4024114620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cbc0f5430 msgr2=0x7f9cbc105d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cb9d9b700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cbc0f5430 0x7f9cbc105d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cb9d9b700 1 -- 172.21.15.84:0/4024114620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0005040 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.484+0000 7f9cb9d9b700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 0x7f9cbc106240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9cb0009f50 tx=0x7f9cb0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.485+0000 7f9caaffd700 1 -- 172.21.15.84:0/4024114620 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb001a070 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.485+0000 7f9caaffd700 1 -- 172.21.15.84:0/4024114620 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9cb001faf0 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.485+0000 7f9caaffd700 1 -- 172.21.15.84:0/4024114620 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb001e860 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.485+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc107270 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.485+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc107700 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.486+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc059100 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.486+0000 7f9caaffd700 1 -- 172.21.15.84:0/4024114620 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f9cb001eb20 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.486+0000 7f9caaffd700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9ca4060f70 0x7f9ca4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:25.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.486+0000 7f9caaffd700 1 -- 172.21.15.84:0/4024114620 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9cb00802e0 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.486+0000 7f9cba59c700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9ca4060f70 0x7f9ca4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:25.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.487+0000 7f9cba59c700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9ca4060f70 0x7f9ca4063430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9cbc0f6530 tx=0x7f9cac00b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:25.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.492+0000 7f9caaffd700 1 -- 172.21.15.84:0/4024114620 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9cb00542e0 con 0x7f9cbc0f66d0 2024-02-15T18:31:25.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.673+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cbc0fdec0 con 0x7f9ca4060f70 2024-02-15T18:31:25.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.674+0000 7f9caaffd700 1 -- 172.21.15.84:0/4024114620 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9cbc0fdec0 con 0x7f9ca4060f70 2024-02-15T18:31:25.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9ca4060f70 msgr2=0x7f9ca4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9ca4060f70 0x7f9ca4063430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9cbc0f6530 tx=0x7f9cac00b040).stop 2024-02-15T18:31:25.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 msgr2=0x7f9cbc106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 0x7f9cbc106240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9cb0009f50 tx=0x7f9cb0009b30).stop 2024-02-15T18:31:25.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 shutdown_connections 2024-02-15T18:31:25.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9ca4060f70 0x7f9ca4063430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cbc0f5430 0x7f9cbc105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 --2- 172.21.15.84:0/4024114620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cbc0f66d0 0x7f9cbc106240 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 >> 172.21.15.84:0/4024114620 conn(0x7f9cbc0f0b90 msgr2=0x7f9cbc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:25.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 shutdown_connections 2024-02-15T18:31:25.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.676+0000 7f9cbb59e700 1 -- 172.21.15.84:0/4024114620 wait complete. 2024-02-15T18:31:25.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:25 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:25.076838+0000 mon.smithi084 (mon.0) 461 : cluster [WRN] Health check update: Degraded data redundancy: 53/345 objects degraded (15.362%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T18:31:25.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.774+0000 7f8e59310700 1 -- 172.21.15.84:0/3066291682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f55d0 msgr2=0x7f8e540f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.774+0000 7f8e59310700 1 --2- 172.21.15.84:0/3066291682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f55d0 0x7f8e540f59f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f8e48004660 tx=0x7f8e48009b30).stop 2024-02-15T18:31:25.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.774+0000 7f8e59310700 1 -- 172.21.15.84:0/3066291682 shutdown_connections 2024-02-15T18:31:25.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.774+0000 7f8e59310700 1 --2- 172.21.15.84:0/3066291682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540f6870 0x7f8e540f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.774+0000 7f8e59310700 1 --2- 172.21.15.84:0/3066291682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f55d0 0x7f8e540f59f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.774+0000 7f8e59310700 1 -- 172.21.15.84:0/3066291682 >> 172.21.15.84:0/3066291682 conn(0x7f8e540f0d70 msgr2=0x7f8e540f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:25.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.774+0000 7f8e59310700 1 -- 172.21.15.84:0/3066291682 shutdown_connections 2024-02-15T18:31:25.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.774+0000 7f8e59310700 1 -- 172.21.15.84:0/3066291682 wait complete. 2024-02-15T18:31:25.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e59310700 1 Processor -- start 2024-02-15T18:31:25.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e59310700 1 -- start start 2024-02-15T18:31:25.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e59310700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540f55d0 0x7f8e54105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:25.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e59310700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f6870 0x7f8e541063c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:25.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e59310700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e54106970 con 0x7f8e540f6870 2024-02-15T18:31:25.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e59310700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e54106ab0 con 0x7f8e540f55d0 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e527fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f6870 0x7f8e541063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e527fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f6870 0x7f8e541063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38714/0 (socket says 172.21.15.84:38714) 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e527fc700 1 -- 172.21.15.84:0/3843315032 learned_addr learned my addr 172.21.15.84:0/3843315032 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e52ffd700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540f55d0 0x7f8e54105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e527fc700 1 -- 172.21.15.84:0/3843315032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540f55d0 msgr2=0x7f8e54105ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e527fc700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540f55d0 0x7f8e54105ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e527fc700 1 -- 172.21.15.84:0/3843315032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48005040 con 0x7f8e540f6870 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.775+0000 7f8e527fc700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f6870 0x7f8e541063c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f8e44002700 tx=0x7f8e44009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.776+0000 7f8e3b7fe700 1 -- 172.21.15.84:0/3843315032 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e44009320 con 0x7f8e540f6870 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.776+0000 7f8e3b7fe700 1 -- 172.21.15.84:0/3843315032 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f8e4400f040 con 0x7f8e540f6870 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.776+0000 7f8e3b7fe700 1 -- 172.21.15.84:0/3843315032 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e440149a0 con 0x7f8e540f6870 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.776+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e54107450 con 0x7f8e540f6870 2024-02-15T18:31:25.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.776+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e54107990 con 0x7f8e540f6870 2024-02-15T18:31:25.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.777+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e54045ad0 con 0x7f8e540f6870 2024-02-15T18:31:25.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.777+0000 7f8e3b7fe700 1 -- 172.21.15.84:0/3843315032 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f8e440077b0 con 0x7f8e540f6870 2024-02-15T18:31:25.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.777+0000 7f8e3b7fe700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8e3c060f20 0x7f8e3c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:25.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.777+0000 7f8e3b7fe700 1 -- 172.21.15.84:0/3843315032 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8e4407c3a0 con 0x7f8e540f6870 2024-02-15T18:31:25.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.777+0000 7f8e52ffd700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8e3c060f20 0x7f8e3c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:25.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.778+0000 7f8e52ffd700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8e3c060f20 0x7f8e3c0633e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f8e48004630 tx=0x7f8e48009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:25.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.782+0000 7f8e3b7fe700 1 -- 172.21.15.84:0/3843315032 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8e44050250 con 0x7f8e540f6870 2024-02-15T18:31:25.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:25 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:25.076838+0000 mon.smithi084 (mon.0) 461 : cluster [WRN] Health check update: Degraded data redundancy: 53/345 objects degraded (15.362%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T18:31:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.959+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e54107c10 con 0x7f8e3c060f20 2024-02-15T18:31:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.968+0000 7f8e3b7fe700 1 -- 172.21.15.84:0/3843315032 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8e54107c10 con 0x7f8e3c060f20 2024-02-15T18:31:25.961 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (10m) 87s ago 12m 18.0M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (3m) 87s ago 12m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (3m) 3s ago 11m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (10m) 87s ago 12m 35.6M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (7m) 87s ago 7m 121M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (7m) 87s ago 7m 14.1M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (7m) 3s ago 7m 124M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (7m) 3s ago 7m 15.0M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (4m) 87s ago 13m 433M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (4m) 3s ago 11m 389M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (3m) 87s ago 13m 46.1M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (3m) 3s ago 11m 40.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (11m) 87s ago 11m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:31:25.962 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (11m) 3s ago 11m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:31:25.963 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (2m) 87s ago 10m 207M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:31:25.963 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (2m) 87s ago 10m 236M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:31:25.963 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (93s) 87s ago 9m 12.8M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:31:25.963 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (63s) 3s ago 9m 264M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc b8c15d05905a 2024-02-15T18:31:25.963 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (34s) 3s ago 9m 239M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 612e5da9dba4 2024-02-15T18:31:25.963 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (7s) 3s ago 8m 11.6M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 93c01314b455 2024-02-15T18:31:25.963 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (5m) 87s ago 11m 67.9M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8e3c060f20 msgr2=0x7f8e3c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8e3c060f20 0x7f8e3c0633e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f8e48004630 tx=0x7f8e48009b30).stop 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f6870 msgr2=0x7f8e541063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f6870 0x7f8e541063c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f8e44002700 tx=0x7f8e44009e00).stop 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 shutdown_connections 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8e3c060f20 0x7f8e3c0633e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e540f55d0 0x7f8e54105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 --2- 172.21.15.84:0/3843315032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e540f6870 0x7f8e541063c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 >> 172.21.15.84:0/3843315032 conn(0x7f8e540f0d70 msgr2=0x7f8e540fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 shutdown_connections 2024-02-15T18:31:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:25.970+0000 7f8e59310700 1 -- 172.21.15.84:0/3843315032 wait complete. 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.067+0000 7fbe02303700 1 -- 172.21.15.84:0/1707696871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f5970 msgr2=0x7fbdfc0f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.067+0000 7fbe02303700 1 --2- 172.21.15.84:0/1707696871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f5970 0x7fbdfc0f5df0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fbde4004660 tx=0x7fbde4009b30).stop 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.067+0000 7fbe02303700 1 -- 172.21.15.84:0/1707696871 shutdown_connections 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.067+0000 7fbe02303700 1 --2- 172.21.15.84:0/1707696871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f5970 0x7fbdfc0f5df0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.067+0000 7fbe02303700 1 --2- 172.21.15.84:0/1707696871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0f6c60 0x7fbdfc0f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.067+0000 7fbe02303700 1 -- 172.21.15.84:0/1707696871 >> 172.21.15.84:0/1707696871 conn(0x7fbdfc0f04c0 msgr2=0x7fbdfc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.067+0000 7fbe02303700 1 -- 172.21.15.84:0/1707696871 shutdown_connections 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.067+0000 7fbe02303700 1 -- 172.21.15.84:0/1707696871 wait complete. 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.067+0000 7fbe02303700 1 Processor -- start 2024-02-15T18:31:26.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbe02303700 1 -- start start 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbe02303700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0f5970 0x7fbdfc107040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbe02303700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f6c60 0x7fbdfc107530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbe02303700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc107ae0 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbe02303700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc107c20 con 0x7fbdfc0f5970 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbdfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f6c60 0x7fbdfc107530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbdfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f6c60 0x7fbdfc107530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38722/0 (socket says 172.21.15.84:38722) 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbdfbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0f5970 0x7fbdfc107040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbdfb7fe700 1 -- 172.21.15.84:0/1910773319 learned_addr learned my addr 172.21.15.84:0/1910773319 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbdfb7fe700 1 -- 172.21.15.84:0/1910773319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0f5970 msgr2=0x7fbdfc107040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbdfb7fe700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0f5970 0x7fbdfc107040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbdfb7fe700 1 -- 172.21.15.84:0/1910773319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4005040 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.068+0000 7fbdfb7fe700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f6c60 0x7fbdfc107530 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbde4009f50 tx=0x7fbde4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:26.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.069+0000 7fbdf8ff9700 1 -- 172.21.15.84:0/1910773319 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbde4018070 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.069+0000 7fbdf8ff9700 1 -- 172.21.15.84:0/1910773319 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fbde4004290 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.069+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc108560 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.069+0000 7fbdf8ff9700 1 -- 172.21.15.84:0/1910773319 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbde401c3c0 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.069+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc108a40 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.070+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc045ad0 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.070+0000 7fbdf8ff9700 1 -- 172.21.15.84:0/1910773319 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fbde401c630 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.070+0000 7fbdf8ff9700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fbde8060f20 0x7fbde80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:26.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.070+0000 7fbdf8ff9700 1 -- 172.21.15.84:0/1910773319 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fbde407dd00 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.070+0000 7fbdfbfff700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fbde8060f20 0x7fbde80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:26.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.071+0000 7fbdfbfff700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fbde8060f20 0x7fbde80633e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fbdec004ce0 tx=0x7fbdec00b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:26.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.074+0000 7fbdf8ff9700 1 -- 172.21.15.84:0/1910773319 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbde4081030 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.301+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbdfc0fdf50 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.301+0000 7fbdf8ff9700 1 -- 172.21.15.84:0/1910773319 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+726 (secure 0 0 0) 0x7fbde4051d00 con 0x7fbdfc0f6c60 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 5 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:31:26.295 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:31:26.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:31:26.296 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:31:26.296 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 9, 2024-02-15T18:31:26.296 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:31:26.296 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:31:26.296 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fbde8060f20 msgr2=0x7fbde80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fbde8060f20 0x7fbde80633e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fbdec004ce0 tx=0x7fbdec00b040).stop 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f6c60 msgr2=0x7fbdfc107530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f6c60 0x7fbdfc107530 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbde4009f50 tx=0x7fbde4009b30).stop 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 shutdown_connections 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fbde8060f20 0x7fbde80633e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdfc0f5970 0x7fbdfc107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 --2- 172.21.15.84:0/1910773319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdfc0f6c60 0x7fbdfc107530 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 >> 172.21.15.84:0/1910773319 conn(0x7fbdfc0f04c0 msgr2=0x7fbdfc0f5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 shutdown_connections 2024-02-15T18:31:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.303+0000 7fbe02303700 1 -- 172.21.15.84:0/1910773319 wait complete. 2024-02-15T18:31:26.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 -- 172.21.15.84:0/160232696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f55c0 msgr2=0x7fd4bc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 --2- 172.21.15.84:0/160232696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f55c0 0x7fd4bc0f59e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fd4ac004660 tx=0x7fd4ac009b30).stop 2024-02-15T18:31:26.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 -- 172.21.15.84:0/160232696 shutdown_connections 2024-02-15T18:31:26.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 --2- 172.21.15.84:0/160232696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f6860 0x7fd4bc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 --2- 172.21.15.84:0/160232696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f55c0 0x7fd4bc0f59e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 -- 172.21.15.84:0/160232696 >> 172.21.15.84:0/160232696 conn(0x7fd4bc0f0d40 msgr2=0x7fd4bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:26.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 -- 172.21.15.84:0/160232696 shutdown_connections 2024-02-15T18:31:26.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 -- 172.21.15.84:0/160232696 wait complete. 2024-02-15T18:31:26.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 Processor -- start 2024-02-15T18:31:26.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.401+0000 7fd4c3c17700 1 -- start start 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c3c17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f55c0 0x7fd4bc105f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c3c17700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6860 0x7fd4bc1063f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c3c17700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc1069a0 con 0x7fd4bc0f6860 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c3c17700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc106ae0 con 0x7fd4bc0f55c0 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c11b2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6860 0x7fd4bc1063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c11b2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6860 0x7fd4bc1063f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38744/0 (socket says 172.21.15.84:38744) 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c11b2700 1 -- 172.21.15.84:0/807557296 learned_addr learned my addr 172.21.15.84:0/807557296 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c19b3700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f55c0 0x7fd4bc105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c11b2700 1 -- 172.21.15.84:0/807557296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f55c0 msgr2=0x7fd4bc105f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c11b2700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f55c0 0x7fd4bc105f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c11b2700 1 -- 172.21.15.84:0/807557296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac005040 con 0x7fd4bc0f6860 2024-02-15T18:31:26.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c11b2700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6860 0x7fd4bc1063f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd4b80026d0 tx=0x7fd4b8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:26.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4b27fc700 1 -- 172.21.15.84:0/807557296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b80079c0 con 0x7fd4bc0f6860 2024-02-15T18:31:26.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc107480 con 0x7fd4bc0f6860 2024-02-15T18:31:26.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4b27fc700 1 -- 172.21.15.84:0/807557296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd4b800f040 con 0x7fd4bc0f6860 2024-02-15T18:31:26.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.402+0000 7fd4b27fc700 1 -- 172.21.15.84:0/807557296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b80149f0 con 0x7fd4bc0f6860 2024-02-15T18:31:26.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.403+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc107a40 con 0x7fd4bc0f6860 2024-02-15T18:31:26.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.403+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc045ad0 con 0x7fd4bc0f6860 2024-02-15T18:31:26.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.404+0000 7fd4b27fc700 1 -- 172.21.15.84:0/807557296 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd4b8007b20 con 0x7fd4bc0f6860 2024-02-15T18:31:26.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.404+0000 7fd4b27fc700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd4a8060f20 0x7fd4a80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:26.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.404+0000 7fd4b27fc700 1 -- 172.21.15.84:0/807557296 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd4b807c0e0 con 0x7fd4bc0f6860 2024-02-15T18:31:26.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.404+0000 7fd4c19b3700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd4a8060f20 0x7fd4a80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:26.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.405+0000 7fd4c19b3700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd4a8060f20 0x7fd4a80633e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd4ac004630 tx=0x7fd4ac009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:26.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.408+0000 7fd4b27fc700 1 -- 172.21.15.84:0/807557296 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd4b804ff90 con 0x7fd4bc0f6860 2024-02-15T18:31:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.614+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4bc027a00 con 0x7fd4bc0f6860 2024-02-15T18:31:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.614+0000 7fd4b27fc700 1 -- 172.21.15.84:0/807557296 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1775 (secure 0 0 0) 0x7fd4b804fb80 con 0x7fd4bc0f6860 2024-02-15T18:31:26.607 INFO:teuthology.orchestra.run.smithi084.stdout:e20 2024-02-15T18:31:26.607 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:31:26.607 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:31:26.607 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:31:26.607 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 20 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:31:23.494912+0000 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:31:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 1 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239,1=14438} 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{1:14438} state up:stopping seq 2 join_fscid=1 addr [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:31:26.609 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:31:26.610 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:31:26.610 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:31:26.610 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:31:26.610 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:31:26.610 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd4a8060f20 msgr2=0x7fd4a80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd4a8060f20 0x7fd4a80633e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd4ac004630 tx=0x7fd4ac009b30).stop 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6860 msgr2=0x7fd4bc1063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6860 0x7fd4bc1063f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd4b80026d0 tx=0x7fd4b8009de0).stop 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 shutdown_connections 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd4a8060f20 0x7fd4a80633e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4bc0f55c0 0x7fd4bc105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 --2- 172.21.15.84:0/807557296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4bc0f6860 0x7fd4bc1063f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 >> 172.21.15.84:0/807557296 conn(0x7fd4bc0f0d40 msgr2=0x7fd4bc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 shutdown_connections 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.616+0000 7fd4c3c17700 1 -- 172.21.15.84:0/807557296 wait complete. 2024-02-15T18:31:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 20 2024-02-15T18:31:26.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.714+0000 7fd5e47d2700 1 -- 172.21.15.84:0/644702274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f66e0 msgr2=0x7fd5dc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.714+0000 7fd5e47d2700 1 --2- 172.21.15.84:0/644702274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f66e0 0x7fd5dc0f6b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd5cc004660 tx=0x7fd5cc009b30).stop 2024-02-15T18:31:26.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.714+0000 7fd5e47d2700 1 -- 172.21.15.84:0/644702274 shutdown_connections 2024-02-15T18:31:26.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.714+0000 7fd5e47d2700 1 --2- 172.21.15.84:0/644702274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0f7980 0x7fd5dc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:26.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.714+0000 7fd5e47d2700 1 --2- 172.21.15.84:0/644702274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f66e0 0x7fd5dc0f6b00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.714+0000 7fd5e47d2700 1 -- 172.21.15.84:0/644702274 >> 172.21.15.84:0/644702274 conn(0x7fd5dc0f1e40 msgr2=0x7fd5dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:26.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.714+0000 7fd5e47d2700 1 -- 172.21.15.84:0/644702274 shutdown_connections 2024-02-15T18:31:26.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.714+0000 7fd5e47d2700 1 -- 172.21.15.84:0/644702274 wait complete. 2024-02-15T18:31:26.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e47d2700 1 Processor -- start 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e47d2700 1 -- start start 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e47d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0f66e0 0x7fd5dc1070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e47d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f7980 0x7fd5dc1075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e47d2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc107be0 con 0x7fd5dc0f7980 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e47d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc108490 con 0x7fd5dc0f66e0 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e1d6d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f7980 0x7fd5dc1075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e1d6d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f7980 0x7fd5dc1075a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38766/0 (socket says 172.21.15.84:38766) 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e1d6d700 1 -- 172.21.15.84:0/2574456287 learned_addr learned my addr 172.21.15.84:0/2574456287 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e256e700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0f66e0 0x7fd5dc1070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e1d6d700 1 -- 172.21.15.84:0/2574456287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0f66e0 msgr2=0x7fd5dc1070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e1d6d700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0f66e0 0x7fd5dc1070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e1d6d700 1 -- 172.21.15.84:0/2574456287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc005040 con 0x7fd5dc0f7980 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.715+0000 7fd5e1d6d700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f7980 0x7fd5dc1075a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd5d800b410 tx=0x7fd5d8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.716+0000 7fd5d2ffd700 1 -- 172.21.15.84:0/2574456287 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d80125f0 con 0x7fd5dc0f7980 2024-02-15T18:31:26.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.716+0000 7fd5d2ffd700 1 -- 172.21.15.84:0/2574456287 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd5d800be30 con 0x7fd5dc0f7980 2024-02-15T18:31:26.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.716+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc108770 con 0x7fd5dc0f7980 2024-02-15T18:31:26.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.716+0000 7fd5d2ffd700 1 -- 172.21.15.84:0/2574456287 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5d8002b70 con 0x7fd5dc0f7980 2024-02-15T18:31:26.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.716+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc108cb0 con 0x7fd5dc0f7980 2024-02-15T18:31:26.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.717+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc0f5ad0 con 0x7fd5dc0f7980 2024-02-15T18:31:26.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.717+0000 7fd5d2ffd700 1 -- 172.21.15.84:0/2574456287 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd5d800f030 con 0x7fd5dc0f7980 2024-02-15T18:31:26.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.717+0000 7fd5d2ffd700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd5c8060f20 0x7fd5c80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:26.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.717+0000 7fd5d2ffd700 1 -- 172.21.15.84:0/2574456287 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd5d807c530 con 0x7fd5dc0f7980 2024-02-15T18:31:26.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.717+0000 7fd5e256e700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd5c8060f20 0x7fd5c80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:26.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.718+0000 7fd5e256e700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd5c8060f20 0x7fd5c80633e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd5cc009f50 tx=0x7fd5cc009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.721+0000 7fd5d2ffd700 1 -- 172.21.15.84:0/2574456287 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd5d8050380 con 0x7fd5dc0f7980 2024-02-15T18:31:26.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:24.748136+0000 mgr.smithi084.hjmnez (mgr.14596) 241 : cluster [DBG] pgmap v175: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:31:26.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:25.383823+0000 mgr.smithi084.hjmnez (mgr.14596) 242 : audit [DBG] from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:26.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:25.674946+0000 mgr.smithi084.hjmnez (mgr.14596) 243 : audit [DBG] from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:26.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:26.302343+0000 mon.smithi084 (mon.0) 462 : audit [DBG] from='client.? 172.21.15.84:0/1910773319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:26.889 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:31:26.539+0000 7f99c04ae380 -1 osd.5 73 log_to_monitors {default=true} 2024-02-15T18:31:26.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:24.748136+0000 mgr.smithi084.hjmnez (mgr.14596) 241 : cluster [DBG] pgmap v175: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:31:26.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:25.383823+0000 mgr.smithi084.hjmnez (mgr.14596) 242 : audit [DBG] from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:26.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:25.674946+0000 mgr.smithi084.hjmnez (mgr.14596) 243 : audit [DBG] from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:26.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:26.302343+0000 mon.smithi084 (mon.0) 462 : audit [DBG] from='client.? 172.21.15.84:0/1910773319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:26.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.903+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5dc0ff0a0 con 0x7fd5c8060f20 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.904+0000 7fd5d2ffd700 1 -- 172.21.15.84:0/2574456287 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd5dc0ff0a0 con 0x7fd5c8060f20 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:31:26.897 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "12/21 daemons upgraded", 2024-02-15T18:31:26.898 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:31:26.898 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:31:26.898 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.905+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd5c8060f20 msgr2=0x7fd5c80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.905+0000 7fd5e47d2700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd5c8060f20 0x7fd5c80633e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd5cc009f50 tx=0x7fd5cc009b30).stop 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.905+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f7980 msgr2=0x7fd5dc1075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.905+0000 7fd5e47d2700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f7980 0x7fd5dc1075a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd5d800b410 tx=0x7fd5d8006ef0).stop 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.906+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 shutdown_connections 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.906+0000 7fd5e47d2700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd5c8060f20 0x7fd5c80633e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.906+0000 7fd5e47d2700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5dc0f66e0 0x7fd5dc1070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.906+0000 7fd5e47d2700 1 --2- 172.21.15.84:0/2574456287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5dc0f7980 0x7fd5dc1075a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.906+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 >> 172.21.15.84:0/2574456287 conn(0x7fd5dc0f1e40 msgr2=0x7fd5dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.906+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 shutdown_connections 2024-02-15T18:31:26.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:26.906+0000 7fd5e47d2700 1 -- 172.21.15.84:0/2574456287 wait complete. 2024-02-15T18:31:27.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:25.961114+0000 mgr.smithi084.hjmnez (mgr.14596) 244 : audit [DBG] from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:27.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:26.543829+0000 mon.smithi133 (mon.1) 6 : audit [INF] from='osd.5 [v2:172.21.15.133:6816/1311917098,v1:172.21.15.133:6817/1311917098]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:31:27.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:26.544242+0000 mon.smithi084 (mon.0) 463 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:31:27.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:26.615063+0000 mon.smithi084 (mon.0) 464 : audit [DBG] from='client.? 172.21.15.84:0/807557296' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:31:27.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:27.032232+0000 mon.smithi084 (mon.0) 465 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:27.889 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:31:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:31:27.517+0000 7f99af190700 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:31:27.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:25.961114+0000 mgr.smithi084.hjmnez (mgr.14596) 244 : audit [DBG] from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:27.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:26.543829+0000 mon.smithi133 (mon.1) 6 : audit [INF] from='osd.5 [v2:172.21.15.133:6816/1311917098,v1:172.21.15.133:6817/1311917098]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:31:27.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:26.544242+0000 mon.smithi084 (mon.0) 463 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:31:27.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:26.615063+0000 mon.smithi084 (mon.0) 464 : audit [DBG] from='client.? 172.21.15.84:0/807557296' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:31:27.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:27.032232+0000 mon.smithi084 (mon.0) 465 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:28.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:26.748555+0000 mgr.smithi084.hjmnez (mgr.14596) 245 : cluster [DBG] pgmap v176: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:31:28.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:26.904512+0000 mgr.smithi084.hjmnez (mgr.14596) 246 : audit [DBG] from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:28.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:27.508862+0000 mon.smithi084 (mon.0) 466 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T18:31:28.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:27.508947+0000 mon.smithi084 (mon.0) 467 : cluster [DBG] osdmap e76: 6 total, 5 up, 6 in 2024-02-15T18:31:28.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:27.509665+0000 mon.smithi133 (mon.1) 7 : audit [INF] from='osd.5 [v2:172.21.15.133:6816/1311917098,v1:172.21.15.133:6817/1311917098]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:31:28.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:27.510191+0000 mon.smithi084 (mon.0) 468 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:31:29.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:26.748555+0000 mgr.smithi084.hjmnez (mgr.14596) 245 : cluster [DBG] pgmap v176: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 53/345 objects degraded (15.362%) 2024-02-15T18:31:29.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:26.904512+0000 mgr.smithi084.hjmnez (mgr.14596) 246 : audit [DBG] from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:29.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:27.508862+0000 mon.smithi084 (mon.0) 466 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T18:31:29.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:27.508947+0000 mon.smithi084 (mon.0) 467 : cluster [DBG] osdmap e76: 6 total, 5 up, 6 in 2024-02-15T18:31:29.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:27.509665+0000 mon.smithi133 (mon.1) 7 : audit [INF] from='osd.5 [v2:172.21.15.133:6816/1311917098,v1:172.21.15.133:6817/1311917098]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:31:29.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:27.510191+0000 mon.smithi084 (mon.0) 468 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2024-02-15T18:31:29.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:28.505706+0000 mon.smithi084 (mon.0) 469 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:31:29.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:28.510813+0000 mon.smithi084 (mon.0) 470 : cluster [INF] osd.5 [v2:172.21.15.133:6816/1311917098,v1:172.21.15.133:6817/1311917098] boot 2024-02-15T18:31:29.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:28.510863+0000 mon.smithi084 (mon.0) 471 : cluster [DBG] osdmap e77: 6 total, 6 up, 6 in 2024-02-15T18:31:29.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:28.513485+0000 mon.smithi084 (mon.0) 472 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:31:29.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:29.512400+0000 mon.smithi084 (mon.0) 473 : cluster [DBG] osdmap e78: 6 total, 6 up, 6 in 2024-02-15T18:31:30.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:28.505706+0000 mon.smithi084 (mon.0) 469 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:31:30.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:28.510813+0000 mon.smithi084 (mon.0) 470 : cluster [INF] osd.5 [v2:172.21.15.133:6816/1311917098,v1:172.21.15.133:6817/1311917098] boot 2024-02-15T18:31:30.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:28.510863+0000 mon.smithi084 (mon.0) 471 : cluster [DBG] osdmap e77: 6 total, 6 up, 6 in 2024-02-15T18:31:30.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:28.513485+0000 mon.smithi084 (mon.0) 472 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:31:30.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:29.512400+0000 mon.smithi084 (mon.0) 473 : cluster [DBG] osdmap e78: 6 total, 6 up, 6 in 2024-02-15T18:31:30.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:28.749178+0000 mgr.smithi084.hjmnez (mgr.14596) 247 : cluster [DBG] pgmap v179: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s; 53/345 objects degraded (15.362%) 2024-02-15T18:31:31.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:28.749178+0000 mgr.smithi084.hjmnez (mgr.14596) 247 : cluster [DBG] pgmap v179: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s; 53/345 objects degraded (15.362%) 2024-02-15T18:31:32.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:30.749792+0000 mgr.smithi084.hjmnez (mgr.14596) 248 : cluster [DBG] pgmap v181: 65 pgs: 2 peering, 10 active+undersized+degraded, 11 active+undersized, 42 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s wr, 0 op/s; 43/345 objects degraded (12.464%) 2024-02-15T18:31:32.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:31.083799+0000 mon.smithi084 (mon.0) 474 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:stopping} 2 up:standby 2024-02-15T18:31:32.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:31.526572+0000 mon.smithi084 (mon.0) 475 : cluster [WRN] Health check update: Degraded data redundancy: 43/345 objects degraded (12.464%), 10 pgs degraded (PG_DEGRADED) 2024-02-15T18:31:32.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:30.749792+0000 mgr.smithi084.hjmnez (mgr.14596) 248 : cluster [DBG] pgmap v181: 65 pgs: 2 peering, 10 active+undersized+degraded, 11 active+undersized, 42 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s wr, 0 op/s; 43/345 objects degraded (12.464%) 2024-02-15T18:31:32.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:31.083799+0000 mon.smithi084 (mon.0) 474 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi133.mkpnnx=up:active,1=cephfs.smithi084.cuytny=up:stopping} 2 up:standby 2024-02-15T18:31:32.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:31.526572+0000 mon.smithi084 (mon.0) 475 : cluster [WRN] Health check update: Degraded data redundancy: 43/345 objects degraded (12.464%), 10 pgs degraded (PG_DEGRADED) 2024-02-15T18:31:33.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:33.083258+0000 mon.smithi084 (mon.0) 476 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/345 objects degraded (12.464%), 10 pgs degraded) 2024-02-15T18:31:33.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:33 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:33.083321+0000 mon.smithi084 (mon.0) 477 : cluster [INF] Cluster is now healthy 2024-02-15T18:31:33.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:33.083258+0000 mon.smithi084 (mon.0) 476 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/345 objects degraded (12.464%), 10 pgs degraded) 2024-02-15T18:31:33.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:33 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:33.083321+0000 mon.smithi084 (mon.0) 477 : cluster [INF] Cluster is now healthy 2024-02-15T18:31:34.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:32.750385+0000 mgr.smithi084.hjmnez (mgr.14596) 249 : cluster [DBG] pgmap v182: 65 pgs: 2 peering, 63 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s wr, 1 op/s; 792 B/s, 0 objects/s recovering 2024-02-15T18:31:34.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:33.529602+0000 mon.smithi084 (mon.0) 478 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:34.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:33.822533+0000 mon.smithi084 (mon.0) 479 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:34.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:33.823457+0000 mon.smithi084 (mon.0) 480 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:34.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:33.828577+0000 mon.smithi084 (mon.0) 481 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:34.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:33.835464+0000 mon.smithi084 (mon.0) 482 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:34.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:33.838269+0000 mon.smithi084 (mon.0) 483 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:34.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:33.839709+0000 mon.smithi084 (mon.0) 484 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:34.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:33.841037+0000 mon.smithi084 (mon.0) 485 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:34.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:33.842682+0000 mon.smithi084 (mon.0) 486 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:32.750385+0000 mgr.smithi084.hjmnez (mgr.14596) 249 : cluster [DBG] pgmap v182: 65 pgs: 2 peering, 63 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s wr, 1 op/s; 792 B/s, 0 objects/s recovering 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:33.529602+0000 mon.smithi084 (mon.0) 478 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:33.822533+0000 mon.smithi084 (mon.0) 479 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:33.823457+0000 mon.smithi084 (mon.0) 480 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:33.828577+0000 mon.smithi084 (mon.0) 481 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:33.835464+0000 mon.smithi084 (mon.0) 482 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:33.838269+0000 mon.smithi084 (mon.0) 483 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:33.839709+0000 mon.smithi084 (mon.0) 484 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:33.841037+0000 mon.smithi084 (mon.0) 485 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:34.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:33.842682+0000 mon.smithi084 (mon.0) 486 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:35.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:33.824168+0000 mgr.smithi084.hjmnez (mgr.14596) 250 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:35.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:33.844323+0000 mgr.smithi084.hjmnez (mgr.14596) 251 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:31:35.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:33.824168+0000 mgr.smithi084.hjmnez (mgr.14596) 250 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:35.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:33.844323+0000 mgr.smithi084.hjmnez (mgr.14596) 251 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:31:36.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:34.750968+0000 mgr.smithi084.hjmnez (mgr.14596) 252 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 141 B/s rd, 2.5 KiB/s wr, 1 op/s; 656 B/s, 0 objects/s recovering 2024-02-15T18:31:36.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:34.750968+0000 mgr.smithi084.hjmnez (mgr.14596) 252 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 141 B/s rd, 2.5 KiB/s wr, 1 op/s; 656 B/s, 0 objects/s recovering 2024-02-15T18:31:38.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:36.751380+0000 mgr.smithi084.hjmnez (mgr.14596) 253 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 124 B/s rd, 993 B/s wr, 0 op/s; 577 B/s, 0 objects/s recovering 2024-02-15T18:31:38.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:36.906369+0000 mon.smithi084 (mon.0) 487 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:38.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:36.751380+0000 mgr.smithi084.hjmnez (mgr.14596) 253 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 124 B/s rd, 993 B/s wr, 0 op/s; 577 B/s, 0 objects/s recovering 2024-02-15T18:31:38.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:36.906369+0000 mon.smithi084 (mon.0) 487 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:40.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:38.752024+0000 mgr.smithi084.hjmnez (mgr.14596) 254 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 102 B/s rd, 1.2 KiB/s wr, 1 op/s; 475 B/s, 0 objects/s recovering 2024-02-15T18:31:40.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:38.752024+0000 mgr.smithi084.hjmnez (mgr.14596) 254 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 102 B/s rd, 1.2 KiB/s wr, 1 op/s; 475 B/s, 0 objects/s recovering 2024-02-15T18:31:42.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:40.752447+0000 mgr.smithi084.hjmnez (mgr.14596) 255 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 91 B/s rd, 1.1 KiB/s wr, 0 op/s; 423 B/s, 0 objects/s recovering 2024-02-15T18:31:42.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:42.042472+0000 mon.smithi084 (mon.0) 488 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:42.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:40.752447+0000 mgr.smithi084.hjmnez (mgr.14596) 255 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 91 B/s rd, 1.1 KiB/s wr, 0 op/s; 423 B/s, 0 objects/s recovering 2024-02-15T18:31:42.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:42.042472+0000 mon.smithi084 (mon.0) 488 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:42.752962+0000 mgr.smithi084.hjmnez (mgr.14596) 256 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.5 KiB/s wr, 4 op/s; 396 B/s, 0 objects/s recovering 2024-02-15T18:31:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:43.852362+0000 mon.smithi084 (mon.0) 489 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:43.854283+0000 mon.smithi084 (mon.0) 490 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:43.855026+0000 mon.smithi084 (mon.0) 491 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:43.860290+0000 mon.smithi084 (mon.0) 492 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:43.866257+0000 mon.smithi084 (mon.0) 493 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:44.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:43.868671+0000 mon.smithi084 (mon.0) 494 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:44.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:43.869965+0000 mon.smithi084 (mon.0) 495 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:44.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:43.871181+0000 mon.smithi084 (mon.0) 496 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:44.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:43.872851+0000 mon.smithi084 (mon.0) 497 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:42.752962+0000 mgr.smithi084.hjmnez (mgr.14596) 256 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.5 KiB/s wr, 4 op/s; 396 B/s, 0 objects/s recovering 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:43.852362+0000 mon.smithi084 (mon.0) 489 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:43.854283+0000 mon.smithi084 (mon.0) 490 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:43.855026+0000 mon.smithi084 (mon.0) 491 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:43.860290+0000 mon.smithi084 (mon.0) 492 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:43.866257+0000 mon.smithi084 (mon.0) 493 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:43.868671+0000 mon.smithi084 (mon.0) 494 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:43.869965+0000 mon.smithi084 (mon.0) 495 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:43.871181+0000 mon.smithi084 (mon.0) 496 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:44.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:43.872851+0000 mon.smithi084 (mon.0) 497 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:45.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:43.855671+0000 mgr.smithi084.hjmnez (mgr.14596) 257 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:45.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:43.874420+0000 mgr.smithi084.hjmnez (mgr.14596) 258 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:31:45.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:43.855671+0000 mgr.smithi084.hjmnez (mgr.14596) 257 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:45.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:43.874420+0000 mgr.smithi084.hjmnez (mgr.14596) 258 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:31:46.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:44.753405+0000 mgr.smithi084.hjmnez (mgr.14596) 259 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-15T18:31:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:44.753405+0000 mgr.smithi084.hjmnez (mgr.14596) 259 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-15T18:31:48.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:46.753879+0000 mgr.smithi084.hjmnez (mgr.14596) 260 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 5 op/s 2024-02-15T18:31:48.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:46.753879+0000 mgr.smithi084.hjmnez (mgr.14596) 260 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 5 op/s 2024-02-15T18:31:50.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:48.754312+0000 mgr.smithi084.hjmnez (mgr.14596) 261 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 226 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 6 op/s 2024-02-15T18:31:50.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:48.754312+0000 mgr.smithi084.hjmnez (mgr.14596) 261 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 226 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 6 op/s 2024-02-15T18:31:52.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:50.754979+0000 mgr.smithi084.hjmnez (mgr.14596) 262 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-15T18:31:52.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:50.754979+0000 mgr.smithi084.hjmnez (mgr.14596) 262 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 7 op/s 2024-02-15T18:31:54.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:52.755549+0000 mgr.smithi084.hjmnez (mgr.14596) 263 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 8 op/s 2024-02-15T18:31:54.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:53.884031+0000 mon.smithi084 (mon.0) 498 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:54.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:52.755549+0000 mgr.smithi084.hjmnez (mgr.14596) 263 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 8 op/s 2024-02-15T18:31:54.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:53.884031+0000 mon.smithi084 (mon.0) 498 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:54.184545+0000 mon.smithi084 (mon.0) 499 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:54.185246+0000 mon.smithi084 (mon.0) 500 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:55.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:54.185769+0000 mgr.smithi084.hjmnez (mgr.14596) 264 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:54.189588+0000 mon.smithi084 (mon.0) 501 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:54.194701+0000 mon.smithi084 (mon.0) 502 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:54.196596+0000 mon.smithi084 (mon.0) 503 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:54.197581+0000 mon.smithi084 (mon.0) 504 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:54.198540+0000 mon.smithi084 (mon.0) 505 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:54.199812+0000 mon.smithi084 (mon.0) 506 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:55.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:31:54.201137+0000 mgr.smithi084.hjmnez (mgr.14596) 265 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:31:55.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:54.184545+0000 mon.smithi084 (mon.0) 499 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:55.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:54.185246+0000 mon.smithi084 (mon.0) 500 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:55.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:54.185769+0000 mgr.smithi084.hjmnez (mgr.14596) 264 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:55.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:54.189588+0000 mon.smithi084 (mon.0) 501 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:31:55.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:54.194701+0000 mon.smithi084 (mon.0) 502 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:55.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:54.196596+0000 mon.smithi084 (mon.0) 503 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:55.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:54.197581+0000 mon.smithi084 (mon.0) 504 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:55.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:54.198540+0000 mon.smithi084 (mon.0) 505 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:55.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:54.199812+0000 mon.smithi084 (mon.0) 506 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:55.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:55 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:31:54.201137+0000 mgr.smithi084.hjmnez (mgr.14596) 265 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:31:56.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:54.756100+0000 mgr.smithi084.hjmnez (mgr.14596) 266 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 4 op/s 2024-02-15T18:31:56.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:55.487603+0000 mon.smithi084 (mon.0) 507 : cluster [INF] daemon mds.cephfs.smithi084.cuytny finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-02-15T18:31:56.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:54.756100+0000 mgr.smithi084.hjmnez (mgr.14596) 266 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 4 op/s 2024-02-15T18:31:56.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:55.487603+0000 mon.smithi084 (mon.0) 507 : cluster [INF] daemon mds.cephfs.smithi084.cuytny finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-02-15T18:31:57.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.017+0000 7f84ccca9700 1 -- 172.21.15.84:0/3444987821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f55c0 msgr2=0x7f84c80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.017+0000 7f84ccca9700 1 --2- 172.21.15.84:0/3444987821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f55c0 0x7f84c80f59e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f84b0004660 tx=0x7f84b0009b30).stop 2024-02-15T18:31:57.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.017+0000 7f84ccca9700 1 -- 172.21.15.84:0/3444987821 shutdown_connections 2024-02-15T18:31:57.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.017+0000 7f84ccca9700 1 --2- 172.21.15.84:0/3444987821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80f6860 0x7f84c80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.017+0000 7f84ccca9700 1 --2- 172.21.15.84:0/3444987821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f55c0 0x7f84c80f59e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.017+0000 7f84ccca9700 1 -- 172.21.15.84:0/3444987821 >> 172.21.15.84:0/3444987821 conn(0x7f84c80f0d40 msgr2=0x7f84c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:57.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.017+0000 7f84ccca9700 1 -- 172.21.15.84:0/3444987821 shutdown_connections 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.017+0000 7f84ccca9700 1 -- 172.21.15.84:0/3444987821 wait complete. 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.018+0000 7f84ccca9700 1 Processor -- start 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.018+0000 7f84ccca9700 1 -- start start 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.018+0000 7f84ccca9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80f55c0 0x7f84c8109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.018+0000 7f84ccca9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f6860 0x7f84c810c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.018+0000 7f84ccca9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80603e0 con 0x7f84c80f6860 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.018+0000 7f84ccca9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8060520 con 0x7f84c80f55c0 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.018+0000 7f84c5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f6860 0x7f84c810c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.018+0000 7f84c5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f6860 0x7f84c810c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57380/0 (socket says 172.21.15.84:57380) 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.018+0000 7f84c5d9b700 1 -- 172.21.15.84:0/762325139 learned_addr learned my addr 172.21.15.84:0/762325139 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84c659c700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80f55c0 0x7f84c8109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84c5d9b700 1 -- 172.21.15.84:0/762325139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80f55c0 msgr2=0x7f84c8109d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84c5d9b700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80f55c0 0x7f84c8109d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84c5d9b700 1 -- 172.21.15.84:0/762325139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0005040 con 0x7f84c80f6860 2024-02-15T18:31:57.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84c5d9b700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f6860 0x7f84c810c200 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f84b80026d0 tx=0x7f84b8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:57.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84beffd700 1 -- 172.21.15.84:0/762325139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b8009320 con 0x7f84c80f6860 2024-02-15T18:31:57.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c810c7b0 con 0x7f84c80f6860 2024-02-15T18:31:57.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84beffd700 1 -- 172.21.15.84:0/762325139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f84b800f040 con 0x7f84c80f6860 2024-02-15T18:31:57.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84beffd700 1 -- 172.21.15.84:0/762325139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b80149b0 con 0x7f84c80f6860 2024-02-15T18:31:57.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.019+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c810cd70 con 0x7f84c80f6860 2024-02-15T18:31:57.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.020+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c8045ad0 con 0x7f84c80f6860 2024-02-15T18:31:57.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.020+0000 7f84beffd700 1 -- 172.21.15.84:0/762325139 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f84b8009480 con 0x7f84c80f6860 2024-02-15T18:31:57.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.021+0000 7f84beffd700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f84b4060f20 0x7f84b40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.021+0000 7f84beffd700 1 -- 172.21.15.84:0/762325139 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f84b807c6c0 con 0x7f84c80f6860 2024-02-15T18:31:57.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.021+0000 7f84c659c700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f84b4060f20 0x7f84b40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.021+0000 7f84c659c700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f84b4060f20 0x7f84b40633e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f84c8060060 tx=0x7f84b0009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:57.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.025+0000 7f84beffd700 1 -- 172.21.15.84:0/762325139 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f84b8050570 con 0x7f84c80f6860 2024-02-15T18:31:57.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.209+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84c8057f10 con 0x7f84b4060f20 2024-02-15T18:31:57.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.210+0000 7f84beffd700 1 -- 172.21.15.84:0/762325139 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f84c8057f10 con 0x7f84b4060f20 2024-02-15T18:31:57.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f84b4060f20 msgr2=0x7f84b40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f84b4060f20 0x7f84b40633e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f84c8060060 tx=0x7f84b0009b30).stop 2024-02-15T18:31:57.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f6860 msgr2=0x7f84c810c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f6860 0x7f84c810c200 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f84b80026d0 tx=0x7f84b8009de0).stop 2024-02-15T18:31:57.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 shutdown_connections 2024-02-15T18:31:57.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f84b4060f20 0x7f84b40633e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80f55c0 0x7f84c8109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 --2- 172.21.15.84:0/762325139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84c80f6860 0x7f84c810c200 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 >> 172.21.15.84:0/762325139 conn(0x7f84c80f0d40 msgr2=0x7f84c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:57.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 shutdown_connections 2024-02-15T18:31:57.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.212+0000 7f84ccca9700 1 -- 172.21.15.84:0/762325139 wait complete. 2024-02-15T18:31:57.215 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:31:57.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.311+0000 7efc151a2700 1 -- 172.21.15.84:0/3533753150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f6860 msgr2=0x7efc100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.311+0000 7efc151a2700 1 --2- 172.21.15.84:0/3533753150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f6860 0x7efc100f6cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7efc00004660 tx=0x7efc00009b30).stop 2024-02-15T18:31:57.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.311+0000 7efc151a2700 1 -- 172.21.15.84:0/3533753150 shutdown_connections 2024-02-15T18:31:57.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.311+0000 7efc151a2700 1 --2- 172.21.15.84:0/3533753150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f6860 0x7efc100f6cc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.311+0000 7efc151a2700 1 --2- 172.21.15.84:0/3533753150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc100f55c0 0x7efc100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.311+0000 7efc151a2700 1 -- 172.21.15.84:0/3533753150 >> 172.21.15.84:0/3533753150 conn(0x7efc100f0d40 msgr2=0x7efc100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:57.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.311+0000 7efc151a2700 1 -- 172.21.15.84:0/3533753150 shutdown_connections 2024-02-15T18:31:57.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.311+0000 7efc151a2700 1 -- 172.21.15.84:0/3533753150 wait complete. 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.311+0000 7efc151a2700 1 Processor -- start 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc151a2700 1 -- start start 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc151a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f55c0 0x7efc10109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc151a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc100f6860 0x7efc1010c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc151a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100603e0 con 0x7efc100f55c0 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc151a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc10060520 con 0x7efc100f6860 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc0ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f55c0 0x7efc10109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc0ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f55c0 0x7efc10109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57398/0 (socket says 172.21.15.84:57398) 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc0ed9d700 1 -- 172.21.15.84:0/277849492 learned_addr learned my addr 172.21.15.84:0/277849492 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc0ed9d700 1 -- 172.21.15.84:0/277849492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc100f6860 msgr2=0x7efc1010c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc0ed9d700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc100f6860 0x7efc1010c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:57.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc0ed9d700 1 -- 172.21.15.84:0/277849492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc00005040 con 0x7efc100f55c0 2024-02-15T18:31:57.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc0ed9d700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f55c0 0x7efc10109cb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7efc0400c530 tx=0x7efc04007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:57.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efbf77fe700 1 -- 172.21.15.84:0/277849492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0400f650 con 0x7efc100f55c0 2024-02-15T18:31:57.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efbf77fe700 1 -- 172.21.15.84:0/277849492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7efc0400fca0 con 0x7efc100f55c0 2024-02-15T18:31:57.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1010c760 con 0x7efc100f55c0 2024-02-15T18:31:57.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efbf77fe700 1 -- 172.21.15.84:0/277849492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc04012e60 con 0x7efc100f55c0 2024-02-15T18:31:57.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.312+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1010cd20 con 0x7efc100f55c0 2024-02-15T18:31:57.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.313+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc10045ad0 con 0x7efc100f55c0 2024-02-15T18:31:57.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.314+0000 7efbf77fe700 1 -- 172.21.15.84:0/277849492 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7efc04019030 con 0x7efc100f55c0 2024-02-15T18:31:57.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.314+0000 7efbf77fe700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7efbf8060f20 0x7efbf80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.314+0000 7efbf77fe700 1 -- 172.21.15.84:0/277849492 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5812+0+0 (secure 0 0 0) 0x7efc0407bdd0 con 0x7efc100f55c0 2024-02-15T18:31:57.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.314+0000 7efc0e59c700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7efbf8060f20 0x7efbf80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.314+0000 7efc0e59c700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7efbf8060f20 0x7efbf80633e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7efc00009f50 tx=0x7efc00009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:57.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.318+0000 7efbf77fe700 1 -- 172.21.15.84:0/277849492 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7efc04048f60 con 0x7efc100f55c0 2024-02-15T18:31:57.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.497+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efc10057f10 con 0x7efbf8060f20 2024-02-15T18:31:57.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.498+0000 7efbf77fe700 1 -- 172.21.15.84:0/277849492 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7efc10057f10 con 0x7efbf8060f20 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7efbf8060f20 msgr2=0x7efbf80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7efbf8060f20 0x7efbf80633e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7efc00009f50 tx=0x7efc00009b30).stop 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f55c0 msgr2=0x7efc10109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f55c0 0x7efc10109cb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7efc0400c530 tx=0x7efc04007e10).stop 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 shutdown_connections 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7efbf8060f20 0x7efbf80633e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc100f55c0 0x7efc10109cb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 --2- 172.21.15.84:0/277849492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc100f6860 0x7efc1010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 >> 172.21.15.84:0/277849492 conn(0x7efc100f0d40 msgr2=0x7efc100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 shutdown_connections 2024-02-15T18:31:57.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.500+0000 7efc151a2700 1 -- 172.21.15.84:0/277849492 wait complete. 2024-02-15T18:31:57.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:56.202053+0000 mon.smithi084 (mon.0) 508 : cluster [DBG] mds.1 [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] down:stopped 2024-02-15T18:31:57.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:56.202111+0000 mon.smithi084 (mon.0) 509 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 2 up:standby 2024-02-15T18:31:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 -- 172.21.15.84:0/2463229113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 msgr2=0x7f73e80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 --2- 172.21.15.84:0/2463229113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 0x7f73e80f6cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f73e4004660 tx=0x7f73e4009b30).stop 2024-02-15T18:31:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 -- 172.21.15.84:0/2463229113 shutdown_connections 2024-02-15T18:31:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 --2- 172.21.15.84:0/2463229113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 0x7f73e80f6cc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 --2- 172.21.15.84:0/2463229113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e80f55c0 0x7f73e80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 -- 172.21.15.84:0/2463229113 >> 172.21.15.84:0/2463229113 conn(0x7f73e80f0d40 msgr2=0x7f73e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 -- 172.21.15.84:0/2463229113 shutdown_connections 2024-02-15T18:31:57.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 -- 172.21.15.84:0/2463229113 wait complete. 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 Processor -- start 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 -- start start 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e80f55c0 0x7f73e8106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 0x7f73e81074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8107a60 con 0x7f73e80f6860 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.598+0000 7f73f023b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8107ba0 con 0x7f73e80f55c0 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73ed7d6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 0x7f73e81074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73ed7d6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 0x7f73e81074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57418/0 (socket says 172.21.15.84:57418) 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73ed7d6700 1 -- 172.21.15.84:0/1247051335 learned_addr learned my addr 172.21.15.84:0/1247051335 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:57.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73edfd7700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e80f55c0 0x7f73e8106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73ed7d6700 1 -- 172.21.15.84:0/1247051335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e80f55c0 msgr2=0x7f73e8106fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73ed7d6700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e80f55c0 0x7f73e8106fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73ed7d6700 1 -- 172.21.15.84:0/1247051335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4005040 con 0x7f73e80f6860 2024-02-15T18:31:57.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73ed7d6700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 0x7f73e81074b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f73e4009f50 tx=0x7f73e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:57.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73de7fc700 1 -- 172.21.15.84:0/1247051335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e4018070 con 0x7f73e80f6860 2024-02-15T18:31:57.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73de7fc700 1 -- 172.21.15.84:0/1247051335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f73e4007c70 con 0x7f73e80f6860 2024-02-15T18:31:57.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e81084e0 con 0x7f73e80f6860 2024-02-15T18:31:57.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73de7fc700 1 -- 172.21.15.84:0/1247051335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e401c620 con 0x7f73e80f6860 2024-02-15T18:31:57.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.599+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e8108a40 con 0x7f73e80f6860 2024-02-15T18:31:57.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.600+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e8045ad0 con 0x7f73e80f6860 2024-02-15T18:31:57.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.600+0000 7f73de7fc700 1 -- 172.21.15.84:0/1247051335 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f73e401da10 con 0x7f73e80f6860 2024-02-15T18:31:57.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.601+0000 7f73de7fc700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f73d4060f20 0x7f73d40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.601+0000 7f73de7fc700 1 -- 172.21.15.84:0/1247051335 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f73e407e070 con 0x7f73e80f6860 2024-02-15T18:31:57.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.601+0000 7f73edfd7700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f73d4060f20 0x7f73d40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.601+0000 7f73edfd7700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f73d4060f20 0x7f73d40633e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f73e80f66c0 tx=0x7f73d8009040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:57.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.605+0000 7f73de7fc700 1 -- 172.21.15.84:0/1247051335 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f73e4051f20 con 0x7f73e80f6860 2024-02-15T18:31:57.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:56.202053+0000 mon.smithi084 (mon.0) 508 : cluster [DBG] mds.1 [v2:172.21.15.84:6826/1573509091,v1:172.21.15.84:6827/1573509091] down:stopped 2024-02-15T18:31:57.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:56.202111+0000 mon.smithi084 (mon.0) 509 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 2 up:standby 2024-02-15T18:31:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.781+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f73e80faca0 con 0x7f73d4060f20 2024-02-15T18:31:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.790+0000 7f73de7fc700 1 -- 172.21.15.84:0/1247051335 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f73e80faca0 con 0x7f73d4060f20 2024-02-15T18:31:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:31:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (11m) 119s ago 13m 18.0M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:31:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (3m) 119s ago 12m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:31:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (3m) 35s ago 12m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:31:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (11m) 119s ago 12m 35.6M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:31:57.783 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (7m) 119s ago 7m 121M - 16.2.4 8d91d370c2b8 e9a9e8f9e8fc 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (7m) 119s ago 7m 14.1M - 16.2.4 8d91d370c2b8 d84d00267e06 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (7m) 35s ago 7m 124M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (7m) 35s ago 7m 15.0M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (5m) 119s ago 14m 433M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (4m) 35s ago 12m 389M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (4m) 119s ago 14m 46.1M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (4m) 35s ago 11m 40.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (12m) 119s ago 12m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (11m) 35s ago 11m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (3m) 119s ago 11m 207M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (2m) 119s ago 10m 236M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:31:57.784 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (2m) 119s ago 10m 12.8M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:31:57.785 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (95s) 35s ago 10m 264M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc b8c15d05905a 2024-02-15T18:31:57.785 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (66s) 35s ago 9m 239M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 612e5da9dba4 2024-02-15T18:31:57.785 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (38s) 35s ago 9m 11.6M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 93c01314b455 2024-02-15T18:31:57.785 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (5m) 119s ago 12m 67.9M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f73d4060f20 msgr2=0x7f73d40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f73d4060f20 0x7f73d40633e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f73e80f66c0 tx=0x7f73d8009040).stop 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 msgr2=0x7f73e81074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 0x7f73e81074b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f73e4009f50 tx=0x7f73e4009b30).stop 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 shutdown_connections 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f73d4060f20 0x7f73d40633e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e80f55c0 0x7f73e8106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 --2- 172.21.15.84:0/1247051335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73e80f6860 0x7f73e81074b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 >> 172.21.15.84:0/1247051335 conn(0x7f73e80f0d40 msgr2=0x7f73e805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 shutdown_connections 2024-02-15T18:31:57.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.792+0000 7f73f023b700 1 -- 172.21.15.84:0/1247051335 wait complete. 2024-02-15T18:31:57.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 -- 172.21.15.84:0/2177246166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 msgr2=0x7f90d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 --2- 172.21.15.84:0/2177246166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 0x7f90d00f59e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f90c0004660 tx=0x7f90c0009b30).stop 2024-02-15T18:31:57.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 -- 172.21.15.84:0/2177246166 shutdown_connections 2024-02-15T18:31:57.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 --2- 172.21.15.84:0/2177246166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d00f6860 0x7f90d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 --2- 172.21.15.84:0/2177246166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 0x7f90d00f59e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 -- 172.21.15.84:0/2177246166 >> 172.21.15.84:0/2177246166 conn(0x7f90d00f0d40 msgr2=0x7f90d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:57.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 -- 172.21.15.84:0/2177246166 shutdown_connections 2024-02-15T18:31:57.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 -- 172.21.15.84:0/2177246166 wait complete. 2024-02-15T18:31:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 Processor -- start 2024-02-15T18:31:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.891+0000 7f90d79b9700 1 -- start start 2024-02-15T18:31:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d79b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 0x7f90d0109d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d79b9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d00f6860 0x7f90d010c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d79b9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00603c0 con 0x7f90d00f55c0 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d79b9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0060500 con 0x7f90d00f6860 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d5755700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 0x7f90d0109d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d5755700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 0x7f90d0109d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57436/0 (socket says 172.21.15.84:57436) 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d5755700 1 -- 172.21.15.84:0/2581871440 learned_addr learned my addr 172.21.15.84:0/2581871440 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d4f54700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d00f6860 0x7f90d010c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d5755700 1 -- 172.21.15.84:0/2581871440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d00f6860 msgr2=0x7f90d010c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d5755700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d00f6860 0x7f90d010c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d5755700 1 -- 172.21.15.84:0/2581871440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0005040 con 0x7f90d00f55c0 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d5755700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 0x7f90d0109d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f90c0002040 tx=0x7f90c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:57.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90c5ffb700 1 -- 172.21.15.84:0/2581871440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c0019070 con 0x7f90d00f55c0 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90c5ffb700 1 -- 172.21.15.84:0/2581871440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f90c0007e80 con 0x7f90d00f55c0 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d010c770 con 0x7f90d00f55c0 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90c5ffb700 1 -- 172.21.15.84:0/2581871440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c0014db0 con 0x7f90d00f55c0 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.892+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d010cca0 con 0x7f90d00f55c0 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.893+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d00f49b0 con 0x7f90d00f55c0 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.894+0000 7f90c5ffb700 1 -- 172.21.15.84:0/2581871440 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f90c0025070 con 0x7f90d00f55c0 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.894+0000 7f90c5ffb700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f90bc060f20 0x7f90bc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.894+0000 7f90c5ffb700 1 -- 172.21.15.84:0/2581871440 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f90c007cef0 con 0x7f90d00f55c0 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.894+0000 7f90d4f54700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f90bc060f20 0x7f90bc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:57.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.894+0000 7f90d4f54700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f90bc060f20 0x7f90bc0633e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f90cc009fd0 tx=0x7f90cc00b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:57.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:57.898+0000 7f90c5ffb700 1 -- 172.21.15.84:0/2581871440 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f90c004d390 con 0x7f90d00f55c0 2024-02-15T18:31:58.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.128+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90d00fdfa0 con 0x7f90d00f55c0 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.129+0000 7f90c5ffb700 1 -- 172.21.15.84:0/2581871440 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f90c0023020 con 0x7f90d00f55c0 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:31:58.122 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:31:58.123 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:31:58.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:31:58.123 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:31:58.123 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 10, 2024-02-15T18:31:58.123 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:31:58.123 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:31:58.123 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f90bc060f20 msgr2=0x7f90bc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f90bc060f20 0x7f90bc0633e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f90cc009fd0 tx=0x7f90cc00b040).stop 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 msgr2=0x7f90d0109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 0x7f90d0109d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f90c0002040 tx=0x7f90c000b040).stop 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 shutdown_connections 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f90bc060f20 0x7f90bc0633e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90d00f55c0 0x7f90d0109d20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 --2- 172.21.15.84:0/2581871440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d00f6860 0x7f90d010c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 >> 172.21.15.84:0/2581871440 conn(0x7f90d00f0d40 msgr2=0x7f90d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 shutdown_connections 2024-02-15T18:31:58.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.131+0000 7f90d79b9700 1 -- 172.21.15.84:0/2581871440 wait complete. 2024-02-15T18:31:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.230+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1178379179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 msgr2=0x7f3bac0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.230+0000 7f3bb21ad700 1 --2- 172.21.15.84:0/1178379179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 0x7f3bac0f6b00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f3ba4004660 tx=0x7f3ba4009b30).stop 2024-02-15T18:31:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.230+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1178379179 shutdown_connections 2024-02-15T18:31:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.230+0000 7f3bb21ad700 1 --2- 172.21.15.84:0/1178379179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bac0f7980 0x7f3bac0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.230+0000 7f3bb21ad700 1 --2- 172.21.15.84:0/1178379179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 0x7f3bac0f6b00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.230+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1178379179 >> 172.21.15.84:0/1178379179 conn(0x7f3bac0f1e40 msgr2=0x7f3bac0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.230+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1178379179 shutdown_connections 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.230+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1178379179 wait complete. 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.230+0000 7f3bb21ad700 1 Processor -- start 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bb21ad700 1 -- start start 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bb21ad700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 0x7f3bac1070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bb21ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bac0f7980 0x7f3bac1075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bb21ad700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac107be0 con 0x7f3bac0f66e0 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bb21ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac108490 con 0x7f3bac0f7980 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 0x7f3bac1070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 0x7f3bac1070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57458/0 (socket says 172.21.15.84:57458) 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bab7fe700 1 -- 172.21.15.84:0/1369534558 learned_addr learned my addr 172.21.15.84:0/1369534558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:58.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3baaffd700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bac0f7980 0x7f3bac1075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bab7fe700 1 -- 172.21.15.84:0/1369534558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bac0f7980 msgr2=0x7f3bac1075a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bab7fe700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bac0f7980 0x7f3bac1075a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bab7fe700 1 -- 172.21.15.84:0/1369534558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4005040 con 0x7f3bac0f66e0 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3baaffd700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bac0f7980 0x7f3bac1075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3bab7fe700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 0x7f3bac1070b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3ba4013fd0 tx=0x7f3ba4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.231+0000 7f3ba3fff700 1 -- 172.21.15.84:0/1369534558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba4018070 con 0x7f3bac0f66e0 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.232+0000 7f3ba3fff700 1 -- 172.21.15.84:0/1369534558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f3ba4007d70 con 0x7f3bac0f66e0 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.232+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac108710 con 0x7f3bac0f66e0 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.232+0000 7f3ba3fff700 1 -- 172.21.15.84:0/1369534558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba401c620 con 0x7f3bac0f66e0 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.232+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac108bf0 con 0x7f3bac0f66e0 2024-02-15T18:31:58.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.233+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac0f5ad0 con 0x7f3bac0f66e0 2024-02-15T18:31:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.233+0000 7f3ba3fff700 1 -- 172.21.15.84:0/1369534558 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f3ba401d420 con 0x7f3bac0f66e0 2024-02-15T18:31:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.233+0000 7f3ba3fff700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3b98060f20 0x7f3b980633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.233+0000 7f3ba3fff700 1 -- 172.21.15.84:0/1369534558 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f3ba407dfe0 con 0x7f3bac0f66e0 2024-02-15T18:31:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.233+0000 7f3baaffd700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3b98060f20 0x7f3b980633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:58.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.234+0000 7f3baaffd700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3b98060f20 0x7f3b980633e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3b9400a7e0 tx=0x7f3b94008040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:58.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.238+0000 7f3ba3fff700 1 -- 172.21.15.84:0/1369534558 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3ba4051f70 con 0x7f3bac0f66e0 2024-02-15T18:31:58.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.441+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3bac0ff0f0 con 0x7f3bac0f66e0 2024-02-15T18:31:58.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.442+0000 7f3ba3fff700 1 -- 172.21.15.84:0/1369534558 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1766 (secure 0 0 0) 0x7f3ba4051b60 con 0x7f3bac0f66e0 2024-02-15T18:31:58.434 INFO:teuthology.orchestra.run.smithi084.stdout:e23 2024-02-15T18:31:58.434 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 22 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:31:56.195144+0000 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:31:58.435 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 1 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:in 0 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239} 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 1 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:31:58.436 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:31:58.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:31:58.437 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:31:58.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:31:58.437 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:14454} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.84:6828/2787458317,v1:172.21.15.84:6829/2787458317] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:31:58.437 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:31:58.437 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{-1:34310} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.84:6826/4000569752,v1:172.21.15.84:6827/4000569752] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:31:58.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.443+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3b98060f20 msgr2=0x7f3b980633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.443+0000 7f3bb21ad700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3b98060f20 0x7f3b980633e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3b9400a7e0 tx=0x7f3b94008040).stop 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.443+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 msgr2=0x7f3bac1070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.443+0000 7f3bb21ad700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 0x7f3bac1070b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f3ba4013fd0 tx=0x7f3ba4009b30).stop 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.443+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 shutdown_connections 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.443+0000 7f3bb21ad700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3b98060f20 0x7f3b980633e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.443+0000 7f3bb21ad700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bac0f66e0 0x7f3bac1070b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.443+0000 7f3bb21ad700 1 --2- 172.21.15.84:0/1369534558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bac0f7980 0x7f3bac1075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.443+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 >> 172.21.15.84:0/1369534558 conn(0x7f3bac0f1e40 msgr2=0x7f3bac0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.444+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 shutdown_connections 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.444+0000 7f3bb21ad700 1 -- 172.21.15.84:0/1369534558 wait complete. 2024-02-15T18:31:58.438 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 23 2024-02-15T18:31:58.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:56.756527+0000 mgr.smithi084.hjmnez (mgr.14596) 267 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-02-15T18:31:58.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:57.205989+0000 mon.smithi084 (mon.0) 510 : cluster [DBG] mds.? [v2:172.21.15.84:6826/4000569752,v1:172.21.15.84:6827/4000569752] up:boot 2024-02-15T18:31:58.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:57.206031+0000 mon.smithi084 (mon.0) 511 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 3 up:standby 2024-02-15T18:31:58.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:57.206207+0000 mon.smithi084 (mon.0) 512 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:31:58.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:57.210976+0000 mgr.smithi084.hjmnez (mgr.14596) 268 : audit [DBG] from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:58.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:57.498832+0000 mgr.smithi084.hjmnez (mgr.14596) 269 : audit [DBG] from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:58.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:58.129931+0000 mon.smithi084 (mon.0) 513 : audit [DBG] from='client.? 172.21.15.84:0/2581871440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 -- 172.21.15.84:0/3997755924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 msgr2=0x7f94f80f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 --2- 172.21.15.84:0/3997755924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 0x7f94f80f9340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f94ec004660 tx=0x7f94ec009b30).stop 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 -- 172.21.15.84:0/3997755924 shutdown_connections 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 --2- 172.21.15.84:0/3997755924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94f80f9830 0x7f94f80fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 --2- 172.21.15.84:0/3997755924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 0x7f94f80f9340 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 -- 172.21.15.84:0/3997755924 >> 172.21.15.84:0/3997755924 conn(0x7f94f80f0d40 msgr2=0x7f94f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 -- 172.21.15.84:0/3997755924 shutdown_connections 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 -- 172.21.15.84:0/3997755924 wait complete. 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 Processor -- start 2024-02-15T18:31:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.543+0000 7f94fea82700 1 -- start start 2024-02-15T18:31:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fea82700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 0x7f94f80f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fea82700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94f80f9830 0x7f94f80f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fea82700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f810ac60 con 0x7f94f8060270 2024-02-15T18:31:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fea82700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f810ada0 con 0x7f94f80f9830 2024-02-15T18:31:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fc81e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 0x7f94f80f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fc81e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 0x7f94f80f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57482/0 (socket says 172.21.15.84:57482) 2024-02-15T18:31:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fc81e700 1 -- 172.21.15.84:0/3697720991 learned_addr learned my addr 172.21.15.84:0/3697720991 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:31:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94f7fff700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94f80f9830 0x7f94f80f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:58.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fc81e700 1 -- 172.21.15.84:0/3697720991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94f80f9830 msgr2=0x7f94f80f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fc81e700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94f80f9830 0x7f94f80f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fc81e700 1 -- 172.21.15.84:0/3697720991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec005040 con 0x7f94f8060270 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fc81e700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 0x7f94f80f6dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f94ec009f50 tx=0x7f94ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94f57fa700 1 -- 172.21.15.84:0/3697720991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94ec018070 con 0x7f94f8060270 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f80f5790 con 0x7f94f8060270 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94f57fa700 1 -- 172.21.15.84:0/3697720991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f94ec007d70 con 0x7f94f8060270 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94f57fa700 1 -- 172.21.15.84:0/3697720991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94ec01c6b0 con 0x7f94f8060270 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.544+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f80f5cf0 con 0x7f94f8060270 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.545+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f8045ad0 con 0x7f94f8060270 2024-02-15T18:31:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.546+0000 7f94f57fa700 1 -- 172.21.15.84:0/3697720991 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f94ec01c970 con 0x7f94f8060270 2024-02-15T18:31:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.546+0000 7f94f57fa700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f94e8060f20 0x7f94e80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.546+0000 7f94f57fa700 1 -- 172.21.15.84:0/3697720991 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f94ec07e1a0 con 0x7f94f8060270 2024-02-15T18:31:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.546+0000 7f94f7fff700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f94e8060f20 0x7f94e80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.546+0000 7f94f7fff700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f94e8060f20 0x7f94e80633e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f94e40041d0 tx=0x7f94e4009040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:58.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.550+0000 7f94f57fa700 1 -- 172.21.15.84:0/3697720991 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f94ec04e7f0 con 0x7f94f8060270 2024-02-15T18:31:58.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:56.756527+0000 mgr.smithi084.hjmnez (mgr.14596) 267 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-02-15T18:31:58.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:57.205989+0000 mon.smithi084 (mon.0) 510 : cluster [DBG] mds.? [v2:172.21.15.84:6826/4000569752,v1:172.21.15.84:6827/4000569752] up:boot 2024-02-15T18:31:58.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:57.206031+0000 mon.smithi084 (mon.0) 511 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 3 up:standby 2024-02-15T18:31:58.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:57.206207+0000 mon.smithi084 (mon.0) 512 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:31:58.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:57.210976+0000 mgr.smithi084.hjmnez (mgr.14596) 268 : audit [DBG] from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:58.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:57.498832+0000 mgr.smithi084.hjmnez (mgr.14596) 269 : audit [DBG] from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:58.640 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:58.129931+0000 mon.smithi084 (mon.0) 513 : audit [DBG] from='client.? 172.21.15.84:0/2581871440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.732+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94f80f5f10 con 0x7f94e8060f20 2024-02-15T18:31:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.733+0000 7f94f57fa700 1 -- 172.21.15.84:0/3697720991 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f94f80f5f10 con 0x7f94e8060f20 2024-02-15T18:31:58.726 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:31:58.726 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:31:58.726 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:31:58.726 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:31:58.726 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:31:58.726 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-02-15T18:31:58.727 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:31:58.727 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:31:58.727 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:31:58.727 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:31:58.727 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "12/21 daemons upgraded", 2024-02-15T18:31:58.727 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:31:58.727 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:31:58.727 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:31:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f94e8060f20 msgr2=0x7f94e80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f94e8060f20 0x7f94e80633e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f94e40041d0 tx=0x7f94e4009040).stop 2024-02-15T18:31:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 msgr2=0x7f94f80f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 0x7f94f80f6dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f94ec009f50 tx=0x7f94ec009b30).stop 2024-02-15T18:31:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 shutdown_connections 2024-02-15T18:31:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f94e8060f20 0x7f94e80633e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f8060270 0x7f94f80f6dc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 --2- 172.21.15.84:0/3697720991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94f80f9830 0x7f94f80f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 >> 172.21.15.84:0/3697720991 conn(0x7f94f80f0d40 msgr2=0x7f94f80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 shutdown_connections 2024-02-15T18:31:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:31:58.735+0000 7f94fea82700 1 -- 172.21.15.84:0/3697720991 wait complete. 2024-02-15T18:31:59.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:57.782800+0000 mgr.smithi084.hjmnez (mgr.14596) 270 : audit [DBG] from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:59.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:31:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:58.442596+0000 mon.smithi084 (mon.0) 514 : audit [DBG] from='client.? 172.21.15.84:0/1369534558' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:31:59.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:57.782800+0000 mgr.smithi084.hjmnez (mgr.14596) 270 : audit [DBG] from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:59.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:31:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:58.442596+0000 mon.smithi084 (mon.0) 514 : audit [DBG] from='client.? 172.21.15.84:0/1369534558' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:32:00.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:31:58.733980+0000 mgr.smithi084.hjmnez (mgr.14596) 271 : audit [DBG] from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:00.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:31:58.757008+0000 mgr.smithi084.hjmnez (mgr.14596) 272 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-02-15T18:32:00.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:31:58.733980+0000 mgr.smithi084.hjmnez (mgr.14596) 271 : audit [DBG] from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:00.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:31:58.757008+0000 mgr.smithi084.hjmnez (mgr.14596) 272 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-02-15T18:32:02.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:00.757526+0000 mgr.smithi084.hjmnez (mgr.14596) 273 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-02-15T18:32:02.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:00.757526+0000 mgr.smithi084.hjmnez (mgr.14596) 273 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-02-15T18:32:04.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:02.758175+0000 mgr.smithi084.hjmnez (mgr.14596) 274 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-15T18:32:04.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.202473+0000 mon.smithi084 (mon.0) 515 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:04.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.204385+0000 mon.smithi084 (mon.0) 516 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:04.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.205182+0000 mon.smithi084 (mon.0) 517 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:04.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.210403+0000 mon.smithi084 (mon.0) 518 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:04.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.216128+0000 mon.smithi084 (mon.0) 519 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:04.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:02.758175+0000 mgr.smithi084.hjmnez (mgr.14596) 274 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-15T18:32:04.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.202473+0000 mon.smithi084 (mon.0) 515 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:04.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.204385+0000 mon.smithi084 (mon.0) 516 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:04.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.205182+0000 mon.smithi084 (mon.0) 517 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:04.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.210403+0000 mon.smithi084 (mon.0) 518 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:04.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.216128+0000 mon.smithi084 (mon.0) 519 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:05.334 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:04.205853+0000 mgr.smithi084.hjmnez (mgr.14596) 275 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:05.335 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.221702+0000 mon.smithi084 (mon.0) 520 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:05.335 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.223382+0000 mon.smithi084 (mon.0) 521 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:05.335 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.224898+0000 mon.smithi084 (mon.0) 522 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:05.335 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.226950+0000 mon.smithi084 (mon.0) 523 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:05.335 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:04.228882+0000 mon.smithi084 (mon.0) 524 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi084.cuytny"]}]: dispatch 2024-02-15T18:32:05.335 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:04.229413+0000 mgr.smithi084.hjmnez (mgr.14596) 276 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi084.cuytny 2024-02-15T18:32:05.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:04.205853+0000 mgr.smithi084.hjmnez (mgr.14596) 275 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:05.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.221702+0000 mon.smithi084 (mon.0) 520 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:05.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.223382+0000 mon.smithi084 (mon.0) 521 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:05.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.224898+0000 mon.smithi084 (mon.0) 522 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:05.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.226950+0000 mon.smithi084 (mon.0) 523 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:05.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:04.228882+0000 mon.smithi084 (mon.0) 524 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi084.cuytny"]}]: dispatch 2024-02-15T18:32:05.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:04.229413+0000 mgr.smithi084.hjmnez (mgr.14596) 276 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi084.cuytny 2024-02-15T18:32:06.499 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:04.758599+0000 mgr.smithi084.hjmnez (mgr.14596) 277 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:05.815406+0000 mon.smithi084 (mon.0) 525 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:05.816168+0000 mon.smithi084 (mon.0) 526 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.cuytny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:05.816805+0000 mon.smithi084 (mon.0) 527 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:06.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:04.758599+0000 mgr.smithi084.hjmnez (mgr.14596) 277 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:06.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:05.815406+0000 mon.smithi084 (mon.0) 525 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:06.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:05.816168+0000 mon.smithi084 (mon.0) 526 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.cuytny", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:32:06.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:05.816805+0000 mon.smithi084 (mon.0) 527 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:07.339 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:05.810811+0000 mgr.smithi084.hjmnez (mgr.14596) 278 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi084.cuytny 2024-02-15T18:32:07.339 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:05.817335+0000 mgr.smithi084.hjmnez (mgr.14596) 279 : cephadm [INF] Deploying daemon mds.cephfs.smithi084.cuytny on smithi084 2024-02-15T18:32:07.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:05.810811+0000 mgr.smithi084.hjmnez (mgr.14596) 278 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi084.cuytny 2024-02-15T18:32:07.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:05.817335+0000 mgr.smithi084.hjmnez (mgr.14596) 279 : cephadm [INF] Deploying daemon mds.cephfs.smithi084.cuytny on smithi084 2024-02-15T18:32:08.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:06.759109+0000 mgr.smithi084.hjmnez (mgr.14596) 280 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:08.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:07.634617+0000 mon.smithi084 (mon.0) 528 : cluster [WRN] daemon mds.cephfs.smithi084.cuytny compat changed unexpectedly 2024-02-15T18:32:08.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:07.638350+0000 mon.smithi084 (mon.0) 529 : cluster [DBG] osdmap e79: 6 total, 6 up, 6 in 2024-02-15T18:32:08.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:06.759109+0000 mgr.smithi084.hjmnez (mgr.14596) 280 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:08.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:07.634617+0000 mon.smithi084 (mon.0) 528 : cluster [WRN] daemon mds.cephfs.smithi084.cuytny compat changed unexpectedly 2024-02-15T18:32:08.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:07.638350+0000 mon.smithi084 (mon.0) 529 : cluster [DBG] osdmap e79: 6 total, 6 up, 6 in 2024-02-15T18:32:09.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:08.236173+0000 mon.smithi084 (mon.0) 530 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 2 up:standby 2024-02-15T18:32:09.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:08.236173+0000 mon.smithi084 (mon.0) 530 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 2 up:standby 2024-02-15T18:32:10.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:08.759489+0000 mgr.smithi084.hjmnez (mgr.14596) 281 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:10.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:08.759489+0000 mgr.smithi084.hjmnez (mgr.14596) 281 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:12.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:10.760017+0000 mgr.smithi084.hjmnez (mgr.14596) 282 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:12.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:10.760017+0000 mgr.smithi084.hjmnez (mgr.14596) 282 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:14.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:12.760428+0000 mgr.smithi084.hjmnez (mgr.14596) 283 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:14.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:13.477591+0000 mon.smithi084 (mon.0) 531 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:14.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:13.478273+0000 mon.smithi084 (mon.0) 532 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:14.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:14.249684+0000 mon.smithi084 (mon.0) 533 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] up:boot 2024-02-15T18:32:14.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:14.249723+0000 mon.smithi084 (mon.0) 534 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 3 up:standby 2024-02-15T18:32:14.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:14.249811+0000 mon.smithi084 (mon.0) 535 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:32:14.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:12.760428+0000 mgr.smithi084.hjmnez (mgr.14596) 283 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:14.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:13.477591+0000 mon.smithi084 (mon.0) 531 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:14.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:13.478273+0000 mon.smithi084 (mon.0) 532 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:14.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:14.249684+0000 mon.smithi084 (mon.0) 533 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] up:boot 2024-02-15T18:32:14.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:14.249723+0000 mon.smithi084 (mon.0) 534 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 3 up:standby 2024-02-15T18:32:14.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:14.249811+0000 mon.smithi084 (mon.0) 535 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:32:16.752 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:14.760795+0000 mgr.smithi084.hjmnez (mgr.14596) 284 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:16.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:14.760795+0000 mgr.smithi084.hjmnez (mgr.14596) 284 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:18.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:16.761158+0000 mgr.smithi084.hjmnez (mgr.14596) 285 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:18.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:16.761158+0000 mgr.smithi084.hjmnez (mgr.14596) 285 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:20.043 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:18.761684+0000 mgr.smithi084.hjmnez (mgr.14596) 286 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:20.043 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.049613+0000 mon.smithi084 (mon.0) 536 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:20.043 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.050419+0000 mon.smithi084 (mon.0) 537 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:20.043 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.050986+0000 mon.smithi084 (mon.0) 538 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:20.044 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:19.051456+0000 mgr.smithi084.hjmnez (mgr.14596) 287 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:20.044 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.054326+0000 mon.smithi084 (mon.0) 539 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:20.044 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.058778+0000 mon.smithi084 (mon.0) 540 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:20.044 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.060667+0000 mon.smithi084 (mon.0) 541 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.044 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.061708+0000 mon.smithi084 (mon.0) 542 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.044 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.062688+0000 mon.smithi084 (mon.0) 543 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.044 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.063951+0000 mon.smithi084 (mon.0) 544 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.044 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:19.065406+0000 mon.smithi084 (mon.0) 545 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi084.spootv"]}]: dispatch 2024-02-15T18:32:20.044 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:19.065839+0000 mgr.smithi084.hjmnez (mgr.14596) 288 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi084.spootv 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:18.761684+0000 mgr.smithi084.hjmnez (mgr.14596) 286 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.049613+0000 mon.smithi084 (mon.0) 536 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.050419+0000 mon.smithi084 (mon.0) 537 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.050986+0000 mon.smithi084 (mon.0) 538 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:19.051456+0000 mgr.smithi084.hjmnez (mgr.14596) 287 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.054326+0000 mon.smithi084 (mon.0) 539 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.058778+0000 mon.smithi084 (mon.0) 540 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.060667+0000 mon.smithi084 (mon.0) 541 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.061708+0000 mon.smithi084 (mon.0) 542 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.062688+0000 mon.smithi084 (mon.0) 543 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.063951+0000 mon.smithi084 (mon.0) 544 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:19.065406+0000 mon.smithi084 (mon.0) 545 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi084.spootv"]}]: dispatch 2024-02-15T18:32:20.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:19.065839+0000 mgr.smithi084.hjmnez (mgr.14596) 288 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi084.spootv 2024-02-15T18:32:21.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:20.437373+0000 mgr.smithi084.hjmnez (mgr.14596) 289 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi084.spootv 2024-02-15T18:32:21.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:20.441871+0000 mon.smithi084 (mon.0) 546 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:21.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:20.442532+0000 mon.smithi084 (mon.0) 547 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.spootv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:32:21.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:20.443121+0000 mon.smithi084 (mon.0) 548 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:21.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:21 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:20.443600+0000 mgr.smithi084.hjmnez (mgr.14596) 290 : cephadm [INF] Deploying daemon mds.cephfs.smithi084.spootv on smithi084 2024-02-15T18:32:21.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:20.437373+0000 mgr.smithi084.hjmnez (mgr.14596) 289 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi084.spootv 2024-02-15T18:32:21.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:20.441871+0000 mon.smithi084 (mon.0) 546 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:21.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:20.442532+0000 mon.smithi084 (mon.0) 547 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi084.spootv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:32:21.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:20.443121+0000 mon.smithi084 (mon.0) 548 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:21.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:21 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:20.443600+0000 mgr.smithi084.hjmnez (mgr.14596) 290 : cephadm [INF] Deploying daemon mds.cephfs.smithi084.spootv on smithi084 2024-02-15T18:32:22.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:20.762246+0000 mgr.smithi084.hjmnez (mgr.14596) 291 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:22.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:22.109221+0000 mon.smithi084 (mon.0) 549 : cluster [WRN] daemon mds.cephfs.smithi084.spootv compat changed unexpectedly 2024-02-15T18:32:22.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:22.115309+0000 mon.smithi084 (mon.0) 550 : cluster [DBG] osdmap e80: 6 total, 6 up, 6 in 2024-02-15T18:32:22.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:20.762246+0000 mgr.smithi084.hjmnez (mgr.14596) 291 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:22.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:22.109221+0000 mon.smithi084 (mon.0) 549 : cluster [WRN] daemon mds.cephfs.smithi084.spootv compat changed unexpectedly 2024-02-15T18:32:22.892 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:22.115309+0000 mon.smithi084 (mon.0) 550 : cluster [DBG] osdmap e80: 6 total, 6 up, 6 in 2024-02-15T18:32:23.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:22.452106+0000 mon.smithi084 (mon.0) 551 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 2 up:standby 2024-02-15T18:32:23.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:23 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:22.707534+0000 mon.smithi084 (mon.0) 552 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:32:23.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:22.452106+0000 mon.smithi084 (mon.0) 551 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 2 up:standby 2024-02-15T18:32:23.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:23 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:22.707534+0000 mon.smithi084 (mon.0) 552 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:32:24.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:22.762654+0000 mgr.smithi084.hjmnez (mgr.14596) 292 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:24.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:22.762654+0000 mgr.smithi084.hjmnez (mgr.14596) 292 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:26.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:24.763157+0000 mgr.smithi084.hjmnez (mgr.14596) 293 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:26.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:24.763157+0000 mgr.smithi084.hjmnez (mgr.14596) 293 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:27.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:26.575413+0000 mon.smithi084 (mon.0) 553 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:27.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:26.576193+0000 mon.smithi084 (mon.0) 554 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:27.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:27.465535+0000 mon.smithi084 (mon.0) 555 : cluster [DBG] mds.? [v2:172.21.15.84:6828/2925871822,v1:172.21.15.84:6829/2925871822] up:boot 2024-02-15T18:32:27.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:27.465574+0000 mon.smithi084 (mon.0) 556 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 3 up:standby 2024-02-15T18:32:27.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:27 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:27.466112+0000 mon.smithi084 (mon.0) 557 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:32:28.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:26.575413+0000 mon.smithi084 (mon.0) 553 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:28.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:26.576193+0000 mon.smithi084 (mon.0) 554 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:28.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:27.465535+0000 mon.smithi084 (mon.0) 555 : cluster [DBG] mds.? [v2:172.21.15.84:6828/2925871822,v1:172.21.15.84:6829/2925871822] up:boot 2024-02-15T18:32:28.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:27.465574+0000 mon.smithi084 (mon.0) 556 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.mkpnnx=up:active} 3 up:standby 2024-02-15T18:32:28.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:27 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:27.466112+0000 mon.smithi084 (mon.0) 557 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:32:28.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.836+0000 7f477b096700 1 -- 172.21.15.84:0/2871479648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 msgr2=0x7f47740f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:28.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.836+0000 7f477b096700 1 --2- 172.21.15.84:0/2871479648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 0x7f47740f6b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f4768004660 tx=0x7f4768009b30).stop 2024-02-15T18:32:28.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.836+0000 7f477b096700 1 -- 172.21.15.84:0/2871479648 shutdown_connections 2024-02-15T18:32:28.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.836+0000 7f477b096700 1 --2- 172.21.15.84:0/2871479648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47740f7980 0x7f47740f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:28.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.836+0000 7f477b096700 1 --2- 172.21.15.84:0/2871479648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 0x7f47740f6b00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:28.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.836+0000 7f477b096700 1 -- 172.21.15.84:0/2871479648 >> 172.21.15.84:0/2871479648 conn(0x7f47740f1e40 msgr2=0x7f47740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:28.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.836+0000 7f477b096700 1 -- 172.21.15.84:0/2871479648 shutdown_connections 2024-02-15T18:32:28.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.836+0000 7f477b096700 1 -- 172.21.15.84:0/2871479648 wait complete. 2024-02-15T18:32:28.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f477b096700 1 Processor -- start 2024-02-15T18:32:28.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f477b096700 1 -- start start 2024-02-15T18:32:28.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f477b096700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 0x7f4774109250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:28.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f477b096700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47740f7980 0x7f4774109740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:28.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f477b096700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774109cf0 con 0x7f47740f66e0 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f477b096700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774109e30 con 0x7f47740f7980 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f4778e32700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 0x7f4774109250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f4778e32700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 0x7f4774109250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39940/0 (socket says 172.21.15.84:39940) 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f4778e32700 1 -- 172.21.15.84:0/1103453222 learned_addr learned my addr 172.21.15.84:0/1103453222 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f4773fff700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47740f7980 0x7f4774109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f4778e32700 1 -- 172.21.15.84:0/1103453222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47740f7980 msgr2=0x7f4774109740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f4778e32700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47740f7980 0x7f4774109740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f4778e32700 1 -- 172.21.15.84:0/1103453222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4768005040 con 0x7f47740f66e0 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.837+0000 7f4773fff700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47740f7980 0x7f4774109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.838+0000 7f4778e32700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 0x7f4774109250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f4768013fd0 tx=0x7f4768009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.838+0000 7f47717fa700 1 -- 172.21.15.84:0/1103453222 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4768018070 con 0x7f47740f66e0 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.838+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477410a770 con 0x7f47740f66e0 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.838+0000 7f47717fa700 1 -- 172.21.15.84:0/1103453222 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f4768007d70 con 0x7f47740f66e0 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.838+0000 7f47717fa700 1 -- 172.21.15.84:0/1103453222 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f476801c620 con 0x7f47740f66e0 2024-02-15T18:32:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.838+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477410acd0 con 0x7f47740f66e0 2024-02-15T18:32:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.839+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4774045ad0 con 0x7f47740f66e0 2024-02-15T18:32:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.839+0000 7f47717fa700 1 -- 172.21.15.84:0/1103453222 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f476801d420 con 0x7f47740f66e0 2024-02-15T18:32:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.839+0000 7f47717fa700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4764060f20 0x7f47640633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.840+0000 7f47717fa700 1 -- 172.21.15.84:0/1103453222 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f476807df80 con 0x7f47740f66e0 2024-02-15T18:32:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.840+0000 7f4773fff700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4764060f20 0x7f47640633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.840+0000 7f4773fff700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4764060f20 0x7f47640633e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4760004a70 tx=0x7f4760009040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:28.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:28.844+0000 7f47717fa700 1 -- 172.21.15.84:0/1103453222 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4768051ea0 con 0x7f47740f66e0 2024-02-15T18:32:28.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:26.763548+0000 mgr.smithi084.hjmnez (mgr.14596) 294 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:28.998 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:26.763548+0000 mgr.smithi084.hjmnez (mgr.14596) 294 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:29.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.034+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47740ff0c0 con 0x7f4764060f20 2024-02-15T18:32:29.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.035+0000 7f47717fa700 1 -- 172.21.15.84:0/1103453222 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f47740ff0c0 con 0x7f4764060f20 2024-02-15T18:32:29.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4764060f20 msgr2=0x7f47640633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4764060f20 0x7f47640633e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4760004a70 tx=0x7f4760009040).stop 2024-02-15T18:32:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 msgr2=0x7f4774109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 0x7f4774109250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f4768013fd0 tx=0x7f4768009b30).stop 2024-02-15T18:32:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 shutdown_connections 2024-02-15T18:32:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4764060f20 0x7f47640633e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740f66e0 0x7f4774109250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 --2- 172.21.15.84:0/1103453222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47740f7980 0x7f4774109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 >> 172.21.15.84:0/1103453222 conn(0x7f47740f1e40 msgr2=0x7f477406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 shutdown_connections 2024-02-15T18:32:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.037+0000 7f477b096700 1 -- 172.21.15.84:0/1103453222 wait complete. 2024-02-15T18:32:29.040 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:32:29.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.136+0000 7fa97ad2b700 1 -- 172.21.15.84:0/14058839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 msgr2=0x7fa9740f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.136+0000 7fa97ad2b700 1 --2- 172.21.15.84:0/14058839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 0x7fa9740f5850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fa964004660 tx=0x7fa964009b30).stop 2024-02-15T18:32:29.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.136+0000 7fa97ad2b700 1 -- 172.21.15.84:0/14058839 shutdown_connections 2024-02-15T18:32:29.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.136+0000 7fa97ad2b700 1 --2- 172.21.15.84:0/14058839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9740f66d0 0x7fa9740f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:32:29.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.136+0000 7fa97ad2b700 1 --2- 172.21.15.84:0/14058839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 0x7fa9740f5850 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.136+0000 7fa97ad2b700 1 -- 172.21.15.84:0/14058839 >> 172.21.15.84:0/14058839 conn(0x7fa9740f0b90 msgr2=0x7fa9740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.136+0000 7fa97ad2b700 1 -- 172.21.15.84:0/14058839 shutdown_connections 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.136+0000 7fa97ad2b700 1 -- 172.21.15.84:0/14058839 wait complete. 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa97ad2b700 1 Processor -- start 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa97ad2b700 1 -- start start 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa97ad2b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 0x7fa974109090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa97ad2b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9740f66d0 0x7fa974109580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa97ad2b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa974109bc0 con 0x7fa9740f5430 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa97ad2b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97410a470 con 0x7fa9740f66d0 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa979d29700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 0x7fa974109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa979d29700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 0x7fa974109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39968/0 (socket says 172.21.15.84:39968) 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa979d29700 1 -- 172.21.15.84:0/2913085505 learned_addr learned my addr 172.21.15.84:0/2913085505 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa979d29700 1 -- 172.21.15.84:0/2913085505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9740f66d0 msgr2=0x7fa974109580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa979d29700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9740f66d0 0x7fa974109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:32:29.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa979d29700 1 -- 172.21.15.84:0/2913085505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa964005040 con 0x7fa9740f5430 2024-02-15T18:32:29.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa979d29700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 0x7fa974109090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fa964013fd0 tx=0x7fa964009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:29.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa96a7fc700 1 -- 172.21.15.84:0/2913085505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa964018070 con 0x7fa9740f5430 2024-02-15T18:32:29.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97410a6f0 con 0x7fa9740f5430 2024-02-15T18:32:29.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.137+0000 7fa96a7fc700 1 -- 172.21.15.84:0/2913085505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa964007d70 con 0x7fa9740f5430 2024-02-15T18:32:29.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.138+0000 7fa96a7fc700 1 -- 172.21.15.84:0/2913085505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa96401c620 con 0x7fa9740f5430 2024-02-15T18:32:29.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.138+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97410abd0 con 0x7fa9740f5430 2024-02-15T18:32:29.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.139+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa974059100 con 0x7fa9740f5430 2024-02-15T18:32:29.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.139+0000 7fa96a7fc700 1 -- 172.21.15.84:0/2913085505 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa96401d420 con 0x7fa9740f5430 2024-02-15T18:32:29.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.139+0000 7fa96a7fc700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa960060f70 0x7fa960063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:29.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.139+0000 7fa96a7fc700 1 -- 172.21.15.84:0/2913085505 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa96407dfe0 con 0x7fa9740f5430 2024-02-15T18:32:29.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.139+0000 7fa979528700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa960060f70 0x7fa960063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:29.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.140+0000 7fa979528700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa960060f70 0x7fa960063430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fa970009610 tx=0x7fa970006ab0).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:29.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.144+0000 7fa96a7fc700 1 -- 172.21.15.84:0/2913085505 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa964051f70 con 0x7fa9740f5430 2024-02-15T18:32:29.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.326+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9740fa910 con 0x7fa960060f70 2024-02-15T18:32:29.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.327+0000 7fa96a7fc700 1 -- 172.21.15.84:0/2913085505 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa9740fa910 con 0x7fa960060f70 2024-02-15T18:32:29.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa960060f70 msgr2=0x7fa960063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa960060f70 0x7fa960063430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fa970009610 tx=0x7fa970006ab0).stop 2024-02-15T18:32:29.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 msgr2=0x7fa974109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 0x7fa974109090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fa964013fd0 tx=0x7fa964009b30).stop 2024-02-15T18:32:29.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 shutdown_connections 2024-02-15T18:32:29.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa960060f70 0x7fa960063430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9740f5430 0x7fa974109090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 --2- 172.21.15.84:0/2913085505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9740f66d0 0x7fa974109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:32:29.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 >> 172.21.15.84:0/2913085505 conn(0x7fa9740f0b90 msgr2=0x7fa97405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:29.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 shutdown_connections 2024-02-15T18:32:29.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.329+0000 7fa97ad2b700 1 -- 172.21.15.84:0/2913085505 wait complete. 2024-02-15T18:32:29.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.429+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1583570646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 msgr2=0x7fe0480f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.429+0000 7fe04dd0d700 1 --2- 172.21.15.84:0/1583570646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 0x7fe0480f7920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fe034004660 tx=0x7fe034009b30).stop 2024-02-15T18:32:29.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.429+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1583570646 shutdown_connections 2024-02-15T18:32:29.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.429+0000 7fe04dd0d700 1 --2- 172.21.15.84:0/1583570646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 0x7fe0480f7920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.429+0000 7fe04dd0d700 1 --2- 172.21.15.84:0/1583570646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0480f4800 0x7fe0480f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.429+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1583570646 >> 172.21.15.84:0/1583570646 conn(0x7fe0480f0320 msgr2=0x7fe0480f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.429+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1583570646 shutdown_connections 2024-02-15T18:32:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.429+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1583570646 wait complete. 2024-02-15T18:32:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe04dd0d700 1 Processor -- start 2024-02-15T18:32:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe04dd0d700 1 -- start start 2024-02-15T18:32:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe04dd0d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0480f4800 0x7fe048106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe04dd0d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 0x7fe0481073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe04dd0d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048107950 con 0x7fe0480f51a0 2024-02-15T18:32:29.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe04dd0d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048108150 con 0x7fe0480f4800 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe047fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 0x7fe0481073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe047fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 0x7fe0481073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39982/0 (socket says 172.21.15.84:39982) 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe047fff700 1 -- 172.21.15.84:0/1408308989 learned_addr learned my addr 172.21.15.84:0/1408308989 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.430+0000 7fe04cd0b700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0480f4800 0x7fe048106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.431+0000 7fe047fff700 1 -- 172.21.15.84:0/1408308989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0480f4800 msgr2=0x7fe048106eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.431+0000 7fe047fff700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0480f4800 0x7fe048106eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.431+0000 7fe047fff700 1 -- 172.21.15.84:0/1408308989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034005040 con 0x7fe0480f51a0 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.431+0000 7fe047fff700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 0x7fe0481073a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe034004e30 tx=0x7fe034009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.431+0000 7fe0457fa700 1 -- 172.21.15.84:0/1408308989 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe034018070 con 0x7fe0480f51a0 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.431+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0481083d0 con 0x7fe0480f51a0 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.431+0000 7fe0457fa700 1 -- 172.21.15.84:0/1408308989 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fe034007ba0 con 0x7fe0480f51a0 2024-02-15T18:32:29.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.431+0000 7fe0457fa700 1 -- 172.21.15.84:0/1408308989 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe03401c3c0 con 0x7fe0480f51a0 2024-02-15T18:32:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.431+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe048108930 con 0x7fe0480f51a0 2024-02-15T18:32:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.432+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe048059100 con 0x7fe0480f51a0 2024-02-15T18:32:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.432+0000 7fe0457fa700 1 -- 172.21.15.84:0/1408308989 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe03401c680 con 0x7fe0480f51a0 2024-02-15T18:32:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.433+0000 7fe0457fa700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe038060f70 0x7fe038063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.433+0000 7fe0457fa700 1 -- 172.21.15.84:0/1408308989 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe03407dd40 con 0x7fe0480f51a0 2024-02-15T18:32:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.433+0000 7fe04cd0b700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe038060f70 0x7fe038063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.433+0000 7fe04cd0b700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe038060f70 0x7fe038063430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fe04805eb60 tx=0x7fe03c00b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:29.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.437+0000 7fe0457fa700 1 -- 172.21.15.84:0/1408308989 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe034051bf0 con 0x7fe0480f51a0 2024-02-15T18:32:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.660+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0480fee30 con 0x7fe038060f70 2024-02-15T18:32:29.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.669+0000 7fe0457fa700 1 -- 172.21.15.84:0/1408308989 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe0480fee30 con 0x7fe038060f70 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (11m) 10s ago 13m 17.7M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (4m) 10s ago 13m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (4m) 67s ago 12m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (11m) 10s ago 13m 36.0M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (16s) 10s ago 8m 10.5M - 16.2.14-521-g0e714d9a 1fbc92c859dc 0914a2eeed6f 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 starting - - - - 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (8m) 67s ago 8m 124M - 16.2.4 8d91d370c2b8 455a19023e13 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (8m) 67s ago 8m 15.0M - 16.2.4 8d91d370c2b8 81940aa02d7f 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (6m) 10s ago 14m 437M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (5m) 67s ago 12m 389M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:32:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (5m) 10s ago 15m 54.8M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (4m) 67s ago 12m 40.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (13m) 10s ago 13m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (12m) 67s ago 12m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (3m) 10s ago 11m 203M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 10s ago 11m 247M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (2m) 10s ago 11m 184M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (2m) 67s ago 10m 264M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc b8c15d05905a 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (98s) 67s ago 10m 239M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 612e5da9dba4 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (70s) 67s ago 9m 11.6M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 93c01314b455 2024-02-15T18:32:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (6m) 10s ago 12m 68.0M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:32:29.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe038060f70 msgr2=0x7fe038063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe038060f70 0x7fe038063430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fe04805eb60 tx=0x7fe03c00b040).stop 2024-02-15T18:32:29.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 msgr2=0x7fe0481073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 0x7fe0481073a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe034004e30 tx=0x7fe034009b30).stop 2024-02-15T18:32:29.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 shutdown_connections 2024-02-15T18:32:29.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe038060f70 0x7fe038063430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0480f4800 0x7fe048106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 --2- 172.21.15.84:0/1408308989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0480f51a0 0x7fe0481073a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 >> 172.21.15.84:0/1408308989 conn(0x7fe0480f0320 msgr2=0x7fe0480fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:29.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 shutdown_connections 2024-02-15T18:32:29.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.671+0000 7fe04dd0d700 1 -- 172.21.15.84:0/1408308989 wait complete. 2024-02-15T18:32:29.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.768+0000 7f88b53c6700 1 -- 172.21.15.84:0/2746228883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 msgr2=0x7f88b00f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.768+0000 7f88b53c6700 1 --2- 172.21.15.84:0/2746228883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 0x7f88b00f6b60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f88a4004660 tx=0x7f88a4009b30).stop 2024-02-15T18:32:29.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.768+0000 7f88b53c6700 1 -- 172.21.15.84:0/2746228883 shutdown_connections 2024-02-15T18:32:29.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.768+0000 7f88b53c6700 1 --2- 172.21.15.84:0/2746228883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 0x7f88b00f6b60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.768+0000 7f88b53c6700 1 --2- 172.21.15.84:0/2746228883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b00f5460 0x7f88b00f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.768+0000 7f88b53c6700 1 -- 172.21.15.84:0/2746228883 >> 172.21.15.84:0/2746228883 conn(0x7f88b00f0bc0 msgr2=0x7f88b00f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:29.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.768+0000 7f88b53c6700 1 -- 172.21.15.84:0/2746228883 shutdown_connections 2024-02-15T18:32:29.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.768+0000 7f88b53c6700 1 -- 172.21.15.84:0/2746228883 wait complete. 2024-02-15T18:32:29.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88b53c6700 1 Processor -- start 2024-02-15T18:32:29.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88b53c6700 1 -- start start 2024-02-15T18:32:29.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88b53c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b00f5460 0x7f88b0105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:29.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88b53c6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 0x7f88b0106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:29.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88b53c6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0106840 con 0x7f88b00f6700 2024-02-15T18:32:29.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88b53c6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0107050 con 0x7f88b00f5460 2024-02-15T18:32:29.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88ae7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 0x7f88b0106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88ae7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 0x7f88b0106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39998/0 (socket says 172.21.15.84:39998) 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88ae7fc700 1 -- 172.21.15.84:0/4017589831 learned_addr learned my addr 172.21.15.84:0/4017589831 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.769+0000 7f88aeffd700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b00f5460 0x7f88b0105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88ae7fc700 1 -- 172.21.15.84:0/4017589831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b00f5460 msgr2=0x7f88b0105d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88ae7fc700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b00f5460 0x7f88b0105d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88ae7fc700 1 -- 172.21.15.84:0/4017589831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a4005040 con 0x7f88b00f6700 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88aeffd700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b00f5460 0x7f88b0105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88ae7fc700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 0x7f88b0106240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f88a4009f50 tx=0x7f88a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88977fe700 1 -- 172.21.15.84:0/4017589831 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a401a070 con 0x7f88b00f6700 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b0107270 con 0x7f88b00f6700 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88977fe700 1 -- 172.21.15.84:0/4017589831 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f88a401faf0 con 0x7f88b00f6700 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88977fe700 1 -- 172.21.15.84:0/4017589831 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a401e940 con 0x7f88b00f6700 2024-02-15T18:32:29.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.770+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b01077d0 con 0x7f88b00f6700 2024-02-15T18:32:29.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.771+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b0059100 con 0x7f88b00f6700 2024-02-15T18:32:29.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.771+0000 7f88977fe700 1 -- 172.21.15.84:0/4017589831 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f88a401fc60 con 0x7f88b00f6700 2024-02-15T18:32:29.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.772+0000 7f88977fe700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8898060f70 0x7f8898063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.772+0000 7f88977fe700 1 -- 172.21.15.84:0/4017589831 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f88a40802f0 con 0x7f88b00f6700 2024-02-15T18:32:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.772+0000 7f88aeffd700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8898060f70 0x7f8898063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.772+0000 7f88aeffd700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8898060f70 0x7f8898063430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f88b0105ac0 tx=0x7f88a0009c00).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:29.776+0000 7f88977fe700 1 -- 172.21.15.84:0/4017589831 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f88a4050770 con 0x7f88b00f6700 2024-02-15T18:32:30.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.019+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f88b00ff790 con 0x7f88b00f6700 2024-02-15T18:32:30.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.020+0000 7f88977fe700 1 -- 172.21.15.84:0/4017589831 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f88a401b270 con 0x7f88b00f6700 2024-02-15T18:32:30.012 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:32:30.012 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:32:30.012 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2, 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 12, 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:32:30.013 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:32:30.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.021+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8898060f70 msgr2=0x7f8898063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.021+0000 7f88b53c6700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8898060f70 0x7f8898063430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f88b0105ac0 tx=0x7f88a0009c00).stop 2024-02-15T18:32:30.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.021+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 msgr2=0x7f88b0106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.021+0000 7f88b53c6700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 0x7f88b0106240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f88a4009f50 tx=0x7f88a4009b30).stop 2024-02-15T18:32:30.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.022+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 shutdown_connections 2024-02-15T18:32:30.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.022+0000 7f88b53c6700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8898060f70 0x7f8898063430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.022+0000 7f88b53c6700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b00f5460 0x7f88b0105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.022+0000 7f88b53c6700 1 --2- 172.21.15.84:0/4017589831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b00f6700 0x7f88b0106240 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.022+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 >> 172.21.15.84:0/4017589831 conn(0x7f88b00f0bc0 msgr2=0x7f88b00fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:30.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.022+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 shutdown_connections 2024-02-15T18:32:30.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.022+0000 7f88b53c6700 1 -- 172.21.15.84:0/4017589831 wait complete. 2024-02-15T18:32:30.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.122+0000 7f026ee77700 1 -- 172.21.15.84:0/1203794838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 msgr2=0x7f02680f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.122+0000 7f026ee77700 1 --2- 172.21.15.84:0/1203794838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 0x7f02680f6b30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f0264004660 tx=0x7f0264009b30).stop 2024-02-15T18:32:30.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.122+0000 7f026ee77700 1 -- 172.21.15.84:0/1203794838 shutdown_connections 2024-02-15T18:32:30.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.122+0000 7f026ee77700 1 --2- 172.21.15.84:0/1203794838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 0x7f02680f6b30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.122+0000 7f026ee77700 1 --2- 172.21.15.84:0/1203794838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02680f5430 0x7f02680f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.122+0000 7f026ee77700 1 -- 172.21.15.84:0/1203794838 >> 172.21.15.84:0/1203794838 conn(0x7f02680f0b90 msgr2=0x7f02680f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.122+0000 7f026ee77700 1 -- 172.21.15.84:0/1203794838 shutdown_connections 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.122+0000 7f026ee77700 1 -- 172.21.15.84:0/1203794838 wait complete. 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026ee77700 1 Processor -- start 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026ee77700 1 -- start start 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026ee77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02680f5430 0x7f02680f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026ee77700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 0x7f02680f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026ee77700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680f7f70 con 0x7f02680f66d0 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026ee77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680f80b0 con 0x7f02680f5430 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026d674700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 0x7f02680f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026d674700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 0x7f02680f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40020/0 (socket says 172.21.15.84:40020) 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026d674700 1 -- 172.21.15.84:0/2388107654 learned_addr learned my addr 172.21.15.84:0/2388107654 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026de75700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02680f5430 0x7f02680f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026d674700 1 -- 172.21.15.84:0/2388107654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02680f5430 msgr2=0x7f02680f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026d674700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02680f5430 0x7f02680f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.123+0000 7f026d674700 1 -- 172.21.15.84:0/2388107654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0264005040 con 0x7f02680f66d0 2024-02-15T18:32:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.124+0000 7f026d674700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 0x7f02680f7a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f0264009f50 tx=0x7f0264009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.124+0000 7f025e7fc700 1 -- 172.21.15.84:0/2388107654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0264018070 con 0x7f02680f66d0 2024-02-15T18:32:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.124+0000 7f025e7fc700 1 -- 172.21.15.84:0/2388107654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0264007ba0 con 0x7f02680f66d0 2024-02-15T18:32:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.124+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02680f8330 con 0x7f02680f66d0 2024-02-15T18:32:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.124+0000 7f025e7fc700 1 -- 172.21.15.84:0/2388107654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f026401c420 con 0x7f02680f66d0 2024-02-15T18:32:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.124+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02680f8890 con 0x7f02680f66d0 2024-02-15T18:32:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.125+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0268045ad0 con 0x7f02680f66d0 2024-02-15T18:32:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.125+0000 7f025e7fc700 1 -- 172.21.15.84:0/2388107654 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f026401d420 con 0x7f02680f66d0 2024-02-15T18:32:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.125+0000 7f025e7fc700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0254060f70 0x7f0254063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.126+0000 7f025e7fc700 1 -- 172.21.15.84:0/2388107654 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f026407ddc0 con 0x7f02680f66d0 2024-02-15T18:32:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.126+0000 7f026de75700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0254060f70 0x7f0254063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.126+0000 7f026de75700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0254060f70 0x7f0254063430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f02680f9320 tx=0x7f025800b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.130+0000 7f025e7fc700 1 -- 172.21.15.84:0/2388107654 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f026404e1e0 con 0x7f02680f66d0 2024-02-15T18:32:30.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.339+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f02680fdd00 con 0x7f02680f66d0 2024-02-15T18:32:30.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.340+0000 7f025e7fc700 1 -- 172.21.15.84:0/2388107654 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1766 (secure 0 0 0) 0x7f0264051800 con 0x7f02680f66d0 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:e27 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 22 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:31:56.195144+0000 2024-02-15T18:32:30.334 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 1 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:in 0 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24239} 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 1 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:32:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{0:24239} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.133:6824/652243261,v1:172.21.15.133:6825/652243261] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{-1:34338} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:30.336 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.84:6828/2925871822,v1:172.21.15.84:6829/2925871822] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.342+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0254060f70 msgr2=0x7f0254063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.342+0000 7f026ee77700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0254060f70 0x7f0254063430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f02680f9320 tx=0x7f025800b040).stop 2024-02-15T18:32:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.342+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 msgr2=0x7f02680f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.342+0000 7f026ee77700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 0x7f02680f7a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f0264009f50 tx=0x7f0264009b30).stop 2024-02-15T18:32:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.342+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 shutdown_connections 2024-02-15T18:32:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.342+0000 7f026ee77700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0254060f70 0x7f0254063430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.342+0000 7f026ee77700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02680f5430 0x7f02680f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.342+0000 7f026ee77700 1 --2- 172.21.15.84:0/2388107654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02680f66d0 0x7f02680f7a10 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0x7f0264009f50 tx=0x7f0264009b30).stop 2024-02-15T18:32:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.342+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 >> 172.21.15.84:0/2388107654 conn(0x7f02680f0b90 msgr2=0x7f026805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.344+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 shutdown_connections 2024-02-15T18:32:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.344+0000 7f026ee77700 1 -- 172.21.15.84:0/2388107654 wait complete. 2024-02-15T18:32:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-02-15T18:32:30.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.458+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2013019231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f55e0 msgr2=0x7fe1ac0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.458+0000 7fe1b3ab6700 1 --2- 172.21.15.84:0/2013019231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f55e0 0x7fe1ac0f5a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe1a8004660 tx=0x7fe1a8009b30).stop 2024-02-15T18:32:30.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.458+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2013019231 shutdown_connections 2024-02-15T18:32:30.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.458+0000 7fe1b3ab6700 1 --2- 172.21.15.84:0/2013019231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1ac0f5ef0 0x7fe1ac0f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.458+0000 7fe1b3ab6700 1 --2- 172.21.15.84:0/2013019231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f55e0 0x7fe1ac0f5a00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.458+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2013019231 >> 172.21.15.84:0/2013019231 conn(0x7fe1ac0f0de0 msgr2=0x7fe1ac0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:30.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.459+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2013019231 shutdown_connections 2024-02-15T18:32:30.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.459+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2013019231 wait complete. 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.459+0000 7fe1b3ab6700 1 Processor -- start 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.459+0000 7fe1b3ab6700 1 -- start start 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.459+0000 7fe1b3ab6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1ac0f55e0 0x7fe1ac105f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.459+0000 7fe1b3ab6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f5ef0 0x7fe1ac1063f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.459+0000 7fe1b3ab6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1069a0 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.459+0000 7fe1b3ab6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac106ae0 con 0x7fe1ac0f55e0 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b1051700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f5ef0 0x7fe1ac1063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b1051700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f5ef0 0x7fe1ac1063f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40048/0 (socket says 172.21.15.84:40048) 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b1051700 1 -- 172.21.15.84:0/2390884546 learned_addr learned my addr 172.21.15.84:0/2390884546 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:32:30.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b1852700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1ac0f55e0 0x7fe1ac105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:30.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b1051700 1 -- 172.21.15.84:0/2390884546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1ac0f55e0 msgr2=0x7fe1ac105f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b1051700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1ac0f55e0 0x7fe1ac105f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b1051700 1 -- 172.21.15.84:0/2390884546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8005040 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b1051700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f5ef0 0x7fe1ac1063f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe19c002650 tx=0x7fe19c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:30.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1a27fc700 1 -- 172.21.15.84:0/2390884546 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19c007ba0 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1a27fc700 1 -- 172.21.15.84:0/2390884546 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fe19c0095c0 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac107480 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1a27fc700 1 -- 172.21.15.84:0/2390884546 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19c011d90 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.460+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac107a40 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.461+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe194004fa0 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.462+0000 7fe1a27fc700 1 -- 172.21.15.84:0/2390884546 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe19c012460 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.462+0000 7fe1a27fc700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe198060f20 0x7fe1980633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.462+0000 7fe1a27fc700 1 -- 172.21.15.84:0/2390884546 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe19c07e570 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.462+0000 7fe1b1852700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe198060f20 0x7fe1980633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:30.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.463+0000 7fe1b1852700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe198060f20 0x7fe1980633e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe1a8004630 tx=0x7fe1a8009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:30.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.467+0000 7fe1a27fc700 1 -- 172.21.15.84:0/2390884546 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe19c052440 con 0x7fe1ac0f5ef0 2024-02-15T18:32:30.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.660+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe194000bc0 con 0x7fe198060f20 2024-02-15T18:32:30.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.661+0000 7fe1a27fc700 1 -- 172.21.15.84:0/2390884546 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe194000bc0 con 0x7fe198060f20 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "osd", 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr" 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "13/21 daemons upgraded", 2024-02-15T18:32:30.654 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading mds daemons", 2024-02-15T18:32:30.655 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:32:30.655 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:32:30.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe198060f20 msgr2=0x7fe1980633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe198060f20 0x7fe1980633e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fe1a8004630 tx=0x7fe1a8009b30).stop 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f5ef0 msgr2=0x7fe1ac1063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f5ef0 0x7fe1ac1063f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe19c002650 tx=0x7fe19c009de0).stop 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 shutdown_connections 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe198060f20 0x7fe1980633e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1ac0f55e0 0x7fe1ac105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 --2- 172.21.15.84:0/2390884546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ac0f5ef0 0x7fe1ac1063f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 >> 172.21.15.84:0/2390884546 conn(0x7fe1ac0f0de0 msgr2=0x7fe1ac0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 shutdown_connections 2024-02-15T18:32:30.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:32:30.663+0000 7fe1b3ab6700 1 -- 172.21.15.84:0/2390884546 wait complete. 2024-02-15T18:32:30.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:28.764069+0000 mgr.smithi084.hjmnez (mgr.14596) 295 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:30.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:29.035890+0000 mgr.smithi084.hjmnez (mgr.14596) 296 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:30.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:29.327662+0000 mgr.smithi084.hjmnez (mgr.14596) 297 : audit [DBG] from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:30.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:29.662089+0000 mgr.smithi084.hjmnez (mgr.14596) 298 : audit [DBG] from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:30.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:30.020640+0000 mon.smithi084 (mon.0) 558 : audit [DBG] from='client.? 172.21.15.84:0/4017589831' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:30.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:30.340737+0000 mon.smithi084 (mon.0) 559 : audit [DBG] from='client.? 172.21.15.84:0/2388107654' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:32:31.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:28.764069+0000 mgr.smithi084.hjmnez (mgr.14596) 295 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:31.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:29.035890+0000 mgr.smithi084.hjmnez (mgr.14596) 296 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:31.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:29.327662+0000 mgr.smithi084.hjmnez (mgr.14596) 297 : audit [DBG] from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:31.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:29.662089+0000 mgr.smithi084.hjmnez (mgr.14596) 298 : audit [DBG] from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:31.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:30.020640+0000 mon.smithi084 (mon.0) 558 : audit [DBG] from='client.? 172.21.15.84:0/4017589831' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:31.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:30.340737+0000 mon.smithi084 (mon.0) 559 : audit [DBG] from='client.? 172.21.15.84:0/2388107654' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:32:31.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:30.662006+0000 mgr.smithi084.hjmnez (mgr.14596) 299 : audit [DBG] from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:31.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.364436+0000 mon.smithi084 (mon.0) 560 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:31.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.365155+0000 mon.smithi084 (mon.0) 561 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:31.853 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.365745+0000 mon.smithi084 (mon.0) 562 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:31.854 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.371257+0000 mon.smithi084 (mon.0) 563 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:31.854 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.375726+0000 mon.smithi084 (mon.0) 564 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:31.854 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.377689+0000 mon.smithi084 (mon.0) 565 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:31.854 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.378689+0000 mon.smithi084 (mon.0) 566 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:31.854 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.379637+0000 mon.smithi084 (mon.0) 567 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:31.854 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.380863+0000 mon.smithi084 (mon.0) 568 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:31.854 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:31.382373+0000 mon.smithi084 (mon.0) 569 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi133.mkpnnx"]}]: dispatch 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:30.662006+0000 mgr.smithi084.hjmnez (mgr.14596) 299 : audit [DBG] from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.364436+0000 mon.smithi084 (mon.0) 560 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.365155+0000 mon.smithi084 (mon.0) 561 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.365745+0000 mon.smithi084 (mon.0) 562 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.371257+0000 mon.smithi084 (mon.0) 563 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.375726+0000 mon.smithi084 (mon.0) 564 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.377689+0000 mon.smithi084 (mon.0) 565 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.378689+0000 mon.smithi084 (mon.0) 566 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.379637+0000 mon.smithi084 (mon.0) 567 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.380863+0000 mon.smithi084 (mon.0) 568 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:32.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:31.382373+0000 mon.smithi084 (mon.0) 569 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi133.mkpnnx"]}]: dispatch 2024-02-15T18:32:32.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:30.764568+0000 mgr.smithi084.hjmnez (mgr.14596) 300 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:32.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:31.366263+0000 mgr.smithi084.hjmnez (mgr.14596) 301 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:32.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:31.382843+0000 mgr.smithi084.hjmnez (mgr.14596) 302 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi133.mkpnnx 2024-02-15T18:32:33.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:30.764568+0000 mgr.smithi084.hjmnez (mgr.14596) 300 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:33.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:31.366263+0000 mgr.smithi084.hjmnez (mgr.14596) 301 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:33.007 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:31.382843+0000 mgr.smithi084.hjmnez (mgr.14596) 302 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi133.mkpnnx 2024-02-15T18:32:34.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:32.765101+0000 mgr.smithi084.hjmnez (mgr.14596) 303 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:34.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:33.250419+0000 mgr.smithi084.hjmnez (mgr.14596) 304 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi133.mkpnnx 2024-02-15T18:32:34.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:33.255346+0000 mon.smithi084 (mon.0) 570 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:34.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:33.256375+0000 mon.smithi084 (mon.0) 571 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.mkpnnx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:32:34.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:33.257281+0000 mon.smithi084 (mon.0) 572 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:34.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:33.258040+0000 mgr.smithi084.hjmnez (mgr.14596) 305 : cephadm [INF] Deploying daemon mds.cephfs.smithi133.mkpnnx on smithi133 2024-02-15T18:32:34.623 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:32.765101+0000 mgr.smithi084.hjmnez (mgr.14596) 303 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:34.623 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:33.250419+0000 mgr.smithi084.hjmnez (mgr.14596) 304 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi133.mkpnnx 2024-02-15T18:32:34.623 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:33.255346+0000 mon.smithi084 (mon.0) 570 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:34.623 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:33.256375+0000 mon.smithi084 (mon.0) 571 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.mkpnnx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:32:34.623 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:33.257281+0000 mon.smithi084 (mon.0) 572 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:34.623 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:33.258040+0000 mgr.smithi084.hjmnez (mgr.14596) 305 : cephadm [INF] Deploying daemon mds.cephfs.smithi133.mkpnnx on smithi133 2024-02-15T18:32:36.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:34.765790+0000 mgr.smithi084.hjmnez (mgr.14596) 306 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:36.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:34.907394+0000 mon.smithi084 (mon.0) 573 : cluster [DBG] osdmap e81: 6 total, 6 up, 6 in 2024-02-15T18:32:36.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:35.091788+0000 mon.smithi084 (mon.0) 574 : cluster [INF] Standby daemon mds.cephfs.smithi133.ubglfw assigned to filesystem cephfs as rank 0 2024-02-15T18:32:36.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:35.091957+0000 mon.smithi084 (mon.0) 575 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T18:32:36.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:35.096047+0000 mon.smithi084 (mon.0) 576 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi133.ubglfw=up:replay} 2 up:standby 2024-02-15T18:32:36.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:34.765790+0000 mgr.smithi084.hjmnez (mgr.14596) 306 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:32:36.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:34.907394+0000 mon.smithi084 (mon.0) 573 : cluster [DBG] osdmap e81: 6 total, 6 up, 6 in 2024-02-15T18:32:36.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:35.091788+0000 mon.smithi084 (mon.0) 574 : cluster [INF] Standby daemon mds.cephfs.smithi133.ubglfw assigned to filesystem cephfs as rank 0 2024-02-15T18:32:36.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:35.091957+0000 mon.smithi084 (mon.0) 575 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T18:32:36.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:35.096047+0000 mon.smithi084 (mon.0) 576 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi133.ubglfw=up:replay} 2 up:standby 2024-02-15T18:32:38.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:36.766144+0000 mgr.smithi084.hjmnez (mgr.14596) 307 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-02-15T18:32:38.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:36.907775+0000 mon.smithi084 (mon.0) 577 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:38.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:36.766144+0000 mgr.smithi084.hjmnez (mgr.14596) 307 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-02-15T18:32:38.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:36.907775+0000 mon.smithi084 (mon.0) 577 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:40.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:39 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:38.766684+0000 mgr.smithi084.hjmnez (mgr.14596) 308 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-02-15T18:32:40.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:39 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:38.766684+0000 mgr.smithi084.hjmnez (mgr.14596) 308 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-02-15T18:32:42.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:40.767242+0000 mgr.smithi084.hjmnez (mgr.14596) 309 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-15T18:32:42.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:41.426438+0000 mon.smithi084 (mon.0) 578 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:42.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:41.427300+0000 mon.smithi084 (mon.0) 579 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:42.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:42.100716+0000 mon.smithi084 (mon.0) 580 : cluster [DBG] mds.? [v2:172.21.15.133:6824/553393719,v1:172.21.15.133:6825/553393719] up:boot 2024-02-15T18:32:42.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:42.100798+0000 mon.smithi084 (mon.0) 581 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi133.ubglfw=up:replay} 3 up:standby 2024-02-15T18:32:42.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:42.100924+0000 mon.smithi084 (mon.0) 582 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:32:42.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:40.767242+0000 mgr.smithi084.hjmnez (mgr.14596) 309 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-15T18:32:42.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:41.426438+0000 mon.smithi084 (mon.0) 578 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:42.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:41.427300+0000 mon.smithi084 (mon.0) 579 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:42.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:42.100716+0000 mon.smithi084 (mon.0) 580 : cluster [DBG] mds.? [v2:172.21.15.133:6824/553393719,v1:172.21.15.133:6825/553393719] up:boot 2024-02-15T18:32:42.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:42.100798+0000 mon.smithi084 (mon.0) 581 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi133.ubglfw=up:replay} 3 up:standby 2024-02-15T18:32:42.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:42.100924+0000 mon.smithi084 (mon.0) 582 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:32:44.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:42.767889+0000 mgr.smithi084.hjmnez (mgr.14596) 310 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-15T18:32:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:43.102536+0000 mon.smithi084 (mon.0) 583 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:reconnect 2024-02-15T18:32:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:43.102603+0000 mon.smithi084 (mon.0) 584 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi133.ubglfw=up:reconnect} 3 up:standby 2024-02-15T18:32:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:43.104639+0000 mds.cephfs.smithi133.ubglfw (mds.0) 1 : cluster [DBG] reconnect by client.24291 v1:192.168.0.1:0/2690595474 after 0.00399993 2024-02-15T18:32:44.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:43.104709+0000 mds.cephfs.smithi133.ubglfw (mds.0) 2 : cluster [DBG] reconnect by client.24285 v1:172.21.15.84:0/3631852517 after 0.00399993 2024-02-15T18:32:44.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:42.767889+0000 mgr.smithi084.hjmnez (mgr.14596) 310 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-15T18:32:44.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:43.102536+0000 mon.smithi084 (mon.0) 583 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:reconnect 2024-02-15T18:32:44.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:43.102603+0000 mon.smithi084 (mon.0) 584 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi133.ubglfw=up:reconnect} 3 up:standby 2024-02-15T18:32:44.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:43.104639+0000 mds.cephfs.smithi133.ubglfw (mds.0) 1 : cluster [DBG] reconnect by client.24291 v1:192.168.0.1:0/2690595474 after 0.00399993 2024-02-15T18:32:44.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:43.104709+0000 mds.cephfs.smithi133.ubglfw (mds.0) 2 : cluster [DBG] reconnect by client.24285 v1:172.21.15.84:0/3631852517 after 0.00399993 2024-02-15T18:32:45.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:44.104180+0000 mon.smithi084 (mon.0) 585 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:rejoin 2024-02-15T18:32:45.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:44.104264+0000 mon.smithi084 (mon.0) 586 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi133.ubglfw=up:rejoin} 3 up:standby 2024-02-15T18:32:45.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:44.205402+0000 mon.smithi084 (mon.0) 587 : cluster [INF] daemon mds.cephfs.smithi133.ubglfw is now active in filesystem cephfs as rank 0 2024-02-15T18:32:45.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:44.104180+0000 mon.smithi084 (mon.0) 585 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:rejoin 2024-02-15T18:32:45.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:44.104264+0000 mon.smithi084 (mon.0) 586 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi133.ubglfw=up:rejoin} 3 up:standby 2024-02-15T18:32:45.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:44.205402+0000 mon.smithi084 (mon.0) 587 : cluster [INF] daemon mds.cephfs.smithi133.ubglfw is now active in filesystem cephfs as rank 0 2024-02-15T18:32:46.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:44.768321+0000 mgr.smithi084.hjmnez (mgr.14596) 311 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-15T18:32:46.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:45.108042+0000 mon.smithi084 (mon.0) 588 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T18:32:46.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:45.108071+0000 mon.smithi084 (mon.0) 589 : cluster [INF] Cluster is now healthy 2024-02-15T18:32:46.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:45.117299+0000 mon.smithi084 (mon.0) 590 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:active 2024-02-15T18:32:46.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:45.117360+0000 mon.smithi084 (mon.0) 591 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.ubglfw=up:active} 3 up:standby 2024-02-15T18:32:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:44.768321+0000 mgr.smithi084.hjmnez (mgr.14596) 311 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-15T18:32:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:45.108042+0000 mon.smithi084 (mon.0) 588 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T18:32:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:45.108071+0000 mon.smithi084 (mon.0) 589 : cluster [INF] Cluster is now healthy 2024-02-15T18:32:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:45.117299+0000 mon.smithi084 (mon.0) 590 : cluster [DBG] mds.? [v2:172.21.15.133:6826/560284334,v1:172.21.15.133:6827/560284334] up:active 2024-02-15T18:32:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:45.117360+0000 mon.smithi084 (mon.0) 591 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi133.ubglfw=up:active} 3 up:standby 2024-02-15T18:32:47.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.491888+0000 mon.smithi084 (mon.0) 592 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:47.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.779440+0000 mon.smithi084 (mon.0) 593 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:47.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.780405+0000 mon.smithi084 (mon.0) 594 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:47.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.787559+0000 mon.smithi084 (mon.0) 595 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:47.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.793398+0000 mon.smithi084 (mon.0) 596 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:47.757 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.796097+0000 mon.smithi084 (mon.0) 597 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.797548+0000 mon.smithi084 (mon.0) 598 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.798886+0000 mon.smithi084 (mon.0) 599 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.800603+0000 mon.smithi084 (mon.0) 600 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.758 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:47 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:46.802544+0000 mon.smithi084 (mon.0) 601 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi133.ubglfw"]}]: dispatch 2024-02-15T18:32:47.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.491888+0000 mon.smithi084 (mon.0) 592 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:47.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.779440+0000 mon.smithi084 (mon.0) 593 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:47.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.780405+0000 mon.smithi084 (mon.0) 594 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:47.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.787559+0000 mon.smithi084 (mon.0) 595 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:47.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.793398+0000 mon.smithi084 (mon.0) 596 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:47.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.796097+0000 mon.smithi084 (mon.0) 597 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.797548+0000 mon.smithi084 (mon.0) 598 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.798886+0000 mon.smithi084 (mon.0) 599 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.800603+0000 mon.smithi084 (mon.0) 600 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:46.802544+0000 mon.smithi084 (mon.0) 601 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi133.ubglfw"]}]: dispatch 2024-02-15T18:32:48.744 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:46.768745+0000 mgr.smithi084.hjmnez (mgr.14596) 312 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 5 op/s 2024-02-15T18:32:48.744 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:46.781142+0000 mgr.smithi084.hjmnez (mgr.14596) 313 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:48.744 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:46.803140+0000 mgr.smithi084.hjmnez (mgr.14596) 314 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi133.ubglfw 2024-02-15T18:32:48.744 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:48.238984+0000 mon.smithi084 (mon.0) 602 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:48.744 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:48.239917+0000 mon.smithi084 (mon.0) 603 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.ubglfw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:32:48.744 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:48.240669+0000 mon.smithi084 (mon.0) 604 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:48.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:46.768745+0000 mgr.smithi084.hjmnez (mgr.14596) 312 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 5 op/s 2024-02-15T18:32:48.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:46.781142+0000 mgr.smithi084.hjmnez (mgr.14596) 313 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:48.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:46.803140+0000 mgr.smithi084.hjmnez (mgr.14596) 314 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi133.ubglfw 2024-02-15T18:32:48.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:48.238984+0000 mon.smithi084 (mon.0) 602 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:48.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:48.239917+0000 mon.smithi084 (mon.0) 603 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi133.ubglfw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:32:48.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:48.240669+0000 mon.smithi084 (mon.0) 604 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:49.562 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:48.233714+0000 mgr.smithi084.hjmnez (mgr.14596) 315 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi133.ubglfw 2024-02-15T18:32:49.562 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:48.241319+0000 mgr.smithi084.hjmnez (mgr.14596) 316 : cephadm [INF] Deploying daemon mds.cephfs.smithi133.ubglfw on smithi133 2024-02-15T18:32:49.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:48.233714+0000 mgr.smithi084.hjmnez (mgr.14596) 315 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi133.ubglfw 2024-02-15T18:32:49.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:49 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:48.241319+0000 mgr.smithi084.hjmnez (mgr.14596) 316 : cephadm [INF] Deploying daemon mds.cephfs.smithi133.ubglfw on smithi133 2024-02-15T18:32:50.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:48.769208+0000 mgr.smithi084.hjmnez (mgr.14596) 317 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 5 op/s 2024-02-15T18:32:50.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:49.880175+0000 mon.smithi084 (mon.0) 605 : cluster [DBG] osdmap e82: 6 total, 6 up, 6 in 2024-02-15T18:32:50.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:50.094981+0000 mon.smithi084 (mon.0) 606 : cluster [INF] Standby daemon mds.cephfs.smithi084.cuytny assigned to filesystem cephfs as rank 0 2024-02-15T18:32:50.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:50.095167+0000 mon.smithi084 (mon.0) 607 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T18:32:50.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:50.099310+0000 mon.smithi084 (mon.0) 608 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi084.cuytny=up:replay} 2 up:standby 2024-02-15T18:32:50.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:48.769208+0000 mgr.smithi084.hjmnez (mgr.14596) 317 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 5 op/s 2024-02-15T18:32:50.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:49.880175+0000 mon.smithi084 (mon.0) 605 : cluster [DBG] osdmap e82: 6 total, 6 up, 6 in 2024-02-15T18:32:50.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:50.094981+0000 mon.smithi084 (mon.0) 606 : cluster [INF] Standby daemon mds.cephfs.smithi084.cuytny assigned to filesystem cephfs as rank 0 2024-02-15T18:32:50.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:50.095167+0000 mon.smithi084 (mon.0) 607 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T18:32:50.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:50.099310+0000 mon.smithi084 (mon.0) 608 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi084.cuytny=up:replay} 2 up:standby 2024-02-15T18:32:52.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:50.769542+0000 mgr.smithi084.hjmnez (mgr.14596) 318 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s rd, 614 B/s wr, 5 op/s 2024-02-15T18:32:52.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:50.769542+0000 mgr.smithi084.hjmnez (mgr.14596) 318 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s rd, 614 B/s wr, 5 op/s 2024-02-15T18:32:54.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:52.769979+0000 mgr.smithi084.hjmnez (mgr.14596) 319 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-02-15T18:32:54.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:52.769979+0000 mgr.smithi084.hjmnez (mgr.14596) 319 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-02-15T18:32:56.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:54.770379+0000 mgr.smithi084.hjmnez (mgr.14596) 320 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 5.9 KiB/s wr, 11 op/s 2024-02-15T18:32:56.813 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:54.770379+0000 mgr.smithi084.hjmnez (mgr.14596) 320 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 5.9 KiB/s wr, 11 op/s 2024-02-15T18:32:58.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:56.770798+0000 mgr.smithi084.hjmnez (mgr.14596) 321 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 5.9 KiB/s wr, 10 op/s 2024-02-15T18:32:58.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:56.944375+0000 mon.smithi084 (mon.0) 609 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:58.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:56.945125+0000 mon.smithi084 (mon.0) 610 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:58.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:57.519872+0000 mon.smithi084 (mon.0) 611 : cluster [DBG] mds.? [v2:172.21.15.133:6826/2979200029,v1:172.21.15.133:6827/2979200029] up:boot 2024-02-15T18:32:58.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:57.519921+0000 mon.smithi084 (mon.0) 612 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] up:reconnect 2024-02-15T18:32:58.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:57.519987+0000 mon.smithi084 (mon.0) 613 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi084.cuytny=up:reconnect} 3 up:standby 2024-02-15T18:32:58.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:57 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:57.520121+0000 mon.smithi084 (mon.0) 614 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:32:58.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:56.770798+0000 mgr.smithi084.hjmnez (mgr.14596) 321 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 5.9 KiB/s wr, 10 op/s 2024-02-15T18:32:58.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:56.944375+0000 mon.smithi084 (mon.0) 609 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:32:58.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:56.945125+0000 mon.smithi084 (mon.0) 610 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:58.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:57.519872+0000 mon.smithi084 (mon.0) 611 : cluster [DBG] mds.? [v2:172.21.15.133:6826/2979200029,v1:172.21.15.133:6827/2979200029] up:boot 2024-02-15T18:32:58.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:57.519921+0000 mon.smithi084 (mon.0) 612 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] up:reconnect 2024-02-15T18:32:58.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:57.519987+0000 mon.smithi084 (mon.0) 613 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi084.cuytny=up:reconnect} 3 up:standby 2024-02-15T18:32:58.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:57.520121+0000 mon.smithi084 (mon.0) 614 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:32:59.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:57.522668+0000 mds.cephfs.smithi084.cuytny (mds.0) 1 : cluster [DBG] reconnect by client.24285 v1:172.21.15.84:0/3631852517 after 0.00399993 2024-02-15T18:32:59.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:57.522780+0000 mds.cephfs.smithi084.cuytny (mds.0) 2 : cluster [DBG] reconnect by client.24291 v1:192.168.0.1:0/2690595474 after 0.00399993 2024-02-15T18:32:59.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:58.522151+0000 mon.smithi084 (mon.0) 615 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] up:rejoin 2024-02-15T18:32:59.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:58.522226+0000 mon.smithi084 (mon.0) 616 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi084.cuytny=up:rejoin} 3 up:standby 2024-02-15T18:32:59.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:32:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:58.555346+0000 mon.smithi084 (mon.0) 617 : cluster [INF] daemon mds.cephfs.smithi084.cuytny is now active in filesystem cephfs as rank 0 2024-02-15T18:32:59.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:57.522668+0000 mds.cephfs.smithi084.cuytny (mds.0) 1 : cluster [DBG] reconnect by client.24285 v1:172.21.15.84:0/3631852517 after 0.00399993 2024-02-15T18:32:59.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:57.522780+0000 mds.cephfs.smithi084.cuytny (mds.0) 2 : cluster [DBG] reconnect by client.24291 v1:192.168.0.1:0/2690595474 after 0.00399993 2024-02-15T18:32:59.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:58.522151+0000 mon.smithi084 (mon.0) 615 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] up:rejoin 2024-02-15T18:32:59.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:58.522226+0000 mon.smithi084 (mon.0) 616 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi084.cuytny=up:rejoin} 3 up:standby 2024-02-15T18:32:59.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:32:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:58.555346+0000 mon.smithi084 (mon.0) 617 : cluster [INF] daemon mds.cephfs.smithi084.cuytny is now active in filesystem cephfs as rank 0 2024-02-15T18:33:00.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:58.771307+0000 mgr.smithi084.hjmnez (mgr.14596) 322 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-02-15T18:33:00.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.078023+0000 mon.smithi084 (mon.0) 618 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.078978+0000 mon.smithi084 (mon.0) 619 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.079849+0000 mon.smithi084 (mon.0) 620 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:59.080519+0000 mgr.smithi084.hjmnez (mgr.14596) 323 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.084392+0000 mon.smithi084 (mon.0) 621 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.090710+0000 mon.smithi084 (mon.0) 622 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.093327+0000 mon.smithi084 (mon.0) 623 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.094682+0000 mon.smithi084 (mon.0) 624 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.095965+0000 mon.smithi084 (mon.0) 625 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.097658+0000 mon.smithi084 (mon.0) 626 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.099536+0000 mon.smithi084 (mon.0) 627 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:59.100121+0000 mgr.smithi084.hjmnez (mgr.14596) 324 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-15T18:33:00.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.106339+0000 mon.smithi084 (mon.0) 628 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.107474+0000 mon.smithi084 (mon.0) 629 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.110919+0000 mon.smithi084 (mon.0) 630 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.cuytny"}]': finished 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.111589+0000 mon.smithi084 (mon.0) 631 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.117404+0000 mon.smithi084 (mon.0) 632 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.spootv"}]': finished 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.118148+0000 mon.smithi084 (mon.0) 633 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.121268+0000 mon.smithi084 (mon.0) 634 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi133.mkpnnx"}]': finished 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.121951+0000 mon.smithi084 (mon.0) 635 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.127272+0000 mon.smithi084 (mon.0) 636 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi133.ubglfw"}]': finished 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:59.128012+0000 mgr.smithi084.hjmnez (mgr.14596) 325 : cephadm [INF] Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.128215+0000 mon.smithi084 (mon.0) 637 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:59.520029+0000 mon.smithi084 (mon.0) 638 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:59.520061+0000 mon.smithi084 (mon.0) 639 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T18:33:00.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:59.529350+0000 mon.smithi084 (mon.0) 640 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] up:active 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.529425+0000 mon.smithi084 (mon.0) 641 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:59.529520+0000 mon.smithi084 (mon.0) 642 : cluster [INF] daemon mds.cephfs.smithi084.spootv assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:59.529616+0000 mon.smithi084 (mon.0) 643 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:59.529645+0000 mon.smithi084 (mon.0) 644 : cluster [INF] Cluster is now healthy 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:59.529921+0000 mon.smithi084 (mon.0) 645 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi084.cuytny=up:active} 3 up:standby 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:59.534707+0000 mon.smithi084 (mon.0) 646 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi084.cuytny=up:active,1=cephfs.smithi084.spootv=up:starting} 2 up:standby 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.540164+0000 mon.smithi084 (mon.0) 647 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:32:59.540340+0000 mon.smithi084 (mon.0) 648 : cluster [INF] daemon mds.cephfs.smithi084.spootv is now active in filesystem cephfs as rank 1 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.541239+0000 mon.smithi084 (mon.0) 649 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:59.541974+0000 mgr.smithi084.hjmnez (mgr.14596) 326 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-15T18:33:00.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.546077+0000 mon.smithi084 (mon.0) 650 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.547377+0000 mon.smithi084 (mon.0) 651 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:59.548064+0000 mgr.smithi084.hjmnez (mgr.14596) 327 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.554135+0000 mon.smithi084 (mon.0) 652 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.555273+0000 mon.smithi084 (mon.0) 653 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.556526+0000 mon.smithi084 (mon.0) 654 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:59.557178+0000 mgr.smithi084.hjmnez (mgr.14596) 328 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.561018+0000 mon.smithi084 (mon.0) 655 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.562151+0000 mon.smithi084 (mon.0) 656 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:32:59.562782+0000 mgr.smithi084.hjmnez (mgr.14596) 329 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-15T18:33:00.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:32:59.566672+0000 mon.smithi084 (mon.0) 657 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:58.771307+0000 mgr.smithi084.hjmnez (mgr.14596) 322 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 MiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-02-15T18:33:00.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.078023+0000 mon.smithi084 (mon.0) 618 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.078978+0000 mon.smithi084 (mon.0) 619 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.079849+0000 mon.smithi084 (mon.0) 620 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:59.080519+0000 mgr.smithi084.hjmnez (mgr.14596) 323 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.084392+0000 mon.smithi084 (mon.0) 621 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.090710+0000 mon.smithi084 (mon.0) 622 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.093327+0000 mon.smithi084 (mon.0) 623 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.094682+0000 mon.smithi084 (mon.0) 624 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.095965+0000 mon.smithi084 (mon.0) 625 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.097658+0000 mon.smithi084 (mon.0) 626 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.099536+0000 mon.smithi084 (mon.0) 627 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:59.100121+0000 mgr.smithi084.hjmnez (mgr.14596) 324 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.106339+0000 mon.smithi084 (mon.0) 628 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.107474+0000 mon.smithi084 (mon.0) 629 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.cuytny"}]: dispatch 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.110919+0000 mon.smithi084 (mon.0) 630 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.cuytny"}]': finished 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.111589+0000 mon.smithi084 (mon.0) 631 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.spootv"}]: dispatch 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.117404+0000 mon.smithi084 (mon.0) 632 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi084.spootv"}]': finished 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.118148+0000 mon.smithi084 (mon.0) 633 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi133.mkpnnx"}]: dispatch 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.121268+0000 mon.smithi084 (mon.0) 634 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi133.mkpnnx"}]': finished 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.121951+0000 mon.smithi084 (mon.0) 635 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi133.ubglfw"}]: dispatch 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.127272+0000 mon.smithi084 (mon.0) 636 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi133.ubglfw"}]': finished 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:59.128012+0000 mgr.smithi084.hjmnez (mgr.14596) 325 : cephadm [INF] Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.128215+0000 mon.smithi084 (mon.0) 637 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T18:33:00.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:59.520029+0000 mon.smithi084 (mon.0) 638 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:59.520061+0000 mon.smithi084 (mon.0) 639 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:59.529350+0000 mon.smithi084 (mon.0) 640 : cluster [DBG] mds.? [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] up:active 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.529425+0000 mon.smithi084 (mon.0) 641 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:59.529520+0000 mon.smithi084 (mon.0) 642 : cluster [INF] daemon mds.cephfs.smithi084.spootv assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:59.529616+0000 mon.smithi084 (mon.0) 643 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:59.529645+0000 mon.smithi084 (mon.0) 644 : cluster [INF] Cluster is now healthy 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:59.529921+0000 mon.smithi084 (mon.0) 645 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi084.cuytny=up:active} 3 up:standby 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:59.534707+0000 mon.smithi084 (mon.0) 646 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi084.cuytny=up:active,1=cephfs.smithi084.spootv=up:starting} 2 up:standby 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.540164+0000 mon.smithi084 (mon.0) 647 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:32:59.540340+0000 mon.smithi084 (mon.0) 648 : cluster [INF] daemon mds.cephfs.smithi084.spootv is now active in filesystem cephfs as rank 1 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.541239+0000 mon.smithi084 (mon.0) 649 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.509 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:59.541974+0000 mgr.smithi084.hjmnez (mgr.14596) 326 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.546077+0000 mon.smithi084 (mon.0) 650 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.547377+0000 mon.smithi084 (mon.0) 651 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:59.548064+0000 mgr.smithi084.hjmnez (mgr.14596) 327 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.554135+0000 mon.smithi084 (mon.0) 652 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.555273+0000 mon.smithi084 (mon.0) 653 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.556526+0000 mon.smithi084 (mon.0) 654 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:59.557178+0000 mgr.smithi084.hjmnez (mgr.14596) 328 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.561018+0000 mon.smithi084 (mon.0) 655 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.562151+0000 mon.smithi084 (mon.0) 656 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:32:59.562782+0000 mgr.smithi084.hjmnez (mgr.14596) 329 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-15T18:33:00.510 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:32:59.566672+0000 mon.smithi084 (mon.0) 657 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:00.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.764+0000 7fd6e755d700 1 -- 172.21.15.84:0/2478335926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f66d0 msgr2=0x7fd6e00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:00.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.764+0000 7fd6e755d700 1 --2- 172.21.15.84:0/2478335926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f66d0 0x7fd6e00f6b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fd6d0004660 tx=0x7fd6d0009b30).stop 2024-02-15T18:33:00.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.764+0000 7fd6e755d700 1 -- 172.21.15.84:0/2478335926 shutdown_connections 2024-02-15T18:33:00.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.764+0000 7fd6e755d700 1 --2- 172.21.15.84:0/2478335926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f66d0 0x7fd6e00f6b30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:00.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.764+0000 7fd6e755d700 1 --2- 172.21.15.84:0/2478335926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00f5430 0x7fd6e00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:00.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.764+0000 7fd6e755d700 1 -- 172.21.15.84:0/2478335926 >> 172.21.15.84:0/2478335926 conn(0x7fd6e00f0b90 msgr2=0x7fd6e00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:00.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.764+0000 7fd6e755d700 1 -- 172.21.15.84:0/2478335926 shutdown_connections 2024-02-15T18:33:00.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.764+0000 7fd6e755d700 1 -- 172.21.15.84:0/2478335926 wait complete. 2024-02-15T18:33:00.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.765+0000 7fd6e755d700 1 Processor -- start 2024-02-15T18:33:00.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.765+0000 7fd6e755d700 1 -- start start 2024-02-15T18:33:00.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.765+0000 7fd6e755d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f5430 0x7fd6e0105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:00.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.765+0000 7fd6e755d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00f66d0 0x7fd6e0106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:00.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.765+0000 7fd6e755d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e01067f0 con 0x7fd6e00f5430 2024-02-15T18:33:00.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.765+0000 7fd6e755d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0106ff0 con 0x7fd6e00f66d0 2024-02-15T18:33:00.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.765+0000 7fd6e655b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f5430 0x7fd6e0105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.765+0000 7fd6e655b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f5430 0x7fd6e0105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42374/0 (socket says 172.21.15.84:42374) 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.765+0000 7fd6e655b700 1 -- 172.21.15.84:0/3173437154 learned_addr learned my addr 172.21.15.84:0/3173437154 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6e5d5a700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00f66d0 0x7fd6e0106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6e655b700 1 -- 172.21.15.84:0/3173437154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00f66d0 msgr2=0x7fd6e0106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6e655b700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00f66d0 0x7fd6e0106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6e655b700 1 -- 172.21.15.84:0/3173437154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0005040 con 0x7fd6e00f5430 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6e5d5a700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00f66d0 0x7fd6e0106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6e655b700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f5430 0x7fd6e0105d50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fd6dc002700 tx=0x7fd6dc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6d6ffd700 1 -- 172.21.15.84:0/3173437154 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc009320 con 0x7fd6e00f5430 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6d6ffd700 1 -- 172.21.15.84:0/3173437154 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd6dc00f040 con 0x7fd6e00f5430 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e01072d0 con 0x7fd6e00f5430 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6d6ffd700 1 -- 172.21.15.84:0/3173437154 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc0149d0 con 0x7fd6e00f5430 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.766+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e0107890 con 0x7fd6e00f5430 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.767+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e0059100 con 0x7fd6e00f5430 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.767+0000 7fd6d6ffd700 1 -- 172.21.15.84:0/3173437154 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd6dc0077b0 con 0x7fd6e00f5430 2024-02-15T18:33:00.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.768+0000 7fd6d6ffd700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd6cc060f70 0x7fd6cc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:00.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.768+0000 7fd6d6ffd700 1 -- 172.21.15.84:0/3173437154 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fd6dc07c350 con 0x7fd6e00f5430 2024-02-15T18:33:00.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.768+0000 7fd6e5d5a700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd6cc060f70 0x7fd6cc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:00.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.768+0000 7fd6e5d5a700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd6cc060f70 0x7fd6cc063430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd6d0005010 tx=0x7fd6d0009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:00.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.772+0000 7fd6d6ffd700 1 -- 172.21.15.84:0/3173437154 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd6dc0501e0 con 0x7fd6e00f5430 2024-02-15T18:33:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.956+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6e00ff870 con 0x7fd6cc060f70 2024-02-15T18:33:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.957+0000 7fd6d6ffd700 1 -- 172.21.15.84:0/3173437154 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fd6e00ff870 con 0x7fd6cc060f70 2024-02-15T18:33:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd6cc060f70 msgr2=0x7fd6cc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd6cc060f70 0x7fd6cc063430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd6d0005010 tx=0x7fd6d0009b30).stop 2024-02-15T18:33:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f5430 msgr2=0x7fd6e0105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f5430 0x7fd6e0105d50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fd6dc002700 tx=0x7fd6dc009d80).stop 2024-02-15T18:33:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 shutdown_connections 2024-02-15T18:33:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd6cc060f70 0x7fd6cc063430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6e00f5430 0x7fd6e0105d50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 --2- 172.21.15.84:0/3173437154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00f66d0 0x7fd6e0106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:00.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 >> 172.21.15.84:0/3173437154 conn(0x7fd6e00f0b90 msgr2=0x7fd6e00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:00.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 shutdown_connections 2024-02-15T18:33:00.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:00.959+0000 7fd6e755d700 1 -- 172.21.15.84:0/3173437154 wait complete. 2024-02-15T18:33:00.961 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:33:01.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 -- 172.21.15.84:0/1918090351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92440f9820 msgr2=0x7f92440fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 --2- 172.21.15.84:0/1918090351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92440f9820 0x7f92440fbc70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9234004660 tx=0x7f9234009b30).stop 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 -- 172.21.15.84:0/1918090351 shutdown_connections 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 --2- 172.21.15.84:0/1918090351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92440f9820 0x7f92440fbc70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 --2- 172.21.15.84:0/1918090351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9244060310 0x7f92440f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 -- 172.21.15.84:0/1918090351 >> 172.21.15.84:0/1918090351 conn(0x7f92440f0d40 msgr2=0x7f92440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 -- 172.21.15.84:0/1918090351 shutdown_connections 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 -- 172.21.15.84:0/1918090351 wait complete. 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 Processor -- start 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.058+0000 7f9248e44700 1 -- start start 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9248e44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9244060310 0x7f9244106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9248e44700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92440f9820 0x7f92441074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9248e44700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9244107a70 con 0x7f9244060310 2024-02-15T18:33:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9248e44700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9244107bb0 con 0x7f92440f9820 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f924259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9244060310 0x7f9244106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f924259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9244060310 0x7f9244106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42390/0 (socket says 172.21.15.84:42390) 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f924259c700 1 -- 172.21.15.84:0/858399485 learned_addr learned my addr 172.21.15.84:0/858399485 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9241d9b700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92440f9820 0x7f92441074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f924259c700 1 -- 172.21.15.84:0/858399485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92440f9820 msgr2=0x7f92441074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f924259c700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92440f9820 0x7f92441074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f924259c700 1 -- 172.21.15.84:0/858399485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234005040 con 0x7f9244060310 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f924259c700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9244060310 0x7f9244106fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f923800e7f0 tx=0x7f923800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9232ffd700 1 -- 172.21.15.84:0/858399485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92380092e0 con 0x7f9244060310 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9232ffd700 1 -- 172.21.15.84:0/858399485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f923800f040 con 0x7f9244060310 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9244108550 con 0x7f9244060310 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9232ffd700 1 -- 172.21.15.84:0/858399485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9238014880 con 0x7f9244060310 2024-02-15T18:33:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.059+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9244108b10 con 0x7f9244060310 2024-02-15T18:33:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.060+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9244045ad0 con 0x7f9244060310 2024-02-15T18:33:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.060+0000 7f9232ffd700 1 -- 172.21.15.84:0/858399485 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f923801b030 con 0x7f9244060310 2024-02-15T18:33:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.061+0000 7f9232ffd700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f922c060f20 0x7f922c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.061+0000 7f9232ffd700 1 -- 172.21.15.84:0/858399485 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f923807bfe0 con 0x7f9244060310 2024-02-15T18:33:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.061+0000 7f9241d9b700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f922c060f20 0x7f922c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.061+0000 7f9241d9b700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f922c060f20 0x7f922c0633e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f9234009720 tx=0x7f923400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.065+0000 7f9232ffd700 1 -- 172.21.15.84:0/858399485 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f923804fea0 con 0x7f9244060310 2024-02-15T18:33:01.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.243+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92440ff140 con 0x7f922c060f20 2024-02-15T18:33:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.245+0000 7f9232ffd700 1 -- 172.21.15.84:0/858399485 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f923401a040 con 0x7f922c060f20 2024-02-15T18:33:01.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.246+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f922c060f20 msgr2=0x7f922c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.246+0000 7f9248e44700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f922c060f20 0x7f922c0633e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f9234009720 tx=0x7f923400b040).stop 2024-02-15T18:33:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.246+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9244060310 msgr2=0x7f9244106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.246+0000 7f9248e44700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9244060310 0x7f9244106fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f923800e7f0 tx=0x7f923800b040).stop 2024-02-15T18:33:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.246+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 shutdown_connections 2024-02-15T18:33:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.246+0000 7f9248e44700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f922c060f20 0x7f922c0633e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.246+0000 7f9248e44700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9244060310 0x7f9244106fd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.246+0000 7f9248e44700 1 --2- 172.21.15.84:0/858399485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92440f9820 0x7f92441074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.246+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 >> 172.21.15.84:0/858399485 conn(0x7f92440f0d40 msgr2=0x7f92440f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.247+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 shutdown_connections 2024-02-15T18:33:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.247+0000 7f9248e44700 1 -- 172.21.15.84:0/858399485 wait complete. 2024-02-15T18:33:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.344+0000 7f49d3f51700 1 -- 172.21.15.84:0/2357101384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f49a0 msgr2=0x7f49cc0f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.344+0000 7f49d3f51700 1 --2- 172.21.15.84:0/2357101384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f49a0 0x7f49cc0f4dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f49c8004660 tx=0x7f49c8009b30).stop 2024-02-15T18:33:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.344+0000 7f49d3f51700 1 -- 172.21.15.84:0/2357101384 shutdown_connections 2024-02-15T18:33:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.344+0000 7f49d3f51700 1 --2- 172.21.15.84:0/2357101384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f5340 0x7f49cc0f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.344+0000 7f49d3f51700 1 --2- 172.21.15.84:0/2357101384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f49a0 0x7f49cc0f4dc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.344+0000 7f49d3f51700 1 -- 172.21.15.84:0/2357101384 >> 172.21.15.84:0/2357101384 conn(0x7f49cc0f04c0 msgr2=0x7f49cc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.344+0000 7f49d3f51700 1 -- 172.21.15.84:0/2357101384 shutdown_connections 2024-02-15T18:33:01.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.344+0000 7f49d3f51700 1 -- 172.21.15.84:0/2357101384 wait complete. 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.344+0000 7f49d3f51700 1 Processor -- start 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d3f51700 1 -- start start 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d3f51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f49a0 0x7f49cc1070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d3f51700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f5340 0x7f49cc1075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d3f51700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc107b90 con 0x7f49cc0f5340 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d3f51700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc107cd0 con 0x7f49cc0f49a0 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d14ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f5340 0x7f49cc1075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d14ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f5340 0x7f49cc1075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42414/0 (socket says 172.21.15.84:42414) 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d14ec700 1 -- 172.21.15.84:0/1422862728 learned_addr learned my addr 172.21.15.84:0/1422862728 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d14ec700 1 -- 172.21.15.84:0/1422862728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f49a0 msgr2=0x7f49cc1070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d1ced700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f49a0 0x7f49cc1070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d14ec700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f49a0 0x7f49cc1070f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d14ec700 1 -- 172.21.15.84:0/1422862728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c8005040 con 0x7f49cc0f5340 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d1ced700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f49a0 0x7f49cc1070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:33:01.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d14ec700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f5340 0x7f49cc1075e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f49bc00c510 tx=0x7f49bc007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49c27fc700 1 -- 172.21.15.84:0/1422862728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49bc00f650 con 0x7f49cc0f5340 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49c27fc700 1 -- 172.21.15.84:0/1422862728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f49bc00fca0 con 0x7f49cc0f5340 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc108670 con 0x7f49cc0f5340 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.345+0000 7f49c27fc700 1 -- 172.21.15.84:0/1422862728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49bc012df0 con 0x7f49cc0f5340 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.346+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc108c30 con 0x7f49cc0f5340 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.346+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc045ad0 con 0x7f49cc0f5340 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.347+0000 7f49c27fc700 1 -- 172.21.15.84:0/1422862728 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f49bc010070 con 0x7f49cc0f5340 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.347+0000 7f49c27fc700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49b8060ec0 0x7f49b8063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.348+0000 7f49c27fc700 1 -- 172.21.15.84:0/1422862728 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f49bc07c760 con 0x7f49cc0f5340 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.348+0000 7f49d1ced700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49b8060ec0 0x7f49b8063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:01.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.348+0000 7f49d1ced700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49b8060ec0 0x7f49b8063380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f49c8004630 tx=0x7f49c8009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:01.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.351+0000 7f49c27fc700 1 -- 172.21.15.84:0/1422862728 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f49bc050550 con 0x7f49cc0f5340 2024-02-15T18:33:01.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.538+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f49cc108ea0 con 0x7f49b8060ec0 2024-02-15T18:33:01.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.548+0000 7f49c27fc700 1 -- 172.21.15.84:0/1422862728 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f49cc108ea0 con 0x7f49b8060ec0 2024-02-15T18:33:01.540 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:33:01.543 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (12m) 30s ago 14m 17.7M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:33:01.543 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (4m) 30s ago 14m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:33:01.543 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (4m) 2s ago 13m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:33:01.543 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (12m) 30s ago 13m 36.0M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (48s) 30s ago 8m 11.6M - 16.2.14-521-g0e714d9a 1fbc92c859dc 0914a2eeed6f 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (35s) 30s ago 8m 11.1M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4b79925c0d8d 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (20s) 2s ago 8m 14.6M - 16.2.14-521-g0e714d9a 1fbc92c859dc 2ad04fa2e1ba 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (5s) 2s ago 8m 10.1M - 16.2.14-521-g0e714d9a 1fbc92c859dc 6fdbbf145708 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (6m) 30s ago 15m 437M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (5m) 2s ago 13m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (5m) 30s ago 15m 55.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (5m) 2s ago 12m 50.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (13m) 30s ago 13m 17.2M - 0.18.1 e5a616e4b9cf 1dd8baa18882 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (12m) 2s ago 12m 17.0M - 0.18.1 e5a616e4b9cf bb8b5cdf3aa0 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 30s ago 12m 203M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (3m) 30s ago 11m 247M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 30s ago 11m 184M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:33:01.544 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (2m) 2s ago 11m 280M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc b8c15d05905a 2024-02-15T18:33:01.545 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (2m) 2s ago 10m 249M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 612e5da9dba4 2024-02-15T18:33:01.545 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (102s) 2s ago 10m 196M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 93c01314b455 2024-02-15T18:33:01.545 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (6m) 30s ago 13m 68.0M - 2.18.1 de242295e225 8987dc573308 2024-02-15T18:33:01.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49b8060ec0 msgr2=0x7f49b8063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49b8060ec0 0x7f49b8063380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f49c8004630 tx=0x7f49c8009b30).stop 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f5340 msgr2=0x7f49cc1075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f5340 0x7f49cc1075e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f49bc00c510 tx=0x7f49bc007df0).stop 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 shutdown_connections 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f49b8060ec0 0x7f49b8063380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49cc0f49a0 0x7f49cc1070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 --2- 172.21.15.84:0/1422862728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49cc0f5340 0x7f49cc1075e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 >> 172.21.15.84:0/1422862728 conn(0x7f49cc0f04c0 msgr2=0x7f49cc0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 shutdown_connections 2024-02-15T18:33:01.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.550+0000 7f49d3f51700 1 -- 172.21.15.84:0/1422862728 wait complete. 2024-02-15T18:33:01.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 -- 172.21.15.84:0/2325910591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 msgr2=0x7facf80f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 --2- 172.21.15.84:0/2325910591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 0x7facf80f6960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7face8004660 tx=0x7face8009b30).stop 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 -- 172.21.15.84:0/2325910591 shutdown_connections 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 --2- 172.21.15.84:0/2325910591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf80f77e0 0x7facf80f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 --2- 172.21.15.84:0/2325910591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 0x7facf80f6960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 -- 172.21.15.84:0/2325910591 >> 172.21.15.84:0/2325910591 conn(0x7facf80f1ca0 msgr2=0x7facf80f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 -- 172.21.15.84:0/2325910591 shutdown_connections 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 -- 172.21.15.84:0/2325910591 wait complete. 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 Processor -- start 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 -- start start 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 0x7facf8106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.660+0000 7facfd2a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf80f77e0 0x7facf8107330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:01.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facfd2a5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8107930 con 0x7facf80f6540 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facfd2a5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf8108140 con 0x7facf80f77e0 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 0x7facf8106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 0x7facf8106e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42418/0 (socket says 172.21.15.84:42418) 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facf6ffd700 1 -- 172.21.15.84:0/92915738 learned_addr learned my addr 172.21.15.84:0/92915738 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facf67fc700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf80f77e0 0x7facf8107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facf6ffd700 1 -- 172.21.15.84:0/92915738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf80f77e0 msgr2=0x7facf8107330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facf6ffd700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf80f77e0 0x7facf8107330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facf6ffd700 1 -- 172.21.15.84:0/92915738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8005040 con 0x7facf80f6540 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facf67fc700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf80f77e0 0x7facf8107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facf6ffd700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 0x7facf8106e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7face8002040 tx=0x7face800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facdf7fe700 1 -- 172.21.15.84:0/92915738 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face8019070 con 0x7facf80f6540 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facdf7fe700 1 -- 172.21.15.84:0/92915738 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7face8014420 con 0x7facf80f6540 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facdf7fe700 1 -- 172.21.15.84:0/92915738 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face801d5c0 con 0x7facf80f6540 2024-02-15T18:33:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf8108360 con 0x7facf80f6540 2024-02-15T18:33:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.661+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf8108870 con 0x7facf80f6540 2024-02-15T18:33:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.662+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf8059100 con 0x7facf80f6540 2024-02-15T18:33:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.663+0000 7facdf7fe700 1 -- 172.21.15.84:0/92915738 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7face8025070 con 0x7facf80f6540 2024-02-15T18:33:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.664+0000 7facdf7fe700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7face0060f70 0x7face0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.664+0000 7facdf7fe700 1 -- 172.21.15.84:0/92915738 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7face807d510 con 0x7facf80f6540 2024-02-15T18:33:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.664+0000 7facf67fc700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7face0060f70 0x7face0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:01.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.664+0000 7facf67fc700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7face0060f70 0x7face0063430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7facec009da0 tx=0x7facec00b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:01.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.667+0000 7facdf7fe700 1 -- 172.21.15.84:0/92915738 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7face804d970 con 0x7facf80f6540 2024-02-15T18:33:01.721 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:00.541421+0000 mon.smithi084 (mon.0) 658 : cluster [DBG] mds.? [v2:172.21.15.84:6828/2925871822,v1:172.21.15.84:6829/2925871822] up:active 2024-02-15T18:33:01.721 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:01 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:00.541461+0000 mon.smithi084 (mon.0) 659 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi084.cuytny=up:active,1=cephfs.smithi084.spootv=up:active} 2 up:standby 2024-02-15T18:33:01.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:00.541421+0000 mon.smithi084 (mon.0) 658 : cluster [DBG] mds.? [v2:172.21.15.84:6828/2925871822,v1:172.21.15.84:6829/2925871822] up:active 2024-02-15T18:33:01.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:00.541461+0000 mon.smithi084 (mon.0) 659 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi084.cuytny=up:active,1=cephfs.smithi084.spootv=up:active} 2 up:standby 2024-02-15T18:33:01.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.915+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7facf8027a00 con 0x7facf80f6540 2024-02-15T18:33:01.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.916+0000 7facdf7fe700 1 -- 172.21.15.84:0/92915738 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7face8023070 con 0x7facf80f6540 2024-02-15T18:33:01.908 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:33:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:33:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:33:01.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:33:01.909 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.917+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7face0060f70 msgr2=0x7face0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.917+0000 7facfd2a5700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7face0060f70 0x7face0063430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7facec009da0 tx=0x7facec00b040).stop 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.918+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 msgr2=0x7facf8106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.918+0000 7facfd2a5700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 0x7facf8106e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7face8002040 tx=0x7face800b040).stop 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.918+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 shutdown_connections 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.918+0000 7facfd2a5700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7face0060f70 0x7face0063430 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.918+0000 7facfd2a5700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facf80f6540 0x7facf8106e40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.918+0000 7facfd2a5700 1 --2- 172.21.15.84:0/92915738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf80f77e0 0x7facf8107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.918+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 >> 172.21.15.84:0/92915738 conn(0x7facf80f1ca0 msgr2=0x7facf80fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.918+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 shutdown_connections 2024-02-15T18:33:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:01.918+0000 7facfd2a5700 1 -- 172.21.15.84:0/92915738 wait complete. 2024-02-15T18:33:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.017+0000 7f961ae88700 1 -- 172.21.15.84:0/2938691629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 msgr2=0x7f96140f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.017+0000 7f961ae88700 1 --2- 172.21.15.84:0/2938691629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 0x7f96140f6b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9608004660 tx=0x7f9608009b30).stop 2024-02-15T18:33:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.017+0000 7f961ae88700 1 -- 172.21.15.84:0/2938691629 shutdown_connections 2024-02-15T18:33:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.017+0000 7f961ae88700 1 --2- 172.21.15.84:0/2938691629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96140f7980 0x7f96140f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.017+0000 7f961ae88700 1 --2- 172.21.15.84:0/2938691629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 0x7f96140f6b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.017+0000 7f961ae88700 1 -- 172.21.15.84:0/2938691629 >> 172.21.15.84:0/2938691629 conn(0x7f96140f1e40 msgr2=0x7f96140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:02.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.017+0000 7f961ae88700 1 -- 172.21.15.84:0/2938691629 shutdown_connections 2024-02-15T18:33:02.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.017+0000 7f961ae88700 1 -- 172.21.15.84:0/2938691629 wait complete. 2024-02-15T18:33:02.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f961ae88700 1 Processor -- start 2024-02-15T18:33:02.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f961ae88700 1 -- start start 2024-02-15T18:33:02.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f961ae88700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 0x7f9614107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:02.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f961ae88700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96140f7980 0x7f9614107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:02.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f961ae88700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614107ad0 con 0x7f96140f66e0 2024-02-15T18:33:02.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f961ae88700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614107c10 con 0x7f96140f7980 2024-02-15T18:33:02.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f9618c24700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 0x7f9614107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:02.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f9618c24700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 0x7f9614107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42436/0 (socket says 172.21.15.84:42436) 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f9618c24700 1 -- 172.21.15.84:0/1130562991 learned_addr learned my addr 172.21.15.84:0/1130562991 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f9613fff700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96140f7980 0x7f9614107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f9618c24700 1 -- 172.21.15.84:0/1130562991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96140f7980 msgr2=0x7f9614107520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f9618c24700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96140f7980 0x7f9614107520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f9618c24700 1 -- 172.21.15.84:0/1130562991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608005040 con 0x7f96140f66e0 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.018+0000 7f9618c24700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 0x7f9614107030 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f9608004620 tx=0x7f9608009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.019+0000 7f96117fa700 1 -- 172.21.15.84:0/1130562991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9608018070 con 0x7f96140f66e0 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.019+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9614108550 con 0x7f96140f66e0 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.019+0000 7f96117fa700 1 -- 172.21.15.84:0/1130562991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9608007df0 con 0x7f96140f66e0 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.019+0000 7f96117fa700 1 -- 172.21.15.84:0/1130562991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960801c7b0 con 0x7f96140f66e0 2024-02-15T18:33:02.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.019+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9614108ab0 con 0x7f96140f66e0 2024-02-15T18:33:02.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.020+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9614045ad0 con 0x7f96140f66e0 2024-02-15T18:33:02.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.020+0000 7f96117fa700 1 -- 172.21.15.84:0/1130562991 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f960801c910 con 0x7f96140f66e0 2024-02-15T18:33:02.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.020+0000 7f96117fa700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9604060f70 0x7f9604063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:02.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.020+0000 7f96117fa700 1 -- 172.21.15.84:0/1130562991 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f960807e200 con 0x7f96140f66e0 2024-02-15T18:33:02.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.020+0000 7f9613fff700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9604060f70 0x7f9604063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:02.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.021+0000 7f9613fff700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9604060f70 0x7f9604063430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f96000041d0 tx=0x7f9600009040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:02.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.025+0000 7f96117fa700 1 -- 172.21.15.84:0/1130562991 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9608051f10 con 0x7f96140f66e0 2024-02-15T18:33:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.237+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f96140ff050 con 0x7f96140f66e0 2024-02-15T18:33:02.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.238+0000 7f96117fa700 1 -- 172.21.15.84:0/1130562991 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1778 (secure 0 0 0) 0x7f9608051b00 con 0x7f96140f66e0 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:e38 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 38 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:33:00.537828+0000 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:33:02.230 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 82 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=34338,1=34342} 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:33:02.231 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{0:34338} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{1:34342} state up:active seq 10 join_fscid=1 addr [v2:172.21.15.84:6828/2925871822,v1:172.21.15.84:6829/2925871822] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.133:6824/553393719,v1:172.21.15.133:6825/553393719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:02.232 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.133:6826/2979200029,v1:172.21.15.133:6827/2979200029] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9604060f70 msgr2=0x7f9604063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9604060f70 0x7f9604063430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f96000041d0 tx=0x7f9600009040).stop 2024-02-15T18:33:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 msgr2=0x7f9614107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 0x7f9614107030 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f9608004620 tx=0x7f9608009b30).stop 2024-02-15T18:33:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 shutdown_connections 2024-02-15T18:33:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f9604060f70 0x7f9604063430 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96140f66e0 0x7f9614107030 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 --2- 172.21.15.84:0/1130562991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96140f7980 0x7f9614107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 >> 172.21.15.84:0/1130562991 conn(0x7f96140f1e40 msgr2=0x7f96140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:02.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 shutdown_connections 2024-02-15T18:33:02.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.239+0000 7f961ae88700 1 -- 172.21.15.84:0/1130562991 wait complete. 2024-02-15T18:33:02.234 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2024-02-15T18:33:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.347+0000 7ffa16ba2700 1 -- 172.21.15.84:0/2458677103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 msgr2=0x7ffa100f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.347+0000 7ffa16ba2700 1 --2- 172.21.15.84:0/2458677103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 0x7ffa100f91b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ffa00004660 tx=0x7ffa00009b30).stop 2024-02-15T18:33:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.347+0000 7ffa16ba2700 1 -- 172.21.15.84:0/2458677103 shutdown_connections 2024-02-15T18:33:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.347+0000 7ffa16ba2700 1 --2- 172.21.15.84:0/2458677103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa100f96a0 0x7ffa100fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.347+0000 7ffa16ba2700 1 --2- 172.21.15.84:0/2458677103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 0x7ffa100f91b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.347+0000 7ffa16ba2700 1 -- 172.21.15.84:0/2458677103 >> 172.21.15.84:0/2458677103 conn(0x7ffa100f0b90 msgr2=0x7ffa100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.347+0000 7ffa16ba2700 1 -- 172.21.15.84:0/2458677103 shutdown_connections 2024-02-15T18:33:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.347+0000 7ffa16ba2700 1 -- 172.21.15.84:0/2458677103 wait complete. 2024-02-15T18:33:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa16ba2700 1 Processor -- start 2024-02-15T18:33:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa16ba2700 1 -- start start 2024-02-15T18:33:02.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa16ba2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 0x7ffa100f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:02.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa16ba2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa100f96a0 0x7ffa100f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:02.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa16ba2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100f5610 con 0x7ffa10060270 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa16ba2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100f5750 con 0x7ffa100f96a0 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa15ba0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 0x7ffa100f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa15ba0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 0x7ffa100f6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42452/0 (socket says 172.21.15.84:42452) 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa15ba0700 1 -- 172.21.15.84:0/160320937 learned_addr learned my addr 172.21.15.84:0/160320937 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa15ba0700 1 -- 172.21.15.84:0/160320937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa100f96a0 msgr2=0x7ffa100f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa15ba0700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa100f96a0 0x7ffa100f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa15ba0700 1 -- 172.21.15.84:0/160320937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00005040 con 0x7ffa10060270 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa15ba0700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 0x7ffa100f6c30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7ffa00009f50 tx=0x7ffa00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa067fc700 1 -- 172.21.15.84:0/160320937 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa00018070 con 0x7ffa10060270 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa067fc700 1 -- 172.21.15.84:0/160320937 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7ffa00007ba0 con 0x7ffa10060270 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa067fc700 1 -- 172.21.15.84:0/160320937 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa0001c620 con 0x7ffa10060270 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.348+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa100f59d0 con 0x7ffa10060270 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.349+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa100f5ee0 con 0x7ffa10060270 2024-02-15T18:33:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.349+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa10045ad0 con 0x7ffa10060270 2024-02-15T18:33:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.350+0000 7ffa067fc700 1 -- 172.21.15.84:0/160320937 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ffa0001d9a0 con 0x7ffa10060270 2024-02-15T18:33:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.350+0000 7ffa067fc700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff9fc060f70 0x7ff9fc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.350+0000 7ffa067fc700 1 -- 172.21.15.84:0/160320937 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7ffa0007e010 con 0x7ffa10060270 2024-02-15T18:33:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.350+0000 7ffa1539f700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff9fc060f70 0x7ff9fc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.351+0000 7ffa1539f700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff9fc060f70 0x7ff9fc063430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ffa10060040 tx=0x7ffa0c009b10).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:02.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.354+0000 7ffa067fc700 1 -- 172.21.15.84:0/160320937 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ffa0004e470 con 0x7ffa10060270 2024-02-15T18:33:02.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.543+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa100fefb0 con 0x7ff9fc060f70 2024-02-15T18:33:02.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.544+0000 7ffa067fc700 1 -- 172.21.15.84:0/160320937 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7ffa100fefb0 con 0x7ff9fc060f70 2024-02-15T18:33:02.536 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:33:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:33:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:33:02.536 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mds", 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "osd" 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "16/21 daemons upgraded", 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:33:02.537 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:33:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff9fc060f70 msgr2=0x7ff9fc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff9fc060f70 0x7ff9fc063430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ffa10060040 tx=0x7ffa0c009b10).stop 2024-02-15T18:33:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 msgr2=0x7ffa100f6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:02.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 0x7ffa100f6c30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7ffa00009f50 tx=0x7ffa00009b30).stop 2024-02-15T18:33:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 shutdown_connections 2024-02-15T18:33:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff9fc060f70 0x7ff9fc063430 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa10060270 0x7ffa100f6c30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 --2- 172.21.15.84:0/160320937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa100f96a0 0x7ffa100f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:33:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 >> 172.21.15.84:0/160320937 conn(0x7ffa100f0b90 msgr2=0x7ffa100f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 shutdown_connections 2024-02-15T18:33:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:02.547+0000 7ffa16ba2700 1 -- 172.21.15.84:0/160320937 wait complete. 2024-02-15T18:33:02.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:00.771731+0000 mgr.smithi084.hjmnez (mgr.14596) 330 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-02-15T18:33:02.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:00.957658+0000 mgr.smithi084.hjmnez (mgr.14596) 331 : audit [DBG] from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:02.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:01.245321+0000 mgr.smithi084.hjmnez (mgr.14596) 332 : audit [DBG] from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:02.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:01.377063+0000 mgr.smithi084.hjmnez (mgr.14596) 333 : cephadm [INF] Upgrade: Updating node-exporter.smithi084 (1/2) 2024-02-15T18:33:02.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:01.377200+0000 mgr.smithi084.hjmnez (mgr.14596) 334 : cephadm [INF] Deploying daemon node-exporter.smithi084 on smithi084 2024-02-15T18:33:02.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:01.539639+0000 mgr.smithi084.hjmnez (mgr.14596) 335 : audit [DBG] from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:02.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:01.916722+0000 mon.smithi084 (mon.0) 660 : audit [DBG] from='client.? 172.21.15.84:0/92915738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:02.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:02.238572+0000 mon.smithi084 (mon.0) 661 : audit [DBG] from='client.? 172.21.15.84:0/1130562991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:33:02.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:00.771731+0000 mgr.smithi084.hjmnez (mgr.14596) 330 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-02-15T18:33:02.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:00.957658+0000 mgr.smithi084.hjmnez (mgr.14596) 331 : audit [DBG] from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:02.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:01.245321+0000 mgr.smithi084.hjmnez (mgr.14596) 332 : audit [DBG] from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:02.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:01.377063+0000 mgr.smithi084.hjmnez (mgr.14596) 333 : cephadm [INF] Upgrade: Updating node-exporter.smithi084 (1/2) 2024-02-15T18:33:02.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:01.377200+0000 mgr.smithi084.hjmnez (mgr.14596) 334 : cephadm [INF] Deploying daemon node-exporter.smithi084 on smithi084 2024-02-15T18:33:02.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:01.539639+0000 mgr.smithi084.hjmnez (mgr.14596) 335 : audit [DBG] from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:02.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:01.916722+0000 mon.smithi084 (mon.0) 660 : audit [DBG] from='client.? 172.21.15.84:0/92915738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:02.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:02.238572+0000 mon.smithi084 (mon.0) 661 : audit [DBG] from='client.? 172.21.15.84:0/1130562991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:33:03.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:03 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:02.544776+0000 mgr.smithi084.hjmnez (mgr.14596) 336 : audit [DBG] from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:03.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:03 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:02.544776+0000 mgr.smithi084.hjmnez (mgr.14596) 336 : audit [DBG] from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:04.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:02.772162+0000 mgr.smithi084.hjmnez (mgr.14596) 337 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-02-15T18:33:05.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:02.772162+0000 mgr.smithi084.hjmnez (mgr.14596) 337 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-02-15T18:33:06.883 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:04.772816+0000 mgr.smithi084.hjmnez (mgr.14596) 338 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.4 MiB/s rd, 341 B/s wr, 9 op/s 2024-02-15T18:33:06.883 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:06.095430+0000 mon.smithi084 (mon.0) 662 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:07.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:04.772816+0000 mgr.smithi084.hjmnez (mgr.14596) 338 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 7.4 MiB/s rd, 341 B/s wr, 9 op/s 2024-02-15T18:33:07.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:06.095430+0000 mon.smithi084 (mon.0) 662 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:08.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:06.773116+0000 mgr.smithi084.hjmnez (mgr.14596) 339 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 341 B/s wr, 8 op/s 2024-02-15T18:33:08.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:06.907616+0000 mon.smithi084 (mon.0) 663 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:08.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:07.585790+0000 mgr.smithi084.hjmnez (mgr.14596) 340 : cephadm [INF] Upgrade: Updating node-exporter.smithi133 (2/2) 2024-02-15T18:33:08.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:07.585978+0000 mgr.smithi084.hjmnez (mgr.14596) 341 : cephadm [INF] Deploying daemon node-exporter.smithi133 on smithi133 2024-02-15T18:33:08.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:06.773116+0000 mgr.smithi084.hjmnez (mgr.14596) 339 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 341 B/s wr, 8 op/s 2024-02-15T18:33:08.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:06.907616+0000 mon.smithi084 (mon.0) 663 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:08.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:07.585790+0000 mgr.smithi084.hjmnez (mgr.14596) 340 : cephadm [INF] Upgrade: Updating node-exporter.smithi133 (2/2) 2024-02-15T18:33:08.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:07.585978+0000 mgr.smithi084.hjmnez (mgr.14596) 341 : cephadm [INF] Deploying daemon node-exporter.smithi133 on smithi133 2024-02-15T18:33:10.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:08.773521+0000 mgr.smithi084.hjmnez (mgr.14596) 342 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-02-15T18:33:10.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:08.773521+0000 mgr.smithi084.hjmnez (mgr.14596) 342 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-02-15T18:33:12.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:10.774038+0000 mgr.smithi084.hjmnez (mgr.14596) 343 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 348 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-02-15T18:33:12.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:11.954205+0000 mon.smithi084 (mon.0) 664 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:12.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:11.955057+0000 mon.smithi084 (mon.0) 665 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:12.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:10.774038+0000 mgr.smithi084.hjmnez (mgr.14596) 343 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 348 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-02-15T18:33:12.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:11.954205+0000 mon.smithi084 (mon.0) 664 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:12.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:11.955057+0000 mon.smithi084 (mon.0) 665 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:14.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:12.774451+0000 mgr.smithi084.hjmnez (mgr.14596) 344 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.3 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-02-15T18:33:14.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:12.774451+0000 mgr.smithi084.hjmnez (mgr.14596) 344 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.3 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-02-15T18:33:15.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:14.105008+0000 mon.smithi084 (mon.0) 666 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:15.505 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:14.105008+0000 mon.smithi084 (mon.0) 666 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:16.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:14.774821+0000 mgr.smithi084.hjmnez (mgr.14596) 345 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-15T18:33:16.505 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:14.774821+0000 mgr.smithi084.hjmnez (mgr.14596) 345 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-15T18:33:17.850 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.675133+0000 mon.smithi084 (mon.0) 667 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.675852+0000 mon.smithi084 (mon.0) 668 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.676429+0000 mon.smithi084 (mon.0) 669 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:16.676952+0000 mgr.smithi084.hjmnez (mgr.14596) 346 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.680253+0000 mon.smithi084 (mon.0) 670 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.684608+0000 mon.smithi084 (mon.0) 671 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.686606+0000 mon.smithi084 (mon.0) 672 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.687670+0000 mon.smithi084 (mon.0) 673 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.688604+0000 mon.smithi084 (mon.0) 674 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.689818+0000 mon.smithi084 (mon.0) 675 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.691279+0000 mon.smithi084 (mon.0) 676 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.692147+0000 mon.smithi084 (mon.0) 677 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.692941+0000 mon.smithi084 (mon.0) 678 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.693715+0000 mon.smithi084 (mon.0) 679 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.851 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.694507+0000 mon.smithi084 (mon.0) 680 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.852 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.695309+0000 mon.smithi084 (mon.0) 681 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:17.852 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:17 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:16.696404+0000 mon.smithi084 (mon.0) 682 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.675133+0000 mon.smithi084 (mon.0) 667 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:18.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.675852+0000 mon.smithi084 (mon.0) 668 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:18.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.676429+0000 mon.smithi084 (mon.0) 669 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:18.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:16.676952+0000 mgr.smithi084.hjmnez (mgr.14596) 346 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.680253+0000 mon.smithi084 (mon.0) 670 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.684608+0000 mon.smithi084 (mon.0) 671 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.686606+0000 mon.smithi084 (mon.0) 672 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.687670+0000 mon.smithi084 (mon.0) 673 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.688604+0000 mon.smithi084 (mon.0) 674 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.689818+0000 mon.smithi084 (mon.0) 675 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.691279+0000 mon.smithi084 (mon.0) 676 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.692147+0000 mon.smithi084 (mon.0) 677 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.692941+0000 mon.smithi084 (mon.0) 678 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.693715+0000 mon.smithi084 (mon.0) 679 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.694507+0000 mon.smithi084 (mon.0) 680 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.695309+0000 mon.smithi084 (mon.0) 681 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:18.139 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:16.696404+0000 mon.smithi084 (mon.0) 682 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:19.005 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:16.775159+0000 mgr.smithi084.hjmnez (mgr.14596) 347 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-02-15T18:33:19.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:16.775159+0000 mgr.smithi084.hjmnez (mgr.14596) 347 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-02-15T18:33:20.005 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:18.232587+0000 mgr.smithi084.hjmnez (mgr.14596) 348 : cephadm [INF] Upgrade: Updating prometheus.smithi084 2024-02-15T18:33:20.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:19 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:18.243130+0000 mgr.smithi084.hjmnez (mgr.14596) 349 : cephadm [INF] Deploying daemon prometheus.smithi084 on smithi084 2024-02-15T18:33:20.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:18.232587+0000 mgr.smithi084.hjmnez (mgr.14596) 348 : cephadm [INF] Upgrade: Updating prometheus.smithi084 2024-02-15T18:33:20.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:19 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:18.243130+0000 mgr.smithi084.hjmnez (mgr.14596) 349 : cephadm [INF] Deploying daemon prometheus.smithi084 on smithi084 2024-02-15T18:33:21.006 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:18.775570+0000 mgr.smithi084.hjmnez (mgr.14596) 350 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-02-15T18:33:21.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:18.775570+0000 mgr.smithi084.hjmnez (mgr.14596) 350 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-02-15T18:33:22.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:20.775956+0000 mgr.smithi084.hjmnez (mgr.14596) 351 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:23.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:20.775956+0000 mgr.smithi084.hjmnez (mgr.14596) 351 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:24.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:22.776488+0000 mgr.smithi084.hjmnez (mgr.14596) 352 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:24.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:23.351816+0000 mon.smithi084 (mon.0) 683 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:24.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:23.352613+0000 mon.smithi084 (mon.0) 684 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:24.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:22.776488+0000 mgr.smithi084.hjmnez (mgr.14596) 352 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:24.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:23.351816+0000 mon.smithi084 (mon.0) 683 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:24.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:23.352613+0000 mon.smithi084 (mon.0) 684 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:26.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:24.777041+0000 mgr.smithi084.hjmnez (mgr.14596) 353 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:26.661 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:24.777041+0000 mgr.smithi084.hjmnez (mgr.14596) 353 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:28.610 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:26.777387+0000 mgr.smithi084.hjmnez (mgr.14596) 354 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:28.610 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.138637+0000 mon.smithi084 (mon.0) 685 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.139335+0000 mon.smithi084 (mon.0) 686 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.139884+0000 mon.smithi084 (mon.0) 687 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.143246+0000 mon.smithi084 (mon.0) 688 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.148897+0000 mon.smithi084 (mon.0) 689 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.150565+0000 mon.smithi084 (mon.0) 690 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.152500+0000 mon.smithi084 (mon.0) 691 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.153523+0000 mon.smithi084 (mon.0) 692 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.154496+0000 mon.smithi084 (mon.0) 693 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.155775+0000 mon.smithi084 (mon.0) 694 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.157240+0000 mon.smithi084 (mon.0) 695 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.158021+0000 mon.smithi084 (mon.0) 696 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.158822+0000 mon.smithi084 (mon.0) 697 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.159596+0000 mon.smithi084 (mon.0) 698 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.611 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.160455+0000 mon.smithi084 (mon.0) 699 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.161291+0000 mon.smithi084 (mon.0) 700 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.162458+0000 mon.smithi084 (mon.0) 701 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.612 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.163512+0000 mon.smithi084 (mon.0) 702 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:26.777387+0000 mgr.smithi084.hjmnez (mgr.14596) 354 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:28.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.138637+0000 mon.smithi084 (mon.0) 685 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:28.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.139335+0000 mon.smithi084 (mon.0) 686 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:28.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.139884+0000 mon.smithi084 (mon.0) 687 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:28.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.143246+0000 mon.smithi084 (mon.0) 688 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.148897+0000 mon.smithi084 (mon.0) 689 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.150565+0000 mon.smithi084 (mon.0) 690 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.152500+0000 mon.smithi084 (mon.0) 691 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.153523+0000 mon.smithi084 (mon.0) 692 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.154496+0000 mon.smithi084 (mon.0) 693 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.155775+0000 mon.smithi084 (mon.0) 694 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.157240+0000 mon.smithi084 (mon.0) 695 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.158021+0000 mon.smithi084 (mon.0) 696 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.158822+0000 mon.smithi084 (mon.0) 697 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.159596+0000 mon.smithi084 (mon.0) 698 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.160455+0000 mon.smithi084 (mon.0) 699 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.161291+0000 mon.smithi084 (mon.0) 700 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.162458+0000 mon.smithi084 (mon.0) 701 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:28.639 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.163512+0000 mon.smithi084 (mon.0) 702 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:29.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:28.140374+0000 mgr.smithi084.hjmnez (mgr.14596) 355 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:29.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:29 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:28.149279+0000 mgr.smithi084.hjmnez (mgr.14596) 356 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:33:29.712 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:28.140374+0000 mgr.smithi084.hjmnez (mgr.14596) 355 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:29.712 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:29 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:28.149279+0000 mgr.smithi084.hjmnez (mgr.14596) 356 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:33:30.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:28.777732+0000 mgr.smithi084.hjmnez (mgr.14596) 357 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:30.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:28.777732+0000 mgr.smithi084.hjmnez (mgr.14596) 357 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:31.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:29.739461+0000 mgr.smithi084.hjmnez (mgr.14596) 358 : cephadm [INF] Upgrade: Updating alertmanager.smithi084 2024-02-15T18:33:31.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:31 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:29.744937+0000 mgr.smithi084.hjmnez (mgr.14596) 359 : cephadm [INF] Deploying daemon alertmanager.smithi084 on smithi084 2024-02-15T18:33:31.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:29.739461+0000 mgr.smithi084.hjmnez (mgr.14596) 358 : cephadm [INF] Upgrade: Updating alertmanager.smithi084 2024-02-15T18:33:31.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:31 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:29.744937+0000 mgr.smithi084.hjmnez (mgr.14596) 359 : cephadm [INF] Deploying daemon alertmanager.smithi084 on smithi084 2024-02-15T18:33:32.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:30.778097+0000 mgr.smithi084.hjmnez (mgr.14596) 360 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.661+0000 7fa62c8f4700 1 -- 172.21.15.84:0/1639638002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6280f9850 msgr2=0x7fa6280fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.661+0000 7fa62c8f4700 1 --2- 172.21.15.84:0/1639638002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6280f9850 0x7fa6280fbc80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fa610004660 tx=0x7fa610009b30).stop 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.661+0000 7fa62c8f4700 1 -- 172.21.15.84:0/1639638002 shutdown_connections 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.661+0000 7fa62c8f4700 1 --2- 172.21.15.84:0/1639638002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6280f9850 0x7fa6280fbc80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.661+0000 7fa62c8f4700 1 --2- 172.21.15.84:0/1639638002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa628060250 0x7fa6280f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.661+0000 7fa62c8f4700 1 -- 172.21.15.84:0/1639638002 >> 172.21.15.84:0/1639638002 conn(0x7fa6280f0d40 msgr2=0x7fa6280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.661+0000 7fa62c8f4700 1 -- 172.21.15.84:0/1639638002 shutdown_connections 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.661+0000 7fa62c8f4700 1 -- 172.21.15.84:0/1639638002 wait complete. 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62c8f4700 1 Processor -- start 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62c8f4700 1 -- start start 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62c8f4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa628060250 0x7fa6280f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62c8f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6280f9850 0x7fa6280f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62c8f4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280f5850 con 0x7fa628060250 2024-02-15T18:33:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62c8f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280f5990 con 0x7fa6280f9850 2024-02-15T18:33:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa628060250 0x7fa6280f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa628060250 0x7fa6280f6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44814/0 (socket says 172.21.15.84:44814) 2024-02-15T18:33:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62659c700 1 -- 172.21.15.84:0/3114604418 learned_addr learned my addr 172.21.15.84:0/3114604418 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62659c700 1 -- 172.21.15.84:0/3114604418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6280f9850 msgr2=0x7fa6280f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa625d9b700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6280f9850 0x7fa6280f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62659c700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6280f9850 0x7fa6280f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62659c700 1 -- 172.21.15.84:0/3114604418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610005040 con 0x7fa628060250 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa625d9b700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6280f9850 0x7fa6280f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.662+0000 7fa62659c700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa628060250 0x7fa6280f6de0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fa61800b790 tx=0x7fa6180092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.663+0000 7fa61effd700 1 -- 172.21.15.84:0/3114604418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61800d780 con 0x7fa628060250 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.663+0000 7fa61effd700 1 -- 172.21.15.84:0/3114604418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa61800ddd0 con 0x7fa628060250 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.663+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6280f5c70 con 0x7fa628060250 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.663+0000 7fa61effd700 1 -- 172.21.15.84:0/3114604418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61800e380 con 0x7fa628060250 2024-02-15T18:33:32.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.663+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62810f090 con 0x7fa628060250 2024-02-15T18:33:32.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.664+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa628045ad0 con 0x7fa628060250 2024-02-15T18:33:32.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.664+0000 7fa61effd700 1 -- 172.21.15.84:0/3114604418 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa61800f400 con 0x7fa628060250 2024-02-15T18:33:32.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.664+0000 7fa61effd700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa614060f20 0x7fa6140633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:32.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.664+0000 7fa61effd700 1 -- 172.21.15.84:0/3114604418 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa61807cac0 con 0x7fa628060250 2024-02-15T18:33:32.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.664+0000 7fa625d9b700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa614060f20 0x7fa6140633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:32.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.665+0000 7fa625d9b700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa614060f20 0x7fa6140633e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa610005010 tx=0x7fa610009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:32.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.669+0000 7fa61effd700 1 -- 172.21.15.84:0/3114604418 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa61804cea0 con 0x7fa628060250 2024-02-15T18:33:32.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:30.778097+0000 mgr.smithi084.hjmnez (mgr.14596) 360 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.861+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6280ff190 con 0x7fa614060f20 2024-02-15T18:33:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.862+0000 7fa61effd700 1 -- 172.21.15.84:0/3114604418 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fa6280ff190 con 0x7fa614060f20 2024-02-15T18:33:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa614060f20 msgr2=0x7fa6140633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa614060f20 0x7fa6140633e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa610005010 tx=0x7fa610009b30).stop 2024-02-15T18:33:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa628060250 msgr2=0x7fa6280f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa628060250 0x7fa6280f6de0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fa61800b790 tx=0x7fa6180092d0).stop 2024-02-15T18:33:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 shutdown_connections 2024-02-15T18:33:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa614060f20 0x7fa6140633e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa628060250 0x7fa6280f6de0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 --2- 172.21.15.84:0/3114604418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6280f9850 0x7fa6280f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 >> 172.21.15.84:0/3114604418 conn(0x7fa6280f0d40 msgr2=0x7fa6280f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 shutdown_connections 2024-02-15T18:33:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.864+0000 7fa62c8f4700 1 -- 172.21.15.84:0/3114604418 wait complete. 2024-02-15T18:33:32.866 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:33:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 -- 172.21.15.84:0/3960385205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f5430 msgr2=0x7fae380f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 --2- 172.21.15.84:0/3960385205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f5430 0x7fae380f5850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fae34004660 tx=0x7fae34009b30).stop 2024-02-15T18:33:32.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 -- 172.21.15.84:0/3960385205 shutdown_connections 2024-02-15T18:33:32.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 --2- 172.21.15.84:0/3960385205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae380f66d0 0x7fae380f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:32.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 --2- 172.21.15.84:0/3960385205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f5430 0x7fae380f5850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:32.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 -- 172.21.15.84:0/3960385205 >> 172.21.15.84:0/3960385205 conn(0x7fae380f0b90 msgr2=0x7fae380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:32.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 -- 172.21.15.84:0/3960385205 shutdown_connections 2024-02-15T18:33:32.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 -- 172.21.15.84:0/3960385205 wait complete. 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 Processor -- start 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.970+0000 7fae3ea65700 1 -- start start 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3ea65700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae380f5430 0x7fae38109b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3ea65700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f66d0 0x7fae3810c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3ea65700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae380603c0 con 0x7fae380f66d0 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3ea65700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae38060500 con 0x7fae380f5430 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3d262700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f66d0 0x7fae3810c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3d262700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f66d0 0x7fae3810c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44840/0 (socket says 172.21.15.84:44840) 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3d262700 1 -- 172.21.15.84:0/778829231 learned_addr learned my addr 172.21.15.84:0/778829231 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:32.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3da63700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae380f5430 0x7fae38109b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3d262700 1 -- 172.21.15.84:0/778829231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae380f5430 msgr2=0x7fae38109b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3d262700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae380f5430 0x7fae38109b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3d262700 1 -- 172.21.15.84:0/778829231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34005040 con 0x7fae380f66d0 2024-02-15T18:33:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3d262700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f66d0 0x7fae3810c040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fae2800c530 tx=0x7fae28007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae2e7fc700 1 -- 172.21.15.84:0/778829231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae2800f650 con 0x7fae380f66d0 2024-02-15T18:33:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae2e7fc700 1 -- 172.21.15.84:0/778829231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fae2800fca0 con 0x7fae380f66d0 2024-02-15T18:33:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae2e7fc700 1 -- 172.21.15.84:0/778829231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae28012e10 con 0x7fae380f66d0 2024-02-15T18:33:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3810c5f0 con 0x7fae380f66d0 2024-02-15T18:33:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.971+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3810cb30 con 0x7fae380f66d0 2024-02-15T18:33:32.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.972+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae38045ad0 con 0x7fae380f66d0 2024-02-15T18:33:32.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.973+0000 7fae2e7fc700 1 -- 172.21.15.84:0/778829231 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fae28010070 con 0x7fae380f66d0 2024-02-15T18:33:32.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.973+0000 7fae2e7fc700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fae24060f70 0x7fae24063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:32.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.973+0000 7fae2e7fc700 1 -- 172.21.15.84:0/778829231 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fae2807bed0 con 0x7fae380f66d0 2024-02-15T18:33:32.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.973+0000 7fae3da63700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fae24060f70 0x7fae24063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:32.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.974+0000 7fae3da63700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fae24060f70 0x7fae24063430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fae34009490 tx=0x7fae34009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:32.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:32.977+0000 7fae2e7fc700 1 -- 172.21.15.84:0/778829231 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fae28047f60 con 0x7fae380f66d0 2024-02-15T18:33:33.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.173+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae38057f10 con 0x7fae24060f70 2024-02-15T18:33:33.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.174+0000 7fae2e7fc700 1 -- 172.21.15.84:0/778829231 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fae38057f10 con 0x7fae24060f70 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fae24060f70 msgr2=0x7fae24063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fae24060f70 0x7fae24063430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fae34009490 tx=0x7fae34009b30).stop 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f66d0 msgr2=0x7fae3810c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f66d0 0x7fae3810c040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fae2800c530 tx=0x7fae28007e20).stop 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 shutdown_connections 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fae24060f70 0x7fae24063430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae380f5430 0x7fae38109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 --2- 172.21.15.84:0/778829231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae380f66d0 0x7fae3810c040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 >> 172.21.15.84:0/778829231 conn(0x7fae380f0b90 msgr2=0x7fae380fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:33.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 shutdown_connections 2024-02-15T18:33:33.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.176+0000 7fae3ea65700 1 -- 172.21.15.84:0/778829231 wait complete. 2024-02-15T18:33:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.277+0000 7f2e59984700 1 -- 172.21.15.84:0/2912834109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 msgr2=0x7f2e540f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.277+0000 7f2e59984700 1 --2- 172.21.15.84:0/2912834109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 0x7f2e540f6b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f2e48004660 tx=0x7f2e48009b30).stop 2024-02-15T18:33:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.277+0000 7f2e59984700 1 -- 172.21.15.84:0/2912834109 shutdown_connections 2024-02-15T18:33:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.277+0000 7f2e59984700 1 --2- 172.21.15.84:0/2912834109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540f7980 0x7f2e540f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.277+0000 7f2e59984700 1 --2- 172.21.15.84:0/2912834109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 0x7f2e540f6b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.277+0000 7f2e59984700 1 -- 172.21.15.84:0/2912834109 >> 172.21.15.84:0/2912834109 conn(0x7f2e540f1e40 msgr2=0x7f2e540f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.277+0000 7f2e59984700 1 -- 172.21.15.84:0/2912834109 shutdown_connections 2024-02-15T18:33:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.277+0000 7f2e59984700 1 -- 172.21.15.84:0/2912834109 wait complete. 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e59984700 1 Processor -- start 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e59984700 1 -- start start 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e59984700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 0x7f2e54107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e59984700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540f7980 0x7f2e541074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e59984700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54107aa0 con 0x7f2e540f66e0 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e59984700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54107be0 con 0x7f2e540f7980 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e52ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 0x7f2e54107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e52ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 0x7f2e54107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44872/0 (socket says 172.21.15.84:44872) 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e52ffd700 1 -- 172.21.15.84:0/2405115103 learned_addr learned my addr 172.21.15.84:0/2405115103 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e527fc700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540f7980 0x7f2e541074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e52ffd700 1 -- 172.21.15.84:0/2405115103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540f7980 msgr2=0x7f2e541074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e52ffd700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540f7980 0x7f2e541074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.278+0000 7f2e52ffd700 1 -- 172.21.15.84:0/2405115103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e48005040 con 0x7f2e540f66e0 2024-02-15T18:33:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.279+0000 7f2e52ffd700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 0x7f2e54107000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2e48004e30 tx=0x7f2e48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.279+0000 7f2e3b7fe700 1 -- 172.21.15.84:0/2405115103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e48018070 con 0x7f2e540f66e0 2024-02-15T18:33:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.279+0000 7f2e3b7fe700 1 -- 172.21.15.84:0/2405115103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f2e48007ba0 con 0x7f2e540f66e0 2024-02-15T18:33:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.279+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e54108520 con 0x7f2e540f66e0 2024-02-15T18:33:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.279+0000 7f2e3b7fe700 1 -- 172.21.15.84:0/2405115103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e4801c3c0 con 0x7f2e540f66e0 2024-02-15T18:33:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.279+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e54108a00 con 0x7f2e540f66e0 2024-02-15T18:33:33.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.280+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e54045ad0 con 0x7f2e540f66e0 2024-02-15T18:33:33.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.280+0000 7f2e3b7fe700 1 -- 172.21.15.84:0/2405115103 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f2e4801d420 con 0x7f2e540f66e0 2024-02-15T18:33:33.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.280+0000 7f2e3b7fe700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2e3c060f20 0x7f2e3c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:33.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.280+0000 7f2e3b7fe700 1 -- 172.21.15.84:0/2405115103 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f2e4807ddb0 con 0x7f2e540f66e0 2024-02-15T18:33:33.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.281+0000 7f2e527fc700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2e3c060f20 0x7f2e3c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:33.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.281+0000 7f2e527fc700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2e3c060f20 0x7f2e3c0633e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2e44004ce0 tx=0x7f2e4400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.285+0000 7f2e3b7fe700 1 -- 172.21.15.84:0/2405115103 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2e48051c30 con 0x7f2e540f66e0 2024-02-15T18:33:33.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.483+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e54101020 con 0x7f2e3c060f20 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.494+0000 7f2e3b7fe700 1 -- 172.21.15.84:0/2405115103 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2e54101020 con 0x7f2e3c060f20 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (12m) 5s ago 14m 17.7M - 0.20.0 0881eb8f169f 6b00e37581e2 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (5m) 5s ago 14m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (5m) 19s ago 13m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (12m) 5s ago 14m 35.8M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (80s) 5s ago 9m 69.8M - 16.2.14-521-g0e714d9a 1fbc92c859dc 0914a2eeed6f 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (67s) 5s ago 9m 14.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4b79925c0d8d 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (52s) 19s ago 9m 14.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc 2ad04fa2e1ba 2024-02-15T18:33:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (37s) 19s ago 9m 11.3M - 16.2.14-521-g0e714d9a 1fbc92c859dc 6fdbbf145708 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (7m) 5s ago 15m 440M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (6m) 19s ago 13m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (6m) 5s ago 16m 60.4M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (5m) 19s ago 13m 52.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (27s) 5s ago 14m 10.3M - 1.3.1 1dbe0e931976 a8a538bf2063 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (22s) 19s ago 13m 3640k - 1.3.1 1dbe0e931976 de489c7951e2 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (4m) 5s ago 12m 209M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 5s ago 12m 254M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (3m) 5s ago 12m 188M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (3m) 19s ago 11m 279M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc b8c15d05905a 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (2m) 19s ago 11m 249M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 612e5da9dba4 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (2m) 19s ago 11m 195M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 93c01314b455 2024-02-15T18:33:33.487 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (10s) 5s ago 13m 35.4M - 2.33.4 514e6a882f6e 7c289bf81b4d 2024-02-15T18:33:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2e3c060f20 msgr2=0x7f2e3c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2e3c060f20 0x7f2e3c0633e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2e44004ce0 tx=0x7f2e4400b040).stop 2024-02-15T18:33:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 msgr2=0x7f2e54107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 0x7f2e54107000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2e48004e30 tx=0x7f2e48009b30).stop 2024-02-15T18:33:33.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 shutdown_connections 2024-02-15T18:33:33.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2e3c060f20 0x7f2e3c0633e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e540f66e0 0x7f2e54107000 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 --2- 172.21.15.84:0/2405115103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540f7980 0x7f2e541074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 >> 172.21.15.84:0/2405115103 conn(0x7f2e540f1e40 msgr2=0x7f2e540fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:33.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 shutdown_connections 2024-02-15T18:33:33.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.496+0000 7f2e59984700 1 -- 172.21.15.84:0/2405115103 wait complete. 2024-02-15T18:33:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 -- 172.21.15.84:0/2387086231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 msgr2=0x7f520c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 --2- 172.21.15.84:0/2387086231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 0x7f520c0f7de0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f5208004660 tx=0x7f5208009b30).stop 2024-02-15T18:33:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 -- 172.21.15.84:0/2387086231 shutdown_connections 2024-02-15T18:33:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 --2- 172.21.15.84:0/2387086231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 0x7f520c0f7de0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 --2- 172.21.15.84:0/2387086231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f520c0f66e0 0x7f520c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 -- 172.21.15.84:0/2387086231 >> 172.21.15.84:0/2387086231 conn(0x7f520c0f1e40 msgr2=0x7f520c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 -- 172.21.15.84:0/2387086231 shutdown_connections 2024-02-15T18:33:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 -- 172.21.15.84:0/2387086231 wait complete. 2024-02-15T18:33:33.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 Processor -- start 2024-02-15T18:33:33.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.602+0000 7f521336f700 1 -- start start 2024-02-15T18:33:33.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521336f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f520c0f66e0 0x7f520c107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:33.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521336f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 0x7f520c1074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521336f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c107aa0 con 0x7f520c0f7980 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521336f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c107be0 con 0x7f520c0f66e0 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521090a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 0x7f520c1074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521090a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 0x7f520c1074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37944/0 (socket says 172.21.15.84:37944) 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521090a700 1 -- 172.21.15.84:0/843628773 learned_addr learned my addr 172.21.15.84:0/843628773 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521090a700 1 -- 172.21.15.84:0/843628773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f520c0f66e0 msgr2=0x7f520c107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521110b700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f520c0f66e0 0x7f520c107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521090a700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f520c0f66e0 0x7f520c107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521090a700 1 -- 172.21.15.84:0/843628773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208005040 con 0x7f520c0f7980 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521110b700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f520c0f66e0 0x7f520c107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521090a700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 0x7f520c1074f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5208009f50 tx=0x7f5208009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f5201ffb700 1 -- 172.21.15.84:0/843628773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5208018070 con 0x7f520c0f7980 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f5201ffb700 1 -- 172.21.15.84:0/843628773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f5208007ba0 con 0x7f520c0f7980 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c108520 con 0x7f520c0f7980 2024-02-15T18:33:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.603+0000 7f5201ffb700 1 -- 172.21.15.84:0/843628773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520801c620 con 0x7f520c0f7980 2024-02-15T18:33:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.604+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c108a80 con 0x7f520c0f7980 2024-02-15T18:33:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.605+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c045ad0 con 0x7f520c0f7980 2024-02-15T18:33:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.605+0000 7f5201ffb700 1 -- 172.21.15.84:0/843628773 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f520801c890 con 0x7f520c0f7980 2024-02-15T18:33:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.605+0000 7f5201ffb700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f51f8060f20 0x7f51f80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.605+0000 7f5201ffb700 1 -- 172.21.15.84:0/843628773 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f520807e000 con 0x7f520c0f7980 2024-02-15T18:33:33.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.605+0000 7f521110b700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f51f8060f20 0x7f51f80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:33.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.606+0000 7f521110b700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f51f8060f20 0x7f51f80633e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f520c0f77e0 tx=0x7f51fc00b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:33.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.610+0000 7f5201ffb700 1 -- 172.21.15.84:0/843628773 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5208051e10 con 0x7f520c0f7980 2024-02-15T18:33:33.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.880+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f520c027a00 con 0x7f520c0f7980 2024-02-15T18:33:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.881+0000 7f5201ffb700 1 -- 172.21.15.84:0/843628773 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f5208051a00 con 0x7f520c0f7980 2024-02-15T18:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:33:33.873 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:33:33.874 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f51f8060f20 msgr2=0x7f51f80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f51f8060f20 0x7f51f80633e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f520c0f77e0 tx=0x7f51fc00b040).stop 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 msgr2=0x7f520c1074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 0x7f520c1074f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5208009f50 tx=0x7f5208009b30).stop 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 shutdown_connections 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f51f8060f20 0x7f51f80633e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f520c0f66e0 0x7f520c107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 --2- 172.21.15.84:0/843628773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f520c0f7980 0x7f520c1074f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 >> 172.21.15.84:0/843628773 conn(0x7f520c0f1e40 msgr2=0x7f520c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 shutdown_connections 2024-02-15T18:33:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.883+0000 7f521336f700 1 -- 172.21.15.84:0/843628773 wait complete. 2024-02-15T18:33:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.985+0000 7f8b4fcda700 1 -- 172.21.15.84:0/2283131602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 msgr2=0x7f8b480f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.985+0000 7f8b4fcda700 1 --2- 172.21.15.84:0/2283131602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 0x7f8b480f5180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f8b44004770 tx=0x7f8b4400ac40).stop 2024-02-15T18:33:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.985+0000 7f8b4fcda700 1 -- 172.21.15.84:0/2283131602 shutdown_connections 2024-02-15T18:33:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.985+0000 7f8b4fcda700 1 --2- 172.21.15.84:0/2283131602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b480f5f60 0x7f8b480f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.985+0000 7f8b4fcda700 1 --2- 172.21.15.84:0/2283131602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 0x7f8b480f5180 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.985+0000 7f8b4fcda700 1 -- 172.21.15.84:0/2283131602 >> 172.21.15.84:0/2283131602 conn(0x7f8b480f04c0 msgr2=0x7f8b480f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.985+0000 7f8b4fcda700 1 -- 172.21.15.84:0/2283131602 shutdown_connections 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.985+0000 7f8b4fcda700 1 -- 172.21.15.84:0/2283131602 wait complete. 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4fcda700 1 Processor -- start 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4fcda700 1 -- start start 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4fcda700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 0x7f8b48107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4fcda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b480f5f60 0x7f8b48107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4fcda700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48107b00 con 0x7f8b480f4d60 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4fcda700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48107c40 con 0x7f8b480f5f60 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4da76700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 0x7f8b48107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4da76700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 0x7f8b48107060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37964/0 (socket says 172.21.15.84:37964) 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4da76700 1 -- 172.21.15.84:0/3169806988 learned_addr learned my addr 172.21.15.84:0/3169806988 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.986+0000 7f8b4d275700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b480f5f60 0x7f8b48107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.987+0000 7f8b4da76700 1 -- 172.21.15.84:0/3169806988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b480f5f60 msgr2=0x7f8b48107550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.987+0000 7f8b4da76700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b480f5f60 0x7f8b48107550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.987+0000 7f8b4da76700 1 -- 172.21.15.84:0/3169806988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44005040 con 0x7f8b480f4d60 2024-02-15T18:33:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.987+0000 7f8b4da76700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 0x7f8b48107060 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f8b44004f40 tx=0x7f8b4400ac40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.987+0000 7f8b3e7fc700 1 -- 172.21.15.84:0/3169806988 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b4400f070 con 0x7f8b480f4d60 2024-02-15T18:33:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.987+0000 7f8b3e7fc700 1 -- 172.21.15.84:0/3169806988 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f8b44014410 con 0x7f8b480f4d60 2024-02-15T18:33:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.987+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b48108580 con 0x7f8b480f4d60 2024-02-15T18:33:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.987+0000 7f8b3e7fc700 1 -- 172.21.15.84:0/3169806988 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b44019070 con 0x7f8b480f4d60 2024-02-15T18:33:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.987+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b48108ae0 con 0x7f8b480f4d60 2024-02-15T18:33:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.988+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b48045ad0 con 0x7f8b480f4d60 2024-02-15T18:33:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.989+0000 7f8b3e7fc700 1 -- 172.21.15.84:0/3169806988 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f8b44025060 con 0x7f8b480f4d60 2024-02-15T18:33:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.989+0000 7f8b3e7fc700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8b34060f20 0x7f8b340633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.989+0000 7f8b3e7fc700 1 -- 172.21.15.84:0/3169806988 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f8b4407d2f0 con 0x7f8b480f4d60 2024-02-15T18:33:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.989+0000 7f8b4d275700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8b34060f20 0x7f8b340633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.989+0000 7f8b4d275700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8b34060f20 0x7f8b340633e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8b38004c60 tx=0x7f8b3800b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:33.994+0000 7f8b3e7fc700 1 -- 172.21.15.84:0/3169806988 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8b44051100 con 0x7f8b480f4d60 2024-02-15T18:33:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.223+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8b4810d680 con 0x7f8b480f4d60 2024-02-15T18:33:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.224+0000 7f8b3e7fc700 1 -- 172.21.15.84:0/3169806988 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1778 (secure 0 0 0) 0x7f8b44050cf0 con 0x7f8b480f4d60 2024-02-15T18:33:34.216 INFO:teuthology.orchestra.run.smithi084.stdout:e38 2024-02-15T18:33:34.216 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:33:34.216 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:33:34.216 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:33:34.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:33:34.216 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 38 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:33:00.537828+0000 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:33:34.217 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 82 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=34338,1=34342} 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{0:34338} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:34.218 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{1:34342} state up:active seq 10 join_fscid=1 addr [v2:172.21.15.84:6828/2925871822,v1:172.21.15.84:6829/2925871822] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:34.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:33:34.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:33:34.219 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:33:34.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:33:34.219 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.133:6824/553393719,v1:172.21.15.133:6825/553393719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:34.219 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.133:6826/2979200029,v1:172.21.15.133:6827/2979200029] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8b34060f20 msgr2=0x7f8b340633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8b34060f20 0x7f8b340633e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8b38004c60 tx=0x7f8b3800b040).stop 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 msgr2=0x7f8b48107060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 0x7f8b48107060 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f8b44004f40 tx=0x7f8b4400ac40).stop 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 shutdown_connections 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8b34060f20 0x7f8b340633e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b480f4d60 0x7f8b48107060 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 --2- 172.21.15.84:0/3169806988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b480f5f60 0x7f8b48107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 >> 172.21.15.84:0/3169806988 conn(0x7f8b480f04c0 msgr2=0x7f8b480f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 shutdown_connections 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.226+0000 7f8b4fcda700 1 -- 172.21.15.84:0/3169806988 wait complete. 2024-02-15T18:33:34.220 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.330+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/154838874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 msgr2=0x7ff7a00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.330+0000 7ff7a4f1a700 1 --2- 172.21.15.84:0/154838874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 0x7ff7a00f7de0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ff794004660 tx=0x7ff794009b30).stop 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.330+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/154838874 shutdown_connections 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.330+0000 7ff7a4f1a700 1 --2- 172.21.15.84:0/154838874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 0x7ff7a00f7de0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.330+0000 7ff7a4f1a700 1 --2- 172.21.15.84:0/154838874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7a00f66e0 0x7ff7a00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.330+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/154838874 >> 172.21.15.84:0/154838874 conn(0x7ff7a00f1e40 msgr2=0x7ff7a00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.330+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/154838874 shutdown_connections 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.330+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/154838874 wait complete. 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff7a4f1a700 1 Processor -- start 2024-02-15T18:33:34.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff7a4f1a700 1 -- start start 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff7a4f1a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7a00f66e0 0x7ff7a0107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff7a4f1a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 0x7ff7a01074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff7a4f1a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0107aa0 con 0x7ff7a00f7980 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff7a4f1a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0107be0 con 0x7ff7a00f66e0 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff79dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 0x7ff7a01074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff79dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 0x7ff7a01074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37986/0 (socket says 172.21.15.84:37986) 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff79dd9b700 1 -- 172.21.15.84:0/1071722216 learned_addr learned my addr 172.21.15.84:0/1071722216 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff79e59c700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7a00f66e0 0x7ff7a0107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff79dd9b700 1 -- 172.21.15.84:0/1071722216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7a00f66e0 msgr2=0x7ff7a0107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff79dd9b700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7a00f66e0 0x7ff7a0107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:34.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff79dd9b700 1 -- 172.21.15.84:0/1071722216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794005040 con 0x7ff7a00f7980 2024-02-15T18:33:34.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.331+0000 7ff79dd9b700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 0x7ff7a01074f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7ff794009f50 tx=0x7ff794009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:34.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.332+0000 7ff78effd700 1 -- 172.21.15.84:0/1071722216 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff794018070 con 0x7ff7a00f7980 2024-02-15T18:33:34.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.332+0000 7ff78effd700 1 -- 172.21.15.84:0/1071722216 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7ff794007d70 con 0x7ff7a00f7980 2024-02-15T18:33:34.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.332+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a0108520 con 0x7ff7a00f7980 2024-02-15T18:33:34.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.332+0000 7ff78effd700 1 -- 172.21.15.84:0/1071722216 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff79401c620 con 0x7ff7a00f7980 2024-02-15T18:33:34.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.332+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a0108a80 con 0x7ff7a00f7980 2024-02-15T18:33:34.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.333+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a0045ad0 con 0x7ff7a00f7980 2024-02-15T18:33:34.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.333+0000 7ff78effd700 1 -- 172.21.15.84:0/1071722216 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ff79401c890 con 0x7ff7a00f7980 2024-02-15T18:33:34.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.333+0000 7ff78effd700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff788060f20 0x7ff7880633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:34.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.333+0000 7ff78effd700 1 -- 172.21.15.84:0/1071722216 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7ff79407e010 con 0x7ff7a00f7980 2024-02-15T18:33:34.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.333+0000 7ff79e59c700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff788060f20 0x7ff7880633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:34.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.334+0000 7ff79e59c700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff788060f20 0x7ff7880633e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff7a00f77e0 tx=0x7ff790009040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:34.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.338+0000 7ff78effd700 1 -- 172.21.15.84:0/1071722216 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff794051ea0 con 0x7ff7a00f7980 2024-02-15T18:33:34.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.531+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7a0108cf0 con 0x7ff788060f20 2024-02-15T18:33:34.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.532+0000 7ff78effd700 1 -- 172.21.15.84:0/1071722216 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7ff7a0108cf0 con 0x7ff788060f20 2024-02-15T18:33:34.524 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:33:34.524 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:33:34.524 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:33:34.524 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:33:34.524 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:33:34.524 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:33:34.524 INFO:teuthology.orchestra.run.smithi084.stdout: "mds", 2024-02-15T18:33:34.525 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-02-15T18:33:34.525 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:33:34.525 INFO:teuthology.orchestra.run.smithi084.stdout: "osd" 2024-02-15T18:33:34.525 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:33:34.525 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "16/21 daemons upgraded", 2024-02-15T18:33:34.525 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading alertmanager daemons", 2024-02-15T18:33:34.525 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:33:34.525 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:33:34.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff788060f20 msgr2=0x7ff7880633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:34.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff788060f20 0x7ff7880633e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff7a00f77e0 tx=0x7ff790009040).stop 2024-02-15T18:33:34.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 msgr2=0x7ff7a01074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:34.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 0x7ff7a01074f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7ff794009f50 tx=0x7ff794009b30).stop 2024-02-15T18:33:34.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 shutdown_connections 2024-02-15T18:33:34.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7ff788060f20 0x7ff7880633e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:34.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7a00f66e0 0x7ff7a0107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:34.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 --2- 172.21.15.84:0/1071722216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a00f7980 0x7ff7a01074f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:34.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 >> 172.21.15.84:0/1071722216 conn(0x7ff7a00f1e40 msgr2=0x7ff7a00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:34.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 shutdown_connections 2024-02-15T18:33:34.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:33:34.534+0000 7ff7a4f1a700 1 -- 172.21.15.84:0/1071722216 wait complete. 2024-02-15T18:33:34.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:32.778564+0000 mgr.smithi084.hjmnez (mgr.14596) 361 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:34.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:32.863048+0000 mgr.smithi084.hjmnez (mgr.14596) 362 : audit [DBG] from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:34.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:33.174928+0000 mgr.smithi084.hjmnez (mgr.14596) 363 : audit [DBG] from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:34.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:33.484677+0000 mgr.smithi084.hjmnez (mgr.14596) 364 : audit [DBG] from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:34.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:33.881931+0000 mon.smithi084 (mon.0) 703 : audit [DBG] from='client.? 172.21.15.84:0/843628773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:34.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:34.225014+0000 mon.smithi084 (mon.0) 704 : audit [DBG] from='client.? 172.21.15.84:0/3169806988' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:33:34.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:32.778564+0000 mgr.smithi084.hjmnez (mgr.14596) 361 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:34.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:32.863048+0000 mgr.smithi084.hjmnez (mgr.14596) 362 : audit [DBG] from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:34.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:33.174928+0000 mgr.smithi084.hjmnez (mgr.14596) 363 : audit [DBG] from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:34.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:33.484677+0000 mgr.smithi084.hjmnez (mgr.14596) 364 : audit [DBG] from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:34.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:33.881931+0000 mon.smithi084 (mon.0) 703 : audit [DBG] from='client.? 172.21.15.84:0/843628773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:34.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:34.225014+0000 mon.smithi084 (mon.0) 704 : audit [DBG] from='client.? 172.21.15.84:0/3169806988' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:33:35.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:35 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:34.532772+0000 mgr.smithi084.hjmnez (mgr.14596) 365 : audit [DBG] from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:35.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:35 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:34.532772+0000 mgr.smithi084.hjmnez (mgr.14596) 365 : audit [DBG] from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:36.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:34.778947+0000 mgr.smithi084.hjmnez (mgr.14596) 366 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:36.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:34.778947+0000 mgr.smithi084.hjmnez (mgr.14596) 366 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:38.628 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:36.779269+0000 mgr.smithi084.hjmnez (mgr.14596) 367 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:38.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:36.779269+0000 mgr.smithi084.hjmnez (mgr.14596) 367 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:40.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:38.779897+0000 mgr.smithi084.hjmnez (mgr.14596) 368 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:40.656 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:38.779897+0000 mgr.smithi084.hjmnez (mgr.14596) 368 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:42.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:40.780237+0000 mgr.smithi084.hjmnez (mgr.14596) 369 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:42.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:40.812362+0000 mon.smithi084 (mon.0) 705 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:42.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:40.813055+0000 mon.smithi084 (mon.0) 706 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:42.183 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:41 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:40.780237+0000 mgr.smithi084.hjmnez (mgr.14596) 369 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:42.183 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:41 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:40.812362+0000 mon.smithi084 (mon.0) 705 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:42.183 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:41 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:40.813055+0000 mon.smithi084 (mon.0) 706 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:44.138 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:43 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:42.780722+0000 mgr.smithi084.hjmnez (mgr.14596) 370 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:44.255 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:43 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:42.780722+0000 mgr.smithi084.hjmnez (mgr.14596) 370 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:44.781103+0000 mgr.smithi084.hjmnez (mgr.14596) 371 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.453716+0000 mon.smithi084 (mon.0) 707 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.454451+0000 mon.smithi084 (mon.0) 708 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.455062+0000 mon.smithi084 (mon.0) 709 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:45.455572+0000 mgr.smithi084.hjmnez (mgr.14596) 372 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.460836+0000 mon.smithi084 (mon.0) 710 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.467383+0000 mon.smithi084 (mon.0) 711 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:33:46.506 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.467693+0000 mgr.smithi084.hjmnez (mgr.14596) 373 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.468382+0000 mon.smithi084 (mon.0) 712 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.468604+0000 mgr.smithi084.hjmnez (mgr.14596) 374 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.474587+0000 mon.smithi084 (mon.0) 713 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.476499+0000 mon.smithi084 (mon.0) 714 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.479398+0000 mon.smithi084 (mon.0) 715 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.480514+0000 mon.smithi084 (mon.0) 716 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.482814+0000 mon.smithi084 (mon.0) 717 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.484446+0000 mon.smithi084 (mon.0) 718 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.486120+0000 mon.smithi084 (mon.0) 719 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.487045+0000 mon.smithi084 (mon.0) 720 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.487867+0000 mon.smithi084 (mon.0) 721 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.488997+0000 mon.smithi084 (mon.0) 722 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.507 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.490076+0000 mon.smithi084 (mon.0) 723 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.491044+0000 mon.smithi084 (mon.0) 724 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.492260+0000 mon.smithi084 (mon.0) 725 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.493305+0000 mon.smithi084 (mon.0) 726 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.508 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:45.494345+0000 mon.smithi084 (mon.0) 727 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:44.781103+0000 mgr.smithi084.hjmnez (mgr.14596) 371 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:46.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.453716+0000 mon.smithi084 (mon.0) 707 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:46.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.454451+0000 mon.smithi084 (mon.0) 708 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.455062+0000 mon.smithi084 (mon.0) 709 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:45.455572+0000 mgr.smithi084.hjmnez (mgr.14596) 372 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.460836+0000 mon.smithi084 (mon.0) 710 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.467383+0000 mon.smithi084 (mon.0) 711 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.467693+0000 mgr.smithi084.hjmnez (mgr.14596) 373 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.468382+0000 mon.smithi084 (mon.0) 712 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.468604+0000 mgr.smithi084.hjmnez (mgr.14596) 374 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi084.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.474587+0000 mon.smithi084 (mon.0) 713 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.476499+0000 mon.smithi084 (mon.0) 714 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.479398+0000 mon.smithi084 (mon.0) 715 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.480514+0000 mon.smithi084 (mon.0) 716 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.889 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.482814+0000 mon.smithi084 (mon.0) 717 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.484446+0000 mon.smithi084 (mon.0) 718 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.486120+0000 mon.smithi084 (mon.0) 719 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.487045+0000 mon.smithi084 (mon.0) 720 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.487867+0000 mon.smithi084 (mon.0) 721 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.488997+0000 mon.smithi084 (mon.0) 722 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.490076+0000 mon.smithi084 (mon.0) 723 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.491044+0000 mon.smithi084 (mon.0) 724 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.492260+0000 mon.smithi084 (mon.0) 725 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.493305+0000 mon.smithi084 (mon.0) 726 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:46.890 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:45.494345+0000 mon.smithi084 (mon.0) 727 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:48.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:46.781639+0000 mgr.smithi084.hjmnez (mgr.14596) 375 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:48.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:47.036614+0000 mgr.smithi084.hjmnez (mgr.14596) 376 : cephadm [INF] Upgrade: Updating grafana.smithi084 2024-02-15T18:33:48.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:47.359834+0000 mon.smithi084 (mon.0) 728 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:48.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:47.362398+0000 mon.smithi084 (mon.0) 729 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:48.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:47.364774+0000 mon.smithi084 (mon.0) 730 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:33:48.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:33:47.365104+0000 mgr.smithi084.hjmnez (mgr.14596) 377 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:33:48.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:33:47.369124+0000 mgr.smithi084.hjmnez (mgr.14596) 378 : cephadm [INF] Deploying daemon grafana.smithi084 on smithi084 2024-02-15T18:33:48.649 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:46.781639+0000 mgr.smithi084.hjmnez (mgr.14596) 375 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:48.649 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:47.036614+0000 mgr.smithi084.hjmnez (mgr.14596) 376 : cephadm [INF] Upgrade: Updating grafana.smithi084 2024-02-15T18:33:48.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:47.359834+0000 mon.smithi084 (mon.0) 728 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:48.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:47.362398+0000 mon.smithi084 (mon.0) 729 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:33:48.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:47.364774+0000 mon.smithi084 (mon.0) 730 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:33:48.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:33:47.365104+0000 mgr.smithi084.hjmnez (mgr.14596) 377 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:33:48.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:33:47.369124+0000 mgr.smithi084.hjmnez (mgr.14596) 378 : cephadm [INF] Deploying daemon grafana.smithi084 on smithi084 2024-02-15T18:33:50.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:48.782116+0000 mgr.smithi084.hjmnez (mgr.14596) 379 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:50.661 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:48.782116+0000 mgr.smithi084.hjmnez (mgr.14596) 379 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:52.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:50.782545+0000 mgr.smithi084.hjmnez (mgr.14596) 380 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:52.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:50.782545+0000 mgr.smithi084.hjmnez (mgr.14596) 380 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:54.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:52.782902+0000 mgr.smithi084.hjmnez (mgr.14596) 381 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:54.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:52.782902+0000 mgr.smithi084.hjmnez (mgr.14596) 381 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:56.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:54.783222+0000 mgr.smithi084.hjmnez (mgr.14596) 382 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:56.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:54.783222+0000 mgr.smithi084.hjmnez (mgr.14596) 382 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:58.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:33:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:56.783592+0000 mgr.smithi084.hjmnez (mgr.14596) 383 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:33:58.649 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:33:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:56.783592+0000 mgr.smithi084.hjmnez (mgr.14596) 383 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:00.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:33:58.784001+0000 mgr.smithi084.hjmnez (mgr.14596) 384 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:00.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:33:58.784001+0000 mgr.smithi084.hjmnez (mgr.14596) 384 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:02.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:00.784453+0000 mgr.smithi084.hjmnez (mgr.14596) 385 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:02.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:00.784453+0000 mgr.smithi084.hjmnez (mgr.14596) 385 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.638+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1997450421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f55c0 msgr2=0x7f1bbc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.638+0000 7f1bc3efd700 1 --2- 172.21.15.84:0/1997450421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f55c0 0x7f1bbc0f59e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f1bb8004660 tx=0x7f1bb8009b30).stop 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.638+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1997450421 shutdown_connections 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.638+0000 7f1bc3efd700 1 --2- 172.21.15.84:0/1997450421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bbc0f6860 0x7f1bbc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.638+0000 7f1bc3efd700 1 --2- 172.21.15.84:0/1997450421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f55c0 0x7f1bbc0f59e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.638+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1997450421 >> 172.21.15.84:0/1997450421 conn(0x7f1bbc0f0d40 msgr2=0x7f1bbc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.638+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1997450421 shutdown_connections 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.638+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1997450421 wait complete. 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc3efd700 1 Processor -- start 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc3efd700 1 -- start start 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc3efd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bbc0f55c0 0x7f1bbc105f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc3efd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f6860 0x7f1bbc1063f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc3efd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc1069a0 con 0x7f1bbc0f6860 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc3efd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc106ae0 con 0x7f1bbc0f55c0 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc1498700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f6860 0x7f1bbc1063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc1498700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f6860 0x7f1bbc1063f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43570/0 (socket says 172.21.15.84:43570) 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc1498700 1 -- 172.21.15.84:0/1372397768 learned_addr learned my addr 172.21.15.84:0/1372397768 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.639+0000 7f1bc1c99700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bbc0f55c0 0x7f1bbc105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.640+0000 7f1bc1498700 1 -- 172.21.15.84:0/1372397768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bbc0f55c0 msgr2=0x7f1bbc105f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.640+0000 7f1bc1498700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bbc0f55c0 0x7f1bbc105f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.640+0000 7f1bc1498700 1 -- 172.21.15.84:0/1372397768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8005040 con 0x7f1bbc0f6860 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.640+0000 7f1bc1498700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f6860 0x7f1bbc1063f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f1bac0026d0 tx=0x7f1bac009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.640+0000 7f1bb27fc700 1 -- 172.21.15.84:0/1372397768 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bac009320 con 0x7f1bbc0f6860 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.640+0000 7f1bb27fc700 1 -- 172.21.15.84:0/1372397768 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f1bac00f040 con 0x7f1bbc0f6860 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.640+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc107480 con 0x7f1bbc0f6860 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.640+0000 7f1bb27fc700 1 -- 172.21.15.84:0/1372397768 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bac0149b0 con 0x7f1bbc0f6860 2024-02-15T18:34:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.640+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc107a40 con 0x7f1bbc0f6860 2024-02-15T18:34:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.641+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bbc045ad0 con 0x7f1bbc0f6860 2024-02-15T18:34:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.641+0000 7f1bb27fc700 1 -- 172.21.15.84:0/1372397768 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f1bac009480 con 0x7f1bbc0f6860 2024-02-15T18:34:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.641+0000 7f1bb27fc700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1ba8060f20 0x7f1ba80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.642+0000 7f1bb27fc700 1 -- 172.21.15.84:0/1372397768 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f1bac07c670 con 0x7f1bbc0f6860 2024-02-15T18:34:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.642+0000 7f1bc1c99700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1ba8060f20 0x7f1ba80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:04.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.642+0000 7f1bc1c99700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1ba8060f20 0x7f1ba80633e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1bb8004e30 tx=0x7f1bb8009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.646+0000 7f1bb27fc700 1 -- 172.21.15.84:0/1372397768 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1bac050500 con 0x7f1bbc0f6860 2024-02-15T18:34:04.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:02.784977+0000 mgr.smithi084.hjmnez (mgr.14596) 386 : cluster [DBG] pgmap v261: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:04.686 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:02.784977+0000 mgr.smithi084.hjmnez (mgr.14596) 386 : cluster [DBG] pgmap v261: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:04.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.836+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bbc107d10 con 0x7f1ba8060f20 2024-02-15T18:34:04.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.837+0000 7f1bb27fc700 1 -- 172.21.15.84:0/1372397768 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f1bbc107d10 con 0x7f1ba8060f20 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1ba8060f20 msgr2=0x7f1ba80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1ba8060f20 0x7f1ba80633e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1bb8004e30 tx=0x7f1bb8009b30).stop 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f6860 msgr2=0x7f1bbc1063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f6860 0x7f1bbc1063f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f1bac0026d0 tx=0x7f1bac009de0).stop 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 shutdown_connections 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1ba8060f20 0x7f1ba80633e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bbc0f55c0 0x7f1bbc105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 --2- 172.21.15.84:0/1372397768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bbc0f6860 0x7f1bbc1063f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 >> 172.21.15.84:0/1372397768 conn(0x7f1bbc0f0d40 msgr2=0x7f1bbc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 shutdown_connections 2024-02-15T18:34:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.839+0000 7f1bc3efd700 1 -- 172.21.15.84:0/1372397768 wait complete. 2024-02-15T18:34:04.841 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:34:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 -- 172.21.15.84:0/3724459202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f5f60 msgr2=0x7f11940f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 --2- 172.21.15.84:0/3724459202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f5f60 0x7f11940f63e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f1188004660 tx=0x7f1188009b30).stop 2024-02-15T18:34:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 -- 172.21.15.84:0/3724459202 shutdown_connections 2024-02-15T18:34:04.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 --2- 172.21.15.84:0/3724459202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f5f60 0x7f11940f63e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 --2- 172.21.15.84:0/3724459202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11940f4d60 0x7f11940f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 -- 172.21.15.84:0/3724459202 >> 172.21.15.84:0/3724459202 conn(0x7f11940f04c0 msgr2=0x7f11940f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 -- 172.21.15.84:0/3724459202 shutdown_connections 2024-02-15T18:34:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 -- 172.21.15.84:0/3724459202 wait complete. 2024-02-15T18:34:04.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 Processor -- start 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.941+0000 7f119b122700 1 -- start start 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f119b122700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f4d60 0x7f1194104e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f119b122700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11940f5f60 0x7f1194105330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f119b122700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1194105930 con 0x7f11940f4d60 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f119b122700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1194106140 con 0x7f11940f5f60 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f1198ebe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f4d60 0x7f1194104e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f1198ebe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f4d60 0x7f1194104e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43586/0 (socket says 172.21.15.84:43586) 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f1198ebe700 1 -- 172.21.15.84:0/2981232003 learned_addr learned my addr 172.21.15.84:0/2981232003 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f1193fff700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11940f5f60 0x7f1194105330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f1198ebe700 1 -- 172.21.15.84:0/2981232003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11940f5f60 msgr2=0x7f1194105330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f1198ebe700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11940f5f60 0x7f1194105330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f1198ebe700 1 -- 172.21.15.84:0/2981232003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188005040 con 0x7f11940f4d60 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f1198ebe700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f4d60 0x7f1194104e40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f118c00eb00 tx=0x7f118c004f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:04.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f11917fa700 1 -- 172.21.15.84:0/2981232003 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c00c750 con 0x7f11940f4d60 2024-02-15T18:34:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f11917fa700 1 -- 172.21.15.84:0/2981232003 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f118c010040 con 0x7f11940f4d60 2024-02-15T18:34:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f11917fa700 1 -- 172.21.15.84:0/2981232003 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118c014d10 con 0x7f11940f4d60 2024-02-15T18:34:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11941063c0 con 0x7f11940f4d60 2024-02-15T18:34:04.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.942+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1194106900 con 0x7f11940f4d60 2024-02-15T18:34:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.943+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11940f4150 con 0x7f11940f4d60 2024-02-15T18:34:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.944+0000 7f11917fa700 1 -- 172.21.15.84:0/2981232003 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f118c01b030 con 0x7f11940f4d60 2024-02-15T18:34:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.944+0000 7f11917fa700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f117c060f20 0x7f117c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.944+0000 7f11917fa700 1 -- 172.21.15.84:0/2981232003 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f118c07d100 con 0x7f11940f4d60 2024-02-15T18:34:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.944+0000 7f1193fff700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f117c060f20 0x7f117c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:04.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.944+0000 7f1193fff700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f117c060f20 0x7f117c0633e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f1188004630 tx=0x7f1188009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:04.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:04.948+0000 7f11917fa700 1 -- 172.21.15.84:0/2981232003 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f118c04d590 con 0x7f11940f4d60 2024-02-15T18:34:05.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.132+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11940fce20 con 0x7f117c060f20 2024-02-15T18:34:05.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.134+0000 7f11917fa700 1 -- 172.21.15.84:0/2981232003 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f11940fce20 con 0x7f117c060f20 2024-02-15T18:34:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.135+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f117c060f20 msgr2=0x7f117c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.135+0000 7f119b122700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f117c060f20 0x7f117c0633e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f1188004630 tx=0x7f1188009b30).stop 2024-02-15T18:34:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.135+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f4d60 msgr2=0x7f1194104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.135+0000 7f119b122700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f4d60 0x7f1194104e40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f118c00eb00 tx=0x7f118c004f00).stop 2024-02-15T18:34:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.136+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 shutdown_connections 2024-02-15T18:34:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.136+0000 7f119b122700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f117c060f20 0x7f117c0633e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.136+0000 7f119b122700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940f4d60 0x7f1194104e40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.136+0000 7f119b122700 1 --2- 172.21.15.84:0/2981232003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11940f5f60 0x7f1194105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.136+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 >> 172.21.15.84:0/2981232003 conn(0x7f11940f04c0 msgr2=0x7f11940f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.136+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 shutdown_connections 2024-02-15T18:34:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.136+0000 7f119b122700 1 -- 172.21.15.84:0/2981232003 wait complete. 2024-02-15T18:34:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.233+0000 7f5c7af47700 1 -- 172.21.15.84:0/3961291050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f5430 msgr2=0x7f5c740f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.233+0000 7f5c7af47700 1 --2- 172.21.15.84:0/3961291050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f5430 0x7f5c740f5850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f5c70004660 tx=0x7f5c70009b30).stop 2024-02-15T18:34:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.233+0000 7f5c7af47700 1 -- 172.21.15.84:0/3961291050 shutdown_connections 2024-02-15T18:34:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.233+0000 7f5c7af47700 1 --2- 172.21.15.84:0/3961291050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c740f66d0 0x7f5c740f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.233+0000 7f5c7af47700 1 --2- 172.21.15.84:0/3961291050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f5430 0x7f5c740f5850 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.233+0000 7f5c7af47700 1 -- 172.21.15.84:0/3961291050 >> 172.21.15.84:0/3961291050 conn(0x7f5c740f0b90 msgr2=0x7f5c740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.233+0000 7f5c7af47700 1 -- 172.21.15.84:0/3961291050 shutdown_connections 2024-02-15T18:34:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c7af47700 1 -- 172.21.15.84:0/3961291050 wait complete. 2024-02-15T18:34:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c7af47700 1 Processor -- start 2024-02-15T18:34:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c7af47700 1 -- start start 2024-02-15T18:34:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c7af47700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c740f5430 0x7f5c74109b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c7af47700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f66d0 0x7f5c7410c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c7af47700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c740603e0 con 0x7f5c740f66d0 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c7af47700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74060520 con 0x7f5c740f5430 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c79744700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f66d0 0x7f5c7410c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c79744700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f66d0 0x7f5c7410c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43596/0 (socket says 172.21.15.84:43596) 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c79744700 1 -- 172.21.15.84:0/649705156 learned_addr learned my addr 172.21.15.84:0/649705156 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.234+0000 7f5c79f45700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c740f5430 0x7f5c74109b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c79744700 1 -- 172.21.15.84:0/649705156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c740f5430 msgr2=0x7f5c74109b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c79744700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c740f5430 0x7f5c74109b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c79744700 1 -- 172.21.15.84:0/649705156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70005040 con 0x7f5c740f66d0 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c79f45700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c740f5430 0x7f5c74109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c79744700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f66d0 0x7f5c7410c020 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f5c6400e7f0 tx=0x7f5c6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c6a7fc700 1 -- 172.21.15.84:0/649705156 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c640092e0 con 0x7f5c740f66d0 2024-02-15T18:34:05.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7410c5d0 con 0x7f5c740f66d0 2024-02-15T18:34:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c6a7fc700 1 -- 172.21.15.84:0/649705156 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f5c6400f040 con 0x7f5c740f66d0 2024-02-15T18:34:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c6a7fc700 1 -- 172.21.15.84:0/649705156 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c64014880 con 0x7f5c740f66d0 2024-02-15T18:34:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.235+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7410cb90 con 0x7f5c740f66d0 2024-02-15T18:34:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.236+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c74045ad0 con 0x7f5c740f66d0 2024-02-15T18:34:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.236+0000 7f5c6a7fc700 1 -- 172.21.15.84:0/649705156 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f5c6401b030 con 0x7f5c740f66d0 2024-02-15T18:34:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.237+0000 7f5c6a7fc700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5c60060f70 0x7f5c60063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.237+0000 7f5c6a7fc700 1 -- 172.21.15.84:0/649705156 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f5c6407c0a0 con 0x7f5c740f66d0 2024-02-15T18:34:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.237+0000 7f5c79f45700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5c60060f70 0x7f5c60063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.237+0000 7f5c79f45700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5c60060f70 0x7f5c60063430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f5c70000c00 tx=0x7f5c7000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:05.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.241+0000 7f5c6a7fc700 1 -- 172.21.15.84:0/649705156 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5c6404c530 con 0x7f5c740f66d0 2024-02-15T18:34:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.423+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c740fde70 con 0x7f5c60060f70 2024-02-15T18:34:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.432+0000 7f5c6a7fc700 1 -- 172.21.15.84:0/649705156 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5c740fde70 con 0x7f5c60060f70 2024-02-15T18:34:05.424 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:34:05.424 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (25s) 19s ago 15m 13.2M - 0.23.0 ba2b418f427c cdab4270924c 2024-02-15T18:34:05.424 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (5m) 19s ago 15m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:34:05.424 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (5m) 51s ago 14m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:34:05.424 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (13m) 19s ago 14m 35.8M - 6.7.4 557c83e11646 cee41dfa69ca 2024-02-15T18:34:05.424 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (112s) 19s ago 9m 69.8M - 16.2.14-521-g0e714d9a 1fbc92c859dc 0914a2eeed6f 2024-02-15T18:34:05.424 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (99s) 19s ago 9m 15.1M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4b79925c0d8d 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (84s) 51s ago 9m 14.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc 2ad04fa2e1ba 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (69s) 51s ago 9m 11.3M - 16.2.14-521-g0e714d9a 1fbc92c859dc 6fdbbf145708 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (7m) 19s ago 16m 440M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (6m) 51s ago 14m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (6m) 19s ago 16m 61.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (6m) 51s ago 14m 52.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (59s) 19s ago 14m 10.9M - 1.3.1 1dbe0e931976 a8a538bf2063 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (54s) 51s ago 13m 3640k - 1.3.1 1dbe0e931976 de489c7951e2 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 19s ago 13m 208M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (4m) 19s ago 12m 254M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 19s ago 12m 188M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (3m) 51s ago 12m 279M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc b8c15d05905a 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (3m) 51s ago 11m 249M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 612e5da9dba4 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (2m) 51s ago 11m 195M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 93c01314b455 2024-02-15T18:34:05.425 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (42s) 19s ago 14m 59.6M - 2.33.4 514e6a882f6e 7c289bf81b4d 2024-02-15T18:34:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5c60060f70 msgr2=0x7f5c60063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5c60060f70 0x7f5c60063430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f5c70000c00 tx=0x7f5c7000b040).stop 2024-02-15T18:34:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f66d0 msgr2=0x7f5c7410c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f66d0 0x7f5c7410c020 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f5c6400e7f0 tx=0x7f5c6400b040).stop 2024-02-15T18:34:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 shutdown_connections 2024-02-15T18:34:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5c60060f70 0x7f5c60063430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c740f5430 0x7f5c74109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 --2- 172.21.15.84:0/649705156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c740f66d0 0x7f5c7410c020 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 >> 172.21.15.84:0/649705156 conn(0x7f5c740f0b90 msgr2=0x7f5c740fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:05.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 shutdown_connections 2024-02-15T18:34:05.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.434+0000 7f5c7af47700 1 -- 172.21.15.84:0/649705156 wait complete. 2024-02-15T18:34:05.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.532+0000 7f307532d700 1 -- 172.21.15.84:0/1328710746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 msgr2=0x7f30700f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.532+0000 7f307532d700 1 --2- 172.21.15.84:0/1328710746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 0x7f30700f6cc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3058004660 tx=0x7f3058009b30).stop 2024-02-15T18:34:05.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.532+0000 7f307532d700 1 -- 172.21.15.84:0/1328710746 shutdown_connections 2024-02-15T18:34:05.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.532+0000 7f307532d700 1 --2- 172.21.15.84:0/1328710746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 0x7f30700f6cc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.532+0000 7f307532d700 1 --2- 172.21.15.84:0/1328710746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700f55c0 0x7f30700f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.532+0000 7f307532d700 1 -- 172.21.15.84:0/1328710746 >> 172.21.15.84:0/1328710746 conn(0x7f30700f0d40 msgr2=0x7f30700f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.532+0000 7f307532d700 1 -- 172.21.15.84:0/1328710746 shutdown_connections 2024-02-15T18:34:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.532+0000 7f307532d700 1 -- 172.21.15.84:0/1328710746 wait complete. 2024-02-15T18:34:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f307532d700 1 Processor -- start 2024-02-15T18:34:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f307532d700 1 -- start start 2024-02-15T18:34:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f307532d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700f55c0 0x7f3070106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f307532d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 0x7f30701074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f307532d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070107a60 con 0x7f30700f6860 2024-02-15T18:34:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f307532d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070107ba0 con 0x7f30700f55c0 2024-02-15T18:34:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f306e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 0x7f30701074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f306e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 0x7f30701074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43612/0 (socket says 172.21.15.84:43612) 2024-02-15T18:34:05.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f306e7fc700 1 -- 172.21.15.84:0/1769789191 learned_addr learned my addr 172.21.15.84:0/1769789191 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.533+0000 7f306effd700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700f55c0 0x7f3070106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.534+0000 7f306e7fc700 1 -- 172.21.15.84:0/1769789191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700f55c0 msgr2=0x7f3070106fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.534+0000 7f306e7fc700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700f55c0 0x7f3070106fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.534+0000 7f306e7fc700 1 -- 172.21.15.84:0/1769789191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058005040 con 0x7f30700f6860 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.534+0000 7f306e7fc700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 0x7f30701074b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f3058000c00 tx=0x7f305800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.534+0000 7f30677fe700 1 -- 172.21.15.84:0/1769789191 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3058019070 con 0x7f30700f6860 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.534+0000 7f30677fe700 1 -- 172.21.15.84:0/1769789191 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f3058014420 con 0x7f30700f6860 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.534+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30701084e0 con 0x7f30700f6860 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.534+0000 7f30677fe700 1 -- 172.21.15.84:0/1769789191 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f305801d600 con 0x7f30700f6860 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.534+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3070108a40 con 0x7f30700f6860 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.535+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3070045ad0 con 0x7f30700f6860 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.535+0000 7f30677fe700 1 -- 172.21.15.84:0/1769789191 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f3058025070 con 0x7f30700f6860 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.536+0000 7f30677fe700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f305c060f20 0x7f305c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.536+0000 7f30677fe700 1 -- 172.21.15.84:0/1769789191 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f305807d170 con 0x7f30700f6860 2024-02-15T18:34:05.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.536+0000 7f306effd700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f305c060f20 0x7f305c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:05.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.536+0000 7f306effd700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f305c060f20 0x7f305c0633e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f30700f66c0 tx=0x7f306000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.540+0000 7f30677fe700 1 -- 172.21.15.84:0/1769789191 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3058050f80 con 0x7f30700f6860 2024-02-15T18:34:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.772+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f307010d5e0 con 0x7f30700f6860 2024-02-15T18:34:05.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.773+0000 7f30677fe700 1 -- 172.21.15.84:0/1769789191 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f3058023070 con 0x7f30700f6860 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:34:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:34:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:34:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:34:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:34:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:34:05.766 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:34:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f305c060f20 msgr2=0x7f305c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f305c060f20 0x7f305c0633e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f30700f66c0 tx=0x7f306000b040).stop 2024-02-15T18:34:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 msgr2=0x7f30701074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 0x7f30701074b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f3058000c00 tx=0x7f305800b040).stop 2024-02-15T18:34:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 shutdown_connections 2024-02-15T18:34:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f305c060f20 0x7f305c0633e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700f55c0 0x7f3070106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 --2- 172.21.15.84:0/1769789191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30700f6860 0x7f30701074b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 >> 172.21.15.84:0/1769789191 conn(0x7f30700f0d40 msgr2=0x7f307005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 shutdown_connections 2024-02-15T18:34:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.775+0000 7f307532d700 1 -- 172.21.15.84:0/1769789191 wait complete. 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.876+0000 7fa09e320700 1 -- 172.21.15.84:0/3560066767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f55c0 msgr2=0x7fa0980f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.876+0000 7fa09e320700 1 --2- 172.21.15.84:0/3560066767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f55c0 0x7fa0980f59e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fa088004660 tx=0x7fa088009b30).stop 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.876+0000 7fa09e320700 1 -- 172.21.15.84:0/3560066767 shutdown_connections 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.876+0000 7fa09e320700 1 --2- 172.21.15.84:0/3560066767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0980f6860 0x7fa0980f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.876+0000 7fa09e320700 1 --2- 172.21.15.84:0/3560066767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f55c0 0x7fa0980f59e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.876+0000 7fa09e320700 1 -- 172.21.15.84:0/3560066767 >> 172.21.15.84:0/3560066767 conn(0x7fa0980f0d40 msgr2=0x7fa0980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.876+0000 7fa09e320700 1 -- 172.21.15.84:0/3560066767 shutdown_connections 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.876+0000 7fa09e320700 1 -- 172.21.15.84:0/3560066767 wait complete. 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.877+0000 7fa09e320700 1 Processor -- start 2024-02-15T18:34:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.877+0000 7fa09e320700 1 -- start start 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.877+0000 7fa09e320700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0980f55c0 0x7fa098068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa09e320700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f6860 0x7fa098069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa09e320700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980696b0 con 0x7fa0980f6860 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa09e320700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980697f0 con 0x7fa0980f55c0 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa0977fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f6860 0x7fa098069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa0977fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f6860 0x7fa098069100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43622/0 (socket says 172.21.15.84:43622) 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa0977fe700 1 -- 172.21.15.84:0/913067382 learned_addr learned my addr 172.21.15.84:0/913067382 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa097fff700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0980f55c0 0x7fa098068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa0977fe700 1 -- 172.21.15.84:0/913067382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0980f55c0 msgr2=0x7fa098068c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa0977fe700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0980f55c0 0x7fa098068c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa0977fe700 1 -- 172.21.15.84:0/913067382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088005040 con 0x7fa0980f6860 2024-02-15T18:34:05.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa0977fe700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f6860 0x7fa098069100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fa08c00e7f0 tx=0x7fa08c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa094ff9700 1 -- 172.21.15.84:0/913067382 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08c0092e0 con 0x7fa0980f6860 2024-02-15T18:34:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09810fc10 con 0x7fa0980f6860 2024-02-15T18:34:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa094ff9700 1 -- 172.21.15.84:0/913067382 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa08c00f040 con 0x7fa0980f6860 2024-02-15T18:34:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.878+0000 7fa094ff9700 1 -- 172.21.15.84:0/913067382 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08c014850 con 0x7fa0980f6860 2024-02-15T18:34:05.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.879+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0981101d0 con 0x7fa0980f6860 2024-02-15T18:34:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.880+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa098045ad0 con 0x7fa0980f6860 2024-02-15T18:34:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.880+0000 7fa094ff9700 1 -- 172.21.15.84:0/913067382 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa08c01b030 con 0x7fa0980f6860 2024-02-15T18:34:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.881+0000 7fa094ff9700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa080060f20 0x7fa0800633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.881+0000 7fa094ff9700 1 -- 172.21.15.84:0/913067382 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa08c07bed0 con 0x7fa0980f6860 2024-02-15T18:34:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.881+0000 7fa097fff700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa080060f20 0x7fa0800633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:05.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.881+0000 7fa097fff700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa080060f20 0x7fa0800633e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa088009720 tx=0x7fa088016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:05.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:05.885+0000 7fa094ff9700 1 -- 172.21.15.84:0/913067382 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa08c04fd90 con 0x7fa0980f6860 2024-02-15T18:34:06.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.105+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa098027a00 con 0x7fa0980f6860 2024-02-15T18:34:06.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.106+0000 7fa094ff9700 1 -- 172.21.15.84:0/913067382 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1778 (secure 0 0 0) 0x7fa08c019020 con 0x7fa0980f6860 2024-02-15T18:34:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:e38 2024-02-15T18:34:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:34:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:34:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:34:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:34:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:34:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:34:06.098 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 38 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:33:00.537828+0000 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 82 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:34:06.099 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=34338,1=34342} 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{0:34338} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{1:34342} state up:active seq 10 join_fscid=1 addr [v2:172.21.15.84:6828/2925871822,v1:172.21.15.84:6829/2925871822] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:34:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:34:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:34:06.101 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.133:6824/553393719,v1:172.21.15.133:6825/553393719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:06.101 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.133:6826/2979200029,v1:172.21.15.133:6827/2979200029] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.107+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa080060f20 msgr2=0x7fa0800633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.107+0000 7fa09e320700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa080060f20 0x7fa0800633e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fa088009720 tx=0x7fa088016040).stop 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.107+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f6860 msgr2=0x7fa098069100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.107+0000 7fa09e320700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f6860 0x7fa098069100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fa08c00e7f0 tx=0x7fa08c00b040).stop 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.108+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 shutdown_connections 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.108+0000 7fa09e320700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa080060f20 0x7fa0800633e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.108+0000 7fa09e320700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0980f55c0 0x7fa098068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.108+0000 7fa09e320700 1 --2- 172.21.15.84:0/913067382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0980f6860 0x7fa098069100 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.108+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 >> 172.21.15.84:0/913067382 conn(0x7fa0980f0d40 msgr2=0x7fa0980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.108+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 shutdown_connections 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.108+0000 7fa09e320700 1 -- 172.21.15.84:0/913067382 wait complete. 2024-02-15T18:34:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2024-02-15T18:34:06.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.212+0000 7fce367d3700 1 -- 172.21.15.84:0/338860788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 msgr2=0x7fce300f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:06.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.212+0000 7fce367d3700 1 --2- 172.21.15.84:0/338860788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 0x7fce300f6950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fce2c004660 tx=0x7fce2c009b30).stop 2024-02-15T18:34:06.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.212+0000 7fce367d3700 1 -- 172.21.15.84:0/338860788 shutdown_connections 2024-02-15T18:34:06.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.212+0000 7fce367d3700 1 --2- 172.21.15.84:0/338860788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce300f77d0 0x7fce300f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:06.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.212+0000 7fce367d3700 1 --2- 172.21.15.84:0/338860788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 0x7fce300f6950 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:06.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.212+0000 7fce367d3700 1 -- 172.21.15.84:0/338860788 >> 172.21.15.84:0/338860788 conn(0x7fce300f1c90 msgr2=0x7fce300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:06.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.212+0000 7fce367d3700 1 -- 172.21.15.84:0/338860788 shutdown_connections 2024-02-15T18:34:06.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.212+0000 7fce367d3700 1 -- 172.21.15.84:0/338860788 wait complete. 2024-02-15T18:34:06.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.213+0000 7fce367d3700 1 Processor -- start 2024-02-15T18:34:06.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.213+0000 7fce367d3700 1 -- start start 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.213+0000 7fce367d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 0x7fce30106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.213+0000 7fce367d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce300f77d0 0x7fce301073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.213+0000 7fce367d3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30107960 con 0x7fce300f6530 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.213+0000 7fce367d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30108160 con 0x7fce300f77d0 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.213+0000 7fce357d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 0x7fce30106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.213+0000 7fce357d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 0x7fce30106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43630/0 (socket says 172.21.15.84:43630) 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce357d1700 1 -- 172.21.15.84:0/2070381811 learned_addr learned my addr 172.21.15.84:0/2070381811 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce34fd0700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce300f77d0 0x7fce301073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce357d1700 1 -- 172.21.15.84:0/2070381811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce300f77d0 msgr2=0x7fce301073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce357d1700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce300f77d0 0x7fce301073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce357d1700 1 -- 172.21.15.84:0/2070381811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c005040 con 0x7fce300f6530 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce357d1700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 0x7fce30106ec0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fce2c004e30 tx=0x7fce2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce25ffb700 1 -- 172.21.15.84:0/2070381811 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce2c018070 con 0x7fce300f6530 2024-02-15T18:34:06.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce301083e0 con 0x7fce300f6530 2024-02-15T18:34:06.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce25ffb700 1 -- 172.21.15.84:0/2070381811 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fce2c007ba0 con 0x7fce300f6530 2024-02-15T18:34:06.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce25ffb700 1 -- 172.21.15.84:0/2070381811 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce2c01c3c0 con 0x7fce300f6530 2024-02-15T18:34:06.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.214+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce30108940 con 0x7fce300f6530 2024-02-15T18:34:06.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.215+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce30059100 con 0x7fce300f6530 2024-02-15T18:34:06.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.216+0000 7fce25ffb700 1 -- 172.21.15.84:0/2070381811 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fce2c01d420 con 0x7fce300f6530 2024-02-15T18:34:06.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.216+0000 7fce25ffb700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fce1c060f70 0x7fce1c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:06.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.216+0000 7fce25ffb700 1 -- 172.21.15.84:0/2070381811 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fce2c07dda0 con 0x7fce300f6530 2024-02-15T18:34:06.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.216+0000 7fce34fd0700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fce1c060f70 0x7fce1c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:06.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.216+0000 7fce34fd0700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fce1c060f70 0x7fce1c063430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fce20004c40 tx=0x7fce2000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:06.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.220+0000 7fce25ffb700 1 -- 172.21.15.84:0/2070381811 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fce2c051c20 con 0x7fce300f6530 2024-02-15T18:34:06.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.407+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce300fee70 con 0x7fce1c060f70 2024-02-15T18:34:06.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.408+0000 7fce25ffb700 1 -- 172.21.15.84:0/2070381811 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fce300fee70 con 0x7fce1c060f70 2024-02-15T18:34:06.400 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:34:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:34:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "in_progress": true, 2024-02-15T18:34:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:34:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "services_complete": [ 2024-02-15T18:34:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "mon", 2024-02-15T18:34:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "mds", 2024-02-15T18:34:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr", 2024-02-15T18:34:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-02-15T18:34:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "osd" 2024-02-15T18:34:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-02-15T18:34:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "progress": "16/21 daemons upgraded", 2024-02-15T18:34:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "Currently upgrading grafana daemons", 2024-02-15T18:34:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "is_paused": false 2024-02-15T18:34:06.401 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:34:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.410+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fce1c060f70 msgr2=0x7fce1c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.410+0000 7fce367d3700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fce1c060f70 0x7fce1c063430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fce20004c40 tx=0x7fce2000b040).stop 2024-02-15T18:34:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.410+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 msgr2=0x7fce30106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.410+0000 7fce367d3700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 0x7fce30106ec0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fce2c004e30 tx=0x7fce2c009b30).stop 2024-02-15T18:34:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.411+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 shutdown_connections 2024-02-15T18:34:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.411+0000 7fce367d3700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fce1c060f70 0x7fce1c063430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:06.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.411+0000 7fce367d3700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce300f6530 0x7fce30106ec0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.411+0000 7fce367d3700 1 --2- 172.21.15.84:0/2070381811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce300f77d0 0x7fce301073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.411+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 >> 172.21.15.84:0/2070381811 conn(0x7fce300f1c90 msgr2=0x7fce300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.411+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 shutdown_connections 2024-02-15T18:34:06.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:06.411+0000 7fce367d3700 1 -- 172.21.15.84:0/2070381811 wait complete. 2024-02-15T18:34:06.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:04.785390+0000 mgr.smithi084.hjmnez (mgr.14596) 387 : cluster [DBG] pgmap v262: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:06.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:04.838202+0000 mgr.smithi084.hjmnez (mgr.14596) 388 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:06.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:05.134305+0000 mgr.smithi084.hjmnez (mgr.14596) 389 : audit [DBG] from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:06.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:05.424919+0000 mgr.smithi084.hjmnez (mgr.14596) 390 : audit [DBG] from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:06.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:05.773910+0000 mon.smithi084 (mon.0) 731 : audit [DBG] from='client.? 172.21.15.84:0/1769789191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:06.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:06.106495+0000 mon.smithi084 (mon.0) 732 : audit [DBG] from='client.? 172.21.15.84:0/913067382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:34:06.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:04.785390+0000 mgr.smithi084.hjmnez (mgr.14596) 387 : cluster [DBG] pgmap v262: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:06.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:04.838202+0000 mgr.smithi084.hjmnez (mgr.14596) 388 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:06.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:05.134305+0000 mgr.smithi084.hjmnez (mgr.14596) 389 : audit [DBG] from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:06.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:05.424919+0000 mgr.smithi084.hjmnez (mgr.14596) 390 : audit [DBG] from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:06.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:05.773910+0000 mon.smithi084 (mon.0) 731 : audit [DBG] from='client.? 172.21.15.84:0/1769789191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:06.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:06.106495+0000 mon.smithi084 (mon.0) 732 : audit [DBG] from='client.? 172.21.15.84:0/913067382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:34:07.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:06.409123+0000 mgr.smithi084.hjmnez (mgr.14596) 391 : audit [DBG] from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:07.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:06.409123+0000 mgr.smithi084.hjmnez (mgr.14596) 391 : audit [DBG] from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:08.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:06.785767+0000 mgr.smithi084.hjmnez (mgr.14596) 392 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:08.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:08.272983+0000 mon.smithi084 (mon.0) 733 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:08.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:08.273738+0000 mon.smithi084 (mon.0) 734 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:08.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:06.785767+0000 mgr.smithi084.hjmnez (mgr.14596) 392 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:08.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:08.272983+0000 mon.smithi084 (mon.0) 733 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:08.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:08.273738+0000 mon.smithi084 (mon.0) 734 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:10.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:08.786284+0000 mgr.smithi084.hjmnez (mgr.14596) 393 : cluster [DBG] pgmap v264: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:10.888 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:08.786284+0000 mgr.smithi084.hjmnez (mgr.14596) 393 : cluster [DBG] pgmap v264: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:12.505 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:10.786773+0000 mgr.smithi084.hjmnez (mgr.14596) 394 : cluster [DBG] pgmap v265: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:12.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:10.786773+0000 mgr.smithi084.hjmnez (mgr.14596) 394 : cluster [DBG] pgmap v265: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:14.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:12.787152+0000 mgr.smithi084.hjmnez (mgr.14596) 395 : cluster [DBG] pgmap v266: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:14.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:12.906965+0000 mon.smithi084 (mon.0) 735 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.195456+0000 mon.smithi084 (mon.0) 736 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:14.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.196077+0000 mon.smithi084 (mon.0) 737 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:14.256 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:34:13.196553+0000 mgr.smithi084.hjmnez (mgr.14596) 396 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.200388+0000 mon.smithi084 (mon.0) 738 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.206223+0000 mon.smithi084 (mon.0) 739 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.206558+0000 mgr.smithi084.hjmnez (mgr.14596) 397 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.207285+0000 mon.smithi084 (mon.0) 740 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi084.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.207533+0000 mgr.smithi084.hjmnez (mgr.14596) 398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi084.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.211432+0000 mon.smithi084 (mon.0) 741 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.214884+0000 mon.smithi084 (mon.0) 742 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.218015+0000 mon.smithi084 (mon.0) 743 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.219391+0000 mon.smithi084 (mon.0) 744 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.220820+0000 mon.smithi084 (mon.0) 745 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.222765+0000 mon.smithi084 (mon.0) 746 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.224398+0000 mon.smithi084 (mon.0) 747 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.225236+0000 mon.smithi084 (mon.0) 748 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.226047+0000 mon.smithi084 (mon.0) 749 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.257 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.226842+0000 mon.smithi084 (mon.0) 750 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.227727+0000 mon.smithi084 (mon.0) 751 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.228736+0000 mon.smithi084 (mon.0) 752 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.230359+0000 mon.smithi084 (mon.0) 753 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.231616+0000 mon.smithi084 (mon.0) 754 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.232808+0000 mon.smithi084 (mon.0) 755 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.233922+0000 mon.smithi084 (mon.0) 756 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:34:13.234456+0000 mgr.smithi084.hjmnez (mgr.14596) 399 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.238204+0000 mon.smithi084 (mon.0) 757 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.238806+0000 mon.smithi084 (mon.0) 758 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.241717+0000 mon.smithi084 (mon.0) 759 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.242293+0000 mon.smithi084 (mon.0) 760 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.246795+0000 mon.smithi084 (mon.0) 761 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.247345+0000 mon.smithi084 (mon.0) 762 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T18:34:14.258 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.250288+0000 mon.smithi084 (mon.0) 763 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.250815+0000 mon.smithi084 (mon.0) 764 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.255459+0000 mon.smithi084 (mon.0) 765 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.256008+0000 mon.smithi084 (mon.0) 766 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.258926+0000 mon.smithi084 (mon.0) 767 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.259442+0000 mon.smithi084 (mon.0) 768 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.264176+0000 mon.smithi084 (mon.0) 769 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.264706+0000 mon.smithi084 (mon.0) 770 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.267694+0000 mon.smithi084 (mon.0) 771 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.268239+0000 mon.smithi084 (mon.0) 772 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.268678+0000 mon.smithi084 (mon.0) 773 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.272850+0000 mon.smithi084 (mon.0) 774 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.273363+0000 mon.smithi084 (mon.0) 775 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.276383+0000 mon.smithi084 (mon.0) 776 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T18:34:14.259 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.276897+0000 mon.smithi084 (mon.0) 777 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.277325+0000 mon.smithi084 (mon.0) 778 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.277738+0000 mon.smithi084 (mon.0) 779 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.278147+0000 mon.smithi084 (mon.0) 780 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.278543+0000 mon.smithi084 (mon.0) 781 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.281794+0000 mon.smithi084 (mon.0) 782 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:34:13.282249+0000 mgr.smithi084.hjmnez (mgr.14596) 400 : cephadm [INF] Upgrade: Complete! 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.282585+0000 mon.smithi084 (mon.0) 783 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.284898+0000 mon.smithi084 (mon.0) 784 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.285205+0000 mon.smithi084 (mon.0) 785 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.286370+0000 mon.smithi084 (mon.0) 786 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.286878+0000 mon.smithi084 (mon.0) 787 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:34:13.287362+0000 mgr.smithi084.hjmnez (mgr.14596) 401 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:14.260 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.290345+0000 mon.smithi084 (mon.0) 788 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.294813+0000 mon.smithi084 (mon.0) 789 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:14.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.295949+0000 mon.smithi084 (mon.0) 790 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:14.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.296488+0000 mon.smithi084 (mon.0) 791 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:14.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:34:13.296924+0000 mgr.smithi084.hjmnez (mgr.14596) 402 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:14.261 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:13.299951+0000 mon.smithi084 (mon.0) 792 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:12.787152+0000 mgr.smithi084.hjmnez (mgr.14596) 395 : cluster [DBG] pgmap v266: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:12.906965+0000 mon.smithi084 (mon.0) 735 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.195456+0000 mon.smithi084 (mon.0) 736 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.196077+0000 mon.smithi084 (mon.0) 737 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:34:13.196553+0000 mgr.smithi084.hjmnez (mgr.14596) 396 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.200388+0000 mon.smithi084 (mon.0) 738 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.206223+0000 mon.smithi084 (mon.0) 739 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.206558+0000 mgr.smithi084.hjmnez (mgr.14596) 397 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.207285+0000 mon.smithi084 (mon.0) 740 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi084.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.207533+0000 mgr.smithi084.hjmnez (mgr.14596) 398 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi084.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T18:34:14.389 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.211432+0000 mon.smithi084 (mon.0) 741 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.214884+0000 mon.smithi084 (mon.0) 742 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.218015+0000 mon.smithi084 (mon.0) 743 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.219391+0000 mon.smithi084 (mon.0) 744 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.220820+0000 mon.smithi084 (mon.0) 745 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.222765+0000 mon.smithi084 (mon.0) 746 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.224398+0000 mon.smithi084 (mon.0) 747 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.225236+0000 mon.smithi084 (mon.0) 748 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.226047+0000 mon.smithi084 (mon.0) 749 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.226842+0000 mon.smithi084 (mon.0) 750 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.227727+0000 mon.smithi084 (mon.0) 751 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.228736+0000 mon.smithi084 (mon.0) 752 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.230359+0000 mon.smithi084 (mon.0) 753 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.231616+0000 mon.smithi084 (mon.0) 754 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.390 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.232808+0000 mon.smithi084 (mon.0) 755 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.233922+0000 mon.smithi084 (mon.0) 756 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:34:13.234456+0000 mgr.smithi084.hjmnez (mgr.14596) 399 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.238204+0000 mon.smithi084 (mon.0) 757 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.238806+0000 mon.smithi084 (mon.0) 758 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.241717+0000 mon.smithi084 (mon.0) 759 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.242293+0000 mon.smithi084 (mon.0) 760 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.246795+0000 mon.smithi084 (mon.0) 761 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.247345+0000 mon.smithi084 (mon.0) 762 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.250288+0000 mon.smithi084 (mon.0) 763 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.250815+0000 mon.smithi084 (mon.0) 764 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.255459+0000 mon.smithi084 (mon.0) 765 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.256008+0000 mon.smithi084 (mon.0) 766 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.258926+0000 mon.smithi084 (mon.0) 767 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.259442+0000 mon.smithi084 (mon.0) 768 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T18:34:14.391 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.264176+0000 mon.smithi084 (mon.0) 769 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.264706+0000 mon.smithi084 (mon.0) 770 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.267694+0000 mon.smithi084 (mon.0) 771 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.268239+0000 mon.smithi084 (mon.0) 772 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.268678+0000 mon.smithi084 (mon.0) 773 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.272850+0000 mon.smithi084 (mon.0) 774 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.273363+0000 mon.smithi084 (mon.0) 775 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.276383+0000 mon.smithi084 (mon.0) 776 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.276897+0000 mon.smithi084 (mon.0) 777 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.277325+0000 mon.smithi084 (mon.0) 778 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.277738+0000 mon.smithi084 (mon.0) 779 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.278147+0000 mon.smithi084 (mon.0) 780 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.278543+0000 mon.smithi084 (mon.0) 781 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.281794+0000 mon.smithi084 (mon.0) 782 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:34:13.282249+0000 mgr.smithi084.hjmnez (mgr.14596) 400 : cephadm [INF] Upgrade: Complete! 2024-02-15T18:34:14.392 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.282585+0000 mon.smithi084 (mon.0) 783 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.284898+0000 mon.smithi084 (mon.0) 784 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.285205+0000 mon.smithi084 (mon.0) 785 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.286370+0000 mon.smithi084 (mon.0) 786 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.286878+0000 mon.smithi084 (mon.0) 787 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:34:13.287362+0000 mgr.smithi084.hjmnez (mgr.14596) 401 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.290345+0000 mon.smithi084 (mon.0) 788 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.294813+0000 mon.smithi084 (mon.0) 789 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.295949+0000 mon.smithi084 (mon.0) 790 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.296488+0000 mon.smithi084 (mon.0) 791 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:34:13.296924+0000 mgr.smithi084.hjmnez (mgr.14596) 402 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:14.393 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:13.299951+0000 mon.smithi084 (mon.0) 792 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:16.388 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:14.787577+0000 mgr.smithi084.hjmnez (mgr.14596) 403 : cluster [DBG] pgmap v267: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:16.505 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:14.787577+0000 mgr.smithi084.hjmnez (mgr.14596) 403 : cluster [DBG] pgmap v267: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:18.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:16.787987+0000 mgr.smithi084.hjmnez (mgr.14596) 404 : cluster [DBG] pgmap v268: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:18.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:17.277449+0000 mon.smithi084 (mon.0) 793 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:18.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:16.787987+0000 mgr.smithi084.hjmnez (mgr.14596) 404 : cluster [DBG] pgmap v268: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:18.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:17.277449+0000 mon.smithi084 (mon.0) 793 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:34:20.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:18.788577+0000 mgr.smithi084.hjmnez (mgr.14596) 405 : cluster [DBG] pgmap v269: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:20.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:18.788577+0000 mgr.smithi084.hjmnez (mgr.14596) 405 : cluster [DBG] pgmap v269: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:22.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:20.789048+0000 mgr.smithi084.hjmnez (mgr.14596) 406 : cluster [DBG] pgmap v270: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:22.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:20.789048+0000 mgr.smithi084.hjmnez (mgr.14596) 406 : cluster [DBG] pgmap v270: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:24.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:22.789535+0000 mgr.smithi084.hjmnez (mgr.14596) 407 : cluster [DBG] pgmap v271: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:24.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:22.789535+0000 mgr.smithi084.hjmnez (mgr.14596) 407 : cluster [DBG] pgmap v271: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:26.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:24.790152+0000 mgr.smithi084.hjmnez (mgr.14596) 408 : cluster [DBG] pgmap v272: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:26.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:24.790152+0000 mgr.smithi084.hjmnez (mgr.14596) 408 : cluster [DBG] pgmap v272: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:28.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:26.790653+0000 mgr.smithi084.hjmnez (mgr.14596) 409 : cluster [DBG] pgmap v273: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:28.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:26.790653+0000 mgr.smithi084.hjmnez (mgr.14596) 409 : cluster [DBG] pgmap v273: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:30.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:28.791180+0000 mgr.smithi084.hjmnez (mgr.14596) 410 : cluster [DBG] pgmap v274: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:30.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:28.791180+0000 mgr.smithi084.hjmnez (mgr.14596) 410 : cluster [DBG] pgmap v274: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:32.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:30.791732+0000 mgr.smithi084.hjmnez (mgr.14596) 411 : cluster [DBG] pgmap v275: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:32.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:30.791732+0000 mgr.smithi084.hjmnez (mgr.14596) 411 : cluster [DBG] pgmap v275: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:34.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:32.792248+0000 mgr.smithi084.hjmnez (mgr.14596) 412 : cluster [DBG] pgmap v276: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:34.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:32.792248+0000 mgr.smithi084.hjmnez (mgr.14596) 412 : cluster [DBG] pgmap v276: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.522+0000 7fed30f4f700 1 -- 172.21.15.84:0/1941474964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 msgr2=0x7fed2c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.522+0000 7fed30f4f700 1 --2- 172.21.15.84:0/1941474964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 0x7fed2c0f7de0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fed1c004660 tx=0x7fed1c009b30).stop 2024-02-15T18:34:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.522+0000 7fed30f4f700 1 -- 172.21.15.84:0/1941474964 shutdown_connections 2024-02-15T18:34:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.522+0000 7fed30f4f700 1 --2- 172.21.15.84:0/1941474964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 0x7fed2c0f7de0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.522+0000 7fed30f4f700 1 --2- 172.21.15.84:0/1941474964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0f66e0 0x7fed2c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:34:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.522+0000 7fed30f4f700 1 -- 172.21.15.84:0/1941474964 >> 172.21.15.84:0/1941474964 conn(0x7fed2c0f1e40 msgr2=0x7fed2c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.522+0000 7fed30f4f700 1 -- 172.21.15.84:0/1941474964 shutdown_connections 2024-02-15T18:34:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.522+0000 7fed30f4f700 1 -- 172.21.15.84:0/1941474964 wait complete. 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.522+0000 7fed30f4f700 1 Processor -- start 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed30f4f700 1 -- start start 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed30f4f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0f66e0 0x7fed2c107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed30f4f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 0x7fed2c107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed30f4f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c107ba0 con 0x7fed2c0f7980 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed30f4f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c108450 con 0x7fed2c0f66e0 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed29d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 0x7fed2c107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed29d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 0x7fed2c107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46124/0 (socket says 172.21.15.84:46124) 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed29d9b700 1 -- 172.21.15.84:0/944881149 learned_addr learned my addr 172.21.15.84:0/944881149 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed2a59c700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0f66e0 0x7fed2c107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed29d9b700 1 -- 172.21.15.84:0/944881149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0f66e0 msgr2=0x7fed2c107070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed29d9b700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0f66e0 0x7fed2c107070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed29d9b700 1 -- 172.21.15.84:0/944881149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c005040 con 0x7fed2c0f7980 2024-02-15T18:34:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed2a59c700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0f66e0 0x7fed2c107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:34:36.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed29d9b700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 0x7fed2c107560 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fed1c009f50 tx=0x7fed1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:36.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.523+0000 7fed22ffd700 1 -- 172.21.15.84:0/944881149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1c018070 con 0x7fed2c0f7980 2024-02-15T18:34:36.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.524+0000 7fed22ffd700 1 -- 172.21.15.84:0/944881149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fed1c007d70 con 0x7fed2c0f7980 2024-02-15T18:34:36.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.524+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c1086d0 con 0x7fed2c0f7980 2024-02-15T18:34:36.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.524+0000 7fed22ffd700 1 -- 172.21.15.84:0/944881149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1c01c620 con 0x7fed2c0f7980 2024-02-15T18:34:36.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.524+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c108bb0 con 0x7fed2c0f7980 2024-02-15T18:34:36.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.524+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c0f5ad0 con 0x7fed2c0f7980 2024-02-15T18:34:36.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.525+0000 7fed22ffd700 1 -- 172.21.15.84:0/944881149 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fed1c01c8e0 con 0x7fed2c0f7980 2024-02-15T18:34:36.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.525+0000 7fed22ffd700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed18060f20 0x7fed180633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:36.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.525+0000 7fed22ffd700 1 -- 172.21.15.84:0/944881149 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fed1c07e110 con 0x7fed2c0f7980 2024-02-15T18:34:36.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.526+0000 7fed2a59c700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed18060f20 0x7fed180633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:36.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.526+0000 7fed2a59c700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed18060f20 0x7fed180633e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fed2c0f77e0 tx=0x7fed14008040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:36.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.530+0000 7fed22ffd700 1 -- 172.21.15.84:0/944881149 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fed1c051f20 con 0x7fed2c0f7980 2024-02-15T18:34:36.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:34.792872+0000 mgr.smithi084.hjmnez (mgr.14596) 413 : cluster [DBG] pgmap v277: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:36.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.708+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed2c0ff0c0 con 0x7fed18060f20 2024-02-15T18:34:36.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.710+0000 7fed22ffd700 1 -- 172.21.15.84:0/944881149 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fed2c0ff0c0 con 0x7fed18060f20 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.711+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed18060f20 msgr2=0x7fed180633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.711+0000 7fed30f4f700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed18060f20 0x7fed180633e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fed2c0f77e0 tx=0x7fed14008040).stop 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.711+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 msgr2=0x7fed2c107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.711+0000 7fed30f4f700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 0x7fed2c107560 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fed1c009f50 tx=0x7fed1c009b30).stop 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.711+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 shutdown_connections 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.711+0000 7fed30f4f700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed18060f20 0x7fed180633e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.711+0000 7fed30f4f700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0f66e0 0x7fed2c107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.711+0000 7fed30f4f700 1 --2- 172.21.15.84:0/944881149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed2c0f7980 0x7fed2c107560 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.711+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 >> 172.21.15.84:0/944881149 conn(0x7fed2c0f1e40 msgr2=0x7fed2c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:36.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.712+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 shutdown_connections 2024-02-15T18:34:36.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:36.712+0000 7fed30f4f700 1 -- 172.21.15.84:0/944881149 wait complete. 2024-02-15T18:34:36.729 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:34.792872+0000 mgr.smithi084.hjmnez (mgr.14596) 413 : cluster [DBG] pgmap v277: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:37.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:37 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:36.710404+0000 mgr.smithi084.hjmnez (mgr.14596) 414 : audit [DBG] from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:37.756 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:37 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:36.710404+0000 mgr.smithi084.hjmnez (mgr.14596) 414 : audit [DBG] from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:38.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:36.793273+0000 mgr.smithi084.hjmnez (mgr.14596) 415 : cluster [DBG] pgmap v278: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:38.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:36.793273+0000 mgr.smithi084.hjmnez (mgr.14596) 415 : cluster [DBG] pgmap v278: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:39.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-15T18:34:40.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:38.793946+0000 mgr.smithi084.hjmnez (mgr.14596) 416 : cluster [DBG] pgmap v279: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:40.696 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:38.793946+0000 mgr.smithi084.hjmnez (mgr.14596) 416 : cluster [DBG] pgmap v279: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:41.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.516+0000 7f099ff16700 1 -- 172.21.15.84:0/118044609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 msgr2=0x7f09980f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:41.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.516+0000 7f099ff16700 1 --2- 172.21.15.84:0/118044609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 0x7f09980f4dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f0994004660 tx=0x7f0994009b30).stop 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 -- 172.21.15.84:0/118044609 shutdown_connections 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 --2- 172.21.15.84:0/118044609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09980f5340 0x7f09980f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 --2- 172.21.15.84:0/118044609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 0x7f09980f4dc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 -- 172.21.15.84:0/118044609 >> 172.21.15.84:0/118044609 conn(0x7f09980f04c0 msgr2=0x7f09980f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 -- 172.21.15.84:0/118044609 shutdown_connections 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 -- 172.21.15.84:0/118044609 wait complete. 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 Processor -- start 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 -- start start 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 0x7f09980f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09980f5340 0x7f09980f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980f5fc0 con 0x7f09980f49a0 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.517+0000 7f099ff16700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980f6100 con 0x7f09980f5340 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099dcb2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 0x7f09980f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:41.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099dcb2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 0x7f09980f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46134/0 (socket says 172.21.15.84:46134) 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099dcb2700 1 -- 172.21.15.84:0/131482691 learned_addr learned my addr 172.21.15.84:0/131482691 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099dcb2700 1 -- 172.21.15.84:0/131482691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09980f5340 msgr2=0x7f09980f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099d4b1700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09980f5340 0x7f09980f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099dcb2700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09980f5340 0x7f09980f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099dcb2700 1 -- 172.21.15.84:0/131482691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994005040 con 0x7f09980f49a0 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099d4b1700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09980f5340 0x7f09980f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099dcb2700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 0x7f09980f7550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f0994009830 tx=0x7f0994009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f098e7fc700 1 -- 172.21.15.84:0/131482691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0994018070 con 0x7f09980f49a0 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f098e7fc700 1 -- 172.21.15.84:0/131482691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f0994007c70 con 0x7f09980f49a0 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f098e7fc700 1 -- 172.21.15.84:0/131482691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f099401c620 con 0x7f09980f49a0 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09980f6380 con 0x7f09980f49a0 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.518+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099810f180 con 0x7f09980f49a0 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.519+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09980f4150 con 0x7f09980f49a0 2024-02-15T18:34:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.519+0000 7f098e7fc700 1 -- 172.21.15.84:0/131482691 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f099401c780 con 0x7f09980f49a0 2024-02-15T18:34:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.520+0000 7f098e7fc700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0984060f20 0x7f09840633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.520+0000 7f098e7fc700 1 -- 172.21.15.84:0/131482691 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f099407dee0 con 0x7f09980f49a0 2024-02-15T18:34:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.520+0000 7f099d4b1700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0984060f20 0x7f09840633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.520+0000 7f099d4b1700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0984060f20 0x7f09840633e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f09980f5780 tx=0x7f0988008040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.524+0000 7f098e7fc700 1 -- 172.21.15.84:0/131482691 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f099404e340 con 0x7f09980f49a0 2024-02-15T18:34:41.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.701+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f09980ff150 con 0x7f0984060f20 2024-02-15T18:34:41.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.710+0000 7f098e7fc700 1 -- 172.21.15.84:0/131482691 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f09980ff150 con 0x7f0984060f20 2024-02-15T18:34:41.702 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:34:41.702 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (61s) 28s ago 15m 15.7M - 0.23.0 ba2b418f427c cdab4270924c 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (6m) 28s ago 15m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (6m) 87s ago 14m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (34s) 28s ago 15m 26.8M - 8.3.5 dad864ee21e9 1ff11ede16cb 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (2m) 28s ago 10m 69.9M - 16.2.14-521-g0e714d9a 1fbc92c859dc 0914a2eeed6f 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (2m) 28s ago 10m 15.8M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4b79925c0d8d 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (2m) 87s ago 10m 14.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc 2ad04fa2e1ba 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (105s) 87s ago 10m 11.3M - 16.2.14-521-g0e714d9a 1fbc92c859dc 6fdbbf145708 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (8m) 28s ago 17m 442M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (7m) 87s ago 14m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (7m) 28s ago 17m 64.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (6m) 87s ago 14m 52.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (96s) 28s ago 15m 11.9M - 1.3.1 1dbe0e931976 a8a538bf2063 2024-02-15T18:34:41.703 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (90s) 87s ago 14m 3640k - 1.3.1 1dbe0e931976 de489c7951e2 2024-02-15T18:34:41.704 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (5m) 28s ago 14m 209M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:34:41.704 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (5m) 28s ago 13m 254M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:34:41.704 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (4m) 28s ago 13m 188M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:34:41.704 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (4m) 87s ago 12m 279M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc b8c15d05905a 2024-02-15T18:34:41.704 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (3m) 87s ago 12m 249M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 612e5da9dba4 2024-02-15T18:34:41.704 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (3m) 87s ago 12m 195M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 93c01314b455 2024-02-15T18:34:41.704 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (78s) 28s ago 14m 59.9M - 2.33.4 514e6a882f6e 7c289bf81b4d 2024-02-15T18:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0984060f20 msgr2=0x7f09840633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0984060f20 0x7f09840633e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f09980f5780 tx=0x7f0988008040).stop 2024-02-15T18:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 msgr2=0x7f09980f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 0x7f09980f7550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f0994009830 tx=0x7f0994009b30).stop 2024-02-15T18:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 shutdown_connections 2024-02-15T18:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0984060f20 0x7f09840633e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09980f49a0 0x7f09980f7550 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 --2- 172.21.15.84:0/131482691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09980f5340 0x7f09980f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 >> 172.21.15.84:0/131482691 conn(0x7f09980f04c0 msgr2=0x7f09980fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 shutdown_connections 2024-02-15T18:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:41.712+0000 7f099ff16700 1 -- 172.21.15.84:0/131482691 wait complete. 2024-02-15T18:34:42.343 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:40.794500+0000 mgr.smithi084.hjmnez (mgr.14596) 417 : cluster [DBG] pgmap v280: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:42.343 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:41.703605+0000 mgr.smithi084.hjmnez (mgr.14596) 418 : audit [DBG] from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:42.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-15T18:34:42.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:40.794500+0000 mgr.smithi084.hjmnez (mgr.14596) 417 : cluster [DBG] pgmap v280: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:42.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:41.703605+0000 mgr.smithi084.hjmnez (mgr.14596) 418 : audit [DBG] from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 -- 172.21.15.84:0/257711445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f6870 msgr2=0x7f76b40f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 --2- 172.21.15.84:0/257711445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f6870 0x7f76b40f6cd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f76a4004660 tx=0x7f76a4009b30).stop 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 -- 172.21.15.84:0/257711445 shutdown_connections 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 --2- 172.21.15.84:0/257711445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f6870 0x7f76b40f6cd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 --2- 172.21.15.84:0/257711445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40f55d0 0x7f76b40f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 -- 172.21.15.84:0/257711445 >> 172.21.15.84:0/257711445 conn(0x7f76b40f0d70 msgr2=0x7f76b40f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 -- 172.21.15.84:0/257711445 shutdown_connections 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 -- 172.21.15.84:0/257711445 wait complete. 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 Processor -- start 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 -- start start 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f55d0 0x7f76b4109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:44.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40f6870 0x7f76b410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40604c0 con 0x7f76b40f55d0 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76bc497700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b4060600 con 0x7f76b40f6870 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.486+0000 7f76ba233700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f55d0 0x7f76b4109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76ba233700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f55d0 0x7f76b4109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55186/0 (socket says 172.21.15.84:55186) 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76ba233700 1 -- 172.21.15.84:0/1452072846 learned_addr learned my addr 172.21.15.84:0/1452072846 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76ba233700 1 -- 172.21.15.84:0/1452072846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40f6870 msgr2=0x7f76b410c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76b9a32700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40f6870 0x7f76b410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76ba233700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40f6870 0x7f76b410c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76ba233700 1 -- 172.21.15.84:0/1452072846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4005040 con 0x7f76b40f55d0 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76b9a32700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40f6870 0x7f76b410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76ba233700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f55d0 0x7f76b4109cd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f76b0002700 tx=0x7f76b0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76aaffd700 1 -- 172.21.15.84:0/1452072846 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b0009320 con 0x7f76b40f55d0 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b410c780 con 0x7f76b40f55d0 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76aaffd700 1 -- 172.21.15.84:0/1452072846 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f76b000f040 con 0x7f76b40f55d0 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76aaffd700 1 -- 172.21.15.84:0/1452072846 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b00149d0 con 0x7f76b40f55d0 2024-02-15T18:34:44.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.487+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b410cd40 con 0x7f76b40f55d0 2024-02-15T18:34:44.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.488+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b4045ad0 con 0x7f76b40f55d0 2024-02-15T18:34:44.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.488+0000 7f76aaffd700 1 -- 172.21.15.84:0/1452072846 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f76b00077b0 con 0x7f76b40f55d0 2024-02-15T18:34:44.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.489+0000 7f76aaffd700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f76a0060f20 0x7f76a00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:44.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.489+0000 7f76aaffd700 1 -- 172.21.15.84:0/1452072846 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f76b007c410 con 0x7f76b40f55d0 2024-02-15T18:34:44.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.489+0000 7f76b9a32700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f76a0060f20 0x7f76a00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:44.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.489+0000 7f76b9a32700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f76a0060f20 0x7f76a00633e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f76a4005010 tx=0x7f76a4009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:44.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.493+0000 7f76aaffd700 1 -- 172.21.15.84:0/1452072846 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f76b004c7f0 con 0x7f76b40f55d0 2024-02-15T18:34:44.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:42.795195+0000 mgr.smithi084.hjmnez (mgr.14596) 419 : cluster [DBG] pgmap v281: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.729+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76b40fe020 con 0x7f76b40f55d0 2024-02-15T18:34:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.729+0000 7f76aaffd700 1 -- 172.21.15.84:0/1452072846 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f76b004fe10 con 0x7f76b40f55d0 2024-02-15T18:34:44.721 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:34:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:34:44.723 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:34:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.731+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f76a0060f20 msgr2=0x7f76a00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.731+0000 7f76bc497700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f76a0060f20 0x7f76a00633e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f76a4005010 tx=0x7f76a4009b30).stop 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.731+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f55d0 msgr2=0x7f76b4109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.731+0000 7f76bc497700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f55d0 0x7f76b4109cd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f76b0002700 tx=0x7f76b0009d80).stop 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.731+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 shutdown_connections 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.731+0000 7f76bc497700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f76a0060f20 0x7f76a00633e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.731+0000 7f76bc497700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b40f55d0 0x7f76b4109cd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.731+0000 7f76bc497700 1 --2- 172.21.15.84:0/1452072846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40f6870 0x7f76b410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.731+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 >> 172.21.15.84:0/1452072846 conn(0x7f76b40f0d70 msgr2=0x7f76b40fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.732+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 shutdown_connections 2024-02-15T18:34:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:34:44.732+0000 7f76bc497700 1 -- 172.21.15.84:0/1452072846 wait complete. 2024-02-15T18:34:44.747 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:42.795195+0000 mgr.smithi084.hjmnez (mgr.14596) 419 : cluster [DBG] pgmap v281: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:45.455 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:45 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:34:44.731249+0000 mon.smithi084 (mon.0) 794 : audit [DBG] from='client.? 172.21.15.84:0/1452072846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:45.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-15T18:34:45.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:34:44.731249+0000 mon.smithi084 (mon.0) 794 : audit [DBG] from='client.? 172.21.15.84:0/1452072846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:46.505 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:44.795557+0000 mgr.smithi084.hjmnez (mgr.14596) 420 : cluster [DBG] pgmap v282: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:46.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:44.795557+0000 mgr.smithi084.hjmnez (mgr.14596) 420 : cluster [DBG] pgmap v282: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:47.546 INFO:teuthology.orchestra.run.smithi084.stdout:wait for servicemap items w/ changing names to refresh 2024-02-15T18:34:48.283 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'sleep 60' 2024-02-15T18:34:48.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:46.796003+0000 mgr.smithi084.hjmnez (mgr.14596) 421 : cluster [DBG] pgmap v283: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:48.649 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:46.796003+0000 mgr.smithi084.hjmnez (mgr.14596) 421 : cluster [DBG] pgmap v283: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:50.505 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:48.796451+0000 mgr.smithi084.hjmnez (mgr.14596) 422 : cluster [DBG] pgmap v284: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:50.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:48.796451+0000 mgr.smithi084.hjmnez (mgr.14596) 422 : cluster [DBG] pgmap v284: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:52.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:50.797168+0000 mgr.smithi084.hjmnez (mgr.14596) 423 : cluster [DBG] pgmap v285: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:52.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:50.797168+0000 mgr.smithi084.hjmnez (mgr.14596) 423 : cluster [DBG] pgmap v285: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:54.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:52.797844+0000 mgr.smithi084.hjmnez (mgr.14596) 424 : cluster [DBG] pgmap v286: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:54.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:52.797844+0000 mgr.smithi084.hjmnez (mgr.14596) 424 : cluster [DBG] pgmap v286: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:56.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:54.798547+0000 mgr.smithi084.hjmnez (mgr.14596) 425 : cluster [DBG] pgmap v287: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:56.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:54.798547+0000 mgr.smithi084.hjmnez (mgr.14596) 425 : cluster [DBG] pgmap v287: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:58.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:34:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:56.799157+0000 mgr.smithi084.hjmnez (mgr.14596) 426 : cluster [DBG] pgmap v288: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:58.649 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:34:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:56.799157+0000 mgr.smithi084.hjmnez (mgr.14596) 426 : cluster [DBG] pgmap v288: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:00.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:34:58.799864+0000 mgr.smithi084.hjmnez (mgr.14596) 427 : cluster [DBG] pgmap v289: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:00.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:34:58.799864+0000 mgr.smithi084.hjmnez (mgr.14596) 427 : cluster [DBG] pgmap v289: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:02.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:00.800419+0000 mgr.smithi084.hjmnez (mgr.14596) 428 : cluster [DBG] pgmap v290: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:02.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:00.800419+0000 mgr.smithi084.hjmnez (mgr.14596) 428 : cluster [DBG] pgmap v290: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:04.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:02.800978+0000 mgr.smithi084.hjmnez (mgr.14596) 429 : cluster [DBG] pgmap v291: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:04.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:02.800978+0000 mgr.smithi084.hjmnez (mgr.14596) 429 : cluster [DBG] pgmap v291: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:06.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:04.801401+0000 mgr.smithi084.hjmnez (mgr.14596) 430 : cluster [DBG] pgmap v292: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:06.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:04.801401+0000 mgr.smithi084.hjmnez (mgr.14596) 430 : cluster [DBG] pgmap v292: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:08.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:06.801852+0000 mgr.smithi084.hjmnez (mgr.14596) 431 : cluster [DBG] pgmap v293: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:08.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:06.801852+0000 mgr.smithi084.hjmnez (mgr.14596) 431 : cluster [DBG] pgmap v293: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:10.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:08.802359+0000 mgr.smithi084.hjmnez (mgr.14596) 432 : cluster [DBG] pgmap v294: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:10.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:08.802359+0000 mgr.smithi084.hjmnez (mgr.14596) 432 : cluster [DBG] pgmap v294: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:12.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:10.802837+0000 mgr.smithi084.hjmnez (mgr.14596) 433 : cluster [DBG] pgmap v295: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:12.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:10.802837+0000 mgr.smithi084.hjmnez (mgr.14596) 433 : cluster [DBG] pgmap v295: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:13.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:35:13.304348+0000 mon.smithi084 (mon.0) 795 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:13.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:35:13.304348+0000 mon.smithi084 (mon.0) 795 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:14.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:12.803423+0000 mgr.smithi084.hjmnez (mgr.14596) 434 : cluster [DBG] pgmap v296: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:14.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:35:13.611982+0000 mon.smithi084 (mon.0) 796 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:14.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:35:13.612676+0000 mon.smithi084 (mon.0) 797 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:14.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:35:13.613262+0000 mgr.smithi084.hjmnez (mgr.14596) 435 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:14.638 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:35:13.616541+0000 mon.smithi084 (mon.0) 798 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:35:14.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:12.803423+0000 mgr.smithi084.hjmnez (mgr.14596) 434 : cluster [DBG] pgmap v296: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:14.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:35:13.611982+0000 mon.smithi084 (mon.0) 796 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:14.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:35:13.612676+0000 mon.smithi084 (mon.0) 797 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:14.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:35:13.613262+0000 mgr.smithi084.hjmnez (mgr.14596) 435 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:14.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:35:13.616541+0000 mon.smithi084 (mon.0) 798 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:35:16.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:14.804085+0000 mgr.smithi084.hjmnez (mgr.14596) 436 : cluster [DBG] pgmap v297: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:16.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:14.804085+0000 mgr.smithi084.hjmnez (mgr.14596) 436 : cluster [DBG] pgmap v297: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:18.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:18 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:16.804625+0000 mgr.smithi084.hjmnez (mgr.14596) 437 : cluster [DBG] pgmap v298: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:18.649 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:16.804625+0000 mgr.smithi084.hjmnez (mgr.14596) 437 : cluster [DBG] pgmap v298: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:20.637 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:20 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:18.805212+0000 mgr.smithi084.hjmnez (mgr.14596) 438 : cluster [DBG] pgmap v299: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:20.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:20 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:18.805212+0000 mgr.smithi084.hjmnez (mgr.14596) 438 : cluster [DBG] pgmap v299: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:22.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:22 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:20.805864+0000 mgr.smithi084.hjmnez (mgr.14596) 439 : cluster [DBG] pgmap v300: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:22.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:22 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:20.805864+0000 mgr.smithi084.hjmnez (mgr.14596) 439 : cluster [DBG] pgmap v300: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:24.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:24 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:22.806368+0000 mgr.smithi084.hjmnez (mgr.14596) 440 : cluster [DBG] pgmap v301: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:24.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:24 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:22.806368+0000 mgr.smithi084.hjmnez (mgr.14596) 440 : cluster [DBG] pgmap v301: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:26.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:24.806922+0000 mgr.smithi084.hjmnez (mgr.14596) 441 : cluster [DBG] pgmap v302: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:26.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:26 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:24.806922+0000 mgr.smithi084.hjmnez (mgr.14596) 441 : cluster [DBG] pgmap v302: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:28.650 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:28 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:26.807397+0000 mgr.smithi084.hjmnez (mgr.14596) 442 : cluster [DBG] pgmap v303: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:28.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:28 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:26.807397+0000 mgr.smithi084.hjmnez (mgr.14596) 442 : cluster [DBG] pgmap v303: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:30.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:30 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:28.808046+0000 mgr.smithi084.hjmnez (mgr.14596) 443 : cluster [DBG] pgmap v304: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:30.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:30 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:28.808046+0000 mgr.smithi084.hjmnez (mgr.14596) 443 : cluster [DBG] pgmap v304: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:32.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:32 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:30.808521+0000 mgr.smithi084.hjmnez (mgr.14596) 444 : cluster [DBG] pgmap v305: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:32.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:32 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:30.808521+0000 mgr.smithi084.hjmnez (mgr.14596) 444 : cluster [DBG] pgmap v305: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:34.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:32.809029+0000 mgr.smithi084.hjmnez (mgr.14596) 445 : cluster [DBG] pgmap v306: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:34.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:34 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:32.809029+0000 mgr.smithi084.hjmnez (mgr.14596) 445 : cluster [DBG] pgmap v306: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:36.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:36 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:34.809700+0000 mgr.smithi084.hjmnez (mgr.14596) 446 : cluster [DBG] pgmap v307: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:36.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:36 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:34.809700+0000 mgr.smithi084.hjmnez (mgr.14596) 446 : cluster [DBG] pgmap v307: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:38.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:38 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:36.810049+0000 mgr.smithi084.hjmnez (mgr.14596) 447 : cluster [DBG] pgmap v308: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:38.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:38 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:36.810049+0000 mgr.smithi084.hjmnez (mgr.14596) 447 : cluster [DBG] pgmap v308: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:40.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:40 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:38.810497+0000 mgr.smithi084.hjmnez (mgr.14596) 448 : cluster [DBG] pgmap v309: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:40.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:40 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:38.810497+0000 mgr.smithi084.hjmnez (mgr.14596) 448 : cluster [DBG] pgmap v309: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:42.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:42 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:40.810979+0000 mgr.smithi084.hjmnez (mgr.14596) 449 : cluster [DBG] pgmap v310: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:42.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:42 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:40.810979+0000 mgr.smithi084.hjmnez (mgr.14596) 449 : cluster [DBG] pgmap v310: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:44.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:44 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:42.811396+0000 mgr.smithi084.hjmnez (mgr.14596) 450 : cluster [DBG] pgmap v311: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:44.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:42.811396+0000 mgr.smithi084.hjmnez (mgr.14596) 450 : cluster [DBG] pgmap v311: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:46.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:46 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:44.811951+0000 mgr.smithi084.hjmnez (mgr.14596) 451 : cluster [DBG] pgmap v312: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:46.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:44.811951+0000 mgr.smithi084.hjmnez (mgr.14596) 451 : cluster [DBG] pgmap v312: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:48.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:48 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:46.812408+0000 mgr.smithi084.hjmnez (mgr.14596) 452 : cluster [DBG] pgmap v313: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:48.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:46.812408+0000 mgr.smithi084.hjmnez (mgr.14596) 452 : cluster [DBG] pgmap v313: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:50.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:50 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:48.812981+0000 mgr.smithi084.hjmnez (mgr.14596) 453 : cluster [DBG] pgmap v314: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:50.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:48.812981+0000 mgr.smithi084.hjmnez (mgr.14596) 453 : cluster [DBG] pgmap v314: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:51.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-15T18:35:52.590 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:52 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:50.813469+0000 mgr.smithi084.hjmnez (mgr.14596) 454 : cluster [DBG] pgmap v315: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:52.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:50.813469+0000 mgr.smithi084.hjmnez (mgr.14596) 454 : cluster [DBG] pgmap v315: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.063+0000 7f8c3227a700 1 -- 172.21.15.84:0/3001934083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 msgr2=0x7f8c2c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.063+0000 7f8c3227a700 1 --2- 172.21.15.84:0/3001934083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 0x7f8c2c0f59e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f8c20004660 tx=0x7f8c20009b30).stop 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.063+0000 7f8c3227a700 1 -- 172.21.15.84:0/3001934083 shutdown_connections 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.063+0000 7f8c3227a700 1 --2- 172.21.15.84:0/3001934083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c0f6860 0x7f8c2c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.063+0000 7f8c3227a700 1 --2- 172.21.15.84:0/3001934083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 0x7f8c2c0f59e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.063+0000 7f8c3227a700 1 -- 172.21.15.84:0/3001934083 >> 172.21.15.84:0/3001934083 conn(0x7f8c2c0f0d40 msgr2=0x7f8c2c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.063+0000 7f8c3227a700 1 -- 172.21.15.84:0/3001934083 shutdown_connections 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.063+0000 7f8c3227a700 1 -- 172.21.15.84:0/3001934083 wait complete. 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.063+0000 7f8c3227a700 1 Processor -- start 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c3227a700 1 -- start start 2024-02-15T18:35:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c3227a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 0x7f8c2c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c3227a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c0f6860 0x7f8c2c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c3227a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0f8100 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c3227a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0f8240 con 0x7f8c2c0f6860 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c2bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 0x7f8c2c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c2bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 0x7f8c2c0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60506/0 (socket says 172.21.15.84:60506) 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c2bfff700 1 -- 172.21.15.84:0/3659804701 learned_addr learned my addr 172.21.15.84:0/3659804701 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c2bfff700 1 -- 172.21.15.84:0/3659804701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c0f6860 msgr2=0x7f8c2c0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c2bfff700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c0f6860 0x7f8c2c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c2bfff700 1 -- 172.21.15.84:0/3659804701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20005040 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c2bfff700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 0x7f8c2c0f9720 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f8c20004e30 tx=0x7f8c20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c28ff9700 1 -- 172.21.15.84:0/3659804701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c20018070 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c28ff9700 1 -- 172.21.15.84:0/3659804701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f8c20007ba0 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c28ff9700 1 -- 172.21.15.84:0/3659804701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c2001c620 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.064+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c0f84c0 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.065+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0f8a20 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.065+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c045ad0 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.066+0000 7f8c28ff9700 1 -- 172.21.15.84:0/3659804701 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f8c2001d9a0 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.066+0000 7f8c28ff9700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8c14060f70 0x7f8c14063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:53.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.066+0000 7f8c28ff9700 1 -- 172.21.15.84:0/3659804701 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f8c2007df30 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.066+0000 7f8c2b7fe700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8c14060f70 0x7f8c14063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:53.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.067+0000 7f8c2b7fe700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8c14060f70 0x7f8c14063430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f8c1c004bd0 tx=0x7f8c1c009b10).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:53.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.070+0000 7f8c28ff9700 1 -- 172.21.15.84:0/3659804701 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8c2004e2f0 con 0x7f8c2c0f55c0 2024-02-15T18:35:53.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.243+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 --> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c2c0faca0 con 0x7f8c14060f70 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.252+0000 7f8c28ff9700 1 -- 172.21.15.84:0/3659804701 <== mgr.14596 v2:172.21.15.84:6800/2731357152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8c2c0faca0 con 0x7f8c14060f70 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:alertmanager.smithi084 smithi084 *:9093,9094 running (2m) 100s ago 16m 15.7M - 0.23.0 ba2b418f427c cdab4270924c 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi084 smithi084 running (7m) 100s ago 16m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc 0aeca14b6e72 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:crash.smithi133 smithi133 running (7m) 2m ago 15m 6643k - 16.2.14-521-g0e714d9a 1fbc92c859dc e8311153e715 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:grafana.smithi084 smithi084 *:3000 running (105s) 100s ago 16m 26.8M - 8.3.5 dad864ee21e9 1ff11ede16cb 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.cuytny smithi084 running (3m) 100s ago 11m 69.9M - 16.2.14-521-g0e714d9a 1fbc92c859dc 0914a2eeed6f 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi084.spootv smithi084 running (3m) 100s ago 11m 15.8M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4b79925c0d8d 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.mkpnnx smithi133 running (3m) 2m ago 11m 14.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc 2ad04fa2e1ba 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:mds.cephfs.smithi133.ubglfw smithi133 running (2m) 2m ago 11m 11.3M - 16.2.14-521-g0e714d9a 1fbc92c859dc 6fdbbf145708 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi084.hjmnez smithi084 *:8443,9283 running (9m) 100s ago 18m 442M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a287d69c40c 2024-02-15T18:35:53.243 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.smithi133.nxzroj smithi133 *:8443,9283 running (8m) 2m ago 15m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc a7a016c946dc 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi084 smithi084 running (8m) 100s ago 18m 64.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc d26a1a913455 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:mon.smithi133 smithi133 running (7m) 2m ago 15m 52.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc bafcf53882a8 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi084 smithi084 *:9100 running (2m) 100s ago 16m 11.9M - 1.3.1 1dbe0e931976 a8a538bf2063 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:node-exporter.smithi133 smithi133 *:9100 running (2m) 2m ago 15m 3640k - 1.3.1 1dbe0e931976 de489c7951e2 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (7m) 100s ago 15m 209M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 645894b31afa 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi084 running (6m) 100s ago 14m 254M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 2d8c766ef013 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi084 running (6m) 100s ago 14m 188M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 29a8be1b61c7 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi133 running (5m) 2m ago 14m 279M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc b8c15d05905a 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi133 running (5m) 2m ago 13m 249M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 612e5da9dba4 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi133 running (4m) 2m ago 13m 195M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 93c01314b455 2024-02-15T18:35:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:prometheus.smithi084 smithi084 *:9095 running (2m) 100s ago 16m 59.9M - 2.33.4 514e6a882f6e 7c289bf81b4d 2024-02-15T18:35:53.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8c14060f70 msgr2=0x7f8c14063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:53.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8c14060f70 0x7f8c14063430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f8c1c004bd0 tx=0x7f8c1c009b10).stop 2024-02-15T18:35:53.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 msgr2=0x7f8c2c0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:53.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 0x7f8c2c0f9720 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f8c20004e30 tx=0x7f8c20009b30).stop 2024-02-15T18:35:53.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 shutdown_connections 2024-02-15T18:35:53.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f8c14060f70 0x7f8c14063430 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:53.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2c0f55c0 0x7f8c2c0f9720 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:53.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 --2- 172.21.15.84:0/3659804701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c0f6860 0x7f8c2c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:35:53.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 >> 172.21.15.84:0/3659804701 conn(0x7f8c2c0f0d40 msgr2=0x7f8c2c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:53.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 shutdown_connections 2024-02-15T18:35:53.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:53.254+0000 7f8c3227a700 1 -- 172.21.15.84:0/3659804701 wait complete. 2024-02-15T18:35:53.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-15T18:35:54.711 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:52.814104+0000 mgr.smithi084.hjmnez (mgr.14596) 455 : cluster [DBG] pgmap v316: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:54.711 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:54 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:35:53.244474+0000 mgr.smithi084.hjmnez (mgr.14596) 456 : audit [DBG] from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:54.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:52.814104+0000 mgr.smithi084.hjmnez (mgr.14596) 455 : cluster [DBG] pgmap v316: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:54.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:35:53.244474+0000 mgr.smithi084.hjmnez (mgr.14596) 456 : audit [DBG] from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.003+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2371690744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 msgr2=0x7fa7e00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.003+0000 7fa7e58bc700 1 --2- 172.21.15.84:0/2371690744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 0x7fa7e00f7c30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fa7cc004660 tx=0x7fa7cc009b30).stop 2024-02-15T18:35:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.003+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2371690744 shutdown_connections 2024-02-15T18:35:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.003+0000 7fa7e58bc700 1 --2- 172.21.15.84:0/2371690744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 0x7fa7e00f7c30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.003+0000 7fa7e58bc700 1 --2- 172.21.15.84:0/2371690744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e00f6530 0x7fa7e00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.003+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2371690744 >> 172.21.15.84:0/2371690744 conn(0x7fa7e00f1c90 msgr2=0x7fa7e00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2371690744 shutdown_connections 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2371690744 wait complete. 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7e58bc700 1 Processor -- start 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7e58bc700 1 -- start start 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7e58bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e00f6530 0x7fa7e006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7e58bc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 0x7fa7e0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7e58bc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e006a380 con 0x7fa7e00f77d0 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7e58bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e006a4c0 con 0x7fa7e00f6530 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 0x7fa7e0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7dffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 0x7fa7e0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36986/0 (socket says 172.21.15.84:36986) 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.004+0000 7fa7dffff700 1 -- 172.21.15.84:0/2648848359 learned_addr learned my addr 172.21.15.84:0/2648848359 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7e48ba700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e00f6530 0x7fa7e006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7dffff700 1 -- 172.21.15.84:0/2648848359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e00f6530 msgr2=0x7fa7e006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7dffff700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e00f6530 0x7fa7e006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7dffff700 1 -- 172.21.15.84:0/2648848359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc005040 con 0x7fa7e00f77d0 2024-02-15T18:35:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7dffff700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 0x7fa7e0069e20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fa7cc009f50 tx=0x7fa7cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7dd7fa700 1 -- 172.21.15.84:0/2648848359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7cc018070 con 0x7fa7e00f77d0 2024-02-15T18:35:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e006a740 con 0x7fa7e00f77d0 2024-02-15T18:35:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7dd7fa700 1 -- 172.21.15.84:0/2648848359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fa7cc007ba0 con 0x7fa7e00f77d0 2024-02-15T18:35:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7dd7fa700 1 -- 172.21.15.84:0/2648848359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7cc01c420 con 0x7fa7e00f77d0 2024-02-15T18:35:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.005+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e006aca0 con 0x7fa7e00f77d0 2024-02-15T18:35:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.006+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e0045ad0 con 0x7fa7e00f77d0 2024-02-15T18:35:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.006+0000 7fa7dd7fa700 1 -- 172.21.15.84:0/2648848359 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa7cc01d420 con 0x7fa7e00f77d0 2024-02-15T18:35:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.007+0000 7fa7dd7fa700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa7d0060f70 0x7fa7d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.007+0000 7fa7dd7fa700 1 -- 172.21.15.84:0/2648848359 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa7cc07de60 con 0x7fa7e00f77d0 2024-02-15T18:35:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.007+0000 7fa7e48ba700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa7d0060f70 0x7fa7d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.007+0000 7fa7e48ba700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa7d0060f70 0x7fa7d0063430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fa7e006b730 tx=0x7fa7d400b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.011+0000 7fa7dd7fa700 1 -- 172.21.15.84:0/2648848359 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa7cc04e240 con 0x7fa7e00f77d0 2024-02-15T18:35:56.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.243+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa7e0027a00 con 0x7fa7e00f77d0 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.243+0000 7fa7dd7fa700 1 -- 172.21.15.84:0/2648848359 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fa7cc051860 con 0x7fa7e00f77d0 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": { 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": { 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": { 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:35:56.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:35:56.235 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-02-15T18:35:56.235 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:35:56.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-02-15T18:35:56.235 INFO:teuthology.orchestra.run.smithi084.stdout: "overall": { 2024-02-15T18:35:56.235 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:35:56.235 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-02-15T18:35:56.235 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa7d0060f70 msgr2=0x7fa7d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa7d0060f70 0x7fa7d0063430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fa7e006b730 tx=0x7fa7d400b040).stop 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 msgr2=0x7fa7e0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 0x7fa7e0069e20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fa7cc009f50 tx=0x7fa7cc009b30).stop 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 shutdown_connections 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa7d0060f70 0x7fa7d0063430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7e00f6530 0x7fa7e006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 --2- 172.21.15.84:0/2648848359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00f77d0 0x7fa7e0069e20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 >> 172.21.15.84:0/2648848359 conn(0x7fa7e00f1c90 msgr2=0x7fa7e00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:56.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 shutdown_connections 2024-02-15T18:35:56.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:56.245+0000 7fa7e58bc700 1 -- 172.21.15.84:0/2648848359 wait complete. 2024-02-15T18:35:56.621 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:54.814763+0000 mgr.smithi084.hjmnez (mgr.14596) 457 : cluster [DBG] pgmap v317: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:56.621 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:56 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:35:56.244089+0000 mon.smithi084 (mon.0) 799 : audit [DBG] from='client.? 172.21.15.84:0/2648848359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:56.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:54.814763+0000 mgr.smithi084.hjmnez (mgr.14596) 457 : cluster [DBG] pgmap v317: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:56.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:35:56.244089+0000 mon.smithi084 (mon.0) 799 : audit [DBG] from='client.? 172.21.15.84:0/2648848359' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:56.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-15T18:35:58.552 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:58 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:56.815186+0000 mgr.smithi084.hjmnez (mgr.14596) 458 : cluster [DBG] pgmap v318: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:58.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.846+0000 7f6517552700 1 -- 172.21.15.84:0/1445575242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 msgr2=0x7f65100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.846+0000 7f6517552700 1 --2- 172.21.15.84:0/1445575242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 0x7f65100f59e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f6500004660 tx=0x7f6500009b30).stop 2024-02-15T18:35:58.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.846+0000 7f6517552700 1 -- 172.21.15.84:0/1445575242 shutdown_connections 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.846+0000 7f6517552700 1 --2- 172.21.15.84:0/1445575242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65100f6860 0x7f65100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.846+0000 7f6517552700 1 --2- 172.21.15.84:0/1445575242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 0x7f65100f59e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.846+0000 7f6517552700 1 -- 172.21.15.84:0/1445575242 >> 172.21.15.84:0/1445575242 conn(0x7f65100f0d40 msgr2=0x7f65100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.846+0000 7f6517552700 1 -- 172.21.15.84:0/1445575242 shutdown_connections 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.846+0000 7f6517552700 1 -- 172.21.15.84:0/1445575242 wait complete. 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6517552700 1 Processor -- start 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6517552700 1 -- start start 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6517552700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 0x7f65100f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6517552700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65100f6860 0x7f65100f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6517552700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65100f89b0 con 0x7f65100f55c0 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6517552700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65100f8af0 con 0x7f65100f6860 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f65152ee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 0x7f65100f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f65152ee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 0x7f65100f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37012/0 (socket says 172.21.15.84:37012) 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f65152ee700 1 -- 172.21.15.84:0/2479255487 learned_addr learned my addr 172.21.15.84:0/2479255487 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:35:58.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6514aed700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65100f6860 0x7f65100f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f65152ee700 1 -- 172.21.15.84:0/2479255487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65100f6860 msgr2=0x7f65100f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f65152ee700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65100f6860 0x7f65100f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f65152ee700 1 -- 172.21.15.84:0/2479255487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500005040 con 0x7f65100f55c0 2024-02-15T18:35:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f65152ee700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 0x7f65100f9f40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f6500013fd0 tx=0x7f6500009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6505ffb700 1 -- 172.21.15.84:0/2479255487 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6500018070 con 0x7f65100f55c0 2024-02-15T18:35:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6505ffb700 1 -- 172.21.15.84:0/2479255487 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f6500007d70 con 0x7f65100f55c0 2024-02-15T18:35:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65100f8d70 con 0x7f65100f55c0 2024-02-15T18:35:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.847+0000 7f6505ffb700 1 -- 172.21.15.84:0/2479255487 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f650001c620 con 0x7f65100f55c0 2024-02-15T18:35:58.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.848+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651010f0e0 con 0x7f65100f55c0 2024-02-15T18:35:58.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.849+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65100f49b0 con 0x7f65100f55c0 2024-02-15T18:35:58.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.849+0000 7f6505ffb700 1 -- 172.21.15.84:0/2479255487 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f650001d420 con 0x7f65100f55c0 2024-02-15T18:35:58.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.850+0000 7f6505ffb700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f64fc060f20 0x7f64fc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.850+0000 7f6505ffb700 1 -- 172.21.15.84:0/2479255487 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f650007dfe0 con 0x7f65100f55c0 2024-02-15T18:35:58.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.850+0000 7f6514aed700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f64fc060f20 0x7f64fc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.850+0000 7f6514aed700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f64fc060f20 0x7f64fc0633e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f650c00b830 tx=0x7f650c008040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:58.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:58.854+0000 7f6505ffb700 1 -- 172.21.15.84:0/2479255487 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f65000acf60 con 0x7f65100f55c0 2024-02-15T18:35:58.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:56.815186+0000 mgr.smithi084.hjmnez (mgr.14596) 458 : cluster [DBG] pgmap v318: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:59.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.083+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f651010f850 con 0x7f65100f55c0 2024-02-15T18:35:59.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.084+0000 7f6505ffb700 1 -- 172.21.15.84:0/2479255487 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f650004e410 con 0x7f65100f55c0 2024-02-15T18:35:59.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.085+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f64fc060f20 msgr2=0x7f64fc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:59.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.085+0000 7f6517552700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f64fc060f20 0x7f64fc0633e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f650c00b830 tx=0x7f650c008040).stop 2024-02-15T18:35:59.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.085+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 msgr2=0x7f65100f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:59.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.085+0000 7f6517552700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 0x7f65100f9f40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f6500013fd0 tx=0x7f6500009b30).stop 2024-02-15T18:35:59.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.086+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 shutdown_connections 2024-02-15T18:35:59.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.086+0000 7f6517552700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f64fc060f20 0x7f64fc0633e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:59.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.086+0000 7f6517552700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65100f55c0 0x7f65100f9f40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:59.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.086+0000 7f6517552700 1 --2- 172.21.15.84:0/2479255487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65100f6860 0x7f65100f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:59.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.086+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 >> 172.21.15.84:0/2479255487 conn(0x7f65100f0d40 msgr2=0x7f651005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:59.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.086+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 shutdown_connections 2024-02-15T18:35:59.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:35:59.086+0000 7f6517552700 1 -- 172.21.15.84:0/2479255487 wait complete. 2024-02-15T18:35:59.086 INFO:teuthology.orchestra.run.smithi084.stdout:true 2024-02-15T18:35:59.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:35:59 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:35:59.084669+0000 mon.smithi084 (mon.0) 800 : audit [DBG] from='client.? 172.21.15.84:0/2479255487' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:59.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-15T18:35:59.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:35:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:35:59.084669+0000 mon.smithi084 (mon.0) 800 : audit [DBG] from='client.? 172.21.15.84:0/2479255487' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:00.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:00 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:35:58.815572+0000 mgr.smithi084.hjmnez (mgr.14596) 459 : cluster [DBG] pgmap v319: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:00.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:35:58.815572+0000 mgr.smithi084.hjmnez (mgr.14596) 459 : cluster [DBG] pgmap v319: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 -- 172.21.15.84:0/2243876302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 msgr2=0x7fac980f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 --2- 172.21.15.84:0/2243876302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 0x7fac980f6af0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fac80004660 tx=0x7fac80009b30).stop 2024-02-15T18:36:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 -- 172.21.15.84:0/2243876302 shutdown_connections 2024-02-15T18:36:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 --2- 172.21.15.84:0/2243876302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac980f6fe0 0x7fac980f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:01.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 --2- 172.21.15.84:0/2243876302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 0x7fac980f6af0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 -- 172.21.15.84:0/2243876302 >> 172.21.15.84:0/2243876302 conn(0x7fac980f1ef0 msgr2=0x7fac980f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 -- 172.21.15.84:0/2243876302 shutdown_connections 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 -- 172.21.15.84:0/2243876302 wait complete. 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 Processor -- start 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.787+0000 7fac9d4a1700 1 -- start start 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac9d4a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 0x7fac9806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac9d4a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac980f6fe0 0x7fac98069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac9d4a1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9806a380 con 0x7fac980f66d0 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac9d4a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9806a4c0 con 0x7fac980f6fe0 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac96ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 0x7fac9806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac96ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 0x7fac9806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37042/0 (socket says 172.21.15.84:37042) 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac96ffd700 1 -- 172.21.15.84:0/4019431654 learned_addr learned my addr 172.21.15.84:0/4019431654 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac967fc700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac980f6fe0 0x7fac98069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac96ffd700 1 -- 172.21.15.84:0/4019431654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac980f6fe0 msgr2=0x7fac98069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac96ffd700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac980f6fe0 0x7fac98069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac96ffd700 1 -- 172.21.15.84:0/4019431654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80005040 con 0x7fac980f66d0 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac967fc700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac980f6fe0 0x7fac98069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac96ffd700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 0x7fac9806b9a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fac800043a0 tx=0x7fac8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac8f7fe700 1 -- 172.21.15.84:0/4019431654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac80019070 con 0x7fac980f66d0 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac8f7fe700 1 -- 172.21.15.84:0/4019431654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fac80014420 con 0x7fac980f66d0 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9806a740 con 0x7fac980f66d0 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac8f7fe700 1 -- 172.21.15.84:0/4019431654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac8001d600 con 0x7fac980f66d0 2024-02-15T18:36:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.788+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9806aca0 con 0x7fac980f66d0 2024-02-15T18:36:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.789+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac98045ad0 con 0x7fac980f66d0 2024-02-15T18:36:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.790+0000 7fac8f7fe700 1 -- 172.21.15.84:0/4019431654 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fac80025070 con 0x7fac980f66d0 2024-02-15T18:36:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.790+0000 7fac8f7fe700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fac84060f20 0x7fac840633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.790+0000 7fac8f7fe700 1 -- 172.21.15.84:0/4019431654 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fac8007d0f0 con 0x7fac980f66d0 2024-02-15T18:36:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.790+0000 7fac967fc700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fac84060f20 0x7fac840633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.791+0000 7fac967fc700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fac84060f20 0x7fac840633e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fac88009fd0 tx=0x7fac8800b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:01.794+0000 7fac8f7fe700 1 -- 172.21.15.84:0/4019431654 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fac8004d4d0 con 0x7fac980f66d0 2024-02-15T18:36:02.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.024+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fac980586e0 con 0x7fac980f66d0 2024-02-15T18:36:02.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.025+0000 7fac8f7fe700 1 -- 172.21.15.84:0/4019431654 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fac80023070 con 0x7fac980f66d0 2024-02-15T18:36:02.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.026+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fac84060f20 msgr2=0x7fac840633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:02.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.026+0000 7fac9d4a1700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fac84060f20 0x7fac840633e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fac88009fd0 tx=0x7fac8800b040).stop 2024-02-15T18:36:02.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.026+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 msgr2=0x7fac9806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:02.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.026+0000 7fac9d4a1700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 0x7fac9806b9a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fac800043a0 tx=0x7fac8000b040).stop 2024-02-15T18:36:02.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.027+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 shutdown_connections 2024-02-15T18:36:02.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.027+0000 7fac9d4a1700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fac84060f20 0x7fac840633e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:02.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.027+0000 7fac9d4a1700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac980f66d0 0x7fac9806b9a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:02.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.027+0000 7fac9d4a1700 1 --2- 172.21.15.84:0/4019431654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac980f6fe0 0x7fac98069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:02.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.027+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 >> 172.21.15.84:0/4019431654 conn(0x7fac980f1ef0 msgr2=0x7fac980fb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:02.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.027+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 shutdown_connections 2024-02-15T18:36:02.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:02.027+0000 7fac9d4a1700 1 -- 172.21.15.84:0/4019431654 wait complete. 2024-02-15T18:36:02.027 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)" 2024-02-15T18:36:02.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:36:00.815979+0000 mgr.smithi084.hjmnez (mgr.14596) 460 : cluster [DBG] pgmap v320: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:02.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:02 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:02.025761+0000 mon.smithi084 (mon.0) 801 : audit [DBG] from='client.? 172.21.15.84:0/4019431654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:02.796 DEBUG:teuthology.parallel:result is None 2024-02-15T18:36:02.797 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:36:02.810 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:36:02.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T18:36:02.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:36:00.815979+0000 mgr.smithi084.hjmnez (mgr.14596) 460 : cluster [DBG] pgmap v320: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:02.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:02 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:02.025761+0000 mon.smithi084 (mon.0) 801 : audit [DBG] from='client.? 172.21.15.84:0/4019431654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:04.755 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:04 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:36:02.816552+0000 mgr.smithi084.hjmnez (mgr.14596) 461 : cluster [DBG] pgmap v321: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:04.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.790+0000 7f3d16af3700 1 -- 172.21.15.84:0/565706464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 msgr2=0x7f3d100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:04.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.790+0000 7f3d16af3700 1 --2- 172.21.15.84:0/565706464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 0x7f3d100f59e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f3d04004660 tx=0x7f3d04009b30).stop 2024-02-15T18:36:04.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.790+0000 7f3d16af3700 1 -- 172.21.15.84:0/565706464 shutdown_connections 2024-02-15T18:36:04.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.790+0000 7f3d16af3700 1 --2- 172.21.15.84:0/565706464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d100f6860 0x7f3d100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:04.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.790+0000 7f3d16af3700 1 --2- 172.21.15.84:0/565706464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 0x7f3d100f59e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:04.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.790+0000 7f3d16af3700 1 -- 172.21.15.84:0/565706464 >> 172.21.15.84:0/565706464 conn(0x7f3d100f0d40 msgr2=0x7f3d100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:04.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.790+0000 7f3d16af3700 1 -- 172.21.15.84:0/565706464 shutdown_connections 2024-02-15T18:36:04.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.790+0000 7f3d16af3700 1 -- 172.21.15.84:0/565706464 wait complete. 2024-02-15T18:36:04.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d16af3700 1 Processor -- start 2024-02-15T18:36:04.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d16af3700 1 -- start start 2024-02-15T18:36:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d16af3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 0x7f3d10109d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d16af3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d100f6860 0x7f3d1010c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d16af3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100603c0 con 0x7f3d100f55c0 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d16af3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10060500 con 0x7f3d100f6860 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d1488f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 0x7f3d10109d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d1488f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 0x7f3d10109d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49650/0 (socket says 172.21.15.84:49650) 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d1488f700 1 -- 172.21.15.84:0/950218019 learned_addr learned my addr 172.21.15.84:0/950218019 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d0ffff700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d100f6860 0x7f3d1010c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d1488f700 1 -- 172.21.15.84:0/950218019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d100f6860 msgr2=0x7f3d1010c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d1488f700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d100f6860 0x7f3d1010c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.791+0000 7f3d1488f700 1 -- 172.21.15.84:0/950218019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04005040 con 0x7f3d100f55c0 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.792+0000 7f3d1488f700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 0x7f3d10109d20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f3d04013fd0 tx=0x7f3d04009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.792+0000 7f3d0d7fa700 1 -- 172.21.15.84:0/950218019 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d04018070 con 0x7f3d100f55c0 2024-02-15T18:36:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.792+0000 7f3d0d7fa700 1 -- 172.21.15.84:0/950218019 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f3d04007d70 con 0x7f3d100f55c0 2024-02-15T18:36:04.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.792+0000 7f3d0d7fa700 1 -- 172.21.15.84:0/950218019 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d0401c620 con 0x7f3d100f55c0 2024-02-15T18:36:04.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.792+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1010c770 con 0x7f3d100f55c0 2024-02-15T18:36:04.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.792+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1010cca0 con 0x7f3d100f55c0 2024-02-15T18:36:04.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.793+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d100f49b0 con 0x7f3d100f55c0 2024-02-15T18:36:04.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.793+0000 7f3d0d7fa700 1 -- 172.21.15.84:0/950218019 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f3d0401d420 con 0x7f3d100f55c0 2024-02-15T18:36:04.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.793+0000 7f3d0d7fa700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3d00060f20 0x7f3d000633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:04.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.794+0000 7f3d0d7fa700 1 -- 172.21.15.84:0/950218019 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3d0407e010 con 0x7f3d100f55c0 2024-02-15T18:36:04.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.794+0000 7f3d0ffff700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3d00060f20 0x7f3d000633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:04.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.794+0000 7f3d0ffff700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3d00060f20 0x7f3d000633e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f3cfc007fd0 tx=0x7f3cfc009040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:04.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:04.798+0000 7f3d0d7fa700 1 -- 172.21.15.84:0/950218019 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3d0404e4d0 con 0x7f3d100f55c0 2024-02-15T18:36:04.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:04 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:36:02.816552+0000 mgr.smithi084.hjmnez (mgr.14596) 461 : cluster [DBG] pgmap v321: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:04.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.005+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3d100fdf60 con 0x7f3d100f55c0 2024-02-15T18:36:04.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.005+0000 7f3d0d7fa700 1 -- 172.21.15.84:0/950218019 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1778 (secure 0 0 0) 0x7f3d04051af0 con 0x7f3d100f55c0 2024-02-15T18:36:04.996 INFO:teuthology.orchestra.run.smithi084.stdout:e38 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 38 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:flags 12 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-02-15T18:24:05.029669+0000 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-02-15T18:33:00.537828+0000 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 60 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-02-15T18:36:04.997 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 82 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 2 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=34338,1=34342} 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-02-15T18:36:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 1 2024-02-15T18:36:04.999 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.cuytny{0:34338} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.84:6826/1471876270,v1:172.21.15.84:6827/1471876270] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:36:04.999 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi084.spootv{1:34342} state up:active seq 10 join_fscid=1 addr [v2:172.21.15.84:6828/2925871822,v1:172.21.15.84:6829/2925871822] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:36:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:04.999 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-02-15T18:36:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:04.999 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.mkpnnx{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.133:6824/553393719,v1:172.21.15.133:6825/553393719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:36:04.999 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.cephfs.smithi133.ubglfw{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.133:6826/2979200029,v1:172.21.15.133:6827/2979200029] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3d00060f20 msgr2=0x7f3d000633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3d00060f20 0x7f3d000633e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f3cfc007fd0 tx=0x7f3cfc009040).stop 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 msgr2=0x7f3d10109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 0x7f3d10109d20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f3d04013fd0 tx=0x7f3d04009b30).stop 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 shutdown_connections 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3d00060f20 0x7f3d000633e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d100f55c0 0x7f3d10109d20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 --2- 172.21.15.84:0/950218019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d100f6860 0x7f3d1010c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 >> 172.21.15.84:0/950218019 conn(0x7f3d100f0d40 msgr2=0x7f3d100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:05.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 shutdown_connections 2024-02-15T18:36:05.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.007+0000 7f3d16af3700 1 -- 172.21.15.84:0/950218019 wait complete. 2024-02-15T18:36:05.001 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2024-02-15T18:36:05.582 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:05 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:05.006474+0000 mon.smithi084 (mon.0) 802 : audit [DBG] from='client.? 172.21.15.84:0/950218019' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:36:05.600 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-15T18:36:05.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T18:36:05.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.743+0000 7f312ef92700 1 -- 172.21.15.84:0/392547422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f64d0 msgr2=0x7f31280f68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:05.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.743+0000 7f312ef92700 1 --2- 172.21.15.84:0/392547422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f64d0 0x7f31280f68f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f311c004660 tx=0x7f311c009b30).stop 2024-02-15T18:36:05.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.743+0000 7f312ef92700 1 -- 172.21.15.84:0/392547422 shutdown_connections 2024-02-15T18:36:05.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.743+0000 7f312ef92700 1 --2- 172.21.15.84:0/392547422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280f7770 0x7f31280f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:05.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.743+0000 7f312ef92700 1 --2- 172.21.15.84:0/392547422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f64d0 0x7f31280f68f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:05.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.743+0000 7f312ef92700 1 -- 172.21.15.84:0/392547422 >> 172.21.15.84:0/392547422 conn(0x7f31280f1c30 msgr2=0x7f31280f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:05.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.743+0000 7f312ef92700 1 -- 172.21.15.84:0/392547422 shutdown_connections 2024-02-15T18:36:05.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.743+0000 7f312ef92700 1 -- 172.21.15.84:0/392547422 wait complete. 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.744+0000 7f312ef92700 1 Processor -- start 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.744+0000 7f312ef92700 1 -- start start 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.744+0000 7f312ef92700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280f64d0 0x7f312806b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.744+0000 7f312ef92700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f7770 0x7f3128069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.744+0000 7f312ef92700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312806bd70 con 0x7f31280f7770 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.744+0000 7f312ef92700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312806a310 con 0x7f31280f64d0 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f3127fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f7770 0x7f3128069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f3127fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f7770 0x7f3128069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49660/0 (socket says 172.21.15.84:49660) 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f3127fff700 1 -- 172.21.15.84:0/3792303720 learned_addr learned my addr 172.21.15.84:0/3792303720 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f312cd2e700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280f64d0 0x7f312806b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f3127fff700 1 -- 172.21.15.84:0/3792303720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280f64d0 msgr2=0x7f312806b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f3127fff700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280f64d0 0x7f312806b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:05.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f3127fff700 1 -- 172.21.15.84:0/3792303720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c005040 con 0x7f31280f7770 2024-02-15T18:36:05.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f3127fff700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f7770 0x7f3128069e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f31140026d0 tx=0x7f3114009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:05.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f31257fa700 1 -- 172.21.15.84:0/3792303720 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31140079c0 con 0x7f31280f7770 2024-02-15T18:36:05.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312806a590 con 0x7f31280f7770 2024-02-15T18:36:05.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f31257fa700 1 -- 172.21.15.84:0/3792303720 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f311400f040 con 0x7f31280f7770 2024-02-15T18:36:05.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f31257fa700 1 -- 172.21.15.84:0/3792303720 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31140149f0 con 0x7f31280f7770 2024-02-15T18:36:05.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.745+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312806ab50 con 0x7f31280f7770 2024-02-15T18:36:05.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.746+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3128027a00 con 0x7f31280f7770 2024-02-15T18:36:05.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.746+0000 7f31257fa700 1 -- 172.21.15.84:0/3792303720 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f3114007b20 con 0x7f31280f7770 2024-02-15T18:36:05.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.747+0000 7f31257fa700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3118060fe0 0x7f31180634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:05.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.747+0000 7f31257fa700 1 -- 172.21.15.84:0/3792303720 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f311407c180 con 0x7f31280f7770 2024-02-15T18:36:05.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.747+0000 7f312cd2e700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3118060fe0 0x7f31180634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:05.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.747+0000 7f312cd2e700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3118060fe0 0x7f31180634a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f311c004630 tx=0x7f311c009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:05.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.751+0000 7f31257fa700 1 -- 172.21.15.84:0/3792303720 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f311404ff90 con 0x7f31280f7770 2024-02-15T18:36:05.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:05 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:05.006474+0000 mon.smithi084 (mon.0) 802 : audit [DBG] from='client.? 172.21.15.84:0/950218019' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:36:05.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.918+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31280586e0 con 0x7f31280f7770 2024-02-15T18:36:05.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.919+0000 7f31257fa700 1 -- 172.21.15.84:0/3792303720 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+15034 (secure 0 0 0) 0x7f311404fb80 con 0x7f31280f7770 2024-02-15T18:36:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:05.910 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":82,"fsid":"631a4cdc-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:17:26.592201+0000","modified":"2024-02-15T18:32:49.875598+0000","last_up_change":"2024-02-15T18:31:28.505134+0000","last_in_change":"2024-02-15T18:22:21.440220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:21:49.806275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T18:24:03.651276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T18:24:04.264343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9ce13286-2da9-4b1e-9121-b14ba88e414c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":4044199563},{"type":"v1","addr":"172.21.15.84:6803","nonce":4044199563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4044199563},{"type":"v1","addr":"172.21.15.84:6805","nonce":4044199563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4044199563},{"type":"v1","addr":"172.21.15.84:6809","nonce":4044199563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":4044199563},{"type":"v1","addr":"172.21.15.84:6807","nonce":4044199563}]},"public_addr":"172.21.15.84:6803/4044199563","cluster_addr":"172.21.15.84:6805/4044199563","heartbeat_back_addr":"172.21.15.84:6809/4044199563","heartbeat_front_addr":"172.21.15.84:6807/4044199563","state":["exists","up"]},{"osd":1,"uuid":"d20fe52a-86d7-421f-ab80-219ad7724f4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1708624404},{"type":"v1","addr":"172.21.15.84:6811","nonce":1708624404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1708624404},{"type":"v1","addr":"172.21.15.84:6813","nonce":1708624404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1708624404},{"type":"v1","addr":"172.21.15.84:6817","nonce":1708624404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1708624404},{"type":"v1","addr":"172.21.15.84:6815","nonce":1708624404}]},"public_addr":"172.21.15.84:6811/1708624404","cluster_addr":"172.21.15.84:6813/1708624404","heartbeat_back_addr":"172.21.15.84:6817/1708624404","heartbeat_front_addr":"172.21.15.84:6815/1708624404","state":["exists","up"]},{"osd":2,"uuid":"b905a1ac-93fe-419d-ab8e-4b3a3e08d448","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3720028012},{"type":"v1","addr":"172.21.15.84:6819","nonce":3720028012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3720028012},{"type":"v1","addr":"172.21.15.84:6821","nonce":3720028012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3720028012},{"type":"v1","addr":"172.21.15.84:6825","nonce":3720028012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3720028012},{"type":"v1","addr":"172.21.15.84:6823","nonce":3720028012}]},"public_addr":"172.21.15.84:6819/3720028012","cluster_addr":"172.21.15.84:6821/3720028012","heartbeat_back_addr":"172.21.15.84:6825/3720028012","heartbeat_front_addr":"172.21.15.84:6823/3720028012","state":["exists","up"]},{"osd":3,"uuid":"ece64a41-54ad-420b-aa77-6d226942a19b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":927364561},{"type":"v1","addr":"172.21.15.133:6801","nonce":927364561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":927364561},{"type":"v1","addr":"172.21.15.133:6803","nonce":927364561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":927364561},{"type":"v1","addr":"172.21.15.133:6807","nonce":927364561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":927364561},{"type":"v1","addr":"172.21.15.133:6805","nonce":927364561}]},"public_addr":"172.21.15.133:6801/927364561","cluster_addr":"172.21.15.133:6803/927364561","heartbeat_back_addr":"172.21.15.133:6807/927364561","heartbeat_front_addr":"172.21.15.133:6805/927364561","state":["exists","up"]},{"osd":4,"uuid":"0d4e40d2-10d1-43ca-b1d3-00d2fe2bcb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":33,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2903661734},{"type":"v1","addr":"172.21.15.133:6809","nonce":2903661734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2903661734},{"type":"v1","addr":"172.21.15.133:6811","nonce":2903661734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2903661734},{"type":"v1","addr":"172.21.15.133:6815","nonce":2903661734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2903661734},{"type":"v1","addr":"172.21.15.133:6813","nonce":2903661734}]},"public_addr":"172.21.15.133:6809/2903661734","cluster_addr":"172.21.15.133:6811/2903661734","heartbeat_back_addr":"172.21.15.133:6815/2903661734","heartbeat_front_addr":"172.21.15.133:6813/2903661734","state":["exists","up"]},{"osd":5,"uuid":"0af0ca6d-3df7-42a9-9cbf-f41a4132671c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1311917098},{"type":"v1","addr":"172.21.15.133:6817","nonce":1311917098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1311917098},{"type":"v1","addr":"172.21.15.133:6819","nonce":1311917098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1311917098},{"type":"v1","addr":"172.21.15.133:6823","nonce":1311917098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1311917098},{"type":"v1","addr":"172.21.15.133:6821","nonce":1311917098}]},"public_addr":"172.21.15.133:6817/1311917098","cluster_addr":"172.21.15.133:6819/1311917098","heartbeat_back_addr":"172.21.15.133:6823/1311917098","heartbeat_front_addr":"172.21.15.133:6821/1311917098","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:20:44.780626+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:10.929070+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:34.608389+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:21:54.376377+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:15.726240+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:22:37.273413+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6826/560284334":"2024-02-16T18:32:49.875569+0000","172.21.15.133:6825/652243261":"2024-02-16T18:32:34.902653+0000","172.21.15.133:6824/652243261":"2024-02-16T18:32:34.902653+0000","172.21.15.84:0/1978539770":"2024-02-16T18:25:57.372443+0000","172.21.15.84:6801/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6800/610282832":"2024-02-16T18:25:57.372443+0000","172.21.15.84:0/448246306":"2024-02-16T18:17:49.286762+0000","172.21.15.84:0/1857689459":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6801/610282832":"2024-02-16T18:25:57.372443+0000","172.21.15.84:6800/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/2943993061":"2024-02-16T18:17:49.286762+0000","172.21.15.133:0/3680615462":"2024-02-16T18:26:35.679992+0000","172.21.15.133:0/956739593":"2024-02-16T18:26:35.679992+0000","172.21.15.133:6829/3317013208":"2024-02-16T18:26:35.679992+0000","172.21.15.84:0/3021498954":"2024-02-16T18:18:13.388623+0000","172.21.15.84:0/3385940609":"2024-02-16T18:18:28.289514+0000","172.21.15.84:6801/519542921":"2024-02-16T18:18:13.388623+0000","172.21.15.133:6827/560284334":"2024-02-16T18:32:49.875569+0000","172.21.15.84:6800/1354831571":"2024-02-16T18:18:28.289514+0000","172.21.15.133:6828/3317013208":"2024-02-16T18:26:35.679992+0000","172.21.15.133:0/1953129866":"2024-02-16T18:26:35.679992+0000","172.21.15.84:6800/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.84:6801/2060840097":"2024-02-16T18:17:49.286762+0000","172.21.15.133:0/669016794":"2024-02-16T18:26:35.679992+0000","172.21.15.84:0/1894268612":"2024-02-16T18:25:57.372443+0000","172.21.15.84:0/855149255":"2024-02-16T18:18:13.388623+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3118060fe0 msgr2=0x7f31180634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3118060fe0 0x7f31180634a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f311c004630 tx=0x7f311c009b30).stop 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f7770 msgr2=0x7f3128069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f7770 0x7f3128069e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f31140026d0 tx=0x7f3114009de0).stop 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 shutdown_connections 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f3118060fe0 0x7f31180634a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280f64d0 0x7f312806b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 --2- 172.21.15.84:0/3792303720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31280f7770 0x7f3128069e20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 >> 172.21.15.84:0/3792303720 conn(0x7f31280f1c30 msgr2=0x7f31280fb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 shutdown_connections 2024-02-15T18:36:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:05.921+0000 7f312ef92700 1 -- 172.21.15.84:0/3792303720 wait complete. 2024-02-15T18:36:05.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-15T18:21:49.806275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T18:24:03.651276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T18:24:04.264343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-15T18:36:05.924 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-15T18:36:06.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.052+0000 7f21156cd700 1 -- 172.21.15.84:0/2343004760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 msgr2=0x7f21100f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.052+0000 7f21156cd700 1 --2- 172.21.15.84:0/2343004760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 0x7f21100f6a90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2104004660 tx=0x7f2104009b30).stop 2024-02-15T18:36:06.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.052+0000 7f21156cd700 1 -- 172.21.15.84:0/2343004760 shutdown_connections 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.052+0000 7f21156cd700 1 --2- 172.21.15.84:0/2343004760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 0x7f21100f6a90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.052+0000 7f21156cd700 1 --2- 172.21.15.84:0/2343004760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21100f5390 0x7f21100f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.052+0000 7f21156cd700 1 -- 172.21.15.84:0/2343004760 >> 172.21.15.84:0/2343004760 conn(0x7f21100f0b10 msgr2=0x7f21100f2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.052+0000 7f21156cd700 1 -- 172.21.15.84:0/2343004760 shutdown_connections 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.052+0000 7f21156cd700 1 -- 172.21.15.84:0/2343004760 wait complete. 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f21156cd700 1 Processor -- start 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f21156cd700 1 -- start start 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f21156cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21100f5390 0x7f2110105bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f21156cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 0x7f21101060a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f21156cd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2110106650 con 0x7f21100f6630 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f21156cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2110106790 con 0x7f21100f5390 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f210e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 0x7f21101060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f210e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 0x7f21101060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49680/0 (socket says 172.21.15.84:49680) 2024-02-15T18:36:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f210e7fc700 1 -- 172.21.15.84:0/2256284985 learned_addr learned my addr 172.21.15.84:0/2256284985 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.053+0000 7f210effd700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21100f5390 0x7f2110105bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f210e7fc700 1 -- 172.21.15.84:0/2256284985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21100f5390 msgr2=0x7f2110105bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f210e7fc700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21100f5390 0x7f2110105bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f210e7fc700 1 -- 172.21.15.84:0/2256284985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104005040 con 0x7f21100f6630 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f210effd700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21100f5390 0x7f2110105bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f210e7fc700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 0x7f21101060a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f2104009f50 tx=0x7f2104009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f20f77fe700 1 -- 172.21.15.84:0/2256284985 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2104018070 con 0x7f21100f6630 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f20f77fe700 1 -- 172.21.15.84:0/2256284985 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f2104007ba0 con 0x7f21100f6630 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211010b1d0 con 0x7f21100f6630 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f20f77fe700 1 -- 172.21.15.84:0/2256284985 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f210401c620 con 0x7f21100f6630 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.054+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211010b790 con 0x7f21100f6630 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.055+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2110027a00 con 0x7f21100f6630 2024-02-15T18:36:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.055+0000 7f20f77fe700 1 -- 172.21.15.84:0/2256284985 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f210401c890 con 0x7f21100f6630 2024-02-15T18:36:06.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.055+0000 7f20f77fe700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f20f8060f20 0x7f20f80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.056+0000 7f20f77fe700 1 -- 172.21.15.84:0/2256284985 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f210407e000 con 0x7f21100f6630 2024-02-15T18:36:06.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.056+0000 7f210effd700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f20f8060f20 0x7f20f80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.056+0000 7f210effd700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f20f8060f20 0x7f20f80633e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f21100f6490 tx=0x7f2100009c00).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:06.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.060+0000 7f20f77fe700 1 -- 172.21.15.84:0/2256284985 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2104051e10 con 0x7f21100f6630 2024-02-15T18:36:06.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.222+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f21100fdc60 con 0x7f21100f6630 2024-02-15T18:36:06.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.222+0000 7f20f77fe700 1 -- 172.21.15.84:0/2256284985 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v82) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2104051a00 con 0x7f21100f6630 2024-02-15T18:36:06.213 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f20f8060f20 msgr2=0x7f20f80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f20f8060f20 0x7f20f80633e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f21100f6490 tx=0x7f2100009c00).stop 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 msgr2=0x7f21101060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 0x7f21101060a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f2104009f50 tx=0x7f2104009b30).stop 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 shutdown_connections 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f20f8060f20 0x7f20f80633e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21100f5390 0x7f2110105bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 --2- 172.21.15.84:0/2256284985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21100f6630 0x7f21101060a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 >> 172.21.15.84:0/2256284985 conn(0x7f21100f0b10 msgr2=0x7f21100fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 shutdown_connections 2024-02-15T18:36:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.224+0000 7f21156cd700 1 -- 172.21.15.84:0/2256284985 wait complete. 2024-02-15T18:36:06.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T18:36:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 -- 172.21.15.84:0/4037741270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 msgr2=0x7f7c640f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 --2- 172.21.15.84:0/4037741270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 0x7f7c640f6e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f7c58004660 tx=0x7f7c58009b30).stop 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 -- 172.21.15.84:0/4037741270 shutdown_connections 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 --2- 172.21.15.84:0/4037741270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c640f5720 0x7f7c640f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 --2- 172.21.15.84:0/4037741270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 0x7f7c640f6e30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 -- 172.21.15.84:0/4037741270 >> 172.21.15.84:0/4037741270 conn(0x7f7c640f0250 msgr2=0x7f7c640f2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 -- 172.21.15.84:0/4037741270 shutdown_connections 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 -- 172.21.15.84:0/4037741270 wait complete. 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 Processor -- start 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.355+0000 7f7c695f8700 1 -- start start 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c695f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c640f5720 0x7f7c64105bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c695f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 0x7f7c641060a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c695f8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64106650 con 0x7f7c640f6a10 2024-02-15T18:36:06.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c695f8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64106790 con 0x7f7c640f5720 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 0x7f7c641060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 0x7f7c641060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49690/0 (socket says 172.21.15.84:49690) 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c627fc700 1 -- 172.21.15.84:0/2654528945 learned_addr learned my addr 172.21.15.84:0/2654528945 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c62ffd700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c640f5720 0x7f7c64105bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c627fc700 1 -- 172.21.15.84:0/2654528945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c640f5720 msgr2=0x7f7c64105bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c627fc700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c640f5720 0x7f7c64105bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c627fc700 1 -- 172.21.15.84:0/2654528945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58005040 con 0x7f7c640f6a10 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c627fc700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 0x7f7c641060a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f7c5400c790 tx=0x7f7c54007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c4b7fe700 1 -- 172.21.15.84:0/2654528945 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c54002590 con 0x7f7c640f6a10 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c4b7fe700 1 -- 172.21.15.84:0/2654528945 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f7c54002be0 con 0x7f7c640f6a10 2024-02-15T18:36:06.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6410b230 con 0x7f7c640f6a10 2024-02-15T18:36:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c4b7fe700 1 -- 172.21.15.84:0/2654528945 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c540123b0 con 0x7f7c640f6a10 2024-02-15T18:36:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.356+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6410b7f0 con 0x7f7c640f6a10 2024-02-15T18:36:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.357+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c64027a00 con 0x7f7c640f6a10 2024-02-15T18:36:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.358+0000 7f7c4b7fe700 1 -- 172.21.15.84:0/2654528945 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f7c5401a060 con 0x7f7c640f6a10 2024-02-15T18:36:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.358+0000 7f7c4b7fe700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7c4c060f20 0x7f7c4c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.358+0000 7f7c4b7fe700 1 -- 172.21.15.84:0/2654528945 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f7c5407c430 con 0x7f7c640f6a10 2024-02-15T18:36:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.358+0000 7f7c62ffd700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7c4c060f20 0x7f7c4c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.358+0000 7f7c62ffd700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7c4c060f20 0x7f7c4c0633e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7c58009f50 tx=0x7f7c58009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.362+0000 7f7c4b7fe700 1 -- 172.21.15.84:0/2654528945 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7c54050240 con 0x7f7c640f6a10 2024-02-15T18:36:06.504 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:36:04.816971+0000 mgr.smithi084.hjmnez (mgr.14596) 462 : cluster [DBG] pgmap v322: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:06.504 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:05.919701+0000 mon.smithi084 (mon.0) 803 : audit [DBG] from='client.? 172.21.15.84:0/3792303720' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:36:06.504 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:06 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:06.223244+0000 mon.smithi084 (mon.0) 804 : audit [DBG] from='client.? 172.21.15.84:0/2256284985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:36:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.524+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f7c640fdd00 con 0x7f7c640f6a10 2024-02-15T18:36:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.525+0000 7f7c4b7fe700 1 -- 172.21.15.84:0/2654528945 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7c5404fe30 con 0x7f7c640f6a10 2024-02-15T18:36:06.515 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7c4c060f20 msgr2=0x7f7c4c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7c4c060f20 0x7f7c4c0633e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7c58009f50 tx=0x7f7c58009b30).stop 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 msgr2=0x7f7c641060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 0x7f7c641060a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f7c5400c790 tx=0x7f7c54007d70).stop 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 shutdown_connections 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7c4c060f20 0x7f7c4c0633e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c640f5720 0x7f7c64105bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 --2- 172.21.15.84:0/2654528945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c640f6a10 0x7f7c641060a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 >> 172.21.15.84:0/2654528945 conn(0x7f7c640f0250 msgr2=0x7f7c640fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 shutdown_connections 2024-02-15T18:36:06.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.527+0000 7f7c695f8700 1 -- 172.21.15.84:0/2654528945 wait complete. 2024-02-15T18:36:06.529 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T18:36:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.657+0000 7f7372c35700 1 -- 172.21.15.84:0/1563583866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5390 msgr2=0x7f736c0f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.657+0000 7f7372c35700 1 --2- 172.21.15.84:0/1563583866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5390 0x7f736c0f57b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7360004660 tx=0x7f7360009b30).stop 2024-02-15T18:36:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.657+0000 7f7372c35700 1 -- 172.21.15.84:0/1563583866 shutdown_connections 2024-02-15T18:36:06.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.657+0000 7f7372c35700 1 --2- 172.21.15.84:0/1563583866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0f5ca0 0x7f736c0f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.657+0000 7f7372c35700 1 --2- 172.21.15.84:0/1563583866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5390 0x7f736c0f57b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.657+0000 7f7372c35700 1 -- 172.21.15.84:0/1563583866 >> 172.21.15.84:0/1563583866 conn(0x7f736c0f0b70 msgr2=0x7f736c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.657+0000 7f7372c35700 1 -- 172.21.15.84:0/1563583866 shutdown_connections 2024-02-15T18:36:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.657+0000 7f7372c35700 1 -- 172.21.15.84:0/1563583866 wait complete. 2024-02-15T18:36:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.658+0000 7f7372c35700 1 Processor -- start 2024-02-15T18:36:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.658+0000 7f7372c35700 1 -- start start 2024-02-15T18:36:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f7372c35700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0f5390 0x7f736c105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f7372c35700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5ca0 0x7f736c1060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f7372c35700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c106670 con 0x7f736c0f5ca0 2024-02-15T18:36:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f7372c35700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c1067b0 con 0x7f736c0f5390 2024-02-15T18:36:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f736bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5ca0 0x7f736c1060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f736bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5ca0 0x7f736c1060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49712/0 (socket says 172.21.15.84:49712) 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f736bfff700 1 -- 172.21.15.84:0/3338168762 learned_addr learned my addr 172.21.15.84:0/3338168762 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f73709d1700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0f5390 0x7f736c105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f736bfff700 1 -- 172.21.15.84:0/3338168762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0f5390 msgr2=0x7f736c105bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f736bfff700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0f5390 0x7f736c105bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f736bfff700 1 -- 172.21.15.84:0/3338168762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360005040 con 0x7f736c0f5ca0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f73709d1700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0f5390 0x7f736c105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f736bfff700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5ca0 0x7f736c1060c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f73580026d0 tx=0x7f7358009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f73697fa700 1 -- 172.21.15.84:0/3338168762 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7358009320 con 0x7f736c0f5ca0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c10b250 con 0x7f736c0f5ca0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f73697fa700 1 -- 172.21.15.84:0/3338168762 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f735800f040 con 0x7f736c0f5ca0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f73697fa700 1 -- 172.21.15.84:0/3338168762 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73580149b0 con 0x7f736c0f5ca0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.659+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c10b810 con 0x7f736c0f5ca0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.660+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c027a00 con 0x7f736c0f5ca0 2024-02-15T18:36:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.661+0000 7f73697fa700 1 -- 172.21.15.84:0/3338168762 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f7358009480 con 0x7f736c0f5ca0 2024-02-15T18:36:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.661+0000 7f73697fa700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f735c060f20 0x7f735c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.661+0000 7f73697fa700 1 -- 172.21.15.84:0/3338168762 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f735807c7a0 con 0x7f736c0f5ca0 2024-02-15T18:36:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.661+0000 7f73709d1700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f735c060f20 0x7f735c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.662+0000 7f73709d1700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f735c060f20 0x7f735c0633e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7360005010 tx=0x7f7360009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.665+0000 7f73697fa700 1 -- 172.21.15.84:0/3338168762 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f73580505b0 con 0x7f736c0f5ca0 2024-02-15T18:36:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.827+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f736c0fdc90 con 0x7f736c0f5ca0 2024-02-15T18:36:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.827+0000 7f73697fa700 1 -- 172.21.15.84:0/3338168762 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f73580501a0 con 0x7f736c0f5ca0 2024-02-15T18:36:06.818 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f735c060f20 msgr2=0x7f735c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f735c060f20 0x7f735c0633e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7360005010 tx=0x7f7360009b30).stop 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5ca0 msgr2=0x7f736c1060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5ca0 0x7f736c1060c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f73580026d0 tx=0x7f7358009de0).stop 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 shutdown_connections 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f735c060f20 0x7f735c0633e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0f5390 0x7f736c105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 --2- 172.21.15.84:0/3338168762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c0f5ca0 0x7f736c1060c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 >> 172.21.15.84:0/3338168762 conn(0x7f736c0f0b70 msgr2=0x7f736c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 shutdown_connections 2024-02-15T18:36:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.829+0000 7f7372c35700 1 -- 172.21.15.84:0/3338168762 wait complete. 2024-02-15T18:36:06.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-15T18:36:06.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:36:04.816971+0000 mgr.smithi084.hjmnez (mgr.14596) 462 : cluster [DBG] pgmap v322: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:06.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:05.919701+0000 mon.smithi084 (mon.0) 803 : audit [DBG] from='client.? 172.21.15.84:0/3792303720' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:36:06.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:06 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:06.223244+0000 mon.smithi084 (mon.0) 804 : audit [DBG] from='client.? 172.21.15.84:0/2256284985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:36:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 -- 172.21.15.84:0/1237788032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f66f0 msgr2=0x7f03480f6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 --2- 172.21.15.84:0/1237788032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f66f0 0x7f03480f6b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f0344004660 tx=0x7f0344009b30).stop 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 -- 172.21.15.84:0/1237788032 shutdown_connections 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 --2- 172.21.15.84:0/1237788032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f66f0 0x7f03480f6b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 --2- 172.21.15.84:0/1237788032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480f5450 0x7f03480f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 -- 172.21.15.84:0/1237788032 >> 172.21.15.84:0/1237788032 conn(0x7f03480f0b90 msgr2=0x7f03480f2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 -- 172.21.15.84:0/1237788032 shutdown_connections 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 -- 172.21.15.84:0/1237788032 wait complete. 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 Processor -- start 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.958+0000 7f035037f700 1 -- start start 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f035037f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f5450 0x7f0348106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f035037f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480f66f0 0x7f0348107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f035037f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03481079d0 con 0x7f03480f5450 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f035037f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348107b10 con 0x7f03480f66f0 2024-02-15T18:36:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f034e11b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f5450 0x7f0348106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f034e11b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f5450 0x7f0348106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49728/0 (socket says 172.21.15.84:49728) 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f034e11b700 1 -- 172.21.15.84:0/2517844865 learned_addr learned my addr 172.21.15.84:0/2517844865 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f034d91a700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480f66f0 0x7f0348107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f034e11b700 1 -- 172.21.15.84:0/2517844865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480f66f0 msgr2=0x7f0348107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f034e11b700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480f66f0 0x7f0348107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f034e11b700 1 -- 172.21.15.84:0/2517844865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344005040 con 0x7f03480f5450 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f034e11b700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f5450 0x7f0348106f30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f0338002700 tx=0x7f0338009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f033effd700 1 -- 172.21.15.84:0/2517844865 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03380079c0 con 0x7f03480f5450 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f033effd700 1 -- 172.21.15.84:0/2517844865 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f033800f040 con 0x7f03480f5450 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034810c5b0 con 0x7f03480f5450 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f033effd700 1 -- 172.21.15.84:0/2517844865 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0338014940 con 0x7f03480f5450 2024-02-15T18:36:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.959+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034810cb70 con 0x7f03480f5450 2024-02-15T18:36:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.960+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034805f3b0 con 0x7f03480f5450 2024-02-15T18:36:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.961+0000 7f033effd700 1 -- 172.21.15.84:0/2517844865 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f033801b060 con 0x7f03480f5450 2024-02-15T18:36:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.961+0000 7f033effd700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0334060fe0 0x7f03340634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.961+0000 7f033effd700 1 -- 172.21.15.84:0/2517844865 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f033807bf90 con 0x7f03480f5450 2024-02-15T18:36:06.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.961+0000 7f034d91a700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0334060fe0 0x7f03340634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:06.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.961+0000 7f034d91a700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0334060fe0 0x7f03340634a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0344004630 tx=0x7f0344009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:06.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:06.965+0000 7f033effd700 1 -- 172.21.15.84:0/2517844865 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f033804fe20 con 0x7f03480f5450 2024-02-15T18:36:07.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.169+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f034810d2c0 con 0x7f03480f5450 2024-02-15T18:36:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.169+0000 7f033effd700 1 -- 172.21.15.84:0/2517844865 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f033804fa10 con 0x7f03480f5450 2024-02-15T18:36:07.160 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:07.160 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44299,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6827/2979200029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2979200029},{"type":"v1","addr":"172.21.15.133:6827","nonce":2979200029}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:33:00.537828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34338,"mds_1":34342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34338":{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":0,"incarnation":33,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34342":{"gid":34342,"name":"cephfs.smithi084.spootv","rank":1,"incarnation":37,"state":"up:active","state_seq":10,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0334060fe0 msgr2=0x7f03340634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0334060fe0 0x7f03340634a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0344004630 tx=0x7f0344009b30).stop 2024-02-15T18:36:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f5450 msgr2=0x7f0348106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f5450 0x7f0348106f30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f0338002700 tx=0x7f0338009d80).stop 2024-02-15T18:36:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 shutdown_connections 2024-02-15T18:36:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0334060fe0 0x7f03340634a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480f5450 0x7f0348106f30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 --2- 172.21.15.84:0/2517844865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480f66f0 0x7f0348107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 >> 172.21.15.84:0/2517844865 conn(0x7f03480f0b90 msgr2=0x7f034805fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 shutdown_connections 2024-02-15T18:36:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.171+0000 7f035037f700 1 -- 172.21.15.84:0/2517844865 wait complete. 2024-02-15T18:36:07.163 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 38 2024-02-15T18:36:07.174 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 2, 'flags': 18} 2024-02-15T18:36:07.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-02-15T18:36:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 -- 172.21.15.84:0/1717950478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203805fe30 msgr2=0x7f20380f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 --2- 172.21.15.84:0/1717950478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203805fe30 0x7f20380f9110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f2028004660 tx=0x7f2028009b30).stop 2024-02-15T18:36:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 -- 172.21.15.84:0/1717950478 shutdown_connections 2024-02-15T18:36:07.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 --2- 172.21.15.84:0/1717950478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20380f9600 0x7f20380fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 --2- 172.21.15.84:0/1717950478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203805fe30 0x7f20380f9110 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 -- 172.21.15.84:0/1717950478 >> 172.21.15.84:0/1717950478 conn(0x7f20380f0b70 msgr2=0x7f20380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 -- 172.21.15.84:0/1717950478 shutdown_connections 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 -- 172.21.15.84:0/1717950478 wait complete. 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 Processor -- start 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 -- start start 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.300+0000 7f203f63c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203805fe30 0x7f2038106c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203f63c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20380f9600 0x7f2038107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203f63c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2038107780 con 0x7f20380f9600 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203f63c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20381078f0 con 0x7f203805fe30 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203cbd7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20380f9600 0x7f2038107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203cbd7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20380f9600 0x7f2038107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49734/0 (socket says 172.21.15.84:49734) 2024-02-15T18:36:07.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203cbd7700 1 -- 172.21.15.84:0/3578297744 learned_addr learned my addr 172.21.15.84:0/3578297744 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203d3d8700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203805fe30 0x7f2038106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203cbd7700 1 -- 172.21.15.84:0/3578297744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203805fe30 msgr2=0x7f2038106c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203cbd7700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203805fe30 0x7f2038106c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203cbd7700 1 -- 172.21.15.84:0/3578297744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028005040 con 0x7f20380f9600 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203cbd7700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20380f9600 0x7f2038107180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f20340026d0 tx=0x7f2034009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f202dffb700 1 -- 172.21.15.84:0/3578297744 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20340079c0 con 0x7f20380f9600 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f202dffb700 1 -- 172.21.15.84:0/3578297744 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f203400f040 con 0x7f20380f9600 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203810c360 con 0x7f20380f9600 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f202dffb700 1 -- 172.21.15.84:0/3578297744 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20340149f0 con 0x7f20380f9600 2024-02-15T18:36:07.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.301+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203810c8f0 con 0x7f20380f9600 2024-02-15T18:36:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.302+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2038046330 con 0x7f20380f9600 2024-02-15T18:36:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.303+0000 7f202dffb700 1 -- 172.21.15.84:0/3578297744 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f2034014b50 con 0x7f20380f9600 2024-02-15T18:36:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.303+0000 7f202dffb700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2024060f20 0x7f20240633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:07.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.303+0000 7f202dffb700 1 -- 172.21.15.84:0/3578297744 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f203407c230 con 0x7f20380f9600 2024-02-15T18:36:07.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.303+0000 7f203d3d8700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2024060f20 0x7f20240633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:07.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.303+0000 7f203d3d8700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2024060f20 0x7f20240633e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f2038107b80 tx=0x7f2028009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:07.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.307+0000 7f202dffb700 1 -- 172.21.15.84:0/3578297744 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f203404c760 con 0x7f20380f9600 2024-02-15T18:36:07.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.509+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7f2038027a00 con 0x7f20380f9600 2024-02-15T18:36:07.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.510+0000 7f202dffb700 1 -- 172.21.15.84:0/3578297744 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v38) v1 ==== 107+0+4593 (secure 0 0 0) 0x7f203404fd80 con 0x7f20380f9600 2024-02-15T18:36:07.501 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:07.501 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:24:22.906819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24239,"mds_1":14438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi084.cuytny","rank":1,"incarnation":9,"state":"up:active","state_seq":2,"addr":"172.21.15.84:6827/1573509091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1573509091},{"type":"v1","addr":"172.21.15.84:6827","nonce":1573509091}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2024060f20 msgr2=0x7f20240633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2024060f20 0x7f20240633e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f2038107b80 tx=0x7f2028009b30).stop 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20380f9600 msgr2=0x7f2038107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20380f9600 0x7f2038107180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f20340026d0 tx=0x7f2034009de0).stop 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 shutdown_connections 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2024060f20 0x7f20240633e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f203805fe30 0x7f2038106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 --2- 172.21.15.84:0/3578297744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20380f9600 0x7f2038107180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 >> 172.21.15.84:0/3578297744 conn(0x7f20380f0b70 msgr2=0x7f20380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 shutdown_connections 2024-02-15T18:36:07.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.512+0000 7f203f63c700 1 -- 172.21.15.84:0/3578297744 wait complete. 2024-02-15T18:36:07.504 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 14 2024-02-15T18:36:07.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.640+0000 7f5234434700 1 -- 172.21.15.84:0/3217583106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 msgr2=0x7f522c0f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.640+0000 7f5234434700 1 --2- 172.21.15.84:0/3217583106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 0x7f522c0f7b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f5228004660 tx=0x7f5228009b30).stop 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.640+0000 7f5234434700 1 -- 172.21.15.84:0/3217583106 shutdown_connections 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.640+0000 7f5234434700 1 --2- 172.21.15.84:0/3217583106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 0x7f522c0f7b90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.640+0000 7f5234434700 1 --2- 172.21.15.84:0/3217583106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f522c0f6490 0x7f522c0f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.640+0000 7f5234434700 1 -- 172.21.15.84:0/3217583106 >> 172.21.15.84:0/3217583106 conn(0x7f522c0f1bd0 msgr2=0x7f522c0f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.640+0000 7f5234434700 1 -- 172.21.15.84:0/3217583106 shutdown_connections 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.640+0000 7f5234434700 1 -- 172.21.15.84:0/3217583106 wait complete. 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.640+0000 7f5234434700 1 Processor -- start 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5234434700 1 -- start start 2024-02-15T18:36:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5234434700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f522c0f6490 0x7f522c106cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5234434700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 0x7f522c1071e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5234434700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1077e0 con 0x7f522c0f7730 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5234434700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c107920 con 0x7f522c0f6490 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f52319cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 0x7f522c1071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f52319cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 0x7f522c1071e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49758/0 (socket says 172.21.15.84:49758) 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f52319cf700 1 -- 172.21.15.84:0/1714370958 learned_addr learned my addr 172.21.15.84:0/1714370958 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f52321d0700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f522c0f6490 0x7f522c106cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f52319cf700 1 -- 172.21.15.84:0/1714370958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f522c0f6490 msgr2=0x7f522c106cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f52319cf700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f522c0f6490 0x7f522c106cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f52319cf700 1 -- 172.21.15.84:0/1714370958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228005040 con 0x7f522c0f7730 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f52321d0700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f522c0f6490 0x7f522c106cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f52319cf700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 0x7f522c1071e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5228009f50 tx=0x7f5228009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5222ffd700 1 -- 172.21.15.84:0/1714370958 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5228018070 con 0x7f522c0f7730 2024-02-15T18:36:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5222ffd700 1 -- 172.21.15.84:0/1714370958 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f5228007ba0 con 0x7f522c0f7730 2024-02-15T18:36:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c10c2d0 con 0x7f522c0f7730 2024-02-15T18:36:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5222ffd700 1 -- 172.21.15.84:0/1714370958 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522801c620 con 0x7f522c0f7730 2024-02-15T18:36:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.641+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c10c830 con 0x7f522c0f7730 2024-02-15T18:36:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.642+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c027a00 con 0x7f522c0f7730 2024-02-15T18:36:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.643+0000 7f5222ffd700 1 -- 172.21.15.84:0/1714370958 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f522801d420 con 0x7f522c0f7730 2024-02-15T18:36:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.643+0000 7f5222ffd700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5218060f20 0x7f52180633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.643+0000 7f5222ffd700 1 -- 172.21.15.84:0/1714370958 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f522807df40 con 0x7f522c0f7730 2024-02-15T18:36:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.643+0000 7f52321d0700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5218060f20 0x7f52180633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.644+0000 7f52321d0700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5218060f20 0x7f52180633e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f522c1081e0 tx=0x7f521c009c00).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.647+0000 7f5222ffd700 1 -- 172.21.15.84:0/1714370958 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f52280acf60 con 0x7f522c0f7730 2024-02-15T18:36:07.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:06.525814+0000 mon.smithi084 (mon.0) 805 : audit [DBG] from='client.? 172.21.15.84:0/2654528945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T18:36:07.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:06.828323+0000 mon.smithi084 (mon.0) 806 : audit [DBG] from='client.? 172.21.15.84:0/3338168762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T18:36:07.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:07 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:07.170347+0000 mon.smithi084 (mon.0) 807 : audit [DBG] from='client.? 172.21.15.84:0/2517844865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:36:07.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.850+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f522c0fed60 con 0x7f522c0f7730 2024-02-15T18:36:07.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.850+0000 7f5222ffd700 1 -- 172.21.15.84:0/1714370958 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v38) v1 ==== 107+0+4594 (secure 0 0 0) 0x7f522804e340 con 0x7f522c0f7730 2024-02-15T18:36:07.841 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:07.841 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:26:32.713494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24239,"mds_1":14438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi084.cuytny","rank":1,"incarnation":9,"state":"up:active","state_seq":2,"addr":"172.21.15.84:6827/1573509091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1573509091},{"type":"v1","addr":"172.21.15.84:6827","nonce":1573509091}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[1],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:07.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5218060f20 msgr2=0x7f52180633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5218060f20 0x7f52180633e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f522c1081e0 tx=0x7f521c009c00).stop 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 msgr2=0x7f522c1071e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 0x7f522c1071e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f5228009f50 tx=0x7f5228009b30).stop 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 shutdown_connections 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5218060f20 0x7f52180633e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f522c0f6490 0x7f522c106cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 --2- 172.21.15.84:0/1714370958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f522c0f7730 0x7f522c1071e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 >> 172.21.15.84:0/1714370958 conn(0x7f522c0f1bd0 msgr2=0x7f522c0fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 shutdown_connections 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.852+0000 7f5234434700 1 -- 172.21.15.84:0/1714370958 wait complete. 2024-02-15T18:36:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 15 2024-02-15T18:36:07.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-02-15T18:36:07.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:06.525814+0000 mon.smithi084 (mon.0) 805 : audit [DBG] from='client.? 172.21.15.84:0/2654528945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T18:36:07.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:06.828323+0000 mon.smithi084 (mon.0) 806 : audit [DBG] from='client.? 172.21.15.84:0/3338168762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T18:36:07.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:07 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:07.170347+0000 mon.smithi084 (mon.0) 807 : audit [DBG] from='client.? 172.21.15.84:0/2517844865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:36:07.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.981+0000 7fa60b380700 1 -- 172.21.15.84:0/4163507323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 msgr2=0x7fa6040f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.981+0000 7fa60b380700 1 --2- 172.21.15.84:0/4163507323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 0x7fa6040f6d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa600004660 tx=0x7fa600009b30).stop 2024-02-15T18:36:07.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.981+0000 7fa60b380700 1 -- 172.21.15.84:0/4163507323 shutdown_connections 2024-02-15T18:36:07.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.981+0000 7fa60b380700 1 --2- 172.21.15.84:0/4163507323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6040f5660 0x7fa6040f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.981+0000 7fa60b380700 1 --2- 172.21.15.84:0/4163507323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 0x7fa6040f6d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.981+0000 7fa60b380700 1 -- 172.21.15.84:0/4163507323 >> 172.21.15.84:0/4163507323 conn(0x7fa6040f0250 msgr2=0x7fa6040f2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.982+0000 7fa60b380700 1 -- 172.21.15.84:0/4163507323 shutdown_connections 2024-02-15T18:36:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.982+0000 7fa60b380700 1 -- 172.21.15.84:0/4163507323 wait complete. 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.982+0000 7fa60b380700 1 Processor -- start 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.982+0000 7fa60b380700 1 -- start start 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60b380700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6040f5660 0x7fa6040f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60b380700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 0x7fa60410bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60b380700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60410bff0 con 0x7fa6040f6960 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60b380700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60410c130 con 0x7fa6040f5660 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60891b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 0x7fa60410bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60891b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 0x7fa60410bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49770/0 (socket says 172.21.15.84:49770) 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60891b700 1 -- 172.21.15.84:0/2077815033 learned_addr learned my addr 172.21.15.84:0/2077815033 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60911c700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6040f5660 0x7fa6040f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60891b700 1 -- 172.21.15.84:0/2077815033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6040f5660 msgr2=0x7fa6040f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60891b700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6040f5660 0x7fa6040f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60891b700 1 -- 172.21.15.84:0/2077815033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600005040 con 0x7fa6040f6960 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60891b700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 0x7fa60410bb00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fa5f400c530 tx=0x7fa5f4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa5f9ffb700 1 -- 172.21.15.84:0/2077815033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f400f650 con 0x7fa6040f6960 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa5f9ffb700 1 -- 172.21.15.84:0/2077815033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fa5f400fca0 con 0x7fa6040f6960 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa5f9ffb700 1 -- 172.21.15.84:0/2077815033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f4012e60 con 0x7fa6040f6960 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60410c390 con 0x7fa6040f6960 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.983+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60410c920 con 0x7fa6040f6960 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.984+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa604046330 con 0x7fa6040f6960 2024-02-15T18:36:07.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.984+0000 7fa5f9ffb700 1 -- 172.21.15.84:0/2077815033 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa5f4019030 con 0x7fa6040f6960 2024-02-15T18:36:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.985+0000 7fa5f9ffb700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa5f0060f20 0x7fa5f00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.985+0000 7fa5f9ffb700 1 -- 172.21.15.84:0/2077815033 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa5f407bdb0 con 0x7fa6040f6960 2024-02-15T18:36:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.985+0000 7fa60911c700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa5f0060f20 0x7fa5f00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:07.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.985+0000 7fa60911c700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa5f0060f20 0x7fa5f00633e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa600009d60 tx=0x7fa600009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:07.989+0000 7fa5f9ffb700 1 -- 172.21.15.84:0/2077815033 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa5f4048f60 con 0x7fa6040f6960 2024-02-15T18:36:08.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.191+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fa604027a00 con 0x7fa6040f6960 2024-02-15T18:36:08.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.191+0000 7fa5f9ffb700 1 -- 172.21.15.84:0/2077815033 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v38) v1 ==== 107+0+4595 (secure 0 0 0) 0x7fa5f4017090 con 0x7fa6040f6960 2024-02-15T18:36:08.182 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:08.182 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:28:06.036365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24239,"mds_1":14438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi084.cuytny","rank":1,"incarnation":9,"state":"up:active","state_seq":2,"addr":"172.21.15.84:6827/1573509091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1573509091},{"type":"v1","addr":"172.21.15.84:6827","nonce":1573509091}]},"join_fscid":1,"export_targets":[0],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[1],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:08.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.193+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa5f0060f20 msgr2=0x7fa5f00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.193+0000 7fa60b380700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa5f0060f20 0x7fa5f00633e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa600009d60 tx=0x7fa600009b30).stop 2024-02-15T18:36:08.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.193+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 msgr2=0x7fa60410bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.193+0000 7fa60b380700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 0x7fa60410bb00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fa5f400c530 tx=0x7fa5f4007e10).stop 2024-02-15T18:36:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.193+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 shutdown_connections 2024-02-15T18:36:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.193+0000 7fa60b380700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fa5f0060f20 0x7fa5f00633e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.193+0000 7fa60b380700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6040f5660 0x7fa6040f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.193+0000 7fa60b380700 1 --2- 172.21.15.84:0/2077815033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6040f6960 0x7fa60410bb00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.193+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 >> 172.21.15.84:0/2077815033 conn(0x7fa6040f0250 msgr2=0x7fa6040fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.194+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 shutdown_connections 2024-02-15T18:36:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.194+0000 7fa60b380700 1 -- 172.21.15.84:0/2077815033 wait complete. 2024-02-15T18:36:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2024-02-15T18:36:08.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-02-15T18:36:08.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.321+0000 7f5cd5124700 1 -- 172.21.15.84:0/1111023170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 msgr2=0x7f5cd00f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.321+0000 7f5cd5124700 1 --2- 172.21.15.84:0/1111023170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 0x7f5cd00f66e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f5cc0004660 tx=0x7f5cc0009b30).stop 2024-02-15T18:36:08.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 -- 172.21.15.84:0/1111023170 shutdown_connections 2024-02-15T18:36:08.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 --2- 172.21.15.84:0/1111023170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 0x7f5cd00f66e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 --2- 172.21.15.84:0/1111023170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00f53a0 0x7f5cd00f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 -- 172.21.15.84:0/1111023170 >> 172.21.15.84:0/1111023170 conn(0x7f5cd00f0ba0 msgr2=0x7f5cd00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 -- 172.21.15.84:0/1111023170 shutdown_connections 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 -- 172.21.15.84:0/1111023170 wait complete. 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 Processor -- start 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 -- start start 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00f53a0 0x7f5cd0105bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 0x7f5cd01060b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0106660 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.322+0000 7f5cd5124700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd01067a0 con 0x7f5cd00f53a0 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cce59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 0x7f5cd01060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cce59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 0x7f5cd01060b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49788/0 (socket says 172.21.15.84:49788) 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cce59c700 1 -- 172.21.15.84:0/401376964 learned_addr learned my addr 172.21.15.84:0/401376964 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:08.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cced9d700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00f53a0 0x7f5cd0105bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cce59c700 1 -- 172.21.15.84:0/401376964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00f53a0 msgr2=0x7f5cd0105bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cce59c700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00f53a0 0x7f5cd0105bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cce59c700 1 -- 172.21.15.84:0/401376964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc0005040 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cce59c700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 0x7f5cd01060b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5cc0009f50 tx=0x7f5cc0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cb77fe700 1 -- 172.21.15.84:0/401376964 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc0018070 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cb77fe700 1 -- 172.21.15.84:0/401376964 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f5cc0007ba0 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd010b1e0 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cb77fe700 1 -- 172.21.15.84:0/401376964 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cc001c620 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.323+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd010b7a0 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.324+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd0027a00 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.324+0000 7f5cb77fe700 1 -- 172.21.15.84:0/401376964 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f5cc001c890 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.325+0000 7f5cb77fe700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5cb8060f20 0x7f5cb80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:08.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.325+0000 7f5cb77fe700 1 -- 172.21.15.84:0/401376964 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f5cc007e000 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.325+0000 7f5cced9d700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5cb8060f20 0x7f5cb80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:08.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.325+0000 7f5cced9d700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5cb8060f20 0x7f5cb80633e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5cc40096c0 tx=0x7f5cc4009be0).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:08.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.329+0000 7f5cb77fe700 1 -- 172.21.15.84:0/401376964 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5cc0051e10 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.531+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f5cd00fdca0 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.532+0000 7f5cb77fe700 1 -- 172.21.15.84:0/401376964 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v38) v1 ==== 107+0+4594 (secure 0 0 0) 0x7f5cc0051a00 con 0x7f5cd00f5cb0 2024-02-15T18:36:08.522 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:08.522 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:30:41.070194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24239,"mds_1":14438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi084.cuytny","rank":1,"incarnation":9,"state":"up:active","state_seq":2,"addr":"172.21.15.84:6827/1573509091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1573509091},{"type":"v1","addr":"172.21.15.84:6827","nonce":1573509091}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[1],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5cb8060f20 msgr2=0x7f5cb80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5cb8060f20 0x7f5cb80633e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5cc40096c0 tx=0x7f5cc4009be0).stop 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 msgr2=0x7f5cd01060b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 0x7f5cd01060b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5cc0009f50 tx=0x7f5cc0009b30).stop 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 shutdown_connections 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5cb8060f20 0x7f5cb80633e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00f53a0 0x7f5cd0105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 --2- 172.21.15.84:0/401376964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cd00f5cb0 0x7f5cd01060b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 >> 172.21.15.84:0/401376964 conn(0x7f5cd00f0ba0 msgr2=0x7f5cd00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 shutdown_connections 2024-02-15T18:36:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.534+0000 7f5cd5124700 1 -- 172.21.15.84:0/401376964 wait complete. 2024-02-15T18:36:08.526 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-02-15T18:36:08.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-02-15T18:36:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.663+0000 7f78f5e0f700 1 -- 172.21.15.84:0/1714282931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 msgr2=0x7f78f00f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.663+0000 7f78f5e0f700 1 --2- 172.21.15.84:0/1714282931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 0x7f78f00f66d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f78e4004660 tx=0x7f78e4009b30).stop 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.663+0000 7f78f5e0f700 1 -- 172.21.15.84:0/1714282931 shutdown_connections 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.663+0000 7f78f5e0f700 1 --2- 172.21.15.84:0/1714282931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 0x7f78f00f66d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.663+0000 7f78f5e0f700 1 --2- 172.21.15.84:0/1714282931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f00f5390 0x7f78f00f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.663+0000 7f78f5e0f700 1 -- 172.21.15.84:0/1714282931 >> 172.21.15.84:0/1714282931 conn(0x7f78f00f0b70 msgr2=0x7f78f00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.663+0000 7f78f5e0f700 1 -- 172.21.15.84:0/1714282931 shutdown_connections 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.663+0000 7f78f5e0f700 1 -- 172.21.15.84:0/1714282931 wait complete. 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.663+0000 7f78f5e0f700 1 Processor -- start 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78f5e0f700 1 -- start start 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78f5e0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f00f5390 0x7f78f005fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78f5e0f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 0x7f78f010ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78f5e0f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f010bf80 con 0x7f78f00f5ca0 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78f5e0f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f010c0c0 con 0x7f78f00f5390 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78eeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 0x7f78f010ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78eeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 0x7f78f010ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49800/0 (socket says 172.21.15.84:49800) 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78eeffd700 1 -- 172.21.15.84:0/214839367 learned_addr learned my addr 172.21.15.84:0/214839367 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78eeffd700 1 -- 172.21.15.84:0/214839367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f00f5390 msgr2=0x7f78f005fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78eeffd700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f00f5390 0x7f78f005fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78eeffd700 1 -- 172.21.15.84:0/214839367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e4005040 con 0x7f78f00f5ca0 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78eeffd700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 0x7f78f010ba90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f78e4009f50 tx=0x7f78e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78d7fff700 1 -- 172.21.15.84:0/214839367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e4018070 con 0x7f78f00f5ca0 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f010c2f0 con 0x7f78f00f5ca0 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78d7fff700 1 -- 172.21.15.84:0/214839367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f78e4007d70 con 0x7f78f00f5ca0 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78d7fff700 1 -- 172.21.15.84:0/214839367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e401c620 con 0x7f78f00f5ca0 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.664+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f010c850 con 0x7f78f00f5ca0 2024-02-15T18:36:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.665+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f0027a00 con 0x7f78f00f5ca0 2024-02-15T18:36:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.666+0000 7f78d7fff700 1 -- 172.21.15.84:0/214839367 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f78e401c8e0 con 0x7f78f00f5ca0 2024-02-15T18:36:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.666+0000 7f78d7fff700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f78d8060f20 0x7f78d80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.666+0000 7f78d7fff700 1 -- 172.21.15.84:0/214839367 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f78e407e110 con 0x7f78f00f5ca0 2024-02-15T18:36:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.666+0000 7f78ef7fe700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f78d8060f20 0x7f78d80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.666+0000 7f78ef7fe700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f78d8060f20 0x7f78d80633e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f78e80079c0 tx=0x7f78e8004940).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.670+0000 7f78d7fff700 1 -- 172.21.15.84:0/214839367 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f78e4051f20 con 0x7f78f00f5ca0 2024-02-15T18:36:08.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:36:06.817303+0000 mgr.smithi084.hjmnez (mgr.14596) 463 : cluster [DBG] pgmap v323: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:08.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:07.510854+0000 mon.smithi084 (mon.0) 808 : audit [DBG] from='client.? 172.21.15.84:0/3578297744' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-02-15T18:36:08.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:07.851363+0000 mon.smithi084 (mon.0) 809 : audit [DBG] from='client.? 172.21.15.84:0/1714370958' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-15T18:36:08.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:08 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:08.192333+0000 mon.smithi084 (mon.0) 810 : audit [DBG] from='client.? 172.21.15.84:0/2077815033' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-15T18:36:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.873+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f78f00fdc90 con 0x7f78f00f5ca0 2024-02-15T18:36:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.874+0000 7f78d7fff700 1 -- 172.21.15.84:0/214839367 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v38) v1 ==== 107+0+4593 (secure 0 0 0) 0x7f78e4051b10 con 0x7f78f00f5ca0 2024-02-15T18:36:08.864 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:08.864 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:30:43.076507+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24239,"mds_1":14438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi084.cuytny","rank":1,"incarnation":9,"state":"up:active","state_seq":2,"addr":"172.21.15.84:6827/1573509091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1573509091},{"type":"v1","addr":"172.21.15.84:6827","nonce":1573509091}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.875+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f78d8060f20 msgr2=0x7f78d80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.875+0000 7f78f5e0f700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f78d8060f20 0x7f78d80633e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f78e80079c0 tx=0x7f78e8004940).stop 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.875+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 msgr2=0x7f78f010ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.875+0000 7f78f5e0f700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 0x7f78f010ba90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f78e4009f50 tx=0x7f78e4009b30).stop 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.875+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 shutdown_connections 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.875+0000 7f78f5e0f700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f78d8060f20 0x7f78d80633e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.875+0000 7f78f5e0f700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f00f5390 0x7f78f005fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.875+0000 7f78f5e0f700 1 --2- 172.21.15.84:0/214839367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f00f5ca0 0x7f78f010ba90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.876+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 >> 172.21.15.84:0/214839367 conn(0x7f78f00f0b70 msgr2=0x7f78f00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.876+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 shutdown_connections 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:08.876+0000 7f78f5e0f700 1 -- 172.21.15.84:0/214839367 wait complete. 2024-02-15T18:36:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2024-02-15T18:36:08.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-15T18:36:08.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:36:06.817303+0000 mgr.smithi084.hjmnez (mgr.14596) 463 : cluster [DBG] pgmap v323: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:08.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:07.510854+0000 mon.smithi084 (mon.0) 808 : audit [DBG] from='client.? 172.21.15.84:0/3578297744' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-02-15T18:36:08.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:07.851363+0000 mon.smithi084 (mon.0) 809 : audit [DBG] from='client.? 172.21.15.84:0/1714370958' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-15T18:36:08.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:08 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:08.192333+0000 mon.smithi084 (mon.0) 810 : audit [DBG] from='client.? 172.21.15.84:0/2077815033' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-15T18:36:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 -- 172.21.15.84:0/4294369793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 msgr2=0x7f4bdc0fba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 --2- 172.21.15.84:0/4294369793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 0x7f4bdc0fba80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f4bd8004660 tx=0x7f4bd8009b30).stop 2024-02-15T18:36:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 -- 172.21.15.84:0/4294369793 shutdown_connections 2024-02-15T18:36:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 --2- 172.21.15.84:0/4294369793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 0x7f4bdc0fba80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 --2- 172.21.15.84:0/4294369793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bdc05fed0 0x7f4bdc0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 -- 172.21.15.84:0/4294369793 >> 172.21.15.84:0/4294369793 conn(0x7f4bdc0f0b30 msgr2=0x7f4bdc0f2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 -- 172.21.15.84:0/4294369793 shutdown_connections 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 -- 172.21.15.84:0/4294369793 wait complete. 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 Processor -- start 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 -- start start 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bdc05fed0 0x7f4bdc106d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 0x7f4bdc1071f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1077f0 con 0x7f4bdc0f9690 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.004+0000 7f4be4281700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc107930 con 0x7f4bdc05fed0 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be181c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 0x7f4bdc1071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be181c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 0x7f4bdc1071f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49822/0 (socket says 172.21.15.84:49822) 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be181c700 1 -- 172.21.15.84:0/2141297349 learned_addr learned my addr 172.21.15.84:0/2141297349 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be201d700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bdc05fed0 0x7f4bdc106d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be181c700 1 -- 172.21.15.84:0/2141297349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bdc05fed0 msgr2=0x7f4bdc106d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:08.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be181c700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bdc05fed0 0x7f4bdc106d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be181c700 1 -- 172.21.15.84:0/2141297349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd8005040 con 0x7f4bdc0f9690 2024-02-15T18:36:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be181c700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 0x7f4bdc1071f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f4bd8004e30 tx=0x7f4bd8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4bd2ffd700 1 -- 172.21.15.84:0/2141297349 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bd8018070 con 0x7f4bdc0f9690 2024-02-15T18:36:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc10c2e0 con 0x7f4bdc0f9690 2024-02-15T18:36:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4bd2ffd700 1 -- 172.21.15.84:0/2141297349 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f4bd8007ba0 con 0x7f4bdc0f9690 2024-02-15T18:36:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4bd2ffd700 1 -- 172.21.15.84:0/2141297349 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bd801c620 con 0x7f4bdc0f9690 2024-02-15T18:36:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.005+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc10c7c0 con 0x7f4bdc0f9690 2024-02-15T18:36:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.006+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc027a00 con 0x7f4bdc0f9690 2024-02-15T18:36:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.006+0000 7f4bd2ffd700 1 -- 172.21.15.84:0/2141297349 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f4bd801d420 con 0x7f4bdc0f9690 2024-02-15T18:36:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.007+0000 7f4bd2ffd700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4bc8060f20 0x7f4bc80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.007+0000 7f4bd2ffd700 1 -- 172.21.15.84:0/2141297349 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f4bd807df50 con 0x7f4bdc0f9690 2024-02-15T18:36:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.007+0000 7f4be201d700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4bc8060f20 0x7f4bc80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:08.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.007+0000 7f4be201d700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4bc8060f20 0x7f4bc80633e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4bcc009880 tx=0x7f4bcc00b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:09.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.011+0000 7f4bd2ffd700 1 -- 172.21.15.84:0/2141297349 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4bd80acf60 con 0x7f4bdc0f9690 2024-02-15T18:36:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.215+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f4bdc0feda0 con 0x7f4bdc0f9690 2024-02-15T18:36:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.215+0000 7f4bd2ffd700 1 -- 172.21.15.84:0/2141297349 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v38) v1 ==== 107+0+4593 (secure 0 0 0) 0x7f4bd804e330 con 0x7f4bdc0f9690 2024-02-15T18:36:09.206 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:09.206 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:31:23.489513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":24239,"mds_1":14438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi084.cuytny","rank":1,"incarnation":9,"state":"up:active","state_seq":2,"addr":"172.21.15.84:6827/1573509091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1573509091},{"type":"v1","addr":"172.21.15.84:6827","nonce":1573509091}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:09.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4bc8060f20 msgr2=0x7f4bc80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4bc8060f20 0x7f4bc80633e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4bcc009880 tx=0x7f4bcc00b040).stop 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 msgr2=0x7f4bdc1071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 0x7f4bdc1071f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f4bd8004e30 tx=0x7f4bd8009b30).stop 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 shutdown_connections 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f4bc8060f20 0x7f4bc80633e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bdc05fed0 0x7f4bdc106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 --2- 172.21.15.84:0/2141297349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc0f9690 0x7f4bdc1071f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 >> 172.21.15.84:0/2141297349 conn(0x7f4bdc0f0b30 msgr2=0x7f4bdc0f2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.217+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 shutdown_connections 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.218+0000 7f4be4281700 1 -- 172.21.15.84:0/2141297349 wait complete. 2024-02-15T18:36:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2024-02-15T18:36:09.220 DEBUG:tasks.fs:max_mds reduced in epoch 19 2024-02-15T18:36:09.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 -- 172.21.15.84:0/1211613942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 msgr2=0x7f0c8c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 --2- 172.21.15.84:0/1211613942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 0x7f0c8c0fbae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f0c88004660 tx=0x7f0c88009b30).stop 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 -- 172.21.15.84:0/1211613942 shutdown_connections 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 --2- 172.21.15.84:0/1211613942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 0x7f0c8c0fbae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 --2- 172.21.15.84:0/1211613942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c8c0f4830 0x7f0c8c0f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 -- 172.21.15.84:0/1211613942 >> 172.21.15.84:0/1211613942 conn(0x7f0c8c0f0250 msgr2=0x7f0c8c0f2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 -- 172.21.15.84:0/1211613942 shutdown_connections 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 -- 172.21.15.84:0/1211613942 wait complete. 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 Processor -- start 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 -- start start 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c8c0f4830 0x7f0c8c106c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 0x7f0c8c107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c107760 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.346+0000 7f0c9454d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c1078d0 con 0x7f0c8c0f4830 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c91ae8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 0x7f0c8c107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c91ae8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 0x7f0c8c107160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49854/0 (socket says 172.21.15.84:49854) 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c91ae8700 1 -- 172.21.15.84:0/3670577328 learned_addr learned my addr 172.21.15.84:0/3670577328 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c922e9700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c8c0f4830 0x7f0c8c106c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c91ae8700 1 -- 172.21.15.84:0/3670577328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c8c0f4830 msgr2=0x7f0c8c106c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c91ae8700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c8c0f4830 0x7f0c8c106c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c91ae8700 1 -- 172.21.15.84:0/3670577328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c88005040 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c91ae8700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 0x7f0c8c107160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f0c88009f50 tx=0x7f0c88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c7effd700 1 -- 172.21.15.84:0/3670577328 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c88018070 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c7effd700 1 -- 172.21.15.84:0/3670577328 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f0c88007ba0 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c10c2e0 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c7effd700 1 -- 172.21.15.84:0/3670577328 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c8801c420 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.347+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c10c810 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.348+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c046330 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.348+0000 7f0c7effd700 1 -- 172.21.15.84:0/3670577328 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f0c8801d420 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.349+0000 7f0c7effd700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0c78060f20 0x7f0c780633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.349+0000 7f0c7effd700 1 -- 172.21.15.84:0/3670577328 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f0c8807dda0 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.349+0000 7f0c922e9700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0c78060f20 0x7f0c780633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.349+0000 7f0c922e9700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0c78060f20 0x7f0c780633e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f0c8c107b60 tx=0x7f0c8000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.353+0000 7f0c7effd700 1 -- 172.21.15.84:0/3670577328 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0c8804e1a0 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.558+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f0c8c027a00 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.559+0000 7f0c7effd700 1 -- 172.21.15.84:0/3670577328 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v38) v1 ==== 107+0+4595 (secure 0 0 0) 0x7f0c880517c0 con 0x7f0c8c0f51d0 2024-02-15T18:36:09.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:09.549 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:31:23.494912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":24239,"mds_1":14438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi084.cuytny","rank":1,"incarnation":9,"state":"up:stopping","state_seq":2,"addr":"172.21.15.84:6827/1573509091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1573509091},{"type":"v1","addr":"172.21.15.84:6827","nonce":1573509091}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.560+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0c78060f20 msgr2=0x7f0c780633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.560+0000 7f0c9454d700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0c78060f20 0x7f0c780633e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f0c8c107b60 tx=0x7f0c8000b040).stop 2024-02-15T18:36:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.560+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 msgr2=0x7f0c8c107160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.560+0000 7f0c9454d700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 0x7f0c8c107160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f0c88009f50 tx=0x7f0c88009b30).stop 2024-02-15T18:36:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.561+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 shutdown_connections 2024-02-15T18:36:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.561+0000 7f0c9454d700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0c78060f20 0x7f0c780633e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.561+0000 7f0c9454d700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c8c0f4830 0x7f0c8c106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.561+0000 7f0c9454d700 1 --2- 172.21.15.84:0/3670577328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c8c0f51d0 0x7f0c8c107160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.561+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 >> 172.21.15.84:0/3670577328 conn(0x7f0c8c0f0250 msgr2=0x7f0c8c0f82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.561+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 shutdown_connections 2024-02-15T18:36:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.561+0000 7f0c9454d700 1 -- 172.21.15.84:0/3670577328 wait complete. 2024-02-15T18:36:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 20 2024-02-15T18:36:09.563 DEBUG:tasks.fs:max_mds reduced in epoch 20 2024-02-15T18:36:09.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-15T18:36:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.691+0000 7f639b2e2700 1 -- 172.21.15.84:0/3062425837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f639405fe30 msgr2=0x7f63940f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.691+0000 7f639b2e2700 1 --2- 172.21.15.84:0/3062425837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f639405fe30 0x7f63940f9110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f6384004660 tx=0x7f6384009b30).stop 2024-02-15T18:36:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.691+0000 7f639b2e2700 1 -- 172.21.15.84:0/3062425837 shutdown_connections 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.691+0000 7f639b2e2700 1 --2- 172.21.15.84:0/3062425837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63940f9600 0x7f63940fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.691+0000 7f639b2e2700 1 --2- 172.21.15.84:0/3062425837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f639405fe30 0x7f63940f9110 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.691+0000 7f639b2e2700 1 -- 172.21.15.84:0/3062425837 >> 172.21.15.84:0/3062425837 conn(0x7f63940f0b70 msgr2=0x7f63940f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.691+0000 7f639b2e2700 1 -- 172.21.15.84:0/3062425837 shutdown_connections 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.691+0000 7f639b2e2700 1 -- 172.21.15.84:0/3062425837 wait complete. 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639b2e2700 1 Processor -- start 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639b2e2700 1 -- start start 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639b2e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639405fe30 0x7f6394106c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639b2e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63940f9600 0x7f6394107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639b2e2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394107780 con 0x7f63940f9600 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639b2e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63941078f0 con 0x7f639405fe30 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639887d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63940f9600 0x7f6394107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639887d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63940f9600 0x7f6394107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49870/0 (socket says 172.21.15.84:49870) 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639887d700 1 -- 172.21.15.84:0/1213184803 learned_addr learned my addr 172.21.15.84:0/1213184803 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639907e700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639405fe30 0x7f6394106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639887d700 1 -- 172.21.15.84:0/1213184803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639405fe30 msgr2=0x7f6394106c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639887d700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639405fe30 0x7f6394106c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639887d700 1 -- 172.21.15.84:0/1213184803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6384005040 con 0x7f63940f9600 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639907e700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639405fe30 0x7f6394106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639887d700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63940f9600 0x7f6394107180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f63900026d0 tx=0x7f6390009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f6389ffb700 1 -- 172.21.15.84:0/1213184803 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6390009320 con 0x7f63940f9600 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f6389ffb700 1 -- 172.21.15.84:0/1213184803 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f639000f040 con 0x7f63940f9600 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639410c360 con 0x7f63940f9600 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.692+0000 7f6389ffb700 1 -- 172.21.15.84:0/1213184803 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63900149b0 con 0x7f63940f9600 2024-02-15T18:36:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.693+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639410c8f0 con 0x7f63940f9600 2024-02-15T18:36:09.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.693+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6394046330 con 0x7f63940f9600 2024-02-15T18:36:09.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.694+0000 7f6389ffb700 1 -- 172.21.15.84:0/1213184803 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f6390009480 con 0x7f63940f9600 2024-02-15T18:36:09.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.694+0000 7f6389ffb700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6380060f20 0x7f63800633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:09.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.694+0000 7f6389ffb700 1 -- 172.21.15.84:0/1213184803 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f639007c720 con 0x7f63940f9600 2024-02-15T18:36:09.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.694+0000 7f639907e700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6380060f20 0x7f63800633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:09.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.695+0000 7f639907e700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6380060f20 0x7f63800633e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6384009d60 tx=0x7f6384009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:09.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.698+0000 7f6389ffb700 1 -- 172.21.15.84:0/1213184803 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f639004cb00 con 0x7f63940f9600 2024-02-15T18:36:09.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:08.532570+0000 mon.smithi084 (mon.0) 811 : audit [DBG] from='client.? 172.21.15.84:0/401376964' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-15T18:36:09.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:08.874522+0000 mon.smithi084 (mon.0) 812 : audit [DBG] from='client.? 172.21.15.84:0/214839367' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-15T18:36:09.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:09 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:09.216365+0000 mon.smithi084 (mon.0) 813 : audit [DBG] from='client.? 172.21.15.84:0/2141297349' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-15T18:36:09.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:08.532570+0000 mon.smithi084 (mon.0) 811 : audit [DBG] from='client.? 172.21.15.84:0/401376964' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-15T18:36:09.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:08.874522+0000 mon.smithi084 (mon.0) 812 : audit [DBG] from='client.? 172.21.15.84:0/214839367' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-15T18:36:09.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:09 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:09.216365+0000 mon.smithi084 (mon.0) 813 : audit [DBG] from='client.? 172.21.15.84:0/2141297349' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-15T18:36:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.903+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f6394027a00 con 0x7f63940f9600 2024-02-15T18:36:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.903+0000 7f6389ffb700 1 -- 172.21.15.84:0/1213184803 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v38) v1 ==== 107+0+4596 (secure 0 0 0) 0x7f6390050120 con 0x7f63940f9600 2024-02-15T18:36:09.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:09.894 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:31:31.079780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":24239,"mds_1":14438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi084.cuytny","rank":1,"incarnation":9,"state":"up:stopping","state_seq":2,"addr":"172.21.15.84:6827/1573509091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1573509091},{"type":"v1","addr":"172.21.15.84:6827","nonce":1573509091}]},"join_fscid":1,"export_targets":[0],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6380060f20 msgr2=0x7f63800633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6380060f20 0x7f63800633e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6384009d60 tx=0x7f6384009b30).stop 2024-02-15T18:36:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63940f9600 msgr2=0x7f6394107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63940f9600 0x7f6394107180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f63900026d0 tx=0x7f6390009de0).stop 2024-02-15T18:36:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 shutdown_connections 2024-02-15T18:36:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f6380060f20 0x7f63800633e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639405fe30 0x7f6394106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 --2- 172.21.15.84:0/1213184803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63940f9600 0x7f6394107180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 >> 172.21.15.84:0/1213184803 conn(0x7f63940f0b70 msgr2=0x7f63940f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 shutdown_connections 2024-02-15T18:36:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:09.905+0000 7f639b2e2700 1 -- 172.21.15.84:0/1213184803 wait complete. 2024-02-15T18:36:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 21 2024-02-15T18:36:09.907 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-02-15T18:36:09.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.033+0000 7fedb9aa1700 1 -- 172.21.15.84:0/4054736999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb405fdd0 msgr2=0x7fedb40f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.033+0000 7fedb9aa1700 1 --2- 172.21.15.84:0/4054736999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb405fdd0 0x7fedb40f9170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7feda8004660 tx=0x7feda8009b30).stop 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.033+0000 7fedb9aa1700 1 -- 172.21.15.84:0/4054736999 shutdown_connections 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.033+0000 7fedb9aa1700 1 --2- 172.21.15.84:0/4054736999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedb40f9660 0x7fedb40fba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.033+0000 7fedb9aa1700 1 --2- 172.21.15.84:0/4054736999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb405fdd0 0x7fedb40f9170 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.033+0000 7fedb9aa1700 1 -- 172.21.15.84:0/4054736999 >> 172.21.15.84:0/4054736999 conn(0x7fedb40f0b70 msgr2=0x7fedb40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.033+0000 7fedb9aa1700 1 -- 172.21.15.84:0/4054736999 shutdown_connections 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.033+0000 7fedb9aa1700 1 -- 172.21.15.84:0/4054736999 wait complete. 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.033+0000 7fedb9aa1700 1 Processor -- start 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb9aa1700 1 -- start start 2024-02-15T18:36:10.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb9aa1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedb405fdd0 0x7fedb4106c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb9aa1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb40f9660 0x7fedb4107170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb9aa1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb4107770 con 0x7fedb40f9660 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb9aa1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb41078e0 con 0x7fedb405fdd0 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb40f9660 0x7fedb4107170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb40f9660 0x7fedb4107170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49878/0 (socket says 172.21.15.84:49878) 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb2ffd700 1 -- 172.21.15.84:0/598506176 learned_addr learned my addr 172.21.15.84:0/598506176 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb37fe700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedb405fdd0 0x7fedb4106c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb2ffd700 1 -- 172.21.15.84:0/598506176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedb405fdd0 msgr2=0x7fedb4106c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb2ffd700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedb405fdd0 0x7fedb4106c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb2ffd700 1 -- 172.21.15.84:0/598506176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8005040 con 0x7fedb40f9660 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb2ffd700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb40f9660 0x7fedb4107170 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7feda40026d0 tx=0x7feda4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fed9bfff700 1 -- 172.21.15.84:0/598506176 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda40079c0 con 0x7fedb40f9660 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fed9bfff700 1 -- 172.21.15.84:0/598506176 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7feda400f040 con 0x7fedb40f9660 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb410c350 con 0x7fedb40f9660 2024-02-15T18:36:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.034+0000 7fed9bfff700 1 -- 172.21.15.84:0/598506176 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda40149f0 con 0x7fedb40f9660 2024-02-15T18:36:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.035+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb410c8e0 con 0x7fedb40f9660 2024-02-15T18:36:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.035+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb4046330 con 0x7fedb40f9660 2024-02-15T18:36:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.036+0000 7fed9bfff700 1 -- 172.21.15.84:0/598506176 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7feda4007b20 con 0x7fedb40f9660 2024-02-15T18:36:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.036+0000 7fed9bfff700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed9c060f20 0x7fed9c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.036+0000 7fed9bfff700 1 -- 172.21.15.84:0/598506176 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7feda407c070 con 0x7fedb40f9660 2024-02-15T18:36:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.036+0000 7fedb37fe700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed9c060f20 0x7fed9c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.037+0000 7fedb37fe700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed9c060f20 0x7fed9c0633e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fedb4107b70 tx=0x7feda8009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.040+0000 7fed9bfff700 1 -- 172.21.15.84:0/598506176 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7feda404c580 con 0x7fedb40f9660 2024-02-15T18:36:10.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.243+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fedb4027a00 con 0x7fedb40f9660 2024-02-15T18:36:10.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.243+0000 7fed9bfff700 1 -- 172.21.15.84:0/598506176 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v38) v1 ==== 107+0+3800 (secure 0 0 0) 0x7feda404fba0 con 0x7fedb40f9660 2024-02-15T18:36:10.234 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:10.234 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:31:56.195144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed9c060f20 msgr2=0x7fed9c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed9c060f20 0x7fed9c0633e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fedb4107b70 tx=0x7feda8009b30).stop 2024-02-15T18:36:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb40f9660 msgr2=0x7fedb4107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb40f9660 0x7fedb4107170 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7feda40026d0 tx=0x7feda4009de0).stop 2024-02-15T18:36:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 shutdown_connections 2024-02-15T18:36:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed9c060f20 0x7fed9c0633e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedb405fdd0 0x7fedb4106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 --2- 172.21.15.84:0/598506176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fedb40f9660 0x7fedb4107170 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 >> 172.21.15.84:0/598506176 conn(0x7fedb40f0b70 msgr2=0x7fedb40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 shutdown_connections 2024-02-15T18:36:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.245+0000 7fedb9aa1700 1 -- 172.21.15.84:0/598506176 wait complete. 2024-02-15T18:36:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 22 2024-02-15T18:36:10.248 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-02-15T18:36:10.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-15T18:36:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 -- 172.21.15.84:0/3728989592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f6490 msgr2=0x7f970c0f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 --2- 172.21.15.84:0/3728989592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f6490 0x7f970c0f68b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f9700004660 tx=0x7f9700009b30).stop 2024-02-15T18:36:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 -- 172.21.15.84:0/3728989592 shutdown_connections 2024-02-15T18:36:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 --2- 172.21.15.84:0/3728989592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0f7730 0x7f970c0f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 --2- 172.21.15.84:0/3728989592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f6490 0x7f970c0f68b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 -- 172.21.15.84:0/3728989592 >> 172.21.15.84:0/3728989592 conn(0x7f970c0f1bd0 msgr2=0x7f970c0f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 -- 172.21.15.84:0/3728989592 shutdown_connections 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 -- 172.21.15.84:0/3728989592 wait complete. 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 Processor -- start 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 -- start start 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0f6490 0x7f970c06b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f7730 0x7f970c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c06bd70 con 0x7f970c0f7730 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.374+0000 7f9713f57700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c06a310 con 0x7f970c0f6490 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f97114f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f7730 0x7f970c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f97114f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f7730 0x7f970c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49892/0 (socket says 172.21.15.84:49892) 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f97114f2700 1 -- 172.21.15.84:0/1843119790 learned_addr learned my addr 172.21.15.84:0/1843119790 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f9711cf3700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0f6490 0x7f970c06b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f97114f2700 1 -- 172.21.15.84:0/1843119790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0f6490 msgr2=0x7f970c06b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f97114f2700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0f6490 0x7f970c06b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f97114f2700 1 -- 172.21.15.84:0/1843119790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700005040 con 0x7f970c0f7730 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f9711cf3700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0f6490 0x7f970c06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f97114f2700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f7730 0x7f970c069e20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f97080026d0 tx=0x7f9708009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f96fe7fc700 1 -- 172.21.15.84:0/1843119790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9708009320 con 0x7f970c0f7730 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f96fe7fc700 1 -- 172.21.15.84:0/1843119790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f970800f040 con 0x7f970c0f7730 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c06a590 con 0x7f970c0f7730 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f96fe7fc700 1 -- 172.21.15.84:0/1843119790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97080149b0 con 0x7f970c0f7730 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.375+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c06ab50 con 0x7f970c0f7730 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.376+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c027a00 con 0x7f970c0f7730 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.376+0000 7f96fe7fc700 1 -- 172.21.15.84:0/1843119790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f9708009480 con 0x7f970c0f7730 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.377+0000 7f96fe7fc700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f96f8060f20 0x7f96f80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.377+0000 7f96fe7fc700 1 -- 172.21.15.84:0/1843119790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f970807c770 con 0x7f970c0f7730 2024-02-15T18:36:10.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.377+0000 7f9711cf3700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f96f8060f20 0x7f96f80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.377+0000 7f9711cf3700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f96f8060f20 0x7f96f80633e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f9700004e30 tx=0x7f9700009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.381+0000 7f96fe7fc700 1 -- 172.21.15.84:0/1843119790 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9708050580 con 0x7f970c0f7730 2024-02-15T18:36:10.504 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:36:08.817683+0000 mgr.smithi084.hjmnez (mgr.14596) 464 : cluster [DBG] pgmap v324: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:10.504 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:09.559550+0000 mon.smithi084 (mon.0) 814 : audit [DBG] from='client.? 172.21.15.84:0/3670577328' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-15T18:36:10.504 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:09.904038+0000 mon.smithi084 (mon.0) 815 : audit [DBG] from='client.? 172.21.15.84:0/1213184803' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-15T18:36:10.505 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:10 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:10.244101+0000 mon.smithi084 (mon.0) 816 : audit [DBG] from='client.? 172.21.15.84:0/598506176' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-15T18:36:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.588+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f970c0fed60 con 0x7f970c0f7730 2024-02-15T18:36:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.589+0000 7f96fe7fc700 1 -- 172.21.15.84:0/1843119790 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v38) v1 ==== 107+0+4579 (secure 0 0 0) 0x7f9708050170 con 0x7f970c0f7730 2024-02-15T18:36:10.580 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:10.580 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34310,"name":"cephfs.smithi084.cuytny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/4000569752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4000569752},{"type":"v1","addr":"172.21.15.84:6827","nonce":4000569752}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:31:56.195144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:10.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f96f8060f20 msgr2=0x7f96f80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f96f8060f20 0x7f96f80633e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f9700004e30 tx=0x7f9700009b30).stop 2024-02-15T18:36:10.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f7730 msgr2=0x7f970c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f7730 0x7f970c069e20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f97080026d0 tx=0x7f9708009de0).stop 2024-02-15T18:36:10.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 shutdown_connections 2024-02-15T18:36:10.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f96f8060f20 0x7f96f80633e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970c0f6490 0x7f970c06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 --2- 172.21.15.84:0/1843119790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f970c0f7730 0x7f970c069e20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 >> 172.21.15.84:0/1843119790 conn(0x7f970c0f1bd0 msgr2=0x7f970c0fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:10.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 shutdown_connections 2024-02-15T18:36:10.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.591+0000 7f9713f57700 1 -- 172.21.15.84:0/1843119790 wait complete. 2024-02-15T18:36:10.583 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 23 2024-02-15T18:36:10.593 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-02-15T18:36:10.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-15T18:36:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 -- 172.21.15.84:0/430156250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 msgr2=0x7f77a80f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 --2- 172.21.15.84:0/430156250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 0x7f77a80f66d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f7794004660 tx=0x7f7794009b30).stop 2024-02-15T18:36:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 -- 172.21.15.84:0/430156250 shutdown_connections 2024-02-15T18:36:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 --2- 172.21.15.84:0/430156250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 0x7f77a80f66d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 --2- 172.21.15.84:0/430156250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a80f5390 0x7f77a80f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 -- 172.21.15.84:0/430156250 >> 172.21.15.84:0/430156250 conn(0x7f77a80f0b70 msgr2=0x7f77a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 -- 172.21.15.84:0/430156250 shutdown_connections 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 -- 172.21.15.84:0/430156250 wait complete. 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 Processor -- start 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.721+0000 7f77af089700 1 -- start start 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77af089700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a80f5390 0x7f77a8105c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77af089700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 0x7f77a81060f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77af089700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a81066f0 con 0x7f77a80f5ca0 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77af089700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8106830 con 0x7f77a80f5390 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 0x7f77a81060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 0x7f77a81060f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49914/0 (socket says 172.21.15.84:49914) 2024-02-15T18:36:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a7fff700 1 -- 172.21.15.84:0/1210748540 learned_addr learned my addr 172.21.15.84:0/1210748540 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77ace25700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a80f5390 0x7f77a8105c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a7fff700 1 -- 172.21.15.84:0/1210748540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a80f5390 msgr2=0x7f77a8105c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a7fff700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a80f5390 0x7f77a8105c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a7fff700 1 -- 172.21.15.84:0/1210748540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794005040 con 0x7f77a80f5ca0 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a7fff700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 0x7f77a81060f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f7794000c00 tx=0x7f779400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a57fa700 1 -- 172.21.15.84:0/1210748540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7794019070 con 0x7f77a80f5ca0 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a57fa700 1 -- 172.21.15.84:0/1210748540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f7794007e80 con 0x7f77a80f5ca0 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a810b1e0 con 0x7f77a80f5ca0 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77a57fa700 1 -- 172.21.15.84:0/1210748540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7794014db0 con 0x7f77a80f5ca0 2024-02-15T18:36:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.722+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a810b740 con 0x7f77a80f5ca0 2024-02-15T18:36:10.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.723+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a8027a00 con 0x7f77a80f5ca0 2024-02-15T18:36:10.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.724+0000 7f77a57fa700 1 -- 172.21.15.84:0/1210748540 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f7794025070 con 0x7f77a80f5ca0 2024-02-15T18:36:10.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.724+0000 7f77a57fa700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7798060ec0 0x7f7798063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:10.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.724+0000 7f77a57fa700 1 -- 172.21.15.84:0/1210748540 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f779407d0e0 con 0x7f77a80f5ca0 2024-02-15T18:36:10.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.724+0000 7f77ace25700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7798060ec0 0x7f7798063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:10.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.724+0000 7f77ace25700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7798060ec0 0x7f7798063380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f77a81070f0 tx=0x7f779c00b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:10.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.728+0000 7f77a57fa700 1 -- 172.21.15.84:0/1210748540 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f779404d4d0 con 0x7f77a80f5ca0 2024-02-15T18:36:10.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:36:08.817683+0000 mgr.smithi084.hjmnez (mgr.14596) 464 : cluster [DBG] pgmap v324: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:10.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:09.559550+0000 mon.smithi084 (mon.0) 814 : audit [DBG] from='client.? 172.21.15.84:0/3670577328' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-15T18:36:10.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:09.904038+0000 mon.smithi084 (mon.0) 815 : audit [DBG] from='client.? 172.21.15.84:0/1213184803' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-15T18:36:10.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:10 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:10.244101+0000 mon.smithi084 (mon.0) 816 : audit [DBG] from='client.? 172.21.15.84:0/598506176' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-15T18:36:10.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.933+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f77a80fdc90 con 0x7f77a80f5ca0 2024-02-15T18:36:10.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.933+0000 7f77a57fa700 1 -- 172.21.15.84:0/1210748540 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v38) v1 ==== 107+0+3800 (secure 0 0 0) 0x7f7794023020 con 0x7f77a80f5ca0 2024-02-15T18:36:10.925 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:10.925 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:31:56.195144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:10.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7798060ec0 msgr2=0x7f7798063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7798060ec0 0x7f7798063380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f77a81070f0 tx=0x7f779c00b040).stop 2024-02-15T18:36:10.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 msgr2=0x7f77a81060f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:10.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 0x7f77a81060f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f7794000c00 tx=0x7f779400b040).stop 2024-02-15T18:36:10.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 shutdown_connections 2024-02-15T18:36:10.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f7798060ec0 0x7f7798063380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77a80f5390 0x7f77a8105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 --2- 172.21.15.84:0/1210748540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77a80f5ca0 0x7f77a81060f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:10.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 >> 172.21.15.84:0/1210748540 conn(0x7f77a80f0b70 msgr2=0x7f77a80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:10.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 shutdown_connections 2024-02-15T18:36:10.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:10.935+0000 7f77af089700 1 -- 172.21.15.84:0/1210748540 wait complete. 2024-02-15T18:36:10.927 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2024-02-15T18:36:10.938 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-02-15T18:36:10.938 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-15T18:36:11.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 -- 172.21.15.84:0/1053480536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 msgr2=0x7fe4840f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 --2- 172.21.15.84:0/1053480536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 0x7fe4840f57d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fe474004660 tx=0x7fe474009b30).stop 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 -- 172.21.15.84:0/1053480536 shutdown_connections 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 --2- 172.21.15.84:0/1053480536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4840f5cc0 0x7fe4840f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 --2- 172.21.15.84:0/1053480536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 0x7fe4840f57d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 -- 172.21.15.84:0/1053480536 >> 172.21.15.84:0/1053480536 conn(0x7fe4840f0bd0 msgr2=0x7fe4840f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 -- 172.21.15.84:0/1053480536 shutdown_connections 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 -- 172.21.15.84:0/1053480536 wait complete. 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 Processor -- start 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 -- start start 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 0x7fe48405fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.064+0000 7fe48a75c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4840f5cc0 0x7fe48410ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe48a75c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4841078b0 con 0x7fe4840f53b0 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe48a75c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48410e3c0 con 0x7fe4840f5cc0 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe483fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 0x7fe48405fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe483fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 0x7fe48405fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49926/0 (socket says 172.21.15.84:49926) 2024-02-15T18:36:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe483fff700 1 -- 172.21.15.84:0/2736802723 learned_addr learned my addr 172.21.15.84:0/2736802723 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe4837fe700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4840f5cc0 0x7fe48410ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe483fff700 1 -- 172.21.15.84:0/2736802723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4840f5cc0 msgr2=0x7fe48410ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe483fff700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4840f5cc0 0x7fe48410ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe483fff700 1 -- 172.21.15.84:0/2736802723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe474005040 con 0x7fe4840f53b0 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe4837fe700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4840f5cc0 0x7fe48410ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe483fff700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 0x7fe48405fd10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe474000c00 tx=0x7fe47400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe480ff9700 1 -- 172.21.15.84:0/2736802723 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe474019070 con 0x7fe4840f53b0 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe480ff9700 1 -- 172.21.15.84:0/2736802723 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fe474014420 con 0x7fe4840f53b0 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48410e500 con 0x7fe4840f53b0 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe480ff9700 1 -- 172.21.15.84:0/2736802723 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe47401d600 con 0x7fe4840f53b0 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.065+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48410ea30 con 0x7fe4840f53b0 2024-02-15T18:36:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.066+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe484046330 con 0x7fe4840f53b0 2024-02-15T18:36:11.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.066+0000 7fe480ff9700 1 -- 172.21.15.84:0/2736802723 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe474025070 con 0x7fe4840f53b0 2024-02-15T18:36:11.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.067+0000 7fe480ff9700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe46c060f20 0x7fe46c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:11.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.067+0000 7fe480ff9700 1 -- 172.21.15.84:0/2736802723 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fe47407d170 con 0x7fe4840f53b0 2024-02-15T18:36:11.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.067+0000 7fe4837fe700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe46c060f20 0x7fe46c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:11.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.067+0000 7fe4837fe700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe46c060f20 0x7fe46c0633e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe478007fc0 tx=0x7fe47800b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.071+0000 7fe480ff9700 1 -- 172.21.15.84:0/2736802723 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe474050f80 con 0x7fe4840f53b0 2024-02-15T18:36:11.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.273+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fe4840586e0 con 0x7fe4840f53b0 2024-02-15T18:36:11.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.274+0000 7fe480ff9700 1 -- 172.21.15.84:0/2736802723 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v38) v1 ==== 107+0+4579 (secure 0 0 0) 0x7fe474023020 con 0x7fe4840f53b0 2024-02-15T18:36:11.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:11.264 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14454,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.84:6829/2787458317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2787458317},{"type":"v1","addr":"172.21.15.84:6829","nonce":2787458317}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:31:56.195144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:11.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.275+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe46c060f20 msgr2=0x7fe46c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.275+0000 7fe48a75c700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe46c060f20 0x7fe46c0633e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe478007fc0 tx=0x7fe47800b040).stop 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.275+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 msgr2=0x7fe48405fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.275+0000 7fe48a75c700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 0x7fe48405fd10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe474000c00 tx=0x7fe47400b040).stop 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.275+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 shutdown_connections 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.275+0000 7fe48a75c700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fe46c060f20 0x7fe46c0633e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.275+0000 7fe48a75c700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4840f53b0 0x7fe48405fd10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.275+0000 7fe48a75c700 1 --2- 172.21.15.84:0/2736802723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4840f5cc0 0x7fe48410ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.275+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 >> 172.21.15.84:0/2736802723 conn(0x7fe4840f0bd0 msgr2=0x7fe4840fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.276+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 shutdown_connections 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.276+0000 7fe48a75c700 1 -- 172.21.15.84:0/2736802723 wait complete. 2024-02-15T18:36:11.267 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-02-15T18:36:11.278 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-02-15T18:36:11.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-15T18:36:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.403+0000 7f091efc0700 1 -- 172.21.15.84:0/4073074154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5390 msgr2=0x7f09180f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.403+0000 7f091efc0700 1 --2- 172.21.15.84:0/4073074154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5390 0x7f09180f57b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f090c004660 tx=0x7f090c009b30).stop 2024-02-15T18:36:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.403+0000 7f091efc0700 1 -- 172.21.15.84:0/4073074154 shutdown_connections 2024-02-15T18:36:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.403+0000 7f091efc0700 1 --2- 172.21.15.84:0/4073074154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09180f5ca0 0x7f09180f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.403+0000 7f091efc0700 1 --2- 172.21.15.84:0/4073074154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5390 0x7f09180f57b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.403+0000 7f091efc0700 1 -- 172.21.15.84:0/4073074154 >> 172.21.15.84:0/4073074154 conn(0x7f09180f0b70 msgr2=0x7f09180f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.403+0000 7f091efc0700 1 -- 172.21.15.84:0/4073074154 shutdown_connections 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.403+0000 7f091efc0700 1 -- 172.21.15.84:0/4073074154 wait complete. 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.404+0000 7f091efc0700 1 Processor -- start 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.404+0000 7f091efc0700 1 -- start start 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.404+0000 7f091efc0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09180f5390 0x7f091805fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.404+0000 7f091efc0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5ca0 0x7f091810bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.404+0000 7f091efc0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091810bfb0 con 0x7f09180f5ca0 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.404+0000 7f091efc0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091810c0f0 con 0x7f09180f5390 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.404+0000 7f0917fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5ca0 0x7f091810bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.404+0000 7f0917fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5ca0 0x7f091810bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49942/0 (socket says 172.21.15.84:49942) 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.404+0000 7f0917fff700 1 -- 172.21.15.84:0/3081662876 learned_addr learned my addr 172.21.15.84:0/3081662876 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f091cd5c700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09180f5390 0x7f091805fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f0917fff700 1 -- 172.21.15.84:0/3081662876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09180f5390 msgr2=0x7f091805fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f0917fff700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09180f5390 0x7f091805fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f0917fff700 1 -- 172.21.15.84:0/3081662876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c005040 con 0x7f09180f5ca0 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f091cd5c700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09180f5390 0x7f091805fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f0917fff700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5ca0 0x7f091810bac0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f09040026d0 tx=0x7f0904009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f09157fa700 1 -- 172.21.15.84:0/3081662876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0904009320 con 0x7f09180f5ca0 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f09157fa700 1 -- 172.21.15.84:0/3081662876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f090400f040 con 0x7f09180f5ca0 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091810c350 con 0x7f09180f5ca0 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f09157fa700 1 -- 172.21.15.84:0/3081662876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09040149b0 con 0x7f09180f5ca0 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.405+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091810c8e0 con 0x7f09180f5ca0 2024-02-15T18:36:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.406+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0918046330 con 0x7f09180f5ca0 2024-02-15T18:36:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.406+0000 7f09157fa700 1 -- 172.21.15.84:0/3081662876 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f0904009480 con 0x7f09180f5ca0 2024-02-15T18:36:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.407+0000 7f09157fa700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0908060f70 0x7f0908063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.407+0000 7f09157fa700 1 -- 172.21.15.84:0/3081662876 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f090407c710 con 0x7f09180f5ca0 2024-02-15T18:36:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.407+0000 7f091cd5c700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0908060f70 0x7f0908063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.407+0000 7f091cd5c700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0908060f70 0x7f0908063430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f090c005010 tx=0x7f090c009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:11.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.411+0000 7f09157fa700 1 -- 172.21.15.84:0/3081662876 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0904050500 con 0x7f09180f5ca0 2024-02-15T18:36:11.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.618+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f0918058710 con 0x7f09180f5ca0 2024-02-15T18:36:11.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.618+0000 7f09157fa700 1 -- 172.21.15.84:0/3081662876 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v38) v1 ==== 107+0+3800 (secure 0 0 0) 0x7f09040500f0 con 0x7f09180f5ca0 2024-02-15T18:36:11.609 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:11.609 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:31:56.195144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:11.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.620+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0908060f70 msgr2=0x7f0908063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.620+0000 7f091efc0700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0908060f70 0x7f0908063430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f090c005010 tx=0x7f090c009b30).stop 2024-02-15T18:36:11.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.620+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5ca0 msgr2=0x7f091810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.620+0000 7f091efc0700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5ca0 0x7f091810bac0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f09040026d0 tx=0x7f0904009de0).stop 2024-02-15T18:36:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.620+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 shutdown_connections 2024-02-15T18:36:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.620+0000 7f091efc0700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0908060f70 0x7f0908063430 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.620+0000 7f091efc0700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09180f5390 0x7f091805fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.620+0000 7f091efc0700 1 --2- 172.21.15.84:0/3081662876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09180f5ca0 0x7f091810bac0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.620+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 >> 172.21.15.84:0/3081662876 conn(0x7f09180f0b70 msgr2=0x7f09180fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.621+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 shutdown_connections 2024-02-15T18:36:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.621+0000 7f091efc0700 1 -- 172.21.15.84:0/3081662876 wait complete. 2024-02-15T18:36:11.612 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2024-02-15T18:36:11.622 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:10.589863+0000 mon.smithi084 (mon.0) 817 : audit [DBG] from='client.? 172.21.15.84:0/1843119790' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-15T18:36:11.622 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:10.934351+0000 mon.smithi084 (mon.0) 818 : audit [DBG] from='client.? 172.21.15.84:0/1210748540' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-15T18:36:11.622 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:11 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:11.274346+0000 mon.smithi084 (mon.0) 819 : audit [DBG] from='client.? 172.21.15.84:0/2736802723' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-15T18:36:11.623 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-02-15T18:36:11.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-15T18:36:11.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.753+0000 7fed6d506700 1 -- 172.21.15.84:0/489396719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f7b40 msgr2=0x7fed680f7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 --2- 172.21.15.84:0/489396719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f7b40 0x7fed680f7f60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fed5c004660 tx=0x7fed5c009b30).stop 2024-02-15T18:36:11.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 -- 172.21.15.84:0/489396719 shutdown_connections 2024-02-15T18:36:11.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 --2- 172.21.15.84:0/489396719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed680f84e0 0x7fed680f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 --2- 172.21.15.84:0/489396719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f7b40 0x7fed680f7f60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 -- 172.21.15.84:0/489396719 >> 172.21.15.84:0/489396719 conn(0x7fed680f02c0 msgr2=0x7fed680f26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:11.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 -- 172.21.15.84:0/489396719 shutdown_connections 2024-02-15T18:36:11.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 -- 172.21.15.84:0/489396719 wait complete. 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 Processor -- start 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 -- start start 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed680f7b40 0x7fed680f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f84e0 0x7fed680f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed680f77e0 con 0x7fed680f84e0 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.754+0000 7fed6d506700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed680f5d80 con 0x7fed680f7b40 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed667fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f84e0 0x7fed680f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed667fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f84e0 0x7fed680f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49950/0 (socket says 172.21.15.84:49950) 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed667fc700 1 -- 172.21.15.84:0/3690059711 learned_addr learned my addr 172.21.15.84:0/3690059711 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed66ffd700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed680f7b40 0x7fed680f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed667fc700 1 -- 172.21.15.84:0/3690059711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed680f7b40 msgr2=0x7fed680f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed667fc700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed680f7b40 0x7fed680f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed667fc700 1 -- 172.21.15.84:0/3690059711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c005040 con 0x7fed680f84e0 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed667fc700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f84e0 0x7fed680f5890 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fed5800c790 tx=0x7fed58007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed4f7fe700 1 -- 172.21.15.84:0/3690059711 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed58002590 con 0x7fed680f84e0 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed4f7fe700 1 -- 172.21.15.84:0/3690059711 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fed58002be0 con 0x7fed680f84e0 2024-02-15T18:36:11.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed680f6000 con 0x7fed680f84e0 2024-02-15T18:36:11.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed4f7fe700 1 -- 172.21.15.84:0/3690059711 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed580123b0 con 0x7fed680f84e0 2024-02-15T18:36:11.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.755+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed680f65c0 con 0x7fed680f84e0 2024-02-15T18:36:11.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.756+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed68027a00 con 0x7fed680f84e0 2024-02-15T18:36:11.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.756+0000 7fed4f7fe700 1 -- 172.21.15.84:0/3690059711 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fed5801a060 con 0x7fed680f84e0 2024-02-15T18:36:11.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.757+0000 7fed4f7fe700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed50060f20 0x7fed500633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:11.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.757+0000 7fed4f7fe700 1 -- 172.21.15.84:0/3690059711 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fed5807c360 con 0x7fed680f84e0 2024-02-15T18:36:11.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.757+0000 7fed66ffd700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed50060f20 0x7fed500633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:11.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.757+0000 7fed66ffd700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed50060f20 0x7fed500633e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fed5c009f50 tx=0x7fed5c009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:11.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.761+0000 7fed4f7fe700 1 -- 172.21.15.84:0/3690059711 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fed580501f0 con 0x7fed680f84e0 2024-02-15T18:36:11.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:10.589863+0000 mon.smithi084 (mon.0) 817 : audit [DBG] from='client.? 172.21.15.84:0/1843119790' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-15T18:36:11.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:10.934351+0000 mon.smithi084 (mon.0) 818 : audit [DBG] from='client.? 172.21.15.84:0/1210748540' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-15T18:36:11.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:11 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:11.274346+0000 mon.smithi084 (mon.0) 819 : audit [DBG] from='client.? 172.21.15.84:0/2736802723' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-15T18:36:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.962+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fed680fedc0 con 0x7fed680f84e0 2024-02-15T18:36:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.963+0000 7fed4f7fe700 1 -- 172.21.15.84:0/3690059711 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v38) v1 ==== 107+0+4579 (secure 0 0 0) 0x7fed5804fde0 con 0x7fed680f84e0 2024-02-15T18:36:11.954 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:11.954 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:31:56.195144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24239":{"gid":24239,"name":"cephfs.smithi133.mkpnnx","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6825/652243261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":652243261},{"type":"v1","addr":"172.21.15.133:6825","nonce":652243261}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed50060f20 msgr2=0x7fed500633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed50060f20 0x7fed500633e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fed5c009f50 tx=0x7fed5c009b30).stop 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f84e0 msgr2=0x7fed680f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f84e0 0x7fed680f5890 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fed5800c790 tx=0x7fed58007d70).stop 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 shutdown_connections 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fed50060f20 0x7fed500633e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed680f7b40 0x7fed680f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 --2- 172.21.15.84:0/3690059711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed680f84e0 0x7fed680f5890 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 >> 172.21.15.84:0/3690059711 conn(0x7fed680f02c0 msgr2=0x7fed680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 shutdown_connections 2024-02-15T18:36:11.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:11.965+0000 7fed6d506700 1 -- 172.21.15.84:0/3690059711 wait complete. 2024-02-15T18:36:11.957 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-02-15T18:36:11.968 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-02-15T18:36:11.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-15T18:36:12.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.093+0000 7f043f5c4700 1 -- 172.21.15.84:0/2089158630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 msgr2=0x7f04380f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.093+0000 7f043f5c4700 1 --2- 172.21.15.84:0/2089158630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 0x7f04380f66d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f0434004660 tx=0x7f0434009b30).stop 2024-02-15T18:36:12.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.093+0000 7f043f5c4700 1 -- 172.21.15.84:0/2089158630 shutdown_connections 2024-02-15T18:36:12.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.093+0000 7f043f5c4700 1 --2- 172.21.15.84:0/2089158630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 0x7f04380f66d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.093+0000 7f043f5c4700 1 --2- 172.21.15.84:0/2089158630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04380f5390 0x7f04380f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.093+0000 7f043f5c4700 1 -- 172.21.15.84:0/2089158630 >> 172.21.15.84:0/2089158630 conn(0x7f04380f0b70 msgr2=0x7f04380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.093+0000 7f043f5c4700 1 -- 172.21.15.84:0/2089158630 shutdown_connections 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.093+0000 7f043f5c4700 1 -- 172.21.15.84:0/2089158630 wait complete. 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.093+0000 7f043f5c4700 1 Processor -- start 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043f5c4700 1 -- start start 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043f5c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04380f5390 0x7f0438106cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043f5c4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 0x7f04381071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043f5c4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04381077c0 con 0x7f04380f5ca0 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043f5c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0438107900 con 0x7f04380f5390 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043cb5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 0x7f04381071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043cb5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 0x7f04381071c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49968/0 (socket says 172.21.15.84:49968) 2024-02-15T18:36:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043cb5f700 1 -- 172.21.15.84:0/1011181865 learned_addr learned my addr 172.21.15.84:0/1011181865 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043d360700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04380f5390 0x7f0438106cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043cb5f700 1 -- 172.21.15.84:0/1011181865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04380f5390 msgr2=0x7f0438106cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043cb5f700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04380f5390 0x7f0438106cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043cb5f700 1 -- 172.21.15.84:0/1011181865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0434005040 con 0x7f04380f5ca0 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043d360700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04380f5390 0x7f0438106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043cb5f700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 0x7f04381071c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f0434009f50 tx=0x7f0434009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f042dffb700 1 -- 172.21.15.84:0/1011181865 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0434018070 con 0x7f04380f5ca0 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043810c2b0 con 0x7f04380f5ca0 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f042dffb700 1 -- 172.21.15.84:0/1011181865 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f0434007ba0 con 0x7f04380f5ca0 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.094+0000 7f042dffb700 1 -- 172.21.15.84:0/1011181865 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f043401c620 con 0x7f04380f5ca0 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.095+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043810c790 con 0x7f04380f5ca0 2024-02-15T18:36:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.095+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04380fdc90 con 0x7f04380f5ca0 2024-02-15T18:36:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.096+0000 7f042dffb700 1 -- 172.21.15.84:0/1011181865 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f043401c890 con 0x7f04380f5ca0 2024-02-15T18:36:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.096+0000 7f042dffb700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0424060f20 0x7f04240633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.096+0000 7f042dffb700 1 -- 172.21.15.84:0/1011181865 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f043407e000 con 0x7f04380f5ca0 2024-02-15T18:36:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.096+0000 7f043d360700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0424060f20 0x7f04240633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.096+0000 7f043d360700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0424060f20 0x7f04240633e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0428009880 tx=0x7f042800b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.100+0000 7f042dffb700 1 -- 172.21.15.84:0/1011181865 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f043404e3e0 con 0x7f04380f5ca0 2024-02-15T18:36:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.302+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f043810d2c0 con 0x7f04380f5ca0 2024-02-15T18:36:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.303+0000 7f042dffb700 1 -- 172.21.15.84:0/1011181865 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v38) v1 ==== 107+0+3802 (secure 0 0 0) 0x7f0434051a00 con 0x7f04380f5ca0 2024-02-15T18:36:12.294 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:12.294 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:35.091850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":0,"incarnation":28,"state":"up:replay","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0424060f20 msgr2=0x7f04240633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0424060f20 0x7f04240633e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0428009880 tx=0x7f042800b040).stop 2024-02-15T18:36:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 msgr2=0x7f04381071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 0x7f04381071c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f0434009f50 tx=0x7f0434009b30).stop 2024-02-15T18:36:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 shutdown_connections 2024-02-15T18:36:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f0424060f20 0x7f04240633e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04380f5390 0x7f0438106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 --2- 172.21.15.84:0/1011181865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04380f5ca0 0x7f04381071c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 >> 172.21.15.84:0/1011181865 conn(0x7f04380f0b70 msgr2=0x7f043805fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 shutdown_connections 2024-02-15T18:36:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.305+0000 7f043f5c4700 1 -- 172.21.15.84:0/1011181865 wait complete. 2024-02-15T18:36:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 28 2024-02-15T18:36:12.308 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-02-15T18:36:12.308 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-15T18:36:12.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.434+0000 7f830d155700 1 -- 172.21.15.84:0/3108272780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 msgr2=0x7f83080f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.434+0000 7f830d155700 1 --2- 172.21.15.84:0/3108272780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 0x7f83080f66f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f82fc004660 tx=0x7f82fc009b30).stop 2024-02-15T18:36:12.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.434+0000 7f830d155700 1 -- 172.21.15.84:0/3108272780 shutdown_connections 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.434+0000 7f830d155700 1 --2- 172.21.15.84:0/3108272780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 0x7f83080f66f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.434+0000 7f830d155700 1 --2- 172.21.15.84:0/3108272780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83080f53b0 0x7f83080f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.434+0000 7f830d155700 1 -- 172.21.15.84:0/3108272780 >> 172.21.15.84:0/3108272780 conn(0x7f83080f0bd0 msgr2=0x7f83080f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.434+0000 7f830d155700 1 -- 172.21.15.84:0/3108272780 shutdown_connections 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.434+0000 7f830d155700 1 -- 172.21.15.84:0/3108272780 wait complete. 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.434+0000 7f830d155700 1 Processor -- start 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830d155700 1 -- start start 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830d155700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83080f53b0 0x7f8308106c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830d155700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 0x7f8308107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830d155700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8308107760 con 0x7f83080f5cc0 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830d155700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83081078d0 con 0x7f83080f53b0 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 0x7f8308107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 0x7f8308107160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49990/0 (socket says 172.21.15.84:49990) 2024-02-15T18:36:12.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830659c700 1 -- 172.21.15.84:0/1768403655 learned_addr learned my addr 172.21.15.84:0/1768403655 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f8306d9d700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83080f53b0 0x7f8308106c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830659c700 1 -- 172.21.15.84:0/1768403655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83080f53b0 msgr2=0x7f8308106c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830659c700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83080f53b0 0x7f8308106c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830659c700 1 -- 172.21.15.84:0/1768403655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc005040 con 0x7f83080f5cc0 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830659c700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 0x7f8308107160 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f82fc009f50 tx=0x7f82fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f82ef7fe700 1 -- 172.21.15.84:0/1768403655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82fc018070 con 0x7f83080f5cc0 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f82ef7fe700 1 -- 172.21.15.84:0/1768403655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f82fc007d70 con 0x7f83080f5cc0 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f82ef7fe700 1 -- 172.21.15.84:0/1768403655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82fc01c620 con 0x7f83080f5cc0 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830810c2e0 con 0x7f83080f5cc0 2024-02-15T18:36:12.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.435+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830810c810 con 0x7f83080f5cc0 2024-02-15T18:36:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.436+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8308046330 con 0x7f83080f5cc0 2024-02-15T18:36:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.437+0000 7f82ef7fe700 1 -- 172.21.15.84:0/1768403655 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f82fc01c890 con 0x7f83080f5cc0 2024-02-15T18:36:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.437+0000 7f82ef7fe700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f82f0060f20 0x7f82f00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.437+0000 7f82ef7fe700 1 -- 172.21.15.84:0/1768403655 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f82fc07e020 con 0x7f83080f5cc0 2024-02-15T18:36:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.437+0000 7f8306d9d700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f82f0060f20 0x7f82f00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:12.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.437+0000 7f8306d9d700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f82f0060f20 0x7f82f00633e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f82f8007fd0 tx=0x7f82f8009040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:12.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.441+0000 7f82ef7fe700 1 -- 172.21.15.84:0/1768403655 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f82fc04e480 con 0x7f83080f5cc0 2024-02-15T18:36:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.647+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f83080fdcb0 con 0x7f83080f5cc0 2024-02-15T18:36:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.648+0000 7f82ef7fe700 1 -- 172.21.15.84:0/1768403655 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v38) v1 ==== 107+0+4581 (secure 0 0 0) 0x7f82fc051aa0 con 0x7f83080f5cc0 2024-02-15T18:36:12.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:12.638 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:35.091850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":0,"incarnation":28,"state":"up:replay","state_seq":2,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.649+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f82f0060f20 msgr2=0x7f82f00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.649+0000 7f830d155700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f82f0060f20 0x7f82f00633e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f82f8007fd0 tx=0x7f82f8009040).stop 2024-02-15T18:36:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.649+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 msgr2=0x7f8308107160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.649+0000 7f830d155700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 0x7f8308107160 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f82fc009f50 tx=0x7f82fc009b30).stop 2024-02-15T18:36:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.650+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 shutdown_connections 2024-02-15T18:36:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.650+0000 7f830d155700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f82f0060f20 0x7f82f00633e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.650+0000 7f830d155700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83080f53b0 0x7f8308106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.650+0000 7f830d155700 1 --2- 172.21.15.84:0/1768403655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83080f5cc0 0x7f8308107160 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.650+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 >> 172.21.15.84:0/1768403655 conn(0x7f83080f0bd0 msgr2=0x7f830805fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.650+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 shutdown_connections 2024-02-15T18:36:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.650+0000 7f830d155700 1 -- 172.21.15.84:0/1768403655 wait complete. 2024-02-15T18:36:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2024-02-15T18:36:12.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:36:10.818093+0000 mgr.smithi084.hjmnez (mgr.14596) 465 : cluster [DBG] pgmap v325: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:12.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:11.619395+0000 mon.smithi084 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.84:0/3081662876' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-15T18:36:12.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:11.963873+0000 mon.smithi084 (mon.0) 821 : audit [DBG] from='client.? 172.21.15.84:0/3690059711' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-15T18:36:12.651 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:12 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:12.303987+0000 mon.smithi084 (mon.0) 822 : audit [DBG] from='client.? 172.21.15.84:0/1011181865' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-15T18:36:12.652 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-02-15T18:36:12.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-15T18:36:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.778+0000 7fd8e6237700 1 -- 172.21.15.84:0/2112744162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5ca0 msgr2=0x7fd8e00f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.778+0000 7fd8e6237700 1 --2- 172.21.15.84:0/2112744162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5ca0 0x7fd8e00f66d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fd8d4004660 tx=0x7fd8d4009b30).stop 2024-02-15T18:36:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.778+0000 7fd8e6237700 1 -- 172.21.15.84:0/2112744162 shutdown_connections 2024-02-15T18:36:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.778+0000 7fd8e6237700 1 --2- 172.21.15.84:0/2112744162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5ca0 0x7fd8e00f66d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.778+0000 7fd8e6237700 1 --2- 172.21.15.84:0/2112744162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8e00f5390 0x7fd8e00f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.778+0000 7fd8e6237700 1 -- 172.21.15.84:0/2112744162 >> 172.21.15.84:0/2112744162 conn(0x7fd8e00f0b70 msgr2=0x7fd8e00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.778+0000 7fd8e6237700 1 -- 172.21.15.84:0/2112744162 shutdown_connections 2024-02-15T18:36:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.778+0000 7fd8e6237700 1 -- 172.21.15.84:0/2112744162 wait complete. 2024-02-15T18:36:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.779+0000 7fd8e6237700 1 Processor -- start 2024-02-15T18:36:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.779+0000 7fd8e6237700 1 -- start start 2024-02-15T18:36:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.779+0000 7fd8e6237700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5390 0x7fd8e0106c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.779+0000 7fd8e6237700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8e00f5ca0 0x7fd8e0107150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.779+0000 7fd8e6237700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0107750 con 0x7fd8e00f5390 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.779+0000 7fd8e6237700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0107890 con 0x7fd8e00f5ca0 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.779+0000 7fd8df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5390 0x7fd8e0106c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.779+0000 7fd8df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5390 0x7fd8e0106c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50012/0 (socket says 172.21.15.84:50012) 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.779+0000 7fd8df7fe700 1 -- 172.21.15.84:0/2097811312 learned_addr learned my addr 172.21.15.84:0/2097811312 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8deffd700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8e00f5ca0 0x7fd8e0107150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8df7fe700 1 -- 172.21.15.84:0/2097811312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8e00f5ca0 msgr2=0x7fd8e0107150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8df7fe700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8e00f5ca0 0x7fd8e0107150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8df7fe700 1 -- 172.21.15.84:0/2097811312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4005040 con 0x7fd8e00f5390 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8df7fe700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5390 0x7fd8e0106c60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fd8d000c510 tx=0x7fd8d0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8c7fff700 1 -- 172.21.15.84:0/2097811312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8d000f650 con 0x7fd8e00f5390 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8c7fff700 1 -- 172.21.15.84:0/2097811312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fd8d000fca0 con 0x7fd8e00f5390 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e010c2a0 con 0x7fd8e00f5390 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8c7fff700 1 -- 172.21.15.84:0/2097811312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8d0012df0 con 0x7fd8e00f5390 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.780+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e010c860 con 0x7fd8e00f5390 2024-02-15T18:36:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.781+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e00fdcb0 con 0x7fd8e00f5390 2024-02-15T18:36:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.781+0000 7fd8c7fff700 1 -- 172.21.15.84:0/2097811312 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd8d0010070 con 0x7fd8e00f5390 2024-02-15T18:36:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.782+0000 7fd8c7fff700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd8c8060ec0 0x7fd8c8063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.782+0000 7fd8c7fff700 1 -- 172.21.15.84:0/2097811312 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fd8d007bf50 con 0x7fd8e00f5390 2024-02-15T18:36:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.782+0000 7fd8deffd700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd8c8060ec0 0x7fd8c8063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.782+0000 7fd8deffd700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd8c8060ec0 0x7fd8c8063380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fd8d4009d60 tx=0x7fd8d4009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.786+0000 7fd8c7fff700 1 -- 172.21.15.84:0/2097811312 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd8d0047f60 con 0x7fd8e00f5390 2024-02-15T18:36:12.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:36:10.818093+0000 mgr.smithi084.hjmnez (mgr.14596) 465 : cluster [DBG] pgmap v325: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:12.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:11.619395+0000 mon.smithi084 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.84:0/3081662876' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-15T18:36:12.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:11.963873+0000 mon.smithi084 (mon.0) 821 : audit [DBG] from='client.? 172.21.15.84:0/3690059711' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-15T18:36:12.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:12 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:12.303987+0000 mon.smithi084 (mon.0) 822 : audit [DBG] from='client.? 172.21.15.84:0/1011181865' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-15T18:36:12.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.991+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fd8e010cef0 con 0x7fd8e00f5390 2024-02-15T18:36:12.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.991+0000 7fd8c7fff700 1 -- 172.21.15.84:0/2097811312 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v38) v1 ==== 107+0+4586 (secure 0 0 0) 0x7fd8d004c330 con 0x7fd8e00f5390 2024-02-15T18:36:12.982 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:12.982 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:43.098170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":129,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd8c8060ec0 msgr2=0x7fd8c8063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd8c8060ec0 0x7fd8c8063380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fd8d4009d60 tx=0x7fd8d4009b30).stop 2024-02-15T18:36:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5390 msgr2=0x7fd8e0106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5390 0x7fd8e0106c60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fd8d000c510 tx=0x7fd8d0007e00).stop 2024-02-15T18:36:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 shutdown_connections 2024-02-15T18:36:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd8c8060ec0 0x7fd8c8063380 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e00f5390 0x7fd8e0106c60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 --2- 172.21.15.84:0/2097811312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8e00f5ca0 0x7fd8e0107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 >> 172.21.15.84:0/2097811312 conn(0x7fd8e00f0b70 msgr2=0x7fd8e005fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 shutdown_connections 2024-02-15T18:36:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:12.993+0000 7fd8e6237700 1 -- 172.21.15.84:0/2097811312 wait complete. 2024-02-15T18:36:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 30 2024-02-15T18:36:12.996 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-02-15T18:36:12.996 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-15T18:36:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 -- 172.21.15.84:0/371154560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 msgr2=0x7f26380f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 --2- 172.21.15.84:0/371154560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 0x7f26380f7b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f2628004660 tx=0x7f2628009b30).stop 2024-02-15T18:36:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 -- 172.21.15.84:0/371154560 shutdown_connections 2024-02-15T18:36:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 --2- 172.21.15.84:0/371154560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 0x7f26380f7b90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 --2- 172.21.15.84:0/371154560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26380f6490 0x7f26380f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 -- 172.21.15.84:0/371154560 >> 172.21.15.84:0/371154560 conn(0x7f26380f1bd0 msgr2=0x7f26380f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 -- 172.21.15.84:0/371154560 shutdown_connections 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 -- 172.21.15.84:0/371154560 wait complete. 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 Processor -- start 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 -- start start 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26380f6490 0x7f263806b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 0x7f2638069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263806bd70 con 0x7f26380f7730 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.122+0000 7f263ca23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263806a310 con 0x7f26380f6490 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2635d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 0x7f2638069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2635d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 0x7f2638069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50024/0 (socket says 172.21.15.84:50024) 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2635d9b700 1 -- 172.21.15.84:0/198659195 learned_addr learned my addr 172.21.15.84:0/198659195 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f263659c700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26380f6490 0x7f263806b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2635d9b700 1 -- 172.21.15.84:0/198659195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26380f6490 msgr2=0x7f263806b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2635d9b700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26380f6490 0x7f263806b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2635d9b700 1 -- 172.21.15.84:0/198659195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628005040 con 0x7f26380f7730 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2635d9b700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 0x7f2638069e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f2628009f50 tx=0x7f2628009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2626ffd700 1 -- 172.21.15.84:0/198659195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2628018070 con 0x7f26380f7730 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263806a530 con 0x7f26380f7730 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2626ffd700 1 -- 172.21.15.84:0/198659195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f2628007ba0 con 0x7f26380f7730 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f2626ffd700 1 -- 172.21.15.84:0/198659195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f262801c620 con 0x7f26380f7730 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.123+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263806aa90 con 0x7f26380f7730 2024-02-15T18:36:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.124+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2638046330 con 0x7f26380f7730 2024-02-15T18:36:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.124+0000 7f2626ffd700 1 -- 172.21.15.84:0/198659195 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f262801c890 con 0x7f26380f7730 2024-02-15T18:36:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.125+0000 7f2626ffd700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2620060f20 0x7f26200633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.125+0000 7f2626ffd700 1 -- 172.21.15.84:0/198659195 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f262807e000 con 0x7f26380f7730 2024-02-15T18:36:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.125+0000 7f263659c700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2620060f20 0x7f26200633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.125+0000 7f263659c700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2620060f20 0x7f26200633e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f26380f7590 tx=0x7f262c009c00).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.129+0000 7f2626ffd700 1 -- 172.21.15.84:0/198659195 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2628051e10 con 0x7f26380f7730 2024-02-15T18:36:13.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.331+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f2638027a00 con 0x7f26380f7730 2024-02-15T18:36:13.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.331+0000 7f2626ffd700 1 -- 172.21.15.84:0/198659195 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v38) v1 ==== 107+0+4583 (secure 0 0 0) 0x7f2628051a00 con 0x7f26380f7730 2024-02-15T18:36:13.322 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:13.322 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:44.099901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":130,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:13.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2620060f20 msgr2=0x7f26200633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2620060f20 0x7f26200633e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f26380f7590 tx=0x7f262c009c00).stop 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 msgr2=0x7f2638069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 0x7f2638069e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f2628009f50 tx=0x7f2628009b30).stop 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 shutdown_connections 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f2620060f20 0x7f26200633e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26380f6490 0x7f263806b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 --2- 172.21.15.84:0/198659195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26380f7730 0x7f2638069e20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 >> 172.21.15.84:0/198659195 conn(0x7f26380f1bd0 msgr2=0x7f26380fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 shutdown_connections 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.333+0000 7f263ca23700 1 -- 172.21.15.84:0/198659195 wait complete. 2024-02-15T18:36:13.325 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 31 2024-02-15T18:36:13.336 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-02-15T18:36:13.336 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.462+0000 7f380358a700 1 -- 172.21.15.84:0/2690491346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f53b0 msgr2=0x7f37fc0f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.462+0000 7f380358a700 1 --2- 172.21.15.84:0/2690491346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f53b0 0x7f37fc0f57d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f37f0004660 tx=0x7f37f0009b30).stop 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.462+0000 7f380358a700 1 -- 172.21.15.84:0/2690491346 shutdown_connections 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.462+0000 7f380358a700 1 --2- 172.21.15.84:0/2690491346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc0f6650 0x7f37fc0f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.462+0000 7f380358a700 1 --2- 172.21.15.84:0/2690491346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f53b0 0x7f37fc0f57d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.462+0000 7f380358a700 1 -- 172.21.15.84:0/2690491346 >> 172.21.15.84:0/2690491346 conn(0x7f37fc0f0af0 msgr2=0x7f37fc0f2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.462+0000 7f380358a700 1 -- 172.21.15.84:0/2690491346 shutdown_connections 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.462+0000 7f380358a700 1 -- 172.21.15.84:0/2690491346 wait complete. 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f380358a700 1 Processor -- start 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f380358a700 1 -- start start 2024-02-15T18:36:13.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f380358a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc0f53b0 0x7f37fc105c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f380358a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f6650 0x7f37fc106120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f380358a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc106720 con 0x7f37fc0f6650 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f380358a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc106860 con 0x7f37fc0f53b0 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f3800b25700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f6650 0x7f37fc106120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f3800b25700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f6650 0x7f37fc106120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55052/0 (socket says 172.21.15.84:55052) 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f3800b25700 1 -- 172.21.15.84:0/49819030 learned_addr learned my addr 172.21.15.84:0/49819030 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f3801326700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc0f53b0 0x7f37fc105c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f3800b25700 1 -- 172.21.15.84:0/49819030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc0f53b0 msgr2=0x7f37fc105c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f3800b25700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc0f53b0 0x7f37fc105c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f3800b25700 1 -- 172.21.15.84:0/49819030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0005040 con 0x7f37fc0f6650 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.463+0000 7f3800b25700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f6650 0x7f37fc106120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f37f80026d0 tx=0x7f37f8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.464+0000 7f37edffb700 1 -- 172.21.15.84:0/49819030 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f80079c0 con 0x7f37fc0f6650 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.464+0000 7f37edffb700 1 -- 172.21.15.84:0/49819030 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f37f800f040 con 0x7f37fc0f6650 2024-02-15T18:36:13.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.464+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc10b270 con 0x7f37fc0f6650 2024-02-15T18:36:13.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.464+0000 7f37edffb700 1 -- 172.21.15.84:0/49819030 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f80149f0 con 0x7f37fc0f6650 2024-02-15T18:36:13.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.464+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc10b830 con 0x7f37fc0f6650 2024-02-15T18:36:13.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.465+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc027a00 con 0x7f37fc0f6650 2024-02-15T18:36:13.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.465+0000 7f37edffb700 1 -- 172.21.15.84:0/49819030 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f37f8014b50 con 0x7f37fc0f6650 2024-02-15T18:36:13.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.465+0000 7f37edffb700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f37e8060f20 0x7f37e80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:13.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.465+0000 7f37edffb700 1 -- 172.21.15.84:0/49819030 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f37f807c170 con 0x7f37fc0f6650 2024-02-15T18:36:13.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.465+0000 7f3801326700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f37e8060f20 0x7f37e80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:13.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.466+0000 7f3801326700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f37e8060f20 0x7f37e80633e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f37fc107120 tx=0x7f37f0009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:13.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.470+0000 7f37edffb700 1 -- 172.21.15.84:0/49819030 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f37f804c550 con 0x7f37fc0f6650 2024-02-15T18:36:13.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.681+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f37fc0fdc80 con 0x7f37fc0f6650 2024-02-15T18:36:13.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.682+0000 7f37edffb700 1 -- 172.21.15.84:0/49819030 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v38) v1 ==== 107+0+4583 (secure 0 0 0) 0x7f37f804fb70 con 0x7f37fc0f6650 2024-02-15T18:36:13.673 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:13.673 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:45.107994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi133.ubglfw","rank":0,"incarnation":28,"state":"up:active","state_seq":131,"addr":"172.21.15.133:6827/560284334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":560284334},{"type":"v1","addr":"172.21.15.133:6827","nonce":560284334}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f37e8060f20 msgr2=0x7f37e80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f37e8060f20 0x7f37e80633e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f37fc107120 tx=0x7f37f0009b30).stop 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f6650 msgr2=0x7f37fc106120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f6650 0x7f37fc106120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f37f80026d0 tx=0x7f37f8009de0).stop 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 shutdown_connections 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f37e8060f20 0x7f37e80633e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc0f53b0 0x7f37fc105c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 --2- 172.21.15.84:0/49819030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37fc0f6650 0x7f37fc106120 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 >> 172.21.15.84:0/49819030 conn(0x7f37fc0f0af0 msgr2=0x7f37fc0fa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 shutdown_connections 2024-02-15T18:36:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.684+0000 7f380358a700 1 -- 172.21.15.84:0/49819030 wait complete. 2024-02-15T18:36:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 32 2024-02-15T18:36:13.686 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:12.648539+0000 mon.smithi084 (mon.0) 823 : audit [DBG] from='client.? 172.21.15.84:0/1768403655' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-15T18:36:13.686 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:12.992174+0000 mon.smithi084 (mon.0) 824 : audit [DBG] from='client.? 172.21.15.84:0/2097811312' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-15T18:36:13.686 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:13 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:13.332326+0000 mon.smithi084 (mon.0) 825 : audit [DBG] from='client.? 172.21.15.84:0/198659195' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-15T18:36:13.687 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-02-15T18:36:13.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-15T18:36:13.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 -- 172.21.15.84:0/3778091039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 msgr2=0x7f22cc0f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 --2- 172.21.15.84:0/3778091039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 0x7f22cc0f91b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f22bc004660 tx=0x7f22bc009b30).stop 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 -- 172.21.15.84:0/3778091039 shutdown_connections 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 --2- 172.21.15.84:0/3778091039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0f96a0 0x7f22cc0fba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 --2- 172.21.15.84:0/3778091039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 0x7f22cc0f91b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 -- 172.21.15.84:0/3778091039 >> 172.21.15.84:0/3778091039 conn(0x7f22cc0f0bd0 msgr2=0x7f22cc0f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 -- 172.21.15.84:0/3778091039 shutdown_connections 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 -- 172.21.15.84:0/3778091039 wait complete. 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 Processor -- start 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 -- start start 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 0x7f22cc106d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0f96a0 0x7f22cc107200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc107800 con 0x7f22cc05fe30 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.822+0000 7f22d08be700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc107940 con 0x7f22cc0f96a0 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22ca59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 0x7f22cc106d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22ca59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 0x7f22cc106d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55082/0 (socket says 172.21.15.84:55082) 2024-02-15T18:36:13.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22ca59c700 1 -- 172.21.15.84:0/1743778820 learned_addr learned my addr 172.21.15.84:0/1743778820 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22c9d9b700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0f96a0 0x7f22cc107200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22ca59c700 1 -- 172.21.15.84:0/1743778820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0f96a0 msgr2=0x7f22cc107200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22ca59c700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0f96a0 0x7f22cc107200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22ca59c700 1 -- 172.21.15.84:0/1743778820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc005040 con 0x7f22cc05fe30 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22ca59c700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 0x7f22cc106d10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f22bc002040 tx=0x7f22bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22baffd700 1 -- 172.21.15.84:0/1743778820 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22bc019070 con 0x7f22cc05fe30 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22baffd700 1 -- 172.21.15.84:0/1743778820 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f22bc007e80 con 0x7f22cc05fe30 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22baffd700 1 -- 172.21.15.84:0/1743778820 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22bc014db0 con 0x7f22cc05fe30 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc10c2f0 con 0x7f22cc05fe30 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.823+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc10c850 con 0x7f22cc05fe30 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.824+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc027a00 con 0x7f22cc05fe30 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.824+0000 7f22baffd700 1 -- 172.21.15.84:0/1743778820 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f22bc025070 con 0x7f22cc05fe30 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.825+0000 7f22baffd700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f22b4060ec0 0x7f22b4063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.825+0000 7f22baffd700 1 -- 172.21.15.84:0/1743778820 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f22bc07d090 con 0x7f22cc05fe30 2024-02-15T18:36:13.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.825+0000 7f22c9d9b700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f22b4060ec0 0x7f22b4063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:13.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.825+0000 7f22c9d9b700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f22b4060ec0 0x7f22b4063380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f22c0009fd0 tx=0x7f22c000b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:13.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:13.829+0000 7f22baffd700 1 -- 172.21.15.84:0/1743778820 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f22bc04d410 con 0x7f22cc05fe30 2024-02-15T18:36:13.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:12.648539+0000 mon.smithi084 (mon.0) 823 : audit [DBG] from='client.? 172.21.15.84:0/1768403655' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-15T18:36:13.886 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:12.992174+0000 mon.smithi084 (mon.0) 824 : audit [DBG] from='client.? 172.21.15.84:0/2097811312' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-15T18:36:13.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:13 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:13.332326+0000 mon.smithi084 (mon.0) 825 : audit [DBG] from='client.? 172.21.15.84:0/198659195' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-15T18:36:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.048+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f22cc0fed90 con 0x7f22cc05fe30 2024-02-15T18:36:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.048+0000 7f22baffd700 1 -- 172.21.15.84:0/1743778820 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v38) v1 ==== 107+0+3802 (secure 0 0 0) 0x7f22bc023070 con 0x7f22cc05fe30 2024-02-15T18:36:14.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:14.039 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:50.095066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34338},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34338":{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f22b4060ec0 msgr2=0x7f22b4063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f22b4060ec0 0x7f22b4063380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f22c0009fd0 tx=0x7f22c000b040).stop 2024-02-15T18:36:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 msgr2=0x7f22cc106d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 0x7f22cc106d10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f22bc002040 tx=0x7f22bc00b040).stop 2024-02-15T18:36:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 shutdown_connections 2024-02-15T18:36:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f22b4060ec0 0x7f22b4063380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc05fe30 0x7f22cc106d10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 --2- 172.21.15.84:0/1743778820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0f96a0 0x7f22cc107200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 >> 172.21.15.84:0/1743778820 conn(0x7f22cc0f0bd0 msgr2=0x7f22cc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 shutdown_connections 2024-02-15T18:36:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.050+0000 7f22d08be700 1 -- 172.21.15.84:0/1743778820 wait complete. 2024-02-15T18:36:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 33 2024-02-15T18:36:14.053 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-02-15T18:36:14.053 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-15T18:36:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.181+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1914632983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5ca0 msgr2=0x7f1f140f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.181+0000 7f1f1a4e7700 1 --2- 172.21.15.84:0/1914632983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5ca0 0x7f1f140f66d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f1f08004660 tx=0x7f1f08009b30).stop 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.181+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1914632983 shutdown_connections 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.181+0000 7f1f1a4e7700 1 --2- 172.21.15.84:0/1914632983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5ca0 0x7f1f140f66d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.181+0000 7f1f1a4e7700 1 --2- 172.21.15.84:0/1914632983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f140f5390 0x7f1f140f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.181+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1914632983 >> 172.21.15.84:0/1914632983 conn(0x7f1f140f0b70 msgr2=0x7f1f140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.181+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1914632983 shutdown_connections 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.181+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1914632983 wait complete. 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f1a4e7700 1 Processor -- start 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f1a4e7700 1 -- start start 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f1a4e7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5390 0x7f1f14105c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f1a4e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f140f5ca0 0x7f1f141060f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f1a4e7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f141066f0 con 0x7f1f140f5390 2024-02-15T18:36:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f1a4e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14106830 con 0x7f1f140f5ca0 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5390 0x7f1f14105c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5390 0x7f1f14105c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55102/0 (socket says 172.21.15.84:55102) 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f13fff700 1 -- 172.21.15.84:0/1440688250 learned_addr learned my addr 172.21.15.84:0/1440688250 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f137fe700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f140f5ca0 0x7f1f141060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f13fff700 1 -- 172.21.15.84:0/1440688250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f140f5ca0 msgr2=0x7f1f141060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f13fff700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f140f5ca0 0x7f1f141060f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.182+0000 7f1f13fff700 1 -- 172.21.15.84:0/1440688250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f08005040 con 0x7f1f140f5390 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.183+0000 7f1f13fff700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5390 0x7f1f14105c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f1f0400e7f0 tx=0x7f1f0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.183+0000 7f1f10ff9700 1 -- 172.21.15.84:0/1440688250 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f040092e0 con 0x7f1f140f5390 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.183+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1410b240 con 0x7f1f140f5390 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.183+0000 7f1f10ff9700 1 -- 172.21.15.84:0/1440688250 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f1f0400f040 con 0x7f1f140f5390 2024-02-15T18:36:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.183+0000 7f1f10ff9700 1 -- 172.21.15.84:0/1440688250 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f04014850 con 0x7f1f140f5390 2024-02-15T18:36:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.183+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1410b800 con 0x7f1f140f5390 2024-02-15T18:36:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.184+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f14027a00 con 0x7f1f140f5390 2024-02-15T18:36:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.184+0000 7f1f10ff9700 1 -- 172.21.15.84:0/1440688250 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f1f0401b030 con 0x7f1f140f5390 2024-02-15T18:36:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.184+0000 7f1f10ff9700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1efc060f20 0x7f1efc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:14.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.185+0000 7f1f10ff9700 1 -- 172.21.15.84:0/1440688250 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f1f0407bed0 con 0x7f1f140f5390 2024-02-15T18:36:14.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.185+0000 7f1f137fe700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1efc060f20 0x7f1efc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:14.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.185+0000 7f1f137fe700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1efc060f20 0x7f1efc0633e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f1f08009720 tx=0x7f1f08016040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.189+0000 7f1f10ff9700 1 -- 172.21.15.84:0/1440688250 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1f0404c360 con 0x7f1f140f5390 2024-02-15T18:36:14.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.399+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f1f140586e0 con 0x7f1f140f5390 2024-02-15T18:36:14.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.399+0000 7f1f10ff9700 1 -- 172.21.15.84:0/1440688250 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v38) v1 ==== 107+0+4588 (secure 0 0 0) 0x7f1f04019020 con 0x7f1f140f5390 2024-02-15T18:36:14.390 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:14.390 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44299,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6827/2979200029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2979200029},{"type":"v1","addr":"172.21.15.133:6827","nonce":2979200029}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:57.513306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34338},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34338":{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":0,"incarnation":33,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.401+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1efc060f20 msgr2=0x7f1efc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.401+0000 7f1f1a4e7700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1efc060f20 0x7f1efc0633e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f1f08009720 tx=0x7f1f08016040).stop 2024-02-15T18:36:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.401+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5390 msgr2=0x7f1f14105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.401+0000 7f1f1a4e7700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5390 0x7f1f14105c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f1f0400e7f0 tx=0x7f1f0400b040).stop 2024-02-15T18:36:14.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.401+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 shutdown_connections 2024-02-15T18:36:14.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.402+0000 7f1f1a4e7700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1efc060f20 0x7f1efc0633e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.402+0000 7f1f1a4e7700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f140f5390 0x7f1f14105c00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.402+0000 7f1f1a4e7700 1 --2- 172.21.15.84:0/1440688250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f140f5ca0 0x7f1f141060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.402+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 >> 172.21.15.84:0/1440688250 conn(0x7f1f140f0b70 msgr2=0x7f1f140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:14.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.402+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 shutdown_connections 2024-02-15T18:36:14.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.402+0000 7f1f1a4e7700 1 -- 172.21.15.84:0/1440688250 wait complete. 2024-02-15T18:36:14.393 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 34 2024-02-15T18:36:14.404 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-02-15T18:36:14.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 -- 172.21.15.84:0/2517617887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 msgr2=0x7f1a8c0f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 --2- 172.21.15.84:0/2517617887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 0x7f1a8c0f57c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f1a7c004660 tx=0x7f1a7c009b30).stop 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 -- 172.21.15.84:0/2517617887 shutdown_connections 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 --2- 172.21.15.84:0/2517617887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a8c0f5cb0 0x7f1a8c0f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 --2- 172.21.15.84:0/2517617887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 0x7f1a8c0f57c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 -- 172.21.15.84:0/2517617887 >> 172.21.15.84:0/2517617887 conn(0x7f1a8c0f0b40 msgr2=0x7f1a8c0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 -- 172.21.15.84:0/2517617887 shutdown_connections 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 -- 172.21.15.84:0/2517617887 wait complete. 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 Processor -- start 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 -- start start 2024-02-15T18:36:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 0x7f1a8c05fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a8c0f5cb0 0x7f1a8c10ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c10bf80 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a94684700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c10c0c0 con 0x7f1a8c0f5cb0 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.532+0000 7f1a92420700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 0x7f1a8c05fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a92420700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 0x7f1a8c05fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55122/0 (socket says 172.21.15.84:55122) 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a92420700 1 -- 172.21.15.84:0/1971714507 learned_addr learned my addr 172.21.15.84:0/1971714507 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a91c1f700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a8c0f5cb0 0x7f1a8c10ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a92420700 1 -- 172.21.15.84:0/1971714507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a8c0f5cb0 msgr2=0x7f1a8c10ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a92420700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a8c0f5cb0 0x7f1a8c10ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a92420700 1 -- 172.21.15.84:0/1971714507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c005040 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a91c1f700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a8c0f5cb0 0x7f1a8c10ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a92420700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 0x7f1a8c05fd70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f1a7c009830 tx=0x7f1a7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a82ffd700 1 -- 172.21.15.84:0/1971714507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7c018070 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a82ffd700 1 -- 172.21.15.84:0/1971714507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f1a7c007ba0 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c10c2c0 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a82ffd700 1 -- 172.21.15.84:0/1971714507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7c01c620 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.533+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c10c820 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.534+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c027a00 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.534+0000 7f1a82ffd700 1 -- 172.21.15.84:0/1971714507 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f1a7c01c890 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.535+0000 7f1a82ffd700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1a78060f20 0x7f1a780633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:14.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.535+0000 7f1a82ffd700 1 -- 172.21.15.84:0/1971714507 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f1a7c07dff0 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.535+0000 7f1a91c1f700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1a78060f20 0x7f1a780633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:14.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.535+0000 7f1a91c1f700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1a78060f20 0x7f1a780633e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f1a88009fd0 tx=0x7f1a8800b040).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.539+0000 7f1a82ffd700 1 -- 172.21.15.84:0/1971714507 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1a7c051da0 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.744+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f1a8c0586e0 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.745+0000 7f1a82ffd700 1 -- 172.21.15.84:0/1971714507 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v38) v1 ==== 107+0+4585 (secure 0 0 0) 0x7f1a7c051990 con 0x7f1a8c0f53a0 2024-02-15T18:36:14.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:14.736 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44299,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6827/2979200029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2979200029},{"type":"v1","addr":"172.21.15.133:6827","nonce":2979200029}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:58.518029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34338},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34338":{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:14.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1a78060f20 msgr2=0x7f1a780633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1a78060f20 0x7f1a780633e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f1a88009fd0 tx=0x7f1a8800b040).stop 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 msgr2=0x7f1a8c05fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 0x7f1a8c05fd70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f1a7c009830 tx=0x7f1a7c009b30).stop 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 shutdown_connections 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f1a78060f20 0x7f1a780633e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a8c0f53a0 0x7f1a8c05fd70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 --2- 172.21.15.84:0/1971714507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a8c0f5cb0 0x7f1a8c10ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 >> 172.21.15.84:0/1971714507 conn(0x7f1a8c0f0b40 msgr2=0x7f1a8c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 shutdown_connections 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.747+0000 7f1a94684700 1 -- 172.21.15.84:0/1971714507 wait complete. 2024-02-15T18:36:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 35 2024-02-15T18:36:14.748 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:36:12.818496+0000 mgr.smithi084.hjmnez (mgr.14596) 466 : cluster [DBG] pgmap v326: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:14.748 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:13.621201+0000 mon.smithi084 (mon.0) 826 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:14.748 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:13.682797+0000 mon.smithi084 (mon.0) 827 : audit [DBG] from='client.? 172.21.15.84:0/49819030' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-15T18:36:14.748 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:13.934669+0000 mon.smithi084 (mon.0) 828 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:14.748 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:13.935301+0000 mon.smithi084 (mon.0) 829 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:14.748 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:13.941163+0000 mon.smithi084 (mon.0) 830 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:36:14.749 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:14.049091+0000 mon.smithi084 (mon.0) 831 : audit [DBG] from='client.? 172.21.15.84:0/1743778820' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-15T18:36:14.749 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:14 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:14.400301+0000 mon.smithi084 (mon.0) 832 : audit [DBG] from='client.? 172.21.15.84:0/1440688250' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-15T18:36:14.750 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-02-15T18:36:14.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-02-15T18:36:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.876+0000 7f5bc3afa700 1 -- 172.21.15.84:0/4168752292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f5390 msgr2=0x7f5bbc0f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.876+0000 7f5bc3afa700 1 --2- 172.21.15.84:0/4168752292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f5390 0x7f5bbc0f57b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5bac004660 tx=0x7f5bac009b30).stop 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.876+0000 7f5bc3afa700 1 -- 172.21.15.84:0/4168752292 shutdown_connections 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.876+0000 7f5bc3afa700 1 --2- 172.21.15.84:0/4168752292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0f6630 0x7f5bbc0f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.876+0000 7f5bc3afa700 1 --2- 172.21.15.84:0/4168752292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f5390 0x7f5bbc0f57b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.876+0000 7f5bc3afa700 1 -- 172.21.15.84:0/4168752292 >> 172.21.15.84:0/4168752292 conn(0x7f5bbc0f0ad0 msgr2=0x7f5bbc0f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.876+0000 7f5bc3afa700 1 -- 172.21.15.84:0/4168752292 shutdown_connections 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.876+0000 7f5bc3afa700 1 -- 172.21.15.84:0/4168752292 wait complete. 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc3afa700 1 Processor -- start 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc3afa700 1 -- start start 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc3afa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0f5390 0x7f5bbc060120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc3afa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f6630 0x7f5bbc10baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc3afa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc10bfe0 con 0x7f5bbc0f6630 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc3afa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc10c120 con 0x7f5bbc0f5390 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc1095700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f6630 0x7f5bbc10baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc1095700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f6630 0x7f5bbc10baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55130/0 (socket says 172.21.15.84:55130) 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc1095700 1 -- 172.21.15.84:0/888764903 learned_addr learned my addr 172.21.15.84:0/888764903 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc1896700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0f5390 0x7f5bbc060120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc1095700 1 -- 172.21.15.84:0/888764903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0f5390 msgr2=0x7f5bbc060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc1095700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0f5390 0x7f5bbc060120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc1095700 1 -- 172.21.15.84:0/888764903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac005040 con 0x7f5bbc0f6630 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc1896700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0f5390 0x7f5bbc060120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc1095700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f6630 0x7f5bbc10baf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f5bb8002700 tx=0x7f5bb8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bb27fc700 1 -- 172.21.15.84:0/888764903 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb8009320 con 0x7f5bbc0f6630 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc10c380 con 0x7f5bbc0f6630 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bb27fc700 1 -- 172.21.15.84:0/888764903 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f5bb800f040 con 0x7f5bbc0f6630 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bb27fc700 1 -- 172.21.15.84:0/888764903 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb8014a40 con 0x7f5bbc0f6630 2024-02-15T18:36:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.877+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc10c940 con 0x7f5bbc0f6630 2024-02-15T18:36:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.878+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc027a00 con 0x7f5bbc0f6630 2024-02-15T18:36:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.879+0000 7f5bb27fc700 1 -- 172.21.15.84:0/888764903 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f5bb801e440 con 0x7f5bbc0f6630 2024-02-15T18:36:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.879+0000 7f5bb27fc700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5ba8060f20 0x7f5ba80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.879+0000 7f5bb27fc700 1 -- 172.21.15.84:0/888764903 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f5bb807c760 con 0x7f5bbc0f6630 2024-02-15T18:36:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.879+0000 7f5bc1896700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5ba8060f20 0x7f5ba80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.879+0000 7f5bc1896700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5ba8060f20 0x7f5ba80633e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5bac005010 tx=0x7f5bac009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:14.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:14.883+0000 7f5bb27fc700 1 -- 172.21.15.84:0/888764903 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5bb8050570 con 0x7f5bbc0f6630 2024-02-15T18:36:14.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:36:12.818496+0000 mgr.smithi084.hjmnez (mgr.14596) 466 : cluster [DBG] pgmap v326: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:14.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:13.621201+0000 mon.smithi084 (mon.0) 826 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:14.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:13.682797+0000 mon.smithi084 (mon.0) 827 : audit [DBG] from='client.? 172.21.15.84:0/49819030' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-15T18:36:14.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:13.934669+0000 mon.smithi084 (mon.0) 828 : audit [DBG] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:14.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:13.935301+0000 mon.smithi084 (mon.0) 829 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:14.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:13.941163+0000 mon.smithi084 (mon.0) 830 : audit [INF] from='mgr.14596 172.21.15.84:0/2070533856' entity='mgr.smithi084.hjmnez' 2024-02-15T18:36:14.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:14.049091+0000 mon.smithi084 (mon.0) 831 : audit [DBG] from='client.? 172.21.15.84:0/1743778820' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-15T18:36:14.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:14 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:14.400301+0000 mon.smithi084 (mon.0) 832 : audit [DBG] from='client.? 172.21.15.84:0/1440688250' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-15T18:36:15.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.087+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f5bbc0fdc60 con 0x7f5bbc0f6630 2024-02-15T18:36:15.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.088+0000 7f5bb27fc700 1 -- 172.21.15.84:0/888764903 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v38) v1 ==== 107+0+4585 (secure 0 0 0) 0x7f5bb8050160 con 0x7f5bbc0f6630 2024-02-15T18:36:15.078 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:15.078 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi084.spootv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44299,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6827/2979200029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2979200029},{"type":"v1","addr":"172.21.15.133:6827","nonce":2979200029}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:59.519944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0],"up":{"mds_0":34338},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34338":{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":0,"incarnation":33,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5ba8060f20 msgr2=0x7f5ba80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5ba8060f20 0x7f5ba80633e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5bac005010 tx=0x7f5bac009b30).stop 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f6630 msgr2=0x7f5bbc10baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f6630 0x7f5bbc10baf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f5bb8002700 tx=0x7f5bb8009de0).stop 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 shutdown_connections 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7f5ba8060f20 0x7f5ba80633e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0f5390 0x7f5bbc060120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 --2- 172.21.15.84:0/888764903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bbc0f6630 0x7f5bbc10baf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 >> 172.21.15.84:0/888764903 conn(0x7f5bbc0f0ad0 msgr2=0x7f5bbc0fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 shutdown_connections 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.090+0000 7f5bc3afa700 1 -- 172.21.15.84:0/888764903 wait complete. 2024-02-15T18:36:15.081 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 36 2024-02-15T18:36:15.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.223+0000 7fd99285d700 1 -- 172.21.15.84:0/25421603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f7730 msgr2=0x7fd98c0f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.223+0000 7fd99285d700 1 --2- 172.21.15.84:0/25421603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f7730 0x7fd98c0f7b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fd980004660 tx=0x7fd980009b30).stop 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.223+0000 7fd99285d700 1 -- 172.21.15.84:0/25421603 shutdown_connections 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.223+0000 7fd99285d700 1 --2- 172.21.15.84:0/25421603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f7730 0x7fd98c0f7b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.223+0000 7fd99285d700 1 --2- 172.21.15.84:0/25421603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd98c0f6490 0x7fd98c0f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.223+0000 7fd99285d700 1 -- 172.21.15.84:0/25421603 >> 172.21.15.84:0/25421603 conn(0x7fd98c0f1bd0 msgr2=0x7fd98c0f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.223+0000 7fd99285d700 1 -- 172.21.15.84:0/25421603 shutdown_connections 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.223+0000 7fd99285d700 1 -- 172.21.15.84:0/25421603 wait complete. 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd99285d700 1 Processor -- start 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd99285d700 1 -- start start 2024-02-15T18:36:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd99285d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f6490 0x7fd98c106d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd99285d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd98c0f7730 0x7fd98c107210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd99285d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c107810 con 0x7fd98c0f6490 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd99285d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c107950 con 0x7fd98c0f7730 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd98bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f6490 0x7fd98c106d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd98bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f6490 0x7fd98c106d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55158/0 (socket says 172.21.15.84:55158) 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd98bfff700 1 -- 172.21.15.84:0/2156708150 learned_addr learned my addr 172.21.15.84:0/2156708150 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.224+0000 7fd98b7fe700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd98c0f7730 0x7fd98c107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.225+0000 7fd98bfff700 1 -- 172.21.15.84:0/2156708150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd98c0f7730 msgr2=0x7fd98c107210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.225+0000 7fd98bfff700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd98c0f7730 0x7fd98c107210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.225+0000 7fd98bfff700 1 -- 172.21.15.84:0/2156708150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd980005040 con 0x7fd98c0f6490 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.225+0000 7fd98bfff700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f6490 0x7fd98c106d20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd97c00c510 tx=0x7fd97c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.225+0000 7fd988ff9700 1 -- 172.21.15.84:0/2156708150 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd97c00f650 con 0x7fd98c0f6490 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.225+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c10c360 con 0x7fd98c0f6490 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.225+0000 7fd988ff9700 1 -- 172.21.15.84:0/2156708150 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fd97c00fca0 con 0x7fd98c0f6490 2024-02-15T18:36:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.225+0000 7fd988ff9700 1 -- 172.21.15.84:0/2156708150 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd97c012dd0 con 0x7fd98c0f6490 2024-02-15T18:36:15.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.225+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c10c920 con 0x7fd98c0f6490 2024-02-15T18:36:15.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.226+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c027a00 con 0x7fd98c0f6490 2024-02-15T18:36:15.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.227+0000 7fd988ff9700 1 -- 172.21.15.84:0/2156708150 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 31) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd97c010070 con 0x7fd98c0f6490 2024-02-15T18:36:15.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.227+0000 7fd988ff9700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd974060f20 0x7fd9740633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:15.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.227+0000 7fd988ff9700 1 -- 172.21.15.84:0/2156708150 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fd97c07c310 con 0x7fd98c0f6490 2024-02-15T18:36:15.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.227+0000 7fd98b7fe700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd974060f20 0x7fd9740633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:15.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.227+0000 7fd98b7fe700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd974060f20 0x7fd9740633e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fd980009f50 tx=0x7fd980009b30).ready entity=mgr.14596 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:15.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.231+0000 7fd988ff9700 1 -- 172.21.15.84:0/2156708150 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd97c04c820 con 0x7fd98c0f6490 2024-02-15T18:36:15.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.433+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fd98c0fed80 con 0x7fd98c0f6490 2024-02-15T18:36:15.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.433+0000 7fd988ff9700 1 -- 172.21.15.84:0/2156708150 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v38) v1 ==== 107+0+4602 (secure 0 0 0) 0x7fd97c04fe40 con 0x7fd98c0f6490 2024-02-15T18:36:15.424 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-02-15T18:36:15.424 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44295,"name":"cephfs.smithi133.mkpnnx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/553393719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":553393719},{"type":"v1","addr":"172.21.15.133:6825","nonce":553393719}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":44299,"name":"cephfs.smithi133.ubglfw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6827/2979200029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2979200029},{"type":"v1","addr":"172.21.15.133:6827","nonce":2979200029}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:24:05.029669+0000","modified":"2024-02-15T18:32:59.529568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34338,"mds_1":34342},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34338":{"gid":34338,"name":"cephfs.smithi084.cuytny","rank":0,"incarnation":33,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6827/1471876270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1471876270},{"type":"v1","addr":"172.21.15.84:6827","nonce":1471876270}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34342":{"gid":34342,"name":"cephfs.smithi084.spootv","rank":1,"incarnation":37,"state":"up:starting","state_seq":1,"addr":"172.21.15.84:6829/2925871822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":2925871822},{"type":"v1","addr":"172.21.15.84:6829","nonce":2925871822}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:36:15.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.435+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd974060f20 msgr2=0x7fd9740633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.435+0000 7fd99285d700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd974060f20 0x7fd9740633e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fd980009f50 tx=0x7fd980009b30).stop 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.435+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f6490 msgr2=0x7fd98c106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.435+0000 7fd99285d700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f6490 0x7fd98c106d20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd97c00c510 tx=0x7fd97c007df0).stop 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.435+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 shutdown_connections 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.435+0000 7fd99285d700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:6800/2731357152,v1:172.21.15.84:6801/2731357152] conn(0x7fd974060f20 0x7fd9740633e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.435+0000 7fd99285d700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98c0f6490 0x7fd98c106d20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.435+0000 7fd99285d700 1 --2- 172.21.15.84:0/2156708150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd98c0f7730 0x7fd98c107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.435+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 >> 172.21.15.84:0/2156708150 conn(0x7fd98c0f1bd0 msgr2=0x7fd98c0fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.436+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 shutdown_connections 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-02-15T18:36:15.436+0000 7fd99285d700 1 -- 172.21.15.84:0/2156708150 wait complete. 2024-02-15T18:36:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 37 2024-02-15T18:36:15.438 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-15T18:36:15.449 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-15T18:36:15.449 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-15T18:36:15.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-15T18:36:15.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-15T18:36:15.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:36:15.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:36:15.491 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-15T18:36:15.579 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-15T18:36:15.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-15T18:36:15.579 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-15T18:36:15.635 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T18:36:15.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:36:15.635 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-15T18:36:15.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:36:15.684 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-02-15T18:36:15.703 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-15T18:36:15.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:36:15.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-15T18:36:15.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cephadm 2024-02-15T18:36:13.935847+0000 mgr.smithi084.hjmnez (mgr.14596) 467 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:15.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:14.745916+0000 mon.smithi084 (mon.0) 833 : audit [DBG] from='client.? 172.21.15.84:0/1971714507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-15T18:36:15.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:15.088546+0000 mon.smithi084 (mon.0) 834 : audit [DBG] from='client.? 172.21.15.84:0/888764903' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-15T18:36:15.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:15 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: audit 2024-02-15T18:36:15.434247+0000 mon.smithi084 (mon.0) 835 : audit [DBG] from='client.? 172.21.15.84:0/2156708150' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-15T18:36:15.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:36:15.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-02-15T18:36:15.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cephadm 2024-02-15T18:36:13.935847+0000 mgr.smithi084.hjmnez (mgr.14596) 467 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:15.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:14.745916+0000 mon.smithi084 (mon.0) 833 : audit [DBG] from='client.? 172.21.15.84:0/1971714507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-15T18:36:15.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:15.088546+0000 mon.smithi084 (mon.0) 834 : audit [DBG] from='client.? 172.21.15.84:0/888764903' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-15T18:36:15.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:15 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: audit 2024-02-15T18:36:15.434247+0000 mon.smithi084 (mon.0) 835 : audit [DBG] from='client.? 172.21.15.84:0/2156708150' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-15T18:36:15.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:36:15.893 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-02-15T18:36:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-15T18:36:15.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:36:15.915 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-15T18:36:16.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:36:16.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-02-15T18:36:16.089 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-15T18:36:16.100 INFO:tasks.cephadm:Teardown begin 2024-02-15T18:36:16.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:36:16.129 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:36:16.160 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-15T18:36:16.161 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-15T18:36:16.187 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-15T18:36:16.219 INFO:tasks.cephadm:Stopping all daemons... 2024-02-15T18:36:16.219 INFO:tasks.cephadm.mon.smithi084:Stopping mon.smithi084... 2024-02-15T18:36:16.219 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084 2024-02-15T18:36:16.499 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:16 smithi084 systemd[1]: Stopping Ceph mon.smithi084 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:36:16.500 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:16 smithi084 bash[99408]: Error: no container with name or ID "ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi084" found: no such container 2024-02-15T18:36:16.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: cluster 2024-02-15T18:36:14.818904+0000 mgr.smithi084.hjmnez (mgr.14596) 468 : cluster [DBG] pgmap v327: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:16.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:36:16.580+0000 7f8e3b673700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi084 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:36:16.754 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:16 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084[77480]: debug 2024-02-15T18:36:16.580+0000 7f8e3b673700 -1 mon.smithi084@0(leader) e2 *** Got Signal Terminated *** 2024-02-15T18:36:16.887 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:16 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: cluster 2024-02-15T18:36:14.818904+0000 mgr.smithi084.hjmnez (mgr.14596) 468 : cluster [DBG] pgmap v327: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:17.254 INFO:journalctl@ceph.mon.smithi084.smithi084.stdout:Feb 15 18:36:16 smithi084 bash[99447]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi084 2024-02-15T18:36:17.375 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi084.service' 2024-02-15T18:36:17.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:36:17.419 INFO:tasks.cephadm.mon.smithi084:Stopped mon.smithi084 2024-02-15T18:36:17.419 INFO:tasks.cephadm.mon.smithi133:Stopping mon.smithi133... 2024-02-15T18:36:17.419 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi133 2024-02-15T18:36:17.748 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:17 smithi133 systemd[1]: Stopping Ceph mon.smithi133 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:36:17.748 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:17 smithi133 bash[70671]: Error: no container with name or ID "ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon.smithi133" found: no such container 2024-02-15T18:36:18.075 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:36:17.756+0000 7f6d52e03700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi133 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:36:18.076 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:17 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133[59601]: debug 2024-02-15T18:36:17.756+0000 7f6d52e03700 -1 mon.smithi133@1(peon) e2 *** Got Signal Terminated *** 2024-02-15T18:36:18.386 INFO:journalctl@ceph.mon.smithi133.smithi133.stdout:Feb 15 18:36:18 smithi133 bash[70711]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-mon-smithi133 2024-02-15T18:36:18.561 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@mon.smithi133.service' 2024-02-15T18:36:18.610 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:36:18.611 INFO:tasks.cephadm.mon.smithi133:Stopped mon.smithi133 2024-02-15T18:36:18.611 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-15T18:36:18.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.0 2024-02-15T18:36:18.932 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:36:18 smithi084 systemd[1]: Stopping Ceph osd.0 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:36:18.932 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:36:18 smithi084 bash[99577]: Error: no container with name or ID "ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.0" found: no such container 2024-02-15T18:36:19.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:36:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-0[80703]: debug 2024-02-15T18:36:18.942+0000 7fc854b16700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:36:19.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:36:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-0[80703]: debug 2024-02-15T18:36:18.942+0000 7fc854b16700 -1 osd.0 82 *** Got signal Terminated *** 2024-02-15T18:36:19.254 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:36:18 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-0[80703]: debug 2024-02-15T18:36:18.942+0000 7fc854b16700 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:36:24.754 INFO:journalctl@ceph.osd.0.smithi084.stdout:Feb 15 18:36:24 smithi084 bash[99618]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-0 2024-02-15T18:36:26.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.0.service' 2024-02-15T18:36:26.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:36:26.284 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-15T18:36:26.284 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-15T18:36:26.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.1 2024-02-15T18:36:26.504 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:36:26 smithi084 systemd[1]: Stopping Ceph osd.1 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:36:26.504 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:36:26 smithi084 bash[99859]: Error: no container with name or ID "ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.1" found: no such container 2024-02-15T18:36:27.004 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:36:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-1[83547]: debug 2024-02-15T18:36:26.652+0000 7fde24c92700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:36:27.004 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:36:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-1[83547]: debug 2024-02-15T18:36:26.652+0000 7fde24c92700 -1 osd.1 82 *** Got signal Terminated *** 2024-02-15T18:36:27.004 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:36:26 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-1[83547]: debug 2024-02-15T18:36:26.652+0000 7fde24c92700 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:36:32.255 INFO:journalctl@ceph.osd.1.smithi084.stdout:Feb 15 18:36:32 smithi084 bash[99901]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-1 2024-02-15T18:36:33.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.1.service' 2024-02-15T18:36:33.945 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:36:33.945 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-15T18:36:33.945 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-15T18:36:33.946 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.2 2024-02-15T18:36:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:36:34 smithi084 systemd[1]: Stopping Ceph osd.2 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:36:34.254 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:36:34 smithi084 bash[100136]: Error: no container with name or ID "ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.2" found: no such container 2024-02-15T18:36:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:36:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-2[86222]: debug 2024-02-15T18:36:34.275+0000 7fa9ea680700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:36:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:36:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-2[86222]: debug 2024-02-15T18:36:34.275+0000 7fa9ea680700 -1 osd.2 82 *** Got signal Terminated *** 2024-02-15T18:36:34.755 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:36:34 smithi084 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-2[86222]: debug 2024-02-15T18:36:34.275+0000 7fa9ea680700 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:36:40.004 INFO:journalctl@ceph.osd.2.smithi084.stdout:Feb 15 18:36:39 smithi084 bash[100176]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-2 2024-02-15T18:36:41.413 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.2.service' 2024-02-15T18:36:41.455 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:36:41.456 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-15T18:36:41.456 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-15T18:36:41.456 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.3 2024-02-15T18:36:41.749 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:36:41 smithi133 systemd[1]: Stopping Ceph osd.3 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:36:41.749 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:36:41 smithi133 bash[70841]: Error: no container with name or ID "ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.3" found: no such container 2024-02-15T18:36:42.136 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:36:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:36:41.758+0000 7fa4fa8fb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:36:42.136 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:36:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:36:41.758+0000 7fa4fa8fb700 -1 osd.3 82 *** Got signal Terminated *** 2024-02-15T18:36:42.137 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:36:41 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:36:41.758+0000 7fa4fa8fb700 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:36:44.636 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:36:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:36:44.313+0000 7fa4f3870700 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:23.484984+0000 front 2024-02-15T18:36:23.485008+0000 (oldest deadline 2024-02-15T18:36:43.985067+0000) 2024-02-15T18:36:45.295 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:44 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:44.984+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:45.636 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:36:45 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:36:45.305+0000 7fa4f3870700 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:23.484984+0000 front 2024-02-15T18:36:23.485008+0000 (oldest deadline 2024-02-15T18:36:43.985067+0000) 2024-02-15T18:36:46.386 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:36:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3[62016]: debug 2024-02-15T18:36:46.269+0000 7fa4f3870700 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:23.484984+0000 front 2024-02-15T18:36:23.485008+0000 (oldest deadline 2024-02-15T18:36:43.985067+0000) 2024-02-15T18:36:46.387 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:46.027+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:46.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:46 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:46.163+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:47.387 INFO:journalctl@ceph.osd.3.smithi133.stdout:Feb 15 18:36:47 smithi133 bash[70882]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-3 2024-02-15T18:36:47.387 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:47.019+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:47.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:47 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:47.166+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:48.386 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:48.028+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:48.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:48 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:48.146+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:49.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.3.service' 2024-02-15T18:36:49.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:36:49.138 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-15T18:36:49.138 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-15T18:36:49.139 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.4 2024-02-15T18:36:49.386 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:49.045+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:49.387 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:49 smithi133 systemd[1]: Stopping Ceph osd.4 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:36:49.387 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:49 smithi133 bash[71123]: Error: no container with name or ID "ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.4" found: no such container 2024-02-15T18:36:49.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:49.163+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:49.886 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:49.486+0000 7f3a1dee7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:36:49.887 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:49.486+0000 7f3a1dee7700 -1 osd.4 82 *** Got signal Terminated *** 2024-02-15T18:36:49.887 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:49 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:49.486+0000 7f3a1dee7700 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:36:50.386 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:50.038+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:50.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:50 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:50.175+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:51.386 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:51.030+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:51.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:51.184+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:52.386 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:51 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:51.988+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:52.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:52.217+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:52.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:52 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:52.217+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:36:53.248 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:53.002+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:53.637 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:53.258+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:53.637 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:53.258+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:36:54.244 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:53.979+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:21.700082+0000 front 2024-02-15T18:36:21.699994+0000 (oldest deadline 2024-02-15T18:36:43.999906+0000) 2024-02-15T18:36:54.244 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:53 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4[64301]: debug 2024-02-15T18:36:53.979+0000 7f3a16e5c700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.001296+0000 front 2024-02-15T18:36:31.001301+0000 (oldest deadline 2024-02-15T18:36:53.901316+0000) 2024-02-15T18:36:54.637 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:54.254+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:54.637 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:54 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:54.254+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:36:55.136 INFO:journalctl@ceph.osd.4.smithi133.stdout:Feb 15 18:36:54 smithi133 bash[71162]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-4 2024-02-15T18:36:55.551 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:55.218+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:55.551 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:55 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:55.218+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:36:56.553 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:56.258+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:56.554 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:56.258+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:36:56.560 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.4.service' 2024-02-15T18:36:56.603 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:36:56.603 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-15T18:36:56.603 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-15T18:36:56.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.5 2024-02-15T18:36:56.886 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:56 smithi133 systemd[1]: Stopping Ceph osd.5 for 631a4cdc-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:36:56.887 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:56 smithi133 bash[71397]: Error: no container with name or ID "ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd.5" found: no such container 2024-02-15T18:36:57.386 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:56.970+0000 7f99b7a1e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:36:57.386 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:56.970+0000 7f99b7a1e700 -1 osd.5 82 *** Got signal Terminated *** 2024-02-15T18:36:57.386 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:56 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:56.970+0000 7f99b7a1e700 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:36:57.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:57.214+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:57.387 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:57 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:57.214+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:36:58.636 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:58.220+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:58.636 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:58 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:58.220+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:36:59.636 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:59.226+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:36:59.636 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:36:59 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:36:59.226+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:37:00.636 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:37:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:37:00.272+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:37:00.636 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:37:00 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:37:00.272+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:37:01.636 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:37:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:37:01.320+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-02-15T18:36:19.380590+0000 front 2024-02-15T18:36:19.380571+0000 (oldest deadline 2024-02-15T18:36:45.280523+0000) 2024-02-15T18:37:01.636 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:37:01 smithi133 ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5[66506]: debug 2024-02-15T18:37:01.320+0000 7f99b0993700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.84:6814 osd.1 since back 2024-02-15T18:36:31.081857+0000 front 2024-02-15T18:36:31.081785+0000 (oldest deadline 2024-02-15T18:36:52.181525+0000) 2024-02-15T18:37:02.637 INFO:journalctl@ceph.osd.5.smithi133.stdout:Feb 15 18:37:02 smithi133 bash[71437]: ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715-osd-5 2024-02-15T18:37:04.079 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-631a4cdc-cc2e-11ee-95ba-87774f69a715@osd.5.service' 2024-02-15T18:37:04.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:37:04.120 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-15T18:37:04.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-15T18:37:25.806 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-15T18:37:37.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:37:37.910 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:37:37.940 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-15T18:37:37.942 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660/remote/ubuntu@smithi084.front.sepia.ceph.com/crash 2024-02-15T18:37:37.943 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/crash -- . 2024-02-15T18:37:37.980 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-15T18:37:37.980 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2024-02-15T18:37:37.982 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660/remote/ubuntu@smithi133.front.sepia.ceph.com/crash 2024-02-15T18:37:37.983 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/crash -- . 2024-02-15T18:37:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:tar: /var/lib/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-15T18:37:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:tar: Error is not recoverable: exiting now 2024-02-15T18:37:38.011 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-15T18:37:38.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v 'Degraded data redundancy' | egrep -v '\(PG_' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T18:37:38.056 INFO:teuthology.orchestra.run.smithi084.stdout:2024-02-15T18:24:12.690103+0000 mon.smithi084 (mon.0) 507 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T18:37:38.056 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-15T18:37:38.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[SEC\]' /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v 'Degraded data redundancy' | egrep -v '\(PG_' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T18:37:38.131 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]' /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v 'Degraded data redundancy' | egrep -v '\(PG_' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T18:37:38.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[WRN\]' /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v 'Degraded data redundancy' | egrep -v '\(PG_' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T18:37:38.274 INFO:teuthology.orchestra.run.smithi084.stdout:2024-02-15T18:24:12.690103+0000 mon.smithi084 (mon.0) 507 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T18:37:38.274 INFO:tasks.cephadm:Compressing logs... 2024-02-15T18:37:38.274 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T18:37:38.316 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T18:37:38.340 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-15T18:37:38.341 INFO:teuthology.orchestra.run.smithi084.stderr:: No such file or directory 2024-02-15T18:37:38.341 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-15T18:37:38.342 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.2.log 2024-02-15T18:37:38.342 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi084.cuytny.log 2024-02-15T18:37:38.342 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-volume.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-15T18:37:38.342 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-15T18:37:38.343 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi084.cuytny.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-15T18:37:38.343 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi084.spootv.log 2024-02-15T18:37:38.343 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi084.hjmnez.log 2024-02-15T18:37:38.343 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi084.spootv.log: 86.7% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-15T18:37:38.345 INFO:teuthology.orchestra.run.smithi133.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-15T18:37:38.345 INFO:teuthology.orchestra.run.smithi133.stderr:: No such file or directory 2024-02-15T18:37:38.345 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-15T18:37:38.345 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-15T18:37:38.345 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-15T18:37:38.345 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-volume.log: /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi133.mkpnnx.log 2024-02-15T18:37:38.345 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.3.log 2024-02-15T18:37:38.346 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log: /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi133.mkpnnx.log: 87.0% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-15T18:37:38.347 INFO:teuthology.orchestra.run.smithi084.stderr: 91.2% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-15T18:37:38.347 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-15T18:37:38.347 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.0.log 2024-02-15T18:37:38.347 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi084.hjmnez.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi084.log 2024-02-15T18:37:38.347 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi133.ubglfw.log 2024-02-15T18:37:38.347 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi133.log 2024-02-15T18:37:38.347 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi133.ubglfw.log: /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi133.log: 91.4% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-15T18:37:38.348 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log 2024-02-15T18:37:38.348 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log: 89.5% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-15T18:37:38.350 INFO:teuthology.orchestra.run.smithi133.stderr: 90.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-15T18:37:38.350 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log 2024-02-15T18:37:38.351 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-15T18:37:38.351 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.4.log 2024-02-15T18:37:38.351 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.5.log 2024-02-15T18:37:38.352 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi084.log: /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log: 88.1% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-15T18:37:38.352 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.1.log 2024-02-15T18:37:38.355 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.1.log: 93.7% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi084.spootv.log.gz 2024-02-15T18:37:38.359 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi133.nxzroj.log 2024-02-15T18:37:38.387 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.5.log: /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi133.nxzroj.log: 89.4% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi133.nxzroj.log.gz 2024-02-15T18:37:38.557 INFO:teuthology.orchestra.run.smithi084.stderr: 90.8% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi084.hjmnez.log.gz 2024-02-15T18:37:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 92.7% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi133.log.gz 2024-02-15T18:37:38.986 INFO:teuthology.orchestra.run.smithi084.stderr: 90.7% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi084.log.gz 2024-02-15T18:37:42.001 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.2.log.gz 2024-02-15T18:37:42.021 INFO:teuthology.orchestra.run.smithi133.stderr: 93.3% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.4.log.gz 2024-02-15T18:37:42.453 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.0.log.gz 2024-02-15T18:37:42.989 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.1.log.gz 2024-02-15T18:37:43.413 INFO:teuthology.orchestra.run.smithi133.stderr: 93.5% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.3.log.gz 2024-02-15T18:37:43.612 INFO:teuthology.orchestra.run.smithi133.stderr: 95.2% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi133.ubglfw.log.gz 2024-02-15T18:37:44.237 INFO:teuthology.orchestra.run.smithi133.stderr: 93.6% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-osd.5.log.gz 2024-02-15T18:38:17.577 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi084.cuytny.log.gz 2024-02-15T18:38:17.579 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-02-15T18:38:17.579 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m39.248s 2024-02-15T18:38:17.579 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m50.638s 2024-02-15T18:38:17.579 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m1.826s 2024-02-15T18:38:19.622 INFO:teuthology.orchestra.run.smithi133.stderr: 93.3% -- replaced with /var/log/ceph/631a4cdc-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi133.mkpnnx.log.gz 2024-02-15T18:38:19.623 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-02-15T18:38:19.623 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m41.290s 2024-02-15T18:38:19.623 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m59.415s 2024-02-15T18:38:19.623 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m2.016s 2024-02-15T18:38:19.623 INFO:tasks.cephadm:Archiving logs... 2024-02-15T18:38:19.624 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660/remote/ubuntu@smithi084.front.sepia.ceph.com/log 2024-02-15T18:38:19.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T18:38:27.387 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660/remote/ubuntu@smithi133.front.sepia.ceph.com/log 2024-02-15T18:38:27.388 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T18:38:36.338 INFO:tasks.cephadm:Removing cluster... 2024-02-15T18:38:36.338 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 --force 2024-02-15T18:38:36.705 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 631a4cdc-cc2e-11ee-95ba-87774f69a715 --force 2024-02-15T18:38:37.089 INFO:tasks.cephadm:Removing cephadm ... 2024-02-15T18:38:37.089 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-15T18:38:37.109 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-15T18:38:37.126 INFO:tasks.cephadm:Teardown complete 2024-02-15T18:38:37.127 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-15T18:38:37.138 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-15T18:38:37.138 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T18:38:37.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T18:38:37.240 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-15T18:38:37.251 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-15T18:38:37.251 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T18:38:37.253 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T18:38:37.268 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2024-02-15T18:38:37.270 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2024-02-15T18:38:37.272 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T18:38:37.273 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-02-15T18:38:37.273 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 12 +1227us[+1234us] +/- 109ms 2024-02-15T18:38:37.273 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 +173us[ +179us] +/- 60ms 2024-02-15T18:38:37.273 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -876us[ -876us] +/- 67ms 2024-02-15T18:38:37.273 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:38:37.274 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T18:38:37.275 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-02-15T18:38:37.275 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +1203us[+1213us] +/- 109ms 2024-02-15T18:38:37.275 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 +172us[ +182us] +/- 60ms 2024-02-15T18:38:37.275 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -888us[ -878us] +/- 67ms 2024-02-15T18:38:37.275 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:38:37.275 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-15T18:38:37.321 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-15T18:38:37.322 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-15T18:38:37.437 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T18:38:37.503 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T18:38:37.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T18:38:37.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:38:37.594 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T18:38:37.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:38:37.623 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-15T18:38:37.635 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-15T18:38:37.784 INFO:teuthology.task.internal:Duration was 2249.117717 seconds 2024-02-15T18:38:37.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-15T18:38:37.898 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-15T18:38:37.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T18:38:37.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T18:38:37.945 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T18:38:37.947 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T18:38:38.398 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-15T18:38:38.398 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-02-15T18:38:38.398 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T18:38:38.422 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-02-15T18:38:38.422 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T18:38:38.445 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-15T18:38:38.445 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T18:38:38.465 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T18:38:38.542 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-15T18:38:38.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T18:38:38.545 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T18:38:38.670 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-15T18:38:38.681 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-15T18:38:38.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T18:38:38.708 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T18:38:38.735 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-15T18:38:38.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T18:38:38.752 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T18:38:38.776 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-02-15T18:38:38.801 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-02-15T18:38:38.814 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T18:38:38.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:38:38.846 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T18:38:38.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:38:38.871 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-15T18:38:38.883 INFO:teuthology.task.internal:Transferring archived files... 2024-02-15T18:38:38.884 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660/remote/smithi084 2024-02-15T18:38:38.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T18:38:38.930 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660/remote/smithi133 2024-02-15T18:38:38.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T18:38:38.973 INFO:teuthology.task.internal:Removing archive directory... 2024-02-15T18:38:38.973 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T18:38:38.975 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T18:38:39.024 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-15T18:38:39.037 INFO:teuthology.task.internal:Not uploading archives. 2024-02-15T18:38:39.037 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-15T18:38:39.129 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-15T18:38:39.130 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T18:38:39.132 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T18:38:39.147 INFO:teuthology.orchestra.run.smithi084.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 18:38 /home/ubuntu/cephtest 2024-02-15T18:38:39.149 INFO:teuthology.orchestra.run.smithi133.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 18:38 /home/ubuntu/cephtest 2024-02-15T18:38:39.151 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-15T18:38:39.206 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-15T18:38:39.262 INFO:teuthology.nuke:Checking targets against current locks 2024-02-15T18:38:39.288 DEBUG:teuthology.nuke:shortname: smithi084 2024-02-15T18:38:39.289 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T18:38:39.312 DEBUG:teuthology.nuke:shortname: smithi133 2024-02-15T18:38:39.313 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T18:38:39.316 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 17:52:18.261729', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZPgHaUoLtL8aDy5AByyeDx0k5ZIAoC1tf93FmE2SamUbpB3wb278hdHxbS4TWDGB627OiN7VApJOz6essezVA='} 2024-02-15T18:38:39.338 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 17:52:18.259829', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/0zTmiEH8TOSIkYV9BIk+QNwqG+O3IcutFNQ4xYzIssbN1fiQAeQ3QY2nJ/zNInxNUBPJLj60aqIdr4BLUDnQ='} 2024-02-15T18:38:39.364 INFO:teuthology.orchestra.console.smithi084:Power off 2024-02-15T18:38:39.364 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T18:38:39.388 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-02-15T18:38:39.388 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:38:39.403 INFO:teuthology.orchestra.console.smithi133:Power off 2024-02-15T18:38:39.404 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T18:38:39.413 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-02-15T18:38:39.425 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-02-15T18:38:39.425 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:38:39.447 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-15T18:38:43.414 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:38:43.448 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:38:43.524 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-02-15T18:38:43.557 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-15T18:38:47.525 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:38:47.558 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:38:47.635 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-02-15T18:38:47.667 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-02-15T18:38:47.737 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-02-15T18:38:51.671 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:38:51.782 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-02-15T18:38:51.882 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-02-15T18:38:51.987 INFO:teuthology.run:Summary data: description: rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} duration: 2249.1177167892456 failure_reason: '"2024-02-15T18:24:12.690103+0000 mon.smithi084 (mon.0) 507 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log' flavor: default owner: scheduled_lflores@teuthology success: false 2024-02-15T18:38:51.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T18:38:52.084 INFO:teuthology.run:FAIL